2024-03-28T05:09:45.092 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-28T05:09:45.092 DEBUG:teuthology.run:Teuthology command: teuthology --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305 --name mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} --verbose -- /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305/orig.config.yaml 2024-03-28T05:09:45.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T05:09:45.227 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305 branch: wip-mchangir-testing-main-20240318.032620 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} email: mchangir@redhat.com first_in_suite: false job_id: '7625305' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-main-20240318.032620 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - slow metadata IO - SLOW_OPS - slow request sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-main-20240318.032620 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 owner: mchangir priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3645 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 sleep_before_teardown: 0 subset: 132/256 suite: fs suite_branch: wip-mchangir-testing-main-20240318.032620 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPl+NSuukHgLKDffS5R3CZA4+DZmYhnUn3jJ3ztfuoahBwv8FYdc33lmNCD9pp/J6G+uH26uUzD7Prl3RhJXM60= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABgJKsK96iKfa4dJ0dZBinY045DLAitBZO6ChBRAUNd/DVZDin/ucTas5mIGZwljX3qBPh7uX5kgVBABMVs28s= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlFuT8O2m8LpDkynmg37+es/L00STDrt+KwpvqHuHNkOdniYRyNhYskVzlpdNgd2+ViGQ41/xSK08mWTMSQdBo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_03:45:23 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-28T05:09:45.228 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa; will attempt to use it 2024-03-28T05:09:45.228 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks 2024-03-28T05:09:45.228 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-28T05:09:45.230 INFO:teuthology.task.internal:Checking packages... 2024-03-28T05:09:45.252 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3be9a5c9bc793e11e2800a8c0c696e8b46742033' 2024-03-28T05:09:45.252 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-28T05:09:45.252 INFO:teuthology.packaging:ref: None 2024-03-28T05:09:45.252 INFO:teuthology.packaging:tag: None 2024-03-28T05:09:45.252 INFO:teuthology.packaging:branch: wip-mchangir-testing-main-20240318.032620 2024-03-28T05:09:45.252 INFO:teuthology.packaging:sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:09:45.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-main-20240318.032620 2024-03-28T05:09:45.471 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2145.g3be9a5c9 2024-03-28T05:09:45.472 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-28T05:09:45.480 INFO:teuthology.task.internal:no buildpackages task found 2024-03-28T05:09:45.480 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-28T05:09:45.501 INFO:teuthology.task.internal:Saving configuration 2024-03-28T05:09:45.519 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-28T05:09:45.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-28T05:09:45.550 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 05:04:21.295881', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPl+NSuukHgLKDffS5R3CZA4+DZmYhnUn3jJ3ztfuoahBwv8FYdc33lmNCD9pp/J6G+uH26uUzD7Prl3RhJXM60='} 2024-03-28T05:09:45.571 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 05:04:21.294684', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABgJKsK96iKfa4dJ0dZBinY045DLAitBZO6ChBRAUNd/DVZDin/ucTas5mIGZwljX3qBPh7uX5kgVBABMVs28s='} 2024-03-28T05:09:45.591 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-27_03:45:23-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7625305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 05:04:21.293303', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlFuT8O2m8LpDkynmg37+es/L00STDrt+KwpvqHuHNkOdniYRyNhYskVzlpdNgd2+ViGQ41/xSK08mWTMSQdBo='} 2024-03-28T05:09:45.591 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-28T05:09:45.598 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-28T05:09:45.598 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-28T05:09:45.598 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-28T05:09:45.598 INFO:teuthology.run_tasks:Running task console_log... 2024-03-28T05:09:45.688 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe7737fbf70>, signals=[15]) 2024-03-28T05:09:45.689 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-28T05:09:45.695 INFO:teuthology.task.internal:Opening connections... 2024-03-28T05:09:45.696 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-03-28T05:09:45.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:09:45.804 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-03-28T05:09:45.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:09:45.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-03-28T05:09:45.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:09:45.980 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-28T05:09:45.987 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-03-28T05:09:46.005 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-03-28T05:09:46.006 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-03-28T05:09:46.063 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-03-28T05:09:46.063 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T05:09:46.064 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T05:09:46.065 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-03-28T05:09:46.091 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-03-28T05:09:46.108 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-03-28T05:09:46.108 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-03-28T05:09:46.165 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T05:09:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T05:09:46.167 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-03-28T05:09:46.190 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-03-28T05:09:46.208 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-03-28T05:09:46.208 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-03-28T05:09:46.268 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-28T05:09:46.269 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-28T05:09:46.269 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-03-28T05:09:46.290 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-28T05:09:46.301 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-28T05:09:46.307 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-28T05:09:46.307 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-03-28T05:09:46.310 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-03-28T05:09:46.312 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-03-28T05:09:46.328 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-28T05:09:46.335 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-28T05:09:46.335 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-03-28T05:09:46.367 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-03-28T05:09:46.369 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-03-28T05:09:46.480 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-28T05:09:46.556 INFO:teuthology.run_tasks:Running task kernel... 2024-03-28T05:09:46.572 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-28T05:09:46.572 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-03-28T05:09:46.572 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T05:09:46.573 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T05:09:46.573 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T05:09:46.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:09:46.589 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T05:09:46.590 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-03-28T05:09:46.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:09:46.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:09:46.591 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.591 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T05:09:46.592 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-03-28T05:09:46.592 DEBUG:teuthology.task.kernel:sha1 for mon.c is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.592 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T05:09:46.592 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-03-28T05:09:46.647 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-361.el9.x86_64 2024-03-28T05:09:46.647 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.647 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T05:09:46.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.651 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-361.el9.x86_64 2024-03-28T05:09:46.651 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.651 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T05:09:46.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.655 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-361.el9.x86_64 2024-03-28T05:09:46.655 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.655 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T05:09:46.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:09:46.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum upgrade -y linux-firmware 2024-03-28T05:09:46.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum upgrade -y linux-firmware 2024-03-28T05:09:46.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum upgrade -y linux-firmware 2024-03-28T05:09:48.835 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-28T05:09:48.845 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-28T05:09:49.055 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-28T05:09:50.194 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-28T05:09:50.663 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2024-03-28T05:09:50.671 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2024-03-28T05:09:51.743 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-03-28T05:09:52.836 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-03-28T05:09:53.287 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.0 MB 00:02 2024-03-28T05:09:53.527 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-03-28T05:09:54.487 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 32 MB/s | 19 MB 00:00 2024-03-28T05:09:55.130 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-03-28T05:09:57.630 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.1 MB 00:00 2024-03-28T05:09:58.513 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-28T05:09:59.087 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-03-28T05:10:00.000 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.1 MB 00:01 2024-03-28T05:10:00.397 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-03-28T05:10:00.599 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-28T05:10:01.573 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-03-28T05:10:02.775 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-03-28T05:10:05.480 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-28T05:10:07.751 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 1 Package 2024-03-28T05:10:07.766 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:10:07.767 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 375 M 2024-03-28T05:10:07.767 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-03-28T05:10:07.958 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-28T05:10:10.312 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-03-28T05:10:10.330 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-03-28T05:10:10.331 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 1 Package 2024-03-28T05:10:10.331 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:10:10.331 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 375 M 2024-03-28T05:10:10.331 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-03-28T05:10:19.201 INFO:teuthology.orchestra.run.smithi055.stdout:linux-firmware-20240219-143.el9.noarch.rpm 42 MB/s | 375 MB 00:08 2024-03-28T05:10:19.202 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:10:19.202 INFO:teuthology.orchestra.run.smithi055.stdout:Total 42 MB/s | 375 MB 00:08 2024-03-28T05:10:19.203 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-03-28T05:10:19.288 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-03-28T05:10:19.288 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-03-28T05:10:21.789 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-03-28T05:10:21.789 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-03-28T05:10:22.039 INFO:teuthology.orchestra.run.smithi086.stdout:linux-firmware-20240219-143.el9.noarch.rpm 26 MB/s | 375 MB 00:14 2024-03-28T05:10:22.040 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:10:22.040 INFO:teuthology.orchestra.run.smithi086.stdout:Total 26 MB/s | 375 MB 00:14 2024-03-28T05:10:22.041 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-03-28T05:10:22.129 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-03-28T05:10:22.129 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-03-28T05:10:24.509 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-03-28T05:10:24.509 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-03-28T05:10:28.390 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-03-28T05:10:28.625 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:10:28.712 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:30.095 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:30.095 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:10:30.491 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-03-28T05:10:30.763 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-03-28T05:10:30.782 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-28T05:10:30.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:10:30.927 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-28T05:10:30.927 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-28T05:10:30.930 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi055.front.sepia.ceph.com to complete... 2024-03-28T05:10:30.982 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:10:31.080 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:32.301 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:32.301 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:10:32.682 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-03-28T05:10:32.984 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-28T05:10:32.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:10:33.214 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-28T05:10:33.214 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-28T05:10:33.217 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi086.front.sepia.ceph.com to complete... 2024-03-28T05:10:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28 05:10:49 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-28T05:10:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:FINISHED --2024-03-28 05:10:49-- 2024-03-28T05:10:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:Total wall clock time: 19s 2024-03-28T05:10:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:Downloaded: 1 files, 321M in 18s (17.5 MB/s) 2024-03-28T05:10:49.651 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-28T05:10:49.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-28T05:10:51.679 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying... ######################################## 2024-03-28T05:10:51.740 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing... ######################################## 2024-03-28T05:10:51.824 INFO:teuthology.orchestra.run.smithi055.stdout:Updating / installing... 2024-03-28T05:10:59.116 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28 05:10:59 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-28T05:10:59.117 INFO:teuthology.orchestra.run.smithi086.stderr:FINISHED --2024-03-28 05:10:59-- 2024-03-28T05:10:59.117 INFO:teuthology.orchestra.run.smithi086.stderr:Total wall clock time: 26s 2024-03-28T05:10:59.117 INFO:teuthology.orchestra.run.smithi086.stderr:Downloaded: 1 files, 321M in 25s (12.7 MB/s) 2024-03-28T05:10:59.120 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-28T05:10:59.121 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-28T05:10:59.651 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-28T05:11:01.046 INFO:teuthology.orchestra.run.smithi086.stdout:Verifying... ######################################## 2024-03-28T05:11:01.100 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing... ######################################## 2024-03-28T05:11:01.180 INFO:teuthology.orchestra.run.smithi086.stdout:Updating / installing... 2024-03-28T05:11:08.829 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-28T05:11:15.989 INFO:teuthology.orchestra.run.smithi055.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-28T05:11:23.810 INFO:teuthology.orchestra.run.smithi086.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-28T05:11:39.198 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-28T05:11:39.199 DEBUG:teuthology.orchestra.run.smithi055:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-28T05:11:39.269 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T05:11:39.270 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-28T05:11:39.271 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T05:11:39.272 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T05:11:39.273 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T05:11:39.274 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T05:11:39.275 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T05:11:39.276 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T05:11:39.277 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T05:11:39.278 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T05:11:39.279 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T05:11:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-28T05:11:39.281 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T05:11:39.282 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T05:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-28T05:11:39.284 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-28T05:11:39.285 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T05:11:39.286 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-28T05:11:39.287 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T05:11:39.288 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T05:11:39.289 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T05:11:39.290 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T05:11:39.291 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T05:11:39.292 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T05:11:39.293 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T05:11:39.294 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T05:11:39.295 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T05:11:39.296 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T05:11:39.297 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T05:11:39.298 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T05:11:39.299 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-28T05:11:39.300 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T05:11:39.301 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T05:11:39.302 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-28T05:11:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T05:11:39.304 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-28T05:11:39.305 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T05:11:39.306 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T05:11:39.307 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T05:11:39.308 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T05:11:39.309 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T05:11:39.310 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-28T05:11:39.311 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T05:11:39.312 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-28T05:11:39.313 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T05:11:39.314 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-28T05:11:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T05:11:39.316 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T05:11:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-28T05:11:39.318 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-28T05:11:39.319 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-28T05:11:39.320 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-28T05:11:39.321 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T05:11:39.322 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T05:11:39.323 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T05:11:39.324 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T05:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T05:11:39.326 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-28T05:11:39.327 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T05:11:39.328 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T05:11:39.329 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T05:11:39.330 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T05:11:39.331 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T05:11:39.332 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T05:11:39.333 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T05:11:39.334 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T05:11:39.335 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T05:11:39.336 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T05:11:39.337 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T05:11:39.338 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-28T05:11:39.339 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T05:11:39.340 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T05:11:39.341 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T05:11:39.342 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-28T05:11:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T05:11:39.344 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T05:11:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T05:11:39.346 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-28T05:11:39.347 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T05:11:39.348 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-28T05:11:39.349 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T05:11:39.350 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T05:11:39.351 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T05:11:39.352 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T05:11:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-28T05:11:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-28T05:11:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T05:11:39.356 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-28T05:11:39.357 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T05:11:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T05:11:39.359 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T05:11:39.360 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T05:11:39.361 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-28T05:11:39.362 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-28T05:11:39.363 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-28T05:11:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T05:11:39.365 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T05:11:39.366 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T05:11:39.367 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T05:11:39.368 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T05:11:39.369 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T05:11:39.370 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T05:11:39.371 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T05:11:39.372 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T05:11:39.373 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T05:11:39.374 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T05:11:39.375 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T05:11:39.376 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T05:11:39.377 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T05:11:39.378 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T05:11:39.379 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T05:11:39.380 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T05:11:39.381 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T05:11:39.382 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T05:11:39.383 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T05:11:39.384 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T05:11:39.385 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-28T05:11:39.386 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T05:11:39.387 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T05:11:39.388 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T05:11:39.389 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T05:11:39.390 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-28T05:11:39.391 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T05:11:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T05:11:39.393 INFO:teuthology.orchestra.run.smithi055.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:11:39.396 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T05:11:39.396 DEBUG:teuthology.orchestra.run.smithi055:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-28T05:11:39.419 INFO:teuthology.orchestra.run.smithi055.stdout:postinstall scriptlet (using /bin/sh): 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:for file in vmlinuz System.map config; do 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout: fi 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:done 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-28T05:11:39.420 INFO:teuthology.orchestra.run.smithi055.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-28T05:11:39.421 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-28T05:11:39.421 INFO:teuthology.orchestra.run.smithi055.stdout:fi 2024-03-28T05:11:39.421 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -qi grub2-tools 2024-03-28T05:11:39.501 INFO:teuthology.orchestra.run.smithi055.stdout:Name : grub2-tools 2024-03-28T05:11:39.501 INFO:teuthology.orchestra.run.smithi055.stdout:Epoch : 1 2024-03-28T05:11:39.501 INFO:teuthology.orchestra.run.smithi055.stdout:Version : 2.06 2024-03-28T05:11:39.501 INFO:teuthology.orchestra.run.smithi055.stdout:Release : 68.el9 2024-03-28T05:11:39.501 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: x86_64 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Group : Unspecified 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Size : 8264254 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:License : GPLv3+ 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Packager : builder@centos.org 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Vendor : CentOS 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Summary : Support tools for GRUB. 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:Description : 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:11:39.502 INFO:teuthology.orchestra.run.smithi055.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-28T05:11:39.503 INFO:teuthology.orchestra.run.smithi055.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-28T05:11:39.503 INFO:teuthology.orchestra.run.smithi055.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-28T05:11:39.503 INFO:teuthology.orchestra.run.smithi055.stdout:hardware devices. 2024-03-28T05:11:39.503 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:11:39.503 INFO:teuthology.orchestra.run.smithi055.stdout:This subpackage provides tools for support of all platforms. 2024-03-28T05:11:39.504 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-28T05:11:39.504 INFO:teuthology.task.kernel:Updating grub on smithi055 to boot 6.8.0-g1df0c7e8a235 2024-03-28T05:11:39.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-28T05:11:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-03-28T05:11:41.544 INFO:teuthology.orchestra.run.smithi055.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-28T05:11:41.583 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-03-28T05:11:41.585 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-03-28T05:11:41.601 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.eRksWHQSCx 2024-03-28T05:11:41.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eRksWHQSCx 2024-03-28T05:11:41.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.eRksWHQSCx 2024-03-28T05:11:41.820 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.eRksWHQSCx is 6KB 2024-03-28T05:11:41.870 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.eRksWHQSCx 2024-03-28T05:11:41.885 DEBUG:teuthology.orchestra.run.smithi055:> sudo /bin/ls /boot/loader/entries || true 2024-03-28T05:11:41.955 INFO:teuthology.orchestra.run.smithi055.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-28T05:11:41.955 INFO:teuthology.orchestra.run.smithi055.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-28T05:11:41.955 INFO:teuthology.orchestra.run.smithi055.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-28T05:11:41.955 INFO:teuthology.orchestra.run.smithi055.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-28T05:11:41.956 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-28T05:11:42.103 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2024-03-28T05:11:46.281 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-28T05:11:46.281 DEBUG:teuthology.orchestra.run.smithi086:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-28T05:11:46.350 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T05:11:46.351 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T05:11:46.352 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T05:11:46.353 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T05:11:46.354 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T05:11:46.355 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-28T05:11:46.356 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T05:11:46.357 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T05:11:46.358 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T05:11:46.359 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T05:11:46.360 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T05:11:46.361 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T05:11:46.362 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-28T05:11:46.363 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T05:11:46.364 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-28T05:11:46.365 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T05:11:46.366 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T05:11:46.367 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T05:11:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T05:11:46.369 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T05:11:46.370 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T05:11:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T05:11:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T05:11:46.373 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T05:11:46.374 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T05:11:46.375 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T05:11:46.376 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T05:11:46.377 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T05:11:46.378 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T05:11:46.379 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T05:11:46.380 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T05:11:46.381 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T05:11:46.382 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-28T05:11:46.383 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-28T05:11:46.384 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-28T05:11:46.385 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T05:11:46.386 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T05:11:46.387 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T05:11:46.388 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-28T05:11:46.389 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T05:11:46.390 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T05:11:46.391 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T05:11:46.392 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T05:11:46.393 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-28T05:11:46.394 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T05:11:46.395 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T05:11:46.396 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T05:11:46.397 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-28T05:11:46.398 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T05:11:46.399 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T05:11:46.400 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T05:11:46.401 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T05:11:46.402 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T05:11:46.403 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-28T05:11:46.404 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T05:11:46.405 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T05:11:46.406 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T05:11:46.407 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T05:11:46.408 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-28T05:11:46.409 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T05:11:46.410 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T05:11:46.411 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T05:11:46.412 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T05:11:46.413 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-28T05:11:46.414 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-28T05:11:46.415 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-28T05:11:46.416 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-28T05:11:46.417 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T05:11:46.418 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T05:11:46.419 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T05:11:46.421 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-28T05:11:46.422 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-28T05:11:46.423 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T05:11:46.424 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T05:11:46.425 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T05:11:46.426 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T05:11:46.427 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-28T05:11:46.428 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T05:11:46.429 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T05:11:46.430 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T05:11:46.431 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T05:11:46.432 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T05:11:46.433 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-28T05:11:46.434 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-28T05:11:46.435 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T05:11:46.436 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T05:11:46.437 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T05:11:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-28T05:11:46.439 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T05:11:46.440 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T05:11:46.441 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T05:11:46.442 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T05:11:46.443 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T05:11:46.444 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-28T05:11:46.445 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-28T05:11:46.446 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-28T05:11:46.447 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T05:11:46.448 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T05:11:46.449 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-28T05:11:46.450 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T05:11:46.451 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T05:11:46.452 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T05:11:46.453 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T05:11:46.454 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T05:11:46.455 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T05:11:46.456 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-28T05:11:46.457 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T05:11:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T05:11:46.459 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T05:11:46.460 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T05:11:46.461 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T05:11:46.462 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T05:11:46.463 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T05:11:46.464 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T05:11:46.465 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T05:11:46.466 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T05:11:46.467 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T05:11:46.468 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T05:11:46.469 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-28T05:11:46.470 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T05:11:46.471 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T05:11:46.472 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T05:11:46.473 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T05:11:46.474 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T05:11:46.475 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T05:11:46.476 INFO:teuthology.orchestra.run.smithi086.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:11:46.479 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T05:11:46.480 DEBUG:teuthology.orchestra.run.smithi086:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout:postinstall scriptlet (using /bin/sh): 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout:for file in vmlinuz System.map config; do 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout: fi 2024-03-28T05:11:46.501 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-28T05:11:46.502 INFO:teuthology.orchestra.run.smithi086.stdout:fi 2024-03-28T05:11:46.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-03-28T05:11:46.585 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-03-28T05:11:46.585 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-03-28T05:11:46.585 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-03-28T05:11:46.585 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 68.el9 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8264254 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-03-28T05:11:46.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:11:46.587 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-03-28T05:11:46.587 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-28T05:11:46.588 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 6.8.0-g1df0c7e8a235 2024-03-28T05:11:46.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-28T05:11:47.202 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-03-28T05:11:48.604 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-28T05:11:48.667 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-03-28T05:11:48.669 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-03-28T05:11:48.684 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.Ph4pwVVg7T 2024-03-28T05:11:48.685 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ph4pwVVg7T 2024-03-28T05:11:48.760 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.Ph4pwVVg7T 2024-03-28T05:11:48.908 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.Ph4pwVVg7T is 6KB 2024-03-28T05:11:48.956 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.Ph4pwVVg7T 2024-03-28T05:11:48.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-03-28T05:11:49.036 INFO:teuthology.orchestra.run.smithi086.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-28T05:11:49.036 INFO:teuthology.orchestra.run.smithi086.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-28T05:11:49.036 INFO:teuthology.orchestra.run.smithi086.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-28T05:11:49.036 INFO:teuthology.orchestra.run.smithi086.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-28T05:11:49.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-28T05:11:49.189 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-03-28T05:12:12.106 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-28T05:12:12.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:12:12.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:12:19.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-28T05:12:19.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:12:19.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:12:30.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-03-28T05:12:37.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-28T05:12:39.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:12:39.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:12:46.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:12:46.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:12:49.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-03-28T05:13:01.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:13:01.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:13:39.505 DEBUG:teuthology.orchestra.remote:timed out 2024-03-28T05:13:51.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:13:51.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:13:51.985 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-03-28T05:13:52.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:13:52.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-03-28T05:13:52.646 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-03-28T05:13:52.697 INFO:teuthology.orchestra.run.smithi055.stdout:6.8.0-g1df0c7e8a235 2024-03-28T05:13:52.698 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T05:13:52.698 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T05:13:52.698 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-28T05:13:53.698 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-28T05:13:53.699 DEBUG:teuthology.orchestra.run.smithi055:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-28T05:13:53.850 INFO:teuthology.orchestra.run.smithi055.stdout:ttyS1 2024-03-28T05:13:53.923 DEBUG:teuthology.parallel:result is None 2024-03-28T05:14:01.731 DEBUG:teuthology.orchestra.remote:timed out 2024-03-28T05:14:16.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:14:16.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:14:17.216 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-03-28T05:14:17.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:14:17.945 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-03-28T05:14:17.945 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-03-28T05:14:17.999 INFO:teuthology.orchestra.run.smithi086.stdout:6.8.0-g1df0c7e8a235 2024-03-28T05:14:18.000 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T05:14:18.000 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T05:14:18.000 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-28T05:14:19.000 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-28T05:14:19.000 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-28T05:14:19.153 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-03-28T05:14:19.200 DEBUG:teuthology.parallel:result is None 2024-03-28T05:19:12.453 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 38 kB/s | 21 MB 09:11 2024-03-28T05:19:17.378 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-03-28T05:19:19.647 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-28T05:19:19.661 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 1 Package 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 375 M 2024-03-28T05:19:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-03-28T05:19:28.182 INFO:teuthology.orchestra.run.smithi159.stdout:linux-firmware-20240219-143.el9.noarch.rpm 44 MB/s | 375 MB 00:08 2024-03-28T05:19:28.182 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:19:28.182 INFO:teuthology.orchestra.run.smithi159.stdout:Total 44 MB/s | 375 MB 00:08 2024-03-28T05:19:28.182 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-03-28T05:19:28.276 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-03-28T05:19:28.276 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-03-28T05:19:30.663 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-03-28T05:19:30.664 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-03-28T05:19:37.052 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-03-28T05:19:37.289 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:19:37.379 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:19:38.560 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:19:38.560 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-28T05:19:38.952 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-28T05:19:38.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:19:38.953 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-03-28T05:19:38.953 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-28T05:19:38.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:19:38.953 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-03-28T05:19:39.233 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.c... 2024-03-28T05:19:39.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T05:19:39.467 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-28T05:19:39.467 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-28T05:19:39.470 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi159.front.sepia.ceph.com to complete... 2024-03-28T05:19:51.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28 05:19:51 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-28T05:19:51.065 INFO:teuthology.orchestra.run.smithi159.stderr:FINISHED --2024-03-28 05:19:51-- 2024-03-28T05:19:51.065 INFO:teuthology.orchestra.run.smithi159.stderr:Total wall clock time: 12s 2024-03-28T05:19:51.065 INFO:teuthology.orchestra.run.smithi159.stderr:Downloaded: 1 files, 321M in 11s (28.4 MB/s) 2024-03-28T05:19:51.068 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.c... 2024-03-28T05:19:51.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-28T05:19:53.009 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying... ######################################## 2024-03-28T05:19:53.084 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing... ######################################## 2024-03-28T05:19:53.163 INFO:teuthology.orchestra.run.smithi159.stdout:Updating / installing... 2024-03-28T05:20:00.670 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-28T05:20:16.724 INFO:teuthology.orchestra.run.smithi159.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-28T05:20:39.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-28T05:20:39.248 DEBUG:teuthology.orchestra.run.smithi159:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-28T05:20:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T05:20:39.326 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-28T05:20:39.327 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T05:20:39.328 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T05:20:39.329 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T05:20:39.330 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T05:20:39.331 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T05:20:39.332 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T05:20:39.333 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T05:20:39.334 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T05:20:39.335 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T05:20:39.336 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-28T05:20:39.337 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-28T05:20:39.338 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-28T05:20:39.339 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T05:20:39.340 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-28T05:20:39.341 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T05:20:39.342 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-28T05:20:39.343 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T05:20:39.344 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-28T05:20:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T05:20:39.346 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T05:20:39.347 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T05:20:39.348 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T05:20:39.349 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T05:20:39.350 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T05:20:39.351 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T05:20:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T05:20:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T05:20:39.354 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T05:20:39.355 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T05:20:39.356 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T05:20:39.357 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T05:20:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T05:20:39.359 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-28T05:20:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T05:20:39.361 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T05:20:39.362 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-28T05:20:39.363 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T05:20:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T05:20:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T05:20:39.366 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T05:20:39.367 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T05:20:39.368 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-28T05:20:39.369 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T05:20:39.370 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T05:20:39.371 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-28T05:20:39.372 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-28T05:20:39.373 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T05:20:39.374 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T05:20:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T05:20:39.376 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-28T05:20:39.377 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-28T05:20:39.378 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T05:20:39.379 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T05:20:39.380 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T05:20:39.381 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-28T05:20:39.382 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T05:20:39.383 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-28T05:20:39.384 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T05:20:39.385 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-28T05:20:39.386 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T05:20:39.387 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T05:20:39.388 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T05:20:39.389 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T05:20:39.390 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T05:20:39.391 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T05:20:39.392 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-28T05:20:39.393 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T05:20:39.394 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T05:20:39.395 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T05:20:39.396 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T05:20:39.397 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T05:20:39.398 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-28T05:20:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-28T05:20:39.400 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T05:20:39.401 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T05:20:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T05:20:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T05:20:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T05:20:39.405 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T05:20:39.406 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T05:20:39.407 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T05:20:39.408 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-28T05:20:39.409 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T05:20:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T05:20:39.411 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T05:20:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T05:20:39.413 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T05:20:39.414 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T05:20:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-28T05:20:39.416 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T05:20:39.417 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T05:20:39.418 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T05:20:39.419 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-28T05:20:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T05:20:39.421 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T05:20:39.422 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T05:20:39.423 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T05:20:39.424 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T05:20:39.425 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T05:20:39.426 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T05:20:39.427 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T05:20:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T05:20:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-28T05:20:39.430 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T05:20:39.431 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T05:20:39.432 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-28T05:20:39.433 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T05:20:39.434 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-28T05:20:39.435 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T05:20:39.436 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T05:20:39.437 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T05:20:39.438 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T05:20:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T05:20:39.440 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T05:20:39.441 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T05:20:39.442 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-28T05:20:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T05:20:39.444 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T05:20:39.445 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T05:20:39.446 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T05:20:39.447 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T05:20:39.448 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T05:20:39.449 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T05:20:39.450 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T05:20:39.451 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T05:20:39.452 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T05:20:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T05:20:39.454 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T05:20:39.455 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T05:20:39.456 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T05:20:39.457 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T05:20:39.458 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-28T05:20:39.459 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T05:20:39.460 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:20:39.463 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T05:20:39.464 DEBUG:teuthology.orchestra.run.smithi159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:postinstall scriptlet (using /bin/sh): 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:for file in vmlinuz System.map config; do 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout: fi 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:done 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-28T05:20:39.487 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-28T05:20:39.488 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-03-28T05:20:39.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-28T05:20:39.562 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:20:39.563 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-03-28T05:20:39.564 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-28T05:20:39.564 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 6.8.0-g1df0c7e8a235 2024-03-28T05:20:39.564 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-28T05:20:40.199 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-03-28T05:20:41.611 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-28T05:20:41.640 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-03-28T05:20:41.643 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-03-28T05:20:41.658 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.5eB1GZlzxr 2024-03-28T05:20:41.659 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5eB1GZlzxr 2024-03-28T05:20:41.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.5eB1GZlzxr 2024-03-28T05:20:41.870 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.5eB1GZlzxr is 6KB 2024-03-28T05:20:41.920 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.5eB1GZlzxr 2024-03-28T05:20:41.934 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-03-28T05:20:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-28T05:20:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-28T05:20:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-28T05:20:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-28T05:20:42.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-28T05:20:42.165 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-03-28T05:21:12.168 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-03-28T05:21:12.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-28T05:21:12.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:22:12.174 DEBUG:teuthology.orchestra.remote:timed out 2024-03-28T05:22:21.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-28T05:22:21.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:22:37.039 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-03-28T05:22:37.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-28T05:22:37.632 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.8.0-g1df0c7e8a235"... 2024-03-28T05:22:37.633 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-03-28T05:22:37.676 INFO:teuthology.orchestra.run.smithi159.stdout:6.8.0-g1df0c7e8a235 2024-03-28T05:22:37.676 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T05:22:37.676 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T05:22:37.676 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-28T05:22:38.677 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-03-28T05:22:38.677 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-28T05:22:38.787 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-03-28T05:22:38.831 DEBUG:teuthology.parallel:result is None 2024-03-28T05:22:38.831 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-28T05:22:38.840 INFO:teuthology.task.internal:Creating test directory... 2024-03-28T05:22:38.840 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T05:22:38.848 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T05:22:38.856 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T05:22:38.906 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-28T05:22:38.912 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-28T05:22:38.922 INFO:teuthology.task.internal:Creating archive directory... 2024-03-28T05:22:38.922 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T05:22:38.929 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T05:22:38.936 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T05:22:39.003 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-28T05:22:39.010 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-28T05:22:39.010 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T05:22:39.017 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T05:22:39.024 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T05:22:39.107 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.114 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.118 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.140 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.155 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.163 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T05:22:39.168 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-28T05:22:39.175 INFO:teuthology.task.internal:Configuring sudo... 2024-03-28T05:22:39.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T05:22:39.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T05:22:39.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T05:22:39.269 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-28T05:22:39.277 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-28T05:22:39.277 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T05:22:39.284 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T05:22:39.289 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T05:22:39.334 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:39.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:39.547 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:39.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:39.738 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:22:39.738 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T05:22:39.838 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:39.924 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:40.057 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:40.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:40.237 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:22:40.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T05:22:40.332 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:40.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T05:22:40.501 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:40.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T05:22:40.663 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:22:40.663 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T05:22:40.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-03-28T05:22:40.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-03-28T05:22:40.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-03-28T05:22:40.886 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-28T05:22:40.887 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-28T05:22:40.912 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-28T05:22:41.386 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-28T05:22:41.394 INFO:teuthology.task.internal:Starting timer... 2024-03-28T05:22:41.394 INFO:teuthology.run_tasks:Running task pcp... 2024-03-28T05:22:41.409 INFO:teuthology.run_tasks:Running task selinux... 2024-03-28T05:22:41.417 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-28T05:22:41.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-03-28T05:22:41.551 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-03-28T05:22:41.557 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-03-28T05:22:41.695 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-03-28T05:22:41.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-03-28T05:22:41.817 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-03-28T05:22:41.821 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-28T05:22:41.821 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-03-28T05:22:41.876 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-03-28T05:22:41.876 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-03-28T05:22:41.933 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-03-28T05:22:41.933 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-03-28T05:22:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-03-28T05:22:41.978 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2024-03-28T05:22:41.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-28T05:22:42.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:22:42.069 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-28T05:22:42.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:22:42.147 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-28T05:22:42.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:22:42.223 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-28T05:22:42.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-03-28T05:22:42.315 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-03-28T05:22:42.396 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-03-28T05:22:42.474 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-28T05:22:42.485 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-28T05:22:42.492 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-28T05:22:42.642 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-28T05:22:42.656 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-28T05:22:42.657 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi086.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-28T05:28:49.768 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-03-28T05:28:49.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:28:49.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:28:49.919 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-03-28T05:28:50.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-28T05:28:50.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:28:50.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:28:50.199 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-03-28T05:28:50.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-03-28T05:28:50.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-28T05:28:50.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T05:28:50.493 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-03-28T05:28:50.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-28T05:28:50.643 INFO:teuthology.run_tasks:Running task clock... 2024-03-28T05:28:50.654 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-28T05:28:50.655 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T05:28:50.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T05:28:50.663 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T05:28:50.663 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T05:28:50.670 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T05:28:50.670 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T05:28:50.765 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-28T05:28:50.769 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-28T05:28:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-28T05:28:50.816 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-28T05:28:50.822 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-28T05:28:50.825 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-28T05:28:50.906 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-03-28T05:28:50.913 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-03-28T05:28:50.924 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-03-28T05:28:50.946 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-03-28T05:28:50.954 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-03-28T05:28:50.969 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-03-28T05:28:50.996 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-28T05:28:51.004 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-28T05:28:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-28T05:28:51.048 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-28T05:28:51.056 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-28T05:28:51.077 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-28T05:28:51.181 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-03-28T05:28:51.188 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.191 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.198 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-03-28T05:28:51.230 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-28T05:28:51.231 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-03-28T05:28:51.231 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.231 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.231 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.231 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-28T05:28:51.232 INFO:teuthology.run_tasks:Running task install... 2024-03-28T05:28:51.240 DEBUG:teuthology.task.install:project ceph 2024-03-28T05:28:51.240 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}} 2024-03-28T05:28:51.240 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'} 2024-03-28T05:28:51.241 INFO:teuthology.task.install:Using flavor: default 2024-03-28T05:28:51.246 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-28T05:28:51.246 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-28T05:28:51.247 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'tag': None, 'wait_for_package': False} 2024-03-28T05:28:51.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:28:51.249 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'tag': None, 'wait_for_package': False} 2024-03-28T05:28:51.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:28:51.251 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'tag': None, 'wait_for_package': False} 2024-03-28T05:28:51.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:28:51.403 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/ 2024-03-28T05:28:51.403 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2145.g3be9a5c9 2024-03-28T05:28:51.407 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/ 2024-03-28T05:28:51.407 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2145.g3be9a5c9 2024-03-28T05:28:51.471 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/ 2024-03-28T05:28:51.471 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2145.g3be9a5c9 2024-03-28T05:28:51.576 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-28T05:28:51.576 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:28:51.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-28T05:28:51.602 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-28T05:28:51.602 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:28:51.602 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-28T05:28:51.640 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-28T05:28:51.640 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:28:51.640 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-28T05:28:51.675 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-28T05:28:51.676 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3be9a5c9bc793e11e2800a8c0c696e8b46742033/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-28T05:28:51.697 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-28T05:28:51.698 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3be9a5c9bc793e11e2800a8c0c696e8b46742033/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-28T05:28:51.740 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-28T05:28:51.740 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3be9a5c9bc793e11e2800a8c0c696e8b46742033/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-28T05:28:51.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-28T05:28:51.830 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-28T05:28:51.872 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-28T05:28:51.961 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-28T05:28:51.963 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-28T05:28:51.997 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-28T05:28:52.051 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-03-28T05:28:52.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-03-28T05:28:52.058 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-03-28T05:28:52.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-03-28T05:28:52.078 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-03-28T05:28:52.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-03-28T05:28:52.403 INFO:teuthology.orchestra.run.smithi159.stdout:74 files removed 2024-03-28T05:28:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:74 files removed 2024-03-28T05:28:52.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-28T05:28:52.447 INFO:teuthology.orchestra.run.smithi086.stdout:74 files removed 2024-03-28T05:28:52.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-28T05:28:52.487 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-28T05:28:53.335 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 226 kB/s | 83 kB 00:00 2024-03-28T05:28:53.458 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-03-28T05:28:53.514 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 162 kB/s | 83 kB 00:00 2024-03-28T05:28:53.777 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-28T05:28:53.967 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-28T05:28:54.056 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 22 kB/s | 10 kB 00:00 2024-03-28T05:28:54.286 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-28T05:28:54.476 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-28T05:28:54.540 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-03-28T05:28:54.889 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-28T05:28:55.177 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-28T05:28:55.230 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-03-28T05:28:56.573 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-28T05:28:56.760 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-03-28T05:28:56.872 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-03-28T05:28:57.478 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-28T05:28:58.343 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-03-28T05:28:58.515 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.0 MB 00:01 2024-03-28T05:29:00.466 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-28T05:29:01.208 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-28T05:29:01.211 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 19 MB 00:02 2024-03-28T05:29:05.514 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.1 MB 00:01 2024-03-28T05:29:05.746 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.1 MB 00:00 2024-03-28T05:29:05.804 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.1 MB 00:00 2024-03-28T05:29:07.127 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-03-28T05:29:07.405 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-03-28T05:29:07.572 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-03-28T05:29:08.462 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-28T05:29:09.282 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-28T05:29:11.079 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 21 MB 00:03 2024-03-28T05:29:14.220 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-03-28T05:29:15.207 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-03-28T05:29:16.794 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:16.795 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:16.815 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-28T05:29:16.816 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-28T05:29:16.818 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-28T05:29:16.819 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:16.821 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:16.825 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-28T05:29:16.826 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-28T05:29:16.873 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-03-28T05:29:16.912 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================================ 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================================ 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 6.6 k 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.4 M 2024-03-28T05:29:16.934 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 890 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 145 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 1.5 M 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 139 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 1.8 M 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 7.4 M 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 49 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 9.9 M 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 48 M 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 264 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 748 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 220 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 27 k 2024-03-28T05:29:16.935 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 18 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 31 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 746 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 127 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-28T05:29:16.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 162 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 321 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 298 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 99 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 85 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 170 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-28T05:29:16.937 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.4 M 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-28T05:29:16.938 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 20 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 34 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 2.3 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 248 k 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 4.7 M 2024-03-28T05:29:16.939 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 17 M 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 16 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 25 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 163 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-28T05:29:16.940 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 501 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.1 M 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-28T05:29:16.941 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 45 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 131 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-28T05:29:16.942 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-28T05:29:16.943 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-28T05:29:16.944 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-28T05:29:16.945 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-28T05:29:16.946 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================================ 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout:Install 150 Packages 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 24 Packages 2024-03-28T05:29:16.947 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:29:16.948 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 225 M 2024-03-28T05:29:16.948 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-03-28T05:29:17.746 INFO:teuthology.orchestra.run.smithi086.stdout:(1/174): ceph-19.0.0-2145.g3be9a5c9.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-03-28T05:29:17.936 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:17.937 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:17.958 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-28T05:29:17.959 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-28T05:29:17.961 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-28T05:29:17.962 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:17.965 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:17.968 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-28T05:29:17.969 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-28T05:29:18.065 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-03-28T05:29:18.092 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-03-28T05:29:18.092 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-03-28T05:29:18.092 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-03-28T05:29:18.092 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 6.6 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.4 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 890 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 145 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 1.5 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 139 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 1.8 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 7.4 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 49 k 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 9.9 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 48 M 2024-03-28T05:29:18.093 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 264 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 748 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 220 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 27 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 18 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 31 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 746 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 127 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-28T05:29:18.094 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 162 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 321 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 298 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 99 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 85 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 170 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-03-28T05:29:18.095 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-28T05:29:18.096 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.4 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-28T05:29:18.097 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 20 M 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 34 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 2.3 M 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 248 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 4.7 M 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 17 M 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 16 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 25 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-28T05:29:18.098 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 163 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 501 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-28T05:29:18.099 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.1 M 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-28T05:29:18.100 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 45 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 131 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-28T05:29:18.101 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-28T05:29:18.102 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-28T05:29:18.103 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-28T05:29:18.104 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout:Installing weak dependencies: 2024-03-28T05:29:18.105 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout:Install 150 Packages 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 24 Packages 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:29:18.106 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 225 M 2024-03-28T05:29:18.107 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-03-28T05:29:18.280 INFO:teuthology.orchestra.run.smithi086.stdout:(2/174): ceph-base-19.0.0-2145.g3be9a5c9.el9.x8 6.1 MB/s | 5.4 MB 00:00 2024-03-28T05:29:18.338 INFO:teuthology.orchestra.run.smithi086.stdout:(3/174): ceph-immutable-object-cache-19.0.0-214 2.5 MB/s | 145 kB 00:00 2024-03-28T05:29:18.589 INFO:teuthology.orchestra.run.smithi086.stdout:(4/174): ceph-mds-19.0.0-2145.g3be9a5c9.el9.x86 9.3 MB/s | 2.3 MB 00:00 2024-03-28T05:29:18.664 INFO:teuthology.orchestra.run.smithi086.stdout:(5/174): ceph-fuse-19.0.0-2145.g3be9a5c9.el9.x8 972 kB/s | 890 kB 00:00 2024-03-28T05:29:18.764 INFO:teuthology.orchestra.run.smithi086.stdout:(6/174): ceph-mgr-19.0.0-2145.g3be9a5c9.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-03-28T05:29:19.123 INFO:teuthology.orchestra.run.smithi086.stdout:(7/174): ceph-common-19.0.0-2145.g3be9a5c9.el9. 12 MB/s | 20 MB 00:01 2024-03-28T05:29:19.184 INFO:teuthology.orchestra.run.smithi055.stdout:(1/174): ceph-19.0.0-2145.g3be9a5c9.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-03-28T05:29:19.548 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:19.550 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-28T05:29:19.573 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-28T05:29:19.574 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-28T05:29:19.575 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-28T05:29:19.577 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:19.579 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-28T05:29:19.583 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-28T05:29:19.584 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-28T05:29:19.673 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 6.6 k 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.4 M 2024-03-28T05:29:19.692 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 890 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 145 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 1.5 M 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 139 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 1.8 M 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 7.4 M 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 49 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 9.9 M 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 48 M 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 264 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 748 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 220 k 2024-03-28T05:29:19.693 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 27 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 18 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 31 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 746 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 127 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-28T05:29:19.694 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 162 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 321 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 298 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 99 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 85 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 170 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-28T05:29:19.695 INFO:teuthology.orchestra.run.smithi159.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.4 M 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-28T05:29:19.696 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 20 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 34 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 2.3 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 248 k 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 4.7 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 17 M 2024-03-28T05:29:19.697 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 16 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 25 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-28T05:29:19.698 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 163 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 501 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.1 M 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-28T05:29:19.699 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-28T05:29:19.700 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 45 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 131 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-28T05:29:19.701 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-28T05:29:19.702 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-28T05:29:19.703 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-28T05:29:19.704 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================================ 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout:Install 150 Packages 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 24 Packages 2024-03-28T05:29:19.705 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:29:19.706 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 225 M 2024-03-28T05:29:19.706 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-03-28T05:29:20.040 INFO:teuthology.orchestra.run.smithi086.stdout:(8/174): ceph-radosgw-19.0.0-2145.g3be9a5c9.el9 11 MB/s | 9.9 MB 00:00 2024-03-28T05:29:20.081 INFO:teuthology.orchestra.run.smithi086.stdout:(9/174): ceph-selinux-19.0.0-2145.g3be9a5c9.el9 617 kB/s | 25 kB 00:00 2024-03-28T05:29:20.125 INFO:teuthology.orchestra.run.smithi055.stdout:(2/174): ceph-fuse-19.0.0-2145.g3be9a5c9.el9.x8 947 kB/s | 890 kB 00:00 2024-03-28T05:29:20.242 INFO:teuthology.orchestra.run.smithi055.stdout:(3/174): ceph-immutable-object-cache-19.0.0-214 1.2 MB/s | 145 kB 00:00 2024-03-28T05:29:20.307 INFO:teuthology.orchestra.run.smithi086.stdout:(10/174): ceph-osd-19.0.0-2145.g3be9a5c9.el9.x8 11 MB/s | 17 MB 00:01 2024-03-28T05:29:20.374 INFO:teuthology.orchestra.run.smithi086.stdout:(11/174): cephfs-mirror-19.0.0-2145.g3be9a5c9.e 3.3 MB/s | 220 kB 00:00 2024-03-28T05:29:20.432 INFO:teuthology.orchestra.run.smithi086.stdout:(12/174): cephfs-shell-19.0.0-2145.g3be9a5c9.el 470 kB/s | 27 kB 00:00 2024-03-28T05:29:20.491 INFO:teuthology.orchestra.run.smithi086.stdout:(13/174): libcephfs-devel-19.0.0-2145.g3be9a5c9 544 kB/s | 31 kB 00:00 2024-03-28T05:29:20.500 INFO:teuthology.orchestra.run.smithi159.stdout:(1/174): ceph-19.0.0-2145.g3be9a5c9.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-03-28T05:29:20.666 INFO:teuthology.orchestra.run.smithi086.stdout:(14/174): libcephfs2-19.0.0-2145.g3be9a5c9.el9. 4.2 MB/s | 746 kB 00:00 2024-03-28T05:29:20.750 INFO:teuthology.orchestra.run.smithi086.stdout:(15/174): libcephsqlite-19.0.0-2145.g3be9a5c9.e 1.9 MB/s | 163 kB 00:00 2024-03-28T05:29:20.842 INFO:teuthology.orchestra.run.smithi086.stdout:(16/174): librados-devel-19.0.0-2145.g3be9a5c9. 1.4 MB/s | 127 kB 00:00 2024-03-28T05:29:20.942 INFO:teuthology.orchestra.run.smithi086.stdout:(17/174): libradosstriper1-19.0.0-2145.g3be9a5c 4.9 MB/s | 501 kB 00:00 2024-03-28T05:29:21.334 INFO:teuthology.orchestra.run.smithi086.stdout:(18/174): ceph-mon-19.0.0-2145.g3be9a5c9.el9.x8 1.8 MB/s | 4.7 MB 00:02 2024-03-28T05:29:21.350 INFO:teuthology.orchestra.run.smithi159.stdout:(2/174): ceph-fuse-19.0.0-2145.g3be9a5c9.el9.x8 1.0 MB/s | 890 kB 00:00 2024-03-28T05:29:21.384 INFO:teuthology.orchestra.run.smithi055.stdout:(4/174): ceph-mds-19.0.0-2145.g3be9a5c9.el9.x86 2.0 MB/s | 2.3 MB 00:01 2024-03-28T05:29:21.434 INFO:teuthology.orchestra.run.smithi086.stdout:(19/174): python3-ceph-argparse-19.0.0-2145.g3b 456 kB/s | 45 kB 00:00 2024-03-28T05:29:21.492 INFO:teuthology.orchestra.run.smithi159.stdout:(3/174): ceph-immutable-object-cache-19.0.0-214 1.0 MB/s | 145 kB 00:00 2024-03-28T05:29:21.618 INFO:teuthology.orchestra.run.smithi086.stdout:(20/174): librgw2-19.0.0-2145.g3be9a5c9.el9.x86 7.6 MB/s | 5.1 MB 00:00 2024-03-28T05:29:21.643 INFO:teuthology.orchestra.run.smithi086.stdout:(21/174): python3-ceph-common-19.0.0-2145.g3be9 632 kB/s | 131 kB 00:00 2024-03-28T05:29:21.693 INFO:teuthology.orchestra.run.smithi086.stdout:(22/174): python3-cephfs-19.0.0-2145.g3be9a5c9. 2.1 MB/s | 162 kB 00:00 2024-03-28T05:29:21.794 INFO:teuthology.orchestra.run.smithi086.stdout:(23/174): python3-rbd-19.0.0-2145.g3be9a5c9.el9 2.9 MB/s | 298 kB 00:00 2024-03-28T05:29:21.869 INFO:teuthology.orchestra.run.smithi086.stdout:(24/174): python3-rgw-19.0.0-2145.g3be9a5c9.el9 1.3 MB/s | 99 kB 00:00 2024-03-28T05:29:21.911 INFO:teuthology.orchestra.run.smithi086.stdout:(25/174): python3-rados-19.0.0-2145.g3be9a5c9.e 1.2 MB/s | 321 kB 00:00 2024-03-28T05:29:21.953 INFO:teuthology.orchestra.run.smithi086.stdout:(26/174): rbd-fuse-19.0.0-2145.g3be9a5c9.el9.x8 1.0 MB/s | 85 kB 00:00 2024-03-28T05:29:22.053 INFO:teuthology.orchestra.run.smithi086.stdout:(27/174): rbd-nbd-19.0.0-2145.g3be9a5c9.el9.x86 1.7 MB/s | 170 kB 00:00 2024-03-28T05:29:22.128 INFO:teuthology.orchestra.run.smithi086.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2145.g 457 kB/s | 34 kB 00:00 2024-03-28T05:29:22.134 INFO:teuthology.orchestra.run.smithi055.stdout:(5/174): ceph-mgr-19.0.0-2145.g3be9a5c9.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-03-28T05:29:22.192 INFO:teuthology.orchestra.run.smithi159.stdout:(4/174): ceph-mds-19.0.0-2145.g3be9a5c9.el9.x86 3.3 MB/s | 2.3 MB 00:00 2024-03-28T05:29:22.204 INFO:teuthology.orchestra.run.smithi086.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2145.g3be9a5c 1.8 MB/s | 139 kB 00:00 2024-03-28T05:29:22.496 INFO:teuthology.orchestra.run.smithi086.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2145.g3be9a 6.2 MB/s | 1.8 MB 00:00 2024-03-28T05:29:22.625 INFO:teuthology.orchestra.run.smithi159.stdout:(5/174): ceph-mgr-19.0.0-2145.g3be9a5c9.el9.x86 3.5 MB/s | 1.5 MB 00:00 2024-03-28T05:29:23.501 INFO:teuthology.orchestra.run.smithi055.stdout:(6/174): ceph-base-19.0.0-2145.g3be9a5c9.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-03-28T05:29:23.546 INFO:teuthology.orchestra.run.smithi086.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-03-28T05:29:23.584 INFO:teuthology.orchestra.run.smithi159.stdout:(6/174): ceph-mon-19.0.0-2145.g3be9a5c9.el9.x86 4.9 MB/s | 4.7 MB 00:00 2024-03-28T05:29:23.604 INFO:teuthology.orchestra.run.smithi086.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2145.g3b 4.2 MB/s | 248 kB 00:00 2024-03-28T05:29:23.680 INFO:teuthology.orchestra.run.smithi086.stdout:(33/174): ceph-mgr-rook-19.0.0-2145.g3be9a5c9.e 665 kB/s | 49 kB 00:00 2024-03-28T05:29:23.763 INFO:teuthology.orchestra.run.smithi086.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2145.g3 199 kB/s | 16 kB 00:00 2024-03-28T05:29:23.855 INFO:teuthology.orchestra.run.smithi086.stdout:(35/174): ceph-volume-19.0.0-2145.g3be9a5c9.el9 2.8 MB/s | 264 kB 00:00 2024-03-28T05:29:24.039 INFO:teuthology.orchestra.run.smithi086.stdout:(36/174): cephadm-19.0.0-2145.g3be9a5c9.el9.noa 4.0 MB/s | 748 kB 00:00 2024-03-28T05:29:24.156 INFO:teuthology.orchestra.run.smithi086.stdout:(37/174): cephfs-top-19.0.0-2145.g3be9a5c9.el9. 157 kB/s | 18 kB 00:00 2024-03-28T05:29:24.231 INFO:teuthology.orchestra.run.smithi086.stdout:(38/174): rbd-mirror-19.0.0-2145.g3be9a5c9.el9. 1.3 MB/s | 3.1 MB 00:02 2024-03-28T05:29:24.448 INFO:teuthology.orchestra.run.smithi086.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 662 kB 00:00 2024-03-28T05:29:24.529 INFO:teuthology.orchestra.run.smithi086.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2024-03-28T05:29:24.565 INFO:teuthology.orchestra.run.smithi086.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 942 kB/s | 106 kB 00:00 2024-03-28T05:29:24.599 INFO:teuthology.orchestra.run.smithi086.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-03-28T05:29:24.649 INFO:teuthology.orchestra.run.smithi086.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 32 kB 00:00 2024-03-28T05:29:24.758 INFO:teuthology.orchestra.run.smithi086.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-03-28T05:29:24.800 INFO:teuthology.orchestra.run.smithi086.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 126 kB/s | 17 kB 00:00 2024-03-28T05:29:24.850 INFO:teuthology.orchestra.run.smithi086.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 206 kB/s | 10 kB 00:00 2024-03-28T05:29:24.851 INFO:teuthology.orchestra.run.smithi055.stdout:(7/174): ceph-mon-19.0.0-2145.g3be9a5c9.el9.x86 1.7 MB/s | 4.7 MB 00:02 2024-03-28T05:29:24.876 INFO:teuthology.orchestra.run.smithi086.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-28T05:29:24.951 INFO:teuthology.orchestra.run.smithi086.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 44 kB 00:00 2024-03-28T05:29:24.993 INFO:teuthology.orchestra.run.smithi086.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2024-03-28T05:29:25.035 INFO:teuthology.orchestra.run.smithi086.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-28T05:29:25.050 INFO:teuthology.orchestra.run.smithi159.stdout:(7/174): ceph-osd-19.0.0-2145.g3be9a5c9.el9.x86 11 MB/s | 17 MB 00:01 2024-03-28T05:29:25.085 INFO:teuthology.orchestra.run.smithi086.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 538 kB/s | 46 kB 00:00 2024-03-28T05:29:25.118 INFO:teuthology.orchestra.run.smithi086.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2024-03-28T05:29:25.152 INFO:teuthology.orchestra.run.smithi086.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-28T05:29:25.186 INFO:teuthology.orchestra.run.smithi086.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-28T05:29:25.236 INFO:teuthology.orchestra.run.smithi086.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 422 kB/s | 34 kB 00:00 2024-03-28T05:29:25.370 INFO:teuthology.orchestra.run.smithi086.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-03-28T05:29:25.411 INFO:teuthology.orchestra.run.smithi086.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.3 MB/s | 1.0 MB 00:00 2024-03-28T05:29:25.454 INFO:teuthology.orchestra.run.smithi086.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-03-28T05:29:25.605 INFO:teuthology.orchestra.run.smithi086.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-03-28T05:29:25.654 INFO:teuthology.orchestra.run.smithi086.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 131 kB/s | 24 kB 00:00 2024-03-28T05:29:25.729 INFO:teuthology.orchestra.run.smithi086.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 146 kB/s | 18 kB 00:00 2024-03-28T05:29:25.755 INFO:teuthology.orchestra.run.smithi086.stdout:(62/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 144 kB 00:00 2024-03-28T05:29:25.797 INFO:teuthology.orchestra.run.smithi086.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 487 kB/s | 32 kB 00:00 2024-03-28T05:29:25.851 INFO:teuthology.orchestra.run.smithi159.stdout:(8/174): ceph-radosgw-19.0.0-2145.g3be9a5c9.el9 12 MB/s | 9.9 MB 00:00 2024-03-28T05:29:25.922 INFO:teuthology.orchestra.run.smithi086.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-03-28T05:29:25.947 INFO:teuthology.orchestra.run.smithi086.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-28T05:29:25.951 INFO:teuthology.orchestra.run.smithi159.stdout:(9/174): ceph-base-19.0.0-2145.g3be9a5c9.el9.x8 953 kB/s | 5.4 MB 00:05 2024-03-28T05:29:25.976 INFO:teuthology.orchestra.run.smithi159.stdout:(10/174): ceph-selinux-19.0.0-2145.g3be9a5c9.el 202 kB/s | 25 kB 00:00 2024-03-28T05:29:25.989 INFO:teuthology.orchestra.run.smithi086.stdout:(66/174): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-03-28T05:29:26.014 INFO:teuthology.orchestra.run.smithi086.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-28T05:29:26.035 INFO:teuthology.orchestra.run.smithi159.stdout:(11/174): cephfs-mirror-19.0.0-2145.g3be9a5c9.e 3.7 MB/s | 220 kB 00:00 2024-03-28T05:29:26.056 INFO:teuthology.orchestra.run.smithi086.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 636 kB/s | 41 kB 00:00 2024-03-28T05:29:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:(12/174): cephfs-shell-19.0.0-2145.g3be9a5c9.el 551 kB/s | 27 kB 00:00 2024-03-28T05:29:26.123 INFO:teuthology.orchestra.run.smithi086.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 238 kB 00:00 2024-03-28T05:29:26.149 INFO:teuthology.orchestra.run.smithi086.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-03-28T05:29:26.182 INFO:teuthology.orchestra.run.smithi086.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-28T05:29:26.233 INFO:teuthology.orchestra.run.smithi086.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 582 kB/s | 47 kB 00:00 2024-03-28T05:29:26.276 INFO:teuthology.orchestra.run.smithi086.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 470 kB/s | 43 kB 00:00 2024-03-28T05:29:26.344 INFO:teuthology.orchestra.run.smithi159.stdout:(13/174): ceph-common-19.0.0-2145.g3be9a5c9.el9 3.3 MB/s | 20 MB 00:06 2024-03-28T05:29:26.369 INFO:teuthology.orchestra.run.smithi159.stdout:(14/174): libcephfs-devel-19.0.0-2145.g3be9a5c9 111 kB/s | 31 kB 00:00 2024-03-28T05:29:26.419 INFO:teuthology.orchestra.run.smithi159.stdout:(15/174): libcephsqlite-19.0.0-2145.g3be9a5c9.e 3.2 MB/s | 163 kB 00:00 2024-03-28T05:29:26.470 INFO:teuthology.orchestra.run.smithi159.stdout:(16/174): librados-devel-19.0.0-2145.g3be9a5c9. 2.5 MB/s | 127 kB 00:00 2024-03-28T05:29:26.520 INFO:teuthology.orchestra.run.smithi159.stdout:(17/174): libcephfs2-19.0.0-2145.g3be9a5c9.el9. 4.2 MB/s | 746 kB 00:00 2024-03-28T05:29:26.570 INFO:teuthology.orchestra.run.smithi159.stdout:(18/174): libradosstriper1-19.0.0-2145.g3be9a5c 4.9 MB/s | 501 kB 00:00 2024-03-28T05:29:26.629 INFO:teuthology.orchestra.run.smithi159.stdout:(19/174): python3-ceph-argparse-19.0.0-2145.g3b 784 kB/s | 45 kB 00:00 2024-03-28T05:29:26.696 INFO:teuthology.orchestra.run.smithi159.stdout:(20/174): python3-ceph-common-19.0.0-2145.g3be9 1.9 MB/s | 131 kB 00:00 2024-03-28T05:29:26.754 INFO:teuthology.orchestra.run.smithi159.stdout:(21/174): python3-cephfs-19.0.0-2145.g3be9a5c9. 2.8 MB/s | 162 kB 00:00 2024-03-28T05:29:26.846 INFO:teuthology.orchestra.run.smithi159.stdout:(22/174): python3-rados-19.0.0-2145.g3be9a5c9.e 3.5 MB/s | 321 kB 00:00 2024-03-28T05:29:26.899 INFO:teuthology.orchestra.run.smithi086.stdout:(74/174): ceph-test-19.0.0-2145.g3be9a5c9.el9.x 7.0 MB/s | 48 MB 00:06 2024-03-28T05:29:26.921 INFO:teuthology.orchestra.run.smithi159.stdout:(23/174): python3-rbd-19.0.0-2145.g3be9a5c9.el9 4.0 MB/s | 298 kB 00:00 2024-03-28T05:29:26.972 INFO:teuthology.orchestra.run.smithi159.stdout:(24/174): python3-rgw-19.0.0-2145.g3be9a5c9.el9 2.0 MB/s | 99 kB 00:00 2024-03-28T05:29:27.014 INFO:teuthology.orchestra.run.smithi159.stdout:(25/174): rbd-fuse-19.0.0-2145.g3be9a5c9.el9.x8 2.1 MB/s | 85 kB 00:00 2024-03-28T05:29:27.176 INFO:teuthology.orchestra.run.smithi086.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-03-28T05:29:27.200 INFO:teuthology.orchestra.run.smithi086.stdout:(76/174): python3-toml-0.10.2-6.el9.noarch.rpm 42 kB/s | 39 kB 00:00 2024-03-28T05:29:27.226 INFO:teuthology.orchestra.run.smithi086.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 132 kB/s | 41 kB 00:00 2024-03-28T05:29:27.297 INFO:teuthology.orchestra.run.smithi159.stdout:(26/174): rbd-mirror-19.0.0-2145.g3be9a5c9.el9. 11 MB/s | 3.1 MB 00:00 2024-03-28T05:29:27.302 INFO:teuthology.orchestra.run.smithi086.stdout:(78/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 63 kB 00:00 2024-03-28T05:29:27.343 INFO:teuthology.orchestra.run.smithi086.stdout:(79/174): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 300 kB 00:00 2024-03-28T05:29:27.369 INFO:teuthology.orchestra.run.smithi086.stdout:(80/174): uuid-1.6.2-55.el9.x86_64.rpm 401 kB/s | 56 kB 00:00 2024-03-28T05:29:27.393 INFO:teuthology.orchestra.run.smithi086.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 502 kB/s | 44 kB 00:00 2024-03-28T05:29:27.406 INFO:teuthology.orchestra.run.smithi159.stdout:(27/174): librgw2-19.0.0-2145.g3be9a5c9.el9.x86 5.8 MB/s | 5.1 MB 00:00 2024-03-28T05:29:27.427 INFO:teuthology.orchestra.run.smithi086.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-28T05:29:27.439 INFO:teuthology.orchestra.run.smithi159.stdout:(28/174): rbd-nbd-19.0.0-2145.g3be9a5c9.el9.x86 1.2 MB/s | 170 kB 00:00 2024-03-28T05:29:27.460 INFO:teuthology.orchestra.run.smithi086.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-03-28T05:29:27.473 INFO:teuthology.orchestra.run.smithi159.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2145.g 516 kB/s | 34 kB 00:00 2024-03-28T05:29:27.507 INFO:teuthology.orchestra.run.smithi159.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2145.g3be9a5c 2.0 MB/s | 139 kB 00:00 2024-03-28T05:29:27.519 INFO:teuthology.orchestra.run.smithi086.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.1 MB 00:00 2024-03-28T05:29:27.544 INFO:teuthology.orchestra.run.smithi086.stdout:(85/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-28T05:29:27.665 INFO:teuthology.orchestra.run.smithi086.stdout:(86/174): python3-pycparser-2.20-6.el9.noarch.r 640 kB/s | 124 kB 00:00 2024-03-28T05:29:27.720 INFO:teuthology.orchestra.run.smithi086.stdout:(87/174): python3-urllib3-1.26.5-5.el9.noarch.r 937 kB/s | 187 kB 00:00 2024-03-28T05:29:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:(8/174): ceph-common-19.0.0-2145.g3be9a5c9.el9. 2.3 MB/s | 20 MB 00:08 2024-03-28T05:29:27.794 INFO:teuthology.orchestra.run.smithi055.stdout:(9/174): ceph-selinux-19.0.0-2145.g3be9a5c9.el9 385 kB/s | 25 kB 00:00 2024-03-28T05:29:27.849 INFO:teuthology.orchestra.run.smithi159.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2145.g3be9a 4.8 MB/s | 1.8 MB 00:00 2024-03-28T05:29:28.041 INFO:teuthology.orchestra.run.smithi159.stdout:(32/174): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-03-28T05:29:28.052 INFO:teuthology.orchestra.run.smithi055.stdout:(10/174): ceph-radosgw-19.0.0-2145.g3be9a5c9.el 3.1 MB/s | 9.9 MB 00:03 2024-03-28T05:29:28.074 INFO:teuthology.orchestra.run.smithi159.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2145.g3b 1.1 MB/s | 248 kB 00:00 2024-03-28T05:29:28.100 INFO:teuthology.orchestra.run.smithi159.stdout:(34/174): ceph-mgr-rook-19.0.0-2145.g3be9a5c9.e 852 kB/s | 49 kB 00:00 2024-03-28T05:29:28.129 INFO:teuthology.orchestra.run.smithi086.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 407 kB/s | 187 kB 00:00 2024-03-28T05:29:28.133 INFO:teuthology.orchestra.run.smithi159.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2145.g3 282 kB/s | 16 kB 00:00 2024-03-28T05:29:28.152 INFO:teuthology.orchestra.run.smithi055.stdout:(11/174): cephfs-mirror-19.0.0-2145.g3be9a5c9.e 2.2 MB/s | 220 kB 00:00 2024-03-28T05:29:28.167 INFO:teuthology.orchestra.run.smithi159.stdout:(36/174): ceph-volume-19.0.0-2145.g3be9a5c9.el9 3.9 MB/s | 264 kB 00:00 2024-03-28T05:29:28.211 INFO:teuthology.orchestra.run.smithi055.stdout:(12/174): cephfs-shell-19.0.0-2145.g3be9a5c9.el 475 kB/s | 27 kB 00:00 2024-03-28T05:29:28.217 INFO:teuthology.orchestra.run.smithi159.stdout:(37/174): cephfs-top-19.0.0-2145.g3be9a5c9.el9. 370 kB/s | 18 kB 00:00 2024-03-28T05:29:28.268 INFO:teuthology.orchestra.run.smithi159.stdout:(38/174): cephadm-19.0.0-2145.g3be9a5c9.el9.noa 5.5 MB/s | 748 kB 00:00 2024-03-28T05:29:28.270 INFO:teuthology.orchestra.run.smithi055.stdout:(13/174): libcephfs-devel-19.0.0-2145.g3be9a5c9 545 kB/s | 31 kB 00:00 2024-03-28T05:29:28.271 INFO:teuthology.orchestra.run.smithi086.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 355 kB/s | 195 kB 00:00 2024-03-28T05:29:28.321 INFO:teuthology.orchestra.run.smithi086.stdout:(90/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-03-28T05:29:28.355 INFO:teuthology.orchestra.run.smithi086.stdout:(91/174): python3-requests-2.25.1-8.el9.noarch. 557 kB/s | 125 kB 00:00 2024-03-28T05:29:28.470 INFO:teuthology.orchestra.run.smithi055.stdout:(14/174): libcephfs2-19.0.0-2145.g3be9a5c9.el9. 3.7 MB/s | 746 kB 00:00 2024-03-28T05:29:28.526 INFO:teuthology.orchestra.run.smithi159.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-03-28T05:29:28.537 INFO:teuthology.orchestra.run.smithi055.stdout:(15/174): libcephsqlite-19.0.0-2145.g3be9a5c9.e 2.4 MB/s | 163 kB 00:00 2024-03-28T05:29:28.568 INFO:teuthology.orchestra.run.smithi159.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 920 kB 00:00 2024-03-28T05:29:28.585 INFO:teuthology.orchestra.run.smithi159.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-28T05:29:28.597 INFO:teuthology.orchestra.run.smithi086.stdout:(92/174): elfutils-libelf-devel-0.190-2.el9.x86 66 kB/s | 21 kB 00:00 2024-03-28T05:29:28.604 INFO:teuthology.orchestra.run.smithi055.stdout:(16/174): librados-devel-19.0.0-2145.g3be9a5c9. 1.9 MB/s | 127 kB 00:00 2024-03-28T05:29:28.618 INFO:teuthology.orchestra.run.smithi159.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.2 MB/s | 307 kB 00:00 2024-03-28T05:29:28.622 INFO:teuthology.orchestra.run.smithi086.stdout:(93/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 85 kB/s | 25 kB 00:00 2024-03-28T05:29:28.644 INFO:teuthology.orchestra.run.smithi159.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 573 kB/s | 32 kB 00:00 2024-03-28T05:29:28.769 INFO:teuthology.orchestra.run.smithi159.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-03-28T05:29:28.778 INFO:teuthology.orchestra.run.smithi055.stdout:(17/174): libradosstriper1-19.0.0-2145.g3be9a5c 2.8 MB/s | 501 kB 00:00 2024-03-28T05:29:28.795 INFO:teuthology.orchestra.run.smithi159.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 120 kB/s | 17 kB 00:00 2024-03-28T05:29:28.828 INFO:teuthology.orchestra.run.smithi159.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 313 kB/s | 10 kB 00:00 2024-03-28T05:29:28.853 INFO:teuthology.orchestra.run.smithi159.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-28T05:29:28.887 INFO:teuthology.orchestra.run.smithi159.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 781 kB/s | 44 kB 00:00 2024-03-28T05:29:28.937 INFO:teuthology.orchestra.run.smithi159.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-03-28T05:29:28.964 INFO:teuthology.orchestra.run.smithi086.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 2.6 MB/s | 911 kB 00:00 2024-03-28T05:29:28.987 INFO:teuthology.orchestra.run.smithi159.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.1 MB/s | 578 kB 00:00 2024-03-28T05:29:29.013 INFO:teuthology.orchestra.run.smithi159.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 666 kB/s | 46 kB 00:00 2024-03-28T05:29:29.046 INFO:teuthology.orchestra.run.smithi159.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-28T05:29:29.056 INFO:teuthology.orchestra.run.smithi086.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-03-28T05:29:29.080 INFO:teuthology.orchestra.run.smithi159.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-28T05:29:29.106 INFO:teuthology.orchestra.run.smithi086.stdout:(96/174): postgresql-13.14-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-03-28T05:29:29.114 INFO:teuthology.orchestra.run.smithi159.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-28T05:29:29.139 INFO:teuthology.orchestra.run.smithi159.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 34 kB 00:00 2024-03-28T05:29:29.282 INFO:teuthology.orchestra.run.smithi086.stdout:(97/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 4.5 MB/s | 4.1 MB 00:00 2024-03-28T05:29:29.282 INFO:teuthology.orchestra.run.smithi159.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-03-28T05:29:29.323 INFO:teuthology.orchestra.run.smithi086.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-28T05:29:29.331 INFO:teuthology.orchestra.run.smithi159.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-03-28T05:29:29.357 INFO:teuthology.orchestra.run.smithi159.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-28T05:29:29.415 INFO:teuthology.orchestra.run.smithi086.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-03-28T05:29:29.448 INFO:teuthology.orchestra.run.smithi086.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-03-28T05:29:29.482 INFO:teuthology.orchestra.run.smithi086.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 540 kB/s | 36 kB 00:00 2024-03-28T05:29:29.508 INFO:teuthology.orchestra.run.smithi086.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-03-28T05:29:29.515 INFO:teuthology.orchestra.run.smithi159.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-03-28T05:29:29.532 INFO:teuthology.orchestra.run.smithi159.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 158 kB/s | 24 kB 00:00 2024-03-28T05:29:29.558 INFO:teuthology.orchestra.run.smithi086.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-28T05:29:29.574 INFO:teuthology.orchestra.run.smithi159.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 448 kB/s | 18 kB 00:00 2024-03-28T05:29:29.607 INFO:teuthology.orchestra.run.smithi159.stdout:(62/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-28T05:29:29.616 INFO:teuthology.orchestra.run.smithi086.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 207 kB/s | 22 kB 00:00 2024-03-28T05:29:29.699 INFO:teuthology.orchestra.run.smithi159.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 32 kB 00:00 2024-03-28T05:29:29.800 INFO:teuthology.orchestra.run.smithi086.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-03-28T05:29:29.816 INFO:teuthology.orchestra.run.smithi159.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-03-28T05:29:29.842 INFO:teuthology.orchestra.run.smithi159.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-28T05:29:29.883 INFO:teuthology.orchestra.run.smithi159.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-28T05:29:29.909 INFO:teuthology.orchestra.run.smithi159.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-28T05:29:29.951 INFO:teuthology.orchestra.run.smithi159.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-28T05:29:29.963 INFO:teuthology.orchestra.run.smithi055.stdout:(18/174): ceph-osd-19.0.0-2145.g3be9a5c9.el9.x8 2.6 MB/s | 17 MB 00:06 2024-03-28T05:29:29.976 INFO:teuthology.orchestra.run.smithi159.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 3.6 MB/s | 238 kB 00:00 2024-03-28T05:29:30.018 INFO:teuthology.orchestra.run.smithi159.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-03-28T05:29:30.043 INFO:teuthology.orchestra.run.smithi159.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-28T05:29:30.083 INFO:teuthology.orchestra.run.smithi086.stdout:(106/174): postgresql-server-13.14-1.el9.x86_64 5.6 MB/s | 5.8 MB 00:01 2024-03-28T05:29:30.085 INFO:teuthology.orchestra.run.smithi159.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-28T05:29:30.110 INFO:teuthology.orchestra.run.smithi159.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 653 kB/s | 43 kB 00:00 2024-03-28T05:29:30.122 INFO:teuthology.orchestra.run.smithi055.stdout:(19/174): librgw2-19.0.0-2145.g3be9a5c9.el9.x86 3.8 MB/s | 5.1 MB 00:01 2024-03-28T05:29:30.147 INFO:teuthology.orchestra.run.smithi055.stdout:(20/174): python3-ceph-argparse-19.0.0-2145.g3b 247 kB/s | 45 kB 00:00 2024-03-28T05:29:30.202 INFO:teuthology.orchestra.run.smithi159.stdout:(74/174): python3-toml-0.10.2-6.el9.noarch.rpm 427 kB/s | 39 kB 00:00 2024-03-28T05:29:30.205 INFO:teuthology.orchestra.run.smithi055.stdout:(21/174): python3-ceph-common-19.0.0-2145.g3be9 1.6 MB/s | 131 kB 00:00 2024-03-28T05:29:30.289 INFO:teuthology.orchestra.run.smithi055.stdout:(22/174): python3-cephfs-19.0.0-2145.g3be9a5c9. 1.1 MB/s | 162 kB 00:00 2024-03-28T05:29:30.381 INFO:teuthology.orchestra.run.smithi055.stdout:(23/174): python3-rados-19.0.0-2145.g3be9a5c9.e 1.8 MB/s | 321 kB 00:00 2024-03-28T05:29:30.384 INFO:teuthology.orchestra.run.smithi086.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-03-28T05:29:30.418 INFO:teuthology.orchestra.run.smithi086.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 503 kB/s | 309 kB 00:00 2024-03-28T05:29:30.423 INFO:teuthology.orchestra.run.smithi055.stdout:(24/174): python3-rbd-19.0.0-2145.g3be9a5c9.el9 2.2 MB/s | 298 kB 00:00 2024-03-28T05:29:30.457 INFO:teuthology.orchestra.run.smithi055.stdout:(25/174): python3-rgw-19.0.0-2145.g3be9a5c9.el9 1.3 MB/s | 99 kB 00:00 2024-03-28T05:29:30.490 INFO:teuthology.orchestra.run.smithi055.stdout:(26/174): rbd-fuse-19.0.0-2145.g3be9a5c9.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-28T05:29:30.501 INFO:teuthology.orchestra.run.smithi086.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 314 kB/s | 26 kB 00:00 2024-03-28T05:29:30.552 INFO:teuthology.orchestra.run.smithi159.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-28T05:29:30.557 INFO:teuthology.orchestra.run.smithi055.stdout:(27/174): rbd-nbd-19.0.0-2145.g3be9a5c9.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-28T05:29:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 113 kB/s | 41 kB 00:00 2024-03-28T05:29:30.585 INFO:teuthology.orchestra.run.smithi086.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 589 kB/s | 49 kB 00:00 2024-03-28T05:29:30.611 INFO:teuthology.orchestra.run.smithi159.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-03-28T05:29:30.618 INFO:teuthology.orchestra.run.smithi086.stdout:(111/174): abseil-cpp-20211102.0-3.el9.x86_64.r 548 kB/s | 548 kB 00:01 2024-03-28T05:29:30.633 INFO:teuthology.orchestra.run.smithi055.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2145.g 458 kB/s | 34 kB 00:00 2024-03-28T05:29:30.661 INFO:teuthology.orchestra.run.smithi159.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 701 kB/s | 56 kB 00:00 2024-03-28T05:29:30.669 INFO:teuthology.orchestra.run.smithi086.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 814 kB/s | 67 kB 00:00 2024-03-28T05:29:30.687 INFO:teuthology.orchestra.run.smithi159.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 63 kB 00:00 2024-03-28T05:29:30.712 INFO:teuthology.orchestra.run.smithi159.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-03-28T05:29:30.716 INFO:teuthology.orchestra.run.smithi055.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2145.g3be9a5c 1.6 MB/s | 139 kB 00:00 2024-03-28T05:29:30.746 INFO:teuthology.orchestra.run.smithi159.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-28T05:29:30.779 INFO:teuthology.orchestra.run.smithi159.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-28T05:29:30.786 INFO:teuthology.orchestra.run.smithi086.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 909 kB/s | 151 kB 00:00 2024-03-28T05:29:30.846 INFO:teuthology.orchestra.run.smithi159.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-28T05:29:30.872 INFO:teuthology.orchestra.run.smithi159.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-28T05:29:30.881 INFO:teuthology.orchestra.run.smithi086.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-03-28T05:29:30.905 INFO:teuthology.orchestra.run.smithi159.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-03-28T05:29:30.939 INFO:teuthology.orchestra.run.smithi159.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2024-03-28T05:29:30.990 INFO:teuthology.orchestra.run.smithi086.stdout:(115/174): libarrow-9.0.0-10.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-03-28T05:29:31.015 INFO:teuthology.orchestra.run.smithi086.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2024-03-28T05:29:31.066 INFO:teuthology.orchestra.run.smithi086.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 431 kB/s | 32 kB 00:00 2024-03-28T05:29:31.091 INFO:teuthology.orchestra.run.smithi086.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-03-28T05:29:31.150 INFO:teuthology.orchestra.run.smithi086.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-28T05:29:31.192 INFO:teuthology.orchestra.run.smithi086.stdout:(120/174): python3-asyncssh-2.13.2-5.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-03-28T05:29:31.242 INFO:teuthology.orchestra.run.smithi086.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-03-28T05:29:31.309 INFO:teuthology.orchestra.run.smithi086.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-03-28T05:29:31.326 INFO:teuthology.orchestra.run.smithi086.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 265 kB/s | 35 kB 00:00 2024-03-28T05:29:31.350 INFO:teuthology.orchestra.run.smithi055.stdout:(30/174): rbd-mirror-19.0.0-2145.g3be9a5c9.el9. 3.5 MB/s | 3.1 MB 00:00 2024-03-28T05:29:31.359 INFO:teuthology.orchestra.run.smithi086.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-03-28T05:29:31.409 INFO:teuthology.orchestra.run.smithi055.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2145.g3be9a 2.6 MB/s | 1.8 MB 00:00 2024-03-28T05:29:31.460 INFO:teuthology.orchestra.run.smithi086.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-03-28T05:29:31.485 INFO:teuthology.orchestra.run.smithi086.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-03-28T05:29:31.510 INFO:teuthology.orchestra.run.smithi086.stdout:(127/174): python3-grpcio-tools-1.46.7-10.el9.x 788 kB/s | 144 kB 00:00 2024-03-28T05:29:31.531 INFO:teuthology.orchestra.run.smithi159.stdout:(87/174): jq-1.6-16.el9.x86_64.rpm 301 kB/s | 187 kB 00:00 2024-03-28T05:29:31.536 INFO:teuthology.orchestra.run.smithi086.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 236 kB/s | 18 kB 00:00 2024-03-28T05:29:31.551 INFO:teuthology.orchestra.run.smithi055.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2145.g3b 1.7 MB/s | 248 kB 00:00 2024-03-28T05:29:31.561 INFO:teuthology.orchestra.run.smithi086.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-03-28T05:29:31.603 INFO:teuthology.orchestra.run.smithi086.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-28T05:29:31.628 INFO:teuthology.orchestra.run.smithi086.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2024-03-28T05:29:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:(33/174): ceph-mgr-rook-19.0.0-2145.g3be9a5c9.e 544 kB/s | 49 kB 00:00 2024-03-28T05:29:31.695 INFO:teuthology.orchestra.run.smithi086.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-03-28T05:29:31.709 INFO:teuthology.orchestra.run.smithi055.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2145.g3 250 kB/s | 16 kB 00:00 2024-03-28T05:29:31.720 INFO:teuthology.orchestra.run.smithi086.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 397 kB/s | 46 kB 00:00 2024-03-28T05:29:31.739 INFO:teuthology.orchestra.run.smithi159.stdout:(88/174): libquadmath-11.4.1-3.el9.x86_64.rpm 942 kB/s | 195 kB 00:00 2024-03-28T05:29:31.746 INFO:teuthology.orchestra.run.smithi086.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 677 kB/s | 79 kB 00:00 2024-03-28T05:29:31.771 INFO:teuthology.orchestra.run.smithi086.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 773 kB/s | 58 kB 00:00 2024-03-28T05:29:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:(89/174): libgfortran-11.4.1-3.el9.x86_64.rpm 918 kB/s | 803 kB 00:00 2024-03-28T05:29:31.821 INFO:teuthology.orchestra.run.smithi086.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2024-03-28T05:29:31.826 INFO:teuthology.orchestra.run.smithi055.stdout:(35/174): ceph-volume-19.0.0-2145.g3be9a5c9.el9 2.2 MB/s | 264 kB 00:00 2024-03-28T05:29:31.846 INFO:teuthology.orchestra.run.smithi086.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-28T05:29:31.848 INFO:teuthology.orchestra.run.smithi159.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-28T05:29:31.897 INFO:teuthology.orchestra.run.smithi086.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 379 kB/s | 28 kB 00:00 2024-03-28T05:29:31.922 INFO:teuthology.orchestra.run.smithi086.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-03-28T05:29:31.924 INFO:teuthology.orchestra.run.smithi159.stdout:(91/174): elfutils-libelf-devel-0.190-2.el9.x86 199 kB/s | 21 kB 00:00 2024-03-28T05:29:31.956 INFO:teuthology.orchestra.run.smithi086.stdout:(140/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-03-28T05:29:31.957 INFO:teuthology.orchestra.run.smithi159.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 234 kB/s | 25 kB 00:00 2024-03-28T05:29:31.989 INFO:teuthology.orchestra.run.smithi086.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-28T05:29:32.023 INFO:teuthology.orchestra.run.smithi086.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 592 kB/s | 59 kB 00:00 2024-03-28T05:29:32.035 INFO:teuthology.orchestra.run.smithi055.stdout:(36/174): cephadm-19.0.0-2145.g3be9a5c9.el9.noa 3.5 MB/s | 748 kB 00:00 2024-03-28T05:29:32.073 INFO:teuthology.orchestra.run.smithi086.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-03-28T05:29:32.098 INFO:teuthology.orchestra.run.smithi086.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 472 kB/s | 51 kB 00:00 2024-03-28T05:29:32.110 INFO:teuthology.orchestra.run.smithi055.stdout:(37/174): cephfs-top-19.0.0-2145.g3be9a5c9.el9. 246 kB/s | 18 kB 00:00 2024-03-28T05:29:32.140 INFO:teuthology.orchestra.run.smithi086.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-28T05:29:32.191 INFO:teuthology.orchestra.run.smithi086.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 772 kB/s | 90 kB 00:00 2024-03-28T05:29:32.224 INFO:teuthology.orchestra.run.smithi086.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-28T05:29:32.249 INFO:teuthology.orchestra.run.smithi086.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-03-28T05:29:32.358 INFO:teuthology.orchestra.run.smithi086.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-03-28T05:29:32.395 INFO:teuthology.orchestra.run.smithi055.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 662 kB 00:00 2024-03-28T05:29:32.452 INFO:teuthology.orchestra.run.smithi086.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-03-28T05:29:32.469 INFO:teuthology.orchestra.run.smithi055.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-03-28T05:29:32.482 INFO:teuthology.orchestra.run.smithi159.stdout:(93/174): postgresql-13.14-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-03-28T05:29:32.511 INFO:teuthology.orchestra.run.smithi055.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-28T05:29:32.629 INFO:teuthology.orchestra.run.smithi055.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 307 kB 00:00 2024-03-28T05:29:32.641 INFO:teuthology.orchestra.run.smithi159.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 5.7 MB/s | 911 kB 00:00 2024-03-28T05:29:32.662 INFO:teuthology.orchestra.run.smithi055.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 978 kB/s | 32 kB 00:00 2024-03-28T05:29:32.776 INFO:teuthology.orchestra.run.smithi086.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 1.2 MB/s | 321 kB 00:00 2024-03-28T05:29:32.791 INFO:teuthology.orchestra.run.smithi159.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 893 kB/s | 133 kB 00:00 2024-03-28T05:29:32.830 INFO:teuthology.orchestra.run.smithi055.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-03-28T05:29:32.863 INFO:teuthology.orchestra.run.smithi055.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 531 kB/s | 17 kB 00:00 2024-03-28T05:29:32.905 INFO:teuthology.orchestra.run.smithi055.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 247 kB/s | 10 kB 00:00 2024-03-28T05:29:32.964 INFO:teuthology.orchestra.run.smithi055.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-28T05:29:33.014 INFO:teuthology.orchestra.run.smithi055.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2024-03-28T05:29:33.076 INFO:teuthology.orchestra.run.smithi086.stdout:(152/174): librados2-19.0.0-2145.g3be9a5c9.el9. 4.1 MB/s | 3.4 MB 00:00 2024-03-28T05:29:33.148 INFO:teuthology.orchestra.run.smithi055.stdout:(48/174): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-03-28T05:29:33.151 INFO:teuthology.orchestra.run.smithi086.stdout:(153/174): librbd1-19.0.0-2145.g3be9a5c9.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-03-28T05:29:33.190 INFO:teuthology.orchestra.run.smithi055.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 661 kB 00:00 2024-03-28T05:29:33.232 INFO:teuthology.orchestra.run.smithi055.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.4 MB/s | 578 kB 00:00 2024-03-28T05:29:33.257 INFO:teuthology.orchestra.run.smithi055.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 760 kB/s | 46 kB 00:00 2024-03-28T05:29:33.291 INFO:teuthology.orchestra.run.smithi055.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-28T05:29:33.325 INFO:teuthology.orchestra.run.smithi055.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-28T05:29:33.326 INFO:teuthology.orchestra.run.smithi086.stdout:(154/174): NetworkManager-1.47.2-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-03-28T05:29:33.351 INFO:teuthology.orchestra.run.smithi086.stdout:(155/174): NetworkManager-team-1.47.2-1.el9.x86 313 kB/s | 42 kB 00:00 2024-03-28T05:29:33.383 INFO:teuthology.orchestra.run.smithi055.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2024-03-28T05:29:33.400 INFO:teuthology.orchestra.run.smithi055.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 34 kB 00:00 2024-03-28T05:29:33.519 INFO:teuthology.orchestra.run.smithi086.stdout:(156/174): NetworkManager-libnm-1.47.2-1.el9.x8 4.2 MB/s | 1.8 MB 00:00 2024-03-28T05:29:33.544 INFO:teuthology.orchestra.run.smithi086.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 501 kB/s | 71 kB 00:00 2024-03-28T05:29:33.600 INFO:teuthology.orchestra.run.smithi159.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 2.5 MB/s | 4.1 MB 00:01 2024-03-28T05:29:33.653 INFO:teuthology.orchestra.run.smithi086.stdout:(158/174): NetworkManager-tui-1.47.2-1.el9.x86_ 764 kB/s | 248 kB 00:00 2024-03-28T05:29:33.667 INFO:teuthology.orchestra.run.smithi055.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-03-28T05:29:33.717 INFO:teuthology.orchestra.run.smithi055.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-03-28T05:29:33.728 INFO:teuthology.orchestra.run.smithi086.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 174 kB/s | 36 kB 00:00 2024-03-28T05:29:33.743 INFO:teuthology.orchestra.run.smithi055.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-28T05:29:33.853 INFO:teuthology.orchestra.run.smithi086.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 730 kB/s | 192 kB 00:00 2024-03-28T05:29:33.962 INFO:teuthology.orchestra.run.smithi086.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 124 kB/s | 23 kB 00:00 2024-03-28T05:29:34.020 INFO:teuthology.orchestra.run.smithi086.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 800 kB/s | 256 kB 00:00 2024-03-28T05:29:34.050 INFO:teuthology.orchestra.run.smithi159.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 546 kB/s | 245 kB 00:00 2024-03-28T05:29:34.154 INFO:teuthology.orchestra.run.smithi086.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 363 kB/s | 108 kB 00:00 2024-03-28T05:29:34.184 INFO:teuthology.orchestra.run.smithi159.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-03-28T05:29:34.309 INFO:teuthology.orchestra.run.smithi159.stdout:(99/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-03-28T05:29:34.327 INFO:teuthology.orchestra.run.smithi055.stdout:(59/174): ceph-test-19.0.0-2145.g3be9a5c9.el9.x 7.3 MB/s | 48 MB 00:06 2024-03-28T05:29:34.346 INFO:teuthology.orchestra.run.smithi086.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 405 kB/s | 155 kB 00:00 2024-03-28T05:29:34.381 INFO:teuthology.orchestra.run.smithi086.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 441 kB/s | 136 kB 00:00 2024-03-28T05:29:34.443 INFO:teuthology.orchestra.run.smithi159.stdout:(100/174): qatlib-service-24.02.0-1.el9.x86_64. 270 kB/s | 36 kB 00:00 2024-03-28T05:29:34.477 INFO:teuthology.orchestra.run.smithi055.stdout:(60/174): python3-babel-2.9.1-2.el9.noarch.rpm 7.6 MB/s | 5.8 MB 00:00 2024-03-28T05:29:34.489 INFO:teuthology.orchestra.run.smithi086.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 192 kB/s | 64 kB 00:00 2024-03-28T05:29:34.502 INFO:teuthology.orchestra.run.smithi055.stdout:(61/174): python3-jsonpatch-1.21-16.el9.noarch. 32 kB/s | 24 kB 00:00 2024-03-28T05:29:34.544 INFO:teuthology.orchestra.run.smithi055.stdout:(62/174): python3-jsonpointer-2.0-4.el9.noarch. 89 kB/s | 18 kB 00:00 2024-03-28T05:29:34.560 INFO:teuthology.orchestra.run.smithi159.stdout:(101/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 408 kB/s | 47 kB 00:00 2024-03-28T05:29:34.569 INFO:teuthology.orchestra.run.smithi055.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 484 kB/s | 32 kB 00:00 2024-03-28T05:29:34.581 INFO:teuthology.orchestra.run.smithi086.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 123 kB/s | 29 kB 00:00 2024-03-28T05:29:34.711 INFO:teuthology.orchestra.run.smithi159.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 626 kB/s | 94 kB 00:00 2024-03-28T05:29:34.720 INFO:teuthology.orchestra.run.smithi055.stdout:(64/174): python3-mako-1.1.4-6.el9.noarch.rpm 668 kB/s | 144 kB 00:00 2024-03-28T05:29:34.823 INFO:teuthology.orchestra.run.smithi086.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 3.2 MB/s | 1.2 MB 00:00 2024-03-28T05:29:34.844 INFO:teuthology.orchestra.run.smithi159.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 169 kB/s | 22 kB 00:00 2024-03-28T05:29:34.853 INFO:teuthology.orchestra.run.smithi055.stdout:(65/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-03-28T05:29:34.887 INFO:teuthology.orchestra.run.smithi055.stdout:(66/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 693 kB/s | 217 kB 00:00 2024-03-28T05:29:34.921 INFO:teuthology.orchestra.run.smithi055.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 936 kB/s | 174 kB 00:00 2024-03-28T05:29:34.946 INFO:teuthology.orchestra.run.smithi055.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-28T05:29:34.965 INFO:teuthology.orchestra.run.smithi086.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.2 MB/s | 2.2 MB 00:00 2024-03-28T05:29:34.971 INFO:teuthology.orchestra.run.smithi055.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 41 kB 00:00 2024-03-28T05:29:35.002 INFO:teuthology.orchestra.run.smithi159.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-03-28T05:29:35.005 INFO:teuthology.orchestra.run.smithi055.stdout:(70/174): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 238 kB 00:00 2024-03-28T05:29:35.015 INFO:teuthology.orchestra.run.smithi086.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.1 MB/s | 2.3 MB 00:00 2024-03-28T05:29:35.038 INFO:teuthology.orchestra.run.smithi055.stdout:(71/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-28T05:29:35.064 INFO:teuthology.orchestra.run.smithi055.stdout:(72/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-03-28T05:29:35.089 INFO:teuthology.orchestra.run.smithi055.stdout:(73/174): python3-pytz-2021.1-5.el9.noarch.rpm 592 kB/s | 47 kB 00:00 2024-03-28T05:29:35.115 INFO:teuthology.orchestra.run.smithi086.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 1.6 MB/s | 465 kB 00:00 2024-03-28T05:29:35.123 INFO:teuthology.orchestra.run.smithi055.stdout:(74/174): python3-requests-oauthlib-1.3.0-12.el 750 kB/s | 43 kB 00:00 2024-03-28T05:29:35.224 INFO:teuthology.orchestra.run.smithi086.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 120 kB/s | 31 kB 00:00 2024-03-28T05:29:35.382 INFO:teuthology.orchestra.run.smithi055.stdout:(75/174): python3-toml-0.10.2-6.el9.noarch.rpm 135 kB/s | 39 kB 00:00 2024-03-28T05:29:35.406 INFO:teuthology.orchestra.run.smithi055.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 151 kB/s | 41 kB 00:00 2024-03-28T05:29:35.441 INFO:teuthology.orchestra.run.smithi086.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 271 kB/s | 74 kB 00:00 2024-03-28T05:29:35.492 INFO:teuthology.orchestra.run.smithi086.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 2.6 MB/s | 1.1 MB 00:00 2024-03-28T05:29:35.501 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:29:35.502 INFO:teuthology.orchestra.run.smithi086.stdout:Total 12 MB/s | 225 MB 00:18 2024-03-28T05:29:35.544 INFO:teuthology.orchestra.run.smithi159.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-03-28T05:29:35.653 INFO:teuthology.orchestra.run.smithi159.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-03-28T05:29:35.684 INFO:teuthology.orchestra.run.smithi055.stdout:(77/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-03-28T05:29:35.715 INFO:teuthology.orchestra.run.smithi055.stdout:(78/174): socat-1.7.4.1-5.el9.x86_64.rpm 900 kB/s | 300 kB 00:00 2024-03-28T05:29:35.740 INFO:teuthology.orchestra.run.smithi055.stdout:(79/174): uuid-1.6.2-55.el9.x86_64.rpm 177 kB/s | 56 kB 00:00 2024-03-28T05:29:35.761 INFO:teuthology.orchestra.run.smithi159.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 181 kB/s | 19 kB 00:00 2024-03-28T05:29:35.782 INFO:teuthology.orchestra.run.smithi055.stdout:(80/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-28T05:29:35.808 INFO:teuthology.orchestra.run.smithi055.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2024-03-28T05:29:35.833 INFO:teuthology.orchestra.run.smithi055.stdout:(82/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 487 kB/s | 44 kB 00:00 2024-03-28T05:29:35.875 INFO:teuthology.orchestra.run.smithi055.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-28T05:29:35.917 INFO:teuthology.orchestra.run.smithi055.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-28T05:29:35.942 INFO:teuthology.orchestra.run.smithi055.stdout:(85/174): python3-ply-3.11-14.el9.noarch.rpm 957 kB/s | 103 kB 00:00 2024-03-28T05:29:35.984 INFO:teuthology.orchestra.run.smithi055.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 4.6 MB/s | 187 kB 00:00 2024-03-28T05:29:36.009 INFO:teuthology.orchestra.run.smithi055.stdout:(87/174): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 124 kB 00:00 2024-03-28T05:29:36.143 INFO:teuthology.orchestra.run.smithi055.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 942 kB/s | 187 kB 00:00 2024-03-28T05:29:36.145 INFO:teuthology.orchestra.run.smithi159.stdout:(108/174): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-28T05:29:36.202 INFO:teuthology.orchestra.run.smithi055.stdout:(89/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-28T05:29:36.237 INFO:teuthology.orchestra.run.smithi159.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 285 kB/s | 26 kB 00:00 2024-03-28T05:29:36.260 INFO:teuthology.orchestra.run.smithi055.stdout:(90/174): libquadmath-11.4.1-3.el9.x86_64.rpm 782 kB/s | 195 kB 00:00 2024-03-28T05:29:36.337 INFO:teuthology.orchestra.run.smithi159.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 489 kB/s | 49 kB 00:00 2024-03-28T05:29:36.344 INFO:teuthology.orchestra.run.smithi055.stdout:(91/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-03-28T05:29:36.429 INFO:teuthology.orchestra.run.smithi159.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 740 kB/s | 67 kB 00:00 2024-03-28T05:29:36.530 INFO:teuthology.orchestra.run.smithi159.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-03-28T05:29:36.655 INFO:teuthology.orchestra.run.smithi159.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.6 MB/s | 838 kB 00:00 2024-03-28T05:29:36.764 INFO:teuthology.orchestra.run.smithi159.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-03-28T05:29:36.864 INFO:teuthology.orchestra.run.smithi159.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 438 kB/s | 43 kB 00:00 2024-03-28T05:29:36.869 INFO:teuthology.orchestra.run.smithi055.stdout:(92/174): elfutils-libelf-devel-0.190-2.el9.x86 32 kB/s | 21 kB 00:00 2024-03-28T05:29:36.953 INFO:teuthology.orchestra.run.smithi055.stdout:(93/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 37 kB/s | 25 kB 00:00 2024-03-28T05:29:36.964 INFO:teuthology.orchestra.run.smithi159.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 324 kB/s | 32 kB 00:00 2024-03-28T05:29:37.065 INFO:teuthology.orchestra.run.smithi159.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 151 kB/s | 15 kB 00:00 2024-03-28T05:29:37.149 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-03-28T05:29:37.156 INFO:teuthology.orchestra.run.smithi159.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-03-28T05:29:37.265 INFO:teuthology.orchestra.run.smithi159.stdout:(119/174): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-03-28T05:29:37.390 INFO:teuthology.orchestra.run.smithi159.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-03-28T05:29:37.491 INFO:teuthology.orchestra.run.smithi159.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 356 kB/s | 35 kB 00:00 2024-03-28T05:29:37.526 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-03-28T05:29:37.527 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-03-28T05:29:37.591 INFO:teuthology.orchestra.run.smithi159.stdout:(122/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-28T05:29:38.541 INFO:teuthology.orchestra.run.smithi159.stdout:(123/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-03-28T05:29:38.641 INFO:teuthology.orchestra.run.smithi159.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-03-28T05:29:38.742 INFO:teuthology.orchestra.run.smithi159.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-03-28T05:29:38.803 INFO:teuthology.orchestra.run.smithi055.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 493 kB/s | 911 kB 00:01 2024-03-28T05:29:38.842 INFO:teuthology.orchestra.run.smithi159.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2024-03-28T05:29:38.942 INFO:teuthology.orchestra.run.smithi159.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-03-28T05:29:39.034 INFO:teuthology.orchestra.run.smithi159.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2024-03-28T05:29:39.135 INFO:teuthology.orchestra.run.smithi159.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2024-03-28T05:29:39.260 INFO:teuthology.orchestra.run.smithi159.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-03-28T05:29:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 507 kB/s | 46 kB 00:00 2024-03-28T05:29:39.453 INFO:teuthology.orchestra.run.smithi159.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 794 kB/s | 79 kB 00:00 2024-03-28T05:29:39.545 INFO:teuthology.orchestra.run.smithi159.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 634 kB/s | 58 kB 00:00 2024-03-28T05:29:39.645 INFO:teuthology.orchestra.run.smithi055.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 159 kB/s | 133 kB 00:00 2024-03-28T05:29:39.653 INFO:teuthology.orchestra.run.smithi159.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-03-28T05:29:39.696 INFO:teuthology.orchestra.run.smithi055.stdout:(96/174): postgresql-13.14-1.el9.x86_64.rpm 576 kB/s | 1.6 MB 00:02 2024-03-28T05:29:39.754 INFO:teuthology.orchestra.run.smithi159.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-03-28T05:29:39.854 INFO:teuthology.orchestra.run.smithi159.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 906 kB/s | 90 kB 00:00 2024-03-28T05:29:39.890 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-03-28T05:29:39.891 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-03-28T05:29:39.954 INFO:teuthology.orchestra.run.smithi159.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 284 kB/s | 28 kB 00:00 2024-03-28T05:29:40.054 INFO:teuthology.orchestra.run.smithi159.stdout:(138/174): python3-repoze-lru-0.7-16.el9.noarch 310 kB/s | 31 kB 00:00 2024-03-28T05:29:40.155 INFO:teuthology.orchestra.run.smithi159.stdout:(139/174): python3-routes-2.5.1-5.el9.noarch.rp 1.9 MB/s | 188 kB 00:00 2024-03-28T05:29:40.272 INFO:teuthology.orchestra.run.smithi159.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 510 kB/s | 59 kB 00:00 2024-03-28T05:29:40.372 INFO:teuthology.orchestra.run.smithi159.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 360 kB/s | 36 kB 00:00 2024-03-28T05:29:40.472 INFO:teuthology.orchestra.run.smithi159.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 513 kB/s | 51 kB 00:00 2024-03-28T05:29:40.564 INFO:teuthology.orchestra.run.smithi159.stdout:(143/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-03-28T05:29:40.663 INFO:teuthology.orchestra.run.smithi159.stdout:(144/174): python3-websocket-client-1.2.3-2.el9 921 kB/s | 90 kB 00:00 2024-03-28T05:29:40.671 INFO:teuthology.orchestra.run.smithi055.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 252 kB/s | 245 kB 00:00 2024-03-28T05:29:40.771 INFO:teuthology.orchestra.run.smithi159.stdout:(145/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2024-03-28T05:29:40.872 INFO:teuthology.orchestra.run.smithi159.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 201 kB/s | 20 kB 00:00 2024-03-28T05:29:40.972 INFO:teuthology.orchestra.run.smithi159.stdout:(147/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-28T05:29:41.165 INFO:teuthology.orchestra.run.smithi159.stdout:(148/174): postgresql-server-13.14-1.el9.x86_64 707 kB/s | 5.8 MB 00:08 2024-03-28T05:29:41.240 INFO:teuthology.orchestra.run.smithi159.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-03-28T05:29:41.646 INFO:teuthology.orchestra.run.smithi055.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 255 kB/s | 248 kB 00:00 2024-03-28T05:29:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:(150/174): ceph-test-19.0.0-2145.g3be9a5c9.el9. 3.0 MB/s | 48 MB 00:15 2024-03-28T05:29:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-03-28T05:29:42.141 INFO:teuthology.orchestra.run.smithi159.stdout:(152/174): librados2-19.0.0-2145.g3be9a5c9.el9. 3.5 MB/s | 3.4 MB 00:00 2024-03-28T05:29:42.250 INFO:teuthology.orchestra.run.smithi159.stdout:(153/174): librbd1-19.0.0-2145.g3be9a5c9.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-03-28T05:29:42.297 INFO:teuthology.orchestra.run.smithi055.stdout:(99/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 711 kB/s | 4.1 MB 00:05 2024-03-28T05:29:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:(154/174): NetworkManager-1.47.2-1.el9.x86_64.r 4.9 MB/s | 2.3 MB 00:00 2024-03-28T05:29:42.516 INFO:teuthology.orchestra.run.smithi159.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 2.3 MB/s | 248 kB 00:00 2024-03-28T05:29:42.625 INFO:teuthology.orchestra.run.smithi159.stdout:(156/174): NetworkManager-team-1.47.2-1.el9.x86 112 kB/s | 42 kB 00:00 2024-03-28T05:29:42.630 INFO:teuthology.orchestra.run.smithi055.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 225 kB/s | 221 kB 00:00 2024-03-28T05:29:42.650 INFO:teuthology.orchestra.run.smithi159.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 536 kB/s | 71 kB 00:00 2024-03-28T05:29:42.759 INFO:teuthology.orchestra.run.smithi159.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-03-28T05:29:42.826 INFO:teuthology.orchestra.run.smithi159.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 182 kB/s | 36 kB 00:00 2024-03-28T05:29:42.876 INFO:teuthology.orchestra.run.smithi159.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-03-28T05:29:42.952 INFO:teuthology.orchestra.run.smithi159.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 185 kB/s | 23 kB 00:00 2024-03-28T05:29:42.964 INFO:teuthology.orchestra.run.smithi055.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 54 kB/s | 36 kB 00:00 2024-03-28T05:29:42.993 INFO:teuthology.orchestra.run.smithi159.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 932 kB/s | 108 kB 00:00 2024-03-28T05:29:43.137 INFO:teuthology.orchestra.run.smithi159.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 952 kB/s | 136 kB 00:00 2024-03-28T05:29:43.211 INFO:teuthology.orchestra.run.smithi159.stdout:(164/174): NetworkManager-libnm-1.47.2-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-03-28T05:29:43.236 INFO:teuthology.orchestra.run.smithi159.stdout:(165/174): libfdisk-2.37.4-18.el9.x86_64.rpm 546 kB/s | 155 kB 00:00 2024-03-28T05:29:43.286 INFO:teuthology.orchestra.run.smithi159.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 431 kB/s | 64 kB 00:00 2024-03-28T05:29:43.311 INFO:teuthology.orchestra.run.smithi159.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 287 kB/s | 29 kB 00:00 2024-03-28T05:29:43.331 INFO:teuthology.orchestra.run.smithi055.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 68 kB/s | 47 kB 00:00 2024-03-28T05:29:43.431 INFO:teuthology.orchestra.run.smithi055.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 233 kB/s | 22 kB 00:00 2024-03-28T05:29:43.639 INFO:teuthology.orchestra.run.smithi159.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.0 MB/s | 2.3 MB 00:00 2024-03-28T05:29:43.679 INFO:teuthology.orchestra.run.smithi159.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 2.7 MB/s | 1.2 MB 00:00 2024-03-28T05:29:43.684 INFO:teuthology.orchestra.run.smithi055.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-03-28T05:29:43.741 INFO:teuthology.orchestra.run.smithi159.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.8 MB/s | 2.2 MB 00:00 2024-03-28T05:29:43.771 INFO:teuthology.orchestra.run.smithi159.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 3.4 MB/s | 465 kB 00:00 2024-03-28T05:29:43.773 INFO:teuthology.orchestra.run.smithi055.stdout:(105/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 116 kB/s | 94 kB 00:00 2024-03-28T05:29:43.797 INFO:teuthology.orchestra.run.smithi159.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 267 kB/s | 31 kB 00:00 2024-03-28T05:29:43.880 INFO:teuthology.orchestra.run.smithi159.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 688 kB/s | 74 kB 00:00 2024-03-28T05:29:44.022 INFO:teuthology.orchestra.run.smithi159.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.8 MB/s | 1.1 MB 00:00 2024-03-28T05:29:44.032 INFO:teuthology.orchestra.run.smithi055.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-03-28T05:29:44.033 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:29:44.033 INFO:teuthology.orchestra.run.smithi159.stdout:Total 9.2 MB/s | 225 MB 00:24 2024-03-28T05:29:44.099 INFO:teuthology.orchestra.run.smithi055.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 954 kB/s | 309 kB 00:00 2024-03-28T05:29:44.124 INFO:teuthology.orchestra.run.smithi055.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-03-28T05:29:44.191 INFO:teuthology.orchestra.run.smithi055.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 397 kB/s | 26 kB 00:00 2024-03-28T05:29:44.258 INFO:teuthology.orchestra.run.smithi055.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 736 kB/s | 49 kB 00:00 2024-03-28T05:29:44.333 INFO:teuthology.orchestra.run.smithi055.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 907 kB/s | 67 kB 00:00 2024-03-28T05:29:44.425 INFO:teuthology.orchestra.run.smithi055.stdout:(112/174): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-03-28T05:29:44.450 INFO:teuthology.orchestra.run.smithi055.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-28T05:29:44.517 INFO:teuthology.orchestra.run.smithi055.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2024-03-28T05:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 661 kB/s | 43 kB 00:00 2024-03-28T05:29:44.618 INFO:teuthology.orchestra.run.smithi055.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-03-28T05:29:44.652 INFO:teuthology.orchestra.run.smithi055.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 485 kB/s | 32 kB 00:00 2024-03-28T05:29:44.686 INFO:teuthology.orchestra.run.smithi055.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2024-03-28T05:29:44.719 INFO:teuthology.orchestra.run.smithi055.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-28T05:29:44.769 INFO:teuthology.orchestra.run.smithi055.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-28T05:29:44.812 INFO:teuthology.orchestra.run.smithi055.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-03-28T05:29:44.828 INFO:teuthology.orchestra.run.smithi055.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 607 kB/s | 35 kB 00:00 2024-03-28T05:29:44.913 INFO:teuthology.orchestra.run.smithi055.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-28T05:29:45.013 INFO:teuthology.orchestra.run.smithi055.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-03-28T05:29:45.038 INFO:teuthology.orchestra.run.smithi055.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-03-28T05:29:45.080 INFO:teuthology.orchestra.run.smithi055.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-03-28T05:29:45.105 INFO:teuthology.orchestra.run.smithi055.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 267 kB/s | 18 kB 00:00 2024-03-28T05:29:45.147 INFO:teuthology.orchestra.run.smithi055.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 350 kB/s | 23 kB 00:00 2024-03-28T05:29:45.173 INFO:teuthology.orchestra.run.smithi055.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 293 kB/s | 19 kB 00:00 2024-03-28T05:29:45.214 INFO:teuthology.orchestra.run.smithi055.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 297 kB/s | 20 kB 00:00 2024-03-28T05:29:45.273 INFO:teuthology.orchestra.run.smithi055.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-28T05:29:45.298 INFO:teuthology.orchestra.run.smithi055.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 560 kB/s | 46 kB 00:00 2024-03-28T05:29:45.340 INFO:teuthology.orchestra.run.smithi055.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-28T05:29:45.366 INFO:teuthology.orchestra.run.smithi055.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 871 kB/s | 58 kB 00:00 2024-03-28T05:29:45.416 INFO:teuthology.orchestra.run.smithi055.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-03-28T05:29:45.441 INFO:teuthology.orchestra.run.smithi055.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-03-28T05:29:45.483 INFO:teuthology.orchestra.run.smithi055.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-28T05:29:45.509 INFO:teuthology.orchestra.run.smithi055.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 425 kB/s | 28 kB 00:00 2024-03-28T05:29:45.551 INFO:teuthology.orchestra.run.smithi055.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 462 kB/s | 31 kB 00:00 2024-03-28T05:29:45.584 INFO:teuthology.orchestra.run.smithi055.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-03-28T05:29:45.618 INFO:teuthology.orchestra.run.smithi055.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 894 kB/s | 59 kB 00:00 2024-03-28T05:29:45.652 INFO:teuthology.orchestra.run.smithi055.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 540 kB/s | 36 kB 00:00 2024-03-28T05:29:45.685 INFO:teuthology.orchestra.run.smithi055.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 770 kB/s | 51 kB 00:00 2024-03-28T05:29:45.695 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-03-28T05:29:45.727 INFO:teuthology.orchestra.run.smithi055.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-28T05:29:45.752 INFO:teuthology.orchestra.run.smithi055.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-28T05:29:45.803 INFO:teuthology.orchestra.run.smithi055.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-03-28T05:29:45.837 INFO:teuthology.orchestra.run.smithi055.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-03-28T05:29:45.879 INFO:teuthology.orchestra.run.smithi055.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-28T05:29:45.954 INFO:teuthology.orchestra.run.smithi055.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-03-28T05:29:46.080 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-03-28T05:29:46.080 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-03-28T05:29:46.634 INFO:teuthology.orchestra.run.smithi055.stdout:(150/174): librados2-19.0.0-2145.g3be9a5c9.el9. 4.5 MB/s | 3.4 MB 00:00 2024-03-28T05:29:46.676 INFO:teuthology.orchestra.run.smithi055.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-28T05:29:46.785 INFO:teuthology.orchestra.run.smithi055.stdout:(152/174): librbd1-19.0.0-2145.g3be9a5c9.el9.x8 3.8 MB/s | 3.1 MB 00:00 2024-03-28T05:29:47.035 INFO:teuthology.orchestra.run.smithi055.stdout:(153/174): NetworkManager-1.47.2-1.el9.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2024-03-28T05:29:47.094 INFO:teuthology.orchestra.run.smithi055.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 733 kB/s | 42 kB 00:00 2024-03-28T05:29:47.152 INFO:teuthology.orchestra.run.smithi055.stdout:(155/174): NetworkManager-libnm-1.47.2-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-03-28T05:29:47.218 INFO:teuthology.orchestra.run.smithi055.stdout:(156/174): NetworkManager-tui-1.47.2-1.el9.x86_ 2.0 MB/s | 248 kB 00:00 2024-03-28T05:29:47.253 INFO:teuthology.orchestra.run.smithi055.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 718 kB/s | 71 kB 00:00 2024-03-28T05:29:47.278 INFO:teuthology.orchestra.run.smithi055.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 609 kB/s | 36 kB 00:00 2024-03-28T05:29:47.321 INFO:teuthology.orchestra.run.smithi055.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-28T05:29:47.354 INFO:teuthology.orchestra.run.smithi055.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.4 MB/s | 256 kB 00:00 2024-03-28T05:29:47.379 INFO:teuthology.orchestra.run.smithi055.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 398 kB/s | 23 kB 00:00 2024-03-28T05:29:47.413 INFO:teuthology.orchestra.run.smithi055.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-03-28T05:29:47.438 INFO:teuthology.orchestra.run.smithi055.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-03-28T05:29:47.472 INFO:teuthology.orchestra.run.smithi055.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-28T05:29:47.497 INFO:teuthology.orchestra.run.smithi055.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-28T05:29:47.531 INFO:teuthology.orchestra.run.smithi055.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 496 kB/s | 29 kB 00:00 2024-03-28T05:29:47.593 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-03-28T05:29:47.623 INFO:teuthology.orchestra.run.smithi055.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-28T05:29:47.707 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-28T05:29:47.747 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-28T05:29:47.748 INFO:teuthology.orchestra.run.smithi055.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2024-03-28T05:29:47.777 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:29:47.821 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:29:47.849 INFO:teuthology.orchestra.run.smithi055.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2024-03-28T05:29:47.883 INFO:teuthology.orchestra.run.smithi055.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.4 MB/s | 465 kB 00:00 2024-03-28T05:29:47.928 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-28T05:29:48.004 INFO:teuthology.orchestra.run.smithi055.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 201 kB/s | 31 kB 00:00 2024-03-28T05:29:48.045 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-28T05:29:48.103 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-28T05:29:48.133 INFO:teuthology.orchestra.run.smithi055.stdout:(172/174): postgresql-server-13.14-1.el9.x86_64 697 kB/s | 5.8 MB 00:08 2024-03-28T05:29:48.134 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-28T05:29:48.200 INFO:teuthology.orchestra.run.smithi055.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 3.4 MB/s | 1.1 MB 00:00 2024-03-28T05:29:48.218 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-28T05:29:48.657 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-28T05:29:48.719 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-03-28T05:29:48.719 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-03-28T05:29:48.740 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:29:48.800 INFO:teuthology.orchestra.run.smithi055.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 94 kB/s | 74 kB 00:00 2024-03-28T05:29:48.809 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:29:48.809 INFO:teuthology.orchestra.run.smithi055.stdout:Total 7.3 MB/s | 225 MB 00:30 2024-03-28T05:29:48.894 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:29:48.933 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:29:49.057 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:29:49.098 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:29:49.165 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-28T05:29:49.455 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-28T05:29:49.514 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-28T05:29:49.538 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:29:49.688 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:29:49.714 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:29:49.803 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:29:49.882 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-28T05:29:49.907 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:29:49.971 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:29:50.322 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:29:50.383 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:29:50.433 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-28T05:29:50.478 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-03-28T05:29:50.772 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-28T05:29:50.845 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-03-28T05:29:50.845 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-03-28T05:29:50.949 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:29:51.054 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:29:51.252 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:29:51.301 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:29:51.610 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:29:51.796 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-28T05:29:51.935 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-28T05:29:51.974 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-28T05:29:52.002 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-28T05:29:52.058 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-28T05:29:52.171 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-28T05:29:52.256 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-28T05:29:52.299 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-28T05:29:52.388 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-28T05:29:52.429 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-28T05:29:52.489 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-28T05:29:52.525 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-28T05:29:52.557 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-28T05:29:52.691 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-28T05:29:52.728 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 39/198 2024-03-28T05:29:52.793 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 40/198 2024-03-28T05:29:52.829 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 41/198 2024-03-28T05:29:52.948 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-28T05:29:53.032 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-28T05:29:53.133 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-28T05:29:53.342 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-03-28T05:29:53.342 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-03-28T05:29:53.404 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-28T05:29:53.475 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-28T05:29:54.152 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-28T05:29:54.246 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-28T05:29:54.372 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-28T05:29:54.440 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:29:54.468 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:29:54.516 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-28T05:29:54.596 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-28T05:29:54.648 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 53/198 2024-03-28T05:29:54.688 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-28T05:29:55.104 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-28T05:29:55.295 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-28T05:29:55.426 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-28T05:29:55.475 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-28T05:29:55.675 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-28T05:29:55.749 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-28T05:29:55.834 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-28T05:29:55.929 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-28T05:29:55.964 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-28T05:29:56.003 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-28T05:29:56.005 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-03-28T05:29:56.070 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-28T05:29:56.113 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-28T05:29:56.121 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-28T05:29:56.161 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-28T05:29:56.182 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-28T05:29:56.199 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:29:56.240 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-28T05:29:56.243 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:29:56.330 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-28T05:29:56.428 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-28T05:29:56.432 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-28T05:29:56.485 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-28T05:29:56.492 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-28T05:29:56.523 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-28T05:29:56.556 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-28T05:29:56.575 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-28T05:29:56.614 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-28T05:29:56.757 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-28T05:29:56.804 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-28T05:29:56.842 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-28T05:29:56.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-28T05:29:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-28T05:29:56.954 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-28T05:29:57.023 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:29:57.096 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-28T05:29:57.174 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:29:57.198 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:29:57.279 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-28T05:29:57.320 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:29:57.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:29:57.412 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-28T05:29:57.439 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-28T05:29:57.494 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-28T05:29:57.556 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-28T05:29:57.630 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-28T05:29:57.707 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-28T05:29:57.760 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-28T05:29:57.787 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:29:57.875 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-28T05:29:57.927 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:29:57.930 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-28T05:29:57.955 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:29:58.044 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:29:58.094 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-28T05:29:58.098 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-28T05:29:58.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:29:58.144 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-28T05:29:58.184 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-28T05:29:58.185 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:29:58.214 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T05:29:58.254 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-28T05:29:58.300 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-28T05:29:58.358 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-28T05:29:58.408 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-28T05:29:58.450 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-28T05:29:58.494 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:29:58.574 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:29:58.606 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-28T05:29:58.615 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-28T05:29:58.656 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-28T05:29:58.691 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-28T05:29:58.756 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-28T05:29:58.802 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-28T05:29:58.922 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-28T05:29:58.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-28T05:29:59.048 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-28T05:29:59.107 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-28T05:29:59.122 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:29:59.142 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-28T05:29:59.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-28T05:29:59.219 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:29:59.337 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-28T05:29:59.399 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-28T05:29:59.420 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:29:59.467 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:29:59.839 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:30:00.024 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-28T05:30:00.142 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-28T05:30:00.182 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-28T05:30:00.217 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-28T05:30:00.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-28T05:30:00.366 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-28T05:30:00.385 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-28T05:30:00.415 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-28T05:30:00.456 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-28T05:30:00.481 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-28T05:30:00.523 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-28T05:30:00.543 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-28T05:30:00.621 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-28T05:30:00.664 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-28T05:30:00.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-28T05:30:00.707 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-28T05:30:00.725 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-03-28T05:30:00.725 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-28T05:30:00.766 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-28T05:30:00.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-28T05:30:00.800 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-28T05:30:00.848 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-28T05:30:00.903 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:30:00.905 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-28T05:30:00.946 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 39/198 2024-03-28T05:30:00.947 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-28T05:30:00.950 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-28T05:30:00.979 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-28T05:30:01.009 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 40/198 2024-03-28T05:30:01.035 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-28T05:30:01.044 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 41/198 2024-03-28T05:30:01.074 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-28T05:30:01.147 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-28T05:30:01.164 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-28T05:30:01.196 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-28T05:30:01.222 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-28T05:30:01.227 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-28T05:30:01.314 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-28T05:30:01.320 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-28T05:30:01.493 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-28T05:30:01.558 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-28T05:30:01.742 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-28T05:30:01.782 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:30:01.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-28T05:30:01.940 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:30:01.966 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:30:02.006 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-28T05:30:02.088 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:30:02.123 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:30:02.203 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-28T05:30:02.250 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-28T05:30:02.339 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-28T05:30:02.503 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-28T05:30:02.515 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-28T05:30:02.554 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-28T05:30:02.565 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:30:02.579 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:30:02.596 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:30:02.639 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-28T05:30:02.704 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-28T05:30:02.731 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:30:02.758 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 53/198 2024-03-28T05:30:02.763 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:30:02.798 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-28T05:30:02.854 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-28T05:30:02.899 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-28T05:30:02.924 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:30:02.991 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-28T05:30:03.174 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-28T05:30:03.279 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:30:03.361 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-28T05:30:03.405 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-28T05:30:03.416 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-28T05:30:03.495 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-28T05:30:03.499 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-28T05:30:03.552 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-28T05:30:03.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-28T05:30:03.671 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-28T05:30:03.701 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-28T05:30:03.742 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-28T05:30:03.747 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-28T05:30:03.776 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-28T05:30:03.808 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-28T05:30:03.883 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-28T05:30:03.897 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:30:03.977 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-28T05:30:03.987 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-28T05:30:04.024 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-28T05:30:04.072 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-28T05:30:04.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-28T05:30:04.141 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-28T05:30:04.156 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-28T05:30:04.191 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:30:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-28T05:30:04.250 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:30:04.308 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:04.311 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-28T05:30:04.328 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 125/198 2024-03-28T05:30:04.407 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-28T05:30:04.500 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-28T05:30:04.553 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-28T05:30:04.584 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-28T05:30:04.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-28T05:30:04.638 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-28T05:30:04.766 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-28T05:30:04.773 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-28T05:30:04.806 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-28T05:30:04.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-28T05:30:04.880 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-28T05:30:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-28T05:30:04.913 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-28T05:30:04.919 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-28T05:30:04.932 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-28T05:30:04.950 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:04.968 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-28T05:30:05.028 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-28T05:30:05.041 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:05.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-28T05:30:05.069 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 129/198 2024-03-28T05:30:05.143 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-28T05:30:05.215 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-28T05:30:05.245 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-28T05:30:05.265 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-28T05:30:05.359 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-28T05:30:05.388 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-28T05:30:05.420 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-28T05:30:05.440 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-28T05:30:05.486 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-28T05:30:05.503 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-28T05:30:05.535 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-28T05:30:05.568 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-28T05:30:05.575 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-28T05:30:05.698 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-28T05:30:05.746 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 39/198 2024-03-28T05:30:05.806 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 40/198 2024-03-28T05:30:05.817 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-28T05:30:05.843 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 41/198 2024-03-28T05:30:05.870 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-28T05:30:05.948 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-28T05:30:06.011 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-28T05:30:06.041 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-28T05:30:06.083 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-28T05:30:06.115 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-28T05:30:06.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-28T05:30:06.162 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T05:30:06.229 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-28T05:30:06.276 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-28T05:30:06.296 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-28T05:30:06.362 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-28T05:30:06.363 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-28T05:30:06.421 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-28T05:30:06.468 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-28T05:30:06.556 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-28T05:30:06.596 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-28T05:30:06.630 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-28T05:30:06.679 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-28T05:30:06.715 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-28T05:30:06.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-28T05:30:06.954 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-28T05:30:07.015 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-28T05:30:07.058 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-28T05:30:07.093 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-28T05:30:07.115 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-28T05:30:07.195 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-28T05:30:07.263 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-28T05:30:07.305 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-28T05:30:07.333 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-28T05:30:07.355 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:30:07.383 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-28T05:30:07.428 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-28T05:30:07.491 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-28T05:30:07.545 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 53/198 2024-03-28T05:30:07.587 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-28T05:30:08.012 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-28T05:30:08.265 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:08.270 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-28T05:30:08.299 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-28T05:30:08.324 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:08.352 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-28T05:30:08.374 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-28T05:30:08.408 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-28T05:30:08.416 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-28T05:30:08.468 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-28T05:30:08.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-28T05:30:08.624 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-28T05:30:08.635 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-28T05:30:08.689 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-28T05:30:08.768 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-28T05:30:08.863 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-28T05:30:08.866 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-28T05:30:08.896 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-28T05:30:08.905 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-28T05:30:08.945 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-28T05:30:08.954 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:08.989 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-28T05:30:09.002 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:09.016 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-28T05:30:09.062 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-28T05:30:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-28T05:30:09.221 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-28T05:30:09.233 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:09.234 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-28T05:30:09.234 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-28T05:30:09.234 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:09.286 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:09.426 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-28T05:30:09.485 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-28T05:30:09.523 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-28T05:30:09.591 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-28T05:30:09.738 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-28T05:30:09.778 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-28T05:30:09.779 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-28T05:30:09.828 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-28T05:30:09.862 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-28T05:30:09.895 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-28T05:30:09.915 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-28T05:30:10.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-28T05:30:10.244 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-28T05:30:10.382 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-28T05:30:10.439 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-28T05:30:10.501 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-28T05:30:10.577 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-28T05:30:10.829 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-28T05:30:10.893 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-28T05:30:11.069 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-28T05:30:11.115 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-28T05:30:11.156 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-28T05:30:11.194 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-28T05:30:11.235 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-28T05:30:11.281 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-28T05:30:11.350 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-28T05:30:11.422 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-28T05:30:11.433 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-28T05:30:11.483 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-28T05:30:11.509 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-28T05:30:11.546 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-28T05:30:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-28T05:30:11.597 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-28T05:30:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-28T05:30:11.635 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-28T05:30:11.670 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-28T05:30:11.723 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-28T05:30:11.765 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-28T05:30:11.913 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-28T05:30:11.994 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-28T05:30:12.016 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:12.034 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-28T05:30:12.087 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-28T05:30:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:12.131 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-28T05:30:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 125/198 2024-03-28T05:30:12.191 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-28T05:30:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-28T05:30:12.343 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-28T05:30:12.405 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-28T05:30:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-28T05:30:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:13.329 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:13.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 129/198 2024-03-28T05:30:13.426 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-28T05:30:13.480 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-28T05:30:13.513 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-28T05:30:13.582 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-28T05:30:13.699 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-28T05:30:13.739 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-28T05:30:13.990 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-28T05:30:14.019 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-28T05:30:14.126 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-28T05:30:15.031 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-28T05:30:15.170 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-28T05:30:15.953 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:16.009 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:16.638 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:16.679 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:16.784 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-28T05:30:16.841 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:16.841 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-28T05:30:16.841 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-28T05:30:16.841 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:16.874 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-28T05:30:16.896 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:16.911 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-28T05:30:16.942 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-28T05:30:16.974 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-28T05:30:17.372 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-28T05:30:17.397 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:17.502 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-28T05:30:17.537 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 125/198 2024-03-28T05:30:17.591 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-28T05:30:18.132 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-28T05:30:18.158 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-28T05:30:18.310 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 129/198 2024-03-28T05:30:20.933 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:20.974 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:21.632 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-28T05:30:21.677 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:21.845 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-28T05:30:21.845 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-28T05:30:21.846 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-28T05:30:21.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:21.878 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:22.192 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:22.192 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-03-28T05:30:22.192 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-03-28T05:30:22.192 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-03-28T05:30:22.193 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-03-28T05:30:22.193 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-03-28T05:30:22.193 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-03-28T05:30:22.193 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-03-28T05:30:22.193 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:22.423 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:22.471 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:22.471 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-28T05:30:22.471 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:24.186 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:24.187 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:24.187 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-28T05:30:24.187 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:24.187 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:24.187 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:24.485 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:24.558 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-28T05:30:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:24.559 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:24.559 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:25.051 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:25.130 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:25.236 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-28T05:30:25.892 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:25.937 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:25.990 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 139/198 2024-03-28T05:30:26.089 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 140/198 2024-03-28T05:30:26.124 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:26.456 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:26.492 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:27.619 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:27.650 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:27.792 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:27.990 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 144/198 2024-03-28T05:30:28.044 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:28.111 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:28.111 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:28.111 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-28T05:30:28.111 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:28.112 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:28.112 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:28.170 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:28.208 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:28.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 147/198 2024-03-28T05:30:29.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-28T05:30:29.338 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:29.415 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:29.464 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:29.552 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:29.552 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-28T05:30:29.552 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:29.623 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:29.696 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:29.696 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:29.696 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-28T05:30:29.696 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:29.696 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:29.697 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:29.722 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:29.722 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-03-28T05:30:29.722 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-03-28T05:30:29.723 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:29.929 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:29.977 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:29.977 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:29.977 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-28T05:30:29.977 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:30.090 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:30.163 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:31.530 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:31.612 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:31.612 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:31.612 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-28T05:30:31.612 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:31.612 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:31.613 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:31.958 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:31.958 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-28T05:30:31.958 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:31.959 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:32.536 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:32.536 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-28T05:30:32.536 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:32.536 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:32.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-28T05:30:33.306 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:33.334 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:33.386 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 139/198 2024-03-28T05:30:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 140/198 2024-03-28T05:30:33.496 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:33.821 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:34.971 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:34.972 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:35.006 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:35.025 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 154/198 2024-03-28T05:30:35.093 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 155/198 2024-03-28T05:30:35.133 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-28T05:30:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:35.319 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 144/198 2024-03-28T05:30:35.346 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-28T05:30:35.346 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-03-28T05:30:35.346 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-03-28T05:30:35.346 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-03-28T05:30:35.347 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-03-28T05:30:35.347 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-03-28T05:30:35.347 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-03-28T05:30:35.347 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-03-28T05:30:35.347 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:35.358 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:35.419 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 157/198 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:35.427 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:35.484 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:35.520 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:35.568 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-28T05:30:35.596 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:35.602 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 147/198 2024-03-28T05:30:35.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 159/198 2024-03-28T05:30:35.641 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-28T05:30:35.641 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:35.641 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-28T05:30:35.641 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:35.678 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-28T05:30:35.770 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-28T05:30:35.840 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-28T05:30:35.906 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 163/198 2024-03-28T05:30:35.978 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-28T05:30:36.029 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-28T05:30:36.133 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-28T05:30:36.263 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-28T05:30:36.346 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-28T05:30:36.551 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-28T05:30:36.586 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:36.654 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:36.654 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:36.654 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-28T05:30:36.654 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:36.654 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:36.655 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:36.712 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:36.807 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:36.808 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:36.808 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-28T05:30:36.808 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:36.983 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:36.983 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-28T05:30:36.983 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:36.984 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:37.186 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:37.233 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:37.287 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:37.323 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:37.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-28T05:30:37.422 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:37.423 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:37.681 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-28T05:30:37.759 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:38.273 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-28T05:30:38.342 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:38.459 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-28T05:30:38.603 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 170/198 2024-03-28T05:30:38.712 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-28T05:30:38.765 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-28T05:30:38.885 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-28T05:30:38.922 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-28T05:30:38.956 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-28T05:30:38.990 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-28T05:30:39.010 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:39.043 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-28T05:30:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-28T05:30:39.060 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:39.104 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 139/198 2024-03-28T05:30:39.209 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 140/198 2024-03-28T05:30:39.210 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:39.239 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:39.254 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-28T05:30:39.255 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:39.393 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:39.465 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-28T05:30:39.516 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-28T05:30:39.549 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-28T05:30:39.580 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-28T05:30:39.581 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-28T05:30:39.614 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:39.650 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-28T05:30:39.729 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-28T05:30:39.786 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-28T05:30:39.819 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-28T05:30:39.886 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-28T05:30:39.920 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:39.953 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-28T05:30:39.989 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:39.989 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:40.312 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:40.312 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:40.451 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:40.472 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:40.527 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-28T05:30:40.559 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-28T05:30:40.599 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-28T05:30:40.745 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:40.792 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-28T05:30:40.823 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:40.972 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-28T05:30:41.002 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:41.002 INFO:teuthology.orchestra.run.smithi086.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-28T05:30:41.002 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:41.154 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 144/198 2024-03-28T05:30:41.183 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-28T05:30:41.266 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:41.325 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:41.364 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-28T05:30:41.425 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 147/198 2024-03-28T05:30:42.227 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:42.273 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 154/198 2024-03-28T05:30:42.308 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 155/198 2024-03-28T05:30:42.346 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-28T05:30:42.441 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-28T05:30:42.478 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-28T05:30:42.555 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:42.605 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:42.611 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 157/198 2024-03-28T05:30:42.676 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-28T05:30:42.677 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:42.677 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-28T05:30:42.677 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:42.737 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-28T05:30:42.756 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:42.784 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 159/198 2024-03-28T05:30:42.844 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-28T05:30:42.857 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:42.857 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:42.857 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-28T05:30:42.858 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:42.858 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-28T05:30:42.858 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:42.918 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-28T05:30:42.963 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-28T05:30:42.998 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 163/198 2024-03-28T05:30:43.043 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-28T05:30:43.095 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-28T05:30:43.182 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-28T05:30:43.240 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:43.282 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-28T05:30:43.319 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T05:30:43.322 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:44.237 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:44.282 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:44.337 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:45.675 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 170/198 2024-03-28T05:30:45.746 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 1/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 3/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 4/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 5/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 6/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 7/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 8/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 9/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:30:45.747 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 13/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 14/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 15/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 17/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 18/198 2024-03-28T05:30:45.749 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 19/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 20/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 21/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 22/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 23/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 24/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 25/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 26/198 2024-03-28T05:30:45.750 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 27/198 2024-03-28T05:30:45.765 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 28/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 29/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 30/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 31/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 32/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 33/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 34/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 35/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 36/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 37/198 2024-03-28T05:30:45.767 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 38/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 39/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-28T05:30:45.768 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-28T05:30:45.769 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-28T05:30:45.770 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-28T05:30:45.771 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-28T05:30:45.772 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-28T05:30:45.773 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-28T05:30:45.774 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-28T05:30:45.775 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-28T05:30:45.776 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-28T05:30:45.777 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-28T05:30:45.778 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-28T05:30:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-28T05:30:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-28T05:30:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-28T05:30:45.779 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-28T05:30:45.824 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-28T05:30:45.949 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-28T05:30:45.992 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-28T05:30:46.025 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-28T05:30:46.059 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-28T05:30:46.101 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-28T05:30:46.101 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:46.288 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-28T05:30:46.289 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:46.460 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:46.507 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-28T05:30:46.559 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-28T05:30:46.591 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-28T05:30:46.624 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-28T05:30:46.697 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-28T05:30:46.773 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-28T05:30:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-28T05:30:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-28T05:30:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-28T05:30:46.920 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:46.954 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-28T05:30:46.990 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:46.990 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:47.313 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:47.313 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:47.469 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:47.499 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:47.553 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-28T05:30:47.585 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-28T05:30:47.625 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-28T05:30:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:47.976 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:47.976 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-28T05:30:47.976 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:48.422 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: acl-2.3.1-4.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-28T05:30:48.423 INFO:teuthology.orchestra.run.smithi086.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:48.424 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.2-8.el9.noarch 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.7.4-5.el9.x86_64 2024-03-28T05:30:48.425 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.427 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.4-9.el9.x86_64 2024-03-28T05:30:48.428 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.6-16.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-28T05:30:48.429 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-28T05:30:48.430 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-28T05:30:48.431 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-13.14-1.el9.x86_64 2024-03-28T05:30:48.432 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-28T05:30:48.433 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-28T05:30:48.434 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-28T05:30:48.435 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-28T05:30:48.436 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-28T05:30:48.437 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-28T05:30:48.438 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-28T05:30:48.439 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-3.el9.x86_64 2024-03-28T05:30:48.440 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-28T05:30:48.441 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-28T05:30:48.441 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-28T05:30:48.441 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-28T05:30:48.441 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-28T05:30:48.441 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:48.442 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-28T05:30:48.442 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-03-28T05:30:48.442 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-03-28T05:30:48.474 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 154/198 2024-03-28T05:30:48.510 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 155/198 2024-03-28T05:30:48.548 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-28T05:30:48.876 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 157/198 2024-03-28T05:30:49.013 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-28T05:30:49.052 DEBUG:teuthology.parallel:result is None 2024-03-28T05:30:49.064 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 159/198 2024-03-28T05:30:49.115 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-28T05:30:49.170 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-28T05:30:49.224 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-28T05:30:49.268 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 163/198 2024-03-28T05:30:49.312 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-28T05:30:49.363 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-28T05:30:49.450 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-28T05:30:49.552 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-28T05:30:49.588 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-28T05:30:50.400 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:50.443 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:50.500 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-28T05:30:51.910 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 170/198 2024-03-28T05:30:51.998 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-28T05:30:52.070 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-28T05:30:52.212 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-28T05:30:52.251 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-28T05:30:52.284 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-28T05:30:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-28T05:30:52.360 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-28T05:30:52.360 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:52.506 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-28T05:30:52.555 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-28T05:30:52.556 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 1/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 3/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 4/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 5/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 6/198 2024-03-28T05:30:52.632 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 7/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 8/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 9/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 13/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 14/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 15/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 17/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 18/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 19/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 20/198 2024-03-28T05:30:52.633 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 21/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 22/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 23/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 24/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 25/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 26/198 2024-03-28T05:30:52.634 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 27/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 28/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 29/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 30/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 31/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 32/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 33/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 34/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 35/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 36/198 2024-03-28T05:30:52.649 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 37/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 38/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 39/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-28T05:30:52.650 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-28T05:30:52.651 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-28T05:30:52.652 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-28T05:30:52.653 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-28T05:30:52.654 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-28T05:30:52.655 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-28T05:30:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-28T05:30:52.657 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-28T05:30:52.658 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-28T05:30:52.659 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-28T05:30:52.660 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-28T05:30:52.661 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-28T05:30:52.694 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-28T05:30:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-28T05:30:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-28T05:30:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-28T05:30:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-28T05:30:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-28T05:30:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-28T05:30:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-28T05:30:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-28T05:30:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-28T05:30:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-28T05:30:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-28T05:30:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-28T05:30:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-28T05:30:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-28T05:30:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-28T05:30:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-28T05:30:54.263 INFO:teuthology.orchestra.run.smithi055.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-28T05:30:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: acl-2.3.1-4.el9.x86_64 2024-03-28T05:30:55.218 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:55.219 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.220 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.221 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-28T05:30:55.222 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.6-16.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.223 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-28T05:30:55.224 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.14-1.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.225 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-28T05:30:55.226 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-28T05:30:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-28T05:30:55.228 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-28T05:30:55.229 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-28T05:30:55.230 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-28T05:30:55.231 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:30:55.231 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-03-28T05:30:55.875 DEBUG:teuthology.parallel:result is None 2024-03-28T05:30:59.151 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 1/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 3/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 4/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 5/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 6/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 7/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 8/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 9/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 13/198 2024-03-28T05:30:59.152 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 14/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 15/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 17/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 18/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 19/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 20/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 21/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 22/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 23/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 24/198 2024-03-28T05:30:59.153 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 25/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 26/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 27/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 28/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 29/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 30/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 31/198 2024-03-28T05:30:59.169 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 32/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 33/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 34/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 35/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 36/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 37/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 38/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 39/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-28T05:30:59.170 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-28T05:30:59.171 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-28T05:30:59.172 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-28T05:30:59.172 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-28T05:30:59.172 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-28T05:30:59.172 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-28T05:30:59.173 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-28T05:30:59.174 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-28T05:30:59.175 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-28T05:30:59.176 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-28T05:30:59.177 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-28T05:30:59.178 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-28T05:30:59.179 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-28T05:30:59.180 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-28T05:30:59.181 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-28T05:30:59.182 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-28T05:31:01.747 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-28T05:31:01.747 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:31:01.747 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: acl-2.3.1-4.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-28T05:31:01.748 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.749 INFO:teuthology.orchestra.run.smithi055.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-28T05:31:01.750 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.751 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.752 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-28T05:31:01.753 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: jq-1.6-16.el9.x86_64 2024-03-28T05:31:01.754 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-28T05:31:01.755 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-28T05:31:01.756 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.14-1.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-28T05:31:01.757 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.758 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-28T05:31:01.759 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-28T05:31:01.761 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-28T05:31:01.762 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-28T05:31:01.763 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.764 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-28T05:31:01.765 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-28T05:31:01.766 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:31:01.767 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-03-28T05:31:02.510 DEBUG:teuthology.parallel:result is None 2024-03-28T05:31:02.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:02.740 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-28T05:31:02.795 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:02.795 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:02.795 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145.g3be9a5c9 is installed. 2024-03-28T05:31:02.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:02.935 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-28T05:31:03.006 INFO:teuthology.orchestra.run.smithi086.stdout:19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:03.006 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:03.006 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145.g3be9a5c9 is installed. 2024-03-28T05:31:03.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:03.244 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-28T05:31:03.305 INFO:teuthology.orchestra.run.smithi159.stdout:19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:03.305 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145.g3be9a5c9.el9 2024-03-28T05:31:03.305 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145.g3be9a5c9 is installed. 2024-03-28T05:31:03.307 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-28T05:31:03.307 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:31:03.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T05:31:03.392 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:31:03.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T05:31:03.496 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:31:03.496 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T05:31:03.586 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-28T05:31:03.587 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:31:03.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T05:31:03.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T05:31:03.784 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:31:03.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T05:31:03.885 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T05:31:04.021 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:31:04.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T05:31:04.106 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T05:31:04.225 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-28T05:31:04.225 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:31:04.225 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T05:31:04.304 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T05:31:04.425 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:31:04.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T05:31:04.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T05:31:04.653 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:31:04.654 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T05:31:04.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T05:31:04.889 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-28T05:31:04.889 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:31:04.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T05:31:04.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T05:31:05.071 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:31:05.071 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T05:31:05.170 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T05:31:05.265 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:31:05.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T05:31:05.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T05:31:05.455 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-28T05:31:05.546 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'subvols': {'create': 2}} 2024-03-28T05:31:05.546 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:05.547 INFO:tasks.cephadm:Cluster fsid is 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:31:05.547 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-28T05:31:05.547 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.55', 'mon.b': '172.21.15.86', 'mon.c': '172.21.15.159'} 2024-03-28T05:31:05.547 INFO:tasks.cephadm:First mon is mon.a on smithi055 2024-03-28T05:31:05.547 INFO:tasks.cephadm:First mgr is x 2024-03-28T05:31:05.547 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-28T05:31:05.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname $(hostname -s) 2024-03-28T05:31:05.636 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-03-28T05:31:05.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-03-28T05:31:05.832 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-28T05:31:05.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:05.972 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77877/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2145-g3be9a5c9', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2145.g3be9a5c9'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-22 05:51:42.267384', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-main-20240318.032620', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-03-28T05:31:06.191 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-main-20240318.032620, sha1 3be9a5c9bc793e11e2800a8c0c696e8b46742033 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:31:06.193 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/x86_64/flavors/default/cephadm 2024-03-28T05:31:06.193 DEBUG:teuthology.orchestra.run.smithi055:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:06.730 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r--. 1 ubuntu ubuntu 767371 Mar 28 05:31 /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:06.731 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.319 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r--. 1 ubuntu ubuntu 767371 Mar 28 05:31 /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.319 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.857 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 767371 Mar 28 05:31 /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.858 DEBUG:teuthology.orchestra.run.smithi055:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.922 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:07.983 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-28T05:31:08.060 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 on all hosts... 2024-03-28T05:31:08.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 pull 2024-03-28T05:31:08.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 pull 2024-03-28T05:31:08.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 pull 2024-03-28T05:31:09.267 INFO:teuthology.orchestra.run.smithi055.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033... 2024-03-28T05:31:09.333 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033... 2024-03-28T05:31:09.445 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033... 2024-03-28T05:31:45.229 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev)", 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2", 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc" 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-03-28T05:31:45.230 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev)", 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2", 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc" 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-03-28T05:31:46.547 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-03-28T05:31:57.471 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:31:57.471 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev)", 2024-03-28T05:31:57.472 INFO:teuthology.orchestra.run.smithi055.stdout: "image_id": "c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2", 2024-03-28T05:31:57.472 INFO:teuthology.orchestra.run.smithi055.stdout: "repo_digests": [ 2024-03-28T05:31:57.472 INFO:teuthology.orchestra.run.smithi055.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc" 2024-03-28T05:31:57.472 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T05:31:57.472 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:31:57.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph 2024-03-28T05:31:57.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-03-28T05:31:57.721 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-03-28T05:31:57.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /etc/ceph 2024-03-28T05:31:57.929 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-03-28T05:31:58.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-03-28T05:31:58.127 INFO:tasks.cephadm:Writing seed config... 2024-03-28T05:31:58.128 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-28T05:31:58.128 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-28T05:31:58.128 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-28T05:31:58.128 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-28T05:31:58.129 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-28T05:31:58.130 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-28T05:31:58.131 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-28T05:31:58.132 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-03-28T05:31:58.133 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:31:58.133 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-28T05:31:58.194 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5f86a62c-ecc4-11ee-95d0-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-28T05:31:58.194 DEBUG:teuthology.orchestra.run.smithi055:mon.a> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service 2024-03-28T05:31:58.242 DEBUG:teuthology.orchestra.run.smithi055:mgr.x> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.x.service 2024-03-28T05:31:58.290 INFO:tasks.cephadm:Bootstrapping... 2024-03-28T05:31:58.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 -v bootstrap --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.55 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-28T05:31:58.576 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-03-28T05:31:58.577 INFO:teuthology.orchestra.run.smithi055.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033', '-v', 'bootstrap', '--fsid', '5f86a62c-ecc4-11ee-95d0-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.55', '--skip-admin-label'] 2024-03-28T05:31:58.632 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-28T05:31:58.633 INFO:teuthology.orchestra.run.smithi055.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-28T05:31:58.633 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying podman|docker is present... 2024-03-28T05:31:58.686 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-28T05:31:58.686 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying lvm2 is present... 2024-03-28T05:31:58.687 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying time synchronization is in place... 2024-03-28T05:31:58.703 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-28T05:31:58.703 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-28T05:31:58.718 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-28T05:31:58.718 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:31:58.736 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout enabled 2024-03-28T05:31:58.756 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout active 2024-03-28T05:31:58.756 INFO:teuthology.orchestra.run.smithi055.stdout:Unit chronyd.service is enabled and running 2024-03-28T05:31:58.756 INFO:teuthology.orchestra.run.smithi055.stdout:Repeating the final host check... 2024-03-28T05:31:58.809 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-28T05:31:58.809 INFO:teuthology.orchestra.run.smithi055.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-28T05:31:58.809 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl is present 2024-03-28T05:31:58.809 INFO:teuthology.orchestra.run.smithi055.stdout:lvcreate is present 2024-03-28T05:31:58.827 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-28T05:31:58.827 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-28T05:31:58.844 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-28T05:31:58.844 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:31:58.866 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout enabled 2024-03-28T05:31:58.888 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout active 2024-03-28T05:31:58.888 INFO:teuthology.orchestra.run.smithi055.stdout:Unit chronyd.service is enabled and running 2024-03-28T05:31:58.889 INFO:teuthology.orchestra.run.smithi055.stdout:Host looks OK 2024-03-28T05:31:58.889 INFO:teuthology.orchestra.run.smithi055.stdout:Cluster fsid: 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:31:58.889 INFO:teuthology.orchestra.run.smithi055.stdout:Acquiring lock 139639217471392 on /run/cephadm/5f86a62c-ecc4-11ee-95d0-87774f69a715.lock 2024-03-28T05:31:58.890 INFO:teuthology.orchestra.run.smithi055.stdout:Lock 139639217471392 acquired on /run/cephadm/5f86a62c-ecc4-11ee-95d0-87774f69a715.lock 2024-03-28T05:31:58.891 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying IP 172.21.15.55 port 3300 ... 2024-03-28T05:31:58.892 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying IP 172.21.15.55 port 6789 ... 2024-03-28T05:31:58.892 INFO:teuthology.orchestra.run.smithi055.stdout:Base mon IP(s) is [172.21.15.55:3300, 172.21.15.55:6789], mon addrv is [v2:172.21.15.55:3300,v1:172.21.15.55:6789] 2024-03-28T05:31:58.908 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.55 metric 100 2024-03-28T05:31:58.908 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.55 metric 100 2024-03-28T05:31:58.921 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-28T05:31:58.921 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-28T05:31:58.921 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-28T05:31:58.933 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-28T05:31:58.933 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-28T05:31:58.933 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-28T05:31:58.933 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-28T05:31:58.934 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-03-28T05:31:58.934 INFO:teuthology.orchestra.run.smithi055.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-28T05:31:58.937 INFO:teuthology.orchestra.run.smithi055.stdout:Mon IP `172.21.15.55` is in CIDR network `172.21.0.0/20` 2024-03-28T05:31:58.937 INFO:teuthology.orchestra.run.smithi055.stdout:Mon IP `172.21.15.55` is in CIDR network `172.21.0.0/20` 2024-03-28T05:31:58.937 INFO:teuthology.orchestra.run.smithi055.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-28T05:31:58.940 INFO:teuthology.orchestra.run.smithi055.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-28T05:31:58.942 INFO:teuthology.orchestra.run.smithi055.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033... 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stdout c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033... 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Getting image source signatures 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying blob sha256:9516588f908cdb14b5e4062a6063db2d9291b355c3f32e2a99864608a4a7b649 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying blob sha256:4dd83c6ee8921fe17396d77c31e205985ae94c87d3f752465b5f04aaf9ae340a 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Copying config sha256:c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 2024-03-28T05:31:59.547 INFO:teuthology.orchestra.run.smithi055.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-28T05:32:00.819 INFO:teuthology.orchestra.run.smithi055.stdout:ceph: stdout ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:32:00.819 INFO:teuthology.orchestra.run.smithi055.stdout:Ceph version: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:32:00.820 INFO:teuthology.orchestra.run.smithi055.stdout:Extracting ceph user uid/gid from container image... 2024-03-28T05:32:01.911 INFO:teuthology.orchestra.run.smithi055.stdout:stat: stdout 167 167 2024-03-28T05:32:01.912 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial keys... 2024-03-28T05:32:03.567 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQDSAAVmxmd+NBAABU3P5P0U11Ypa9wjSiy/nQ== 2024-03-28T05:32:04.663 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQDUAAVmEC4mABAAYoiCzSWD2hOzTYTWAiDO0A== 2024-03-28T05:32:05.693 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph-authtool: stdout AQDVAAVmtlfdBRAAQfQE3udXdAmi0HvgyFhNKA== 2024-03-28T05:32:05.694 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial monmap... 2024-03-28T05:32:06.694 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool for a [v2:172.21.15.55:3300,v1:172.21.15.55:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = quincy 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: set fsid to 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-28T05:32:06.695 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:32:06.696 INFO:teuthology.orchestra.run.smithi055.stdout:Creating mon... 2024-03-28T05:32:07.856 INFO:teuthology.orchestra.run.smithi055.stdout:create mon.a on 2024-03-28T05:32:08.235 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-28T05:32:08.481 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-28T05:32:08.778 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target. 2024-03-28T05:32:08.778 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target. 2024-03-28T05:32:09.167 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a 2024-03-28T05:32:09.167 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service: Unit ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service not loaded. 2024-03-28T05:32:09.462 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target.wants/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service → /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@.service. 2024-03-28T05:32:10.135 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 podman[31481]: 2024-03-28 05:32:10.123354875 +0000 UTC m=+0.377969752 container init abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, io.buildah.version=1.33.5) 2024-03-28T05:32:10.135 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 podman[31481]: 2024-03-28 05:32:10.134095167 +0000 UTC m=+0.388710044 container start abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319) 2024-03-28T05:32:10.268 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-28T05:32:10.268 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-03-28T05:32:10.284 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-28T05:32:10.284 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:32:10.284 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-03-28T05:32:10.284 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to enable service . firewalld.service is not available 2024-03-28T05:32:10.286 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mon to start... 2024-03-28T05:32:10.286 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mon... 2024-03-28T05:32:10.435 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 ceph-mon[31499]: mkfs 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:10.436 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 ceph-mon[31499]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-28T05:32:10.436 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 bash[31481]: abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 2024-03-28T05:32:10.436 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:10 smithi055 systemd[1]: Started Ceph mon.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:32:11.594 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-28T05:32:11.594 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: monmap e1: 1 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:32:11.594 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: fsmap 2024-03-28T05:32:11.595 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: osdmap e1: 0 total, 0 up, 0 in 2024-03-28T05:32:11.595 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: mgrmap e1: no daemons active 2024-03-28T05:32:11.595 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:11 smithi055 ceph-mon[31499]: from='client.? 172.21.15.55:0/1647499836' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-28T05:32:11.604 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout cluster: 2024-03-28T05:32:11.613 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout id: 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:11.613 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout services: 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.704281s) 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout data: 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-28T05:32:11.614 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout pgs: 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.835+0000 7f35ce200700 1 Processor -- start 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.835+0000 7f35ce200700 1 -- start start 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.835+0000 7f35ce200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.835+0000 7f35ce200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8063410 con 0x7f35c8106350 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.837+0000 7f35c7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:11.615 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.837+0000 7f35c7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46444/0 (socket says 172.21.15.55:46444) 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.837+0000 7f35c7400700 1 -- 172.21.15.55:0/3362107465 learned_addr learned my addr 172.21.15.55:0/3362107465 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.837+0000 7f35c7400700 1 -- 172.21.15.55:0/3362107465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8106cb0 con 0x7f35c8106350 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.838+0000 7f35c7400700 1 --2- 172.21.15.55:0/3362107465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35b80098a0 tx=0x7f35b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af4b49863279111 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.838+0000 7f35c6000700 1 -- 172.21.15.55:0/3362107465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b8004160 con 0x7f35c8106350 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.838+0000 7f35c6000700 1 -- 172.21.15.55:0/3362107465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8004300 con 0x7f35c8106350 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.838+0000 7f35c6000700 1 -- 172.21.15.55:0/3362107465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b80036a0 con 0x7f35c8106350 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 -- 172.21.15.55:0/3362107465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 msgr2=0x7f35c8106770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 --2- 172.21.15.55:0/3362107465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f35b80098a0 tx=0x7f35b8009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 -- 172.21.15.55:0/3362107465 shutdown_connections 2024-03-28T05:32:11.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 --2- 172.21.15.55:0/3362107465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c8106770 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 -- 172.21.15.55:0/3362107465 >> 172.21.15.55:0/3362107465 conn(0x7f35c8101f70 msgr2=0x7f35c8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 -- 172.21.15.55:0/3362107465 shutdown_connections 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.839+0000 7f35ce200700 1 -- 172.21.15.55:0/3362107465 wait complete. 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.840+0000 7f35ce200700 1 Processor -- start 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.840+0000 7f35ce200700 1 -- start start 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35ce200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35ce200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81071e0 con 0x7f35c8106350 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35c7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35c7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46454/0 (socket says 172.21.15.55:46454) 2024-03-28T05:32:11.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35c7400700 1 -- 172.21.15.55:0/1647499836 learned_addr learned my addr 172.21.15.55:0/1647499836 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.841+0000 7f35c7400700 1 -- 172.21.15.55:0/1647499836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c819d890 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35c7400700 1 --2- 172.21.15.55:0/1647499836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b8003db0 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8011630 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b8011950 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c819db20 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.842+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c81a0810 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.843+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f35b801a460 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.843+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35b801b780 con 0x7f35c8106350 2024-03-28T05:32:11.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.843+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80637c0 con 0x7f35c8106350 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.847+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f35b801ba20 con 0x7f35c8106350 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.928+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f35c81a09e0 con 0x7f35c8106350 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.929+0000 7f35bfe00700 1 -- 172.21.15.55:0/1647499836 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f35b801bc00 con 0x7f35c8106350 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.930+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 msgr2=0x7f35c819d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.930+0000 7f35ce200700 1 --2- 172.21.15.55:0/1647499836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8004750 comp rx=0 tx=0).stop 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.930+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 shutdown_connections 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.930+0000 7f35ce200700 1 --2- 172.21.15.55:0/1647499836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35c8106350 0x7f35c819d350 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.930+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 >> 172.21.15.55:0/1647499836 conn(0x7f35c8101f70 msgr2=0x7f35c8193970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.931+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 shutdown_connections 2024-03-28T05:32:11.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:10.931+0000 7f35ce200700 1 -- 172.21.15.55:0/1647499836 wait complete. 2024-03-28T05:32:11.620 INFO:teuthology.orchestra.run.smithi055.stdout:mon is available 2024-03-28T05:32:11.620 INFO:teuthology.orchestra.run.smithi055.stdout:Assimilating anything we can from ceph.conf... 2024-03-28T05:32:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:12 smithi055 ceph-mon[31499]: from='client.? 172.21.15.55:0/3490494815' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-28T05:32:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:12 smithi055 ceph-mon[31499]: from='client.? 172.21.15.55:0/3490494815' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [global] 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout fsid = 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.55:3300,v1:172.21.15.55:6789] 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-28T05:32:13.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [osd] 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-28T05:32:13.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.208+0000 7f6a76a00700 1 Processor -- start 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.208+0000 7f6a76a00700 1 -- start start 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.209+0000 7f6a76a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.209+0000 7f6a76a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7007be50 con 0x7f6a701084a0 2024-03-28T05:32:13.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.209+0000 7f6a6fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.209+0000 7f6a6fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46462/0 (socket says 172.21.15.55:46462) 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.209+0000 7f6a6fe00700 1 -- 172.21.15.55:0/3381127173 learned_addr learned my addr 172.21.15.55:0/3381127173 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.210+0000 7f6a6fe00700 1 -- 172.21.15.55:0/3381127173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7010add0 con 0x7f6a701084a0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.210+0000 7f6a6fe00700 1 --2- 172.21.15.55:0/3381127173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098a0 tx=0x7f6a60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7dccde0833f40 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.210+0000 7f6a6f400700 1 -- 172.21.15.55:0/3381127173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a60004160 con 0x7f6a701084a0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a6f400700 1 -- 172.21.15.55:0/3381127173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60004300 con 0x7f6a701084a0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a6f400700 1 -- 172.21.15.55:0/3381127173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a600036a0 con 0x7f6a701084a0 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a76a00700 1 -- 172.21.15.55:0/3381127173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 msgr2=0x7f6a7010a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a76a00700 1 --2- 172.21.15.55:0/3381127173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6a600098a0 tx=0x7f6a60009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:13.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a76a00700 1 -- 172.21.15.55:0/3381127173 shutdown_connections 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a76a00700 1 --2- 172.21.15.55:0/3381127173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7010a890 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.211+0000 7f6a76a00700 1 -- 172.21.15.55:0/3381127173 >> 172.21.15.55:0/3381127173 conn(0x7f6a70101f70 msgr2=0x7f6a70104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.212+0000 7f6a76a00700 1 -- 172.21.15.55:0/3381127173 shutdown_connections 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.212+0000 7f6a76a00700 1 -- 172.21.15.55:0/3381127173 wait complete. 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.213+0000 7f6a76a00700 1 Processor -- start 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.213+0000 7f6a76a00700 1 -- start start 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.213+0000 7f6a76a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.213+0000 7f6a76a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7010b2a0 con 0x7f6a701084a0 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.214+0000 7f6a6fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:13.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.214+0000 7f6a6fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46472/0 (socket says 172.21.15.55:46472) 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.214+0000 7f6a6fe00700 1 -- 172.21.15.55:0/3490494815 learned_addr learned my addr 172.21.15.55:0/3490494815 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.214+0000 7f6a6fe00700 1 -- 172.21.15.55:0/3490494815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7019b650 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.214+0000 7f6a6fe00700 1 --2- 172.21.15.55:0/3490494815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a60003db0 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60011630 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a60011950 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7019b8e0 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7019e5d0 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6a60011af0 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.215+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6a6001c450 con 0x7f6a701084a0 2024-03-28T05:32:13.227 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.216+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a700637c0 con 0x7f6a701084a0 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.219+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6a60004260 con 0x7f6a701084a0 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.297+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6a7002dc40 con 0x7f6a701084a0 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.308+0000 7f6a6d600700 1 -- 172.21.15.55:0/3490494815 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+456 (secure 0 0 0) 0x7f6a6001b450 con 0x7f6a701084a0 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.309+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 msgr2=0x7f6a7019b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.309+0000 7f6a76a00700 1 --2- 172.21.15.55:0/3490494815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60004750 comp rx=0 tx=0).stop 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.310+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 shutdown_connections 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.310+0000 7f6a76a00700 1 --2- 172.21.15.55:0/3490494815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a701084a0 0x7f6a7019b110 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.310+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 >> 172.21.15.55:0/3490494815 conn(0x7f6a70101f70 msgr2=0x7f6a70104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.310+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 shutdown_connections 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:12.310+0000 7f6a76a00700 1 -- 172.21.15.55:0/3490494815 wait complete. 2024-03-28T05:32:13.228 INFO:teuthology.orchestra.run.smithi055.stdout:Generating new minimal ceph.conf... 2024-03-28T05:32:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:13 smithi055 ceph-mon[31499]: from='client.? 172.21.15.55:0/4273038200' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:32:14.508 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.817+0000 7f35d6800700 1 Processor -- start 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.818+0000 7f35d6800700 1 -- start start 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.818+0000 7f35d6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.818+0000 7f35d6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0082450 con 0x7f35d0081a60 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.819+0000 7f35cf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.819+0000 7f35cf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46476/0 (socket says 172.21.15.55:46476) 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.819+0000 7f35cf400700 1 -- 172.21.15.55:0/1748356643 learned_addr learned my addr 172.21.15.55:0/1748356643 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.819+0000 7f35cf400700 1 -- 172.21.15.55:0/1748356643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d010f240 con 0x7f35d0081a60 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.820+0000 7f35cf400700 1 --2- 172.21.15.55:0/1748356643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35c00098a0 tx=0x7f35c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478f827d9f4340c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.820+0000 7f35ce000700 1 -- 172.21.15.55:0/1748356643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c0004160 con 0x7f35d0081a60 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.820+0000 7f35ce000700 1 -- 172.21.15.55:0/1748356643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f35c0004300 con 0x7f35d0081a60 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.820+0000 7f35ce000700 1 -- 172.21.15.55:0/1748356643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c0011a80 con 0x7f35d0081a60 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 -- 172.21.15.55:0/1748356643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 msgr2=0x7f35d0081e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 --2- 172.21.15.55:0/1748356643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f35c00098a0 tx=0x7f35c0009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:14.509 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 -- 172.21.15.55:0/1748356643 shutdown_connections 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 --2- 172.21.15.55:0/1748356643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d0081e80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 -- 172.21.15.55:0/1748356643 >> 172.21.15.55:0/1748356643 conn(0x7f35d007d0a0 msgr2=0x7f35d007f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 -- 172.21.15.55:0/1748356643 shutdown_connections 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.821+0000 7f35d6800700 1 -- 172.21.15.55:0/1748356643 wait complete. 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.822+0000 7f35d6800700 1 Processor -- start 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.822+0000 7f35d6800700 1 -- start start 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35d6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35d6800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d01125f0 con 0x7f35d0081a60 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35cf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35cf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46490/0 (socket says 172.21.15.55:46490) 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35cf400700 1 -- 172.21.15.55:0/4273038200 learned_addr learned my addr 172.21.15.55:0/4273038200 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.823+0000 7f35cf400700 1 -- 172.21.15.55:0/4273038200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d01a24d0 con 0x7f35d0081a60 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35cf400700 1 --2- 172.21.15.55:0/4273038200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006af0 tx=0x7f35c0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:14.510 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c00039e0 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f35c0003b80 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d01a2760 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c00196a0 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.824+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01a5450 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.825+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f35c0019ce0 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.825+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35c0024730 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.826+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00637c0 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.829+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f35c0043dd0 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.905+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f35d01a5620 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.906+0000 7f35c7e00700 1 -- 172.21.15.55:0/4273038200 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f35c0032020 con 0x7f35d0081a60 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.907+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 msgr2=0x7f35d01a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.907+0000 7f35d6800700 1 --2- 172.21.15.55:0/4273038200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006af0 tx=0x7f35c0011c40 comp rx=0 tx=0).stop 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.907+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 shutdown_connections 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.907+0000 7f35d6800700 1 --2- 172.21.15.55:0/4273038200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d0081a60 0x7f35d01a1f90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.908+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 >> 172.21.15.55:0/4273038200 conn(0x7f35d007d0a0 msgr2=0x7f35d007db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.908+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 shutdown_connections 2024-03-28T05:32:14.511 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:13.908+0000 7f35d6800700 1 -- 172.21.15.55:0/4273038200 wait complete. 2024-03-28T05:32:14.512 INFO:teuthology.orchestra.run.smithi055.stdout:Restarting the monitor... 2024-03-28T05:32:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:14 smithi055 systemd[1]: Stopping Ceph mon.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:32:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:14 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a[31495]: 2024-03-28T05:32:14.984+0000 7fae46c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-28T05:32:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:14 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a[31495]: 2024-03-28T05:32:14.984+0000 7fae46c00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-28T05:32:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:15 smithi055 podman[31742]: 2024-03-28 05:32:15.190264706 +0000 UTC m=+0.331791629 container died abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2) 2024-03-28T05:32:15.736 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:15 smithi055 podman[31742]: 2024-03-28 05:32:15.577317731 +0000 UTC m=+0.718844650 container cleanup abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-03-28T05:32:15.737 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:15 smithi055 bash[31742]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a 2024-03-28T05:32:15.995 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:15 smithi055 podman[31756]: 2024-03-28 05:32:15.736326661 +0000 UTC m=+0.534418325 container remove abc76fd145942ccc4d29c8c924529d4a73202f36bb9d869af810220e805c0d12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319) 2024-03-28T05:32:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-28T05:32:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 systemd[1]: Stopped Ceph mon.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:32:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.a.service: Consumed 1.995s CPU time. 2024-03-28T05:32:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 systemd[1]: Starting Ceph mon.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:32:16.910 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 podman[31845]: 2024-03-28 05:32:16.560385357 +0000 UTC m=+0.037765316 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:32:16.910 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 podman[31845]: 2024-03-28 05:32:16.653908434 +0000 UTC m=+0.131288368 container create 714d91b7a4b434c100de7dd2d640b964e1e467d2efc2089f990aa44f80bdf3ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:32:16.910 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 podman[31845]: 2024-03-28 05:32:16.899352737 +0000 UTC m=+0.376732707 container init 714d91b7a4b434c100de7dd2d640b964e1e467d2efc2089f990aa44f80bdf3ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-28T05:32:17.008 INFO:teuthology.orchestra.run.smithi055.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-28T05:32:17.183 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 podman[31845]: 2024-03-28 05:32:16.909968826 +0000 UTC m=+0.387348796 container start 714d91b7a4b434c100de7dd2d640b964e1e467d2efc2089f990aa44f80bdf3ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:32:17.183 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: set uid:gid to 167:167 (ceph:ceph) 2024-03-28T05:32:17.183 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev), process ceph-mon, pid 2 2024-03-28T05:32:17.183 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: pidfile_write: ignore empty --pid-file 2024-03-28T05:32:17.183 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: load: jerasure load: lrc 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: RocksDB version: 7.9.2 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Git sha 0 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Compile date 2024-03-22 04:58:55 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: DB SUMMARY 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: DB Session ID: AMNSDT1C4IQAT3DTUASC 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: CURRENT file: CURRENT 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: IDENTITY file: IDENTITY 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-28T05:32:17.184 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99990 ; 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.error_if_exists: 0 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.create_if_missing: 0 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.paranoid_checks: 1 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.env: 0x5587abc20b20 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.fs: PosixFileSystem 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.info_log: 0x5587ad12f960 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_file_opening_threads: 16 2024-03-28T05:32:17.185 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.statistics: (nil) 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.use_fsync: 0 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_log_file_size: 0 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.keep_log_file_num: 1000 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.recycle_log_file_num: 0 2024-03-28T05:32:17.186 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_fallocate: 1 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_mmap_reads: 0 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_mmap_writes: 0 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.use_direct_reads: 0 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.create_missing_column_families: 0 2024-03-28T05:32:17.188 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.db_log_dir: 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.wal_dir: 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.advise_random_on_open: 1 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.db_write_buffer_size: 0 2024-03-28T05:32:17.189 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.write_buffer_manager: 0x5587ad1021e0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.rate_limiter: (nil) 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.wal_recovery_mode: 2 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enable_thread_tracking: 0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enable_pipelined_write: 0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.unordered_write: 0 2024-03-28T05:32:17.190 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.row_cache: None 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.wal_filter: None 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_ingest_behind: 0 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.two_write_queues: 0 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.manual_wal_flush: 0 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.wal_compression: 0 2024-03-28T05:32:17.191 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.atomic_flush: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.log_readahead_size: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.best_efforts_recovery: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.allow_data_in_errors: 0 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.db_host_id: __hostname__ 2024-03-28T05:32:17.192 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_background_jobs: 2 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_background_compactions: -1 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_subcompactions: 1 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_total_wal_size: 0 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-28T05:32:17.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_open_files: -1 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bytes_per_sync: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_readahead_size: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_background_flushes: -1 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Compression algorithms supported: 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kZSTD supported: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kXpressCompression supported: 0 2024-03-28T05:32:17.194 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kLZ4HCCompression supported: 1 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kZlibCompression supported: 1 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kSnappyCompression supported: 1 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kLZ4Compression supported: 1 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: kBZip2Compression supported: 0 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.merge_operator: 2024-03-28T05:32:17.195 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_filter: None 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_filter_factory: None 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.sst_partitioner_factory: None 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5587ad12fa60) 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: cache_index_and_filter_blocks: 1 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: pin_top_level_index_and_filter: 1 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: index_type: 0 2024-03-28T05:32:17.196 INFO:journalctl@ceph.mon.a.smithi055.stdout: data_block_index_type: 0 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: index_shortening: 1 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: checksum: 4 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: no_block_cache: 0 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_cache: 0x5587ad135090 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_cache_name: BinnedLRUCache 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_cache_options: 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: capacity : 536870912 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: num_shard_bits : 4 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: strict_capacity_limit : 0 2024-03-28T05:32:17.197 INFO:journalctl@ceph.mon.a.smithi055.stdout: high_pri_pool_ratio: 0.000 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_cache_compressed: (nil) 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: persistent_cache: (nil) 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_size: 4096 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_size_deviation: 10 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_restart_interval: 16 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: index_block_restart_interval: 1 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: metadata_block_size: 4096 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: partition_filters: 0 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: use_delta_encoding: 1 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: filter_policy: bloomfilter 2024-03-28T05:32:17.198 INFO:journalctl@ceph.mon.a.smithi055.stdout: whole_key_filtering: 1 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: verify_compression: 0 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: read_amp_bytes_per_bit: 0 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: format_version: 5 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: enable_index_compression: 1 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: block_align: 0 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: max_auto_readahead_size: 262144 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: prepopulate_block_cache: 0 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: initial_auto_readahead_size: 8192 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout: num_file_reads_for_auto_readahead: 2 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.write_buffer_size: 33554432 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_write_buffer_number: 2 2024-03-28T05:32:17.199 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression: NoCompression 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression: Disabled 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.prefix_extractor: nullptr 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.num_levels: 7 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-28T05:32:17.200 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.level: 32767 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.strategy: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:32:17.201 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.enabled: false 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.target_file_size_base: 67108864 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-28T05:32:17.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.arena_block_size: 1048576 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-28T05:32:17.203 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.disable_auto_compactions: 0 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-28T05:32:17.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.table_properties_collectors: 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.inplace_update_support: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.bloom_locality: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.max_successive_merges: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.paranoid_file_checks: 0 2024-03-28T05:32:17.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.force_consistency_checks: 1 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.report_bg_io_stats: 0 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.ttl: 2592000 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enable_blob_files: false 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.min_blob_size: 0 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_file_size: 268435456 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-28T05:32:17.206 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.blob_file_starting_level: 0 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 53847673-30e3-414e-925d-2d538aca115d 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711603936968628, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711603936970998, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95213, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 93212, "index_size": 283, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13761, "raw_average_key_size": 50, "raw_value_size": 85690, "raw_average_value_size": 311, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711603936, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "53847673-30e3-414e-925d-2d538aca115d", "db_session_id": "AMNSDT1C4IQAT3DTUASC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-28T05:32:17.207 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711603936971157, "job": 1, "event": "recovery_finished"} 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5587ad228000 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: DB pointer 0x5587ad212000 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: ** DB Stats ** 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:32:17.208 INFO:journalctl@ceph.mon.a.smithi055.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: ** Compaction Stats [default] ** 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: L0 2/0 94.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: Sum 2/0 94.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 53.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.209 INFO:journalctl@ceph.mon.a.smithi055.stdout: ** Compaction Stats [default] ** 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 53.0 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-28T05:32:17.210 INFO:journalctl@ceph.mon.a.smithi055.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: Cumulative compaction: 0.00 GB write, 7.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: Interval compaction: 0.00 GB write, 7.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: Block cache BinnedLRUCache@0x5587ad135090#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: starting mon.a rank 0 at public addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] at bind addrs [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???) e1 preinit fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).mds e1 new map 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).mds e1 print_map 2024-03-28T05:32:17.211 INFO:journalctl@ceph.mon.a.smithi055.stdout: e1 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout: legacy client fscid: -1 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout: 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout: No filesystems configured 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 ceph-mon[31863]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:16 smithi055 bash[31845]: 714d91b7a4b434c100de7dd2d640b964e1e467d2efc2089f990aa44f80bdf3ea 2024-03-28T05:32:17.212 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 systemd[1]: Started Ceph mon.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:32:17.213 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 ceph-mon[31863]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-28T05:32:17.213 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 ceph-mon[31863]: monmap e1: 1 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:32:17.213 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 ceph-mon[31863]: fsmap 2024-03-28T05:32:17.213 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 ceph-mon[31863]: osdmap e1: 0 total, 0 up, 0 in 2024-03-28T05:32:17.213 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:17 smithi055 ceph-mon[31863]: mgrmap e1: no daemons active 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.815+0000 7fcdb1800700 1 Processor -- start 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.815+0000 7fcdb1800700 1 -- start start 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.816+0000 7fcdb1800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.816+0000 7fcdb1800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac10a660 con 0x7fcdac109c70 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.817+0000 7fcdaaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.817+0000 7fcdaaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46500/0 (socket says 172.21.15.55:46500) 2024-03-28T05:32:18.532 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.817+0000 7fcdaaa00700 1 -- 172.21.15.55:0/755030385 learned_addr learned my addr 172.21.15.55:0/755030385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.817+0000 7fcdaaa00700 1 -- 172.21.15.55:0/755030385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac10ae70 con 0x7fcdac109c70 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.818+0000 7fcdaaa00700 1 --2- 172.21.15.55:0/755030385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009e80 tx=0x7fcd9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab67e0f3b44d9a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.818+0000 7fcdaa000700 1 -- 172.21.15.55:0/755030385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd9c017070 con 0x7fcdac109c70 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.818+0000 7fcdaa000700 1 -- 172.21.15.55:0/755030385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fcd9c00b8c0 con 0x7fcdac109c70 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.818+0000 7fcdaa000700 1 -- 172.21.15.55:0/755030385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd9c004520 con 0x7fcdac109c70 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 -- 172.21.15.55:0/755030385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 msgr2=0x7fcdac10a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 --2- 172.21.15.55:0/755030385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009e80 tx=0x7fcd9c00b330 comp rx=0 tx=0).stop 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 -- 172.21.15.55:0/755030385 shutdown_connections 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 --2- 172.21.15.55:0/755030385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac10a090 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:18.533 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 -- 172.21.15.55:0/755030385 >> 172.21.15.55:0/755030385 conn(0x7fcdac07d070 msgr2=0x7fcdac07d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 -- 172.21.15.55:0/755030385 shutdown_connections 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.819+0000 7fcdb1800700 1 -- 172.21.15.55:0/755030385 wait complete. 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.821+0000 7fcdb1800700 1 Processor -- start 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.821+0000 7fcdb1800700 1 -- start start 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.821+0000 7fcdb1800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.821+0000 7fcdb1800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac10e220 con 0x7fcdac109c70 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.822+0000 7fcdaaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.822+0000 7fcdaaa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46508/0 (socket says 172.21.15.55:46508) 2024-03-28T05:32:18.534 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.822+0000 7fcdaaa00700 1 -- 172.21.15.55:0/3322024871 learned_addr learned my addr 172.21.15.55:0/3322024871 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.822+0000 7fcdaaa00700 1 -- 172.21.15.55:0/3322024871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac19e140 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcdaaa00700 1 --2- 172.21.15.55:0/3322024871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00b7b0 tx=0x7fcd9c004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd9c020020 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fcd9c00bba0 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd9c017040 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac19e3d0 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.823+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac1a10c0 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.824+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcd9c023020 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.824+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0637c0 con 0x7fcdac109c70 2024-03-28T05:32:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.825+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcd9c00f050 con 0x7fcdac109c70 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.828+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcd9c02a020 con 0x7fcdac109c70 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.904+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fcdac1a16d0 con 0x7fcdac109c70 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.908+0000 7fcda3e00700 1 -- 172.21.15.55:0/3322024871 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcd9c00bd50 con 0x7fcdac109c70 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.909+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 msgr2=0x7fcdac19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.909+0000 7fcdb1800700 1 --2- 172.21.15.55:0/3322024871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00b7b0 tx=0x7fcd9c004670 comp rx=0 tx=0).stop 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.910+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 shutdown_connections 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.910+0000 7fcdb1800700 1 --2- 172.21.15.55:0/3322024871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdac109c70 0x7fcdac19dc00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.910+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 >> 172.21.15.55:0/3322024871 conn(0x7fcdac07d070 msgr2=0x7fcdac107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.910+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 shutdown_connections 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:17.910+0000 7fcdb1800700 1 -- 172.21.15.55:0/3322024871 wait complete. 2024-03-28T05:32:18.536 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-28T05:32:18.555 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-28T05:32:18.555 INFO:teuthology.orchestra.run.smithi055.stdout:Creating mgr... 2024-03-28T05:32:18.557 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-28T05:32:18.558 INFO:teuthology.orchestra.run.smithi055.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-28T05:32:18.995 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.x 2024-03-28T05:32:18.996 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.x.service: Unit ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.x.service not loaded. 2024-03-28T05:32:19.297 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715.target.wants/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@.service. 2024-03-28T05:32:19.334 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:18 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3322024871' entity='client.admin' 2024-03-28T05:32:19.624 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:19 smithi055 systemd[1]: Starting Ceph mgr.x for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:32:19.955 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:19 smithi055 podman[32087]: 2024-03-28 05:32:19.598110453 +0000 UTC m=+0.032342678 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:32:19.955 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:19 smithi055 podman[32087]: 2024-03-28 05:32:19.725282523 +0000 UTC m=+0.159514742 container create 3b0dc23314f1ab79b2d17c1943cbf1a10745000d08292b223284961056f7d3e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-28T05:32:19.955 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:19 smithi055 podman[32087]: 2024-03-28 05:32:19.954437388 +0000 UTC m=+0.388669680 container init 3b0dc23314f1ab79b2d17c1943cbf1a10745000d08292b223284961056f7d3e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-28T05:32:20.048 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-28T05:32:20.049 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-03-28T05:32:20.064 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-28T05:32:20.064 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:32:20.064 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-03-28T05:32:20.064 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to enable service . firewalld.service is not available 2024-03-28T05:32:20.087 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-28T05:32:20.087 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-03-28T05:32:20.107 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-28T05:32:20.107 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:32:20.107 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-03-28T05:32:20.107 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-28T05:32:20.108 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr to start... 2024-03-28T05:32:20.108 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr... 2024-03-28T05:32:20.259 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:19 smithi055 podman[32087]: 2024-03-28 05:32:19.964909744 +0000 UTC m=+0.399141999 container start 3b0dc23314f1ab79b2d17c1943cbf1a10745000d08292b223284961056f7d3e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-28T05:32:20.259 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:20 smithi055 bash[32087]: 3b0dc23314f1ab79b2d17c1943cbf1a10745000d08292b223284961056f7d3e5 2024-03-28T05:32:20.259 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:20 smithi055 systemd[1]: Started Ceph mgr.x for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:32:20.771 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:20 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:20.757+0000 7f49af9ff200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T05:32:21.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:20 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1858021267' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-28T05:32:21.112 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:20 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:20.894+0000 7f49af9ff200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-28T05:32:21.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "a" 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-28T05:32:21.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-28T05:32:21.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-28T05:32:21.418 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-28T05:32:21.419 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-28T05:32:21.420 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-03-28T05:32:10.226848+0000", 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.662+0000 7fa9d4600700 1 Processor -- start 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.662+0000 7fa9d4600700 1 -- start start 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.663+0000 7fa9d4600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:21.421 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.663+0000 7fa9d4600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc063430 con 0x7fa9cc108540 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.663+0000 7fa9d1c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.663+0000 7fa9d1c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56784/0 (socket says 172.21.15.55:56784) 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.663+0000 7fa9d1c00700 1 -- 172.21.15.55:0/4146023528 learned_addr learned my addr 172.21.15.55:0/4146023528 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.664+0000 7fa9d1c00700 1 -- 172.21.15.55:0/4146023528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc10ae70 con 0x7fa9cc108540 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.664+0000 7fa9d1c00700 1 --2- 172.21.15.55:0/4146023528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098a0 tx=0x7fa9c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71cf9a56226094 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.664+0000 7fa9cbe00700 1 -- 172.21.15.55:0/4146023528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9c0004160 con 0x7fa9cc108540 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.664+0000 7fa9cbe00700 1 -- 172.21.15.55:0/4146023528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fa9c0004300 con 0x7fa9cc108540 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9cbe00700 1 -- 172.21.15.55:0/4146023528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9c0011a80 con 0x7fa9cc108540 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9d4600700 1 -- 172.21.15.55:0/4146023528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 msgr2=0x7fa9cc10a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9d4600700 1 --2- 172.21.15.55:0/4146023528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00098a0 tx=0x7fa9c0009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9d4600700 1 -- 172.21.15.55:0/4146023528 shutdown_connections 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9d4600700 1 --2- 172.21.15.55:0/4146023528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc10a930 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:21.422 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.665+0000 7fa9d4600700 1 -- 172.21.15.55:0/4146023528 >> 172.21.15.55:0/4146023528 conn(0x7fa9cc101f70 msgr2=0x7fa9cc104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.666+0000 7fa9d4600700 1 -- 172.21.15.55:0/4146023528 shutdown_connections 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.666+0000 7fa9d4600700 1 -- 172.21.15.55:0/4146023528 wait complete. 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d4600700 1 Processor -- start 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d4600700 1 -- start start 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d4600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d4600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc10bdd0 con 0x7fa9cc108540 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d1c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d1c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56790/0 (socket says 172.21.15.55:56790) 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.667+0000 7fa9d1c00700 1 -- 172.21.15.55:0/1858021267 learned_addr learned my addr 172.21.15.55:0/1858021267 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9d1c00700 1 -- 172.21.15.55:0/1858021267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc108300 con 0x7fa9cc108540 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9d1c00700 1 --2- 172.21.15.55:0/1858021267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0011a50 tx=0x7fa9c0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9c00039f0 con 0x7fa9cc108540 2024-03-28T05:32:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fa9c0003b90 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc1064f0 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9c001a600 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.668+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc106a30 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.669+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa9c001ac60 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.669+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa9c0019700 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.669+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc0637c0 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.672+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa9c0024a40 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.752+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa9cc106d70 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.753+0000 7fa9ca000700 1 -- 172.21.15.55:0/1858021267 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fa9c0024440 con 0x7fa9cc108540 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 msgr2=0x7fa9cc107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 --2- 172.21.15.55:0/1858021267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0011a50 tx=0x7fa9c0004290 comp rx=0 tx=0).stop 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 shutdown_connections 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 --2- 172.21.15.55:0/1858021267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9cc108540 0x7fa9cc107dc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 >> 172.21.15.55:0/1858021267 conn(0x7fa9cc101f70 msgr2=0x7fa9cc102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:21.425 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 shutdown_connections 2024-03-28T05:32:21.425 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:20.755+0000 7fa9d4600700 1 -- 172.21.15.55:0/1858021267 wait complete. 2024-03-28T05:32:21.425 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (1/15)... 2024-03-28T05:32:22.043 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:21 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:21.732+0000 7f49af9ff200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T05:32:22.043 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:21 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:21.857+0000 7f49af9ff200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T05:32:22.044 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.042+0000 7f49af9ff200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T05:32:22.372 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.169+0000 7f49af9ff200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T05:32:22.373 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.282+0000 7f49af9ff200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T05:32:22.883 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.623+0000 7f49af9ff200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T05:32:22.883 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.767+0000 7f49af9ff200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T05:32:23.230 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:22 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:22.882+0000 7f49af9ff200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T05:32:23.231 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:23.008+0000 7f49af9ff200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T05:32:23.231 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:23.229+0000 7f49af9ff200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T05:32:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:24 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1918798815' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-28T05:32:24.659 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:24 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:24.591+0000 7f49af9ff200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T05:32:24.670 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:24.671 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "a" 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-28T05:32:24.672 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-28T05:32:24.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-28T05:32:24.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-28T05:32:24.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-28T05:32:24.682 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-28T05:32:24.683 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-28T05:32:24.684 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-03-28T05:32:10.226848+0000", 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-28T05:32:24.685 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.976+0000 7f9446a00700 1 Processor -- start 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.976+0000 7f9446a00700 1 -- start start 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f9446a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f9446a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9440063450 con 0x7f9440108520 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f943fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f943fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56802/0 (socket says 172.21.15.55:56802) 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f943fe00700 1 -- 172.21.15.55:0/484905025 learned_addr learned my addr 172.21.15.55:0/484905025 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.977+0000 7f943fe00700 1 -- 172.21.15.55:0/484905025 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944010ae50 con 0x7f9440108520 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.978+0000 7f943fe00700 1 --2- 172.21.15.55:0/484905025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94300098a0 tx=0x7f9430009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ee515b7288c6fb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.978+0000 7f943ea00700 1 -- 172.21.15.55:0/484905025 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9430004160 con 0x7f9440108520 2024-03-28T05:32:24.686 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.978+0000 7f943ea00700 1 -- 172.21.15.55:0/484905025 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f9430004300 con 0x7f9440108520 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.978+0000 7f943ea00700 1 -- 172.21.15.55:0/484905025 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9430011a80 con 0x7f9440108520 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 -- 172.21.15.55:0/484905025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 msgr2=0x7f944010a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 --2- 172.21.15.55:0/484905025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94300098a0 tx=0x7f9430009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 -- 172.21.15.55:0/484905025 shutdown_connections 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 --2- 172.21.15.55:0/484905025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944010a910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 -- 172.21.15.55:0/484905025 >> 172.21.15.55:0/484905025 conn(0x7f9440101f70 msgr2=0x7f9440104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 -- 172.21.15.55:0/484905025 shutdown_connections 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.979+0000 7f9446a00700 1 -- 172.21.15.55:0/484905025 wait complete. 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.981+0000 7f9446a00700 1 Processor -- start 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.981+0000 7f9446a00700 1 -- start start 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.981+0000 7f9446a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:24.687 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.981+0000 7f9446a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944010bdc0 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.982+0000 7f943fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.982+0000 7f943fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56814/0 (socket says 172.21.15.55:56814) 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.982+0000 7f943fe00700 1 -- 172.21.15.55:0/1918798815 learned_addr learned my addr 172.21.15.55:0/1918798815 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f943fe00700 1 -- 172.21.15.55:0/1918798815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944019e170 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f943fe00700 1 --2- 172.21.15.55:0/1918798815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9430011a50 tx=0x7f9430004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94300039f0 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944019e400 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f9430003b90 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f943001a600 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.983+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94401a10f0 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.984+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f943001acb0 con 0x7f9440108520 2024-03-28T05:32:24.688 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.984+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9430019700 con 0x7f9440108520 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.985+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94400637c0 con 0x7f9440108520 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:23.989+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9430024a40 con 0x7f9440108520 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.067+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f94401a12c0 con 0x7f9440108520 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.068+0000 7f943cc00700 1 -- 172.21.15.55:0/1918798815 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f9430024440 con 0x7f9440108520 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 msgr2=0x7f944019dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 --2- 172.21.15.55:0/1918798815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9430011a50 tx=0x7f9430004290 comp rx=0 tx=0).stop 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 shutdown_connections 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 --2- 172.21.15.55:0/1918798815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9440108520 0x7f944019dc30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 >> 172.21.15.55:0/1918798815 conn(0x7f9440101f70 msgr2=0x7f9440102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 shutdown_connections 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:24.070+0000 7f9446a00700 1 -- 172.21.15.55:0/1918798815 wait complete. 2024-03-28T05:32:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (2/15)... 2024-03-28T05:32:25.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:24 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:24.771+0000 7f49af9ff200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T05:32:25.580 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:25.196+0000 7f49af9ff200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T05:32:25.580 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:25.316+0000 7f49af9ff200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T05:32:25.580 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:25.579+0000 7f49af9ff200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:32:26.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:25.830+0000 7f49af9ff200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T05:32:26.535 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:26 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:26.213+0000 7f49af9ff200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:32:26.826 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:26 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:26.534+0000 7f49af9ff200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T05:32:27.079 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:26 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:26.843+0000 7f49af9ff200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T05:32:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:27 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3122311691' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-28T05:32:27.991 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:27 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:27.963+0000 7f49af9ff200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-28T05:32:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "a" 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:28.016 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-28T05:32:28.017 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.018 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-28T05:32:28.019 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-03-28T05:32:10.226848+0000", 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:28.020 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.235+0000 7fe50a800700 1 Processor -- start 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.235+0000 7fe50a800700 1 -- start start 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.236+0000 7fe50a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.236+0000 7fe50a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504108450 con 0x7fe504107a60 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.236+0000 7fe503400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.236+0000 7fe503400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56822/0 (socket says 172.21.15.55:56822) 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.236+0000 7fe503400700 1 -- 172.21.15.55:0/409949512 learned_addr learned my addr 172.21.15.55:0/409949512 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.237+0000 7fe503400700 1 -- 172.21.15.55:0/409949512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe504108c60 con 0x7fe504107a60 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.237+0000 7fe503400700 1 --2- 172.21.15.55:0/409949512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40098a0 tx=0x7fe4f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d339190747a7c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.237+0000 7fe502000700 1 -- 172.21.15.55:0/409949512 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4f4004160 con 0x7fe504107a60 2024-03-28T05:32:28.021 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.237+0000 7fe502000700 1 -- 172.21.15.55:0/409949512 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fe4f4004300 con 0x7fe504107a60 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.237+0000 7fe502000700 1 -- 172.21.15.55:0/409949512 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4f4011a80 con 0x7fe504107a60 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 -- 172.21.15.55:0/409949512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 msgr2=0x7fe504107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 --2- 172.21.15.55:0/409949512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40098a0 tx=0x7fe4f4009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 -- 172.21.15.55:0/409949512 shutdown_connections 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 --2- 172.21.15.55:0/409949512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe504107e80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 -- 172.21.15.55:0/409949512 >> 172.21.15.55:0/409949512 conn(0x7fe504103060 msgr2=0x7fe504105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.238+0000 7fe50a800700 1 -- 172.21.15.55:0/409949512 shutdown_connections 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.239+0000 7fe50a800700 1 -- 172.21.15.55:0/409949512 wait complete. 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.240+0000 7fe50a800700 1 Processor -- start 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.240+0000 7fe50a800700 1 -- start start 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe50a800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:28.022 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe50a800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50410c010 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe503400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe503400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56830/0 (socket says 172.21.15.55:56830) 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe503400700 1 -- 172.21.15.55:0/3122311691 learned_addr learned my addr 172.21.15.55:0/3122311691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.241+0000 7fe503400700 1 -- 172.21.15.55:0/3122311691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50419e0f0 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe503400700 1 --2- 172.21.15.55:0/3122311691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4006af0 tx=0x7fe4f4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4f40039e0 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fe4f4003b80 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50419e380 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4f40196a0 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5041a1070 con 0x7fe504107a60 2024-03-28T05:32:28.023 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe4f4019ce0 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.242+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe4f4024730 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.243+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5040637c0 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.246+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe4f4043dd0 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.345+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe5041a1240 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.345+0000 7fe4fbe00700 1 -- 172.21.15.55:0/3122311691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1240 (secure 0 0 0) 0x7fe4f4032020 con 0x7fe504107a60 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.346+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 msgr2=0x7fe50419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.346+0000 7fe50a800700 1 --2- 172.21.15.55:0/3122311691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4006af0 tx=0x7fe4f4011c40 comp rx=0 tx=0).stop 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.347+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 shutdown_connections 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.347+0000 7fe50a800700 1 --2- 172.21.15.55:0/3122311691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe504107a60 0x7fe50419dbb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.347+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 >> 172.21.15.55:0/3122311691 conn(0x7fe504103060 msgr2=0x7fe504103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.347+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 shutdown_connections 2024-03-28T05:32:28.024 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:27.347+0000 7fe50a800700 1 -- 172.21.15.55:0/3122311691 wait complete. 2024-03-28T05:32:28.025 INFO:teuthology.orchestra.run.smithi055.stdout:mgr not available, waiting (3/15)... 2024-03-28T05:32:29.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:28.691+0000 7f49af9ff200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T05:32:29.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:28.844+0000 7f49af9ff200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T05:32:29.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:29.137+0000 7f49af9ff200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: Activating manager daemon x 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: mgrmap e2: x(active, starting, since 0.00653177s) 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: Manager daemon x is now available 2024-03-28T05:32:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-28T05:32:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-28T05:32:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' 2024-03-28T05:32:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' 2024-03-28T05:32:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:29 smithi055 ceph-mon[31863]: from='mgr.14100 172.21.15.55:0/4002883266' entity='mgr.x' 2024-03-28T05:32:31.312 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:31 smithi055 ceph-mon[31863]: mgrmap e3: x(active, since 1.01948s) 2024-03-28T05:32:31.312 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:31 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/664706992' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-28T05:32:31.621 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:31.621 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "health": { 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-28T05:32:31.622 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 0 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "a" 2024-03-28T05:32:31.623 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-28T05:32:31.624 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-28T05:32:31.636 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:31.637 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "restful" 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ], 2024-03-28T05:32:31.638 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "modified": "2024-03-28T05:32:10.226848+0000", 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout }, 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.601+0000 7fed5be00700 1 Processor -- start 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.601+0000 7fed5be00700 1 -- start start 2024-03-28T05:32:31.639 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.601+0000 7fed5be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.601+0000 7fed5be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c108240 con 0x7fed5c107850 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.602+0000 7fed5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.602+0000 7fed5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52454/0 (socket says 172.21.15.55:52454) 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.602+0000 7fed5aa00700 1 -- 172.21.15.55:0/579975740 learned_addr learned my addr 172.21.15.55:0/579975740 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.602+0000 7fed5aa00700 1 -- 172.21.15.55:0/579975740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c108a50 con 0x7fed5c107850 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.603+0000 7fed5aa00700 1 --2- 172.21.15.55:0/579975740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0098a0 tx=0x7fed4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fd9f4ee5d6e5f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.603+0000 7fed5a000700 1 -- 172.21.15.55:0/579975740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c004160 con 0x7fed5c107850 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.603+0000 7fed5a000700 1 -- 172.21.15.55:0/579975740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fed4c004300 con 0x7fed5c107850 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.603+0000 7fed5a000700 1 -- 172.21.15.55:0/579975740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c011a80 con 0x7fed5c107850 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 -- 172.21.15.55:0/579975740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 msgr2=0x7fed5c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 --2- 172.21.15.55:0/579975740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0098a0 tx=0x7fed4c009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 -- 172.21.15.55:0/579975740 shutdown_connections 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 --2- 172.21.15.55:0/579975740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c107c70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 -- 172.21.15.55:0/579975740 >> 172.21.15.55:0/579975740 conn(0x7fed5c102df0 msgr2=0x7fed5c105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 -- 172.21.15.55:0/579975740 shutdown_connections 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.604+0000 7fed5be00700 1 -- 172.21.15.55:0/579975740 wait complete. 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.605+0000 7fed5be00700 1 Processor -- start 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.605+0000 7fed5be00700 1 -- start start 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c10be00 con 0x7fed5c107850 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:31.641 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52458/0 (socket says 172.21.15.55:52458) 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5aa00700 1 -- 172.21.15.55:0/664706992 learned_addr learned my addr 172.21.15.55:0/664706992 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.606+0000 7fed5aa00700 1 -- 172.21.15.55:0/664706992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c07e050 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed5aa00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000c00 tx=0x7fed4c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c0039c0 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fed4c003b60 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4c01a6f0 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c07c240 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.607+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c07c780 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.608+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 3) v1 ==== 45989+0+0 (secure 0 0 0) 0x7fed4c024a40 con 0x7fed5c107850 2024-03-28T05:32:31.642 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.608+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0637c0 con 0x7fed5c107850 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.609+0000 7fed60a00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 0x7fed4003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.609+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fed4c04cf20 con 0x7fed5c107850 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.609+0000 7fed53e00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 0x7fed4003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.610+0000 7fed53e00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 0x7fed4003b2c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fed44006fd0 tx=0x7fed44006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.617+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fed4c004300 con 0x7fed5c107850 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.928+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fed5c07ca00 con 0x7fed5c107850 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.929+0000 7fed60a00700 1 -- 172.21.15.55:0/664706992 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fed4c02d770 con 0x7fed5c107850 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 msgr2=0x7fed4003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 0x7fed4003b2c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fed44006fd0 tx=0x7fed44006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 msgr2=0x7fed5c07db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000c00 tx=0x7fed4c004290 comp rx=0 tx=0).stop 2024-03-28T05:32:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 shutdown_connections 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fed40038e00 0x7fed4003b2c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 --2- 172.21.15.55:0/664706992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed5c107850 0x7fed5c07db10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.932+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 >> 172.21.15.55:0/664706992 conn(0x7fed5c102df0 msgr2=0x7fed5c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.933+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 shutdown_connections 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:30.933+0000 7fed5be00700 1 -- 172.21.15.55:0/664706992 wait complete. 2024-03-28T05:32:31.644 INFO:teuthology.orchestra.run.smithi055.stdout:mgr is available 2024-03-28T05:32:32.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:32 smithi055 ceph-mon[31863]: mgrmap e4: x(active, since 2s) 2024-03-28T05:32:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:33 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3687365731' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-28T05:32:33.406 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:33.406 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [global] 2024-03-28T05:32:33.406 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout fsid = 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:33.406 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout [osd] 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-28T05:32:33.407 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.252+0000 7fb1c8000700 1 Processor -- start 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.253+0000 7fb1c8000700 1 -- start start 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.253+0000 7fb1c8000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.253+0000 7fb1c8000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c007b740 con 0x7fb1c007cd10 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.254+0000 7fb1c5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.254+0000 7fb1c5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52464/0 (socket says 172.21.15.55:52464) 2024-03-28T05:32:33.408 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.254+0000 7fb1c5600700 1 -- 172.21.15.55:0/1681244262 learned_addr learned my addr 172.21.15.55:0/1681244262 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.254+0000 7fb1c5600700 1 -- 172.21.15.55:0/1681244262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c007b8c0 con 0x7fb1c007cd10 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1c5600700 1 --2- 172.21.15.55:0/1681244262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40098a0 tx=0x7fb1b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcb19460aa7d5e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1bfe00700 1 -- 172.21.15.55:0/1681244262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4004160 con 0x7fb1c007cd10 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1bfe00700 1 -- 172.21.15.55:0/1681244262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fb1b4004300 con 0x7fb1c007cd10 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1bfe00700 1 -- 172.21.15.55:0/1681244262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4011a80 con 0x7fb1c007cd10 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1c8000700 1 -- 172.21.15.55:0/1681244262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 msgr2=0x7fb1c007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.255+0000 7fb1c8000700 1 --2- 172.21.15.55:0/1681244262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40098a0 tx=0x7fb1b4009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.256+0000 7fb1c8000700 1 -- 172.21.15.55:0/1681244262 shutdown_connections 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.256+0000 7fb1c8000700 1 --2- 172.21.15.55:0/1681244262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c007b170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.256+0000 7fb1c8000700 1 -- 172.21.15.55:0/1681244262 >> 172.21.15.55:0/1681244262 conn(0x7fb1c0103060 msgr2=0x7fb1c0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.256+0000 7fb1c8000700 1 -- 172.21.15.55:0/1681244262 shutdown_connections 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.256+0000 7fb1c8000700 1 -- 172.21.15.55:0/1681244262 wait complete. 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.257+0000 7fb1c8000700 1 Processor -- start 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.257+0000 7fb1c8000700 1 -- start start 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.257+0000 7fb1c8000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.257+0000 7fb1c8000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c010e030 con 0x7fb1c007cd10 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.258+0000 7fb1c5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.258+0000 7fb1c5600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52478/0 (socket says 172.21.15.55:52478) 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.258+0000 7fb1c5600700 1 -- 172.21.15.55:0/3687365731 learned_addr learned my addr 172.21.15.55:0/3687365731 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.258+0000 7fb1c5600700 1 -- 172.21.15.55:0/3687365731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c019e0a0 con 0x7fb1c007cd10 2024-03-28T05:32:33.410 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.258+0000 7fb1c5600700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4011a50 tx=0x7fb1b4011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.259+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4003a80 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.259+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fb1b4003c20 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.259+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b401a650 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.259+0000 7fb1c8000700 1 -- 172.21.15.55:0/3687365731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c019e330 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.259+0000 7fb1c8000700 1 -- 172.21.15.55:0/3687365731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c01a1020 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.260+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 46095+0+0 (secure 0 0 0) 0x7fb1b4024ad0 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.260+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00637c0 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.260+0000 7fb1be000700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 0x7fb1a803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.260+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb1b404d210 con 0x7fb1c007cd10 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.261+0000 7fb1c4c00700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 0x7fb1a803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:33.411 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.261+0000 7fb1c4c00700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 0x7fb1a803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac006fd0 tx=0x7fb1ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.266+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb1b400f2e0 con 0x7fb1c007cd10 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.488+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb1c0074a20 con 0x7fb1c007cd10 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.490+0000 7fb1be000700 1 -- 172.21.15.55:0/3687365731 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+400 (secure 0 0 0) 0x7fb1b400e260 con 0x7fb1c007cd10 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 msgr2=0x7fb1a803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 0x7fb1a803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac006fd0 tx=0x7fb1ac006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 msgr2=0x7fb1c019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4011a50 tx=0x7fb1b4011b30 comp rx=0 tx=0).stop 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 shutdown_connections 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7fb1a8038f20 0x7fb1a803b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 --2- 172.21.15.55:0/3687365731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c007cd10 0x7fb1c019db60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:33.412 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.493+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 >> 172.21.15.55:0/3687365731 conn(0x7fb1c0103060 msgr2=0x7fb1c0103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:33.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.494+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 shutdown_connections 2024-03-28T05:32:33.413 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:32.494+0000 7fb1b3400700 1 -- 172.21.15.55:0/3687365731 wait complete. 2024-03-28T05:32:33.413 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling cephadm module... 2024-03-28T05:32:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:34 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3786950838' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-28T05:32:34.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: ignoring --setuser ceph since I am not root 2024-03-28T05:32:34.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: ignoring --setgroup ceph since I am not root 2024-03-28T05:32:34.947 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.994+0000 7effeac00700 1 Processor -- start 2024-03-28T05:32:34.947 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.995+0000 7effeac00700 1 -- start start 2024-03-28T05:32:34.947 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.995+0000 7effeac00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.995+0000 7effeac00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe410a620 con 0x7effe4109c30 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.996+0000 7effe3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.996+0000 7effe3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52490/0 (socket says 172.21.15.55:52490) 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.996+0000 7effe3e00700 1 -- 172.21.15.55:0/3821925008 learned_addr learned my addr 172.21.15.55:0/3821925008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.996+0000 7effe3e00700 1 -- 172.21.15.55:0/3821925008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe410ae30 con 0x7effe4109c30 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.996+0000 7effe3e00700 1 --2- 172.21.15.55:0/3821925008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effd40098a0 tx=0x7effd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37080b5f8625e3da server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.997+0000 7effe2a00700 1 -- 172.21.15.55:0/3821925008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd4004160 con 0x7effe4109c30 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.997+0000 7effe2a00700 1 -- 172.21.15.55:0/3821925008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7effd4004300 con 0x7effe4109c30 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.997+0000 7effe2a00700 1 -- 172.21.15.55:0/3821925008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd4011a80 con 0x7effe4109c30 2024-03-28T05:32:34.948 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.997+0000 7effeac00700 1 -- 172.21.15.55:0/3821925008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 msgr2=0x7effe410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.997+0000 7effeac00700 1 --2- 172.21.15.55:0/3821925008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effd40098a0 tx=0x7effd4009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.998+0000 7effeac00700 1 -- 172.21.15.55:0/3821925008 shutdown_connections 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.998+0000 7effeac00700 1 --2- 172.21.15.55:0/3821925008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe410a050 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.998+0000 7effeac00700 1 -- 172.21.15.55:0/3821925008 >> 172.21.15.55:0/3821925008 conn(0x7effe4105350 msgr2=0x7effe4107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.998+0000 7effeac00700 1 -- 172.21.15.55:0/3821925008 shutdown_connections 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.998+0000 7effeac00700 1 -- 172.21.15.55:0/3821925008 wait complete. 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.999+0000 7effeac00700 1 Processor -- start 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:33.999+0000 7effeac00700 1 -- start start 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.000+0000 7effeac00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.000+0000 7effeac00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe410e1e0 con 0x7effe4109c30 2024-03-28T05:32:34.949 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.000+0000 7effe3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.000+0000 7effe3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52498/0 (socket says 172.21.15.55:52498) 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.000+0000 7effe3e00700 1 -- 172.21.15.55:0/3786950838 learned_addr learned my addr 172.21.15.55:0/3786950838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effe3e00700 1 -- 172.21.15.55:0/3786950838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe419e0e0 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effe3e00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effd4000c00 tx=0x7effd4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd40039f0 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7effd4003b90 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd401a740 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe419e370 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.001+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe41a1060 con 0x7effe4109c30 2024-03-28T05:32:34.950 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.002+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe40637c0 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.003+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 46095+0+0 (secure 0 0 0) 0x7effd4024af0 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.003+0000 7effe0c00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 0x7effc803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.003+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7effd404d150 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.003+0000 7effe3400700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 0x7effc803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.004+0000 7effe3400700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 0x7effc803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effcc006fd0 tx=0x7effcc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.008+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7effd404cb70 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.299+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7effe41a1230 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.353+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7effe41a1230 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.356+0000 7effe0c00700 1 -- 172.21.15.55:0/3786950838 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 5) v1 ==== 46106+0+0 (secure 0 0 0) 0x7effd402d3f0 con 0x7effe4109c30 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.357+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 msgr2=0x7effc803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:34.951 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.357+0000 7effeac00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 0x7effc803b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7effcc006fd0 tx=0x7effcc006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.357+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 msgr2=0x7effe419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.357+0000 7effeac00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effd4000c00 tx=0x7effd4011b00 comp rx=0 tx=0).stop 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 shutdown_connections 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7effc8038f20 0x7effc803b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 --2- 172.21.15.55:0/3786950838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effe4109c30 0x7effe419dba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 >> 172.21.15.55:0/3786950838 conn(0x7effe4105350 msgr2=0x7effe4106e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 shutdown_connections 2024-03-28T05:32:34.952 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:34.358+0000 7effeac00700 1 -- 172.21.15.55:0/3786950838 wait complete. 2024-03-28T05:32:35.506 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:35 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3786950838' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-28T05:32:35.506 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:35 smithi055 ceph-mon[31863]: mgrmap e5: x(active, since 5s) 2024-03-28T05:32:35.506 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:35 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:35.199+0000 7fa08115a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T05:32:35.506 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:35 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:35.325+0000 7fa08115a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T05:32:36.460 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1091578827' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-28T05:32:36.460 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:36.149+0000 7fa08115a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T05:32:36.460 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:36.274+0000 7fa08115a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T05:32:36.460 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:36.458+0000 7fa08115a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.505+0000 7f0ca3200700 1 Processor -- start 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.505+0000 7f0ca3200700 1 -- start start 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.505+0000 7f0ca3200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.505+0000 7f0ca3200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c0633d0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.506+0000 7f0c9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.506+0000 7f0c9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52534/0 (socket says 172.21.15.55:52534) 2024-03-28T05:32:36.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.506+0000 7f0c9be00700 1 -- 172.21.15.55:0/1684971977 learned_addr learned my addr 172.21.15.55:0/1684971977 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.506+0000 7f0c9be00700 1 -- 172.21.15.55:0/1684971977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c10aed0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.507+0000 7f0c9be00700 1 --2- 172.21.15.55:0/1684971977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098a0 tx=0x7f0c8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c059270d38e82d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.507+0000 7f0c9aa00700 1 -- 172.21.15.55:0/1684971977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c004160 con 0x7f0c9c1085a0 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.507+0000 7f0c9aa00700 1 -- 172.21.15.55:0/1684971977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f0c8c004300 con 0x7f0c9c1085a0 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.507+0000 7f0c9aa00700 1 -- 172.21.15.55:0/1684971977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c011a80 con 0x7f0c9c1085a0 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 -- 172.21.15.55:0/1684971977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 msgr2=0x7f0c9c10a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1684971977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098a0 tx=0x7f0c8c009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 -- 172.21.15.55:0/1684971977 shutdown_connections 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1684971977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c10a990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 -- 172.21.15.55:0/1684971977 >> 172.21.15.55:0/1684971977 conn(0x7f0c9c101f70 msgr2=0x7f0c9c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 -- 172.21.15.55:0/1684971977 shutdown_connections 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.508+0000 7f0ca3200700 1 -- 172.21.15.55:0/1684971977 wait complete. 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.509+0000 7f0ca3200700 1 Processor -- start 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.509+0000 7f0ca3200700 1 -- start start 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0ca3200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:36.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0ca3200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c10bdd0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0c9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0c9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52536/0 (socket says 172.21.15.55:52536) 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0c9be00700 1 -- 172.21.15.55:0/1091578827 learned_addr learned my addr 172.21.15.55:0/1091578827 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0c9be00700 1 -- 172.21.15.55:0/1091578827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c19bf10 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.510+0000 7f0c9be00700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c011a50 tx=0x7f0c8c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.511+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c0039f0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.511+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f0c8c003b90 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.511+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c19c1a0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.511+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c01a600 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.511+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c19ee90 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.512+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c0637c0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.512+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f0c8c024440 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.513+0000 7f0c98c00700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 0x7f0c8003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.513+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0c8c04d2c0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.513+0000 7f0c9b400700 1 -- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 msgr2=0x7f0c8003b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:36.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.513+0000 7f0c9b400700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 0x7f0c8003b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.518+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f0c8c04cce0 con 0x7f0c9c1085a0 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.714+0000 7f0c9b400700 1 -- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 msgr2=0x7f0c8003b3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.714+0000 7f0c9b400700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 0x7f0c8003b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.797+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0c9c19f060 con 0x7f0c9c1085a0 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.798+0000 7f0c98c00700 1 -- 172.21.15.55:0/1091578827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f0c9c19f060 con 0x7f0c9c1085a0 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.801+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 msgr2=0x7f0c8003b3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.801+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 0x7f0c8003b3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.801+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 msgr2=0x7f0c9c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.801+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c011a50 tx=0x7f0c8c004290 comp rx=0 tx=0).stop 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 shutdown_connections 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f0c80038f20 0x7f0c8003b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 --2- 172.21.15.55:0/1091578827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c9c1085a0 0x7f0c9c19b9d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 >> 172.21.15.55:0/1091578827 conn(0x7f0c9c101f70 msgr2=0x7f0c9c102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:36.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 shutdown_connections 2024-03-28T05:32:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:35.802+0000 7f0ca3200700 1 -- 172.21.15.55:0/1091578827 wait complete. 2024-03-28T05:32:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for the mgr to restart... 2024-03-28T05:32:36.479 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr epoch 5... 2024-03-28T05:32:36.800 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:36.591+0000 7fa08115a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T05:32:36.800 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:36.704+0000 7fa08115a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T05:32:37.054 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:37.053+0000 7fa08115a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T05:32:37.317 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:37.201+0000 7fa08115a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T05:32:37.317 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:37.316+0000 7fa08115a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T05:32:37.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:37.445+0000 7fa08115a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T05:32:38.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:37.666+0000 7fa08115a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T05:32:39.373 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:38 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:38.981+0000 7fa08115a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T05:32:39.373 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:39 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:39.158+0000 7fa08115a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T05:32:39.873 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:39 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:39.583+0000 7fa08115a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T05:32:39.873 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:39 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:39.704+0000 7fa08115a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T05:32:40.226 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:39 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:39.967+0000 7fa08115a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:32:40.609 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:40.221+0000 7fa08115a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T05:32:40.609 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:40.607+0000 7fa08115a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:32:41.242 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:40.930+0000 7fa08115a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T05:32:41.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:41 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:41.240+0000 7fa08115a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T05:32:42.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:42 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:42.299+0000 7fa08115a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T05:32:43.299 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:43.015+0000 7fa08115a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T05:32:43.299 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:43.149+0000 7fa08115a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T05:32:43.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:32:43.438+0000 7fa08115a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: Active manager daemon x restarted 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: Activating manager daemon x 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: osdmap e2: 0 total, 0 up, 0 in 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: mgrmap e6: x(active, starting, since 0.00498276s) 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-28T05:32:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-28T05:32:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-28T05:32:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-28T05:32:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:43 smithi055 ceph-mon[31863]: Manager daemon x is now available 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: Found migration_current of "None". Setting to last migration. 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:32:44.830 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:32:44.831 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-28T05:32:44.831 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-28T05:32:44.831 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: mgrmap e7: x(active, since 1.02048s) 2024-03-28T05:32:44.831 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-28T05:32:44.831 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:44 smithi055 ceph-mon[31863]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-28T05:32:45.150 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.081+0000 7f775fe00700 1 Processor -- start 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.081+0000 7f775fe00700 1 -- start start 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.081+0000 7f775fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.081+0000 7f775fe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7760107100 con 0x7f7760106710 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.082+0000 7f775ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.082+0000 7f775ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52552/0 (socket says 172.21.15.55:52552) 2024-03-28T05:32:45.151 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.082+0000 7f775ea00700 1 -- 172.21.15.55:0/3860853766 learned_addr learned my addr 172.21.15.55:0/3860853766 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.082+0000 7f775ea00700 1 -- 172.21.15.55:0/3860853766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7760107910 con 0x7f7760106710 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.082+0000 7f775ea00700 1 --2- 172.21.15.55:0/3860853766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77500098a0 tx=0x7f7750009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c09e83accb3c0e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.083+0000 7f775d600700 1 -- 172.21.15.55:0/3860853766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7750004160 con 0x7f7760106710 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.083+0000 7f775d600700 1 -- 172.21.15.55:0/3860853766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f7750004300 con 0x7f7760106710 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.083+0000 7f775d600700 1 -- 172.21.15.55:0/3860853766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7750011a80 con 0x7f7760106710 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.083+0000 7f775fe00700 1 -- 172.21.15.55:0/3860853766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 msgr2=0x7f7760106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.083+0000 7f775fe00700 1 --2- 172.21.15.55:0/3860853766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77500098a0 tx=0x7f7750009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.084+0000 7f775fe00700 1 -- 172.21.15.55:0/3860853766 shutdown_connections 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.084+0000 7f775fe00700 1 --2- 172.21.15.55:0/3860853766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f7760106b30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.152 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.084+0000 7f775fe00700 1 -- 172.21.15.55:0/3860853766 >> 172.21.15.55:0/3860853766 conn(0x7f7760101d70 msgr2=0x7f7760104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.084+0000 7f775fe00700 1 -- 172.21.15.55:0/3860853766 shutdown_connections 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.084+0000 7f775fe00700 1 -- 172.21.15.55:0/3860853766 wait complete. 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.085+0000 7f775fe00700 1 Processor -- start 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.085+0000 7f775fe00700 1 -- start start 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775fe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600625d0 con 0x7f7760106710 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775ea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52554/0 (socket says 172.21.15.55:52554) 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775ea00700 1 -- 172.21.15.55:0/1635297738 learned_addr learned my addr 172.21.15.55:0/1635297738 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.086+0000 7f775ea00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776019df60 con 0x7f7760106710 2024-03-28T05:32:45.153 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f775ea00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7750000c00 tx=0x7f7750004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77500039c0 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f7750003b60 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776019e1f0 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f775001a6f0 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.087+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77601a0ee0 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.088+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f775001a890 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.089+0000 7f7764a00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.089+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f774403bb40 con 0x7f7744038f70 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.089+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f775004d050 con 0x7f7760106710 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.089+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.089+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:32:45.154 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.290+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.290+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.691+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:37.691+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:38.492+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:38.492+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:40.094+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:40.094+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:43.298+0000 7f775e000700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/860110821 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:43.298+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:43.447+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mgrmap(e 6) v1 ==== 45873+0+0 (secure 0 0 0) 0x7f775001ab80 con 0x7f7760106710 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:43.448+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 msgr2=0x7f774403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:32:45.155 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:43.448+0000 7f7764a00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.456+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 7) v1 ==== 46000+0+0 (secure 0 0 0) 0x7f775002d3f0 con 0x7f7760106710 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.457+0000 7f7764a00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 0x7f774403ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.457+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f775000f500 con 0x7f774403c860 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.459+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 0x7f774403ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.461+0000 7f775e000700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 0x7f774403ec50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f774c003a10 tx=0x7f774c0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.464+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f775000f500 con 0x7f774403c860 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.472+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f77600637c0 con 0x7f774403c860 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.472+0000 7f7764a00700 1 -- 172.21.15.55:0/1635297738 <== mgr.14120 v2:172.21.15.55:6800/2069525720 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f77600637c0 con 0x7f774403c860 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 msgr2=0x7f774403ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 0x7f774403ec50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f774c003a10 tx=0x7f774c0092b0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 msgr2=0x7f776019da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:45.156 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7750000c00 tx=0x7f7750004290 comp rx=0 tx=0).stop 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 shutdown_connections 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f774403c860 0x7f774403ec50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7760106710 0x7f776019da20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 --2- 172.21.15.55:0/1635297738 >> [v2:172.21.15.55:6800/860110821,v1:172.21.15.55:6801/860110821] conn(0x7f7744038f70 0x7f774403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 >> 172.21.15.55:0/1635297738 conn(0x7f7760101d70 msgr2=0x7f776018fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.473+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 shutdown_connections 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:44.474+0000 7f775fe00700 1 -- 172.21.15.55:0/1635297738 wait complete. 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:mgr epoch 5 is available 2024-03-28T05:32:45.157 INFO:teuthology.orchestra.run.smithi055.stdout:Setting orchestrator backend to cephadm... 2024-03-28T05:32:45.723 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:45 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:45.723 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:45 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.722+0000 7f09ffc00700 1 Processor -- start 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.722+0000 7f09ffc00700 1 -- start start 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.723+0000 7f09ffc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.723+0000 7f09ffc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8109a40 con 0x7f09f8109050 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.723+0000 7f09fd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.723+0000 7f09fd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42310/0 (socket says 172.21.15.55:42310) 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.723+0000 7f09fd200700 1 -- 172.21.15.55:0/3282396167 learned_addr learned my addr 172.21.15.55:0/3282396167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.724+0000 7f09fd200700 1 -- 172.21.15.55:0/3282396167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8109bc0 con 0x7f09f8109050 2024-03-28T05:32:46.705 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.724+0000 7f09fd200700 1 --2- 172.21.15.55:0/3282396167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0098a0 tx=0x7f09ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db492b4dd455708 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.724+0000 7f09f7400700 1 -- 172.21.15.55:0/3282396167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec004160 con 0x7f09f8109050 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.724+0000 7f09f7400700 1 -- 172.21.15.55:0/3282396167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f09ec004300 con 0x7f09f8109050 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.724+0000 7f09f7400700 1 -- 172.21.15.55:0/3282396167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec011a80 con 0x7f09f8109050 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 -- 172.21.15.55:0/3282396167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 msgr2=0x7f09f8109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 --2- 172.21.15.55:0/3282396167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0098a0 tx=0x7f09ec009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 -- 172.21.15.55:0/3282396167 shutdown_connections 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 --2- 172.21.15.55:0/3282396167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f8109470 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 -- 172.21.15.55:0/3282396167 >> 172.21.15.55:0/3282396167 conn(0x7f09f81016f0 msgr2=0x7f09f8103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 -- 172.21.15.55:0/3282396167 shutdown_connections 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.725+0000 7f09ffc00700 1 -- 172.21.15.55:0/3282396167 wait complete. 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.726+0000 7f09ffc00700 1 Processor -- start 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.726+0000 7f09ffc00700 1 -- start start 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09ffc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:46.706 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09ffc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8106850 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09fd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09fd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42314/0 (socket says 172.21.15.55:42314) 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09fd200700 1 -- 172.21.15.55:0/2251722165 learned_addr learned my addr 172.21.15.55:0/2251722165 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.727+0000 7f09fd200700 1 -- 172.21.15.55:0/2251722165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f819e110 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09fd200700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f09ec000c00 tx=0x7f09ec004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec0039c0 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f09ec003b60 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f819e400 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09ec01a6f0 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.728+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f81a1090 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.729+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f09ec024a40 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.729+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f810bfe0 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.730+0000 7f09f5600700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 0x7f09e003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.730+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f09ec04d1b0 con 0x7f09f8109050 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.730+0000 7f09f7e00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 0x7f09e003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:46.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.731+0000 7f09f7e00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 0x7f09e003b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e4006fd0 tx=0x7f09e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.737+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f09ec04cb00 con 0x7f09f8109050 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.977+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f81a1260 con 0x7f09e0038f70 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.987+0000 7f09f5600700 1 -- 172.21.15.55:0/2251722165 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f09f81a1260 con 0x7f09e0038f70 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.989+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 msgr2=0x7f09e003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 0x7f09e003b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09e4006fd0 tx=0x7f09e4006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 msgr2=0x7f09f819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f09ec000c00 tx=0x7f09ec004290 comp rx=0 tx=0).stop 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 shutdown_connections 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f09e0038f70 0x7f09e003b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 --2- 172.21.15.55:0/2251722165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f8109050 0x7f09f819dbd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 >> 172.21.15.55:0/2251722165 conn(0x7f09f81016f0 msgr2=0x7f09f81021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 shutdown_connections 2024-03-28T05:32:46.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:45.990+0000 7f09ffc00700 1 -- 172.21.15.55:0/2251722165 wait complete. 2024-03-28T05:32:46.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: mgrmap e8: x(active, since 2s) 2024-03-28T05:32:46.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: [28/Mar/2024:05:32:45] ENGINE Bus STARTING 2024-03-28T05:32:46.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: [28/Mar/2024:05:32:46] ENGINE Serving on https://172.21.15.55:7150 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: [28/Mar/2024:05:32:46] ENGINE Serving on http://172.21.15.55:8765 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: [28/Mar/2024:05:32:46] ENGINE Bus STARTED 2024-03-28T05:32:46.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:46 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:32:48.178 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.285+0000 7fb2d4400700 1 Processor -- start 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.285+0000 7fb2d4400700 1 -- start start 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.285+0000 7fb2d4400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.286+0000 7fb2d4400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc108450 con 0x7fb2cc107a60 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.286+0000 7fb2d1a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.286+0000 7fb2d1a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42320/0 (socket says 172.21.15.55:42320) 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.286+0000 7fb2d1a00700 1 -- 172.21.15.55:0/4089732853 learned_addr learned my addr 172.21.15.55:0/4089732853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.287+0000 7fb2d1a00700 1 -- 172.21.15.55:0/4089732853 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc108c60 con 0x7fb2cc107a60 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.287+0000 7fb2d1a00700 1 --2- 172.21.15.55:0/4089732853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00098a0 tx=0x7fb2c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf36d3c174389f79 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.287+0000 7fb2cbe00700 1 -- 172.21.15.55:0/4089732853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c0004160 con 0x7fb2cc107a60 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.287+0000 7fb2cbe00700 1 -- 172.21.15.55:0/4089732853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fb2c0004300 con 0x7fb2cc107a60 2024-03-28T05:32:48.180 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.287+0000 7fb2cbe00700 1 -- 172.21.15.55:0/4089732853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c0011a80 con 0x7fb2cc107a60 2024-03-28T05:32:48.181 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 -- 172.21.15.55:0/4089732853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 msgr2=0x7fb2cc107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 --2- 172.21.15.55:0/4089732853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00098a0 tx=0x7fb2c0009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 -- 172.21.15.55:0/4089732853 shutdown_connections 2024-03-28T05:32:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 --2- 172.21.15.55:0/4089732853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc107e80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 -- 172.21.15.55:0/4089732853 >> 172.21.15.55:0/4089732853 conn(0x7fb2cc103060 msgr2=0x7fb2cc105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:48.187 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 -- 172.21.15.55:0/4089732853 shutdown_connections 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.288+0000 7fb2d4400700 1 -- 172.21.15.55:0/4089732853 wait complete. 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.289+0000 7fb2d4400700 1 Processor -- start 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d4400700 1 -- start start 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d4400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d4400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc10c010 con 0x7fb2cc107a60 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d1a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d1a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42322/0 (socket says 172.21.15.55:42322) 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.290+0000 7fb2d1a00700 1 -- 172.21.15.55:0/33100460 learned_addr learned my addr 172.21.15.55:0/33100460 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2d1a00700 1 -- 172.21.15.55:0/33100460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc19bf00 con 0x7fb2cc107a60 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2d1a00700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0000c00 tx=0x7fb2c0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c00039f0 con 0x7fb2cc107a60 2024-03-28T05:32:48.188 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fb2c0003b90 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c001a740 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc19c190 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.291+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc19ee80 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.293+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0637c0 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.293+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7fb2c0024af0 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.293+0000 7fb2ca000700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 0x7fb2b403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.293+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb2c004d260 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.293+0000 7fb2d1000700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 0x7fb2b403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.294+0000 7fb2d1000700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 0x7fb2b403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8006fd0 tx=0x7fb2b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.299+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb2c0004300 con 0x7fb2cc107a60 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.523+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2cc1042d0 con 0x7fb2b4038f70 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.524+0000 7fb2ca000700 1 -- 172.21.15.55:0/33100460 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb2cc1042d0 con 0x7fb2b4038f70 2024-03-28T05:32:48.189 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 msgr2=0x7fb2b403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 0x7fb2b403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8006fd0 tx=0x7fb2b8006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 msgr2=0x7fb2cc19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0000c00 tx=0x7fb2c0011b00 comp rx=0 tx=0).stop 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 shutdown_connections 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fb2b4038f70 0x7fb2b403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 --2- 172.21.15.55:0/33100460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2cc107a60 0x7fb2cc19b9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 >> 172.21.15.55:0/33100460 conn(0x7fb2cc103060 msgr2=0x7fb2cc103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 shutdown_connections 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:47.527+0000 7fb2d4400700 1 -- 172.21.15.55:0/33100460 wait complete. 2024-03-28T05:32:48.190 INFO:teuthology.orchestra.run.smithi055.stdout:Generating ssh key... 2024-03-28T05:32:48.766 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:48 smithi055 ceph-mon[31863]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: Generating public/private rsa key pair. 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: Your identification has been saved in /tmp/tmpih1t1a74/key. 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: Your public key has been saved in /tmp/tmpih1t1a74/key.pub. 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: The key fingerprint is: 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: SHA256:N77RymmgiQ8KWXJ8rhgHHJKlWR6CSQtHhCGuwEoZjVs ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: The key's randomart image is: 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: +---[RSA 3072]----+ 2024-03-28T05:32:49.536 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |BOX | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |O@+E | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |*B+ | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |Bo. | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |=.+ . S o | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: | * o .o o | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |+ . o. o .o . | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: | = o..o ..= | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: |. o .. .= | 2024-03-28T05:32:49.537 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:32:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: +----[SHA256]-----+ 2024-03-28T05:32:49.802 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.765+0000 7f38b9e00700 1 Processor -- start 2024-03-28T05:32:49.802 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.765+0000 7f38b9e00700 1 -- start start 2024-03-28T05:32:49.802 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.766+0000 7f38b9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.766+0000 7f38b9e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4063470 con 0x7f38b41062f0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.766+0000 7f38b2a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.766+0000 7f38b2a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42326/0 (socket says 172.21.15.55:42326) 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.766+0000 7f38b2a00700 1 -- 172.21.15.55:0/1382267311 learned_addr learned my addr 172.21.15.55:0/1382267311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.767+0000 7f38b2a00700 1 -- 172.21.15.55:0/1382267311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4106c50 con 0x7f38b41062f0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.767+0000 7f38b2a00700 1 --2- 172.21.15.55:0/1382267311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38a40098a0 tx=0x7f38a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d2c0f945ae3f65 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.767+0000 7f38b1600700 1 -- 172.21.15.55:0/1382267311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a4004160 con 0x7f38b41062f0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.767+0000 7f38b1600700 1 -- 172.21.15.55:0/1382267311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f38a4004300 con 0x7f38b41062f0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.767+0000 7f38b1600700 1 -- 172.21.15.55:0/1382267311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a4011a80 con 0x7f38b41062f0 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 -- 172.21.15.55:0/1382267311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 msgr2=0x7f38b4106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 --2- 172.21.15.55:0/1382267311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38a40098a0 tx=0x7f38a4009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:49.803 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 -- 172.21.15.55:0/1382267311 shutdown_connections 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 --2- 172.21.15.55:0/1382267311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b4106710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 -- 172.21.15.55:0/1382267311 >> 172.21.15.55:0/1382267311 conn(0x7f38b4101f70 msgr2=0x7f38b4104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 -- 172.21.15.55:0/1382267311 shutdown_connections 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.768+0000 7f38b9e00700 1 -- 172.21.15.55:0/1382267311 wait complete. 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.769+0000 7f38b9e00700 1 Processor -- start 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.769+0000 7f38b9e00700 1 -- start start 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b9e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b9e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4107c80 con 0x7f38b41062f0 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b2a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b2a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42340/0 (socket says 172.21.15.55:42340) 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b2a00700 1 -- 172.21.15.55:0/712457725 learned_addr learned my addr 172.21.15.55:0/712457725 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.770+0000 7f38b2a00700 1 -- 172.21.15.55:0/712457725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b419e110 con 0x7f38b41062f0 2024-03-28T05:32:49.804 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b2a00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38a4011a50 tx=0x7f38a4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a40039f0 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f38a4003b90 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a401a600 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b419e3a0 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.771+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b41a1090 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.772+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f38a4024a40 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.772+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b40637c0 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.773+0000 7f38b8a00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 0x7f389803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.773+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f38a404d390 con 0x7f38b41062f0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.773+0000 7f38b2000700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 0x7f389803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.774+0000 7f38b2000700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 0x7f389803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006fd0 tx=0x7f38a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:49.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.778+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f38a404cce0 con 0x7f38b41062f0 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:48.996+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f38b40008d0 con 0x7f3898038f70 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.147+0000 7f38b8a00700 1 -- 172.21.15.55:0/712457725 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f38b40008d0 con 0x7f3898038f70 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.150+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 msgr2=0x7f389803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.150+0000 7f38b9e00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 0x7f389803b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006fd0 tx=0x7f38a0006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.150+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 msgr2=0x7f38b419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.150+0000 7f38b9e00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38a4011a50 tx=0x7f38a4004290 comp rx=0 tx=0).stop 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 shutdown_connections 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f3898038f70 0x7f389803b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 --2- 172.21.15.55:0/712457725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38b41062f0 0x7f38b419dbd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 >> 172.21.15.55:0/712457725 conn(0x7f38b4101f70 msgr2=0x7f38b41947f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 shutdown_connections 2024-03-28T05:32:49.806 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:49.151+0000 7f38b9e00700 1 -- 172.21.15.55:0/712457725 wait complete. 2024-03-28T05:32:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:50 smithi055 ceph-mon[31863]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:32:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:50 smithi055 ceph-mon[31863]: Generating ssh key... 2024-03-28T05:32:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:50 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:50 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.394+0000 7f188c000700 1 Processor -- start 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.395+0000 7f188c000700 1 -- start start 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.395+0000 7f188c000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.395+0000 7f188c000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188407f1f0 con 0x7f188407e800 2024-03-28T05:32:51.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.396+0000 7f1889600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.396+0000 7f1889600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55960/0 (socket says 172.21.15.55:55960) 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.396+0000 7f1889600700 1 -- 172.21.15.55:0/1770705511 learned_addr learned my addr 172.21.15.55:0/1770705511 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.396+0000 7f1889600700 1 -- 172.21.15.55:0/1770705511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188407fa50 con 0x7f188407e800 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f1889600700 1 --2- 172.21.15.55:0/1770705511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18780098a0 tx=0x7f1878009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576ab6cd6065602b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f1883e00700 1 -- 172.21.15.55:0/1770705511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1878004160 con 0x7f188407e800 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f1883e00700 1 -- 172.21.15.55:0/1770705511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f1878004300 con 0x7f188407e800 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f1883e00700 1 -- 172.21.15.55:0/1770705511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1878011a80 con 0x7f188407e800 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f188c000700 1 -- 172.21.15.55:0/1770705511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 msgr2=0x7f188407ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.397+0000 7f188c000700 1 --2- 172.21.15.55:0/1770705511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18780098a0 tx=0x7f1878009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.398+0000 7f188c000700 1 -- 172.21.15.55:0/1770705511 shutdown_connections 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.398+0000 7f188c000700 1 --2- 172.21.15.55:0/1770705511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f188407ec20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:51.304 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.398+0000 7f188c000700 1 -- 172.21.15.55:0/1770705511 >> 172.21.15.55:0/1770705511 conn(0x7f188407d0a0 msgr2=0x7f188407d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.398+0000 7f188c000700 1 -- 172.21.15.55:0/1770705511 shutdown_connections 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.398+0000 7f188c000700 1 -- 172.21.15.55:0/1770705511 wait complete. 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.399+0000 7f188c000700 1 Processor -- start 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.399+0000 7f188c000700 1 -- start start 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.399+0000 7f188c000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.399+0000 7f188c000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884080e10 con 0x7f188407e800 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.400+0000 7f1889600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.400+0000 7f1889600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55962/0 (socket says 172.21.15.55:55962) 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.400+0000 7f1889600700 1 -- 172.21.15.55:0/3378424372 learned_addr learned my addr 172.21.15.55:0/3378424372 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.400+0000 7f1889600700 1 -- 172.21.15.55:0/3378424372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18841a24c0 con 0x7f188407e800 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.400+0000 7f1889600700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1878011a50 tx=0x7f1878011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.401+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1878003a80 con 0x7f188407e800 2024-03-28T05:32:51.305 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.401+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f1878003c20 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.401+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f187801a650 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.401+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18841a2750 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.401+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18841a5440 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.402+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f1878024ad0 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.402+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18840637c0 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.402+0000 7f1882000700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 0x7f186c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.402+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f187804d410 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.403+0000 7f1888c00700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 0x7f186c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.403+0000 7f1888c00700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 0x7f186c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.408+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f18780244f0 con 0x7f188407e800 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.634+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f188402dd60 con 0x7f186c038f70 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.635+0000 7f1882000700 1 -- 172.21.15.55:0/3378424372 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f188402dd60 con 0x7f186c038f70 2024-03-28T05:32:51.306 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.637+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 msgr2=0x7f186c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.637+0000 7f188c000700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 0x7f186c03b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 msgr2=0x7f18841a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1878011a50 tx=0x7f1878011b30 comp rx=0 tx=0).stop 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 shutdown_connections 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f186c038f70 0x7f186c03b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 --2- 172.21.15.55:0/3378424372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f188407e800 0x7f18841a1f80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 >> 172.21.15.55:0/3378424372 conn(0x7f188407d0a0 msgr2=0x7f1884198c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 shutdown_connections 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:50.638+0000 7f188c000700 1 -- 172.21.15.55:0/3378424372 wait complete. 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:Adding key to root@localhost authorized_keys... 2024-03-28T05:32:51.308 INFO:teuthology.orchestra.run.smithi055.stdout:Adding host smithi055... 2024-03-28T05:32:51.858 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:51 smithi055 ceph-mon[31863]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:32:52.696 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:52 smithi055 ceph-mon[31863]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi055", "addr": "172.21.15.55", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:32:54.819 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:54 smithi055 ceph-mon[31863]: Deploying cephadm binary to smithi055 2024-03-28T05:32:59.626 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Added host 'smithi055' with addr '172.21.15.55' 2024-03-28T05:32:59.626 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.931+0000 7fd4cdc00700 1 Processor -- start 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4cdc00700 1 -- start start 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4cdc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4cdc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c807bdc0 con 0x7fd4c8108330 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4c7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4c7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55964/0 (socket says 172.21.15.55:55964) 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.932+0000 7fd4c7e00700 1 -- 172.21.15.55:0/1289390499 learned_addr learned my addr 172.21.15.55:0/1289390499 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.933+0000 7fd4c7e00700 1 -- 172.21.15.55:0/1289390499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c810ac60 con 0x7fd4c8108330 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.933+0000 7fd4c7e00700 1 --2- 172.21.15.55:0/1289390499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80098a0 tx=0x7fd4b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ae5f2da11c2077 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.933+0000 7fd4c6a00700 1 -- 172.21.15.55:0/1289390499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4b8004160 con 0x7fd4c8108330 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.933+0000 7fd4c6a00700 1 -- 172.21.15.55:0/1289390499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fd4b8004300 con 0x7fd4c8108330 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.933+0000 7fd4c6a00700 1 -- 172.21.15.55:0/1289390499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4b8011a80 con 0x7fd4c8108330 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 -- 172.21.15.55:0/1289390499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 msgr2=0x7fd4c810a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/1289390499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80098a0 tx=0x7fd4b8009bb0 comp rx=0 tx=0).stop 2024-03-28T05:32:59.627 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 -- 172.21.15.55:0/1289390499 shutdown_connections 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/1289390499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c810a720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 -- 172.21.15.55:0/1289390499 >> 172.21.15.55:0/1289390499 conn(0x7fd4c8101d20 msgr2=0x7fd4c8104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 -- 172.21.15.55:0/1289390499 shutdown_connections 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.934+0000 7fd4cdc00700 1 -- 172.21.15.55:0/1289390499 wait complete. 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.935+0000 7fd4cdc00700 1 Processor -- start 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4cdc00700 1 -- start start 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4cdc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4cdc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c810bbc0 con 0x7fd4c8108330 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4c7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4c7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55976/0 (socket says 172.21.15.55:55976) 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.936+0000 7fd4c7e00700 1 -- 172.21.15.55:0/210517470 learned_addr learned my addr 172.21.15.55:0/210517470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4c7e00700 1 -- 172.21.15.55:0/210517470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c81080f0 con 0x7fd4c8108330 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4c7e00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8011a50 tx=0x7fd4b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4b80039f0 con 0x7fd4c8108330 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fd4b8003b90 con 0x7fd4c8108330 2024-03-28T05:32:59.628 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4b801a600 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c81062e0 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.937+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c8106820 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.938+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c80637c0 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.939+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7fd4b8024a40 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.939+0000 7fd4c4c00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 0x7fd4ac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.939+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd4b804d360 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.939+0000 7fd4c7400700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 0x7fd4ac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.940+0000 7fd4c7400700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 0x7fd4ac03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4006fd0 tx=0x7fd4b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:51.945+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd4b804ccb0 con 0x7fd4c8108330 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:52.182+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi055", "addr": "172.21.15.55", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4c8107080 con 0x7fd4ac038f70 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.946+0000 7fd4c4c00700 1 -- 172.21.15.55:0/210517470 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd4c8107080 con 0x7fd4ac038f70 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 msgr2=0x7fd4ac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 0x7fd4ac03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4006fd0 tx=0x7fd4b4006e40 comp rx=0 tx=0).stop 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 msgr2=0x7fd4c8107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:32:59.629 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8011a50 tx=0x7fd4b8004290 comp rx=0 tx=0).stop 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 shutdown_connections 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fd4ac038f70 0x7fd4ac03b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 --2- 172.21.15.55:0/210517470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4c8108330 0x7fd4c8107bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 >> 172.21.15.55:0/210517470 conn(0x7fd4c8101d20 msgr2=0x7fd4c8102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 shutdown_connections 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:32:58.951+0000 7fd4cdc00700 1 -- 172.21.15.55:0/210517470 wait complete. 2024-03-28T05:32:59.630 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying unmanaged mon service... 2024-03-28T05:33:00.284 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:59 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:00.284 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:59 smithi055 ceph-mon[31863]: Added host smithi055 2024-03-28T05:33:00.284 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:32:59 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.284+0000 7fa947200700 1 Processor -- start 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.284+0000 7fa947200700 1 -- start start 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.285+0000 7fa947200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.285+0000 7fa947200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94010a6a0 con 0x7fa940109cb0 2024-03-28T05:33:01.287 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.285+0000 7fa93fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.285+0000 7fa93fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52268/0 (socket says 172.21.15.55:52268) 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.285+0000 7fa93fe00700 1 -- 172.21.15.55:0/1968301607 learned_addr learned my addr 172.21.15.55:0/1968301607 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.286+0000 7fa93fe00700 1 -- 172.21.15.55:0/1968301607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94010ae60 con 0x7fa940109cb0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.286+0000 7fa93fe00700 1 --2- 172.21.15.55:0/1968301607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098a0 tx=0x7fa930009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e980fe73018227e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.286+0000 7fa93ea00700 1 -- 172.21.15.55:0/1968301607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa930004160 con 0x7fa940109cb0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.287+0000 7fa93ea00700 1 -- 172.21.15.55:0/1968301607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fa930004300 con 0x7fa940109cb0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.287+0000 7fa93ea00700 1 -- 172.21.15.55:0/1968301607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa930011a80 con 0x7fa940109cb0 2024-03-28T05:33:01.294 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.287+0000 7fa947200700 1 -- 172.21.15.55:0/1968301607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 msgr2=0x7fa94010a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.287+0000 7fa947200700 1 --2- 172.21.15.55:0/1968301607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098a0 tx=0x7fa930009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.288+0000 7fa947200700 1 -- 172.21.15.55:0/1968301607 shutdown_connections 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.288+0000 7fa947200700 1 --2- 172.21.15.55:0/1968301607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94010a0d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.288+0000 7fa947200700 1 -- 172.21.15.55:0/1968301607 >> 172.21.15.55:0/1968301607 conn(0x7fa940105350 msgr2=0x7fa940107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.288+0000 7fa947200700 1 -- 172.21.15.55:0/1968301607 shutdown_connections 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.288+0000 7fa947200700 1 -- 172.21.15.55:0/1968301607 wait complete. 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.289+0000 7fa947200700 1 Processor -- start 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.289+0000 7fa947200700 1 -- start start 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa947200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:01.295 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa947200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94010e210 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa93fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa93fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52284/0 (socket says 172.21.15.55:52284) 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa93fe00700 1 -- 172.21.15.55:0/239159855 learned_addr learned my addr 172.21.15.55:0/239159855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.290+0000 7fa93fe00700 1 -- 172.21.15.55:0/239159855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94019e1a0 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa93fe00700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa930000c00 tx=0x7fa930004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9300039c0 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7fa930003b60 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93001a6f0 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94019e430 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.291+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9401a1120 con 0x7fa940109cb0 2024-03-28T05:33:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.293+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7fa930024a40 con 0x7fa940109cb0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.293+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9400637c0 con 0x7fa940109cb0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.293+0000 7fa93cc00700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 0x7fa92403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.293+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa93004d190 con 0x7fa940109cb0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.293+0000 7fa93f400700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 0x7fa92403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.294+0000 7fa93f400700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 0x7fa92403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006fd0 tx=0x7fa92c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.299+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa930004300 con 0x7fa940109cb0 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.550+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa940106590 con 0x7fa924038f70 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.562+0000 7fa93cc00700 1 -- 172.21.15.55:0/239159855 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa940106590 con 0x7fa924038f70 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 msgr2=0x7fa92403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:01.297 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 0x7fa92403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006fd0 tx=0x7fa92c006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:01.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 msgr2=0x7fa94019dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:01.298 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa930000c00 tx=0x7fa930004290 comp rx=0 tx=0).stop 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 shutdown_connections 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.565+0000 7fa947200700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fa924038f70 0x7fa92403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.566+0000 7fa947200700 1 --2- 172.21.15.55:0/239159855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa940109cb0 0x7fa94019dc60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.566+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 >> 172.21.15.55:0/239159855 conn(0x7fa940105350 msgr2=0x7fa940105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.566+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 shutdown_connections 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:00.566+0000 7fa947200700 1 -- 172.21.15.55:0/239159855 wait complete. 2024-03-28T05:33:01.299 INFO:teuthology.orchestra.run.smithi055.stdout:Deploying unmanaged mgr service... 2024-03-28T05:33:01.852 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:01 smithi055 ceph-mon[31863]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:01.852 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:01 smithi055 ceph-mon[31863]: Saving service mon spec with placement count:5 2024-03-28T05:33:01.852 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:01 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-28T05:33:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.155+0000 7f17fea00700 1 Processor -- start 2024-03-28T05:33:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.155+0000 7f17fea00700 1 -- start start 2024-03-28T05:33:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.155+0000 7f17fea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.155+0000 7f17fea00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8082450 con 0x7f17f8081a60 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.156+0000 7f17f7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.156+0000 7f17f7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52290/0 (socket says 172.21.15.55:52290) 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.156+0000 7f17f7e00700 1 -- 172.21.15.55:0/337324054 learned_addr learned my addr 172.21.15.55:0/337324054 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.156+0000 7f17f7e00700 1 -- 172.21.15.55:0/337324054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f810f240 con 0x7f17f8081a60 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.157+0000 7f17f7e00700 1 --2- 172.21.15.55:0/337324054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098a0 tx=0x7f17e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeb1df3ca4d5695 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.157+0000 7f17f6a00700 1 -- 172.21.15.55:0/337324054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17e8004160 con 0x7f17f8081a60 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.157+0000 7f17f6a00700 1 -- 172.21.15.55:0/337324054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f17e8004300 con 0x7f17f8081a60 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.157+0000 7f17f6a00700 1 -- 172.21.15.55:0/337324054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17e8011a80 con 0x7f17f8081a60 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 -- 172.21.15.55:0/337324054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 msgr2=0x7f17f8081e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 --2- 172.21.15.55:0/337324054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e80098a0 tx=0x7f17e8009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 -- 172.21.15.55:0/337324054 shutdown_connections 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 --2- 172.21.15.55:0/337324054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f8081e80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 -- 172.21.15.55:0/337324054 >> 172.21.15.55:0/337324054 conn(0x7f17f807d0a0 msgr2=0x7f17f807f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 -- 172.21.15.55:0/337324054 shutdown_connections 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.158+0000 7f17fea00700 1 -- 172.21.15.55:0/337324054 wait complete. 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.159+0000 7f17fea00700 1 Processor -- start 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.159+0000 7f17fea00700 1 -- start start 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17fea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17fea00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81125f0 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17f7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17f7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52304/0 (socket says 172.21.15.55:52304) 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17f7e00700 1 -- 172.21.15.55:0/4237356452 learned_addr learned my addr 172.21.15.55:0/4237356452 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17f7e00700 1 -- 172.21.15.55:0/4237356452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f81a24d0 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.160+0000 7f17f7e00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.161+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17e80039f0 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.161+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1071+0+0 (secure 0 0 0) 0x7f17e8003b90 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.161+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17e801a740 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.161+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f81a2760 con 0x7f17f8081a60 2024-03-28T05:33:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.161+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f81a5450 con 0x7f17f8081a60 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.162+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f80637c0 con 0x7f17f8081a60 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.162+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f17e8024af0 con 0x7f17f8081a60 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.163+0000 7f17f4c00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 0x7f17dc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.163+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f17e804d230 con 0x7f17f8081a60 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.163+0000 7f17f7400700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 0x7f17dc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.164+0000 7f17f7400700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 0x7f17dc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006fd0 tx=0x7f17e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.169+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f17e800e260 con 0x7f17f8081a60 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.416+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f17f807e240 con 0x7f17dc038f70 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.425+0000 7f17f4c00700 1 -- 172.21.15.55:0/4237356452 <== mgr.14120 v2:172.21.15.55:6800/2069525720 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f17f807e240 con 0x7f17dc038f70 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.428+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 msgr2=0x7f17dc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.428+0000 7f17fea00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 0x7f17dc03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006fd0 tx=0x7f17e4006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.428+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 msgr2=0x7f17f81a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.428+0000 7f17fea00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8011b00 comp rx=0 tx=0).stop 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 shutdown_connections 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f17dc038f70 0x7f17dc03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 --2- 172.21.15.55:0/4237356452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17f8081a60 0x7f17f81a1f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 >> 172.21.15.55:0/4237356452 conn(0x7f17f807d0a0 msgr2=0x7f17f807db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 shutdown_connections 2024-03-28T05:33:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:02.429+0000 7f17fea00700 1 -- 172.21.15.55:0/4237356452 wait complete. 2024-03-28T05:33:03.737 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:03 smithi055 ceph-mon[31863]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:03.737 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:03 smithi055 ceph-mon[31863]: Saving service mgr spec with placement count:2 2024-03-28T05:33:03.737 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:03 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:03.737 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:03 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:04.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:04 smithi055 ceph-mon[31863]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:04.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:04 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:04.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:04 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2653025065' entity='client.admin' 2024-03-28T05:33:04.929 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.019+0000 7f11a3c00700 1 Processor -- start 2024-03-28T05:33:04.929 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.019+0000 7f11a3c00700 1 -- start start 2024-03-28T05:33:04.929 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.019+0000 7f11a3c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:04.929 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.019+0000 7f11a3c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c07b720 con 0x7f119c07ccf0 2024-03-28T05:33:04.929 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.020+0000 7f11a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.020+0000 7f11a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52314/0 (socket says 172.21.15.55:52314) 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.020+0000 7f11a1200700 1 -- 172.21.15.55:0/1221302750 learned_addr learned my addr 172.21.15.55:0/1221302750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.020+0000 7f11a1200700 1 -- 172.21.15.55:0/1221302750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c07b8a0 con 0x7f119c07ccf0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.021+0000 7f11a1200700 1 --2- 172.21.15.55:0/1221302750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11900098a0 tx=0x7f1190009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c100ac2122564a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.021+0000 7f119b400700 1 -- 172.21.15.55:0/1221302750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1190004160 con 0x7f119c07ccf0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.021+0000 7f119b400700 1 -- 172.21.15.55:0/1221302750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1190004300 con 0x7f119c07ccf0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.021+0000 7f119b400700 1 -- 172.21.15.55:0/1221302750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1190011a50 con 0x7f119c07ccf0 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 -- 172.21.15.55:0/1221302750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 msgr2=0x7f119c07b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:04.930 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 --2- 172.21.15.55:0/1221302750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11900098a0 tx=0x7f1190009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 -- 172.21.15.55:0/1221302750 shutdown_connections 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 --2- 172.21.15.55:0/1221302750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c07b150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 -- 172.21.15.55:0/1221302750 >> 172.21.15.55:0/1221302750 conn(0x7f119c103060 msgr2=0x7f119c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 -- 172.21.15.55:0/1221302750 shutdown_connections 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.022+0000 7f11a3c00700 1 -- 172.21.15.55:0/1221302750 wait complete. 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.023+0000 7f11a3c00700 1 Processor -- start 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a3c00700 1 -- start start 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a3c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a3c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c10e040 con 0x7f119c07ccf0 2024-03-28T05:33:04.931 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52318/0 (socket says 172.21.15.55:52318) 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.024+0000 7f11a1200700 1 -- 172.21.15.55:0/2653025065 learned_addr learned my addr 172.21.15.55:0/2653025065 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.025+0000 7f11a1200700 1 -- 172.21.15.55:0/2653025065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c19e040 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.025+0000 7f11a1200700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1190006b20 tx=0x7f1190011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.025+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1190003b70 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.025+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f119001a8e0 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.025+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c19e2d0 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.026+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11900249b0 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.026+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c1a0fc0 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.027+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c0637c0 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.027+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f1190022020 con 0x7f119c07ccf0 2024-03-28T05:33:04.932 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.027+0000 7f1199600700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.028+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f119004d670 con 0x7f119c07ccf0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.028+0000 7f119be00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.029+0000 7f119be00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 0x7f118403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1188006fd0 tx=0x7f1188006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.033+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f119002c3a0 con 0x7f119c07ccf0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.262+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f119c1a1570 con 0x7f119c07ccf0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.267+0000 7f1199600700 1 -- 172.21.15.55:0/2653025065 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1190016260 con 0x7f119c07ccf0 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.272+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 msgr2=0x7f118403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.272+0000 7f11a3c00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 0x7f118403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1188006fd0 tx=0x7f1188006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.272+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 msgr2=0x7f119c19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.272+0000 7f11a3c00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1190006b20 tx=0x7f1190011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:04.933 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 shutdown_connections 2024-03-28T05:33:04.934 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f1184038f70 0x7f118403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:04.934 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 --2- 172.21.15.55:0/2653025065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f119c07ccf0 0x7f119c19db00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:04.934 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 >> 172.21.15.55:0/2653025065 conn(0x7f119c103060 msgr2=0x7f119c103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:04.934 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 shutdown_connections 2024-03-28T05:33:04.934 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:04.273+0000 7f11a3c00700 1 -- 172.21.15.55:0/2653025065 wait complete. 2024-03-28T05:33:06.790 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:06 smithi055 ceph-mon[31863]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:06.790 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:06 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1508455447' entity='client.admin' 2024-03-28T05:33:06.791 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:06 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.496+0000 7feaa2c00700 1 Processor -- start 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.497+0000 7feaa2c00700 1 -- start start 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.497+0000 7feaa2c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.497+0000 7feaa2c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c07b720 con 0x7fea9c07ccf0 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.498+0000 7fea9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:06.805 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.498+0000 7fea9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52334/0 (socket says 172.21.15.55:52334) 2024-03-28T05:33:06.812 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.498+0000 7fea9be00700 1 -- 172.21.15.55:0/3313929748 learned_addr learned my addr 172.21.15.55:0/3313929748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.498+0000 7fea9be00700 1 -- 172.21.15.55:0/3313929748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c07b8a0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.499+0000 7fea9be00700 1 --2- 172.21.15.55:0/3313929748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098a0 tx=0x7fea8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f244dbe1449635a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.499+0000 7fea9b400700 1 -- 172.21.15.55:0/3313929748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea8c004160 con 0x7fea9c07ccf0 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.499+0000 7fea9b400700 1 -- 172.21.15.55:0/3313929748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea8c004300 con 0x7fea9c07ccf0 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.499+0000 7fea9b400700 1 -- 172.21.15.55:0/3313929748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea8c011a50 con 0x7fea9c07ccf0 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 -- 172.21.15.55:0/3313929748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 msgr2=0x7fea9c07b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 --2- 172.21.15.55:0/3313929748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098a0 tx=0x7fea8c009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:06.813 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 -- 172.21.15.55:0/3313929748 shutdown_connections 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 --2- 172.21.15.55:0/3313929748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c07b150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 -- 172.21.15.55:0/3313929748 >> 172.21.15.55:0/3313929748 conn(0x7fea9c103060 msgr2=0x7fea9c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 -- 172.21.15.55:0/3313929748 shutdown_connections 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.500+0000 7feaa2c00700 1 -- 172.21.15.55:0/3313929748 wait complete. 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.501+0000 7feaa2c00700 1 Processor -- start 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.501+0000 7feaa2c00700 1 -- start start 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7feaa2c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7feaa2c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c10e040 con 0x7fea9c07ccf0 2024-03-28T05:33:06.814 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7fea9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7fea9be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52340/0 (socket says 172.21.15.55:52340) 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7fea9be00700 1 -- 172.21.15.55:0/1508455447 learned_addr learned my addr 172.21.15.55:0/1508455447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.502+0000 7fea9be00700 1 -- 172.21.15.55:0/1508455447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c19e040 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7fea9be00700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006b20 tx=0x7fea8c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea8c003b70 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea8c01a8e0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea8c0249b0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c19e2d0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.503+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c1a0fc0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.815 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.504+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c0637c0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.504+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7fea8c022020 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.505+0000 7fea99600700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 0x7fea8003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.505+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fea8c04d630 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.505+0000 7fea93400700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 0x7fea8003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.506+0000 7fea93400700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 0x7fea8003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.510+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fea8c02c3a0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.750+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fea9c1a15e0 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.754+0000 7fea99600700 1 -- 172.21.15.55:0/1508455447 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fea8c016260 con 0x7fea9c07ccf0 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 msgr2=0x7fea8003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:06.816 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 0x7fea8003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fea84006fd0 tx=0x7fea84006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 msgr2=0x7fea9c19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006b20 tx=0x7fea8c011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 shutdown_connections 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fea80038f70 0x7fea8003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 --2- 172.21.15.55:0/1508455447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea9c07ccf0 0x7fea9c19db00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.757+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 >> 172.21.15.55:0/1508455447 conn(0x7fea9c103060 msgr2=0x7fea9c103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.758+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 shutdown_connections 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:05.758+0000 7feaa2c00700 1 -- 172.21.15.55:0/1508455447 wait complete. 2024-03-28T05:33:06.817 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling the dashboard module... 2024-03-28T05:33:08.858 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:08 smithi055 ceph-mon[31863]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:08.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4029757934' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-28T05:33:08.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:08 smithi055 ceph-mon[31863]: from='mgr.14120 172.21.15.55:0/4193267009' entity='mgr.x' 2024-03-28T05:33:08.859 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:08 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: ignoring --setuser ceph since I am not root 2024-03-28T05:33:08.859 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:08 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: ignoring --setgroup ceph since I am not root 2024-03-28T05:33:09.219 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.378+0000 7f5995400700 1 Processor -- start 2024-03-28T05:33:09.219 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.378+0000 7f5995400700 1 -- start start 2024-03-28T05:33:09.219 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.379+0000 7f5995400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:09.220 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.379+0000 7f5995400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990108450 con 0x7f5990107a60 2024-03-28T05:33:09.220 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.379+0000 7f598e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:09.220 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.379+0000 7f598e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52342/0 (socket says 172.21.15.55:52342) 2024-03-28T05:33:09.220 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.379+0000 7f598e800700 1 -- 172.21.15.55:0/3693080589 learned_addr learned my addr 172.21.15.55:0/3693080589 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.380+0000 7f598e800700 1 -- 172.21.15.55:0/3693080589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990108c60 con 0x7f5990107a60 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.380+0000 7f598e800700 1 --2- 172.21.15.55:0/3693080589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59800098a0 tx=0x7f5980009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79a9c8450cc2763 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.380+0000 7f598d400700 1 -- 172.21.15.55:0/3693080589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5980004160 con 0x7f5990107a60 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.380+0000 7f598d400700 1 -- 172.21.15.55:0/3693080589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5980004300 con 0x7f5990107a60 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.380+0000 7f598d400700 1 -- 172.21.15.55:0/3693080589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5980011a50 con 0x7f5990107a60 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 -- 172.21.15.55:0/3693080589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 msgr2=0x7f5990107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:09.221 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 --2- 172.21.15.55:0/3693080589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59800098a0 tx=0x7f5980009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:09.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 -- 172.21.15.55:0/3693080589 shutdown_connections 2024-03-28T05:33:09.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 --2- 172.21.15.55:0/3693080589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f5990107e80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:09.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 -- 172.21.15.55:0/3693080589 >> 172.21.15.55:0/3693080589 conn(0x7f5990103060 msgr2=0x7f5990105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:09.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 -- 172.21.15.55:0/3693080589 shutdown_connections 2024-03-28T05:33:09.222 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.381+0000 7f5995400700 1 -- 172.21.15.55:0/3693080589 wait complete. 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.382+0000 7f5995400700 1 Processor -- start 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f5995400700 1 -- start start 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f5995400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f5995400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599010c010 con 0x7f5990107a60 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f598e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f598e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52356/0 (socket says 172.21.15.55:52356) 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.383+0000 7f598e800700 1 -- 172.21.15.55:0/4029757934 learned_addr learned my addr 172.21.15.55:0/4029757934 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f598e800700 1 -- 172.21.15.55:0/4029757934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599019be90 con 0x7f5990107a60 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f598e800700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5980006b20 tx=0x7f5980011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:09.223 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59800039e0 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f598001a8e0 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59800247e0 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.384+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599019c120 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.385+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599019ee10 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.386+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 46106+0+0 (secure 0 0 0) 0x7f5980022020 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.386+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59900637c0 con 0x7f5990107a60 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.386+0000 7f5987400700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 0x7f597403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:09.224 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.386+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f598004d200 con 0x7f5990107a60 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.387+0000 7f598de00700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 0x7f597403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.387+0000 7f598de00700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 0x7f597403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f597c006fd0 tx=0x7f597c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.392+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f598002ad60 con 0x7f5990107a60 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:07.679+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f599019f3c0 con 0x7f5990107a60 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.478+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f5980021d60 con 0x7f5990107a60 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.482+0000 7f5987400700 1 -- 172.21.15.55:0/4029757934 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 9) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f598002d3f0 con 0x7f5990107a60 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 msgr2=0x7f597403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 0x7f597403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f597c006fd0 tx=0x7f597c006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 msgr2=0x7f599019b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:09.225 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5980006b20 tx=0x7f5980011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 shutdown_connections 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f5974038f70 0x7f597403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 --2- 172.21.15.55:0/4029757934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5990107a60 0x7f599019b950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.483+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 >> 172.21.15.55:0/4029757934 conn(0x7f5990103060 msgr2=0x7f5990103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.484+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 shutdown_connections 2024-03-28T05:33:09.226 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:08.484+0000 7f5995400700 1 -- 172.21.15.55:0/4029757934 wait complete. 2024-03-28T05:33:09.480 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:09 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:09.302+0000 7ff7f8ac4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T05:33:09.480 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:09 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:09.428+0000 7ff7f8ac4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T05:33:09.756 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:09 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4029757934' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-28T05:33:09.756 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:09 smithi055 ceph-mon[31863]: mgrmap e9: x(active, since 25s) 2024-03-28T05:33:10.372 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:10.261+0000 7ff7f8ac4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T05:33:10.694 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1998159965' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-28T05:33:10.694 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:10.390+0000 7ff7f8ac4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T05:33:10.694 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:10.574+0000 7ff7f8ac4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T05:33:10.701 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.755+0000 7f9283200700 1 Processor -- start 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.755+0000 7f9283200700 1 -- start start 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.756+0000 7f9283200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:10.707 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.756+0000 7f9283200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c063430 con 0x7f927c106330 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.756+0000 7f927be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.756+0000 7f927be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49466/0 (socket says 172.21.15.55:49466) 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.756+0000 7f927be00700 1 -- 172.21.15.55:0/1363027712 learned_addr learned my addr 172.21.15.55:0/1363027712 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.757+0000 7f927be00700 1 -- 172.21.15.55:0/1363027712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c106c90 con 0x7f927c106330 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.757+0000 7f927be00700 1 --2- 172.21.15.55:0/1363027712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f926c0098a0 tx=0x7f926c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44a6ffb54d52963 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.758+0000 7f927aa00700 1 -- 172.21.15.55:0/1363027712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c004160 con 0x7f927c106330 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.758+0000 7f927aa00700 1 -- 172.21.15.55:0/1363027712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f926c004300 con 0x7f927c106330 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.758+0000 7f927aa00700 1 -- 172.21.15.55:0/1363027712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c011a50 con 0x7f927c106330 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.758+0000 7f9283200700 1 -- 172.21.15.55:0/1363027712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 msgr2=0x7f927c106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.758+0000 7f9283200700 1 --2- 172.21.15.55:0/1363027712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f926c0098a0 tx=0x7f926c009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.759+0000 7f9283200700 1 -- 172.21.15.55:0/1363027712 shutdown_connections 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.759+0000 7f9283200700 1 --2- 172.21.15.55:0/1363027712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c106750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.759+0000 7f9283200700 1 -- 172.21.15.55:0/1363027712 >> 172.21.15.55:0/1363027712 conn(0x7f927c101f70 msgr2=0x7f927c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.759+0000 7f9283200700 1 -- 172.21.15.55:0/1363027712 shutdown_connections 2024-03-28T05:33:10.708 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.759+0000 7f9283200700 1 -- 172.21.15.55:0/1363027712 wait complete. 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.760+0000 7f9283200700 1 Processor -- start 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.760+0000 7f9283200700 1 -- start start 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.760+0000 7f9283200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.760+0000 7f9283200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c107d00 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.761+0000 7f927be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.761+0000 7f927be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49482/0 (socket says 172.21.15.55:49482) 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.761+0000 7f927be00700 1 -- 172.21.15.55:0/1998159965 learned_addr learned my addr 172.21.15.55:0/1998159965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.761+0000 7f927be00700 1 -- 172.21.15.55:0/1998159965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c19e0a0 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.761+0000 7f927be00700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f926c011a00 tx=0x7f926c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.762+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c003af0 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.762+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f926c01a8e0 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.762+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c19e330 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.762+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f926c024840 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.762+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c1a1020 con 0x7f927c106330 2024-03-28T05:33:10.709 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.763+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c0637c0 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.763+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f926c022020 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.764+0000 7f9278c00700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 0x7f926003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.764+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f926c04d450 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.764+0000 7f927b400700 1 -- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 msgr2=0x7f926003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.764+0000 7f927b400700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 0x7f926003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.773+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f926c01adb0 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.965+0000 7f927b400700 1 -- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 msgr2=0x7f926003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:09.965+0000 7f927b400700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 0x7f926003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.057+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f927c02dcc0 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.057+0000 7f9278c00700 1 -- 172.21.15.55:0/1998159965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f926c04cda0 con 0x7f927c106330 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.061+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 msgr2=0x7f926003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.061+0000 7f9283200700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 0x7f926003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.710 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 msgr2=0x7f927c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f926c011a00 tx=0x7f926c011ae0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 shutdown_connections 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7f9260038f70 0x7f926003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 --2- 172.21.15.55:0/1998159965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f927c106330 0x7f927c19db60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 >> 172.21.15.55:0/1998159965 conn(0x7f927c101f70 msgr2=0x7f927c1947a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 shutdown_connections 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:10.062+0000 7f9283200700 1 -- 172.21.15.55:0/1998159965 wait complete. 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for the mgr to restart... 2024-03-28T05:33:10.711 INFO:teuthology.orchestra.run.smithi055.stdout:Waiting for mgr epoch 9... 2024-03-28T05:33:10.954 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:10.707+0000 7ff7f8ac4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T05:33:10.954 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:10 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:10.823+0000 7ff7f8ac4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T05:33:11.264 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:11.175+0000 7ff7f8ac4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T05:33:11.570 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:11.324+0000 7ff7f8ac4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T05:33:11.570 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:11.440+0000 7ff7f8ac4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T05:33:11.570 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:11.568+0000 7ff7f8ac4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T05:33:11.873 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:11.790+0000 7ff7f8ac4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T05:33:13.374 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:13.103+0000 7ff7f8ac4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T05:33:13.375 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:13.280+0000 7ff7f8ac4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T05:33:14.096 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:13.707+0000 7ff7f8ac4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T05:33:14.096 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:13.829+0000 7ff7f8ac4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T05:33:14.097 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:14 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:14.095+0000 7ff7f8ac4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:33:14.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:14 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:14.353+0000 7ff7f8ac4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T05:33:15.093 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:14 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:14.742+0000 7ff7f8ac4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:33:15.094 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:15 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:15.092+0000 7ff7f8ac4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T05:33:15.873 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:15 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:15.407+0000 7ff7f8ac4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T05:33:16.766 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:16 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:16.487+0000 7ff7f8ac4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T05:33:17.479 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:17.215+0000 7ff7f8ac4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T05:33:17.479 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:17.351+0000 7ff7f8ac4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T05:33:17.758 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:33:17.645+0000 7ff7f8ac4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T05:33:17.758 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: Active manager daemon x restarted 2024-03-28T05:33:17.758 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: Activating manager daemon x 2024-03-28T05:33:17.758 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: osdmap e3: 0 total, 0 up, 0 in 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: mgrmap e10: x(active, starting, since 0.00723809s) 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-28T05:33:17.759 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:17 smithi055 ceph-mon[31863]: Manager daemon x is now available 2024-03-28T05:33:19.018 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:19.018 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:19.018 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-28T05:33:19.018 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-28T05:33:19.019 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:18 smithi055 ceph-mon[31863]: mgrmap e11: x(active, since 1.01047s) 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout { 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout } 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.263+0000 7fba57a00700 1 Processor -- start 2024-03-28T05:33:19.360 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.263+0000 7fba57a00700 1 -- start start 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.263+0000 7fba57a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.263+0000 7fba57a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5010a620 con 0x7fba50109c30 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.264+0000 7fba55000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.264+0000 7fba55000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49486/0 (socket says 172.21.15.55:49486) 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.264+0000 7fba55000700 1 -- 172.21.15.55:0/3063617100 learned_addr learned my addr 172.21.15.55:0/3063617100 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.264+0000 7fba55000700 1 -- 172.21.15.55:0/3063617100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5010ae30 con 0x7fba50109c30 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.265+0000 7fba55000700 1 --2- 172.21.15.55:0/3063617100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba440098a0 tx=0x7fba44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7317cd1475d75f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.265+0000 7fba4f400700 1 -- 172.21.15.55:0/3063617100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba44004160 con 0x7fba50109c30 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.265+0000 7fba4f400700 1 -- 172.21.15.55:0/3063617100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fba44004300 con 0x7fba50109c30 2024-03-28T05:33:19.361 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.265+0000 7fba4f400700 1 -- 172.21.15.55:0/3063617100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba44011a50 con 0x7fba50109c30 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 -- 172.21.15.55:0/3063617100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 msgr2=0x7fba5010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 --2- 172.21.15.55:0/3063617100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba440098a0 tx=0x7fba44009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 -- 172.21.15.55:0/3063617100 shutdown_connections 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 --2- 172.21.15.55:0/3063617100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5010a050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 -- 172.21.15.55:0/3063617100 >> 172.21.15.55:0/3063617100 conn(0x7fba50105350 msgr2=0x7fba50107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 -- 172.21.15.55:0/3063617100 shutdown_connections 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.266+0000 7fba57a00700 1 -- 172.21.15.55:0/3063617100 wait complete. 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba57a00700 1 Processor -- start 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba57a00700 1 -- start start 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba57a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:19.362 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba57a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5010e1e0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba55000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba55000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49490/0 (socket says 172.21.15.55:49490) 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.268+0000 7fba55000700 1 -- 172.21.15.55:0/3041916360 learned_addr learned my addr 172.21.15.55:0/3041916360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.269+0000 7fba55000700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5019e060 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.269+0000 7fba55000700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba44006b20 tx=0x7fba44011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.269+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba440039e0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.270+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fba4401a8e0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.270+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba440247e0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.270+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5019e2f0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.270+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba501a0fe0 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 46119+0+0 (secure 0 0 0) 0x7fba44022020 con 0x7fba50109c30 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba4d600700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:19.363 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba500637c0 con 0x7fba38038fc0 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fba4404d310 con 0x7fba50109c30 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.271+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.472+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.472+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.873+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:11.873+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:12.674+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:12.674+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:14.276+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:14.276+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-28T05:33:19.364 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:17.478+0000 7fba4fe00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.55:6800/2069525720 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:17.478+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:17.655+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mgrmap(e 10) v1 ==== 45886+0+0 (secure 0 0 0) 0x7fba44021d20 con 0x7fba50109c30 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:17.655+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 msgr2=0x7fba3803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:17.655+0000 7fba4d600700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.655+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 11) v1 ==== 46013+0+0 (secure 0 0 0) 0x7fba4404ef00 con 0x7fba50109c30 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.656+0000 7fba4d600700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 0x7fba3803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.656+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba4402ce50 con 0x7fba3803c850 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.657+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 0x7fba3803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.659+0000 7fba4fe00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 0x7fba3803ec40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba3c003a10 tx=0x7fba3c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.660+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fba4402ce50 con 0x7fba3803c850 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.668+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fba50107510 con 0x7fba3803c850 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.668+0000 7fba4d600700 1 -- 172.21.15.55:0/3041916360 <== mgr.14152 v2:172.21.15.55:6800/3012677107 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fba50107510 con 0x7fba3803c850 2024-03-28T05:33:19.365 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 msgr2=0x7fba3803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 0x7fba3803ec40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fba3c003a10 tx=0x7fba3c009270 comp rx=0 tx=0).stop 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 msgr2=0x7fba5019db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba44006b20 tx=0x7fba44011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 shutdown_connections 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fba3803c850 0x7fba3803ec40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba50109c30 0x7fba5019db20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 --2- 172.21.15.55:0/3041916360 >> [v2:172.21.15.55:6800/2069525720,v1:172.21.15.55:6801/2069525720] conn(0x7fba38038fc0 0x7fba3803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 >> 172.21.15.55:0/3041916360 conn(0x7fba50105350 msgr2=0x7fba50106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 shutdown_connections 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:18.669+0000 7fba57a00700 1 -- 172.21.15.55:0/3041916360 wait complete. 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:mgr epoch 9 is available 2024-03-28T05:33:19.366 INFO:teuthology.orchestra.run.smithi055.stdout:Generating a dashboard self-signed certificate... 2024-03-28T05:33:19.916 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:19 smithi055 ceph-mon[31863]: [28/Mar/2024:05:33:19] ENGINE Bus STARTING 2024-03-28T05:33:19.917 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:19 smithi055 ceph-mon[31863]: [28/Mar/2024:05:33:19] ENGINE Serving on http://172.21.15.55:8765 2024-03-28T05:33:19.917 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:19 smithi055 ceph-mon[31863]: [28/Mar/2024:05:33:19] ENGINE Serving on https://172.21.15.55:7150 2024-03-28T05:33:19.917 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:19 smithi055 ceph-mon[31863]: [28/Mar/2024:05:33:19] ENGINE Bus STARTED 2024-03-28T05:33:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:20 smithi055 ceph-mon[31863]: mgrmap e12: x(active, since 2s) 2024-03-28T05:33:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:21.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-28T05:33:21.474 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.450+0000 7f09d6c00700 1 Processor -- start 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.450+0000 7f09d6c00700 1 -- start start 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.451+0000 7f09d6c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.451+0000 7f09d6c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0108430 con 0x7f09d0107a40 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.451+0000 7f09cfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.451+0000 7f09cfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38568/0 (socket says 172.21.15.55:38568) 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.451+0000 7f09cfe00700 1 -- 172.21.15.55:0/2809498757 learned_addr learned my addr 172.21.15.55:0/2809498757 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.452+0000 7f09cfe00700 1 -- 172.21.15.55:0/2809498757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0108c40 con 0x7f09d0107a40 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.452+0000 7f09cfe00700 1 --2- 172.21.15.55:0/2809498757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09c00098a0 tx=0x7f09c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29112b0127f89eb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:21.475 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.452+0000 7f09cf400700 1 -- 172.21.15.55:0/2809498757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09c0004160 con 0x7f09d0107a40 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.455+0000 7f09cf400700 1 -- 172.21.15.55:0/2809498757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f09c0004300 con 0x7f09d0107a40 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.455+0000 7f09cf400700 1 -- 172.21.15.55:0/2809498757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09c0011a50 con 0x7f09d0107a40 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.455+0000 7f09d6c00700 1 -- 172.21.15.55:0/2809498757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 msgr2=0x7f09d0107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.455+0000 7f09d6c00700 1 --2- 172.21.15.55:0/2809498757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09c00098a0 tx=0x7f09c0009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.456+0000 7f09d6c00700 1 -- 172.21.15.55:0/2809498757 shutdown_connections 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.456+0000 7f09d6c00700 1 --2- 172.21.15.55:0/2809498757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d0107e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.456+0000 7f09d6c00700 1 -- 172.21.15.55:0/2809498757 >> 172.21.15.55:0/2809498757 conn(0x7f09d0103020 msgr2=0x7f09d0105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.456+0000 7f09d6c00700 1 -- 172.21.15.55:0/2809498757 shutdown_connections 2024-03-28T05:33:21.476 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.456+0000 7f09d6c00700 1 -- 172.21.15.55:0/2809498757 wait complete. 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.458+0000 7f09d6c00700 1 Processor -- start 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.458+0000 7f09d6c00700 1 -- start start 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.458+0000 7f09d6c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.458+0000 7f09d6c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d010bff0 con 0x7f09d0107a40 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.458+0000 7f09cfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.459+0000 7f09cfe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38584/0 (socket says 172.21.15.55:38584) 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.459+0000 7f09cfe00700 1 -- 172.21.15.55:0/478275534 learned_addr learned my addr 172.21.15.55:0/478275534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.459+0000 7f09cfe00700 1 -- 172.21.15.55:0/478275534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d007e050 con 0x7f09d0107a40 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.459+0000 7f09cfe00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09c0011a20 tx=0x7f09c0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:21.477 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.460+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09c0003af0 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.460+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f09c001a8e0 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.460+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d007c240 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.460+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09c0024860 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.460+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d007c780 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.461+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d00637c0 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.463+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 12) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f09c0022020 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.463+0000 7f09cd600700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 0x7f09b403b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.464+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f09c004d640 con 0x7f09d0107a40 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.464+0000 7f09c7e00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 0x7f09b403b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:21.478 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.465+0000 7f09c7e00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 0x7f09b403b490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09b8006fd0 tx=0x7f09b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.472+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f09c004bf50 con 0x7f09d0107a40 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.720+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f09d007d0d0 con 0x7f09b4038fd0 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.837+0000 7f09cd600700 1 -- 172.21.15.55:0/478275534 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f09d007d0d0 con 0x7f09b4038fd0 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 msgr2=0x7f09b403b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 0x7f09b403b490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09b8006fd0 tx=0x7f09b8006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 msgr2=0x7f09d007db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09c0011a20 tx=0x7f09c0011b00 comp rx=0 tx=0).stop 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 shutdown_connections 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f09b4038fd0 0x7f09b403b490 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:21.479 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 --2- 172.21.15.55:0/478275534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09d0107a40 0x7f09d007db10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:21.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 >> 172.21.15.55:0/478275534 conn(0x7f09d0103020 msgr2=0x7f09d0103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:21.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.840+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 shutdown_connections 2024-03-28T05:33:21.480 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:20.841+0000 7f09d6c00700 1 -- 172.21.15.55:0/478275534 wait complete. 2024-03-28T05:33:21.480 INFO:teuthology.orchestra.run.smithi055.stdout:Creating initial admin user... 2024-03-28T05:33:22.077 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:21 smithi055 ceph-mon[31863]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:22.077 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:22.077 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$bn9mHSUscnPKKc7GwrcJgeFoJnjfLGMIGIvS6W9Sv2klGob179oM6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711604002, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.076+0000 7fb168200700 1 Processor -- start 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.076+0000 7fb168200700 1 -- start start 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.077+0000 7fb168200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.077+0000 7fb168200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160108450 con 0x7fb160107a60 2024-03-28T05:33:23.310 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.077+0000 7fb165800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.077+0000 7fb165800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38588/0 (socket says 172.21.15.55:38588) 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.077+0000 7fb165800700 1 -- 172.21.15.55:0/601622719 learned_addr learned my addr 172.21.15.55:0/601622719 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.078+0000 7fb165800700 1 -- 172.21.15.55:0/601622719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160108c60 con 0x7fb160107a60 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.078+0000 7fb165800700 1 --2- 172.21.15.55:0/601622719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1540098a0 tx=0x7fb154009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be38e38618e53ae server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.079+0000 7fb15fe00700 1 -- 172.21.15.55:0/601622719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb154004160 con 0x7fb160107a60 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.079+0000 7fb15fe00700 1 -- 172.21.15.55:0/601622719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb154004300 con 0x7fb160107a60 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.079+0000 7fb15fe00700 1 -- 172.21.15.55:0/601622719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb154011a50 con 0x7fb160107a60 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 -- 172.21.15.55:0/601622719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 msgr2=0x7fb160107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 --2- 172.21.15.55:0/601622719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb1540098a0 tx=0x7fb154009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:23.311 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 -- 172.21.15.55:0/601622719 shutdown_connections 2024-03-28T05:33:23.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 --2- 172.21.15.55:0/601622719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb160107e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:23.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 -- 172.21.15.55:0/601622719 >> 172.21.15.55:0/601622719 conn(0x7fb160103060 msgr2=0x7fb160105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:23.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 -- 172.21.15.55:0/601622719 shutdown_connections 2024-03-28T05:33:23.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.080+0000 7fb168200700 1 -- 172.21.15.55:0/601622719 wait complete. 2024-03-28T05:33:23.316 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.081+0000 7fb168200700 1 Processor -- start 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.081+0000 7fb168200700 1 -- start start 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.081+0000 7fb168200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.081+0000 7fb168200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16010c010 con 0x7fb160107a60 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.082+0000 7fb165800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.082+0000 7fb165800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38592/0 (socket says 172.21.15.55:38592) 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.082+0000 7fb165800700 1 -- 172.21.15.55:0/3975792023 learned_addr learned my addr 172.21.15.55:0/3975792023 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.082+0000 7fb165800700 1 -- 172.21.15.55:0/3975792023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16019e0f0 con 0x7fb160107a60 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.082+0000 7fb165800700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb154006b20 tx=0x7fb154011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.083+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1540039e0 con 0x7fb160107a60 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.083+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb15401a8e0 con 0x7fb160107a60 2024-03-28T05:33:23.317 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.083+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1540247e0 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.083+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16019e380 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.083+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1601a1070 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.084+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 12) v1 ==== 46119+0+0 (secure 0 0 0) 0x7fb154022020 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.084+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1600637c0 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.085+0000 7fb15e000700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 0x7fb14803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.085+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb15404d310 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.085+0000 7fb164e00700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 0x7fb14803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.086+0000 7fb164e00700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 0x7fb14803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb14c006fd0 tx=0x7fb14c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.091+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb15402c3a0 con 0x7fb160107a60 2024-03-28T05:33:23.318 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.336+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb16019e860 con 0x7fb148038fc0 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.614+0000 7fb15e000700 1 -- 172.21.15.55:0/3975792023 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fb16019e860 con 0x7fb148038fc0 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 msgr2=0x7fb14803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 0x7fb14803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb14c006fd0 tx=0x7fb14c006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 msgr2=0x7fb16019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb154006b20 tx=0x7fb154011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 shutdown_connections 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb148038fc0 0x7fb14803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 --2- 172.21.15.55:0/3975792023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb160107a60 0x7fb16019dbb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 >> 172.21.15.55:0/3975792023 conn(0x7fb160103060 msgr2=0x7fb160103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 shutdown_connections 2024-03-28T05:33:23.319 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:22.617+0000 7fb168200700 1 -- 172.21.15.55:0/3975792023 wait complete. 2024-03-28T05:33:23.320 INFO:teuthology.orchestra.run.smithi055.stdout:Fetching dashboard port number... 2024-03-28T05:33:23.581 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:23 smithi055 ceph-mon[31863]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:23.581 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:23.581 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:24.813 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:24 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4129027332' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-28T05:33:25.607 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stdout 8443 2024-03-28T05:33:25.607 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.903+0000 7f021b800700 1 Processor -- start 2024-03-28T05:33:25.607 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.903+0000 7f021b800700 1 -- start start 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.903+0000 7f021b800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.903+0000 7f021b800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214108450 con 0x7f0214107a60 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.904+0000 7f0218e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.904+0000 7f0218e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38602/0 (socket says 172.21.15.55:38602) 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.904+0000 7f0218e00700 1 -- 172.21.15.55:0/727708165 learned_addr learned my addr 172.21.15.55:0/727708165 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.905+0000 7f0218e00700 1 -- 172.21.15.55:0/727708165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214108c60 con 0x7f0214107a60 2024-03-28T05:33:25.610 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.905+0000 7f0218e00700 1 --2- 172.21.15.55:0/727708165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02040098a0 tx=0x7f0204009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868c2f7020ce5bee server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.905+0000 7f0213e00700 1 -- 172.21.15.55:0/727708165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0204004160 con 0x7f0214107a60 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.905+0000 7f0213e00700 1 -- 172.21.15.55:0/727708165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0204004300 con 0x7f0214107a60 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.905+0000 7f0213e00700 1 -- 172.21.15.55:0/727708165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0204011a50 con 0x7f0214107a60 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 -- 172.21.15.55:0/727708165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 msgr2=0x7f0214107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 --2- 172.21.15.55:0/727708165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02040098a0 tx=0x7f0204009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 -- 172.21.15.55:0/727708165 shutdown_connections 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 --2- 172.21.15.55:0/727708165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f0214107e80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:25.611 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 -- 172.21.15.55:0/727708165 >> 172.21.15.55:0/727708165 conn(0x7f0214103060 msgr2=0x7f0214105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:25.616 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 -- 172.21.15.55:0/727708165 shutdown_connections 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.906+0000 7f021b800700 1 -- 172.21.15.55:0/727708165 wait complete. 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.907+0000 7f021b800700 1 Processor -- start 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f021b800700 1 -- start start 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f021b800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f021b800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021410c010 con 0x7f0214107a60 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f0218e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f0218e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38604/0 (socket says 172.21.15.55:38604) 2024-03-28T05:33:25.617 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.908+0000 7f0218e00700 1 -- 172.21.15.55:0/4129027332 learned_addr learned my addr 172.21.15.55:0/4129027332 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f0218e00700 1 -- 172.21.15.55:0/4129027332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021419be90 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f0218e00700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0204006b20 tx=0x7f0204011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02040039e0 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f020401a8e0 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02040247e0 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021419c120 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.909+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021419ee10 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.910+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 12) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f0204022020 con 0x7f0214107a60 2024-03-28T05:33:25.618 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.910+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02140637c0 con 0x7f0214107a60 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.911+0000 7f0212000700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 0x7f01f803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.911+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f020404d400 con 0x7f0214107a60 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.911+0000 7f020be00700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 0x7f01f803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.912+0000 7f020be00700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 0x7f01f803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01fc006fd0 tx=0x7f01fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:23.916+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f020402ad60 con 0x7f0214107a60 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.148+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f021419f3c0 con 0x7f0214107a60 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.148+0000 7f0212000700 1 -- 172.21.15.55:0/4129027332 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0204021d60 con 0x7f0214107a60 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 msgr2=0x7f01f803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 0x7f01f803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01fc006fd0 tx=0x7f01fc006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 msgr2=0x7f021419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0204006b20 tx=0x7f0204011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:25.619 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 shutdown_connections 2024-03-28T05:33:25.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01f8038fc0 0x7f01f803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:25.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 --2- 172.21.15.55:0/4129027332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0214107a60 0x7f021419b950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:25.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.151+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 >> 172.21.15.55:0/4129027332 conn(0x7f0214103060 msgr2=0x7f0214103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:25.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.152+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 shutdown_connections 2024-03-28T05:33:25.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:24.152+0000 7f021b800700 1 -- 172.21.15.55:0/4129027332 wait complete. 2024-03-28T05:33:25.644 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-28T05:33:25.644 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout disabled 2024-03-28T05:33:25.667 INFO:teuthology.orchestra.run.smithi055.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-28T05:33:25.668 INFO:teuthology.orchestra.run.smithi055.stdout:systemctl: stdout inactive 2024-03-28T05:33:25.668 INFO:teuthology.orchestra.run.smithi055.stdout:firewalld.service is not enabled 2024-03-28T05:33:25.668 INFO:teuthology.orchestra.run.smithi055.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-28T05:33:25.675 INFO:teuthology.orchestra.run.smithi055.stdout:Ceph Dashboard is now available at: 2024-03-28T05:33:25.675 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout: URL: https://smithi055.front.sepia.ceph.com:8443/ 2024-03-28T05:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout: User: admin 2024-03-28T05:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout: Password: e6j5moqqxk 2024-03-28T05:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout:Saving cluster configuration to /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config directory 2024-03-28T05:33:25.679 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling autotune for osd_memory_target 2024-03-28T05:33:25.835 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:25 smithi055 ceph-mon[31863]: mgrmap e13: x(active, since 6s) 2024-03-28T05:33:27.103 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.259+0000 7f97b0800700 1 Processor -- start 2024-03-28T05:33:27.103 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.259+0000 7f97b0800700 1 -- start start 2024-03-28T05:33:27.103 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.260+0000 7f97b0800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:27.103 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.260+0000 7f97b0800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8082450 con 0x7f97a8081a60 2024-03-28T05:33:27.103 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.260+0000 7f97ade00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:27.104 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.261+0000 7f97ade00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38616/0 (socket says 172.21.15.55:38616) 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.261+0000 7f97ade00700 1 -- 172.21.15.55:0/2430000194 learned_addr learned my addr 172.21.15.55:0/2430000194 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.261+0000 7f97ade00700 1 -- 172.21.15.55:0/2430000194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a810f240 con 0x7f97a8081a60 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.261+0000 7f97ade00700 1 --2- 172.21.15.55:0/2430000194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f979c0098a0 tx=0x7f979c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c661b19d59daeb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97aca00700 1 -- 172.21.15.55:0/2430000194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f979c004160 con 0x7f97a8081a60 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97aca00700 1 -- 172.21.15.55:0/2430000194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f979c004300 con 0x7f97a8081a60 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97aca00700 1 -- 172.21.15.55:0/2430000194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f979c011a50 con 0x7f97a8081a60 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97b0800700 1 -- 172.21.15.55:0/2430000194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 msgr2=0x7f97a8081e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:27.105 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97b0800700 1 --2- 172.21.15.55:0/2430000194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f979c0098a0 tx=0x7f979c009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97b0800700 1 -- 172.21.15.55:0/2430000194 shutdown_connections 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97b0800700 1 --2- 172.21.15.55:0/2430000194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a8081e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.262+0000 7f97b0800700 1 -- 172.21.15.55:0/2430000194 >> 172.21.15.55:0/2430000194 conn(0x7f97a807d0a0 msgr2=0x7f97a807f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.263+0000 7f97b0800700 1 -- 172.21.15.55:0/2430000194 shutdown_connections 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.263+0000 7f97b0800700 1 -- 172.21.15.55:0/2430000194 wait complete. 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.264+0000 7f97b0800700 1 Processor -- start 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.264+0000 7f97b0800700 1 -- start start 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.264+0000 7f97b0800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.264+0000 7f97b0800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81125f0 con 0x7f97a8081a60 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.265+0000 7f97ade00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:27.107 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.265+0000 7f97ade00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38624/0 (socket says 172.21.15.55:38624) 2024-03-28T05:33:27.108 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.265+0000 7f97ade00700 1 -- 172.21.15.55:0/4220471158 learned_addr learned my addr 172.21.15.55:0/4220471158 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:27.108 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.265+0000 7f97ade00700 1 -- 172.21.15.55:0/4220471158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a81a24e0 con 0x7f97a8081a60 2024-03-28T05:33:27.108 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.265+0000 7f97ade00700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f979c006b20 tx=0x7f979c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:27.110 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.266+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f979c0039e0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.266+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f979c01a8e0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.266+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f979c0247e0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.266+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a81a2770 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.266+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a81a2bd0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.267+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a80637c0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.267+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f979c022020 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.268+0000 7f97a2a00700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 0x7f979003b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.268+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f979c04d500 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.268+0000 7f97ad400700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 0x7f979003b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.269+0000 7f97ad400700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 0x7f979003b4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9798006fd0 tx=0x7f9798006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.273+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f979c02c3a0 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.499+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f97a81a5660 con 0x7f97a8081a60 2024-03-28T05:33:27.111 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.500+0000 7f97a2a00700 1 -- 172.21.15.55:0/4220471158 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f979c02a2a0 con 0x7f97a8081a60 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.502+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 msgr2=0x7f979003b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.502+0000 7f97b0800700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 0x7f979003b4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9798006fd0 tx=0x7f9798006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.502+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 msgr2=0x7f97a81a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.502+0000 7f97b0800700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f979c006b20 tx=0x7f979c011ad0 comp rx=0 tx=0).stop 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 shutdown_connections 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9790039010 0x7f979003b4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 --2- 172.21.15.55:0/4220471158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a8081a60 0x7f97a81a1fa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 >> 172.21.15.55:0/4220471158 conn(0x7f97a807d0a0 msgr2=0x7f97a807db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 shutdown_connections 2024-03-28T05:33:27.112 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:26.503+0000 7f97b0800700 1 -- 172.21.15.55:0/4220471158 wait complete. 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.711+0000 7f18bfc00700 1 Processor -- start 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.711+0000 7f18bfc00700 1 -- start start 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.712+0000 7f18bfc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.712+0000 7f18bfc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80634b0 con 0x7f18b81084c0 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.712+0000 7f18bd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.712+0000 7f18bd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38632/0 (socket says 172.21.15.55:38632) 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.712+0000 7f18bd200700 1 -- 172.21.15.55:0/2263373640 learned_addr learned my addr 172.21.15.55:0/2263373640 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.713+0000 7f18bd200700 1 -- 172.21.15.55:0/2263373640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b810adf0 con 0x7f18b81084c0 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.713+0000 7f18bd200700 1 --2- 172.21.15.55:0/2263373640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098a0 tx=0x7f18ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3859e31c4933f8d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:28.766 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.713+0000 7f18b7400700 1 -- 172.21.15.55:0/2263373640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18ac004160 con 0x7f18b81084c0 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18b7400700 1 -- 172.21.15.55:0/2263373640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f18ac004300 con 0x7f18b81084c0 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18b7400700 1 -- 172.21.15.55:0/2263373640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18ac011a50 con 0x7f18b81084c0 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18bfc00700 1 -- 172.21.15.55:0/2263373640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 msgr2=0x7f18b810a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18bfc00700 1 --2- 172.21.15.55:0/2263373640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0098a0 tx=0x7f18ac009bb0 comp rx=0 tx=0).stop 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18bfc00700 1 -- 172.21.15.55:0/2263373640 shutdown_connections 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18bfc00700 1 --2- 172.21.15.55:0/2263373640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b810a8b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.714+0000 7f18bfc00700 1 -- 172.21.15.55:0/2263373640 >> 172.21.15.55:0/2263373640 conn(0x7f18b8101f70 msgr2=0x7f18b8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.715+0000 7f18bfc00700 1 -- 172.21.15.55:0/2263373640 shutdown_connections 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.715+0000 7f18bfc00700 1 -- 172.21.15.55:0/2263373640 wait complete. 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.716+0000 7f18bfc00700 1 Processor -- start 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.716+0000 7f18bfc00700 1 -- start start 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bfc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bfc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b810be00 con 0x7f18b81084c0 2024-03-28T05:33:28.767 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38640/0 (socket says 172.21.15.55:38640) 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bd200700 1 -- 172.21.15.55:0/4126326773 learned_addr learned my addr 172.21.15.55:0/4126326773 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.717+0000 7f18bd200700 1 -- 172.21.15.55:0/4126326773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8108280 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18bd200700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ac011a00 tx=0x7f18ac011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18ac003af0 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f18ac01a8e0 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8106470 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18ac024840 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.718+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b81069b0 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.720+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f18ac022020 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.720+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b80637c0 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.720+0000 7f18b5600700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 0x7f18a003b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.720+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f18ac04d460 con 0x7f18b81084c0 2024-03-28T05:33:28.768 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.720+0000 7f18b7e00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 0x7f18a003b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.721+0000 7f18b7e00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 0x7f18a003b530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006fd0 tx=0x7f18a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:27.726+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f18ac01aa90 con 0x7f18b81084c0 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.072+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f18b8106c30 con 0x7f18b81084c0 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.077+0000 7f18b5600700 1 -- 172.21.15.55:0/4126326773 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f18ac00b3e0 con 0x7f18b81084c0 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.080+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 msgr2=0x7f18a003b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.080+0000 7f18bfc00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 0x7f18a003b530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18a4006fd0 tx=0x7f18a4006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.080+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 msgr2=0x7f18b8107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.080+0000 7f18bfc00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ac011a00 tx=0x7f18ac011ae0 comp rx=0 tx=0).stop 2024-03-28T05:33:28.769 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 shutdown_connections 2024-03-28T05:33:28.770 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f18a0039070 0x7f18a003b530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 --2- 172.21.15.55:0/4126326773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b81084c0 0x7f18b8107d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 >> 172.21.15.55:0/4126326773 conn(0x7f18b8101f70 msgr2=0x7f18b8102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 shutdown_connections 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr 2024-03-28T05:33:28.081+0000 7f18bfc00700 1 -- 172.21.15.55:0/4126326773 wait complete. 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:Or, if you are only running a single cluster on this host: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-28T05:33:28.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout: ceph telemetry on 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout:For more information see: 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:28.772 INFO:teuthology.orchestra.run.smithi055.stdout:Bootstrap complete. 2024-03-28T05:33:28.881 INFO:tasks.cephadm:Fetching config... 2024-03-28T05:33:28.881 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:33:28.881 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-28T05:33:28.933 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-28T05:33:28.933 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:33:28.933 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-28T05:33:28.977 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-28T05:33:28.977 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:33:28.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-28T05:33:29.114 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-28T05:33:29.114 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:33:29.114 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-28T05:33:29.210 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-28T05:33:29.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-28T05:33:29.329 INFO:teuthology.orchestra.run.smithi055.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:33:29.330 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:29 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4126326773' entity='client.admin' 2024-03-28T05:33:29.377 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-28T05:33:29.511 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:33:29.579 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-28T05:33:29.716 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbWSjfvEwrBpWfuUePWq2wsmgYH0EZsN/CFNnZssxerWFcp8z67b3cEDdEQJlQlfw7cVIFQ9TZGOSzWrp5UMJCzOvMxF1Y3M751U8NKIRqhpw82VJAMBJKBo9Ig2Ebv8DTNnn+/H3fZE1uOfsRin1oC6AJBf9qxvDRIkcEzG217MCHQBTCiHUu4YhX6Ra6Ot/Zox443eywAkcg3fj+y4/w3Cukh1EAapLaXKkSJyOjZuJNMi+ZASvVxXV1ZaGGZSOhfNOKl6HnC3wJWOqlqleR4h/oq/MbJM5n/nMYinDCupmgQDMAX35AS2u4GjwY8eI0ZlL5Q9ibkYGSA63rK0yoxAdjHdtsAw+ZBTTgsK8tMkTmbFSkAlapQ1ZyrGkvjLWrtkrB6TqbpvdCq0yJ3m4hkIyoLoRiGjS2U/mHj7Z22RHSB8wWOrHLn0aCl1Xsv3hOviNCvnVqZMFTFciCgDcuydHjwQg03+FCzDhqU/i4icivpq/idQqhlzAdDF2GyLs= ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:33:29.783 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-28T05:33:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:33:32.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 -- 172.21.15.55:0/3457495432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 msgr2=0x7f6de8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:32.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 --2- 172.21.15.55:0/3457495432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de8100860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009910 tx=0x7f6dd8009c20 comp rx=0 tx=0).stop 2024-03-28T05:33:32.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 -- 172.21.15.55:0/3457495432 shutdown_connections 2024-03-28T05:33:32.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 --2- 172.21.15.55:0/3457495432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de8100860 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:32.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 -- 172.21.15.55:0/3457495432 >> 172.21.15.55:0/3457495432 conn(0x7f6de80fc060 msgr2=0x7f6de80fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:32.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 -- 172.21.15.55:0/3457495432 shutdown_connections 2024-03-28T05:33:32.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.658+0000 7f6ded600700 1 -- 172.21.15.55:0/3457495432 wait complete. 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.659+0000 7f6ded600700 1 Processor -- start 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.659+0000 7f6ded600700 1 -- start start 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.660+0000 7f6ded600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.660+0000 7f6ded600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8109cf0 con 0x7f6de8100440 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.660+0000 7f6de6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.660+0000 7f6de6a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50944/0 (socket says 172.21.15.55:50944) 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.660+0000 7f6de6a00700 1 -- 172.21.15.55:0/1802539842 learned_addr learned my addr 172.21.15.55:0/1802539842 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:32.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6de6a00700 1 -- 172.21.15.55:0/1802539842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8199920 con 0x7f6de8100440 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6de6a00700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8005190 tx=0x7f6dd8004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dd8027070 con 0x7f6de8100440 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6dd8022470 con 0x7f6de8100440 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8199bb0 con 0x7f6de8100440 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dd800f5f0 con 0x7f6de8100440 2024-03-28T05:33:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.661+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de819c8a0 con 0x7f6de8100440 2024-03-28T05:33:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.662+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de810a470 con 0x7f6de8100440 2024-03-28T05:33:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.662+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f6dd802a070 con 0x7f6de8100440 2024-03-28T05:33:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.663+0000 7f6ddf400700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 0x7f6dcc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.663+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6dd801e030 con 0x7f6de8100440 2024-03-28T05:33:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.663+0000 7f6de6000700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 0x7f6dcc03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.664+0000 7f6de6000700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 0x7f6dcc03b4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.669+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f6dd8013070 con 0x7f6de8100440 2024-03-28T05:33:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.896+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f6de802db40 con 0x7f6de8100440 2024-03-28T05:33:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.907+0000 7f6ddf400700 1 -- 172.21.15.55:0/1802539842 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6dd80310c0 con 0x7f6de8100440 2024-03-28T05:33:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 msgr2=0x7f6dcc03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 0x7f6dcc03b4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 msgr2=0x7f6de81993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8005190 tx=0x7f6dd8004f80 comp rx=0 tx=0).stop 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 shutdown_connections 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6dcc039020 0x7f6dcc03b4e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 --2- 172.21.15.55:0/1802539842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6de8100440 0x7f6de81993e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.910+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 >> 172.21.15.55:0/1802539842 conn(0x7f6de80fc060 msgr2=0x7f6de80fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.911+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 shutdown_connections 2024-03-28T05:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:32.911+0000 7f6ded600700 1 -- 172.21.15.55:0/1802539842 wait complete. 2024-03-28T05:33:33.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:33.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:33.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1802539842' entity='client.admin' 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:33.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:33.689 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-28T05:33:33.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-28T05:33:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:33:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.014+0000 7f5257000700 1 -- 172.21.15.55:0/2667981352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 msgr2=0x7f5250101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.014+0000 7f5257000700 1 --2- 172.21.15.55:0/2667981352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250101fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5240009910 tx=0x7f5240009c20 comp rx=0 tx=0).stop 2024-03-28T05:33:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.015+0000 7f5257000700 1 -- 172.21.15.55:0/2667981352 shutdown_connections 2024-03-28T05:33:36.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.015+0000 7f5257000700 1 --2- 172.21.15.55:0/2667981352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250101fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.015+0000 7f5257000700 1 -- 172.21.15.55:0/2667981352 >> 172.21.15.55:0/2667981352 conn(0x7f52500fd160 msgr2=0x7f52500ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.015+0000 7f5257000700 1 -- 172.21.15.55:0/2667981352 shutdown_connections 2024-03-28T05:33:36.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.015+0000 7f5257000700 1 -- 172.21.15.55:0/2667981352 wait complete. 2024-03-28T05:33:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.016+0000 7f5257000700 1 Processor -- start 2024-03-28T05:33:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.016+0000 7f5257000700 1 -- start start 2024-03-28T05:33:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f5257000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f5257000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250107b00 con 0x7f5250101bc0 2024-03-28T05:33:36.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f524fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f524fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50972/0 (socket says 172.21.15.55:50972) 2024-03-28T05:33:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f524fe00700 1 -- 172.21.15.55:0/3290475677 learned_addr learned my addr 172.21.15.55:0/3290475677 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.017+0000 7f524fe00700 1 -- 172.21.15.55:0/3290475677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52501977c0 con 0x7f5250101bc0 2024-03-28T05:33:36.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f524fe00700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5240005950 tx=0x7f5240004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5240026070 con 0x7f5250101bc0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f524000bc00 con 0x7f5250101bc0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52400039a0 con 0x7f5250101bc0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5250197a50 con 0x7f5250101bc0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.018+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525019a740 con 0x7f5250101bc0 2024-03-28T05:33:36.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.019+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250108280 con 0x7f5250101bc0 2024-03-28T05:33:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.020+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f5240029070 con 0x7f5250101bc0 2024-03-28T05:33:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.020+0000 7f524d600700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 0x7f523403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.020+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f524001e070 con 0x7f5250101bc0 2024-03-28T05:33:36.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.020+0000 7f5247400700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 0x7f523403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:36.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.021+0000 7f5247400700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 0x7f523403b4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5238006fd0 tx=0x7f5238006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:36.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.025+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5240013070 con 0x7f5250101bc0 2024-03-28T05:33:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.256+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f525002db40 con 0x7f5234039020 2024-03-28T05:33:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.269+0000 7f524d600700 1 -- 172.21.15.55:0/3290475677 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f525002db40 con 0x7f5234039020 2024-03-28T05:33:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 msgr2=0x7f523403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 0x7f523403b4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5238006fd0 tx=0x7f5238006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 msgr2=0x7f5250197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5240005950 tx=0x7f5240004fa0 comp rx=0 tx=0).stop 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 shutdown_connections 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5234039020 0x7f523403b4e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 --2- 172.21.15.55:0/3290475677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5250101bc0 0x7f5250197280 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.272+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 >> 172.21.15.55:0/3290475677 conn(0x7f52500fd160 msgr2=0x7f52500fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.273+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 shutdown_connections 2024-03-28T05:33:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:36.273+0000 7f5257000700 1 -- 172.21.15.55:0/3290475677 wait complete. 2024-03-28T05:33:37.034 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi086 2024-03-28T05:33:37.036 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:33:37.036 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.conf 2024-03-28T05:33:37.095 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:33:37.095 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:33:37.192 INFO:tasks.cephadm:Adding host smithi086 to orchestrator... 2024-03-28T05:33:37.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch host add smithi086 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:33:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:37 smithi055 ceph-mon[31863]: Updating smithi055:/etc/ceph/ceph.conf 2024-03-28T05:33:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:33:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:38 smithi055 ceph-mon[31863]: Updating smithi055:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:33:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:38 smithi055 ceph-mon[31863]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:33:39.529 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:39 smithi055 ceph-mon[31863]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:39.529 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:39 smithi055 ceph-mon[31863]: Updating smithi055:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:33:39.529 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:39.529 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:39.529 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 -- 172.21.15.55:0/2924771912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 msgr2=0x7f59c80749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:39.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 --2- 172.21.15.55:0/2924771912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c80749a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009910 tx=0x7f59b8009c20 comp rx=0 tx=0).stop 2024-03-28T05:33:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 -- 172.21.15.55:0/2924771912 shutdown_connections 2024-03-28T05:33:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 --2- 172.21.15.55:0/2924771912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c80749a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 -- 172.21.15.55:0/2924771912 >> 172.21.15.55:0/2924771912 conn(0x7f59c80fd670 msgr2=0x7f59c80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 -- 172.21.15.55:0/2924771912 shutdown_connections 2024-03-28T05:33:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.700+0000 7f59cce00700 1 -- 172.21.15.55:0/2924771912 wait complete. 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.701+0000 7f59cce00700 1 Processor -- start 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59cce00700 1 -- start start 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59cce00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59cce00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c810e2c0 con 0x7f59c80745c0 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59c5e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59c5e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57484/0 (socket says 172.21.15.55:57484) 2024-03-28T05:33:39.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.702+0000 7f59c5e00700 1 -- 172.21.15.55:0/1389266031 learned_addr learned my addr 172.21.15.55:0/1389266031 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59c5e00700 1 -- 172.21.15.55:0/1389266031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c819fb60 con 0x7f59c80745c0 2024-03-28T05:33:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59c5e00700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59b80056d0 tx=0x7f59b80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b8026070 con 0x7f59c80745c0 2024-03-28T05:33:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f59b8004370 con 0x7f59c80745c0 2024-03-28T05:33:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b80039b0 con 0x7f59c80745c0 2024-03-28T05:33:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.703+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c819fdf0 con 0x7f59c80745c0 2024-03-28T05:33:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.704+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c81996f0 con 0x7f59c80745c0 2024-03-28T05:33:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.705+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8075c70 con 0x7f59c80745c0 2024-03-28T05:33:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.705+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f59b8029070 con 0x7f59c80745c0 2024-03-28T05:33:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.705+0000 7f59bf400700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 0x7f59ac03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.706+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f59b801e070 con 0x7f59c80745c0 2024-03-28T05:33:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.706+0000 7f59bd400700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 0x7f59ac03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:39.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.707+0000 7f59bd400700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 0x7f59ac03b4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59b000ad30 tx=0x7f59b00093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:39.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.711+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f59b8013070 con 0x7f59c80745c0 2024-03-28T05:33:39.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:39.944+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}) v1 -- 0x7f59c80637c0 con 0x7f59ac039020 2024-03-28T05:33:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:41 smithi055 ceph-mon[31863]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:41 smithi055 ceph-mon[31863]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:42 smithi055 ceph-mon[31863]: Deploying cephadm binary to smithi086 2024-03-28T05:33:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:43 smithi055 ceph-mon[31863]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:45 smithi055 ceph-mon[31863]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.623+0000 7f59bf400700 1 -- 172.21.15.55:0/1389266031 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f59c80637c0 con 0x7f59ac039020 2024-03-28T05:33:46.627 INFO:teuthology.orchestra.run.smithi055.stdout:Added host 'smithi086' with addr '172.21.15.86' 2024-03-28T05:33:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 msgr2=0x7f59ac03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:46.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 0x7f59ac03b4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59b000ad30 tx=0x7f59b00093f0 comp rx=0 tx=0).stop 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 msgr2=0x7f59c819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59b80056d0 tx=0x7f59b80057b0 comp rx=0 tx=0).stop 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 shutdown_connections 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f59ac039020 0x7f59ac03b4e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 --2- 172.21.15.55:0/1389266031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80745c0 0x7f59c819f620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 >> 172.21.15.55:0/1389266031 conn(0x7f59c80fd670 msgr2=0x7f59c8105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 shutdown_connections 2024-03-28T05:33:46.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:46.627+0000 7f59cce00700 1 -- 172.21.15.55:0/1389266031 wait complete. 2024-03-28T05:33:47.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-28T05:33:47.773 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:33:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:47 smithi055 ceph-mon[31863]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:47 smithi055 ceph-mon[31863]: Added host smithi086 2024-03-28T05:33:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:33:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:49.467 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:49 smithi055 ceph-mon[31863]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:49.467 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 -- 172.21.15.55:0/912801369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 msgr2=0x7f7b8c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 --2- 172.21.15.55:0/912801369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c0749a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009910 tx=0x7f7b80009c20 comp rx=0 tx=0).stop 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 -- 172.21.15.55:0/912801369 shutdown_connections 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 --2- 172.21.15.55:0/912801369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c0749a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 -- 172.21.15.55:0/912801369 >> 172.21.15.55:0/912801369 conn(0x7f7b8c0fd670 msgr2=0x7f7b8c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 -- 172.21.15.55:0/912801369 shutdown_connections 2024-03-28T05:33:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.637+0000 7f7b93400700 1 -- 172.21.15.55:0/912801369 wait complete. 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.638+0000 7f7b93400700 1 Processor -- start 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b93400700 1 -- start start 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b93400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b93400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c10e2c0 con 0x7f7b8c0745c0 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b90a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b90a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44106/0 (socket says 172.21.15.55:44106) 2024-03-28T05:33:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.639+0000 7f7b90a00700 1 -- 172.21.15.55:0/2077173313 learned_addr learned my addr 172.21.15.55:0/2077173313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b90a00700 1 -- 172.21.15.55:0/2077173313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c19fb00 con 0x7f7b8c0745c0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b90a00700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006010 tx=0x7f7b80005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b80026070 con 0x7f7b8c0745c0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7b8000bc00 con 0x7f7b8c0745c0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c19fd90 con 0x7f7b8c0745c0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.640+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b80003910 con 0x7f7b8c0745c0 2024-03-28T05:33:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.641+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c199690 con 0x7f7b8c0745c0 2024-03-28T05:33:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.642+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c075c70 con 0x7f7b8c0745c0 2024-03-28T05:33:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.642+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f7b80029070 con 0x7f7b8c0745c0 2024-03-28T05:33:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.643+0000 7f7b89600700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 0x7f7b7403b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.643+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7b8001e070 con 0x7f7b8c0745c0 2024-03-28T05:33:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.643+0000 7f7b8be00700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 0x7f7b7403b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.644+0000 7f7b8be00700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 0x7f7b7403b530 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b78006fd0 tx=0x7f7b78006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.648+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f7b80013070 con 0x7f7b8c0745c0 2024-03-28T05:33:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.884+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b8c0637c0 con 0x7f7b74039070 2024-03-28T05:33:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.888+0000 7f7b89600700 1 -- 172.21.15.55:0/2077173313 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f7b8c0637c0 con 0x7f7b74039070 2024-03-28T05:33:49.888 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:33:49.888 INFO:teuthology.orchestra.run.smithi055.stdout:[{"addr": "172.21.15.55", "hostname": "smithi055", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}] 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.890+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 msgr2=0x7f7b7403b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.890+0000 7f7b93400700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 0x7f7b7403b530 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b78006fd0 tx=0x7f7b78006e40 comp rx=0 tx=0).stop 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.890+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 msgr2=0x7f7b8c19f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.890+0000 7f7b93400700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b80006010 tx=0x7f7b80005780 comp rx=0 tx=0).stop 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 shutdown_connections 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7b74039070 0x7f7b7403b530 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 --2- 172.21.15.55:0/2077173313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b8c0745c0 0x7f7b8c19f5c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 >> 172.21.15.55:0/2077173313 conn(0x7f7b8c0fd670 msgr2=0x7f7b8c107e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 shutdown_connections 2024-03-28T05:33:49.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:49.891+0000 7f7b93400700 1 -- 172.21.15.55:0/2077173313 wait complete. 2024-03-28T05:33:50.628 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2024-03-28T05:33:50.629 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:33:50.629 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2024-03-28T05:33:50.686 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:33:50.686 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:33:50.781 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2024-03-28T05:33:50.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch host add smithi159 2024-03-28T05:33:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:33:51.713 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:51 smithi055 ceph-mon[31863]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:51.713 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:51 smithi055 ceph-mon[31863]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:33:51.713 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.203+0000 7fb707800700 1 -- 172.21.15.55:0/2553751732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 msgr2=0x7fb7001043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.203+0000 7fb707800700 1 --2- 172.21.15.55:0/2553751732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb7001043e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009910 tx=0x7fb6f4009c20 comp rx=0 tx=0).stop 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.203+0000 7fb707800700 1 -- 172.21.15.55:0/2553751732 shutdown_connections 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.203+0000 7fb707800700 1 --2- 172.21.15.55:0/2553751732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb7001043e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.203+0000 7fb707800700 1 -- 172.21.15.55:0/2553751732 >> 172.21.15.55:0/2553751732 conn(0x7fb7000ff870 msgr2=0x7fb700101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:33:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.204+0000 7fb707800700 1 -- 172.21.15.55:0/2553751732 shutdown_connections 2024-03-28T05:33:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.204+0000 7fb707800700 1 -- 172.21.15.55:0/2553751732 wait complete. 2024-03-28T05:33:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.205+0000 7fb707800700 1 Processor -- start 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.205+0000 7fb707800700 1 -- start start 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb707800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb707800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70010e280 con 0x7fb700104000 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb704e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb704e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44120/0 (socket says 172.21.15.55:44120) 2024-03-28T05:33:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb704e00700 1 -- 172.21.15.55:0/4240736665 learned_addr learned my addr 172.21.15.55:0/4240736665 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:33:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.206+0000 7fb704e00700 1 -- 172.21.15.55:0/4240736665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70019f990 con 0x7fb700104000 2024-03-28T05:33:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb704e00700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006010 tx=0x7fb6f4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4026070 con 0x7fb700104000 2024-03-28T05:33:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70019fc80 con 0x7fb700104000 2024-03-28T05:33:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6f400bba0 con 0x7fb700104000 2024-03-28T05:33:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6f40038a0 con 0x7fb700104000 2024-03-28T05:33:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.207+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb700199610 con 0x7fb700104000 2024-03-28T05:33:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.208+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7fb6f4029070 con 0x7fb700104000 2024-03-28T05:33:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.208+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7001054e0 con 0x7fb700104000 2024-03-28T05:33:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.209+0000 7fb6fd600700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 0x7fb6e803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:33:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.209+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb6f401e070 con 0x7fb700104000 2024-03-28T05:33:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.209+0000 7fb6ffe00700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 0x7fb6e803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:33:53.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.210+0000 7fb6ffe00700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 0x7fb6e803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec006fd0 tx=0x7fb6ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:33:53.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.214+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb6f4013070 con 0x7fb700104000 2024-03-28T05:33:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:33:53.445+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) v1 -- 0x7fb70019ab40 con 0x7fb6e8038fc0 2024-03-28T05:33:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:53 smithi055 ceph-mon[31863]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:54 smithi055 ceph-mon[31863]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:33:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:55 smithi055 ceph-mon[31863]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: Deploying cephadm binary to smithi159 2024-03-28T05:33:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:56 smithi055 ceph-mon[31863]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:33:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:57 smithi055 ceph-mon[31863]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:33:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:33:59 smithi055 ceph-mon[31863]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:00.259 INFO:teuthology.orchestra.run.smithi055.stdout:Added host 'smithi159' with addr '172.21.15.159' 2024-03-28T05:34:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.258+0000 7fb6fd600700 1 -- 172.21.15.55:0/4240736665 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb70019ab40 con 0x7fb6e8038fc0 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 msgr2=0x7fb6e803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 0x7fb6e803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec006fd0 tx=0x7fb6ec006e40 comp rx=0 tx=0).stop 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 msgr2=0x7fb70019f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4006010 tx=0x7fb6f4005780 comp rx=0 tx=0).stop 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 shutdown_connections 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6e8038fc0 0x7fb6e803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 --2- 172.21.15.55:0/4240736665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb700104000 0x7fb70019f450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.262+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 >> 172.21.15.55:0/4240736665 conn(0x7fb7000ff870 msgr2=0x7fb7001059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.263+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 shutdown_connections 2024-03-28T05:34:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:00.263+0000 7fb707800700 1 -- 172.21.15.55:0/4240736665 wait complete. 2024-03-28T05:34:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:00 smithi055 ceph-mon[31863]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:00.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-28T05:34:01.438 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:34:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: Added host smithi159 2024-03-28T05:34:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:02.753 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:03.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 -- 172.21.15.55:0/3021092382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 msgr2=0x7f9088102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 --2- 172.21.15.55:0/3021092382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088102f60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9078009910 tx=0x7f9078009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 -- 172.21.15.55:0/3021092382 shutdown_connections 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 --2- 172.21.15.55:0/3021092382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088102f60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 -- 172.21.15.55:0/3021092382 >> 172.21.15.55:0/3021092382 conn(0x7f90880fc410 msgr2=0x7f90880fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 -- 172.21.15.55:0/3021092382 shutdown_connections 2024-03-28T05:34:03.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.496+0000 7f9087200700 1 -- 172.21.15.55:0/3021092382 wait complete. 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.497+0000 7f9087200700 1 Processor -- start 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9087200700 1 -- start start 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9087200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9087200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908810bf20 con 0x7f9088102b80 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9085e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9085e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45476/0 (socket says 172.21.15.55:45476) 2024-03-28T05:34:03.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.498+0000 7f9085e00700 1 -- 172.21.15.55:0/891752122 learned_addr learned my addr 172.21.15.55:0/891752122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f9085e00700 1 -- 172.21.15.55:0/891752122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088199c50 con 0x7f9088102b80 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f9085e00700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f9078005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9078026070 con 0x7f9088102b80 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088199ee0 con 0x7f9088102b80 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f907800bc00 con 0x7f9088102b80 2024-03-28T05:34:03.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.499+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9078003910 con 0x7f9088102b80 2024-03-28T05:34:03.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.500+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908819a340 con 0x7f9088102b80 2024-03-28T05:34:03.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.501+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908806a6f0 con 0x7f9088102b80 2024-03-28T05:34:03.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.501+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f9078029070 con 0x7f9088102b80 2024-03-28T05:34:03.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.502+0000 7f907f400700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 0x7f906c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:03.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.502+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f907801e070 con 0x7f9088102b80 2024-03-28T05:34:03.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.502+0000 7f907d400700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 0x7f906c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:03.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.503+0000 7f907d400700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 0x7f906c03b480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:03.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.508+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9078013070 con 0x7f9088102b80 2024-03-28T05:34:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:03 smithi055 ceph-mon[31863]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.743+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f908819aa70 con 0x7f906c038fc0 2024-03-28T05:34:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.745+0000 7f907f400700 1 -- 172.21.15.55:0/891752122 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f908819aa70 con 0x7f906c038fc0 2024-03-28T05:34:03.746 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:34:03.746 INFO:teuthology.orchestra.run.smithi055.stdout:[{"addr": "172.21.15.55", "hostname": "smithi055", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}] 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 msgr2=0x7f906c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 0x7f906c03b480 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9070006fd0 tx=0x7f9070006e40 comp rx=0 tx=0).stop 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 msgr2=0x7f9088199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f9078005780 comp rx=0 tx=0).stop 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 shutdown_connections 2024-03-28T05:34:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f906c038fc0 0x7f906c03b480 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 --2- 172.21.15.55:0/891752122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9088102b80 0x7f9088199710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 >> 172.21.15.55:0/891752122 conn(0x7f90880fc410 msgr2=0x7f9088107d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 shutdown_connections 2024-03-28T05:34:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:03.748+0000 7f9087200700 1 -- 172.21.15.55:0/891752122 wait complete. 2024-03-28T05:34:04.447 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-28T05:34:04.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd crush tunables default 2024-03-28T05:34:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:34:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:05 smithi055 ceph-mon[31863]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:05 smithi055 ceph-mon[31863]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:34:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:06.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 -- 172.21.15.55:0/2048348986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 msgr2=0x7f111c107dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:06.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 --2- 172.21.15.55:0/2048348986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c107dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f110c009910 tx=0x7f110c009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:06.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 -- 172.21.15.55:0/2048348986 shutdown_connections 2024-03-28T05:34:06.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 --2- 172.21.15.55:0/2048348986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c107dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:06.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 -- 172.21.15.55:0/2048348986 >> 172.21.15.55:0/2048348986 conn(0x7f111c076420 msgr2=0x7f111c076830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:06.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 -- 172.21.15.55:0/2048348986 shutdown_connections 2024-03-28T05:34:06.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.742+0000 7f1120e00700 1 -- 172.21.15.55:0/2048348986 wait complete. 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.743+0000 7f1120e00700 1 Processor -- start 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.743+0000 7f1120e00700 1 -- start start 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.744+0000 7f1120e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.744+0000 7f1120e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c10bec0 con 0x7f111c1079f0 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.744+0000 7f111b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.744+0000 7f111b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45502/0 (socket says 172.21.15.55:45502) 2024-03-28T05:34:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.744+0000 7f111b400700 1 -- 172.21.15.55:0/2052833515 learned_addr learned my addr 172.21.15.55:0/2052833515 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f111b400700 1 -- 172.21.15.55:0/2052833515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c199c10 con 0x7f111c1079f0 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f111b400700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f110c006010 tx=0x7f110c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f110c026070 con 0x7f111c1079f0 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f110c00bba0 con 0x7f111c1079f0 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c199f00 con 0x7f111c1079f0 2024-03-28T05:34:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f110c003910 con 0x7f111c1079f0 2024-03-28T05:34:06.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.745+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c19df50 con 0x7f111c1079f0 2024-03-28T05:34:06.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.747+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c103120 con 0x7f111c1079f0 2024-03-28T05:34:06.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.747+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f110c029070 con 0x7f111c1079f0 2024-03-28T05:34:06.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.747+0000 7f1113e00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 0x7f110003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:06.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.747+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f110c01e070 con 0x7f111c1079f0 2024-03-28T05:34:06.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.748+0000 7f111aa00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 0x7f110003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:06.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.748+0000 7f111aa00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 0x7f110003b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1108006fd0 tx=0x7f1108006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:06.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.753+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f110c013070 con 0x7f111c1079f0 2024-03-28T05:34:06.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:06.985+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f111c0637f0 con 0x7f111c1079f0 2024-03-28T05:34:07.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.569+0000 7f1113e00700 1 -- 172.21.15.55:0/2052833515 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f111c0637f0 con 0x7f111c1079f0 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.575+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 msgr2=0x7f110003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.575+0000 7f1120e00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 0x7f110003b4e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1108006fd0 tx=0x7f1108006e40 comp rx=0 tx=0).stop 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.575+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 msgr2=0x7f111c1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.575+0000 7f1120e00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f110c006010 tx=0x7f110c005780 comp rx=0 tx=0).stop 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 shutdown_connections 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1100039020 0x7f110003b4e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 --2- 172.21.15.55:0/2052833515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111c1079f0 0x7f111c1996d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 >> 172.21.15.55:0/2052833515 conn(0x7f111c076420 msgr2=0x7f111c103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:07.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 shutdown_connections 2024-03-28T05:34:07.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:07.576+0000 7f1120e00700 1 -- 172.21.15.55:0/2052833515 wait complete. 2024-03-28T05:34:07.578 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-03-28T05:34:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:07 smithi055 ceph-mon[31863]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:07 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-28T05:34:08.322 INFO:tasks.cephadm:Adding mon.a on smithi055 2024-03-28T05:34:08.323 INFO:tasks.cephadm:Adding mon.b on smithi086 2024-03-28T05:34:08.323 INFO:tasks.cephadm:Adding mon.c on smithi159 2024-03-28T05:34:08.323 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch apply mon '3;smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c' 2024-03-28T05:34:08.730 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-28T05:34:08.833 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-28T05:34:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-28T05:34:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:08 smithi055 ceph-mon[31863]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:09 smithi055 ceph-mon[31863]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:11 smithi055 ceph-mon[31863]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 -- 172.21.15.159:0/798023047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 msgr2=0x7f7330074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 --2- 172.21.15.159:0/798023047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f7330074620 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7320009910 tx=0x7f7320009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 -- 172.21.15.159:0/798023047 shutdown_connections 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 --2- 172.21.15.159:0/798023047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f7330074620 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 -- 172.21.15.159:0/798023047 >> 172.21.15.159:0/798023047 conn(0x7f73300fd160 msgr2=0x7f73300ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 -- 172.21.15.159:0/798023047 shutdown_connections 2024-03-28T05:34:11.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.843+0000 7f7335000700 1 -- 172.21.15.159:0/798023047 wait complete. 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.844+0000 7f7335000700 1 Processor -- start 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.844+0000 7f7335000700 1 -- start start 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.845+0000 7f7335000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.845+0000 7f7335000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733010e1a0 con 0x7f73300761c0 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.845+0000 7f732de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.845+0000 7f732de00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.159:39746/0 (socket says 172.21.15.159:39746) 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.845+0000 7f732de00700 1 -- 172.21.15.159:0/3848058396 learned_addr learned my addr 172.21.15.159:0/3848058396 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:34:11.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.846+0000 7f732de00700 1 -- 172.21.15.159:0/3848058396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733019dd30 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.846+0000 7f732de00700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7320005950 tx=0x7f7320004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.847+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7320026070 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.847+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733019dfc0 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.847+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f732000bc00 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.847+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73200039a0 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.847+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73301a0cb0 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.848+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733010e880 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.849+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f7320029070 con 0x7f73300761c0 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.849+0000 7f7326a00700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 0x7f731403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:11.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.849+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f732001e070 con 0x7f73300761c0 2024-03-28T05:34:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.850+0000 7f732d400700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 0x7f731403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.851+0000 7f732d400700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 0x7f731403b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f731c006fd0 tx=0x7f731c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:11.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:11.865+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f7320013070 con 0x7f73300761c0 2024-03-28T05:34:12.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.175+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f733002dcc0 con 0x7f7314039020 2024-03-28T05:34:12.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.192+0000 7f7326a00700 1 -- 172.21.15.159:0/3848058396 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f733002dcc0 con 0x7f7314039020 2024-03-28T05:34:12.193 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mon update... 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 msgr2=0x7f731403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 0x7f731403b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f731c006fd0 tx=0x7f731c006e40 comp rx=0 tx=0).stop 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 msgr2=0x7f733019d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7320005950 tx=0x7f7320004fa0 comp rx=0 tx=0).stop 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 shutdown_connections 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7314039020 0x7f731403b4e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:12.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 --2- 172.21.15.159:0/3848058396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300761c0 0x7f733019d7f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 >> 172.21.15.159:0/3848058396 conn(0x7f73300fd160 msgr2=0x7f73300fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 shutdown_connections 2024-03-28T05:34:12.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:12.195+0000 7f7335000700 1 -- 172.21.15.159:0/3848058396 wait complete. 2024-03-28T05:34:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:12 smithi055 ceph-mon[31863]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:12.999 DEBUG:teuthology.orchestra.run.smithi086:mon.b> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.b.service 2024-03-28T05:34:13.008 DEBUG:teuthology.orchestra.run.smithi159:mon.c> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mon.c.service 2024-03-28T05:34:13.012 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-28T05:34:13.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-28T05:34:13.451 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: Saving service mon spec with placement smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c;count:3 2024-03-28T05:34:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:14 smithi055 ceph-mon[31863]: Deploying daemon mon.c on smithi159 2024-03-28T05:34:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:15 smithi055 ceph-mon[31863]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:17.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 -- 172.21.15.159:0/3808394282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 msgr2=0x7f53241021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:17.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 --2- 172.21.15.159:0/3808394282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f53241021a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5314009910 tx=0x7f5314009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:17.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 -- 172.21.15.159:0/3808394282 shutdown_connections 2024-03-28T05:34:17.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 --2- 172.21.15.159:0/3808394282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f53241021a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:17.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 -- 172.21.15.159:0/3808394282 >> 172.21.15.159:0/3808394282 conn(0x7f53240fd670 msgr2=0x7f53240ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:17.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.013+0000 7f5329e00700 1 -- 172.21.15.159:0/3808394282 shutdown_connections 2024-03-28T05:34:17.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.014+0000 7f5329e00700 1 -- 172.21.15.159:0/3808394282 wait complete. 2024-03-28T05:34:17.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.015+0000 7f5329e00700 1 Processor -- start 2024-03-28T05:34:17.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.015+0000 7f5329e00700 1 -- start start 2024-03-28T05:34:17.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.015+0000 7f5329e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:17.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.015+0000 7f5329e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532410c040 con 0x7f5324101dc0 2024-03-28T05:34:17.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.016+0000 7f5322a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:17.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.016+0000 7f5322a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.159:40052/0 (socket says 172.21.15.159:40052) 2024-03-28T05:34:17.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.016+0000 7f5322a00700 1 -- 172.21.15.159:0/396583736 learned_addr learned my addr 172.21.15.159:0/396583736 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.017+0000 7f5322a00700 1 -- 172.21.15.159:0/396583736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532419fac0 con 0x7f5324101dc0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.017+0000 7f5322a00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53140056d0 tx=0x7f53140057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.017+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5314026070 con 0x7f5324101dc0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.018+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532419fdb0 con 0x7f5324101dc0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.018+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f531400bba0 con 0x7f5324101dc0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.018+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53140037f0 con 0x7f5324101dc0 2024-03-28T05:34:17.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.018+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324199820 con 0x7f5324101dc0 2024-03-28T05:34:17.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.019+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53241032a0 con 0x7f5324101dc0 2024-03-28T05:34:17.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.019+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f5314029070 con 0x7f5324101dc0 2024-03-28T05:34:17.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.020+0000 7f5328a00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 0x7f530803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:17.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.020+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f531401e070 con 0x7f5324101dc0 2024-03-28T05:34:17.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.021+0000 7f531be00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 0x7f530803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:17.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.022+0000 7f531be00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 0x7f530803b4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:17.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.035+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5314013070 con 0x7f5324101dc0 2024-03-28T05:34:17.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.343+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f532419ab80 con 0x7f5324101dc0 2024-03-28T05:34:17.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.344+0000 7f5328a00700 1 -- 172.21.15.159:0/396583736 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+745 (secure 0 0 0) 0x7f5314030020 con 0x7f5324101dc0 2024-03-28T05:34:17.344 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:34:17.345 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","modified":"2024-03-28T05:32:06.128648Z","created":"2024-03-28T05:32:06.128648Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-28T05:34:17.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 msgr2=0x7f530803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:17.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 0x7f530803b4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c006e40 comp rx=0 tx=0).stop 2024-03-28T05:34:17.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 msgr2=0x7f532419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:17.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53140056d0 tx=0x7f53140057b0 comp rx=0 tx=0).stop 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 shutdown_connections 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5308039020 0x7f530803b4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 --2- 172.21.15.159:0/396583736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5324101dc0 0x7f532419f580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 >> 172.21.15.159:0/396583736 conn(0x7f53240fd670 msgr2=0x7f53240743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 shutdown_connections 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:17.347+0000 7f5329e00700 1 -- 172.21.15.159:0/396583736 wait complete. 2024-03-28T05:34:17.348 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-03-28T05:34:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:17 smithi055 ceph-mon[31863]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:18 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/396583736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:19 smithi055 ceph-mon[31863]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:19.755 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-28T05:34:19.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-28T05:34:20.193 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:34:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:21 smithi055 ceph-mon[31863]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:21 smithi159 podman[36066]: 2024-03-28 05:34:21.656112871 +0000 UTC m=+0.411912957 container create 81b684f93473b2fa1e564d9a267e3b4574b07da58932d6da696616ed65a357a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319) 2024-03-28T05:34:22.168 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 podman[36066]: 2024-03-28 05:34:22.110826437 +0000 UTC m=+0.866626526 container init 81b684f93473b2fa1e564d9a267e3b4574b07da58932d6da696616ed65a357a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-28T05:34:22.168 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 podman[36066]: 2024-03-28 05:34:22.122454306 +0000 UTC m=+0.878254394 container start 81b684f93473b2fa1e564d9a267e3b4574b07da58932d6da696616ed65a357a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-03-28T05:34:22.480 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: set uid:gid to 167:167 (ceph:ceph) 2024-03-28T05:34:22.480 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev), process ceph-mon, pid 2 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pidfile_write: ignore empty --pid-file 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: load: jerasure load: lrc 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: RocksDB version: 7.9.2 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Git sha 0 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Compile date 2024-03-22 04:58:55 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: DB SUMMARY 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: DB Session ID: 6UZUMYOLUPKCEQ7OUDJF 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: CURRENT file: CURRENT 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: IDENTITY file: IDENTITY 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.error_if_exists: 0 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.create_if_missing: 0 2024-03-28T05:34:22.481 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.paranoid_checks: 1 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.env: 0x559a95907b20 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.fs: PosixFileSystem 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.info_log: 0x559a980ef960 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_file_opening_threads: 16 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.statistics: (nil) 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.use_fsync: 0 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_log_file_size: 0 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.keep_log_file_num: 1000 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.recycle_log_file_num: 0 2024-03-28T05:34:22.482 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_fallocate: 1 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_mmap_reads: 0 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_mmap_writes: 0 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.use_direct_reads: 0 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.create_missing_column_families: 0 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.db_log_dir: 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.wal_dir: 2024-03-28T05:34:22.483 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.advise_random_on_open: 1 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.db_write_buffer_size: 0 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.write_buffer_manager: 0x559a980c21e0 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-28T05:34:22.484 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.rate_limiter: (nil) 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.wal_recovery_mode: 2 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enable_thread_tracking: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enable_pipelined_write: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.unordered_write: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.row_cache: None 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.wal_filter: None 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_ingest_behind: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.two_write_queues: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.manual_wal_flush: 0 2024-03-28T05:34:22.485 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.wal_compression: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.atomic_flush: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.log_readahead_size: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.best_efforts_recovery: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.allow_data_in_errors: 0 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.db_host_id: __hostname__ 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_background_jobs: 2 2024-03-28T05:34:22.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_background_compactions: -1 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_subcompactions: 1 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_total_wal_size: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_open_files: -1 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bytes_per_sync: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_readahead_size: 0 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_background_flushes: -1 2024-03-28T05:34:22.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Compression algorithms supported: 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kZSTD supported: 0 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kXpressCompression supported: 0 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kLZ4HCCompression supported: 1 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kZlibCompression supported: 1 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kSnappyCompression supported: 1 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kLZ4Compression supported: 1 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: kBZip2Compression supported: 0 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.merge_operator: 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_filter: None 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_filter_factory: None 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.sst_partitioner_factory: None 2024-03-28T05:34:22.488 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559a980efa60) 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_type: 0 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_index_type: 0 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_shortening: 1 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: checksum: 4 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: no_block_cache: 0 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache: 0x559a980f5090 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_options: 2024-03-28T05:34:22.489 INFO:journalctl@ceph.mon.c.smithi159.stdout: capacity : 536870912 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_shard_bits : 4 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: strict_capacity_limit : 0 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_compressed: (nil) 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: persistent_cache: (nil) 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size: 4096 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size_deviation: 10 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_restart_interval: 16 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_block_restart_interval: 1 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: metadata_block_size: 4096 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: partition_filters: 0 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: use_delta_encoding: 1 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: filter_policy: bloomfilter 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: whole_key_filtering: 1 2024-03-28T05:34:22.490 INFO:journalctl@ceph.mon.c.smithi159.stdout: verify_compression: 0 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: format_version: 5 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_index_compression: 1 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_align: 0 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: max_auto_readahead_size: 262144 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: prepopulate_block_cache: 0 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: initial_auto_readahead_size: 8192 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.write_buffer_size: 33554432 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_write_buffer_number: 2 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression: NoCompression 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression: Disabled 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.prefix_extractor: nullptr 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.num_levels: 7 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-28T05:34:22.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-28T05:34:22.492 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.level: 32767 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.strategy: 0 2024-03-28T05:34:22.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.enabled: false 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.target_file_size_base: 67108864 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-28T05:34:22.494 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.arena_block_size: 1048576 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.disable_auto_compactions: 0 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-28T05:34:22.495 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.table_properties_collectors: 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.inplace_update_support: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.bloom_locality: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.max_successive_merges: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-28T05:34:22.496 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.paranoid_file_checks: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.force_consistency_checks: 1 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.report_bg_io_stats: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.ttl: 2592000 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enable_blob_files: false 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.min_blob_size: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_file_size: 268435456 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.blob_file_starting_level: 0 2024-03-28T05:34:22.497 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 988994eb-de75-4397-bc1f-7cab600d20ad 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604062181033, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604062182249, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711604062, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "988994eb-de75-4397-bc1f-7cab600d20ad", "db_session_id": "6UZUMYOLUPKCEQ7OUDJF", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604062182577, "job": 1, "event": "recovery_finished"} 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559a981e8000 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: DB pointer 0x559a981d2000 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-28T05:34:22.498 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** DB Stats ** 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-03-28T05:34:22.499 INFO:journalctl@ceph.mon.c.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache BinnedLRUCache@0x559a980f5090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-28T05:34:22.500 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: using public_addr v2:172.21.15.159:0/0 -> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: starting mon.c rank -1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(???) e0 preinit fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).mds e1 new map 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: e1 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: legacy client fscid: -1 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout: No filesystems configured 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-28T05:34:22.501 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Added host smithi086 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.502 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Deploying cephadm binary to smithi159 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Added host smithi159 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:22.505 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Saving service mon spec with placement smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c;count:3 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: Deploying daemon mon.c on smithi159 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/396583736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:22.506 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 ceph-mon[36109]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-28T05:34:22.507 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 bash[36066]: 81b684f93473b2fa1e564d9a267e3b4574b07da58932d6da696616ed65a357a5 2024-03-28T05:34:22.507 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:22 smithi159 systemd[1]: Started Ceph mon.c for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: mon.a calling monitor election 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: mon.c calling monitor election 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: monmap e2: 2 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: fsmap 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: mgrmap e13: x(active, since 69s) 2024-03-28T05:34:27.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: overall HEALTH_OK 2024-03-28T05:34:27.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:27.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: mon.a calling monitor election 2024-03-28T05:34:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: mon.c calling monitor election 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: monmap e2: 2 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: fsmap 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: mgrmap e13: x(active, since 69s) 2024-03-28T05:34:27.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: overall HEALTH_OK 2024-03-28T05:34:27.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:27.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:28.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 -- 172.21.15.159:0/4104351452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 msgr2=0x7ff86c0080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:28.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 --2- 172.21.15.159:0/4104351452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff86c0080c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff888102f30 tx=0x7ff87800ff20 comp rx=0 tx=0).stop 2024-03-28T05:34:28.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 -- 172.21.15.159:0/4104351452 shutdown_connections 2024-03-28T05:34:28.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 --2- 172.21.15.159:0/4104351452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff86c0080c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 -- 172.21.15.159:0/4104351452 >> 172.21.15.159:0/4104351452 conn(0x7ff8880fd5d0 msgr2=0x7ff8880ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:28.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.401+0000 7ff887200700 1 -- 172.21.15.159:0/4104351452 shutdown_connections 2024-03-28T05:34:28.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.402+0000 7ff887200700 1 -- 172.21.15.159:0/4104351452 wait complete. 2024-03-28T05:34:28.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.404+0000 7ff887200700 1 Processor -- start 2024-03-28T05:34:28.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.404+0000 7ff887200700 1 -- start start 2024-03-28T05:34:28.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.405+0000 7ff887200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:28.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.405+0000 7ff887200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:28.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.405+0000 7ff887200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881099d0 con 0x7ff86c005c90 2024-03-28T05:34:28.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.405+0000 7ff887200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888109850 con 0x7ff888197b70 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.159:47206/0 (socket says 172.21.15.159:47206) 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 -- 172.21.15.159:0/2722346048 learned_addr learned my addr 172.21.15.159:0/2722346048 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885400700 1 -- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 msgr2=0x7ff88819bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885400700 1 -- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 msgr2=0x7ff88819bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-28T05:34:28.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885400700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:34:28.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885400700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:34:28.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 -- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 msgr2=0x7ff88819bf00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:34:28.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.406+0000 7ff885e00700 1 -- 172.21.15.159:0/2722346048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8881981b0 con 0x7ff86c005c90 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.407+0000 7ff885e00700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff878004900 tx=0x7ff8780049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.408+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff878004020 con 0x7ff86c005c90 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.408+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff878003680 con 0x7ff86c005c90 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.408+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff878027620 con 0x7ff86c005c90 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.408+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88819c440 con 0x7ff86c005c90 2024-03-28T05:34:28.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.408+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88819c9a0 con 0x7ff86c005c90 2024-03-28T05:34:28.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.410+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8881031e0 con 0x7ff86c005c90 2024-03-28T05:34:28.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.410+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7ff878024040 con 0x7ff86c005c90 2024-03-28T05:34:28.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.411+0000 7ff87ea00700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 0x7ff86803b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:28.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.411+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff878022020 con 0x7ff86c005c90 2024-03-28T05:34:28.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.411+0000 7ff885400700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 0x7ff86803b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:28.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.413+0000 7ff885400700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 0x7ff86803b290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff874009850 tx=0x7ff874008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:28.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.426+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7ff87802b030 con 0x7ff86c005c90 2024-03-28T05:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:28 smithi055 ceph-mon[31863]: Deploying daemon mon.b on smithi086 2024-03-28T05:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:28.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.751+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff88819cc50 con 0x7ff86c005c90 2024-03-28T05:34:28.752 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:28.752 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:28.752 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:28.752 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:28 smithi159 ceph-mon[36109]: Deploying daemon mon.b on smithi086 2024-03-28T05:34:28.752 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:28.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.753+0000 7ff87ea00700 1 -- 172.21.15.159:0/2722346048 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1015 (secure 0 0 0) 0x7ff87802c2b0 con 0x7ff86c005c90 2024-03-28T05:34:28.753 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:34:28.753 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","modified":"2024-03-28T05:34:22.231867Z","created":"2024-03-28T05:32:06.128648Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-28T05:34:28.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 msgr2=0x7ff86803b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:28.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 0x7ff86803b290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff874009850 tx=0x7ff874008040 comp rx=0 tx=0).stop 2024-03-28T05:34:28.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 msgr2=0x7ff888197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:28.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff878004900 tx=0x7ff8780049e0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 shutdown_connections 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff868038dd0 0x7ff86803b290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff86c005c90 0x7ff888197630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 --2- 172.21.15.159:0/2722346048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff888197b70 0x7ff88819bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 >> 172.21.15.159:0/2722346048 conn(0x7ff8880fd5d0 msgr2=0x7ff888106de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 shutdown_connections 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:28.756+0000 7ff887200700 1 -- 172.21.15.159:0/2722346048 wait complete. 2024-03-28T05:34:28.757 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-03-28T05:34:29.507 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:29 smithi159 ceph-mon[36109]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:29.507 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:29 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/2722346048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:29 smithi055 ceph-mon[31863]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:29 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/2722346048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:30.566 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-28T05:34:30.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-28T05:34:31.004 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:34:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:31 smithi055 ceph-mon[31863]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:31 smithi159 ceph-mon[36109]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:32.771 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 podman[35144]: 2024-03-28 05:34:32.524560604 +0000 UTC m=+0.136821105 container create 1fd6574df6a58ac1eac9a86082518e773ee6142c7813d6c03c01bd7dccf7347a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-b, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319) 2024-03-28T05:34:32.771 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 podman[35144]: 2024-03-28 05:34:32.769314742 +0000 UTC m=+0.381575283 container init 1fd6574df6a58ac1eac9a86082518e773ee6142c7813d6c03c01bd7dccf7347a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, ceph=True) 2024-03-28T05:34:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 podman[35144]: 2024-03-28 05:34:32.779360612 +0000 UTC m=+0.391621079 container start 1fd6574df6a58ac1eac9a86082518e773ee6142c7813d6c03c01bd7dccf7347a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: set uid:gid to 167:167 (ceph:ceph) 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev), process ceph-mon, pid 2 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pidfile_write: ignore empty --pid-file 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: load: jerasure load: lrc 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: RocksDB version: 7.9.2 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Git sha 0 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Compile date 2024-03-22 04:58:55 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: DB SUMMARY 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: DB Session ID: 0KYI4QYNO38XLYUU8S4G 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: CURRENT file: CURRENT 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: IDENTITY file: IDENTITY 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-28T05:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.error_if_exists: 0 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.create_if_missing: 0 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.paranoid_checks: 1 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.env: 0x55f003da3b20 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.fs: PosixFileSystem 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.info_log: 0x55f005bbf960 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_file_opening_threads: 16 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.statistics: (nil) 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.use_fsync: 0 2024-03-28T05:34:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_log_file_size: 0 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.keep_log_file_num: 1000 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.recycle_log_file_num: 0 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_fallocate: 1 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_mmap_reads: 0 2024-03-28T05:34:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_mmap_writes: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.use_direct_reads: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.create_missing_column_families: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.db_log_dir: 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.wal_dir: 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.advise_random_on_open: 1 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.db_write_buffer_size: 0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.write_buffer_manager: 0x55f005b921e0 2024-03-28T05:34:33.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.rate_limiter: (nil) 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.wal_recovery_mode: 2 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enable_thread_tracking: 0 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enable_pipelined_write: 0 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.unordered_write: 0 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.row_cache: None 2024-03-28T05:34:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.wal_filter: None 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_ingest_behind: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.two_write_queues: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.manual_wal_flush: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.wal_compression: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.atomic_flush: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.log_readahead_size: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.best_efforts_recovery: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.allow_data_in_errors: 0 2024-03-28T05:34:33.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.db_host_id: __hostname__ 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_background_jobs: 2 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_background_compactions: -1 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_subcompactions: 1 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_total_wal_size: 0 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_open_files: -1 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bytes_per_sync: 0 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-28T05:34:33.076 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_readahead_size: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_background_flushes: -1 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Compression algorithms supported: 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kZSTD supported: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kXpressCompression supported: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kLZ4HCCompression supported: 1 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kZlibCompression supported: 1 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kSnappyCompression supported: 1 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kLZ4Compression supported: 1 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: kBZip2Compression supported: 0 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-28T05:34:33.077 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-28T05:34:33.078 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.merge_operator: 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_filter: None 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_filter_factory: None 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.sst_partitioner_factory: None 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f005bbfa60) 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout: cache_index_and_filter_blocks: 1 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-28T05:34:33.081 INFO:journalctl@ceph.mon.b.smithi086.stdout: pin_top_level_index_and_filter: 1 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: index_type: 0 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: data_block_index_type: 0 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: index_shortening: 1 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: checksum: 4 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: no_block_cache: 0 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_cache: 0x55f005bc5090 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_cache_name: BinnedLRUCache 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_cache_options: 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: capacity : 536870912 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: num_shard_bits : 4 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: strict_capacity_limit : 0 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: high_pri_pool_ratio: 0.000 2024-03-28T05:34:33.082 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_cache_compressed: (nil) 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: persistent_cache: (nil) 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_size: 4096 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_size_deviation: 10 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_restart_interval: 16 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: index_block_restart_interval: 1 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: metadata_block_size: 4096 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: partition_filters: 0 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: use_delta_encoding: 1 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: filter_policy: bloomfilter 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: whole_key_filtering: 1 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: verify_compression: 0 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: read_amp_bytes_per_bit: 0 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: format_version: 5 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: enable_index_compression: 1 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: block_align: 0 2024-03-28T05:34:33.083 INFO:journalctl@ceph.mon.b.smithi086.stdout: max_auto_readahead_size: 262144 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout: prepopulate_block_cache: 0 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout: initial_auto_readahead_size: 8192 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout: num_file_reads_for_auto_readahead: 2 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.write_buffer_size: 33554432 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_write_buffer_number: 2 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression: NoCompression 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression: Disabled 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.prefix_extractor: nullptr 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.num_levels: 7 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-28T05:34:33.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.level: 32767 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.strategy: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-28T05:34:33.085 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.enabled: false 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.target_file_size_base: 67108864 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-28T05:34:33.086 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.arena_block_size: 1048576 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.disable_auto_compactions: 0 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-28T05:34:33.087 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.table_properties_collectors: 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.inplace_update_support: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.bloom_locality: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.max_successive_merges: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.paranoid_file_checks: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.force_consistency_checks: 1 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.report_bg_io_stats: 0 2024-03-28T05:34:33.088 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.ttl: 2592000 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enable_blob_files: false 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.min_blob_size: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_file_size: 268435456 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.blob_file_starting_level: 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-28T05:34:33.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 774594f5-523c-4c9d-823c-9c6401cc2d8b 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604072837193, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604072838108, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711604072, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "774594f5-523c-4c9d-823c-9c6401cc2d8b", "db_session_id": "0KYI4QYNO38XLYUU8S4G", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711604072838360, "job": 1, "event": "recovery_finished"} 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f005cb8000 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: DB pointer 0x55f005ca2000 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout: ** DB Stats ** 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:34:33.090 INFO:journalctl@ceph.mon.b.smithi086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: ** Compaction Stats [default] ** 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:33.091 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: ** Compaction Stats [default] ** 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-28T05:34:33.092 INFO:journalctl@ceph.mon.b.smithi086.stdout: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: Block cache BinnedLRUCache@0x55f005bc5090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: using public_addr v2:172.21.15.86:0/0 -> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: starting mon.b rank -1 at public addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] at bind addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(???) e0 preinit fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).mds e1 new map 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).mds e1 print_map 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: e1 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: legacy client fscid: -1 2024-03-28T05:34:33.093 INFO:journalctl@ceph.mon.b.smithi086.stdout: 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout: No filesystems configured 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Added host smithi086 2024-03-28T05:34:33.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Deploying cephadm binary to smithi159 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:34:33.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Added host smithi159 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.096 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2052833515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.097 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:33.098 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Saving service mon spec with placement smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c;count:3 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Deploying daemon mon.c on smithi159 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/396583736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.a calling monitor election 2024-03-28T05:34:33.099 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.c calling monitor election 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: monmap e2: 2 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: fsmap 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mgrmap e13: x(active, since 69s) 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: overall HEALTH_OK 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.100 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: Deploying daemon mon.b on smithi086 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/2722346048' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 ceph-mon[35163]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 bash[35144]: 1fd6574df6a58ac1eac9a86082518e773ee6142c7813d6c03c01bd7dccf7347a 2024-03-28T05:34:33.101 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:32 smithi086 systemd[1]: Started Ceph mon.b for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:34:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: mon.a calling monitor election 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: mon.c calling monitor election 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: mon.b calling monitor election 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-28T05:34:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: monmap e3: 3 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],b=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:37 smithi086 ceph-mon[35163]: fsmap 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:38 smithi086 ceph-mon[35163]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:38 smithi086 ceph-mon[35163]: mgrmap e13: x(active, since 80s) 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:38 smithi086 ceph-mon[35163]: overall HEALTH_OK 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: mon.a calling monitor election 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: mon.c calling monitor election 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: mon.b calling monitor election 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: monmap e3: 3 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],b=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: fsmap 2024-03-28T05:34:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:37 smithi159 ceph-mon[36109]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:38 smithi159 ceph-mon[36109]: mgrmap e13: x(active, since 80s) 2024-03-28T05:34:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:38 smithi159 ceph-mon[36109]: overall HEALTH_OK 2024-03-28T05:34:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: mon.a calling monitor election 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: mon.c calling monitor election 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: mon.b calling monitor election 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:37 smithi055 ceph-mon[31863]: monmap e3: 3 mons at {a=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],b=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0],c=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: fsmap 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: osdmap e4: 0 total, 0 up, 0 in 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: mgrmap e13: x(active, since 80s) 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: overall HEALTH_OK 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:38.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.949+0000 7efcd2200700 1 -- 172.21.15.159:0/66406430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb0005c90 msgr2=0x7efcb0008120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.949+0000 7efcd2200700 1 --2- 172.21.15.159:0/66406430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb0005c90 0x7efcb0008120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efccc103120 tx=0x7efcbc00ff20 comp rx=0 tx=0).stop 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.949+0000 7efcd2200700 1 -- 172.21.15.159:0/66406430 shutdown_connections 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.949+0000 7efcd2200700 1 --2- 172.21.15.159:0/66406430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb0005c90 0x7efcb0008120 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.949+0000 7efcd2200700 1 -- 172.21.15.159:0/66406430 >> 172.21.15.159:0/66406430 conn(0x7efccc0fd720 msgr2=0x7efccc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.950+0000 7efcd2200700 1 -- 172.21.15.159:0/66406430 shutdown_connections 2024-03-28T05:34:38.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.950+0000 7efcd2200700 1 -- 172.21.15.159:0/66406430 wait complete. 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.951+0000 7efcd2200700 1 Processor -- start 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.951+0000 7efcd2200700 1 -- start start 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcb0005c90 0x7efccc199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc109bb0 con 0x7efccc19e9c0 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc109a30 con 0x7efccc19a0c0 2024-03-28T05:34:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.952+0000 7efcd2200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc109d30 con 0x7efcb0005c90 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.159:60842/0 (socket says 172.21.15.159:60842) 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 -- 172.21.15.159:0/2390369929 learned_addr learned my addr 172.21.15.159:0/2390369929 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccaa00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccb400700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcb0005c90 0x7efccc199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccaa00700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 msgr2=0x7efccc19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-28T05:34:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccaa00700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 msgr2=0x7efccc19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccaa00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccaa00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcb0005c90 msgr2=0x7efccc199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcb0005c90 0x7efccc199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 msgr2=0x7efccc19e480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.953+0000 7efccbe00700 1 -- 172.21.15.159:0/2390369929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc1a6730 con 0x7efccc19e9c0 2024-03-28T05:34:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.954+0000 7efccbe00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efcc400ba50 tx=0x7efcc400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.954+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4019070 con 0x7efccc19e9c0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.954+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7efcc4014440 con 0x7efccc19e9c0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.954+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc1a6900 con 0x7efccc19e9c0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.955+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400ce60 con 0x7efccc19e9c0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.955+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc1a6df0 con 0x7efccc19e9c0 2024-03-28T05:34:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.956+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc0637c0 con 0x7efccc19e9c0 2024-03-28T05:34:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.956+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7efcc401c070 con 0x7efccc19e9c0 2024-03-28T05:34:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.957+0000 7efcc3e00700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 0x7efcac03b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.957+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efcc404b6e0 con 0x7efccc19e9c0 2024-03-28T05:34:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.957+0000 7efccb400700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 0x7efcac03b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:38.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.958+0000 7efccb400700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 0x7efcac03b910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcbc005950 tx=0x7efcbc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:38.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:38.972+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7efcc401b2c0 con 0x7efccc19e9c0 2024-03-28T05:34:39.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.298+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efccc02da30 con 0x7efccc19e9c0 2024-03-28T05:34:39.298 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:39 smithi159 ceph-mon[36109]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:39.299 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.299 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.299 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:39.299 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:39.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.299+0000 7efcc3e00700 1 -- 172.21.15.159:0/2390369929 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1281 (secure 0 0 0) 0x7efcc4014980 con 0x7efccc19e9c0 2024-03-28T05:34:39.299 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-28T05:34:39.300 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":3,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","modified":"2024-03-28T05:34:32.907399Z","created":"2024-03-28T05:32:06.128648Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 msgr2=0x7efcac03b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 0x7efcac03b910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efcbc005950 tx=0x7efcbc0058e0 comp rx=0 tx=0).stop 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 msgr2=0x7efccc19ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efcc400ba50 tx=0x7efcc400bd60 comp rx=0 tx=0).stop 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 shutdown_connections 2024-03-28T05:34:39.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7efcac039450 0x7efcac03b910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efccc19e9c0 0x7efccc19ee40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efcb0005c90 0x7efccc199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 --2- 172.21.15.159:0/2390369929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efccc19a0c0 0x7efccc19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.301+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 >> 172.21.15.159:0/2390369929 conn(0x7efccc0fd720 msgr2=0x7efccc0fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.302+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 shutdown_connections 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:39.302+0000 7efcd2200700 1 -- 172.21.15.159:0/2390369929 wait complete. 2024-03-28T05:34:39.303 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 3 2024-03-28T05:34:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:39 smithi086 ceph-mon[35163]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:39 smithi055 ceph-mon[31863]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:34:40.041 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-28T05:34:40.042 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph config generate-minimal-conf 2024-03-28T05:34:40.245 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:40 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/2390369929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:40 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/2390369929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:40 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/2390369929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-28T05:34:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:34:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 -- 172.21.15.55:0/1608041189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96400766c0 msgr2=0x7f9640076aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 --2- 172.21.15.55:0/1608041189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96400766c0 0x7f9640076aa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9630009910 tx=0x7f9630009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 -- 172.21.15.55:0/1608041189 shutdown_connections 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 --2- 172.21.15.55:0/1608041189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96400766c0 0x7f9640076aa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 -- 172.21.15.55:0/1608041189 >> 172.21.15.55:0/1608041189 conn(0x7f96400ff8a0 msgr2=0x7f9640101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 -- 172.21.15.55:0/1608041189 shutdown_connections 2024-03-28T05:34:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.495+0000 7f9647600700 1 -- 172.21.15.55:0/1608041189 wait complete. 2024-03-28T05:34:42.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 Processor -- start 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 -- start start 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400766c0 0x7f964019de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96401126d0 con 0x7f964019e370 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640112550 con 0x7f96401a2c40 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.497+0000 7f9647600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640112850 con 0x7f96400766c0 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41736/0 (socket says 172.21.15.55:41736) 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 -- 172.21.15.55:0/394272401 learned_addr learned my addr 172.21.15.55:0/394272401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9644c00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400766c0 0x7f964019de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:42.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9645600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9645600700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 msgr2=0x7f96401a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-28T05:34:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9645600700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 msgr2=0x7f96401a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-28T05:34:42.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9645600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9645600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400766c0 msgr2=0x7f964019de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400766c0 0x7f964019de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 msgr2=0x7f96401a30f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.498+0000 7f9637e00700 1 -- 172.21.15.55:0/394272401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96401aa9b0 con 0x7f964019e370 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f9637e00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f962800b780 tx=0x7f962800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628004230 con 0x7f964019e370 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96401aabe0 con 0x7f964019e370 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f96280043d0 con 0x7f964019e370 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011b60 con 0x7f964019e370 2024-03-28T05:34:42.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.499+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96401ab120 con 0x7f964019e370 2024-03-28T05:34:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.500+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f9628011d00 con 0x7f964019e370 2024-03-28T05:34:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.500+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96400637c0 con 0x7f964019e370 2024-03-28T05:34:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.501+0000 7f963e000700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 0x7f962403b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.501+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f962804bee0 con 0x7f964019e370 2024-03-28T05:34:42.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.501+0000 7f9644c00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 0x7f962403b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:42.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.502+0000 7f9644c00700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 0x7f962403b910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9630006010 tx=0x7f963001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:42.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.507+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9628020500 con 0x7f964019e370 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi055:/etc/ceph/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi055:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi055:/etc/ceph/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi055:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi055:/etc/ceph/ceph.conf 2024-03-28T05:34:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi086:/etc/ceph/ceph.conf 2024-03-28T05:34:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi159:/etc/ceph/ceph.conf 2024-03-28T05:34:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi055:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi159:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: Updating smithi086:/var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-28T05:34:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.804+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f96401ab440 con 0x7f964019e370 2024-03-28T05:34:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.805+0000 7f963e000700 1 -- 172.21.15.55:0/394272401 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f962804d030 con 0x7f964019e370 2024-03-28T05:34:42.805 INFO:teuthology.orchestra.run.smithi055.stdout:# minimal ceph.conf for 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:42.805 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-03-28T05:34:42.805 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:34:42.805 INFO:teuthology.orchestra.run.smithi055.stdout: mon_host = [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.807+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 msgr2=0x7f962403b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.807+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 0x7f962403b910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9630006010 tx=0x7f963001a040 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.807+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 msgr2=0x7f96401a2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.807+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f962800b780 tx=0x7f962800ba90 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 shutdown_connections 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9624039450 0x7f962403b910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96401a2c40 0x7f96401a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96400766c0 0x7f964019de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 --2- 172.21.15.55:0/394272401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964019e370 0x7f96401a2700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 >> 172.21.15.55:0/394272401 conn(0x7f96400ff8a0 msgr2=0x7f96400ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 shutdown_connections 2024-03-28T05:34:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:42.808+0000 7f9647600700 1 -- 172.21.15.55:0/394272401 wait complete. 2024-03-28T05:34:43.476 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:43.476 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.476 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:43.477 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.478 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:43 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/394272401' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.533 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-28T05:34:43.533 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:34:43.534 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.conf 2024-03-28T05:34:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:43 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/394272401' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:43 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/394272401' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:43.612 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:34:43.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:43.733 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:34:43.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-03-28T05:34:43.837 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:34:43.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:43.975 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:34:43.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-03-28T05:34:44.081 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:34:44.081 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-28T05:34:44.219 INFO:tasks.cephadm:Adding mgr.x on smithi055 2024-03-28T05:34:44.219 INFO:tasks.cephadm:Adding mgr.y on smithi086 2024-03-28T05:34:44.219 INFO:tasks.cephadm:Adding mgr.z on smithi159 2024-03-28T05:34:44.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch apply mgr '3;smithi055=x;smithi086=y;smithi159=z' 2024-03-28T05:34:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:44 smithi159 ceph-mon[36109]: Reconfiguring mon.a (unknown last config time)... 2024-03-28T05:34:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:44 smithi159 ceph-mon[36109]: Reconfiguring daemon mon.a on smithi055 2024-03-28T05:34:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:44 smithi055 ceph-mon[31863]: Reconfiguring mon.a (unknown last config time)... 2024-03-28T05:34:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:44 smithi055 ceph-mon[31863]: Reconfiguring daemon mon.a on smithi055 2024-03-28T05:34:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:44 smithi086 ceph-mon[35163]: Reconfiguring mon.a (unknown last config time)... 2024-03-28T05:34:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:44 smithi086 ceph-mon[35163]: Reconfiguring daemon mon.a on smithi055 2024-03-28T05:34:44.694 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:46.400 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:46 smithi159 ceph-mon[36109]: Reconfiguring mon.b (monmap changed)... 2024-03-28T05:34:46.400 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:46 smithi159 ceph-mon[36109]: Reconfiguring daemon mon.b on smithi086 2024-03-28T05:34:46.542 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:46 smithi086 ceph-mon[35163]: Reconfiguring mon.b (monmap changed)... 2024-03-28T05:34:46.542 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:46 smithi086 ceph-mon[35163]: Reconfiguring daemon mon.b on smithi086 2024-03-28T05:34:46.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 -- 172.21.15.159:0/3925550220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 msgr2=0x7f994c100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:46.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 --2- 172.21.15.159:0/3925550220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c100fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f993c009910 tx=0x7f993c009c20 comp rx=0 tx=0).stop 2024-03-28T05:34:46.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 -- 172.21.15.159:0/3925550220 shutdown_connections 2024-03-28T05:34:46.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 --2- 172.21.15.159:0/3925550220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c100fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 -- 172.21.15.159:0/3925550220 >> 172.21.15.159:0/3925550220 conn(0x7f994c0fc170 msgr2=0x7f994c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:46.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 -- 172.21.15.159:0/3925550220 shutdown_connections 2024-03-28T05:34:46.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.569+0000 7f9951000700 1 -- 172.21.15.159:0/3925550220 wait complete. 2024-03-28T05:34:46.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.570+0000 7f9951000700 1 Processor -- start 2024-03-28T05:34:46.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.570+0000 7f9951000700 1 -- start start 2024-03-28T05:34:46.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994c199b90 0x7f994c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c106af0 con 0x7f994c100bb0 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c106970 con 0x7f994c199b90 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9951000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c106c70 con 0x7f994c19a010 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f994a800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f994a800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42958/0 (socket says 172.21.15.159:42958) 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f994a800700 1 -- 172.21.15.159:0/3240698008 learned_addr learned my addr 172.21.15.159:0/3240698008 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.571+0000 7f9949e00700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f9949400700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994c199b90 0x7f994c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:46.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 -- 172.21.15.159:0/3240698008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994c199b90 msgr2=0x7f994c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994c199b90 0x7f994c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 -- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 msgr2=0x7f994c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 -- 172.21.15.159:0/3240698008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c1a1a10 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.572+0000 7f994a800700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f994400ba50 tx=0x7f994400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.573+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944019070 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.573+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f994400cde0 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.573+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944007350 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.573+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c1a1d00 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.573+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c1a2210 con 0x7f994c19a010 2024-03-28T05:34:46.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.574+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c1a24a0 con 0x7f994c19a010 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.575+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f994401c070 con 0x7f994c19a010 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.575+0000 7f9942a00700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 0x7f993003b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.575+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f994404bd80 con 0x7f994c19a010 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.576+0000 7f9949e00700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 0x7f993003b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.577+0000 7f9949e00700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 0x7f993003b910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f993c005190 tx=0x7f993c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.581+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9944023070 con 0x7f994c19a010 2024-03-28T05:34:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:46 smithi055 ceph-mon[31863]: Reconfiguring mon.b (monmap changed)... 2024-03-28T05:34:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:46 smithi055 ceph-mon[31863]: Reconfiguring daemon mon.b on smithi086 2024-03-28T05:34:46.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.817+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi055=x;smithi086=y;smithi159=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f994c06a1f0 con 0x7f9930039450 2024-03-28T05:34:46.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.832+0000 7f9942a00700 1 -- 172.21.15.159:0/3240698008 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f994c06a1f0 con 0x7f9930039450 2024-03-28T05:34:46.833 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mgr update... 2024-03-28T05:34:46.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.834+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 msgr2=0x7f993003b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:46.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.834+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 0x7f993003b910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f993c005190 tx=0x7f993c01a040 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 msgr2=0x7f994c1a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f994400ba50 tx=0x7f994400bd60 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 shutdown_connections 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9930039450 0x7f993003b910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f994c100bb0 0x7f994c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f994c19a010 0x7f994c1a1140 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 --2- 172.21.15.159:0/3240698008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f994c199b90 0x7f994c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 >> 172.21.15.159:0/3240698008 conn(0x7f994c0fc170 msgr2=0x7f994c069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 shutdown_connections 2024-03-28T05:34:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:34:46.835+0000 7f9951000700 1 -- 172.21.15.159:0/3240698008 wait complete. 2024-03-28T05:34:47.535 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:47.535 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.535 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:47.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:47.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:47.579 DEBUG:teuthology.orchestra.run.smithi086:mgr.y> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.y.service 2024-03-28T05:34:47.588 DEBUG:teuthology.orchestra.run.smithi159:mgr.z> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mgr.z.service 2024-03-28T05:34:47.595 INFO:tasks.cephadm:Deploying OSDs... 2024-03-28T05:34:47.595 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:34:47.595 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T05:34:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-28T05:34:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-28T05:34:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:47.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T05:34:47.656 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-03-28 05:33:30.487591901 +0000 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-03-28 05:28:16.141545919 +0000 2024-03-28T05:34:47.756 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-03-28 05:28:16.141545919 +0000 2024-03-28T05:34:47.757 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-03-28 05:28:16.141545919 +0000 2024-03-28T05:34:47.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T05:34:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-03-28T05:34:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-03-28T05:34:47.854 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000518848 s, 987 kB/s 2024-03-28T05:34:47.860 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T05:34:47.921 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 650 Links: 1 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-03-28 05:33:30.577590152 +0000 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-03-28 05:28:16.836532148 +0000 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-03-28 05:28:16.836532148 +0000 2024-03-28T05:34:47.977 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-03-28 05:28:16.836532148 +0000 2024-03-28T05:34:47.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T05:34:48.074 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-03-28T05:34:48.075 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-03-28T05:34:48.075 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000416394 s, 1.2 MB/s 2024-03-28T05:34:48.079 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T05:34:48.137 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-03-28 05:33:30.642588888 +0000 2024-03-28T05:34:48.185 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-03-28 05:28:17.431520358 +0000 2024-03-28T05:34:48.186 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-03-28 05:28:17.431520358 +0000 2024-03-28T05:34:48.186 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-03-28 05:28:17.431520358 +0000 2024-03-28T05:34:48.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T05:34:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-03-28T05:34:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-03-28T05:34:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000428032 s, 1.2 MB/s 2024-03-28T05:34:48.282 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T05:34:48.345 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-03-28T05:34:48.397 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-03-28 05:33:30.717587430 +0000 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-03-28 05:28:18.015508786 +0000 2024-03-28T05:34:48.398 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-03-28 05:28:18.015508786 +0000 2024-03-28T05:34:48.399 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-03-28 05:28:18.015508786 +0000 2024-03-28T05:34:48.399 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T05:34:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-03-28T05:34:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-03-28T05:34:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000516131 s, 992 kB/s 2024-03-28T05:34:48.500 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T05:34:48.559 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-03-28T05:34:48.559 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T05:34:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:48 smithi159 ceph-mon[36109]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi055=x;smithi086=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:48 smithi159 ceph-mon[36109]: Saving service mgr spec with placement smithi055=x;smithi086=y;smithi159=z;count:3 2024-03-28T05:34:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:48 smithi159 ceph-mon[36109]: Reconfiguring mon.c (monmap changed)... 2024-03-28T05:34:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:48 smithi159 ceph-mon[36109]: Reconfiguring daemon mon.c on smithi159 2024-03-28T05:34:48.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T05:34:48.618 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-03-28T05:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:48 smithi055 ceph-mon[31863]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi055=x;smithi086=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:48 smithi055 ceph-mon[31863]: Saving service mgr spec with placement smithi055=x;smithi086=y;smithi159=z;count:3 2024-03-28T05:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:48 smithi055 ceph-mon[31863]: Reconfiguring mon.c (monmap changed)... 2024-03-28T05:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:48 smithi055 ceph-mon[31863]: Reconfiguring daemon mon.c on smithi159 2024-03-28T05:34:48.671 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T05:34:48.671 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:48.671 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 639 Links: 1 2024-03-28T05:34:48.671 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:48.671 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:48.672 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-03-28 05:34:32.007747295 +0000 2024-03-28T05:34:48.672 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-03-28 05:28:06.149663261 +0000 2024-03-28T05:34:48.672 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-03-28 05:28:06.149663261 +0000 2024-03-28T05:34:48.672 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-03-28 05:28:06.149663261 +0000 2024-03-28T05:34:48.672 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T05:34:48.748 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:48 smithi086 ceph-mon[35163]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi055=x;smithi086=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:48.748 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:48 smithi086 ceph-mon[35163]: Saving service mgr spec with placement smithi055=x;smithi086=y;smithi159=z;count:3 2024-03-28T05:34:48.748 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:48 smithi086 ceph-mon[35163]: Reconfiguring mon.c (monmap changed)... 2024-03-28T05:34:48.748 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:48 smithi086 ceph-mon[35163]: Reconfiguring daemon mon.c on smithi159 2024-03-28T05:34:48.758 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-03-28T05:34:48.758 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-03-28T05:34:48.758 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000471434 s, 1.1 MB/s 2024-03-28T05:34:48.762 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T05:34:48.815 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-03-28T05:34:48.862 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-03-28 05:34:32.008747272 +0000 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-03-28 05:28:06.698650590 +0000 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-03-28 05:28:06.698650590 +0000 2024-03-28T05:34:48.863 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-03-28 05:28:06.698650590 +0000 2024-03-28T05:34:48.864 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T05:34:48.998 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-03-28T05:34:48.998 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-03-28T05:34:48.998 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000406884 s, 1.3 MB/s 2024-03-28T05:34:49.005 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T05:34:49.064 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 679 Links: 1 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:49.114 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-03-28 05:34:32.008747272 +0000 2024-03-28T05:34:49.115 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-03-28 05:28:07.298636741 +0000 2024-03-28T05:34:49.115 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-03-28 05:28:07.298636741 +0000 2024-03-28T05:34:49.115 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-03-28 05:28:07.298636741 +0000 2024-03-28T05:34:49.115 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T05:34:49.199 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-03-28T05:34:49.199 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-03-28T05:34:49.199 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000308923 s, 1.7 MB/s 2024-03-28T05:34:49.203 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T05:34:49.255 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 696 Links: 1 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:49.303 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-03-28 05:34:32.009747249 +0000 2024-03-28T05:34:49.304 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-03-28 05:28:07.865623654 +0000 2024-03-28T05:34:49.304 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-03-28 05:28:07.865623654 +0000 2024-03-28T05:34:49.304 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-03-28 05:28:07.865623654 +0000 2024-03-28T05:34:49.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T05:34:49.434 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-03-28T05:34:49.434 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-03-28T05:34:49.434 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000313828 s, 1.6 MB/s 2024-03-28T05:34:49.438 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T05:34:49.494 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-28T05:34:49.495 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T05:34:49.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T05:34:49.549 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:49.597 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-28 05:34:20.441448438 +0000 2024-03-28T05:34:49.598 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-28 05:28:06.455382419 +0000 2024-03-28T05:34:49.598 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-28 05:28:06.456382401 +0000 2024-03-28T05:34:49.598 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-28 05:28:06.455382419 +0000 2024-03-28T05:34:49.598 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T05:34:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.719 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:49.719 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.719 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.719 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:49.720 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.729 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-28T05:34:49.729 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-28T05:34:49.729 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000365069 s, 1.4 MB/s 2024-03-28T05:34:49.733 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T05:34:49.784 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-03-28T05:34:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-28 05:34:20.442448419 +0000 2024-03-28T05:34:49.823 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-28 05:28:07.053371065 +0000 2024-03-28T05:34:49.824 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-28 05:28:07.053371065 +0000 2024-03-28T05:34:49.824 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-28 05:28:07.053371065 +0000 2024-03-28T05:34:49.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T05:34:49.936 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-28T05:34:49.936 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-28T05:34:49.937 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000290559 s, 1.8 MB/s 2024-03-28T05:34:49.939 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T05:34:49.980 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-28 05:34:20.442448419 +0000 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-28 05:28:07.617360356 +0000 2024-03-28T05:34:50.071 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-28 05:28:07.617360356 +0000 2024-03-28T05:34:50.072 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-28 05:28:07.617360356 +0000 2024-03-28T05:34:50.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T05:34:50.152 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-28T05:34:50.152 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-28T05:34:50.152 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000336024 s, 1.5 MB/s 2024-03-28T05:34:50.156 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T05:34:50.212 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-28 05:34:20.443448400 +0000 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-28 05:28:08.198349324 +0000 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-28 05:28:08.198349324 +0000 2024-03-28T05:34:50.259 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-28 05:28:08.198349324 +0000 2024-03-28T05:34:50.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T05:34:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-28T05:34:50.383 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-28T05:34:50.383 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000283509 s, 1.8 MB/s 2024-03-28T05:34:50.385 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T05:34:50.426 INFO:tasks.cephadm:Deploying osd.0 on smithi055 with /dev/vg_nvme/lv_4... 2024-03-28T05:34:50.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-28T05:34:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:50 smithi055 ceph-mon[31863]: Deploying daemon mgr.z on smithi159 2024-03-28T05:34:50.744 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:50 smithi159 ceph-mon[36109]: Deploying daemon mgr.z on smithi159 2024-03-28T05:34:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:50 smithi086 ceph-mon[35163]: Deploying daemon mgr.z on smithi159 2024-03-28T05:34:50.874 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:34:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:51 smithi055 ceph-mon[31863]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:51.703 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:51 smithi159 ceph-mon[36109]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:51 smithi086 ceph-mon[35163]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:52.049 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:51 smithi159 systemd[1]: Starting Ceph mgr.z for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:34:52.321 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 podman[37815]: 2024-03-28 05:34:52.049039079 +0000 UTC m=+0.126651120 container create c7c1e9f9764ec0f0684295f30bae4c1c60eca1d3c7d2d9aad63df5f3965bdda1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-28T05:34:52.321 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 podman[37815]: 2024-03-28 05:34:51.95272293 +0000 UTC m=+0.030334940 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:34:52.820 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 podman[37815]: 2024-03-28 05:34:52.323939524 +0000 UTC m=+0.401551585 container init c7c1e9f9764ec0f0684295f30bae4c1c60eca1d3c7d2d9aad63df5f3965bdda1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z, org.label-schema.build-date=20240319, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:34:52.820 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 podman[37815]: 2024-03-28 05:34:52.335203192 +0000 UTC m=+0.412815204 container start c7c1e9f9764ec0f0684295f30bae4c1c60eca1d3c7d2d9aad63df5f3965bdda1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319) 2024-03-28T05:34:52.821 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 ceph-mgr[37834]: -- 172.21.15.159:0/332579290 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fa159ca5a0 con 0x55fa1599ec00 2024-03-28T05:34:52.821 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 bash[37815]: c7c1e9f9764ec0f0684295f30bae4c1c60eca1d3c7d2d9aad63df5f3965bdda1 2024-03-28T05:34:52.821 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:52 smithi159 systemd[1]: Started Ceph mgr.z for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:34:53.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:53.093+0000 7f2e862ec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T05:34:53.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:53.212+0000 7f2e862ec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T05:34:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-28T05:34:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-28T05:34:53.675 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-03-28T05:34:53.675 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-03-28T05:34:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0348587 s, 301 MB/s 2024-03-28T05:34:53.676 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:53.891 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:53.892 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:54.308 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.006+0000 7f2e862ec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T05:34:54.308 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.128+0000 7f2e862ec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T05:34:54.308 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.306+0000 7f2e862ec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T05:34:54.514 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_4 2024-03-28T05:34:54.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.430+0000 7f2e862ec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T05:34:54.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.539+0000 7f2e862ec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T05:34:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:54 smithi086 ceph-mon[35163]: Deploying daemon mgr.y on smithi086 2024-03-28T05:34:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:54 smithi055 ceph-mon[31863]: Deploying daemon mgr.y on smithi086 2024-03-28T05:34:54.884 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-mon[36109]: Deploying daemon mgr.y on smithi086 2024-03-28T05:34:54.962 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:34:55.135 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:54.882+0000 7f2e862ec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T05:34:55.135 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:55 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:55.021+0000 7f2e862ec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T05:34:55.476 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:55 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:55.133+0000 7f2e862ec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T05:34:55.477 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:55 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:55.258+0000 7f2e862ec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T05:34:55.477 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:55 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:55.475+0000 7f2e862ec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T05:34:55.672 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:55 smithi086 ceph-mon[35163]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:55 smithi159 ceph-mon[36109]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:56.017 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:55 smithi086 systemd[1]: Starting Ceph mgr.y for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:34:56.108 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:55 smithi055 ceph-mon[31863]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:56.315 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 podman[36519]: 2024-03-28 05:34:55.922788514 +0000 UTC m=+0.036874861 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:34:56.315 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 podman[36519]: 2024-03-28 05:34:56.026655467 +0000 UTC m=+0.140741834 container create 34a1e06d02ce65cc5807f9fe80c0f36ad79c04d95dee3334e1aa61a11c17b86b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-28T05:34:56.315 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 podman[36519]: 2024-03-28 05:34:56.313629678 +0000 UTC m=+0.427716089 container init 34a1e06d02ce65cc5807f9fe80c0f36ad79c04d95dee3334e1aa61a11c17b86b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319) 2024-03-28T05:34:56.568 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 podman[36519]: 2024-03-28 05:34:56.323717675 +0000 UTC m=+0.437804092 container start 34a1e06d02ce65cc5807f9fe80c0f36ad79c04d95dee3334e1aa61a11c17b86b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-28T05:34:56.569 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 ceph-mgr[36538]: -- 172.21.15.86:0/1045080431 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556ca602a5a0 con 0x556ca5ffe800 2024-03-28T05:34:56.569 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 bash[36519]: 34a1e06d02ce65cc5807f9fe80c0f36ad79c04d95dee3334e1aa61a11c17b86b 2024-03-28T05:34:56.569 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:56 smithi086 systemd[1]: Started Ceph mgr.y for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:34:56.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 -- 172.21.15.55:0/2523476245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e241010c0 msgr2=0x7f9e241014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:56.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 --2- 172.21.15.55:0/2523476245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e241010c0 0x7f9e241014e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9e140099c0 tx=0x7f9e14009cd0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 -- 172.21.15.55:0/2523476245 shutdown_connections 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 --2- 172.21.15.55:0/2523476245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e241010c0 0x7f9e241014e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 --2- 172.21.15.55:0/2523476245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 0x7f9e24109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 --2- 172.21.15.55:0/2523476245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 -- 172.21.15.55:0/2523476245 >> 172.21.15.55:0/2523476245 conn(0x7f9e240fc660 msgr2=0x7f9e240feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 -- 172.21.15.55:0/2523476245 shutdown_connections 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.914+0000 7f9e29400700 1 -- 172.21.15.55:0/2523476245 wait complete. 2024-03-28T05:34:56.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 Processor -- start 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 -- start start 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 0x7f9e24198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2410cb80 con 0x7f9e2419dbf0 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2410ca00 con 0x7f9e24102c60 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.916+0000 7f9e29400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2410cd00 con 0x7f9e241022c0 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e23200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e23200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39742/0 (socket says 172.21.15.55:39742) 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e23200700 1 -- 172.21.15.55:0/1906797210 learned_addr learned my addr 172.21.15.55:0/1906797210 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e1be00700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 0x7f9e24198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 -- 172.21.15.55:0/1906797210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 msgr2=0x7f9e24198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 0x7f9e24198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 -- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 msgr2=0x7f9e2419ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:34:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e22800700 1 -- 172.21.15.55:0/1906797210 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e241a0680 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.917+0000 7f9e23200700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e22800700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24198640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e24100c10 tx=0x7f9e14003e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14009e60 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9e1400f460 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e241034e0 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14017650 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.918+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e24103970 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.919+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e24068e50 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.919+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 46162+0+0 (secure 0 0 0) 0x7f9e1400f610 con 0x7f9e241022c0 2024-03-28T05:34:56.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.920+0000 7f9e1b400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 0x7f9e0803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:34:56.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.920+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9e1404c330 con 0x7f9e241022c0 2024-03-28T05:34:56.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.920+0000 7f9e1be00700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 0x7f9e0803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:34:56.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.921+0000 7f9e1be00700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 0x7f9e0803b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009bf0 tx=0x7f9e0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:34:56.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:56.928+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9e14013070 con 0x7f9e241022c0 2024-03-28T05:34:57.070 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:56 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:56.774+0000 7f2e862ec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T05:34:57.070 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:56 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:56.949+0000 7f2e862ec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T05:34:57.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:34:57.170+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e2406a580 con 0x7f9e08039200 2024-03-28T05:34:57.567 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:57.087+0000 7f7cb2dcf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T05:34:57.568 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:57.219+0000 7f7cb2dcf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:57.382+0000 7f2e862ec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:57.505+0000 7f2e862ec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.794 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.795 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.795 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:57.795 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:34:57.795 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:34:57.795 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:34:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:34:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:34:58.060 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:57.792+0000 7f2e862ec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:34:58.060 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:58.058+0000 7f2e862ec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T05:34:58.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.066+0000 7f7cb2dcf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T05:34:58.319 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.185+0000 7f7cb2dcf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T05:34:58.775 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:58.440+0000 7f2e862ec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:34:58.775 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:58.773+0000 7f2e862ec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T05:34:58.775 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:58 smithi159 ceph-mon[36109]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:58.775 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-mon[35163]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:58.818 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.368+0000 7f7cb2dcf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T05:34:58.818 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.497+0000 7f7cb2dcf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T05:34:58.818 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.608+0000 7f7cb2dcf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T05:34:58.858 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:58 smithi055 ceph-mon[31863]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:34:58.858 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:59.225 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:58 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:58.962+0000 7f7cb2dcf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-28T05:34:59.225 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:59.109+0000 7f7cb2dcf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T05:34:59.568 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:59.225+0000 7f7cb2dcf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T05:34:59.568 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:59.352+0000 7f7cb2dcf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T05:34:59.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:34:59.079+0000 7f2e862ec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T05:34:59.806 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:59 smithi055 ceph-mon[31863]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:34:59.806 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:59.807 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:59.807 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:34:59.807 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:34:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.068 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:34:59.573+0000 7f7cb2dcf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T05:35:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-mon[35163]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:34:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-mon[36109]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:34:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.447 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:35:00.105+0000 7f2e862ec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:35:00.761 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:35:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-28T05:35:00.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:01.070 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:35:00.831+0000 7f2e862ec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T05:35:01.070 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:35:00 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:35:00.965+0000 7f2e862ec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T05:35:01.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:00 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:00.874+0000 7f7cb2dcf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-28T05:35:01.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:01.043+0000 7f7cb2dcf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T05:35:01.570 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-z[37830]: 2024-03-28T05:35:01.255+0000 7f2e862ec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T05:35:01.818 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:01.472+0000 7f7cb2dcf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T05:35:01.818 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:01.591+0000 7f7cb2dcf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: Reconfiguring mgr.x (unknown last config time)... 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: Reconfiguring daemon mgr.x on smithi055 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]: dispatch 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]': finished 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: osdmap e5: 1 total, 0 up, 1 in 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: Standby manager daemon z started 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-28T05:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: Reconfiguring mgr.x (unknown last config time)... 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: Reconfiguring daemon mgr.x on smithi055 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]: dispatch 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]': finished 2024-03-28T05:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: osdmap e5: 1 total, 0 up, 1 in 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: Standby manager daemon z started 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-28T05:35:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:01 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:02.023+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 14) v1 ==== 91698+0+0 (secure 0 0 0) 0x7f9e140052d0 con 0x7f9e241022c0 2024-03-28T05:35:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: Reconfiguring mgr.x (unknown last config time)... 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: Reconfiguring daemon mgr.x on smithi055 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]: dispatch 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2808511774' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df00632e-7830-42bc-8e05-74ae3fbbdb94"}]': finished 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: osdmap e5: 1 total, 0 up, 1 in 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: Standby manager daemon z started 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-28T05:35:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:01 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.159:0/1617004097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:02.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:01.847+0000 7f7cb2dcf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:35:02.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:02.090+0000 7f7cb2dcf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T05:35:02.773 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:02.459+0000 7f7cb2dcf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T05:35:02.773 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:02.772+0000 7f7cb2dcf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T05:35:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1885115741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:03 smithi086 ceph-mon[35163]: mgrmap e14: x(active, since 104s), standbys: z 2024-03-28T05:35:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-28T05:35:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1885115741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:03 smithi159 ceph-mon[36109]: mgrmap e14: x(active, since 104s), standbys: z 2024-03-28T05:35:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-28T05:35:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1885115741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:03 smithi055 ceph-mon[31863]: mgrmap e14: x(active, since 104s), standbys: z 2024-03-28T05:35:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-28T05:35:03.568 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:03 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:03.074+0000 7f7cb2dcf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T05:35:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:04 smithi086 ceph-mon[35163]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:04.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:04 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:04.069+0000 7f7cb2dcf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T05:35:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:04 smithi159 ceph-mon[36109]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:04 smithi055 ceph-mon[31863]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:05.026 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:04 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:04.747+0000 7f7cb2dcf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T05:35:05.026 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:04 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:04.872+0000 7f7cb2dcf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T05:35:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:05 smithi086 ceph-mon[35163]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:05.318 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Mar 28 05:35:05 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-y[36534]: 2024-03-28T05:35:05.145+0000 7f7cb2dcf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T05:35:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:05 smithi159 ceph-mon[36109]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:05 smithi055 ceph-mon[31863]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:06.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:06.055+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mon.1 v2:172.21.15.159:3300/0 8 ==== mgrmap(e 15) v1 ==== 137234+0+0 (secure 0 0 0) 0x7f9e14020370 con 0x7f9e241022c0 2024-03-28T05:35:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:06 smithi086 ceph-mon[35163]: Standby manager daemon y started 2024-03-28T05:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:06 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-28T05:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:06 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:06 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-28T05:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:06 smithi086 ceph-mon[35163]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:06 smithi159 ceph-mon[36109]: Standby manager daemon y started 2024-03-28T05:35:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:06 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-28T05:35:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:06 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:06 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-28T05:35:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:06 smithi159 ceph-mon[36109]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:06 smithi055 ceph-mon[31863]: Standby manager daemon y started 2024-03-28T05:35:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:06 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-28T05:35:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:06 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-28T05:35:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:06 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-28T05:35:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:06 smithi055 ceph-mon[31863]: from='mgr.? 172.21.15.86:0/64153654' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-28T05:35:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:07 smithi055 ceph-mon[31863]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:07 smithi055 ceph-mon[31863]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-03-28T05:35:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-28T05:35:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:07 smithi086 ceph-mon[35163]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:07 smithi086 ceph-mon[35163]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-03-28T05:35:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-28T05:35:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:07 smithi159 ceph-mon[36109]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:07 smithi159 ceph-mon[36109]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-03-28T05:35:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-28T05:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:09 smithi055 ceph-mon[31863]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:10.022 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:09 smithi086 ceph-mon[35163]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:10.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:10.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:10.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:09 smithi159 ceph-mon[36109]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:10.734 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:10.734 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:10.735 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:11 smithi055 ceph-mon[31863]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-28T05:35:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:11 smithi086 ceph-mon[35163]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-28T05:35:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:11 smithi159 ceph-mon[36109]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-28T05:35:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:12.909 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:12 smithi055 ceph-mon[31863]: Deploying daemon osd.0 on smithi055 2024-03-28T05:35:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:12 smithi086 ceph-mon[35163]: Deploying daemon osd.0 on smithi055 2024-03-28T05:35:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:12 smithi159 ceph-mon[36109]: Deploying daemon osd.0 on smithi055 2024-03-28T05:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:13 smithi055 ceph-mon[31863]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:13 smithi086 ceph-mon[35163]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:13 smithi159 ceph-mon[36109]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:16.048 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:15 smithi055 ceph-mon[31863]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:15 smithi086 ceph-mon[35163]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:15 smithi159 ceph-mon[36109]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:17.988 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:17 smithi055 ceph-mon[31863]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:17 smithi086 ceph-mon[35163]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:17 smithi159 ceph-mon[36109]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:19.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:19 smithi055 ceph-mon[31863]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:19.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:19.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:19.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:19 smithi086 ceph-mon[35163]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:19 smithi159 ceph-mon[36109]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:20 smithi055 ceph-mon[31863]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:20 smithi086 ceph-mon[35163]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:20 smithi159 ceph-mon[36109]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:23.559 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.287+0000 7f9e1b400700 1 -- 172.21.15.55:0/1906797210 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9e2406a580 con 0x7f9e08039200 2024-03-28T05:35:24.288 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 0 on host 'smithi055' 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.290+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 msgr2=0x7f9e0803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.290+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 0x7f9e0803b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009bf0 tx=0x7f9e0c009260 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 msgr2=0x7f9e24198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24198640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e24100c10 tx=0x7f9e14003e60 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 shutdown_connections 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e08039200 0x7f9e0803b6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e2419dbf0 0x7f9e2419ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e241022c0 0x7f9e24198640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 --2- 172.21.15.55:0/1906797210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e24102c60 0x7f9e24198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 >> 172.21.15.55:0/1906797210 conn(0x7f9e240fc660 msgr2=0x7f9e24069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 shutdown_connections 2024-03-28T05:35:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:35:24.291+0000 7f9e29400700 1 -- 172.21.15.55:0/1906797210 wait complete. 2024-03-28T05:35:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:24 smithi086 ceph-mon[35163]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-28T05:35:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:24 smithi159 ceph-mon[36109]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-28T05:35:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:24 smithi055 ceph-mon[31863]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-28T05:35:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:25.073 DEBUG:teuthology.orchestra.run.smithi055:osd.0> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.0.service 2024-03-28T05:35:25.079 INFO:tasks.cephadm:Deploying osd.1 on smithi086 with /dev/vg_nvme/lv_4... 2024-03-28T05:35:25.079 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-28T05:35:25.517 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:35:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:25 smithi086 ceph-mon[35163]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:25 smithi086 ceph-mon[35163]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-28T05:35:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:25 smithi086 ceph-mon[35163]: osdmap e6: 1 total, 0 up, 1 in 2024-03-28T05:35:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:25 smithi086 ceph-mon[35163]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:35:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-mon[31863]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-mon[31863]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-28T05:35:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-mon[31863]: osdmap e6: 1 total, 0 up, 1 in 2024-03-28T05:35:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-mon[31863]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:35:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:25.624 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-0[44232]: 2024-03-28T05:35:25.350+0000 7f66ae200700 -1 osd.0 0 waiting for initial osdmap 2024-03-28T05:35:25.624 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:35:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-0[44232]: 2024-03-28T05:35:25.360+0000 7f66a9000700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:35:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:25 smithi159 ceph-mon[36109]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:25 smithi159 ceph-mon[36109]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-28T05:35:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:25 smithi159 ceph-mon[36109]: osdmap e6: 1 total, 0 up, 1 in 2024-03-28T05:35:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:25 smithi159 ceph-mon[36109]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:35:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:26 smithi055 ceph-mon[31863]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:35:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:26 smithi055 ceph-mon[31863]: osdmap e7: 1 total, 0 up, 1 in 2024-03-28T05:35:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:26 smithi086 ceph-mon[35163]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:35:26.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:26 smithi086 ceph-mon[35163]: osdmap e7: 1 total, 0 up, 1 in 2024-03-28T05:35:26.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:26 smithi159 ceph-mon[36109]: from='osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:35:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:26 smithi159 ceph-mon[36109]: osdmap e7: 1 total, 0 up, 1 in 2024-03-28T05:35:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:35:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:35:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] boot 2024-03-28T05:35:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: osdmap e8: 1 total, 1 up, 1 in 2024-03-28T05:35:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:35:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:35:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] boot 2024-03-28T05:35:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: osdmap e8: 1 total, 1 up, 1 in 2024-03-28T05:35:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: osd.0 [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] boot 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: osdmap e8: 1 total, 1 up, 1 in 2024-03-28T05:35:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-28T05:35:28.224 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-28T05:35:28.224 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-28T05:35:28.224 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-03-28T05:35:28.225 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-03-28T05:35:28.225 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0381176 s, 275 MB/s 2024-03-28T05:35:28.225 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-03-28T05:35:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:28 smithi086 ceph-mon[35163]: osdmap e9: 1 total, 1 up, 1 in 2024-03-28T05:35:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:28 smithi055 ceph-mon[31863]: osdmap e9: 1 total, 1 up, 1 in 2024-03-28T05:35:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:28 smithi159 ceph-mon[36109]: osdmap e9: 1 total, 1 up, 1 in 2024-03-28T05:35:29.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-03-28T05:35:29.483 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:35:29.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:29 smithi055 ceph-mon[31863]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:29.630 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:29 smithi086 ceph-mon[35163]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:29 smithi159 ceph-mon[36109]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:31.145 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi055 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 17095M 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:31.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi055 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 17095M 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi055 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 17095M 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 -- 172.21.15.86:0/2366462872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c1012c0 msgr2=0x7f3a9c101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 --2- 172.21.15.86:0/2366462872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c1012c0 0x7f3a9c101740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009990 tx=0x7f3a84009ca0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 -- 172.21.15.86:0/2366462872 shutdown_connections 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 --2- 172.21.15.86:0/2366462872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c100960 0x7f3a9c100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 --2- 172.21.15.86:0/2366462872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a9c101c80 0x7f3a9c102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 --2- 172.21.15.86:0/2366462872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c1012c0 0x7f3a9c101740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 -- 172.21.15.86:0/2366462872 >> 172.21.15.86:0/2366462872 conn(0x7f3a9c0fc560 msgr2=0x7f3a9c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 -- 172.21.15.86:0/2366462872 shutdown_connections 2024-03-28T05:35:31.658 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.657+0000 7f3aa1600700 1 -- 172.21.15.86:0/2366462872 wait complete. 2024-03-28T05:35:31.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 Processor -- start 2024-03-28T05:35:31.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 -- start start 2024-03-28T05:35:31.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:35:31.659 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a9c1012c0 0x7f3a9c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 0x7f3a9c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c10fe10 con 0x7f3a9c101c80 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c10fc90 con 0x7f3a9c100960 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.658+0000 7f3aa1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c10ff90 con 0x7f3a9c1012c0 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:38916/0 (socket says 172.21.15.86:38916) 2024-03-28T05:35:31.660 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 -- 172.21.15.86:0/1177862852 learned_addr learned my addr 172.21.15.86:0/1177862852 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-03-28T05:35:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3aa0c00700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 0x7f3a9c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:35:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 -- 172.21.15.86:0/1177862852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a9c1012c0 msgr2=0x7f3a9c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a9c1012c0 0x7f3a9c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 -- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 msgr2=0x7f3a9c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:31.661 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 0x7f3a9c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 -- 172.21.15.86:0/1177862852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c1a20e0 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3aa0c00700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 0x7f3a9c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.659+0000 7f3a9be00700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c920 tx=0x7f3a8c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.660+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c007b00 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.660+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3a8c004ce0 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.660+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c1a23d0 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.660+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c005600 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.660+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c1a2960 con 0x7f3a9c100960 2024-03-28T05:35:31.662 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.661+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c068e50 con 0x7f3a9c100960 2024-03-28T05:35:31.664 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.663+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) v1 ==== 137234+0+0 (secure 0 0 0) 0x7f3a8c004750 con 0x7f3a9c100960 2024-03-28T05:35:31.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.664+0000 7f3a99600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 0x7f3a800a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:35:31.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.665+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f3a8c0ccc70 con 0x7f3a9c100960 2024-03-28T05:35:31.665 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.665+0000 7f3a93400700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 0x7f3a800a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:35:31.667 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.666+0000 7f3a93400700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 0x7f3a800a4d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a840098e0 tx=0x7f3a84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:35:31.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.670+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f3a8c014030 con 0x7f3a9c100960 2024-03-28T05:35:31.902 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:31.900+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a9c0625d0 con 0x7f3a800a2880 2024-03-28T05:35:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:35:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:35:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:35:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:35:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:35:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:35:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:32 smithi086 ceph-mon[35163]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:32 smithi086 ceph-mon[35163]: from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:32 smithi159 ceph-mon[36109]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:32 smithi159 ceph-mon[36109]: from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:35:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:32 smithi055 ceph-mon[31863]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:32 smithi055 ceph-mon[31863]: from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:35:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:34 smithi086 ceph-mon[35163]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:34 smithi159 ceph-mon[36109]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:34 smithi055 ceph-mon[31863]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:35 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/760380540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:35 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:35 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]': finished 2024-03-28T05:35:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:35 smithi086 ceph-mon[35163]: osdmap e10: 2 total, 1 up, 2 in 2024-03-28T05:35:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:35 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/760380540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:35 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:35 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]': finished 2024-03-28T05:35:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:35 smithi159 ceph-mon[36109]: osdmap e10: 2 total, 1 up, 2 in 2024-03-28T05:35:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:35 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/760380540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:35 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]: dispatch 2024-03-28T05:35:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:35 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7cbaa230-33bb-4f8a-aed7-0bdabfeaa815"}]': finished 2024-03-28T05:35:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:35 smithi055 ceph-mon[31863]: osdmap e10: 2 total, 1 up, 2 in 2024-03-28T05:35:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:37 smithi086 ceph-mon[35163]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:37 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/672140977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:37 smithi159 ceph-mon[36109]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:37 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/672140977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:37 smithi055 ceph-mon[31863]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:37 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/672140977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:35:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:39 smithi086 ceph-mon[35163]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:39 smithi159 ceph-mon[36109]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:39 smithi055 ceph-mon[31863]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:41.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:41 smithi086 ceph-mon[35163]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:41 smithi159 ceph-mon[36109]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:41 smithi055 ceph-mon[31863]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:43 smithi086 ceph-mon[35163]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:43 smithi159 ceph-mon[36109]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:43 smithi055 ceph-mon[31863]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:45 smithi086 ceph-mon[35163]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:45 smithi159 ceph-mon[36109]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:45 smithi055 ceph-mon[31863]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-28T05:35:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-28T05:35:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-28T05:35:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:47 smithi055 ceph-mon[31863]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:47 smithi055 ceph-mon[31863]: Deploying daemon osd.1 on smithi086 2024-03-28T05:35:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:47 smithi086 ceph-mon[35163]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:47 smithi086 ceph-mon[35163]: Deploying daemon osd.1 on smithi086 2024-03-28T05:35:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:47 smithi159 ceph-mon[36109]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:47 smithi159 ceph-mon[36109]: Deploying daemon osd.1 on smithi086 2024-03-28T05:35:49.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:49 smithi086 ceph-mon[35163]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:49 smithi159 ceph-mon[36109]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:49 smithi055 ceph-mon[31863]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:51 smithi086 ceph-mon[35163]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:51 smithi159 ceph-mon[36109]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:51 smithi055 ceph-mon[31863]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:53 smithi086 ceph-mon[35163]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:53 smithi055 ceph-mon[31863]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:53 smithi159 ceph-mon[36109]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:55.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:54 smithi086 ceph-mon[35163]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:55.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:54 smithi159 ceph-mon[36109]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:54 smithi055 ceph-mon[31863]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:57.207 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:56 smithi086 ceph-mon[35163]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:56 smithi159 ceph-mon[36109]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:56 smithi055 ceph-mon[31863]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:58 smithi086 ceph-mon[35163]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:58.819 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.817+0000 7f3a99600700 1 -- 172.21.15.86:0/1177862852 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3a9c0625d0 con 0x7f3a800a2880 2024-03-28T05:35:58.819 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 1 on host 'smithi086' 2024-03-28T05:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:58 smithi159 ceph-mon[36109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:58.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 msgr2=0x7f3a800a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:58.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 0x7f3a800a4d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a840098e0 tx=0x7f3a84005fb0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.822 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 msgr2=0x7f3a9c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c920 tx=0x7f3a8c00cce0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 shutdown_connections 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a800a2880 0x7f3a800a4d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a9c101c80 0x7f3a9c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a9c100960 0x7f3a9c19a480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 --2- 172.21.15.86:0/1177862852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a9c1012c0 0x7f3a9c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 >> 172.21.15.86:0/1177862852 conn(0x7f3a9c0fc560 msgr2=0x7f3a9c0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 shutdown_connections 2024-03-28T05:35:58.823 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:35:58.821+0000 7f3aa1600700 1 -- 172.21.15.86:0/1177862852 wait complete. 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:58 smithi055 ceph-mon[31863]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-28T05:35:59.567 DEBUG:teuthology.orchestra.run.smithi086:osd.1> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.1.service 2024-03-28T05:35:59.573 INFO:tasks.cephadm:Deploying osd.2 on smithi159 with /dev/vg_nvme/lv_4... 2024-03-28T05:35:59.573 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: osdmap e11: 2 total, 1 up, 2 in 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.783 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.784 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:35:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-28T05:35:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: osdmap e11: 2 total, 1 up, 2 in 2024-03-28T05:35:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:35:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:35:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:35:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-28T05:35:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: osdmap e11: 2 total, 1 up, 2 in 2024-03-28T05:35:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:35:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:35:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:35:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:35:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:00.005 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:36:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:00 smithi086 ceph-mon[35163]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:36:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:00 smithi086 ceph-mon[35163]: osdmap e12: 2 total, 1 up, 2 in 2024-03-28T05:36:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:00 smithi159 ceph-mon[36109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:36:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:00 smithi159 ceph-mon[36109]: osdmap e12: 2 total, 1 up, 2 in 2024-03-28T05:36:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:00 smithi055 ceph-mon[31863]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:36:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:00 smithi055 ceph-mon[31863]: osdmap e12: 2 total, 1 up, 2 in 2024-03-28T05:36:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] boot 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: osdmap e13: 2 total, 2 up, 2 in 2024-03-28T05:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] boot 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: osdmap e13: 2 total, 2 up, 2 in 2024-03-28T05:36:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: osd.1 [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] boot 2024-03-28T05:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: osdmap e13: 2 total, 2 up, 2 in 2024-03-28T05:36:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0399083 s, 263 MB/s 2024-03-28T05:36:02.574 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-03-28T05:36:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:02 smithi086 ceph-mon[35163]: osdmap e14: 2 total, 2 up, 2 in 2024-03-28T05:36:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:02 smithi159 ceph-mon[36109]: osdmap e14: 2 total, 2 up, 2 in 2024-03-28T05:36:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:02 smithi055 ceph-mon[31863]: osdmap e14: 2 total, 2 up, 2 in 2024-03-28T05:36:03.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-03-28T05:36:03.617 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:36:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:03 smithi086 ceph-mon[35163]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:03 smithi159 ceph-mon[36109]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:03 smithi055 ceph-mon[31863]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi086 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 17091M 2024-03-28T05:36:05.380 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.381 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:05.381 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:05.381 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.549+0000 7fd32f000700 1 -- 172.21.15.159:0/2358929415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328105fb0 msgr2=0x7fd32810c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:05.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.549+0000 7fd32f000700 1 --2- 172.21.15.159:0/2358929415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328105fb0 0x7fd32810c860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd32000b0a0 tx=0x7fd32000b3b0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 -- 172.21.15.159:0/2358929415 shutdown_connections 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 --2- 172.21.15.159:0/2358929415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328104410 0x7fd328104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 --2- 172.21.15.159:0/2358929415 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328105fb0 0x7fd32810c860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 --2- 172.21.15.159:0/2358929415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105610 0x7fd328105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 -- 172.21.15.159:0/2358929415 >> 172.21.15.159:0/2358929415 conn(0x7fd3280ff9b0 msgr2=0x7fd328101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 -- 172.21.15.159:0/2358929415 shutdown_connections 2024-03-28T05:36:05.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.550+0000 7fd32f000700 1 -- 172.21.15.159:0/2358929415 wait complete. 2024-03-28T05:36:05.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 Processor -- start 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 -- start start 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328105610 0x7fd32819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105fb0 0x7fd3281a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32810ff00 con 0x7fd328105610 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32810fd80 con 0x7fd328105fb0 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.551+0000 7fd32f000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328110080 con 0x7fd328104410 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40082/0 (socket says 172.21.15.159:40082) 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 -- 172.21.15.159:0/263677318 learned_addr learned my addr 172.21.15.159:0/263677318 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327400700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328105610 0x7fd32819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd32d000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105fb0 0x7fd3281a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:05.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 -- 172.21.15.159:0/263677318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105fb0 msgr2=0x7fd3281a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105fb0 0x7fd3281a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 -- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328105610 msgr2=0x7fd32819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328105610 0x7fd32819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.552+0000 7fd327e00700 1 -- 172.21.15.159:0/263677318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3281a20c0 con 0x7fd328104410 2024-03-28T05:36:05.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd327e00700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd31800c9c0 tx=0x7fd31800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318007ac0 con 0x7fd328104410 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd318007c60 con 0x7fd328104410 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318018660 con 0x7fd328104410 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3281a23b0 con 0x7fd328104410 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.553+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3281a28a0 con 0x7fd328104410 2024-03-28T05:36:05.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.554+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328068e50 con 0x7fd328104410 2024-03-28T05:36:05.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.556+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) v1 ==== 137234+0+0 (secure 0 0 0) 0x7fd31800f450 con 0x7fd328104410 2024-03-28T05:36:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.558+0000 7fd324c00700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 0x7fd30c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.558+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fd3180cd310 con 0x7fd328104410 2024-03-28T05:36:05.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.558+0000 7fd327400700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 0x7fd30c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:05.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.560+0000 7fd327400700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 0x7fd30c0a4d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd314005950 tx=0x7fd3140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:36:05.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.561+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd318014030 con 0x7fd328104410 2024-03-28T05:36:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi086 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 17091M 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi086 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 17091M 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:05.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:05.795+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3280625d0 con 0x7fd30c0a2880 2024-03-28T05:36:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:07 smithi055 ceph-mon[31863]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:07 smithi055 ceph-mon[31863]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:07.693 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:07 smithi159 ceph-mon[36109]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:07.693 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:07 smithi159 ceph-mon[36109]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:07 smithi086 ceph-mon[35163]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:07 smithi086 ceph-mon[35163]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:09 smithi055 ceph-mon[31863]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:09 smithi086 ceph-mon[35163]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:09 smithi159 ceph-mon[36109]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/2539401007' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]': finished 2024-03-28T05:36:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: osdmap e15: 3 total, 2 up, 3 in 2024-03-28T05:36:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/950179219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/2539401007' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]': finished 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: osdmap e15: 3 total, 2 up, 3 in 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:10.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/950179219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/2539401007' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]: dispatch 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65e1186a-cbc9-429b-ba19-135a705d8a7c"}]': finished 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: osdmap e15: 3 total, 2 up, 3 in 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/950179219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:11 smithi086 ceph-mon[35163]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:11 smithi159 ceph-mon[36109]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:11 smithi055 ceph-mon[31863]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:13.785 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:13 smithi159 ceph-mon[36109]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:13 smithi086 ceph-mon[35163]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:13 smithi055 ceph-mon[31863]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:15.762 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:15 smithi159 ceph-mon[36109]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:15 smithi086 ceph-mon[35163]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:15 smithi055 ceph-mon[31863]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:17 smithi055 ceph-mon[31863]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:17 smithi086 ceph-mon[35163]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:17 smithi159 ceph-mon[36109]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-28T05:36:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-28T05:36:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-28T05:36:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:19.692 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:19 smithi159 ceph-mon[36109]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:19.692 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:19 smithi159 ceph-mon[36109]: Deploying daemon osd.2 on smithi159 2024-03-28T05:36:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:19 smithi086 ceph-mon[35163]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:19 smithi086 ceph-mon[35163]: Deploying daemon osd.2 on smithi159 2024-03-28T05:36:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:19 smithi055 ceph-mon[31863]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:19 smithi055 ceph-mon[31863]: Deploying daemon osd.2 on smithi159 2024-03-28T05:36:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:21 smithi086 ceph-mon[35163]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:21 smithi159 ceph-mon[36109]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:21 smithi055 ceph-mon[31863]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:23 smithi086 ceph-mon[35163]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:23 smithi159 ceph-mon[36109]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:23 smithi055 ceph-mon[31863]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:25 smithi086 ceph-mon[35163]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:25 smithi159 ceph-mon[36109]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:25 smithi055 ceph-mon[31863]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:27.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:27 smithi159 ceph-mon[36109]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:27.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:27.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:27.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:27 smithi086 ceph-mon[35163]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:27 smithi055 ceph-mon[31863]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:29 smithi159 ceph-mon[36109]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:29.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:29 smithi086 ceph-mon[35163]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:29 smithi055 ceph-mon[31863]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.118+0000 7fd324c00700 1 -- 172.21.15.159:0/263677318 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd3280625d0 con 0x7fd30c0a2880 2024-03-28T05:36:31.120 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 2 on host 'smithi159' 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 msgr2=0x7fd30c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 0x7fd30c0a4d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd314005950 tx=0x7fd3140058e0 comp rx=0 tx=0).stop 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 msgr2=0x7fd32819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd31800c9c0 tx=0x7fd31800cd80 comp rx=0 tx=0).stop 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 shutdown_connections 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd30c0a2880 0x7fd30c0a4d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd328105fb0 0x7fd3281a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:31.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd328104410 0x7fd32819a460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:31.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 --2- 172.21.15.159:0/263677318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd328105610 0x7fd32819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:31.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.121+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 >> 172.21.15.159:0/263677318 conn(0x7fd3280ff9b0 msgr2=0x7fd3281088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:36:31.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.122+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 shutdown_connections 2024-03-28T05:36:31.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:36:31.122+0000 7fd32f000700 1 -- 172.21.15.159:0/263677318 wait complete. 2024-03-28T05:36:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.601 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:31.601 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:31.601 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:36:31.602 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:31.859 DEBUG:teuthology.orchestra.run.smithi159:osd.2> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.2.service 2024-03-28T05:36:31.864 INFO:tasks.cephadm:Deploying osd.3 on smithi055 with /dev/vg_nvme/lv_3... 2024-03-28T05:36:31.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-28T05:36:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:36:32.508 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:32 smithi159 ceph-mon[36109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-28T05:36:32.509 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:32 smithi159 ceph-mon[36109]: osdmap e16: 3 total, 2 up, 3 in 2024-03-28T05:36:32.509 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:32.509 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:32 smithi159 ceph-mon[36109]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:32.509 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:32 smithi159 ceph-mon[36109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:32 smithi055 ceph-mon[31863]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-28T05:36:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:32 smithi055 ceph-mon[31863]: osdmap e16: 3 total, 2 up, 3 in 2024-03-28T05:36:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:32 smithi055 ceph-mon[31863]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:32 smithi055 ceph-mon[31863]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:32 smithi086 ceph-mon[35163]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-28T05:36:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:32 smithi086 ceph-mon[35163]: osdmap e16: 3 total, 2 up, 3 in 2024-03-28T05:36:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:32 smithi086 ceph-mon[35163]: from='osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:32 smithi086 ceph-mon[35163]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:36:33.388 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-mon[36109]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:33.388 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-mon[36109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:36:33.389 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-mon[36109]: osdmap e17: 3 total, 2 up, 3 in 2024-03-28T05:36:33.389 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:33.389 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:33.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:33 smithi055 ceph-mon[31863]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:33.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:33 smithi055 ceph-mon[31863]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:36:33.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:33 smithi055 ceph-mon[31863]: osdmap e17: 3 total, 2 up, 3 in 2024-03-28T05:36:33.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:33.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:33.667 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-2[41096]: 2024-03-28T05:36:33.415+0000 7fdc05c00700 -1 osd.2 0 waiting for initial osdmap 2024-03-28T05:36:33.667 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:33 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-2[41096]: 2024-03-28T05:36:33.461+0000 7fdbfba00700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:33 smithi086 ceph-mon[35163]: pgmap v103: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:33 smithi086 ceph-mon[35163]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:33 smithi086 ceph-mon[35163]: osdmap e17: 3 total, 2 up, 3 in 2024-03-28T05:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:34 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:36:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:34 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:36:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:34 smithi055 ceph-mon[31863]: from='osd.2 ' entity='osd.2' 2024-03-28T05:36:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:34 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:36:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:34 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:36:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:34 smithi086 ceph-mon[35163]: from='osd.2 ' entity='osd.2' 2024-03-28T05:36:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:34 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:36:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:34 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:36:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:34 smithi159 ceph-mon[36109]: from='osd.2 ' entity='osd.2' 2024-03-28T05:36:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-28T05:36:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-28T05:36:35.051 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-03-28T05:36:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-03-28T05:36:35.052 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0385526 s, 272 MB/s 2024-03-28T05:36:35.052 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-03-28T05:36:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:35 smithi159 ceph-mon[36109]: pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:35 smithi159 ceph-mon[36109]: osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] boot 2024-03-28T05:36:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:35 smithi159 ceph-mon[36109]: osdmap e18: 3 total, 3 up, 3 in 2024-03-28T05:36:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:35 smithi055 ceph-mon[31863]: pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:35 smithi055 ceph-mon[31863]: osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] boot 2024-03-28T05:36:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:35 smithi055 ceph-mon[31863]: osdmap e18: 3 total, 3 up, 3 in 2024-03-28T05:36:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:35 smithi086 ceph-mon[35163]: pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-28T05:36:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:35 smithi086 ceph-mon[35163]: osd.2 [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] boot 2024-03-28T05:36:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:35 smithi086 ceph-mon[35163]: osdmap e18: 3 total, 3 up, 3 in 2024-03-28T05:36:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-28T05:36:35.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_3 2024-03-28T05:36:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: osdmap e19: 3 total, 3 up, 3 in 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:36.787 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.788 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:36.788 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:36.788 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: osdmap e19: 3 total, 3 up, 3 in 2024-03-28T05:36:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: osdmap e19: 3 total, 3 up, 3 in 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:36:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:37.503 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: pgmap v108: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:37.504 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi159 2024-03-28T05:36:37.504 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 17091M 2024-03-28T05:36:37.504 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:37.504 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: osdmap e20: 3 total, 3 up, 3 in 2024-03-28T05:36:37.504 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: pgmap v108: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi159 2024-03-28T05:36:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 17091M 2024-03-28T05:36:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: osdmap e20: 3 total, 3 up, 3 in 2024-03-28T05:36:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: pgmap v108: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi159 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 17091M 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: osdmap e20: 3 total, 3 up, 3 in 2024-03-28T05:36:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 -- 172.21.15.55:0/3174953266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 msgr2=0x7fa2e8075010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 --2- 172.21.15.55:0/3174953266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e8075010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009990 tx=0x7fa2d4009ca0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 -- 172.21.15.55:0/3174953266 shutdown_connections 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 --2- 172.21.15.55:0/3174953266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 0x7fa2e810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 --2- 172.21.15.55:0/3174953266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e80745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 --2- 172.21.15.55:0/3174953266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e8075010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 -- 172.21.15.55:0/3174953266 >> 172.21.15.55:0/3174953266 conn(0x7fa2e80fd7b0 msgr2=0x7fa2e80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:36:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 -- 172.21.15.55:0/3174953266 shutdown_connections 2024-03-28T05:36:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.380+0000 7fa2ee600700 1 -- 172.21.15.55:0/3174953266 wait complete. 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.381+0000 7fa2ee600700 1 Processor -- start 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.381+0000 7fa2ee600700 1 -- start start 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 0x7fa2e81a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e810fec0 con 0x7fa2e8074b90 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e810fd40 con 0x7fa2e8076160 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2ee600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8110040 con 0x7fa2e810a0f0 2024-03-28T05:36:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2e7400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58518/0 (socket says 172.21.15.55:58518) 2024-03-28T05:36:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2e7400700 1 -- 172.21.15.55:0/2525490595 learned_addr learned my addr 172.21.15.55:0/2525490595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:36:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2e6a00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.382+0000 7fa2e7e00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 0x7fa2e81a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 -- 172.21.15.55:0/2525490595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 msgr2=0x7fa2e81a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 0x7fa2e81a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 -- 172.21.15.55:0/2525490595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 msgr2=0x7fa2e819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 -- 172.21.15.55:0/2525490595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e81a20e0 con 0x7fa2e8074b90 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e6a00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2e7400700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d980 tx=0x7fa2d800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8016070 con 0x7fa2e8074b90 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa2d8010460 con 0x7fa2e8074b90 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.383+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e81a23d0 con 0x7fa2e8074b90 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.384+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800f620 con 0x7fa2e8074b90 2024-03-28T05:36:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.384+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e81a2910 con 0x7fa2e8074b90 2024-03-28T05:36:38.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.385+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e8068e50 con 0x7fa2e8074b90 2024-03-28T05:36:38.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.389+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 15) v1 ==== 137234+0+0 (secure 0 0 0) 0x7fa2d8019070 con 0x7fa2e8074b90 2024-03-28T05:36:38.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.390+0000 7fa2dfe00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 0x7fa2cc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:36:38.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.391+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fa2d80cd210 con 0x7fa2e8074b90 2024-03-28T05:36:38.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.391+0000 7fa2e6a00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 0x7fa2cc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:36:38.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.391+0000 7fa2e6a00700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 0x7fa2cc0a4cc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40036e0 tx=0x7fa2d4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:36:38.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.393+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa2d809b6c0 con 0x7fa2e8074b90 2024-03-28T05:36:38.485 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[48911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:38.485 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[48911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:38.485 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[48911]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:38.485 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[48911]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.507+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa2d8097630 con 0x7fa2e8074b90 2024-03-28T05:36:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:36:38.640+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2e802de90 con 0x7fa2cc0a2800 2024-03-28T05:36:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:38 smithi086 ceph-mon[35163]: osdmap e21: 3 total, 3 up, 3 in 2024-03-28T05:36:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:38 smithi159 ceph-mon[36109]: osdmap e21: 3 total, 3 up, 3 in 2024-03-28T05:36:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-28T05:36:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:38 smithi055 ceph-mon[31863]: osdmap e21: 3 total, 3 up, 3 in 2024-03-28T05:36:39.372 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[49001]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:39.373 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[49001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:39.373 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[49001]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:39.373 INFO:journalctl@ceph.osd.0.smithi055.stdout:Mar 28 05:36:38 smithi055 sudo[49001]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: osdmap e22: 3 total, 3 up, 3 in 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:39.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:39.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:39.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-28T05:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: osdmap e22: 3 total, 3 up, 3 in 2024-03-28T05:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:39.819 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:39 smithi086 sudo[43807]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:39.819 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:39 smithi086 sudo[43807]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:39.819 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:39 smithi086 sudo[43807]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:39.819 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:39 smithi086 sudo[43807]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: osdmap e22: 3 total, 3 up, 3 in 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:40.569 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:40 smithi086 sudo[43810]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:40.569 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:40 smithi086 sudo[43810]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:40.569 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:40 smithi086 sudo[43810]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:40.569 INFO:journalctl@ceph.osd.1.smithi086.stdout:Mar 28 05:36:40 smithi086 sudo[43810]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:41.070 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:40 smithi159 sudo[45132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:41.071 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:40 smithi159 sudo[45132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:41.071 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:40 smithi159 sudo[45132]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:41.071 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:40 smithi159 sudo[45132]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:41 smithi086 ceph-mon[35163]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:41 smithi159 ceph-mon[36109]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:41.570 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:41 smithi159 sudo[45135]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:41.570 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:41 smithi159 sudo[45135]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:41.570 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:41 smithi159 sudo[45135]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:41.570 INFO:journalctl@ceph.osd.2.smithi159.stdout:Mar 28 05:36:41 smithi159 sudo[45135]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 ceph-mon[31863]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 sudo[49123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 sudo[49123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 sudo[49123]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:41 smithi055 sudo[49123]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:42 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:42 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 sudo[49151]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 sudo[49151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 sudo[49151]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 sudo[49151]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:36:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:42 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45138]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45138]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45138]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45138]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45141]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45141]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45141]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:43 smithi159 sudo[45141]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43825]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-28T05:36:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43825]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43825]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43825]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43828]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43828]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 sudo[43828]: pam_unix(sudo:session): session closed for user root 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:44 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]: dispatch 2024-03-28T05:36:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:44 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:44 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]: dispatch 2024-03-28T05:36:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]': finished 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: osdmap e23: 4 total, 3 up, 4 in 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:45 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3658059562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]': finished 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: osdmap e23: 4 total, 3 up, 4 in 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:45 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3658059562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-28T05:36:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1913554121' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7fdfb8b-c726-4cb0-9d81-c96524ccbd17"}]': finished 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: osdmap e23: 4 total, 3 up, 4 in 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:36:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:45 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3658059562' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:36:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:46 smithi055 ceph-mon[31863]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:46 smithi086 ceph-mon[35163]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:46 smithi159 ceph-mon[36109]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:36:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:48 smithi086 ceph-mon[35163]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-03-28T05:36:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:48 smithi159 ceph-mon[36109]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-03-28T05:36:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:48 smithi055 ceph-mon[31863]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-03-28T05:36:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:50 smithi086 ceph-mon[35163]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-03-28T05:36:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:50 smithi159 ceph-mon[36109]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-03-28T05:36:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:50 smithi055 ceph-mon[31863]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-03-28T05:36:53.202 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:52 smithi055 ceph-mon[31863]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:52 smithi086 ceph-mon[35163]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:52 smithi159 ceph-mon[36109]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:54 smithi086 ceph-mon[35163]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:54 smithi159 ceph-mon[36109]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:54 smithi055 ceph-mon[31863]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-03-28T05:36:56.286 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-28T05:36:56.286 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:56.286 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:56 smithi055 ceph-mon[31863]: Deploying daemon osd.3 on smithi055 2024-03-28T05:36:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-28T05:36:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:56 smithi086 ceph-mon[35163]: Deploying daemon osd.3 on smithi055 2024-03-28T05:36:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-28T05:36:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:36:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:56 smithi159 ceph-mon[36109]: Deploying daemon osd.3 on smithi055 2024-03-28T05:36:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:57 smithi055 ceph-mon[31863]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 843 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-28T05:36:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:57 smithi086 ceph-mon[35163]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 843 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-28T05:36:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:57 smithi159 ceph-mon[36109]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 843 B/s rd, 24 KiB/s wr, 2 op/s 2024-03-28T05:36:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:36:59 smithi055 ceph-mon[31863]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-03-28T05:36:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:36:59 smithi086 ceph-mon[35163]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-03-28T05:36:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:36:59 smithi159 ceph-mon[36109]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-03-28T05:37:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:01 smithi086 ceph-mon[35163]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:01 smithi159 ceph-mon[36109]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:01 smithi055 ceph-mon[31863]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:03.317 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:03 smithi055 ceph-mon[31863]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:03 smithi086 ceph-mon[35163]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:03 smithi159 ceph-mon[36109]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:04.721 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.721 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.721 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:05 smithi086 ceph-mon[35163]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:05 smithi159 ceph-mon[36109]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:05 smithi055 ceph-mon[31863]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:07.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:07 smithi055 ceph-mon[31863]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:07.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:07.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:07 smithi086 ceph-mon[35163]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:07 smithi159 ceph-mon[36109]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:08.338 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 3 on host 'smithi055' 2024-03-28T05:37:08.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.336+0000 7fa2dfe00700 1 -- 172.21.15.55:0/2525490595 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa2d4003950 con 0x7fa2cc0a2800 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 msgr2=0x7fa2cc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 0x7fa2cc0a4cc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40036e0 tx=0x7fa2d4005fd0 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 msgr2=0x7fa2e819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d980 tx=0x7fa2d800dd40 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 shutdown_connections 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.339+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2cc0a2800 0x7fa2cc0a4cc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2e8074b90 0x7fa2e819a480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2e810a0f0 0x7fa2e81a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 --2- 172.21.15.55:0/2525490595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e8076160 0x7fa2e819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 >> 172.21.15.55:0/2525490595 conn(0x7fa2e80fd7b0 msgr2=0x7fa2e8106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 shutdown_connections 2024-03-28T05:37:08.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:37:08.340+0000 7fa2ee600700 1 -- 172.21.15.55:0/2525490595 wait complete. 2024-03-28T05:37:09.062 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-28T05:37:09.062 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:09.062 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:09.063 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.063 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.063 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.063 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:09.118 DEBUG:teuthology.orchestra.run.smithi055:osd.3> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.3.service 2024-03-28T05:37:09.123 INFO:tasks.cephadm:Deploying osd.4 on smithi086 with /dev/vg_nvme/lv_3... 2024-03-28T05:37:09.123 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-28T05:37:09.566 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:37:09.923 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:09 smithi086 ceph-mon[35163]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:09.923 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:09 smithi086 ceph-mon[35163]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-28T05:37:09.923 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:09 smithi086 ceph-mon[35163]: osdmap e24: 4 total, 3 up, 4 in 2024-03-28T05:37:09.923 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:09 smithi086 ceph-mon[35163]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:37:09.923 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:09 smithi159 ceph-mon[36109]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:09 smithi159 ceph-mon[36109]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-28T05:37:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:09 smithi159 ceph-mon[36109]: osdmap e24: 4 total, 3 up, 4 in 2024-03-28T05:37:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:09 smithi159 ceph-mon[36109]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:37:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.083 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-mon[31863]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:10.083 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-mon[31863]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-28T05:37:10.083 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-mon[31863]: osdmap e24: 4 total, 3 up, 4 in 2024-03-28T05:37:10.083 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-mon[31863]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:37:10.084 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.084 INFO:journalctl@ceph.osd.3.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-3[51196]: 2024-03-28T05:37:09.709+0000 7fc85bc00700 -1 osd.3 0 waiting for initial osdmap 2024-03-28T05:37:10.084 INFO:journalctl@ceph.osd.3.smithi055.stdout:Mar 28 05:37:09 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-3[51196]: 2024-03-28T05:37:09.721+0000 7fc856a00700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:37:10.953 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:10 smithi055 ceph-mon[31863]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:37:10.953 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:10 smithi055 ceph-mon[31863]: osdmap e25: 4 total, 3 up, 4 in 2024-03-28T05:37:10.953 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.953 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.954 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:10 smithi055 ceph-mon[31863]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:10.980 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:10 smithi086 ceph-mon[35163]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:37:10.980 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:10 smithi086 ceph-mon[35163]: osdmap e25: 4 total, 3 up, 4 in 2024-03-28T05:37:10.980 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.980 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:10.980 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:10 smithi086 ceph-mon[35163]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:10 smithi159 ceph-mon[36109]: from='osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:10 smithi159 ceph-mon[36109]: osdmap e25: 4 total, 3 up, 4 in 2024-03-28T05:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:10 smithi159 ceph-mon[36109]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-03-28T05:37:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:11 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:37:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:11 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:37:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:11 smithi086 ceph-mon[35163]: osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] boot 2024-03-28T05:37:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:11 smithi086 ceph-mon[35163]: osdmap e26: 4 total, 4 up, 4 in 2024-03-28T05:37:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:11 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:37:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:11 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:37:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:11 smithi159 ceph-mon[36109]: osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] boot 2024-03-28T05:37:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:11 smithi159 ceph-mon[36109]: osdmap e26: 4 total, 4 up, 4 in 2024-03-28T05:37:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:11 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:11 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:11 smithi055 ceph-mon[31863]: osd.3 [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] boot 2024-03-28T05:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:11 smithi055 ceph-mon[31863]: osdmap e26: 4 total, 4 up, 4 in 2024-03-28T05:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0356926 s, 294 MB/s 2024-03-28T05:37:12.447 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-03-28T05:37:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:12 smithi086 ceph-mon[35163]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:12 smithi086 ceph-mon[35163]: osdmap e27: 4 total, 4 up, 4 in 2024-03-28T05:37:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:12 smithi159 ceph-mon[36109]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:12 smithi159 ceph-mon[36109]: osdmap e27: 4 total, 4 up, 4 in 2024-03-28T05:37:13.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:12 smithi055 ceph-mon[31863]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:13.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:12 smithi055 ceph-mon[31863]: osdmap e27: 4 total, 4 up, 4 in 2024-03-28T05:37:13.314 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi086:vg_nvme/lv_3 2024-03-28T05:37:13.722 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:37:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:13 smithi055 ceph-mon[31863]: osdmap e28: 4 total, 4 up, 4 in 2024-03-28T05:37:14.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:13 smithi086 ceph-mon[35163]: osdmap e28: 4 total, 4 up, 4 in 2024-03-28T05:37:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:13 smithi159 ceph-mon[36109]: osdmap e28: 4 total, 4 up, 4 in 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: osdmap e29: 4 total, 4 up, 4 in 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi055 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 8547M 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: osdmap e29: 4 total, 4 up, 4 in 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi055 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 8547M 2024-03-28T05:37:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: osdmap e29: 4 total, 4 up, 4 in 2024-03-28T05:37:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi055 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 8547M 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:15.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 -- 172.21.15.86:0/2275671534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4100ad0 msgr2=0x7f13d4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:15.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 --2- 172.21.15.86:0/2275671534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4100ad0 0x7f13d4100ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009990 tx=0x7f13c4009ca0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 -- 172.21.15.86:0/2275671534 shutdown_connections 2024-03-28T05:37:15.911 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 --2- 172.21.15.86:0/2275671534 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4101df0 0x7f13d4102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 --2- 172.21.15.86:0/2275671534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4100ad0 0x7f13d4100ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 --2- 172.21.15.86:0/2275671534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101430 0x7f13d41018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 -- 172.21.15.86:0/2275671534 >> 172.21.15.86:0/2275671534 conn(0x7f13d40fc690 msgr2=0x7f13d40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:37:15.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 -- 172.21.15.86:0/2275671534 shutdown_connections 2024-03-28T05:37:15.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.911+0000 7f13da000700 1 -- 172.21.15.86:0/2275671534 wait complete. 2024-03-28T05:37:15.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.912+0000 7f13da000700 1 Processor -- start 2024-03-28T05:37:15.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.912+0000 7f13da000700 1 -- start start 2024-03-28T05:37:15.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4100ad0 0x7f13d419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:15.914 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 0x7f13d41a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d410fea0 con 0x7f13d4101df0 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d410fd20 con 0x7f13d4101430 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13da000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4110020 con 0x7f13d4100ad0 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13cbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13cbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51454/0 (socket says 172.21.15.86:51454) 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13cbe00700 1 -- 172.21.15.86:0/744053631 learned_addr learned my addr 172.21.15.86:0/744053631 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.913+0000 7f13d3400700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4100ad0 0x7f13d419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13d3e00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 0x7f13d41a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 -- 172.21.15.86:0/744053631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4100ad0 msgr2=0x7f13d419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4100ad0 0x7f13d419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 -- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 msgr2=0x7f13d41a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:15.915 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 0x7f13d41a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 -- 172.21.15.86:0/744053631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d41a20f0 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13d3e00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 0x7f13d41a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13cbe00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c920 tx=0x7f13bc00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc007b00 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f13bc004ce0 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d41a23e0 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc005600 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.914+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d41a2920 con 0x7f13d4101430 2024-03-28T05:37:15.916 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.916+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d4068e50 con 0x7f13d4101430 2024-03-28T05:37:15.918 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.918+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f13bc004750 con 0x7f13d4101430 2024-03-28T05:37:15.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.919+0000 7f13d0c00700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 0x7f13b80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:15.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.919+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f13bc0cd900 con 0x7f13d4101430 2024-03-28T05:37:15.919 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.920+0000 7f13d3400700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 0x7f13b80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:15.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.921+0000 7f13d3400700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 0x7f13b80a4d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13c40036e0 tx=0x7f13c4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:37:15.922 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:15.923+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f13bc014030 con 0x7f13d4101430 2024-03-28T05:37:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:15 smithi086 ceph-mon[35163]: osdmap e30: 4 total, 4 up, 4 in 2024-03-28T05:37:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:15 smithi159 ceph-mon[36109]: osdmap e30: 4 total, 4 up, 4 in 2024-03-28T05:37:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:15 smithi055 ceph-mon[31863]: osdmap e30: 4 total, 4 up, 4 in 2024-03-28T05:37:16.154 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:16.154+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f13d40625d0 con 0x7f13b80a2890 2024-03-28T05:37:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:16 smithi086 ceph-mon[35163]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:16 smithi086 ceph-mon[35163]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:16 smithi159 ceph-mon[36109]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:16 smithi159 ceph-mon[36109]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:16 smithi055 ceph-mon[31863]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:16 smithi055 ceph-mon[31863]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:18.921 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:18 smithi086 ceph-mon[35163]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:37:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:18 smithi159 ceph-mon[36109]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:37:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:18 smithi055 ceph-mon[31863]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/162882713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]': finished 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: osdmap e31: 5 total, 4 up, 5 in 2024-03-28T05:37:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/162882713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]': finished 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: osdmap e31: 5 total, 4 up, 5 in 2024-03-28T05:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/162882713' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]: dispatch 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d81c2c4b-5f5f-4b51-ab13-740a305476a5"}]': finished 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: osdmap e31: 5 total, 4 up, 5 in 2024-03-28T05:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:21 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/589308413' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:21 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/589308413' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:21 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/589308413' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:22 smithi086 ceph-mon[35163]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:37:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:22 smithi159 ceph-mon[36109]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:37:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:22 smithi055 ceph-mon[31863]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:37:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:24 smithi086 ceph-mon[35163]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-28T05:37:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:24 smithi159 ceph-mon[36109]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-28T05:37:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:24 smithi055 ceph-mon[31863]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-28T05:37:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:26 smithi055 ceph-mon[31863]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-28T05:37:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:26 smithi086 ceph-mon[35163]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-28T05:37:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:26 smithi159 ceph-mon[36109]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-28T05:37:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:28 smithi055 ceph-mon[31863]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:29.199 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:28 smithi086 ceph-mon[35163]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:28 smithi159 ceph-mon[36109]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-28T05:37:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:29 smithi055 ceph-mon[31863]: Deploying daemon osd.4 on smithi086 2024-03-28T05:37:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-28T05:37:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:29 smithi086 ceph-mon[35163]: Deploying daemon osd.4 on smithi086 2024-03-28T05:37:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-28T05:37:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:29 smithi159 ceph-mon[36109]: Deploying daemon osd.4 on smithi086 2024-03-28T05:37:30.942 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:30 smithi086 ceph-mon[35163]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:30 smithi055 ceph-mon[31863]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:31.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:30 smithi159 ceph-mon[36109]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:32 smithi159 ceph-mon[36109]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:32 smithi055 ceph-mon[31863]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:33.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:32 smithi086 ceph-mon[35163]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:35.123 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:34 smithi086 ceph-mon[35163]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:34 smithi055 ceph-mon[31863]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:34 smithi159 ceph-mon[36109]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:36 smithi055 ceph-mon[31863]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:37.296 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:36 smithi086 ceph-mon[35163]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:36 smithi159 ceph-mon[36109]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:38 smithi086 ceph-mon[35163]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:38 smithi055 ceph-mon[31863]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:38 smithi159 ceph-mon[36109]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:40 smithi055 ceph-mon[31863]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:41.249 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:40 smithi086 ceph-mon[35163]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:40 smithi159 ceph-mon[36109]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:42.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.675+0000 7f13d0c00700 1 -- 172.21.15.86:0/744053631 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f13d40625d0 con 0x7f13b80a2890 2024-03-28T05:37:42.676 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 4 on host 'smithi086' 2024-03-28T05:37:42.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 msgr2=0x7f13b80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:42.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 0x7f13b80a4d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13c40036e0 tx=0x7f13c4005fd0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 msgr2=0x7f13d419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c920 tx=0x7f13bc00cce0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 shutdown_connections 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f13b80a2890 0x7f13b80a4d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13d4101df0 0x7f13d41a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13d4100ad0 0x7f13d419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 --2- 172.21.15.86:0/744053631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13d4101430 0x7f13d419a9d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 >> 172.21.15.86:0/744053631 conn(0x7f13d40fc690 msgr2=0x7f13d40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.678+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 shutdown_connections 2024-03-28T05:37:42.680 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:37:42.679+0000 7f13da000700 1 -- 172.21.15.86:0/744053631 wait complete. 2024-03-28T05:37:42.846 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:42.846 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:42.846 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:42 smithi159 ceph-mon[36109]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:42.846 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:42 smithi159 ceph-mon[36109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:42 smithi055 ceph-mon[31863]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:42 smithi055 ceph-mon[31863]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:42 smithi086 ceph-mon[35163]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:42 smithi086 ceph-mon[35163]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-28T05:37:43.490 DEBUG:teuthology.orchestra.run.smithi086:osd.4> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.4.service 2024-03-28T05:37:43.494 INFO:tasks.cephadm:Deploying osd.5 on smithi159 with /dev/vg_nvme/lv_3... 2024-03-28T05:37:43.495 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-28T05:37:43.768 INFO:journalctl@ceph.osd.4.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-4[46527]: 2024-03-28T05:37:43.642+0000 7fa1aac00700 -1 osd.4 0 waiting for initial osdmap 2024-03-28T05:37:43.768 INFO:journalctl@ceph.osd.4.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-4[46527]: 2024-03-28T05:37:43.651+0000 7fa1a5a00700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: osdmap e32: 5 total, 4 up, 5 in 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:43.769 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:43.928 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: osdmap e32: 5 total, 4 up, 5 in 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-28T05:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: osdmap e32: 5 total, 4 up, 5 in 2024-03-28T05:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:37:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:44.936 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:44 smithi159 ceph-mon[36109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:37:44.936 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:44 smithi159 ceph-mon[36109]: osdmap e33: 5 total, 4 up, 5 in 2024-03-28T05:37:44.936 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:44.936 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:44 smithi055 ceph-mon[31863]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:37:45.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:44 smithi055 ceph-mon[31863]: osdmap e33: 5 total, 4 up, 5 in 2024-03-28T05:37:45.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:44 smithi086 ceph-mon[35163]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:37:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:44 smithi086 ceph-mon[35163]: osdmap e33: 5 total, 4 up, 5 in 2024-03-28T05:37:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] boot 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: osdmap e34: 5 total, 5 up, 5 in 2024-03-28T05:37:45.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:45.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:37:45.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:37:45.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:45.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] boot 2024-03-28T05:37:45.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: osdmap e34: 5 total, 5 up, 5 in 2024-03-28T05:37:45.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:37:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:37:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-03-28T05:37:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: osd.4 [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] boot 2024-03-28T05:37:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: osdmap e34: 5 total, 5 up, 5 in 2024-03-28T05:37:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0356617 s, 294 MB/s 2024-03-28T05:37:46.722 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-03-28T05:37:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:46 smithi086 ceph-mon[35163]: osdmap e35: 5 total, 5 up, 5 in 2024-03-28T05:37:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:46 smithi159 ceph-mon[36109]: osdmap e35: 5 total, 5 up, 5 in 2024-03-28T05:37:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:46 smithi055 ceph-mon[31863]: osdmap e35: 5 total, 5 up, 5 in 2024-03-28T05:37:47.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-03-28T05:37:48.004 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:37:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:47 smithi086 ceph-mon[35163]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:47 smithi159 ceph-mon[36109]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:47 smithi055 ceph-mon[31863]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:49.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:49.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi086 2024-03-28T05:37:49.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.705 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 8545M 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.706 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi086 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 8545M 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi086 2024-03-28T05:37:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 8545M 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 -- 172.21.15.159:0/3352367103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e4102c60 msgr2=0x7f21e4109510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 --2- 172.21.15.159:0/3352367103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e4102c60 0x7f21e4109510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00b0a0 tx=0x7f21dc00b3b0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 -- 172.21.15.159:0/3352367103 shutdown_connections 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 --2- 172.21.15.159:0/3352367103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e4102c60 0x7f21e4109510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 --2- 172.21.15.159:0/3352367103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41010c0 0x7f21e41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 --2- 172.21.15.159:0/3352367103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e41022c0 0x7f21e4102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 -- 172.21.15.159:0/3352367103 >> 172.21.15.159:0/3352367103 conn(0x7f21e40fc660 msgr2=0x7f21e40feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:37:49.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 -- 172.21.15.159:0/3352367103 shutdown_connections 2024-03-28T05:37:49.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.873+0000 7f21ea200700 1 -- 172.21.15.159:0/3352367103 wait complete. 2024-03-28T05:37:49.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.874+0000 7f21ea200700 1 Processor -- start 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 -- start start 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41022c0 0x7f21e41036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e4102c60 0x7f21e4103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e410cb90 con 0x7f21e4102c60 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e410ca10 con 0x7f21e41022c0 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21ea200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e410cd10 con 0x7f21e41010c0 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21e3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21e3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47128/0 (socket says 172.21.15.159:47128) 2024-03-28T05:37:49.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.875+0000 7f21e3400700 1 -- 172.21.15.159:0/3627331572 learned_addr learned my addr 172.21.15.159:0/3627331572 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21daa00700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41022c0 0x7f21e41036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3e00700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e4102c60 0x7f21e4103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 -- 172.21.15.159:0/3627331572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41022c0 msgr2=0x7f21e41036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41022c0 0x7f21e41036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 -- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e4102c60 msgr2=0x7f21e4103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e4102c60 0x7f21e4103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 -- 172.21.15.159:0/3627331572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e41044b0 con 0x7f21e41010c0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e3400700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21d400d980 tx=0x7f21d400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.876+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4016070 con 0x7f21e41010c0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.877+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f21d400bb60 con 0x7f21e41010c0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.877+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e41a2470 con 0x7f21e41010c0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.877+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d400f3c0 con 0x7f21e41010c0 2024-03-28T05:37:49.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.877+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e41a29d0 con 0x7f21e41010c0 2024-03-28T05:37:49.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.878+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e4068e50 con 0x7f21e41010c0 2024-03-28T05:37:49.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.880+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f21d4019070 con 0x7f21e41010c0 2024-03-28T05:37:49.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.881+0000 7f21e0c00700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 0x7f21c80a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:37:49.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.882+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f21d40cdf20 con 0x7f21e41010c0 2024-03-28T05:37:49.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.882+0000 7f21daa00700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 0x7f21c80a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:37:49.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.883+0000 7f21daa00700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 0x7f21c80a4dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21cc005950 tx=0x7f21cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:37:49.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:49.885+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f21d4020020 con 0x7f21e41010c0 2024-03-28T05:37:50.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:37:50.119+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f21e40fe850 con 0x7f21c80a2910 2024-03-28T05:37:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:37:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:37:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:37:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:51 smithi159 ceph-mon[36109]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:51 smithi159 ceph-mon[36109]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:51 smithi086 ceph-mon[35163]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:51 smithi086 ceph-mon[35163]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:51 smithi055 ceph-mon[31863]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:51 smithi055 ceph-mon[31863]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:37:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:53 smithi086 ceph-mon[35163]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:53 smithi159 ceph-mon[36109]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:53 smithi055 ceph-mon[31863]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:54 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/2368246073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:54 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:54 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]': finished 2024-03-28T05:37:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:54 smithi086 ceph-mon[35163]: osdmap e36: 6 total, 5 up, 6 in 2024-03-28T05:37:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:54 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/2368246073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:54 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:54 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]': finished 2024-03-28T05:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:54 smithi159 ceph-mon[36109]: osdmap e36: 6 total, 5 up, 6 in 2024-03-28T05:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:54 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/2368246073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:54 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]: dispatch 2024-03-28T05:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:54 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db884aaf-8559-4c28-a521-57ee113e3107"}]': finished 2024-03-28T05:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:54 smithi055 ceph-mon[31863]: osdmap e36: 6 total, 5 up, 6 in 2024-03-28T05:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:37:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:55 smithi055 ceph-mon[31863]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:55 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/1217704444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:55 smithi086 ceph-mon[35163]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:55 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/1217704444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:55 smithi159 ceph-mon[36109]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:55 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/1217704444' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:37:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:57 smithi055 ceph-mon[31863]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:57 smithi086 ceph-mon[35163]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:57 smithi159 ceph-mon[36109]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:37:59 smithi159 ceph-mon[36109]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:37:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:37:59 smithi055 ceph-mon[31863]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:37:59 smithi086 ceph-mon[35163]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:01.675 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:01 smithi159 ceph-mon[36109]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:01 smithi055 ceph-mon[31863]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:01 smithi086 ceph-mon[35163]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:03 smithi055 ceph-mon[31863]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-28T05:38:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:03 smithi086 ceph-mon[35163]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-28T05:38:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:03 smithi159 ceph-mon[36109]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-28T05:38:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:04.644 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:04 smithi159 ceph-mon[36109]: Deploying daemon osd.5 on smithi159 2024-03-28T05:38:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:04 smithi055 ceph-mon[31863]: Deploying daemon osd.5 on smithi159 2024-03-28T05:38:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:04 smithi086 ceph-mon[35163]: Deploying daemon osd.5 on smithi159 2024-03-28T05:38:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:05 smithi055 ceph-mon[31863]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:05.936 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:05 smithi159 ceph-mon[36109]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:05 smithi086 ceph-mon[35163]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:07.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:07 smithi159 ceph-mon[36109]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:07 smithi086 ceph-mon[35163]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:07 smithi055 ceph-mon[31863]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:09.791 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:09 smithi159 ceph-mon[36109]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:09 smithi086 ceph-mon[35163]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:09 smithi055 ceph-mon[31863]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:12.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:11 smithi159 ceph-mon[36109]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:12.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.018 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:11 smithi086 ceph-mon[35163]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:11 smithi055 ceph-mon[31863]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:13 smithi086 ceph-mon[35163]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:13 smithi159 ceph-mon[36109]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:13 smithi055 ceph-mon[31863]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:15.397 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:15.398 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:15 smithi159 ceph-mon[36109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:15.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.537+0000 7f21e0c00700 1 -- 172.21.15.159:0/3627331572 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f21e40fe850 con 0x7f21c80a2910 2024-03-28T05:38:15.539 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 5 on host 'smithi159' 2024-03-28T05:38:15.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 msgr2=0x7f21c80a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:15.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 0x7f21c80a4dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21cc005950 tx=0x7f21cc0058e0 comp rx=0 tx=0).stop 2024-03-28T05:38:15.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 msgr2=0x7f21e4105000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:15.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21d400d980 tx=0x7f21d400dd40 comp rx=0 tx=0).stop 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 shutdown_connections 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f21c80a2910 0x7f21c80a4dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e4102c60 0x7f21e4103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21e41010c0 0x7f21e4105000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 --2- 172.21.15.159:0/3627331572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21e41022c0 0x7f21e41036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.541+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 >> 172.21.15.159:0/3627331572 conn(0x7f21e40fc660 msgr2=0x7f21e40fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.542+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 shutdown_connections 2024-03-28T05:38:15.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:38:15.542+0000 7f21ea200700 1 -- 172.21.15.159:0/3627331572 wait complete. 2024-03-28T05:38:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:15 smithi086 ceph-mon[35163]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:15.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:15.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:15 smithi055 ceph-mon[31863]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-28T05:38:16.257 DEBUG:teuthology.orchestra.run.smithi159:osd.5> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.5.service 2024-03-28T05:38:16.262 INFO:tasks.cephadm:Deploying osd.6 on smithi055 with /dev/vg_nvme/lv_2... 2024-03-28T05:38:16.262 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: osdmap e37: 6 total, 5 up, 6 in 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:16 smithi055 ceph-mon[31863]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:16.738 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: osdmap e37: 6 total, 5 up, 6 in 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:16.779 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:16 smithi159 ceph-mon[36109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-28T05:38:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: osdmap e37: 6 total, 5 up, 6 in 2024-03-28T05:38:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:16 smithi086 ceph-mon[35163]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: osdmap e38: 6 total, 5 up, 6 in 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: osdmap e39: 6 total, 5 up, 6 in 2024-03-28T05:38:17.736 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:17.737 INFO:journalctl@ceph.osd.5.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-5[48030]: 2024-03-28T05:38:17.699+0000 7f420f600700 -1 osd.5 0 waiting for initial osdmap 2024-03-28T05:38:17.737 INFO:journalctl@ceph.osd.5.smithi159.stdout:Mar 28 05:38:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-5[48030]: 2024-03-28T05:38:17.735+0000 7f4205400700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: osdmap e38: 6 total, 5 up, 6 in 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: osdmap e39: 6 total, 5 up, 6 in 2024-03-28T05:38:17.915 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: osdmap e38: 6 total, 5 up, 6 in 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: osdmap e39: 6 total, 5 up, 6 in 2024-03-28T05:38:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: from='osd.5 ' entity='osd.5' 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] boot 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: osdmap e40: 6 total, 6 up, 6 in 2024-03-28T05:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: from='osd.5 ' entity='osd.5' 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] boot 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: osdmap e40: 6 total, 6 up, 6 in 2024-03-28T05:38:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: from='osd.5 ' entity='osd.5' 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: osd.5 [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] boot 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: osdmap e40: 6 total, 6 up, 6 in 2024-03-28T05:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-28T05:38:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-28T05:38:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-28T05:38:19.645 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-03-28T05:38:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-03-28T05:38:19.645 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0397728 s, 264 MB/s 2024-03-28T05:38:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-03-28T05:38:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:19 smithi055 ceph-mon[31863]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:19 smithi055 ceph-mon[31863]: osdmap e41: 6 total, 6 up, 6 in 2024-03-28T05:38:20.037 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:19 smithi159 ceph-mon[36109]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:20.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:19 smithi159 ceph-mon[36109]: osdmap e41: 6 total, 6 up, 6 in 2024-03-28T05:38:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:19 smithi086 ceph-mon[35163]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-03-28T05:38:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:19 smithi086 ceph-mon[35163]: osdmap e41: 6 total, 6 up, 6 in 2024-03-28T05:38:20.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_2 2024-03-28T05:38:21.002 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:38:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi159 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 8545M 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:21 smithi086 ceph-mon[35163]: osdmap e42: 6 total, 6 up, 6 in 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi159 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 8545M 2024-03-28T05:38:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:21 smithi159 ceph-mon[36109]: osdmap e42: 6 total, 6 up, 6 in 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi159 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 8545M 2024-03-28T05:38:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:21 smithi055 ceph-mon[31863]: osdmap e42: 6 total, 6 up, 6 in 2024-03-28T05:38:22.990 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:22 smithi055 ceph-mon[31863]: osdmap e43: 6 total, 6 up, 6 in 2024-03-28T05:38:22.990 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:22 smithi055 ceph-mon[31863]: pgmap v185: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-28T05:38:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:22 smithi086 ceph-mon[35163]: osdmap e43: 6 total, 6 up, 6 in 2024-03-28T05:38:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:22 smithi086 ceph-mon[35163]: pgmap v185: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-28T05:38:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:22 smithi159 ceph-mon[36109]: osdmap e43: 6 total, 6 up, 6 in 2024-03-28T05:38:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:22 smithi159 ceph-mon[36109]: pgmap v185: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.165+0000 7ff22d600700 1 -- 172.21.15.55:0/1156599888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff228102c60 msgr2=0x7ff228109510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.165+0000 7ff22d600700 1 --2- 172.21.15.55:0/1156599888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff228102c60 0x7ff228109510 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22000b0d0 tx=0x7ff22000b3e0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 -- 172.21.15.55:0/1156599888 shutdown_connections 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 --2- 172.21.15.55:0/1156599888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff228102c60 0x7ff228109510 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 --2- 172.21.15.55:0/1156599888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff2281014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 --2- 172.21.15.55:0/1156599888 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff2281022c0 0x7ff228102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 -- 172.21.15.55:0/1156599888 >> 172.21.15.55:0/1156599888 conn(0x7ff2280fc680 msgr2=0x7ff2280feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 -- 172.21.15.55:0/1156599888 shutdown_connections 2024-03-28T05:38:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.166+0000 7ff22d600700 1 -- 172.21.15.55:0/1156599888 wait complete. 2024-03-28T05:38:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 Processor -- start 2024-03-28T05:38:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 -- start start 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff22819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff228102c60 0x7ff2281a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22810cb40 con 0x7ff2281022c0 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22810c9c0 con 0x7ff2281010c0 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.167+0000 7ff22d600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22810ccc0 con 0x7ff228102c60 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39444/0 (socket says 172.21.15.55:39444) 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 -- 172.21.15.55:0/3102050519 learned_addr learned my addr 172.21.15.55:0/3102050519 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226a00700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff22819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff227400700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff228102c60 0x7ff2281a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 -- 172.21.15.55:0/3102050519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff228102c60 msgr2=0x7ff2281a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff228102c60 0x7ff2281a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 -- 172.21.15.55:0/3102050519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 msgr2=0x7ff22819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff22819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226000700 1 -- 172.21.15.55:0/3102050519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2281a20e0 con 0x7ff2281022c0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.168+0000 7ff226a00700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff22819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff226000700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d980 tx=0x7ff21400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214016070 con 0x7ff2281022c0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff214010460 con 0x7ff2281022c0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2281a23d0 con 0x7ff2281022c0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400f620 con 0x7ff2281022c0 2024-03-28T05:38:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.169+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2281a2910 con 0x7ff2281022c0 2024-03-28T05:38:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.170+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff228068e50 con 0x7ff2281022c0 2024-03-28T05:38:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.174+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7ff214019070 con 0x7ff2281022c0 2024-03-28T05:38:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.175+0000 7ff21f400700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 0x7ff20c0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.175+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4533+0+0 (secure 0 0 0) 0x7ff2140cd810 con 0x7ff2281022c0 2024-03-28T05:38:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.176+0000 7ff226a00700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 0x7ff20c0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.176+0000 7ff226a00700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 0x7ff20c0a4d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff218005950 tx=0x7ff2180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:38:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.179+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7ff21409b6d0 con 0x7ff2281022c0 2024-03-28T05:38:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:23.418+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff22806afc0 con 0x7ff20c0a2890 2024-03-28T05:38:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:23 smithi086 ceph-mon[35163]: osdmap e44: 6 total, 6 up, 6 in 2024-03-28T05:38:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:23 smithi086 ceph-mon[35163]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:38:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:23 smithi159 ceph-mon[36109]: osdmap e44: 6 total, 6 up, 6 in 2024-03-28T05:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:23 smithi159 ceph-mon[36109]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:23 smithi055 ceph-mon[31863]: osdmap e44: 6 total, 6 up, 6 in 2024-03-28T05:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:23 smithi055 ceph-mon[31863]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:24 smithi086 ceph-mon[35163]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-28T05:38:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:24 smithi159 ceph-mon[36109]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-28T05:38:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:24 smithi055 ceph-mon[31863]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-28T05:38:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:26 smithi086 ceph-mon[35163]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:38:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:26 smithi159 ceph-mon[36109]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:38:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:26 smithi055 ceph-mon[31863]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-28T05:38:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:27 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]: dispatch 2024-03-28T05:38:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:27 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]': finished 2024-03-28T05:38:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:27 smithi086 ceph-mon[35163]: osdmap e45: 7 total, 6 up, 7 in 2024-03-28T05:38:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:27 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]: dispatch 2024-03-28T05:38:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:27 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]': finished 2024-03-28T05:38:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:27 smithi159 ceph-mon[36109]: osdmap e45: 7 total, 6 up, 7 in 2024-03-28T05:38:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:27 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]: dispatch 2024-03-28T05:38:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:27 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/696297525' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f026158b-3c5a-4fc7-866c-86f5adc9d2f0"}]': finished 2024-03-28T05:38:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:27 smithi055 ceph-mon[31863]: osdmap e45: 7 total, 6 up, 7 in 2024-03-28T05:38:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:28 smithi086 ceph-mon[35163]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:28 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/827393934' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:38:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:28 smithi159 ceph-mon[36109]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:28 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/827393934' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:38:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:28 smithi055 ceph-mon[31863]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:28 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/827393934' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:38:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:30 smithi086 ceph-mon[35163]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:30 smithi159 ceph-mon[36109]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:30 smithi055 ceph-mon[31863]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:33 smithi159 ceph-mon[36109]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:33 smithi086 ceph-mon[35163]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:33 smithi055 ceph-mon[31863]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:35 smithi086 ceph-mon[35163]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:35 smithi159 ceph-mon[36109]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:35.342 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:35 smithi055 ceph-mon[31863]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:37 smithi055 ceph-mon[31863]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:37 smithi086 ceph-mon[35163]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:37 smithi159 ceph-mon[36109]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:39 smithi086 ceph-mon[35163]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-28T05:38:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:39 smithi086 ceph-mon[35163]: Deploying daemon osd.6 on smithi055 2024-03-28T05:38:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:39 smithi159 ceph-mon[36109]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-28T05:38:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:39 smithi159 ceph-mon[36109]: Deploying daemon osd.6 on smithi055 2024-03-28T05:38:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:39 smithi055 ceph-mon[31863]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-28T05:38:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:39 smithi055 ceph-mon[31863]: Deploying daemon osd.6 on smithi055 2024-03-28T05:38:41.179 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:41 smithi055 ceph-mon[31863]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:41 smithi086 ceph-mon[35163]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:41 smithi159 ceph-mon[36109]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:43.309 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:43 smithi055 ceph-mon[31863]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:43 smithi086 ceph-mon[35163]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:43 smithi159 ceph-mon[36109]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:45 smithi055 ceph-mon[31863]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:45 smithi086 ceph-mon[35163]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:45 smithi159 ceph-mon[36109]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:47.654 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:47 smithi055 ceph-mon[31863]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:47.654 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:47.654 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:47.654 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:47 smithi086 ceph-mon[35163]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:47 smithi159 ceph-mon[36109]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:49 smithi055 ceph-mon[31863]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:49 smithi086 ceph-mon[35163]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:49 smithi159 ceph-mon[36109]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:50.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.913+0000 7ff21f400700 1 -- 172.21.15.55:0/3102050519 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff22806afc0 con 0x7ff20c0a2890 2024-03-28T05:38:50.915 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 6 on host 'smithi055' 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 msgr2=0x7ff20c0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 0x7ff20c0a4d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff218005950 tx=0x7ff2180058e0 comp rx=0 tx=0).stop 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 msgr2=0x7ff22819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d980 tx=0x7ff21400dd40 comp rx=0 tx=0).stop 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 shutdown_connections 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff20c0a2890 0x7ff20c0a4d50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:50.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff228102c60 0x7ff2281a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2281010c0 0x7ff22819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 --2- 172.21.15.55:0/3102050519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2281022c0 0x7ff22819a9c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 >> 172.21.15.55:0/3102050519 conn(0x7ff2280fc680 msgr2=0x7ff22806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:38:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 shutdown_connections 2024-03-28T05:38:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:38:50.917+0000 7ff22d600700 1 -- 172.21.15.55:0/3102050519 wait complete. 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-28T05:38:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:38:51.692 DEBUG:teuthology.orchestra.run.smithi055:osd.6> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.6.service 2024-03-28T05:38:51.696 INFO:tasks.cephadm:Deploying osd.7 on smithi086 with /dev/vg_nvme/lv_2... 2024-03-28T05:38:51.696 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-28T05:38:52.130 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:38:52.204 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:52 smithi055 ceph-mon[31863]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-28T05:38:52.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:52 smithi055 ceph-mon[31863]: osdmap e46: 7 total, 6 up, 7 in 2024-03-28T05:38:52.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:52 smithi055 ceph-mon[31863]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:38:52.205 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:52.344 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:52 smithi086 ceph-mon[35163]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-28T05:38:52.344 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:52 smithi086 ceph-mon[35163]: osdmap e46: 7 total, 6 up, 7 in 2024-03-28T05:38:52.344 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:52 smithi086 ceph-mon[35163]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:38:52.344 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:52 smithi159 ceph-mon[36109]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-28T05:38:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:52 smithi159 ceph-mon[36109]: osdmap e46: 7 total, 6 up, 7 in 2024-03-28T05:38:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:52 smithi159 ceph-mon[36109]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:38:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.341 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-mon[31863]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:53.341 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-mon[31863]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:38:53.341 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-mon[31863]: osdmap e47: 7 total, 6 up, 7 in 2024-03-28T05:38:53.341 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.342 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.342 INFO:journalctl@ceph.osd.6.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-6[58130]: 2024-03-28T05:38:53.175+0000 7fc097a00700 -1 osd.6 0 waiting for initial osdmap 2024-03-28T05:38:53.342 INFO:journalctl@ceph.osd.6.smithi055.stdout:Mar 28 05:38:53 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-6[58130]: 2024-03-28T05:38:53.212+0000 7fc08d800700 -1 osd.6 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:38:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:53 smithi086 ceph-mon[35163]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:53 smithi086 ceph-mon[35163]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:38:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:53 smithi086 ceph-mon[35163]: osdmap e47: 7 total, 6 up, 7 in 2024-03-28T05:38:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:53 smithi159 ceph-mon[36109]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:53 smithi159 ceph-mon[36109]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:38:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:53 smithi159 ceph-mon[36109]: osdmap e47: 7 total, 6 up, 7 in 2024-03-28T05:38:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:54.285 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:54 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:38:54.285 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:54 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:38:54.285 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:54.285 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:54 smithi086 ceph-mon[35163]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' 2024-03-28T05:38:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:54 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:38:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:54 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:38:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:54 smithi055 ceph-mon[31863]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' 2024-03-28T05:38:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:54 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:38:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:54 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:38:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:54 smithi159 ceph-mon[36109]: from='osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926]' entity='osd.6' 2024-03-28T05:38:55.125 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-28T05:38:55.125 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-28T05:38:55.125 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-03-28T05:38:55.125 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-03-28T05:38:55.126 INFO:teuthology.orchestra.run.smithi086.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0614201 s, 171 MB/s 2024-03-28T05:38:55.126 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-03-28T05:38:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:55 smithi055 ceph-mon[31863]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:55 smithi055 ceph-mon[31863]: osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] boot 2024-03-28T05:38:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:55 smithi055 ceph-mon[31863]: osdmap e48: 7 total, 7 up, 7 in 2024-03-28T05:38:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:55 smithi086 ceph-mon[35163]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:55 smithi086 ceph-mon[35163]: osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] boot 2024-03-28T05:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:55 smithi086 ceph-mon[35163]: osdmap e48: 7 total, 7 up, 7 in 2024-03-28T05:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:55 smithi159 ceph-mon[36109]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-03-28T05:38:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:55 smithi159 ceph-mon[36109]: osd.6 [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] boot 2024-03-28T05:38:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:55 smithi159 ceph-mon[36109]: osdmap e48: 7 total, 7 up, 7 in 2024-03-28T05:38:55.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-28T05:38:56.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi086:vg_nvme/lv_2 2024-03-28T05:38:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:56 smithi086 ceph-mon[35163]: osdmap e49: 7 total, 7 up, 7 in 2024-03-28T05:38:56.438 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:38:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:56 smithi159 ceph-mon[36109]: osdmap e49: 7 total, 7 up, 7 in 2024-03-28T05:38:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:56 smithi055 ceph-mon[31863]: osdmap e49: 7 total, 7 up, 7 in 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi055 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 5698M 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi055 2024-03-28T05:38:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 5698M 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi055 2024-03-28T05:38:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 5698M 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:38:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:38:58.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 -- 172.21.15.86:0/355339874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60104410 msgr2=0x7f8c60104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:58.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 --2- 172.21.15.86:0/355339874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60104410 0x7f8c60104830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c500099c0 tx=0x7f8c50009cd0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.670 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 -- 172.21.15.86:0/355339874 shutdown_connections 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 --2- 172.21.15.86:0/355339874 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60105fb0 0x7f8c6010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 --2- 172.21.15.86:0/355339874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60104410 0x7f8c60104830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 --2- 172.21.15.86:0/355339874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105610 0x7f8c60105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 -- 172.21.15.86:0/355339874 >> 172.21.15.86:0/355339874 conn(0x7f8c600ff9b0 msgr2=0x7f8c60101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 -- 172.21.15.86:0/355339874 shutdown_connections 2024-03-28T05:38:58.671 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.669+0000 7f8c66e00700 1 -- 172.21.15.86:0/355339874 wait complete. 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.670+0000 7f8c66e00700 1 Processor -- start 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.670+0000 7f8c66e00700 1 -- start start 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60104410 0x7f8c6019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 0x7f8c601a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6010fee0 con 0x7f8c60104410 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6010fd60 con 0x7f8c60105610 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c66e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60110060 con 0x7f8c60105fb0 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:58.672 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:51912/0 (socket says 172.21.15.86:51912) 2024-03-28T05:38:58.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 -- 172.21.15.86:0/867665007 learned_addr learned my addr 172.21.15.86:0/867665007 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-03-28T05:38:58.673 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c64e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 0x7f8c601a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c5fe00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60104410 0x7f8c6019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 -- 172.21.15.86:0/867665007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 msgr2=0x7f8c601a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 0x7f8c601a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.671+0000 7f8c57400700 1 -- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60104410 msgr2=0x7f8c6019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c57400700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60104410 0x7f8c6019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c57400700 1 -- 172.21.15.86:0/867665007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c601a2150 con 0x7f8c60105610 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c64e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 0x7f8c601a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c57400700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c48007e20 tx=0x7f8c4800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48016020 con 0x7f8c60105610 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601a2440 con 0x7f8c60105610 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8c4800ae00 con 0x7f8c60105610 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48011700 con 0x7f8c60105610 2024-03-28T05:38:58.674 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.672+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c601a2980 con 0x7f8c60105610 2024-03-28T05:38:58.675 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.673+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60068e50 con 0x7f8c60105610 2024-03-28T05:38:58.676 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.676+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8c48019020 con 0x7f8c60105610 2024-03-28T05:38:58.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.677+0000 7f8c5d600700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 0x7f8c440a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:38:58.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.677+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f8c480cdc20 con 0x7f8c60105610 2024-03-28T05:38:58.678 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.678+0000 7f8c5fe00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 0x7f8c440a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:38:58.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.679+0000 7f8c5fe00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 0x7f8c440a4d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c500038f0 tx=0x7f8c50000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:38:58.684 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.683+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8c48019310 con 0x7f8c60105610 2024-03-28T05:38:58.920 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:38:58.918+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c600625d0 con 0x7f8c440a2890 2024-03-28T05:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:59 smithi086 ceph-mon[35163]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:59 smithi159 ceph-mon[36109]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:59 smithi055 ceph-mon[31863]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:00 smithi086 ceph-mon[35163]: from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:00 smithi159 ceph-mon[36109]: from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:00 smithi055 ceph-mon[31863]: from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:01.486 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:01 smithi086 ceph-mon[35163]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:01 smithi159 ceph-mon[36109]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:01 smithi055 ceph-mon[31863]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/4089097012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]': finished 2024-03-28T05:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: osdmap e50: 8 total, 7 up, 8 in 2024-03-28T05:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/4089097012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]': finished 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: osdmap e50: 8 total, 7 up, 8 in 2024-03-28T05:39:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/4089097012' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]: dispatch 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "625d939c-a761-46ea-96b0-ad1f45d0889b"}]': finished 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: osdmap e50: 8 total, 7 up, 8 in 2024-03-28T05:39:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:04 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/1229174360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:04 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/1229174360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:04 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/1229174360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:05 smithi086 ceph-mon[35163]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:05 smithi055 ceph-mon[31863]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:05 smithi159 ceph-mon[36109]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:07 smithi055 ceph-mon[31863]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:07.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:07 smithi086 ceph-mon[35163]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:07 smithi159 ceph-mon[36109]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:09.525 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:09 smithi086 ceph-mon[35163]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:09 smithi055 ceph-mon[31863]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:09 smithi159 ceph-mon[36109]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:11.611 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:11 smithi086 ceph-mon[35163]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:11 smithi055 ceph-mon[31863]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:11 smithi159 ceph-mon[36109]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:13 smithi086 ceph-mon[35163]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-28T05:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:13 smithi086 ceph-mon[35163]: Deploying daemon osd.7 on smithi086 2024-03-28T05:39:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:13 smithi055 ceph-mon[31863]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-28T05:39:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:13 smithi055 ceph-mon[31863]: Deploying daemon osd.7 on smithi086 2024-03-28T05:39:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:13 smithi159 ceph-mon[36109]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-28T05:39:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:13 smithi159 ceph-mon[36109]: Deploying daemon osd.7 on smithi086 2024-03-28T05:39:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:15 smithi086 ceph-mon[35163]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:15 smithi055 ceph-mon[31863]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:15 smithi159 ceph-mon[36109]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:17.500 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:17 smithi086 ceph-mon[35163]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:17 smithi159 ceph-mon[36109]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:17 smithi055 ceph-mon[31863]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:19 smithi086 ceph-mon[35163]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:19 smithi159 ceph-mon[36109]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:19 smithi055 ceph-mon[31863]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:21.661 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:21 smithi086 ceph-mon[35163]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:21.661 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.661 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.661 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:21 smithi159 ceph-mon[36109]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:21 smithi055 ceph-mon[31863]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:23 smithi086 ceph-mon[35163]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:23 smithi159 ceph-mon[36109]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:23 smithi055 ceph-mon[31863]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:25.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.729+0000 7f8c5d600700 1 -- 172.21.15.86:0/867665007 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c600625d0 con 0x7f8c440a2890 2024-03-28T05:39:25.730 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 7 on host 'smithi086' 2024-03-28T05:39:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.732+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 msgr2=0x7f8c440a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:25.733 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.732+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 0x7f8c440a4d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c500038f0 tx=0x7f8c50000bc0 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 msgr2=0x7f8c6019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c48007e20 tx=0x7f8c4800a340 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 shutdown_connections 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8c440a2890 0x7f8c440a4d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c60104410 0x7f8c6019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c60105fb0 0x7f8c601a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 --2- 172.21.15.86:0/867665007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c60105610 0x7f8c6019aa30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 >> 172.21.15.86:0/867665007 conn(0x7f8c600ff9b0 msgr2=0x7f8c60108910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 shutdown_connections 2024-03-28T05:39:25.734 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:39:25.733+0000 7f8c66e00700 1 -- 172.21.15.86:0/867665007 wait complete. 2024-03-28T05:39:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:25 smithi086 ceph-mon[35163]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:25 smithi159 ceph-mon[36109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:25 smithi055 ceph-mon[31863]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-28T05:39:26.536 DEBUG:teuthology.orchestra.run.smithi086:osd.7> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.7.service 2024-03-28T05:39:26.542 INFO:tasks.cephadm:Deploying osd.8 on smithi159 with /dev/vg_nvme/lv_2... 2024-03-28T05:39:26.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-28T05:39:26.736 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-28T05:39:26.736 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:26.736 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: osdmap e51: 8 total, 7 up, 8 in 2024-03-28T05:39:26.736 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:26.736 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:26.737 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:26.737 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:26.737 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-28T05:39:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: osdmap e51: 8 total, 7 up, 8 in 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:26.988 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:39:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-28T05:39:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: osdmap e51: 8 total, 7 up, 8 in 2024-03-28T05:39:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:39:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:39:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: osdmap e52: 8 total, 7 up, 8 in 2024-03-28T05:39:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:27 smithi159 ceph-mon[36109]: from='osd.7 ' entity='osd.7' 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: osdmap e52: 8 total, 7 up, 8 in 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:27 smithi055 ceph-mon[31863]: from='osd.7 ' entity='osd.7' 2024-03-28T05:39:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:39:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: osdmap e52: 8 total, 7 up, 8 in 2024-03-28T05:39:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-mon[35163]: from='osd.7 ' entity='osd.7' 2024-03-28T05:39:28.069 INFO:journalctl@ceph.osd.7.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-7[53482]: 2024-03-28T05:39:27.586+0000 7fedcce00700 -1 osd.7 0 waiting for initial osdmap 2024-03-28T05:39:28.069 INFO:journalctl@ceph.osd.7.smithi086.stdout:Mar 28 05:39:27 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-7[53482]: 2024-03-28T05:39:27.629+0000 7fedc2c00700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:39:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:28 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:39:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:28 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:39:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:28 smithi086 ceph-mon[35163]: osdmap e53: 8 total, 7 up, 8 in 2024-03-28T05:39:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:28 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:39:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:28 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:39:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:28 smithi159 ceph-mon[36109]: osdmap e53: 8 total, 7 up, 8 in 2024-03-28T05:39:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:28 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:39:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:28 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:39:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:28 smithi055 ceph-mon[31863]: osdmap e53: 8 total, 7 up, 8 in 2024-03-28T05:39:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:29.684 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-28T05:39:29.684 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-28T05:39:29.685 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-03-28T05:39:29.685 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-03-28T05:39:29.685 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.036669 s, 286 MB/s 2024-03-28T05:39:29.685 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-03-28T05:39:30.002 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:29 smithi086 ceph-mon[35163]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:30.002 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:29 smithi086 ceph-mon[35163]: osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] boot 2024-03-28T05:39:30.002 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:29 smithi086 ceph-mon[35163]: osdmap e54: 8 total, 8 up, 8 in 2024-03-28T05:39:30.002 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:29 smithi159 ceph-mon[36109]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:29 smithi159 ceph-mon[36109]: osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] boot 2024-03-28T05:39:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:29 smithi159 ceph-mon[36109]: osdmap e54: 8 total, 8 up, 8 in 2024-03-28T05:39:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:29 smithi055 ceph-mon[31863]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-03-28T05:39:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:29 smithi055 ceph-mon[31863]: osd.7 [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] boot 2024-03-28T05:39:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:29 smithi055 ceph-mon[31863]: osdmap e54: 8 total, 8 up, 8 in 2024-03-28T05:39:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-28T05:39:30.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-03-28T05:39:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:30 smithi086 ceph-mon[35163]: osdmap e55: 8 total, 8 up, 8 in 2024-03-28T05:39:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:30 smithi159 ceph-mon[36109]: osdmap e55: 8 total, 8 up, 8 in 2024-03-28T05:39:31.018 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:39:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:30 smithi055 ceph-mon[31863]: osdmap e55: 8 total, 8 up, 8 in 2024-03-28T05:39:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: pgmap v231: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: osdmap e56: 8 total, 8 up, 8 in 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: pgmap v231: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: osdmap e56: 8 total, 8 up, 8 in 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: pgmap v231: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: osdmap e56: 8 total, 8 up, 8 in 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:39:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:32.759 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:32 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi086 2024-03-28T05:39:32.759 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:32 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 5697M 2024-03-28T05:39:32.759 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:32 smithi159 ceph-mon[36109]: osdmap e57: 8 total, 8 up, 8 in 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 -- 172.21.15.159:0/1290594771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 msgr2=0x7f2760103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 --2- 172.21.15.159:0/1290594771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f2760103860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f274c009990 tx=0x7f274c009ca0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 -- 172.21.15.159:0/1290594771 shutdown_connections 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 --2- 172.21.15.159:0/1290594771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f2760102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 --2- 172.21.15.159:0/1290594771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 0x7f276010a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 --2- 172.21.15.159:0/1290594771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f2760103860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 -- 172.21.15.159:0/1290594771 >> 172.21.15.159:0/1290594771 conn(0x7f27600fd7e0 msgr2=0x7f27600ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 -- 172.21.15.159:0/1290594771 shutdown_connections 2024-03-28T05:39:32.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.917+0000 7f2766a00700 1 -- 172.21.15.159:0/1290594771 wait complete. 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.918+0000 7f2766a00700 1 Processor -- start 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 -- start start 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f276019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 0x7f27601a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010dce0 con 0x7f2760102200 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010db60 con 0x7f2760103da0 2024-03-28T05:39:32.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f2766a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010de60 con 0x7f2760103400 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f275f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f275f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58080/0 (socket says 172.21.15.159:58080) 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.919+0000 7f275f400700 1 -- 172.21.15.159:0/496172227 learned_addr learned my addr 172.21.15.159:0/496172227 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275fe00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f276019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f2764a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 0x7f27601a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 -- 172.21.15.159:0/496172227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 msgr2=0x7f27601a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 0x7f27601a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 -- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 msgr2=0x7f276019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f276019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 -- 172.21.15.159:0/496172227 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27601a2160 con 0x7f2760103400 2024-03-28T05:39:32.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275fe00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f276019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275f400700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f274c0057c0 tx=0x7f274c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.920+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c027070 con 0x7f2760103400 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.921+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f274c004100 con 0x7f2760103400 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.921+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27601a23f0 con 0x7f2760103400 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.921+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c00f460 con 0x7f2760103400 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.921+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27601a28a0 con 0x7f2760103400 2024-03-28T05:39:32.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.922+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2760068e50 con 0x7f2760103400 2024-03-28T05:39:32.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.924+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f274c02a070 con 0x7f2760103400 2024-03-28T05:39:32.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.925+0000 7f275cc00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 0x7f27440a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:39:32.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.925+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f274c0cf760 con 0x7f2760103400 2024-03-28T05:39:32.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.926+0000 7f275fe00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 0x7f27440a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:39:32.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.927+0000 7f275fe00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 0x7f27440a4e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2760103260 tx=0x7f275000a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:39:32.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:32.928+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f274c031020 con 0x7f2760103400 2024-03-28T05:39:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:32 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi086 2024-03-28T05:39:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:32 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 5697M 2024-03-28T05:39:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:32 smithi086 ceph-mon[35163]: osdmap e57: 8 total, 8 up, 8 in 2024-03-28T05:39:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:32 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi086 2024-03-28T05:39:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:32 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 5697M 2024-03-28T05:39:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:32 smithi055 ceph-mon[31863]: osdmap e57: 8 total, 8 up, 8 in 2024-03-28T05:39:33.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:33.162+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f27601a2bc0 con 0x7f27440a2990 2024-03-28T05:39:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: pgmap v234: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: osdmap e58: 8 total, 8 up, 8 in 2024-03-28T05:39:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:39:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:39:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: pgmap v234: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: osdmap e58: 8 total, 8 up, 8 in 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:39:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: pgmap v234: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: osdmap e58: 8 total, 8 up, 8 in 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:39:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:34 smithi086 ceph-mon[35163]: pgmap v236: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:34 smithi159 ceph-mon[36109]: pgmap v236: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:34 smithi055 ceph-mon[31863]: pgmap v236: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:35 smithi159 ceph-mon[36109]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-28T05:39:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:35 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:39:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:35 smithi055 ceph-mon[31863]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-28T05:39:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:35 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:39:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:35 smithi086 ceph-mon[35163]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-03-28T05:39:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:35 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:39:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/454349082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]': finished 2024-03-28T05:39:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: osdmap e59: 9 total, 8 up, 9 in 2024-03-28T05:39:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:39:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/454349082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]': finished 2024-03-28T05:39:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: osdmap e59: 9 total, 8 up, 9 in 2024-03-28T05:39:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/454349082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]: dispatch 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3778672-12bc-4c1a-a1a8-d26e981911e0"}]': finished 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: osdmap e59: 9 total, 8 up, 9 in 2024-03-28T05:39:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:39:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:37 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/825997439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:37 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/825997439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:37 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/825997439' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:39:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:38 smithi086 ceph-mon[35163]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:38 smithi159 ceph-mon[36109]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:38 smithi055 ceph-mon[31863]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:41.146 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:40 smithi086 ceph-mon[35163]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:40 smithi159 ceph-mon[36109]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:40 smithi055 ceph-mon[31863]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:42 smithi086 ceph-mon[35163]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:43.200 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:42 smithi159 ceph-mon[36109]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:42 smithi055 ceph-mon[31863]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:45.175 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:44 smithi055 ceph-mon[31863]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:44 smithi086 ceph-mon[35163]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:44 smithi159 ceph-mon[36109]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:47.254 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:46 smithi159 ceph-mon[36109]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:47.254 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-28T05:39:47.255 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:47.255 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:46 smithi159 ceph-mon[36109]: Deploying daemon osd.8 on smithi159 2024-03-28T05:39:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:46 smithi086 ceph-mon[35163]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-28T05:39:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:46 smithi086 ceph-mon[35163]: Deploying daemon osd.8 on smithi159 2024-03-28T05:39:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:46 smithi055 ceph-mon[31863]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-28T05:39:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:39:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:46 smithi055 ceph-mon[31863]: Deploying daemon osd.8 on smithi159 2024-03-28T05:39:49.185 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:48 smithi159 ceph-mon[36109]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:48 smithi086 ceph-mon[35163]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:48 smithi055 ceph-mon[31863]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:51.005 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:50 smithi159 ceph-mon[36109]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:50 smithi086 ceph-mon[35163]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:50 smithi055 ceph-mon[31863]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:52 smithi086 ceph-mon[35163]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:53.297 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:52 smithi159 ceph-mon[36109]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:52 smithi055 ceph-mon[31863]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:55 smithi086 ceph-mon[35163]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:55 smithi159 ceph-mon[36109]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:55 smithi055 ceph-mon[31863]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:39:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:57.262 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:57 smithi159 ceph-mon[36109]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:57 smithi086 ceph-mon[35163]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:57 smithi055 ceph-mon[31863]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:58.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.875+0000 7f275cc00700 1 -- 172.21.15.159:0/496172227 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f27601a2bc0 con 0x7f27440a2990 2024-03-28T05:39:58.876 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 8 on host 'smithi159' 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 msgr2=0x7f27440a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 0x7f27440a4e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2760103260 tx=0x7f275000a680 comp rx=0 tx=0).stop 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 msgr2=0x7f276019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f274c0057c0 tx=0x7f274c0057f0 comp rx=0 tx=0).stop 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 shutdown_connections 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27440a2990 0x7f27440a4e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2760102200 0x7f276019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:58.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2760103da0 0x7f27601a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:58.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 --2- 172.21.15.159:0/496172227 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2760103400 0x7f276019aa40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:39:58.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.878+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 >> 172.21.15.159:0/496172227 conn(0x7f27600fd7e0 msgr2=0x7f27600743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:39:58.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.879+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 shutdown_connections 2024-03-28T05:39:58.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:39:58.879+0000 7f2766a00700 1 -- 172.21.15.159:0/496172227 wait complete. 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:39:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:39:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-28T05:39:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:39:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:39:59.694 DEBUG:teuthology.orchestra.run.smithi159:osd.8> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.8.service 2024-03-28T05:39:59.701 INFO:tasks.cephadm:Deploying osd.9 on smithi055 with /dev/vg_nvme/lv_1... 2024-03-28T05:39:59.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-28T05:40:00.161 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:40:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-28T05:40:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: osdmap e60: 9 total, 8 up, 9 in 2024-03-28T05:40:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:00 smithi086 ceph-mon[35163]: overall HEALTH_OK 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: osdmap e60: 9 total, 8 up, 9 in 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:00 smithi159 ceph-mon[36109]: overall HEALTH_OK 2024-03-28T05:40:00.339 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-28T05:40:00.339 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: osdmap e60: 9 total, 8 up, 9 in 2024-03-28T05:40:00.339 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:00.339 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: from='osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.340 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:40:00.340 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:00 smithi055 ceph-mon[31863]: overall HEALTH_OK 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: osdmap e61: 9 total, 8 up, 9 in 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:40:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:40:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:40:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: osdmap e61: 9 total, 8 up, 9 in 2024-03-28T05:40:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: osdmap e61: 9 total, 8 up, 9 in 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:01.321 INFO:journalctl@ceph.osd.8.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-8[54611]: 2024-03-28T05:40:01.095+0000 7f3a3c400700 -1 osd.8 0 waiting for initial osdmap 2024-03-28T05:40:01.322 INFO:journalctl@ceph.osd.8.smithi159.stdout:Mar 28 05:40:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-8[54611]: 2024-03-28T05:40:01.140+0000 7f3a31800700 -1 osd.8 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:40:02.217 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:02 smithi055 ceph-mon[31863]: osdmap e62: 9 total, 8 up, 9 in 2024-03-28T05:40:02.217 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:02.218 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:02 smithi055 ceph-mon[31863]: from='osd.8 ' entity='osd.8' 2024-03-28T05:40:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:02 smithi086 ceph-mon[35163]: osdmap e62: 9 total, 8 up, 9 in 2024-03-28T05:40:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:02 smithi086 ceph-mon[35163]: from='osd.8 ' entity='osd.8' 2024-03-28T05:40:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:02 smithi159 ceph-mon[36109]: osdmap e62: 9 total, 8 up, 9 in 2024-03-28T05:40:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:02 smithi159 ceph-mon[36109]: from='osd.8 ' entity='osd.8' 2024-03-28T05:40:03.145 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-28T05:40:03.146 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-28T05:40:03.146 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-03-28T05:40:03.146 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-03-28T05:40:03.146 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0376684 s, 278 MB/s 2024-03-28T05:40:03.146 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-03-28T05:40:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:03 smithi055 ceph-mon[31863]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:03 smithi055 ceph-mon[31863]: osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] boot 2024-03-28T05:40:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:03 smithi055 ceph-mon[31863]: osdmap e63: 9 total, 9 up, 9 in 2024-03-28T05:40:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:03 smithi055 ceph-mon[31863]: osdmap e64: 9 total, 9 up, 9 in 2024-03-28T05:40:03.448 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:03 smithi159 ceph-mon[36109]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:03.448 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:03 smithi159 ceph-mon[36109]: osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] boot 2024-03-28T05:40:03.448 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:03 smithi159 ceph-mon[36109]: osdmap e63: 9 total, 9 up, 9 in 2024-03-28T05:40:03.448 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:03.448 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:03 smithi159 ceph-mon[36109]: osdmap e64: 9 total, 9 up, 9 in 2024-03-28T05:40:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:03 smithi086 ceph-mon[35163]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-03-28T05:40:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:03 smithi086 ceph-mon[35163]: osd.8 [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] boot 2024-03-28T05:40:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:03 smithi086 ceph-mon[35163]: osdmap e63: 9 total, 9 up, 9 in 2024-03-28T05:40:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-28T05:40:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:03 smithi086 ceph-mon[35163]: osdmap e64: 9 total, 9 up, 9 in 2024-03-28T05:40:03.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_1 2024-03-28T05:40:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: osdmap e65: 9 total, 9 up, 9 in 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: osdmap e65: 9 total, 9 up, 9 in 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: osdmap e65: 9 total, 9 up, 9 in 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi159 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 5697M 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: osdmap e66: 9 total, 9 up, 9 in 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:05.982 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:05.983 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi159 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 5697M 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: osdmap e66: 9 total, 9 up, 9 in 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi159 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 5697M 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: osdmap e66: 9 total, 9 up, 9 in 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 -- 172.21.15.55:0/777977625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 msgr2=0x7f2dac101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 --2- 172.21.15.55:0/777977625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac101820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009990 tx=0x7f2d98009ca0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 -- 172.21.15.55:0/777977625 shutdown_connections 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 --2- 172.21.15.55:0/777977625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac101d60 0x7f2dac1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 --2- 172.21.15.55:0/777977625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac100a40 0x7f2dac100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 --2- 172.21.15.55:0/777977625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac101820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 -- 172.21.15.55:0/777977625 >> 172.21.15.55:0/777977625 conn(0x7f2dac0fc660 msgr2=0x7f2dac0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 -- 172.21.15.55:0/777977625 shutdown_connections 2024-03-28T05:40:06.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.446+0000 7f2db3600700 1 -- 172.21.15.55:0/777977625 wait complete. 2024-03-28T05:40:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.447+0000 7f2db3600700 1 Processor -- start 2024-03-28T05:40:06.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 -- start start 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac100a40 0x7f2dac19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac101d60 0x7f2dac1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10fe90 con 0x7f2dac1013a0 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac10fd10 con 0x7f2dac100a40 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2db3600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac110010 con 0x7f2dac101d60 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2dabe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2dabe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45808/0 (socket says 172.21.15.55:45808) 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.448+0000 7f2dabe00700 1 -- 172.21.15.55:0/3645338849 learned_addr learned my addr 172.21.15.55:0/3645338849 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:40:06.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2db0c00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac100a40 0x7f2dac19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2db1600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac101d60 0x7f2dac1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 -- 172.21.15.55:0/3645338849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac101d60 msgr2=0x7f2dac1a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac101d60 0x7f2dac1a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 -- 172.21.15.55:0/3645338849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac100a40 msgr2=0x7f2dac19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac100a40 0x7f2dac19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 -- 172.21.15.55:0/3645338849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac1a21d0 con 0x7f2dac1013a0 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.449+0000 7f2dabe00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d980095c0 tx=0x7f2d98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:40:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.450+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98027070 con 0x7f2dac1013a0 2024-03-28T05:40:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.450+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac1a2460 con 0x7f2dac1013a0 2024-03-28T05:40:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.450+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2d98004090 con 0x7f2dac1013a0 2024-03-28T05:40:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.450+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98022df0 con 0x7f2dac1013a0 2024-03-28T05:40:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.450+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac1a2910 con 0x7f2dac1013a0 2024-03-28T05:40:06.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.451+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac068e50 con 0x7f2dac1013a0 2024-03-28T05:40:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.453+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f2d9802a070 con 0x7f2dac1013a0 2024-03-28T05:40:06.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.455+0000 7f2da9600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 0x7f2d940a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:06.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.455+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f2d980cf3e0 con 0x7f2dac1013a0 2024-03-28T05:40:06.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.455+0000 7f2db0c00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 0x7f2d940a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:06.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.456+0000 7f2db0c00700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 0x7f2d940a4dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da0005950 tx=0x7f2da00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:40:06.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.458+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2d98031070 con 0x7f2dac1013a0 2024-03-28T05:40:06.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:06.696+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dac0625d0 con 0x7f2d940a2910 2024-03-28T05:40:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:06 smithi086 ceph-mon[35163]: osdmap e67: 9 total, 9 up, 9 in 2024-03-28T05:40:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:06 smithi159 ceph-mon[36109]: osdmap e67: 9 total, 9 up, 9 in 2024-03-28T05:40:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:06 smithi055 ceph-mon[31863]: osdmap e67: 9 total, 9 up, 9 in 2024-03-28T05:40:07.979 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:07 smithi055 ceph-mon[31863]: pgmap v261: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-03-28T05:40:07.979 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:07 smithi055 ceph-mon[31863]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:07.979 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:07.979 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:07.979 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:07 smithi086 ceph-mon[35163]: pgmap v261: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-03-28T05:40:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:07 smithi086 ceph-mon[35163]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:07 smithi159 ceph-mon[36109]: pgmap v261: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-03-28T05:40:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:07 smithi159 ceph-mon[36109]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:08.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:08 smithi055 ceph-mon[31863]: pgmap v262: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:40:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:08 smithi086 ceph-mon[35163]: pgmap v262: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:40:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:08 smithi159 ceph-mon[36109]: pgmap v262: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:40:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:10 smithi055 ceph-mon[31863]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:40:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]: dispatch 2024-03-28T05:40:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]': finished 2024-03-28T05:40:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:10 smithi055 ceph-mon[31863]: osdmap e68: 10 total, 9 up, 10 in 2024-03-28T05:40:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:10 smithi086 ceph-mon[35163]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:40:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]: dispatch 2024-03-28T05:40:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]': finished 2024-03-28T05:40:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:10 smithi086 ceph-mon[35163]: osdmap e68: 10 total, 9 up, 10 in 2024-03-28T05:40:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:10 smithi159 ceph-mon[36109]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:40:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]: dispatch 2024-03-28T05:40:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3672335186' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffea7a53-4b7a-4d50-a690-3ec6a3dc005c"}]': finished 2024-03-28T05:40:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:10 smithi159 ceph-mon[36109]: osdmap e68: 10 total, 9 up, 10 in 2024-03-28T05:40:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:12 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1086894253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:12 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1086894253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:12 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1086894253' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:13 smithi055 ceph-mon[31863]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:13 smithi086 ceph-mon[35163]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:13 smithi159 ceph-mon[36109]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:15 smithi086 ceph-mon[35163]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:15 smithi159 ceph-mon[36109]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:15 smithi055 ceph-mon[31863]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:17 smithi086 ceph-mon[35163]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:17 smithi159 ceph-mon[36109]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:17 smithi055 ceph-mon[31863]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:19.799 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:19 smithi055 ceph-mon[31863]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:19 smithi086 ceph-mon[35163]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:19 smithi159 ceph-mon[36109]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:21 smithi086 ceph-mon[35163]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-28T05:40:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:21 smithi159 ceph-mon[36109]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-28T05:40:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:21 smithi055 ceph-mon[31863]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-28T05:40:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:22.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:22 smithi055 ceph-mon[31863]: Deploying daemon osd.9 on smithi055 2024-03-28T05:40:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:22 smithi086 ceph-mon[35163]: Deploying daemon osd.9 on smithi055 2024-03-28T05:40:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:22 smithi159 ceph-mon[36109]: Deploying daemon osd.9 on smithi055 2024-03-28T05:40:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:23 smithi086 ceph-mon[35163]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:23 smithi159 ceph-mon[36109]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:23 smithi055 ceph-mon[31863]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:25 smithi055 ceph-mon[31863]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:25 smithi086 ceph-mon[35163]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:25 smithi159 ceph-mon[36109]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:27 smithi086 ceph-mon[35163]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:27 smithi159 ceph-mon[36109]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:27 smithi055 ceph-mon[31863]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:29 smithi055 ceph-mon[31863]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:29 smithi086 ceph-mon[35163]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:29 smithi159 ceph-mon[36109]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:30.845 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:30.845 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:30.845 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:31 smithi055 ceph-mon[31863]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:31 smithi086 ceph-mon[35163]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:31 smithi159 ceph-mon[36109]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:33 smithi055 ceph-mon[31863]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:33 smithi055 ceph-mon[31863]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-28T05:40:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:33 smithi086 ceph-mon[35163]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:33 smithi086 ceph-mon[35163]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-28T05:40:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:33 smithi159 ceph-mon[36109]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:33 smithi159 ceph-mon[36109]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-28T05:40:34.402 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 9 on host 'smithi055' 2024-03-28T05:40:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.400+0000 7f2da9600700 1 -- 172.21.15.55:0/3645338849 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2dac0625d0 con 0x7f2d940a2910 2024-03-28T05:40:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.403+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 msgr2=0x7f2d940a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.403+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 0x7f2d940a4dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da0005950 tx=0x7f2da00058e0 comp rx=0 tx=0).stop 2024-03-28T05:40:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.403+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 msgr2=0x7f2dac19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.403+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d980095c0 tx=0x7f2d98009f90 comp rx=0 tx=0).stop 2024-03-28T05:40:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 shutdown_connections 2024-03-28T05:40:34.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2d940a2910 0x7f2d940a4dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dac101d60 0x7f2dac1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dac100a40 0x7f2dac19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 --2- 172.21.15.55:0/3645338849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dac1013a0 0x7f2dac19aab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 >> 172.21.15.55:0/3645338849 conn(0x7f2dac0fc660 msgr2=0x7f2dac0ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 shutdown_connections 2024-03-28T05:40:34.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:40:34.404+0000 7f2db3600700 1 -- 172.21.15.55:0/3645338849 wait complete. 2024-03-28T05:40:35.287 DEBUG:teuthology.orchestra.run.smithi055:osd.9> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.9.service 2024-03-28T05:40:35.294 INFO:tasks.cephadm:Deploying osd.10 on smithi086 with /dev/vg_nvme/lv_1... 2024-03-28T05:40:35.294 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-28T05:40:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: osdmap e69: 10 total, 9 up, 10 in 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:35.744 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:40:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-28T05:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: osdmap e69: 10 total, 9 up, 10 in 2024-03-28T05:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: osdmap e69: 10 total, 9 up, 10 in 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-03-28T05:40:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.515 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-mon[31863]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:40:36.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-mon[31863]: osdmap e70: 10 total, 9 up, 10 in 2024-03-28T05:40:36.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-mon[31863]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' 2024-03-28T05:40:36.516 INFO:journalctl@ceph.osd.9.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-9[64889]: 2024-03-28T05:40:36.463+0000 7fd785000700 -1 osd.9 0 waiting for initial osdmap 2024-03-28T05:40:36.517 INFO:journalctl@ceph.osd.9.smithi055.stdout:Mar 28 05:40:36 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-9[64889]: 2024-03-28T05:40:36.514+0000 7fd77ae00700 -1 osd.9 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:40:36.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:36 smithi086 ceph-mon[35163]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:40:36.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:36 smithi086 ceph-mon[35163]: osdmap e70: 10 total, 9 up, 10 in 2024-03-28T05:40:36.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.785 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:36 smithi086 ceph-mon[35163]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' 2024-03-28T05:40:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:36 smithi159 ceph-mon[36109]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-03-28T05:40:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:36 smithi159 ceph-mon[36109]: osdmap e70: 10 total, 9 up, 10 in 2024-03-28T05:40:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:36.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:36 smithi159 ceph-mon[36109]: from='osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436]' entity='osd.9' 2024-03-28T05:40:37.727 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:37 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:40:37.728 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:37 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:40:37.728 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:37 smithi055 ceph-mon[31863]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:37.728 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:37.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:37 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:40:37.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:37 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:40:37.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:37 smithi086 ceph-mon[35163]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:37.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:37 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:40:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:37 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:40:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:37 smithi159 ceph-mon[36109]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:38.684 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-28T05:40:38.685 INFO:teuthology.orchestra.run.smithi086.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-28T05:40:38.685 INFO:teuthology.orchestra.run.smithi086.stderr: stderr: 10+0 records in 2024-03-28T05:40:38.685 INFO:teuthology.orchestra.run.smithi086.stderr:10+0 records out 2024-03-28T05:40:38.685 INFO:teuthology.orchestra.run.smithi086.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0350167 s, 299 MB/s 2024-03-28T05:40:38.685 INFO:teuthology.orchestra.run.smithi086.stderr:--> Zapping successful for: 2024-03-28T05:40:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:38 smithi086 ceph-mon[35163]: osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] boot 2024-03-28T05:40:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:38 smithi086 ceph-mon[35163]: osdmap e71: 10 total, 10 up, 10 in 2024-03-28T05:40:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:38 smithi159 ceph-mon[36109]: osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] boot 2024-03-28T05:40:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:38 smithi159 ceph-mon[36109]: osdmap e71: 10 total, 10 up, 10 in 2024-03-28T05:40:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:38 smithi055 ceph-mon[31863]: osd.9 [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] boot 2024-03-28T05:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:38 smithi055 ceph-mon[31863]: osdmap e71: 10 total, 10 up, 10 in 2024-03-28T05:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-28T05:40:39.564 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi086:vg_nvme/lv_1 2024-03-28T05:40:39.637 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:39 smithi086 ceph-mon[35163]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:39.638 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:39 smithi086 ceph-mon[35163]: osdmap e72: 10 total, 10 up, 10 in 2024-03-28T05:40:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:39 smithi159 ceph-mon[36109]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:39 smithi159 ceph-mon[36109]: osdmap e72: 10 total, 10 up, 10 in 2024-03-28T05:40:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:39 smithi055 ceph-mon[31863]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail 2024-03-28T05:40:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:39 smithi055 ceph-mon[31863]: osdmap e72: 10 total, 10 up, 10 in 2024-03-28T05:40:39.978 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.b/config 2024-03-28T05:40:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi055 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 4273M 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi055 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 4273M 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi055 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 4273M 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:40:42.314 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 -- 172.21.15.86:0/631422710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103390 msgr2=0x7f04fc1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 --2- 172.21.15.86:0/631422710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103390 0x7f04fc1037f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009990 tx=0x7f04e8009ca0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 -- 172.21.15.86:0/631422710 shutdown_connections 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 --2- 172.21.15.86:0/631422710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103d30 0x7f04fc10a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 --2- 172.21.15.86:0/631422710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 0x7f04fc1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 --2- 172.21.15.86:0/631422710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103390 0x7f04fc1037f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 -- 172.21.15.86:0/631422710 >> 172.21.15.86:0/631422710 conn(0x7f04fc0fbd30 msgr2=0x7f04fc0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 -- 172.21.15.86:0/631422710 shutdown_connections 2024-03-28T05:40:42.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.313+0000 7f0501000700 1 -- 172.21.15.86:0/631422710 wait complete. 2024-03-28T05:40:42.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.314+0000 7f0501000700 1 Processor -- start 2024-03-28T05:40:42.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 -- start start 2024-03-28T05:40:42.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 0x7f04fc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:42.317 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103390 0x7f04fc19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc10dbd0 con 0x7f04fc103390 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc10da50 con 0x7f04fc103d30 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f0501000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc10dd50 con 0x7f04fc1003b0 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f04fbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f04fbe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:56734/0 (socket says 172.21.15.86:56734) 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f04fbe00700 1 -- 172.21.15.86:0/3548365659 learned_addr learned my addr 172.21.15.86:0/3548365659 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f04fb400700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 0x7f04fc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.315+0000 7f04faa00700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103390 0x7f04fc19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 -- 172.21.15.86:0/3548365659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 msgr2=0x7f04fc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 0x7f04fc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 -- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103390 msgr2=0x7f04fc19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103390 0x7f04fc19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:40:42.318 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 -- 172.21.15.86:0/3548365659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc1a20c0 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04fbe00700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04f400ada0 tx=0x7f04f400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4017020 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f04f400ce30 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc1a23b0 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4005460 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.316+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc1a28f0 con 0x7f04fc103d30 2024-03-28T05:40:42.319 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.318+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc068e50 con 0x7f04fc103d30 2024-03-28T05:40:42.320 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.320+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f04f400c980 con 0x7f04fc103d30 2024-03-28T05:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.321+0000 7f04f3e00700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 0x7f04e00a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.321+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f04f40ce0d0 con 0x7f04fc103d30 2024-03-28T05:40:42.322 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.322+0000 7f04fb400700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 0x7f04e00a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:40:42.323 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.323+0000 7f04fb400700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 0x7f04e00a4dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005950 tx=0x7f04ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:40:42.325 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.324+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f04f4021020 con 0x7f04fc103d30 2024-03-28T05:40:42.558 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:40:42.556+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f04fc1028a0 con 0x7f04e00a2910 2024-03-28T05:40:43.760 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:43 smithi055 ceph-mon[31863]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:43.760 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:43 smithi055 ceph-mon[31863]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:43.760 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:43.760 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:43.761 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:43 smithi086 ceph-mon[35163]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:43 smithi086 ceph-mon[35163]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:43 smithi159 ceph-mon[36109]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:43 smithi159 ceph-mon[36109]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:40:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:40:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:40:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:45.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:45 smithi055 ceph-mon[31863]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:45 smithi086 ceph-mon[35163]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:45 smithi159 ceph-mon[36109]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/1699467346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]': finished 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: osdmap e73: 11 total, 10 up, 11 in 2024-03-28T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:40:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/1699467346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]': finished 2024-03-28T05:40:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: osdmap e73: 11 total, 10 up, 11 in 2024-03-28T05:40:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:40:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/1699467346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]: dispatch 2024-03-28T05:40:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7d7d35b-4f51-49d7-9fa8-d558f915ff4f"}]': finished 2024-03-28T05:40:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: osdmap e73: 11 total, 10 up, 11 in 2024-03-28T05:40:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:40:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:48 smithi086 ceph-mon[35163]: from='client.? 172.21.15.86:0/1928738533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:48 smithi159 ceph-mon[36109]: from='client.? 172.21.15.86:0/1928738533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:48 smithi055 ceph-mon[31863]: from='client.? 172.21.15.86:0/1928738533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:40:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:49 smithi086 ceph-mon[35163]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:49 smithi159 ceph-mon[36109]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:49 smithi055 ceph-mon[31863]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:51 smithi086 ceph-mon[35163]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:51 smithi159 ceph-mon[36109]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:51 smithi055 ceph-mon[31863]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:53 smithi086 ceph-mon[35163]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:53 smithi159 ceph-mon[36109]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:53 smithi055 ceph-mon[31863]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:55 smithi086 ceph-mon[35163]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:55 smithi159 ceph-mon[36109]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:55 smithi055 ceph-mon[31863]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:57 smithi086 ceph-mon[35163]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-28T05:40:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:57 smithi159 ceph-mon[36109]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-28T05:40:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:57 smithi055 ceph-mon[31863]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-28T05:40:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:40:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:58 smithi055 ceph-mon[31863]: Deploying daemon osd.10 on smithi086 2024-03-28T05:40:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:58 smithi086 ceph-mon[35163]: Deploying daemon osd.10 on smithi086 2024-03-28T05:40:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:58 smithi159 ceph-mon[36109]: Deploying daemon osd.10 on smithi086 2024-03-28T05:40:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:40:59 smithi086 ceph-mon[35163]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:40:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:40:59 smithi055 ceph-mon[31863]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:40:59 smithi159 ceph-mon[36109]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:01 smithi086 ceph-mon[35163]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:01 smithi055 ceph-mon[31863]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:01.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:01 smithi159 ceph-mon[36109]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:03 smithi159 ceph-mon[36109]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:03 smithi055 ceph-mon[31863]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:03 smithi086 ceph-mon[35163]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:05.868 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:05 smithi086 ceph-mon[35163]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:05.869 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:05.869 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:05.869 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:05 smithi055 ceph-mon[31863]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:05 smithi159 ceph-mon[36109]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:07.797 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:07 smithi086 ceph-mon[35163]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:07 smithi055 ceph-mon[31863]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:07 smithi159 ceph-mon[36109]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:09 smithi086 ceph-mon[35163]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:09 smithi086 ceph-mon[35163]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:09 smithi086 ceph-mon[35163]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:09 smithi055 ceph-mon[31863]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:09 smithi055 ceph-mon[31863]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:09 smithi055 ceph-mon[31863]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:09 smithi159 ceph-mon[36109]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:09 smithi159 ceph-mon[36109]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:09 smithi159 ceph-mon[36109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-28T05:41:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:10.883 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.881+0000 7f04f3e00700 1 -- 172.21.15.86:0/3548365659 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f04fc1028a0 con 0x7f04e00a2910 2024-03-28T05:41:10.883 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 10 on host 'smithi086' 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 msgr2=0x7f04e00a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 0x7f04e00a4dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005950 tx=0x7f04ec0058e0 comp rx=0 tx=0).stop 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 msgr2=0x7f04fc1a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04f400ada0 tx=0x7f04f400c330 comp rx=0 tx=0).stop 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 shutdown_connections 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04e00a2910 0x7f04e00a4dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04fc103d30 0x7f04fc1a1a20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04fc1003b0 0x7f04fc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:10.886 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 --2- 172.21.15.86:0/3548365659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04fc103390 0x7f04fc19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:10.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.884+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 >> 172.21.15.86:0/3548365659 conn(0x7f04fc0fbd30 msgr2=0x7f04fc101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:10.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.885+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 shutdown_connections 2024-03-28T05:41:10.887 INFO:teuthology.orchestra.run.smithi086.stderr:2024-03-28T05:41:10.885+0000 7f0501000700 1 -- 172.21.15.86:0/3548365659 wait complete. 2024-03-28T05:41:10.903 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:10 smithi086 ceph-mon[35163]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-28T05:41:10.903 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:10 smithi086 ceph-mon[35163]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:10.903 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:10 smithi086 ceph-mon[35163]: osdmap e74: 11 total, 10 up, 11 in 2024-03-28T05:41:10.903 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:10.904 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:10 smithi086 ceph-mon[35163]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:10 smithi159 ceph-mon[36109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-28T05:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:10 smithi159 ceph-mon[36109]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:10 smithi159 ceph-mon[36109]: osdmap e74: 11 total, 10 up, 11 in 2024-03-28T05:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:10 smithi159 ceph-mon[36109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:10 smithi055 ceph-mon[31863]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-28T05:41:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:10 smithi055 ceph-mon[31863]: from='osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:10 smithi055 ceph-mon[31863]: osdmap e74: 11 total, 10 up, 11 in 2024-03-28T05:41:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:10 smithi055 ceph-mon[31863]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-03-28T05:41:11.779 DEBUG:teuthology.orchestra.run.smithi086:osd.10> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.10.service 2024-03-28T05:41:11.783 INFO:tasks.cephadm:Deploying osd.11 on smithi159 with /dev/vg_nvme/lv_1... 2024-03-28T05:41:11.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: osdmap e75: 11 total, 10 up, 11 in 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:11 smithi086 ceph-mon[35163]: from='osd.10 ' entity='osd.10' 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: osdmap e75: 11 total, 10 up, 11 in 2024-03-28T05:41:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:11 smithi159 ceph-mon[36109]: from='osd.10 ' entity='osd.10' 2024-03-28T05:41:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: osdmap e75: 11 total, 10 up, 11 in 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:11 smithi055 ceph-mon[31863]: from='osd.10 ' entity='osd.10' 2024-03-28T05:41:12.235 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:41:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:12 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:41:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:12 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:41:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:12 smithi086 ceph-mon[35163]: osdmap e76: 11 total, 10 up, 11 in 2024-03-28T05:41:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:12 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:41:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:12 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:41:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:12 smithi159 ceph-mon[36109]: osdmap e76: 11 total, 10 up, 11 in 2024-03-28T05:41:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:12 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:12 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:12 smithi055 ceph-mon[31863]: osdmap e76: 11 total, 10 up, 11 in 2024-03-28T05:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:13 smithi086 ceph-mon[35163]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:13 smithi086 ceph-mon[35163]: osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] boot 2024-03-28T05:41:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:13 smithi086 ceph-mon[35163]: osdmap e77: 11 total, 11 up, 11 in 2024-03-28T05:41:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:13 smithi086 ceph-mon[35163]: osdmap e78: 11 total, 11 up, 11 in 2024-03-28T05:41:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:13 smithi159 ceph-mon[36109]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:13 smithi159 ceph-mon[36109]: osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] boot 2024-03-28T05:41:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:13 smithi159 ceph-mon[36109]: osdmap e77: 11 total, 11 up, 11 in 2024-03-28T05:41:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:13 smithi159 ceph-mon[36109]: osdmap e78: 11 total, 11 up, 11 in 2024-03-28T05:41:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:13 smithi055 ceph-mon[31863]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-03-28T05:41:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:13 smithi055 ceph-mon[31863]: osd.10 [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] boot 2024-03-28T05:41:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:13 smithi055 ceph-mon[31863]: osdmap e77: 11 total, 11 up, 11 in 2024-03-28T05:41:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-28T05:41:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:13 smithi055 ceph-mon[31863]: osdmap e78: 11 total, 11 up, 11 in 2024-03-28T05:41:15.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:14 smithi055 ceph-mon[31863]: osdmap e79: 11 total, 11 up, 11 in 2024-03-28T05:41:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:14 smithi086 ceph-mon[35163]: osdmap e79: 11 total, 11 up, 11 in 2024-03-28T05:41:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:14 smithi159 ceph-mon[36109]: osdmap e79: 11 total, 11 up, 11 in 2024-03-28T05:41:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-28T05:41:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-28T05:41:15.121 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-03-28T05:41:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-03-28T05:41:15.122 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.036784 s, 285 MB/s 2024-03-28T05:41:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-03-28T05:41:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:15 smithi086 ceph-mon[35163]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:15 smithi086 ceph-mon[35163]: osdmap e80: 11 total, 11 up, 11 in 2024-03-28T05:41:16.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:15 smithi159 ceph-mon[36109]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:16.008 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:15 smithi159 ceph-mon[36109]: osdmap e80: 11 total, 11 up, 11 in 2024-03-28T05:41:16.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_1 2024-03-28T05:41:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:15 smithi055 ceph-mon[31863]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:15 smithi055 ceph-mon[31863]: osdmap e80: 11 total, 11 up, 11 in 2024-03-28T05:41:16.447 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: osdmap e81: 11 total, 11 up, 11 in 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 184 KiB/s, 0 objects/s recovering 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi086 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:16.912 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:16.913 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 4272M 2024-03-28T05:41:16.913 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:16.913 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:16.913 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:16.913 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: osdmap e81: 11 total, 11 up, 11 in 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 184 KiB/s, 0 objects/s recovering 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi086 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 4272M 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: osdmap e81: 11 total, 11 up, 11 in 2024-03-28T05:41:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 184 KiB/s, 0 objects/s recovering 2024-03-28T05:41:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi086 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 4272M 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:18.123 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:41:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:41:17.711+0000 7ff786e00700 -1 calc_pg_upmaps abort due to max <= 0 2024-03-28T05:41:18.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.450+0000 7fd33bc00700 1 -- 172.21.15.159:0/2658064673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 msgr2=0x7fd33410a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.450+0000 7fd33bc00700 1 --2- 172.21.15.159:0/2658064673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd33410a610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00b0a0 tx=0x7fd32c00b3b0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 -- 172.21.15.159:0/2658064673 shutdown_connections 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 --2- 172.21.15.159:0/2658064673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd33410a610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 --2- 172.21.15.159:0/2658064673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 0x7fd3341025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 --2- 172.21.15.159:0/2658064673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 0x7fd334103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 -- 172.21.15.159:0/2658064673 >> 172.21.15.159:0/2658064673 conn(0x7fd3340fd7a0 msgr2=0x7fd3340ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 -- 172.21.15.159:0/2658064673 shutdown_connections 2024-03-28T05:41:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.451+0000 7fd33bc00700 1 -- 172.21.15.159:0/2658064673 wait complete. 2024-03-28T05:41:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 Processor -- start 2024-03-28T05:41:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 -- start start 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 0x7fd334075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 0x7fd334074580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33410dcc0 con 0x7fd3341033c0 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33410db40 con 0x7fd3341021c0 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.452+0000 7fd33bc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33410de40 con 0x7fd334103d60 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40138/0 (socket says 172.21.15.159:40138) 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 -- 172.21.15.159:0/694326143 learned_addr learned my addr 172.21.15.159:0/694326143 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339200700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 0x7fd334075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd333e00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 0x7fd334074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 -- 172.21.15.159:0/694326143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 msgr2=0x7fd334075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 0x7fd334075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 -- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 msgr2=0x7fd334074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 0x7fd334074580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.453+0000 7fd339c00700 1 -- 172.21.15.159:0/694326143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334075370 con 0x7fd334103d60 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd339c00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fa0 tx=0x7fd32c009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c021070 con 0x7fd334103d60 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd32c007d40 con 0x7fd334103d60 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c01d450 con 0x7fd334103d60 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3341a23a0 con 0x7fd334103d60 2024-03-28T05:41:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.454+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341a2850 con 0x7fd334103d60 2024-03-28T05:41:18.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.455+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334068e50 con 0x7fd334103d60 2024-03-28T05:41:18.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.457+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd32c0040b0 con 0x7fd334103d60 2024-03-28T05:41:18.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.458+0000 7fd331600700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 0x7fd31c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:18.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.459+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fd32c00f020 con 0x7fd334103d60 2024-03-28T05:41:18.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.459+0000 7fd339200700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 0x7fd31c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:18.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.460+0000 7fd339200700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 0x7fd31c0a4dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd334103220 tx=0x7fd32800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:18.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.464+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd32c02a020 con 0x7fd334103d60 2024-03-28T05:41:18.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:18.700+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd334062690 con 0x7fd31c0a2910 2024-03-28T05:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:18 smithi159 ceph-mon[36109]: pgmap v311: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:18 smithi159 ceph-mon[36109]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:41:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:18 smithi055 ceph-mon[31863]: pgmap v311: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:18 smithi055 ceph-mon[31863]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:18 smithi086 ceph-mon[35163]: pgmap v311: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-03-28T05:41:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:18 smithi086 ceph-mon[35163]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:41:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-28T05:41:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-28T05:41:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:20 smithi159 ceph-mon[36109]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:41:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:20 smithi055 ceph-mon[31863]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:41:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:20 smithi086 ceph-mon[35163]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-03-28T05:41:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:41:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/3612077159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]': finished 2024-03-28T05:41:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: osdmap e82: 12 total, 11 up, 12 in 2024-03-28T05:41:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/3612077159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]': finished 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: osdmap e82: 12 total, 11 up, 12 in 2024-03-28T05:41:23.164 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/3612077159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]: dispatch 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "238c21e2-0ee8-479f-a68a-22758a71cf10"}]': finished 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: osdmap e82: 12 total, 11 up, 12 in 2024-03-28T05:41:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:23 smithi086 ceph-mon[35163]: from='client.? 172.21.15.159:0/4011914280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:41:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:23 smithi159 ceph-mon[36109]: from='client.? 172.21.15.159:0/4011914280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:41:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:23 smithi055 ceph-mon[31863]: from='client.? 172.21.15.159:0/4011914280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-28T05:41:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:24 smithi086 ceph-mon[35163]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:24 smithi159 ceph-mon[36109]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:24 smithi055 ceph-mon[31863]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:27.233 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:26 smithi159 ceph-mon[36109]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:26 smithi086 ceph-mon[35163]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:26 smithi055 ceph-mon[31863]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:29.243 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:28 smithi159 ceph-mon[36109]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:28 smithi086 ceph-mon[35163]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:28 smithi055 ceph-mon[31863]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:30 smithi159 ceph-mon[36109]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:30 smithi086 ceph-mon[35163]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:30 smithi055 ceph-mon[31863]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:32 smithi159 ceph-mon[36109]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-28T05:41:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:32 smithi159 ceph-mon[36109]: Deploying daemon osd.11 on smithi159 2024-03-28T05:41:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:32 smithi086 ceph-mon[35163]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-28T05:41:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:32 smithi086 ceph-mon[35163]: Deploying daemon osd.11 on smithi159 2024-03-28T05:41:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:32 smithi055 ceph-mon[31863]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-28T05:41:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:32 smithi055 ceph-mon[31863]: Deploying daemon osd.11 on smithi159 2024-03-28T05:41:35.266 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:34 smithi159 ceph-mon[36109]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:34 smithi086 ceph-mon[35163]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:34 smithi055 ceph-mon[31863]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:36 smithi159 ceph-mon[36109]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:36 smithi086 ceph-mon[35163]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:36 smithi055 ceph-mon[31863]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:38 smithi086 ceph-mon[35163]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:38 smithi159 ceph-mon[36109]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:38 smithi055 ceph-mon[31863]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:41 smithi055 ceph-mon[31863]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:41.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:41 smithi159 ceph-mon[36109]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:41.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:41.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:41.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:42.022 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:41 smithi086 ceph-mon[35163]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:42.022 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:42.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:42.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:43.699 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:43 smithi086 ceph-mon[35163]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:43 smithi159 ceph-mon[36109]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:43 smithi055 ceph-mon[31863]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:45.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.425+0000 7fd331600700 1 -- 172.21.15.159:0/694326143 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd334062690 con 0x7fd31c0a2910 2024-03-28T05:41:45.427 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 11 on host 'smithi159' 2024-03-28T05:41:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 msgr2=0x7fd31c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 0x7fd31c0a4dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd334103220 tx=0x7fd32800b410 comp rx=0 tx=0).stop 2024-03-28T05:41:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 msgr2=0x7fd334074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:45.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fa0 tx=0x7fd32c009c70 comp rx=0 tx=0).stop 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 shutdown_connections 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd31c0a2910 0x7fd31c0a4dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.429+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd334103d60 0x7fd334074ac0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.430+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3341021c0 0x7fd334075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.430+0000 7fd33bc00700 1 --2- 172.21.15.159:0/694326143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3341033c0 0x7fd334074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.430+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 >> 172.21.15.159:0/694326143 conn(0x7fd3340fd7a0 msgr2=0x7fd3341066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.430+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 shutdown_connections 2024-03-28T05:41:45.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:45.430+0000 7fd33bc00700 1 -- 172.21.15.159:0/694326143 wait complete. 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:45 smithi159 ceph-mon[36109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:45 smithi086 ceph-mon[35163]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:45 smithi055 ceph-mon[31863]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-28T05:41:46.241 DEBUG:teuthology.orchestra.run.smithi159:osd.11> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@osd.11.service 2024-03-28T05:41:46.245 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-28T05:41:46.245 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd stat -f json 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: osdmap e83: 12 total, 11 up, 12 in 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:46.477 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:46 smithi159 ceph-mon[36109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: osdmap e83: 12 total, 11 up, 12 in 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:46 smithi055 ceph-mon[31863]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: osdmap e83: 12 total, 11 up, 12 in 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:46 smithi086 ceph-mon[35163]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-03-28T05:41:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: purged_snaps scrub starts 2024-03-28T05:41:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: purged_snaps scrub ok 2024-03-28T05:41:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:41:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: osdmap e84: 12 total, 11 up, 12 in 2024-03-28T05:41:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:47.821 INFO:journalctl@ceph.osd.11.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-11[61628]: 2024-03-28T05:41:47.703+0000 7fabfc600700 -1 osd.11 0 waiting for initial osdmap 2024-03-28T05:41:47.821 INFO:journalctl@ceph.osd.11.smithi159.stdout:Mar 28 05:41:47 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-osd-11[61628]: 2024-03-28T05:41:47.754+0000 7fabf2400700 -1 osd.11 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: purged_snaps scrub starts 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: purged_snaps scrub ok 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: osdmap e84: 12 total, 11 up, 12 in 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: purged_snaps scrub starts 2024-03-28T05:41:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: purged_snaps scrub ok 2024-03-28T05:41:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-03-28T05:41:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: osdmap e84: 12 total, 11 up, 12 in 2024-03-28T05:41:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 -- 172.21.15.55:0/51062590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 msgr2=0x7f4cf4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 --2- 172.21.15.55:0/51062590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf4102e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800b0a0 tx=0x7f4ce800b3b0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 -- 172.21.15.55:0/51062590 shutdown_connections 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 --2- 172.21.15.55:0/51062590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf4102e70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 --2- 172.21.15.55:0/51062590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4105d80 0x7f4cf4106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 --2- 172.21.15.55:0/51062590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf41033b0 0x7f4cf4105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 -- 172.21.15.55:0/51062590 >> 172.21.15.55:0/51062590 conn(0x7f4cf40fc660 msgr2=0x7f4cf40feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:48.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 -- 172.21.15.55:0/51062590 shutdown_connections 2024-03-28T05:41:48.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.820+0000 7f4cfc600700 1 -- 172.21.15.55:0/51062590 wait complete. 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.821+0000 7f4cfc600700 1 Processor -- start 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.821+0000 7f4cfc600700 1 -- start start 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf41033b0 0x7f4cf419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf4105d80 0x7f4cf41a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41141b0 con 0x7f4cf4100a40 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4114030 con 0x7f4cf4105d80 2024-03-28T05:41:48.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfc600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4114330 con 0x7f4cf41033b0 2024-03-28T05:41:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cf9c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cf9c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52590/0 (socket says 172.21.15.55:52590) 2024-03-28T05:41:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cf9c00700 1 -- 172.21.15.55:0/2031935490 learned_addr learned my addr 172.21.15.55:0/2031935490 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:41:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cf9200700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf41033b0 0x7f4cf419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:48.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.822+0000 7f4cfa600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf4105d80 0x7f4cf41a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 -- 172.21.15.55:0/2031935490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf41033b0 msgr2=0x7f4cf419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf41033b0 0x7f4cf419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 -- 172.21.15.55:0/2031935490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf4105d80 msgr2=0x7f4cf41a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf4105d80 0x7f4cf41a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 -- 172.21.15.55:0/2031935490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf41a64f0 con 0x7f4cf4100a40 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf9c00700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800ced0 tx=0x7f4ce800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8021070 con 0x7f4cf4100a40 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4ce8007c80 con 0x7f4cf4100a40 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80048a0 con 0x7f4cf4100a40 2024-03-28T05:41:48.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.823+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf41a6780 con 0x7f4cf4100a40 2024-03-28T05:41:48.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.824+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf41a6be0 con 0x7f4cf4100a40 2024-03-28T05:41:48.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.825+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4068e50 con 0x7f4cf4100a40 2024-03-28T05:41:48.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.827+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f4ce8004020 con 0x7f4cf4100a40 2024-03-28T05:41:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.829+0000 7f4cf2000700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 0x7f4cdc0a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.829+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4ce800f020 con 0x7f4cf4100a40 2024-03-28T05:41:48.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.829+0000 7f4cf9200700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 0x7f4cdc0a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:48.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.830+0000 7f4cf9200700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 0x7f4cdc0a4f70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005950 tx=0x7f4ce000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:48.834+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f4ce802a020 con 0x7f4cf4100a40 2024-03-28T05:41:49.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.064+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4cf4062da0 con 0x7f4cf4100a40 2024-03-28T05:41:49.065 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.065 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:48 smithi055 ceph-mon[31863]: from='osd.11 ' entity='osd.11' 2024-03-28T05:41:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.065+0000 7f4cf2000700 1 -- 172.21.15.55:0/2031935490 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v85) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4ce809d120 con 0x7f4cf4100a40 2024-03-28T05:41:49.065 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 msgr2=0x7f4cdc0a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 0x7f4cdc0a4f70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005950 tx=0x7f4ce000b410 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 msgr2=0x7f4cf419e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800ced0 tx=0x7f4ce800cf00 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 shutdown_connections 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4cdc0a2ab0 0x7f4cdc0a4f70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cf4100a40 0x7f4cf419e890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf4105d80 0x7f4cf41a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 --2- 172.21.15.55:0/2031935490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf41033b0 0x7f4cf419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 >> 172.21.15.55:0/2031935490 conn(0x7f4cf40fc660 msgr2=0x7f4cf4103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:48 smithi086 ceph-mon[35163]: from='osd.11 ' entity='osd.11' 2024-03-28T05:41:49.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 shutdown_connections 2024-03-28T05:41:49.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:49.068+0000 7f4cfc600700 1 -- 172.21.15.55:0/2031935490 wait complete. 2024-03-28T05:41:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:48 smithi159 ceph-mon[36109]: from='osd.11 ' entity='osd.11' 2024-03-28T05:41:49.811 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"num_osds":12,"num_up_osds":12,"osd_up_since":1711604508,"num_in_osds":12,"osd_in_since":1711604482,"num_remapped_pgs":0} 2024-03-28T05:41:49.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] boot 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: osdmap e85: 12 total, 12 up, 12 in 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.908 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:49 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2031935490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] boot 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: osdmap e85: 12 total, 12 up, 12 in 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:49.916 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:49 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2031935490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-28T05:41:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-03-28T05:41:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: osd.11 [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] boot 2024-03-28T05:41:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: osdmap e85: 12 total, 12 up, 12 in 2024-03-28T05:41:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-28T05:41:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:49 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2031935490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-28T05:41:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:41:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:50 smithi086 ceph-mon[35163]: osdmap e86: 12 total, 12 up, 12 in 2024-03-28T05:41:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:50 smithi086 ceph-mon[35163]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:50 smithi159 ceph-mon[36109]: osdmap e86: 12 total, 12 up, 12 in 2024-03-28T05:41:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:50 smithi159 ceph-mon[36109]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:50 smithi055 ceph-mon[31863]: osdmap e86: 12 total, 12 up, 12 in 2024-03-28T05:41:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:50 smithi055 ceph-mon[31863]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: Detected new or changed devices on smithi159 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 4272M 2024-03-28T05:41:52.167 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.167 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:52.167 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:52.167 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: Detected new or changed devices on smithi159 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 4272M 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: Detected new or changed devices on smithi159 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 4272M 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:41:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:41:52.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 -- 172.21.15.55:0/1867245325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41045e0 msgr2=0x7fb2c41049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:52.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 --2- 172.21.15.55:0/1867245325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41045e0 0x7fb2c41049c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40099c0 tx=0x7fb2b4009cd0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 -- 172.21.15.55:0/1867245325 shutdown_connections 2024-03-28T05:41:52.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 --2- 172.21.15.55:0/1867245325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41045e0 0x7fb2c41049c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 --2- 172.21.15.55:0/1867245325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c41096c0 0x7fb2c4111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 --2- 172.21.15.55:0/1867245325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c4104f90 0x7fb2c4108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 -- 172.21.15.55:0/1867245325 >> 172.21.15.55:0/1867245325 conn(0x7fb2c40ffe70 msgr2=0x7fb2c4102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 -- 172.21.15.55:0/1867245325 shutdown_connections 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.435+0000 7fb2ca200700 1 -- 172.21.15.55:0/1867245325 wait complete. 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.436+0000 7fb2ca200700 1 Processor -- start 2024-03-28T05:41:52.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 -- start start 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c41045e0 0x7fb2c41a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c4104f90 0x7fb2c41a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c41145d0 con 0x7fb2c41096c0 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4114450 con 0x7fb2c41045e0 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2ca200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4114750 con 0x7fb2c4104f90 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2c3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2c3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41980/0 (socket says 172.21.15.55:41980) 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.437+0000 7fb2c3e00700 1 -- 172.21.15.55:0/3941319735 learned_addr learned my addr 172.21.15.55:0/3941319735 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3400700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c41045e0 0x7fb2c41a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:52.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c2a00700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c4104f90 0x7fb2c41a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 -- 172.21.15.55:0/3941319735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c4104f90 msgr2=0x7fb2c41a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c4104f90 0x7fb2c41a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 -- 172.21.15.55:0/3941319735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c41045e0 msgr2=0x7fb2c41a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c41045e0 0x7fb2c41a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 -- 172.21.15.55:0/3941319735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c419b070 con 0x7fb2c41096c0 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2c3e00700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007ee0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.438+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00dbd0 con 0x7fb2c41096c0 2024-03-28T05:41:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.439+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb2bc00dd70 con 0x7fb2c41096c0 2024-03-28T05:41:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.439+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c419b360 con 0x7fb2c41096c0 2024-03-28T05:41:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.439+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc005a20 con 0x7fb2c41096c0 2024-03-28T05:41:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.439+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c41a75d0 con 0x7fb2c41096c0 2024-03-28T05:41:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.440+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c4068e50 con 0x7fb2c41096c0 2024-03-28T05:41:52.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.442+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb2bc01a020 con 0x7fb2c41096c0 2024-03-28T05:41:52.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.443+0000 7fb2bbe00700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 0x7fb2a80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:52.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.443+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2bc0cde20 con 0x7fb2c41096c0 2024-03-28T05:41:52.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.443+0000 7fb2c3400700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 0x7fb2a80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:52.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.444+0000 7fb2c3400700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 0x7fb2a80a4d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.448+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb2bc010070 con 0x7fb2c41096c0 2024-03-28T05:41:52.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.673+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c402da30 con 0x7fb2c41096c0 2024-03-28T05:41:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.675+0000 7fb2bbe00700 1 -- 172.21.15.55:0/3941319735 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18407 (secure 0 0 0) 0x7fb2bc09b2c0 con 0x7fb2c41096c0 2024-03-28T05:41:52.676 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:41:52.677 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:41:49.723408+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:41:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 msgr2=0x7fb2a80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 0x7fb2a80a4d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b4005fb0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 msgr2=0x7fb2c419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc007ee0 tx=0x7fb2bc00d3b0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 shutdown_connections 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2a80a2890 0x7fb2a80a4d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c41096c0 0x7fb2c419a910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2c41045e0 0x7fb2c41a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 --2- 172.21.15.55:0/3941319735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2c4104f90 0x7fb2c41a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 >> 172.21.15.55:0/3941319735 conn(0x7fb2c40ffe70 msgr2=0x7fb2c4102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 shutdown_connections 2024-03-28T05:41:52.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:52.678+0000 7fb2ca200700 1 -- 172.21.15.55:0/3941319735 wait complete. 2024-03-28T05:41:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:52 smithi086 ceph-mon[35163]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:52 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3941319735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:41:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:52 smithi159 ceph-mon[36109]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:52 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3941319735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:41:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:52 smithi055 ceph-mon[31863]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:52 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3941319735' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:41:53.561 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:41:53.562 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-28T05:41:54.024 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:41:55.193 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:55 smithi055 ceph-mon[31863]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:55 smithi086 ceph-mon[35163]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:55 smithi159 ceph-mon[36109]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 -- 172.21.15.55:0/2854407903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f4074ce0 msgr2=0x7fa5f410e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2854407903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f4074ce0 0x7fa5f410e650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009990 tx=0x7fa5e0009ca0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 -- 172.21.15.55:0/2854407903 shutdown_connections 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2854407903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f410eb90 0x7fa5f4110f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2854407903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f40747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2854407903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f4074ce0 0x7fa5f410e650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 -- 172.21.15.55:0/2854407903 >> 172.21.15.55:0/2854407903 conn(0x7fa5f40792c0 msgr2=0x7fa5f40796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 -- 172.21.15.55:0/2854407903 shutdown_connections 2024-03-28T05:41:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.060+0000 7fa5fc600700 1 -- 172.21.15.55:0/2854407903 wait complete. 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.061+0000 7fa5fc600700 1 Processor -- start 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 -- start start 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f4074ce0 0x7fa5f41a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4114590 con 0x7fa5f410eb90 2024-03-28T05:41:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4114410 con 0x7fa5f40743c0 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fc600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4114710 con 0x7fa5f4074ce0 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fa600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fa600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41992/0 (socket says 172.21.15.55:41992) 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.062+0000 7fa5fa600700 1 -- 172.21.15.55:0/2003874763 learned_addr learned my addr 172.21.15.55:0/2003874763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5f9c00700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5f9200700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f4074ce0 0x7fa5f41a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 -- 172.21.15.55:0/2003874763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f4074ce0 msgr2=0x7fa5f41a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f4074ce0 0x7fa5f41a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 -- 172.21.15.55:0/2003874763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 msgr2=0x7fa5f41a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f41a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 -- 172.21.15.55:0/2003874763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f419aff0 con 0x7fa5f410eb90 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5f9c00700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:41:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.063+0000 7fa5fa600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007d40 tx=0x7fa5ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.064+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec016020 con 0x7fa5f410eb90 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.064+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f419b2e0 con 0x7fa5f410eb90 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.064+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5ec00ad40 con 0x7fa5f410eb90 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.064+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec011660 con 0x7fa5f410eb90 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.064+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f41a75a0 con 0x7fa5f410eb90 2024-03-28T05:41:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.065+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f4068e50 con 0x7fa5f410eb90 2024-03-28T05:41:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.067+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa5ec019020 con 0x7fa5f410eb90 2024-03-28T05:41:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.068+0000 7fa5f2000700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 0x7fa5dc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.068+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa5ec0ce660 con 0x7fa5f410eb90 2024-03-28T05:41:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.069+0000 7fa5f9c00700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 0x7fa5dc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.069+0000 7fa5f9c00700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 0x7fa5dc0a4d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8005950 tx=0x7fa5e80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.073+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa5ec020020 con 0x7fa5f410eb90 2024-03-28T05:41:56.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.298+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f419bdc0 con 0x7fa5f410eb90 2024-03-28T05:41:56.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.299+0000 7fa5f2000700 1 -- 172.21.15.55:0/2003874763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ec09bb00 con 0x7fa5f410eb90 2024-03-28T05:41:56.300 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 msgr2=0x7fa5dc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 0x7fa5dc0a4d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8005950 tx=0x7fa5e80058e0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 msgr2=0x7fa5f419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007d40 tx=0x7fa5ec00a340 comp rx=0 tx=0).stop 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 shutdown_connections 2024-03-28T05:41:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5dc0a2890 0x7fa5dc0a4d50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5f410eb90 0x7fa5f419a890 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f40743c0 0x7fa5f41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 --2- 172.21.15.55:0/2003874763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f4074ce0 0x7fa5f41a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.302+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 >> 172.21.15.55:0/2003874763 conn(0x7fa5f40792c0 msgr2=0x7fa5f40ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.303+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 shutdown_connections 2024-03-28T05:41:56.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:41:56.303+0000 7fa5fc600700 1 -- 172.21.15.55:0/2003874763 wait complete. 2024-03-28T05:41:57.119 INFO:tasks.cephadm:Adding mds.a on smithi055 2024-03-28T05:41:57.119 INFO:tasks.cephadm:Adding mds.d on smithi055 2024-03-28T05:41:57.119 INFO:tasks.cephadm:Adding mds.g on smithi055 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.j on smithi055 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.b on smithi086 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.e on smithi086 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.h on smithi086 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.k on smithi086 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.c on smithi159 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.f on smithi159 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.i on smithi159 2024-03-28T05:41:57.120 INFO:tasks.cephadm:Adding mds.l on smithi159 2024-03-28T05:41:57.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph orch apply mds all '12;smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l' 2024-03-28T05:41:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:57 smithi086 ceph-mon[35163]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:57 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2003874763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:41:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:57 smithi159 ceph-mon[36109]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:57 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2003874763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:41:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:57 smithi055 ceph-mon[31863]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:57 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2003874763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:41:57.579 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.c/config 2024-03-28T05:41:59.207 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:41:59 smithi159 ceph-mon[36109]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:41:59 smithi086 ceph-mon[35163]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:41:59 smithi055 ceph-mon[31863]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.694+0000 7fde5f200700 1 -- 172.21.15.159:0/261627620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde601032e0 msgr2=0x7fde60105770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.694+0000 7fde5f200700 1 --2- 172.21.15.159:0/261627620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde601032e0 0x7fde60105770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009990 tx=0x7fde4c009ca0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 -- 172.21.15.159:0/261627620 shutdown_connections 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 --2- 172.21.15.159:0/261627620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde60100970 0x7fde60102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 --2- 172.21.15.159:0/261627620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde60105cb0 0x7fde60106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 --2- 172.21.15.159:0/261627620 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde601032e0 0x7fde60105770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 -- 172.21.15.159:0/261627620 >> 172.21.15.159:0/261627620 conn(0x7fde600fc5b0 msgr2=0x7fde600fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:59.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 -- 172.21.15.159:0/261627620 shutdown_connections 2024-03-28T05:41:59.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.695+0000 7fde5f200700 1 -- 172.21.15.159:0/261627620 wait complete. 2024-03-28T05:41:59.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 Processor -- start 2024-03-28T05:41:59.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 -- start start 2024-03-28T05:41:59.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:59.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 0x7fde6019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde60105cb0 0x7fde601a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60114140 con 0x7fde60105cb0 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60113fc0 con 0x7fde601032e0 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.696+0000 7fde5f200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde601142c0 con 0x7fde60100970 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33516/0 (socket says 172.21.15.159:33516) 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 -- 172.21.15.159:0/1752309011 learned_addr learned my addr 172.21.15.159:0/1752309011 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5d400700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 0x7fde6019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 -- 172.21.15.159:0/1752309011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 msgr2=0x7fde6019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 0x7fde6019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 -- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde60105cb0 msgr2=0x7fde601a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde60105cb0 0x7fde601a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 -- 172.21.15.159:0/1752309011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde601a63b0 con 0x7fde60100970 2024-03-28T05:41:59.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5d400700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 0x7fde6019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:41:59.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.697+0000 7fde5de00700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c9e0 tx=0x7fde5000cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:59.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.698+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50007ac0 con 0x7fde60100970 2024-03-28T05:41:59.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.698+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fde50007c60 con 0x7fde60100970 2024-03-28T05:41:59.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.698+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde601a66a0 con 0x7fde60100970 2024-03-28T05:41:59.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.698+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50018660 con 0x7fde60100970 2024-03-28T05:41:59.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.698+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde601a6c30 con 0x7fde60100970 2024-03-28T05:41:59.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.699+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde60068e50 con 0x7fde60100970 2024-03-28T05:41:59.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.701+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fde5000f450 con 0x7fde60100970 2024-03-28T05:41:59.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.703+0000 7fde56a00700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 0x7fde440a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:41:59.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.703+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fde500ce5e0 con 0x7fde60100970 2024-03-28T05:41:59.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.704+0000 7fde5d400700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 0x7fde440a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:41:59.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.705+0000 7fde5d400700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 0x7fde440a4dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0036e0 tx=0x7fde4c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:41:59.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.708+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fde50014030 con 0x7fde60100970 2024-03-28T05:41:59.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.944+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fde600627d0 con 0x7fde440a2910 2024-03-28T05:41:59.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.965+0000 7fde56a00700 1 -- 172.21.15.159:0/1752309011 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fde600627d0 con 0x7fde440a2910 2024-03-28T05:41:59.966 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mds.all update... 2024-03-28T05:41:59.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 msgr2=0x7fde440a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:59.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 0x7fde440a4dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0036e0 tx=0x7fde4c005fb0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 msgr2=0x7fde6019e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c9e0 tx=0x7fde5000cda0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 shutdown_connections 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde440a2910 0x7fde440a4dd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde60105cb0 0x7fde601a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60100970 0x7fde6019e750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 --2- 172.21.15.159:0/1752309011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde601032e0 0x7fde6019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 >> 172.21.15.159:0/1752309011 conn(0x7fde600fc5b0 msgr2=0x7fde60101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 shutdown_connections 2024-03-28T05:41:59.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-28T05:41:59.968+0000 7fde5f200700 1 -- 172.21.15.159:0/1752309011 wait complete. 2024-03-28T05:42:00.681 DEBUG:teuthology.orchestra.run.smithi055:mds.a> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service 2024-03-28T05:42:00.689 DEBUG:teuthology.orchestra.run.smithi055:mds.d> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service 2024-03-28T05:42:00.735 DEBUG:teuthology.orchestra.run.smithi055:mds.g> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service 2024-03-28T05:42:00.780 DEBUG:teuthology.orchestra.run.smithi055:mds.j> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service 2024-03-28T05:42:00.824 DEBUG:teuthology.orchestra.run.smithi086:mds.b> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.b.service 2024-03-28T05:42:00.832 DEBUG:teuthology.orchestra.run.smithi086:mds.e> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.e.service 2024-03-28T05:42:00.878 DEBUG:teuthology.orchestra.run.smithi086:mds.h> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service 2024-03-28T05:42:00.924 DEBUG:teuthology.orchestra.run.smithi086:mds.k> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.k.service 2024-03-28T05:42:00.969 DEBUG:teuthology.orchestra.run.smithi159:mds.c> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.c.service 2024-03-28T05:42:00.977 DEBUG:teuthology.orchestra.run.smithi159:mds.f> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service 2024-03-28T05:42:01.022 DEBUG:teuthology.orchestra.run.smithi159:mds.i> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service 2024-03-28T05:42:01.066 DEBUG:teuthology.orchestra.run.smithi159:mds.l> sudo journalctl -f -n 0 -u ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service 2024-03-28T05:42:01.110 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-28T05:42:01.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:42:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: Saving service mds.all spec with placement smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:00 smithi055 ceph-mon[31863]: Deploying daemon mds.l on smithi159 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: Saving service mds.all spec with placement smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.300 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:01.301 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.301 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:01.301 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:01.301 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.301 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:00 smithi159 ceph-mon[36109]: Deploying daemon mds.l on smithi159 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: Saving service mds.all spec with placement smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:00 smithi086 ceph-mon[35163]: Deploying daemon mds.l on smithi159 2024-03-28T05:42:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 -- 172.21.15.55:0/77245610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81052a0 msgr2=0x7f99b810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 --2- 172.21.15.55:0/77245610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81052a0 0x7f99b810bb30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009ca0 tx=0x7f99b002c100 comp rx=0 tx=0).stop 2024-03-28T05:42:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 -- 172.21.15.55:0/77245610 shutdown_connections 2024-03-28T05:42:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 --2- 172.21.15.55:0/77245610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81052a0 0x7f99b810bb30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 --2- 172.21.15.55:0/77245610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81048e0 0x7f99b8104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 --2- 172.21.15.55:0/77245610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 0x7f99b8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 -- 172.21.15.55:0/77245610 >> 172.21.15.55:0/77245610 conn(0x7f99b80fec80 msgr2=0x7f99b81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 -- 172.21.15.55:0/77245610 shutdown_connections 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.348+0000 7f99b7200640 1 -- 172.21.15.55:0/77245610 wait complete. 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 Processor -- start 2024-03-28T05:42:01.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 -- start start 2024-03-28T05:42:01.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 0x7f99b8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81052a0 0x7f99b81a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b810f220 con 0x7f99b81048e0 2024-03-28T05:42:01.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b810f0a0 con 0x7f99b81052a0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.350+0000 7f99b7200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b810f3a0 con 0x7f99b81036f0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47514/0 (socket says 172.21.15.55:47514) 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 -- 172.21.15.55:0/1070670815 learned_addr learned my addr 172.21.15.55:0/1070670815 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99b5e00640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 0x7f99b8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 -- 172.21.15.55:0/1070670815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 msgr2=0x7f99b8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 0x7f99b8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 -- 172.21.15.55:0/1070670815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81052a0 msgr2=0x7f99b81a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99b6800640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81052a0 0x7f99b81a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81052a0 0x7f99b81a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 -- 172.21.15.55:0/1070670815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b81a1450 con 0x7f99b81048e0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.351+0000 7f99ad400640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c920 tx=0x7f99a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.352+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0007c70 con 0x7f99b81048e0 2024-03-28T05:42:01.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.352+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f99a0007e10 con 0x7f99b81048e0 2024-03-28T05:42:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.352+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b81a1740 con 0x7f99b81048e0 2024-03-28T05:42:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.352+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0018820 con 0x7f99b81048e0 2024-03-28T05:42:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.352+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b81a1c90 con 0x7f99b81048e0 2024-03-28T05:42:01.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.353+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b810a9b0 con 0x7f99b81048e0 2024-03-28T05:42:01.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.355+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f99a00189c0 con 0x7f99b81048e0 2024-03-28T05:42:01.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.356+0000 7f99af400640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 0x7f999c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.357+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f99a00ce7b0 con 0x7f99b81048e0 2024-03-28T05:42:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.357+0000 7f99b5e00640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 0x7f999c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.357+0000 7f99b5e00640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 0x7f999c0a4cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99b8104740 tx=0x7f99a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:01.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.361+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f99a0014030 con 0x7f99b81048e0 2024-03-28T05:42:01.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.565+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b80622a0 con 0x7f99b81048e0 2024-03-28T05:42:01.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.566+0000 7f99af400640 1 -- 172.21.15.55:0/1070670815 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18407 (secure 0 0 0) 0x7f99a009bc50 con 0x7f99b81048e0 2024-03-28T05:42:01.567 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:01.568 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:41:49.723408+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 msgr2=0x7f999c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 0x7f999c0a4cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99b8104740 tx=0x7f99a8005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 msgr2=0x7f99b8199d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c920 tx=0x7f99a000cde0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 shutdown_connections 2024-03-28T05:42:01.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f999c0a2800 0x7f999c0a4cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99b81052a0 0x7f99b81a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99b81048e0 0x7f99b8199d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 --2- 172.21.15.55:0/1070670815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f99b81036f0 0x7f99b8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 >> 172.21.15.55:0/1070670815 conn(0x7f99b80fec80 msgr2=0x7f99b8107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 shutdown_connections 2024-03-28T05:42:01.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.569+0000 7f99b7200640 1 -- 172.21.15.55:0/1070670815 wait complete. 2024-03-28T05:42:01.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:42:01.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:42:01.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 -- 172.21.15.55:0/1213858510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 msgr2=0x7fdad410ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 --2- 172.21.15.55:0/1213858510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad410ba00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009ca0 tx=0x7fdacc02c100 comp rx=0 tx=0).stop 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 -- 172.21.15.55:0/1213858510 shutdown_connections 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 --2- 172.21.15.55:0/1213858510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad410ba00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 --2- 172.21.15.55:0/1213858510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad4074100 0x7fdad4074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 --2- 172.21.15.55:0/1213858510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad40756e0 0x7fdad4073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 -- 172.21.15.55:0/1213858510 >> 172.21.15.55:0/1213858510 conn(0x7fdad40fcc40 msgr2=0x7fdad40ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 -- 172.21.15.55:0/1213858510 shutdown_connections 2024-03-28T05:42:01.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.863+0000 7fdada600640 1 -- 172.21.15.55:0/1213858510 wait complete. 2024-03-28T05:42:01.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 Processor -- start 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 -- start start 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad4074100 0x7fdad4199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad40756e0 0x7fdad4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad410f3a0 con 0x7fdad4109570 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad410f220 con 0x7fdad40756e0 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.864+0000 7fdada600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad410f520 con 0x7fdad4074100 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47534/0 (socket says 172.21.15.55:47534) 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 -- 172.21.15.55:0/1686523207 learned_addr learned my addr 172.21.15.55:0/1686523207 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3400640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad4074100 0x7fdad4199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 -- 172.21.15.55:0/1686523207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad4074100 msgr2=0x7fdad4199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad4074100 0x7fdad4199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 -- 172.21.15.55:0/1686523207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad40756e0 msgr2=0x7fdad4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad2a00640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad40756e0 0x7fdad4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad40756e0 0x7fdad4199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 -- 172.21.15.55:0/1686523207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad41a1690 con 0x7fdad4109570 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.865+0000 7fdad3e00640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdacc032520 tx=0x7fdacc034880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.866+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc039040 con 0x7fdad4109570 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.866+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdacc044070 con 0x7fdad4109570 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.866+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc004430 con 0x7fdad4109570 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.866+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad41a1920 con 0x7fdad4109570 2024-03-28T05:42:01.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.866+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad41a1e60 con 0x7fdad4109570 2024-03-28T05:42:01.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.867+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad41082a0 con 0x7fdad4109570 2024-03-28T05:42:01.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.869+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fdacc003bc0 con 0x7fdad4109570 2024-03-28T05:42:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.870+0000 7fdacbe00640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 0x7fdab80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.870+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdacc0f0d90 con 0x7fdad4109570 2024-03-28T05:42:01.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.871+0000 7fdad3400640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 0x7fdab80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:01.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.871+0000 7fdad3400640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 0x7fdab80a4d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdac4005fd0 tx=0x7fdac4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:01.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:01.875+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fdacc0be230 con 0x7fdad4109570 2024-03-28T05:42:02.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.077+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdad40622a0 con 0x7fdad4109570 2024-03-28T05:42:02.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.078+0000 7fdacbe00640 1 -- 172.21.15.55:0/1686523207 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdacc0bdb30 con 0x7fdad4109570 2024-03-28T05:42:02.081 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:42:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 msgr2=0x7fdab80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 0x7fdab80a4d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdac4005fd0 tx=0x7fdac4005850 comp rx=0 tx=0).stop 2024-03-28T05:42:02.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 msgr2=0x7fdad41a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdacc032520 tx=0x7fdacc034880 comp rx=0 tx=0).stop 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 shutdown_connections 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdab80a2880 0x7fdab80a4d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdad4109570 0x7fdad41a1020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdad40756e0 0x7fdad4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 --2- 172.21.15.55:0/1686523207 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad4074100 0x7fdad4199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.081+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 >> 172.21.15.55:0/1686523207 conn(0x7fdad40fcc40 msgr2=0x7fdad4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.082+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 shutdown_connections 2024-03-28T05:42:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.082+0000 7fdada600640 1 -- 172.21.15.55:0/1686523207 wait complete. 2024-03-28T05:42:02.103 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:02.230 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1070670815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1070670815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 -- 172.21.15.55:0/3084214034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de41030b0 msgr2=0x7f8de4109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 --2- 172.21.15.55:0/3084214034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de41030b0 0x7f8de4109940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009ca0 tx=0x7f8ddc02c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 -- 172.21.15.55:0/3084214034 shutdown_connections 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 --2- 172.21.15.55:0/3084214034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de41030b0 0x7f8de4109940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 --2- 172.21.15.55:0/3084214034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 0x7f8de4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 --2- 172.21.15.55:0/3084214034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de4101500 0x7f8de4101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.331+0000 7f8deae00640 1 -- 172.21.15.55:0/3084214034 >> 172.21.15.55:0/3084214034 conn(0x7f8de40fca70 msgr2=0x7f8de40feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.332+0000 7f8deae00640 1 -- 172.21.15.55:0/3084214034 shutdown_connections 2024-03-28T05:42:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.332+0000 7f8deae00640 1 -- 172.21.15.55:0/3084214034 wait complete. 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 Processor -- start 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 -- start start 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 0x7f8de4073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 0x7f8de4073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de410d040 con 0x7f8de4101500 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de410cec0 con 0x7f8de41026f0 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.333+0000 7f8deae00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de410d1c0 con 0x7f8de41030b0 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8de9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8de9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47554/0 (socket says 172.21.15.55:47554) 2024-03-28T05:42:02.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8de9a00640 1 -- 172.21.15.55:0/2841034853 learned_addr learned my addr 172.21.15.55:0/2841034853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 0x7f8de4073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8de9000640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 0x7f8de4073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 -- 172.21.15.55:0/2841034853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 msgr2=0x7f8de4073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 0x7f8de4073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 -- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 msgr2=0x7f8de4075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8dea400640 1 -- 172.21.15.55:0/2841034853 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4074860 con 0x7f8de41030b0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.334+0000 7f8de9a00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8dea400640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 0x7f8de4073fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc037040 tx=0x7f8ddc032820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc041020 con 0x7f8de41030b0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ddc003e20 con 0x7f8de41030b0 2024-03-28T05:42:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de41a1790 con 0x7f8de41030b0 2024-03-28T05:42:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc039040 con 0x7f8de41030b0 2024-03-28T05:42:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.335+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de41a1cb0 con 0x7f8de41030b0 2024-03-28T05:42:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.337+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4108940 con 0x7f8de41030b0 2024-03-28T05:42:02.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.339+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8ddc044020 con 0x7f8de41030b0 2024-03-28T05:42:02.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.341+0000 7f8de2000640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 0x7f8dcc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:02.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.341+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8ddc0f0a40 con 0x7f8de41030b0 2024-03-28T05:42:02.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.341+0000 7f8de9a00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 0x7f8dcc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:02.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.342+0000 7f8de9a00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 0x7f8dcc0a4cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80058c0 tx=0x7f8dd8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:02.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.345+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8ddc04b020 con 0x7f8de41030b0 2024-03-28T05:42:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1070670815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.590+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8de402d070 con 0x7f8de41030b0 2024-03-28T05:42:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.591+0000 7f8de2000640 1 -- 172.21.15.55:0/2841034853 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8ddc0bdee0 con 0x7f8de41030b0 2024-03-28T05:42:02.595 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:02.595 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-28T05:42:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 1 2024-03-28T05:42:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 msgr2=0x7f8dcc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 0x7f8dcc0a4cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80058c0 tx=0x7f8dd8005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 msgr2=0x7f8de4073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 0x7f8de4073fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc037040 tx=0x7f8ddc032820 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 shutdown_connections 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8dcc0a2800 0x7f8dcc0a4cc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8de41030b0 0x7f8de4073fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8de41026f0 0x7f8de4073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 --2- 172.21.15.55:0/2841034853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de4101500 0x7f8de4075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.593+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 >> 172.21.15.55:0/2841034853 conn(0x7f8de40fca70 msgr2=0x7f8de4105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.594+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 shutdown_connections 2024-03-28T05:42:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:02.594+0000 7f8deae00640 1 -- 172.21.15.55:0/2841034853 wait complete. 2024-03-28T05:42:03.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:02 smithi159 ceph-mon[36109]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:03.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1686523207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:03.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2841034853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:02 smithi086 ceph-mon[35163]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1686523207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2841034853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:02 smithi055 ceph-mon[31863]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1686523207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2841034853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:03.518 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 podman[66043]: 2024-03-28 05:42:03.279464073 +0000 UTC m=+0.189315208 container create 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-28T05:42:03.518 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 podman[66043]: 2024-03-28 05:42:03.516567468 +0000 UTC m=+0.426418646 container init 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:42:03.821 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 podman[66043]: 2024-03-28 05:42:03.526830656 +0000 UTC m=+0.436681761 container start 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0) 2024-03-28T05:42:03.821 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 ceph-mds[66062]: -- 172.21.15.159:0/2673990770 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cf586b5a40 con 0x55cf58688800 2024-03-28T05:42:03.821 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: starting mds.l at 2024-03-28T05:42:03.821 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 bash[66043]: 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 2024-03-28T05:42:03.821 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:42:03 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:04.618 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:04.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.849+0000 7fe9a7200640 1 -- 172.21.15.55:0/3220276815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81036f0 msgr2=0x7fe9a8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:04.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.849+0000 7fe9a7200640 1 --2- 172.21.15.55:0/3220276815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81036f0 0x7fe9a8103b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe998009900 tx=0x7fe99802bc40 comp rx=0 tx=0).stop 2024-03-28T05:42:04.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 -- 172.21.15.55:0/3220276815 shutdown_connections 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 --2- 172.21.15.55:0/3220276815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81052a0 0x7fe9a810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 --2- 172.21.15.55:0/3220276815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 0x7fe9a8104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 --2- 172.21.15.55:0/3220276815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81036f0 0x7fe9a8103b10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 -- 172.21.15.55:0/3220276815 >> 172.21.15.55:0/3220276815 conn(0x7fe9a80fec80 msgr2=0x7fe9a81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 -- 172.21.15.55:0/3220276815 shutdown_connections 2024-03-28T05:42:04.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.850+0000 7fe9a7200640 1 -- 172.21.15.55:0/3220276815 wait complete. 2024-03-28T05:42:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 Processor -- start 2024-03-28T05:42:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 -- start start 2024-03-28T05:42:04.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81036f0 0x7fe9a81998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 0x7fe9a8199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810f2c0 con 0x7fe9a81052a0 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810f140 con 0x7fe9a81048e0 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.851+0000 7fe9a7200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810f440 con 0x7fe9a81036f0 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47582/0 (socket says 172.21.15.55:47582) 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 -- 172.21.15.55:0/2814122356 learned_addr learned my addr 172.21.15.55:0/2814122356 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a5e00640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81036f0 0x7fe9a81998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:04.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe99d400640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 0x7fe9a8199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 -- 172.21.15.55:0/2814122356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81036f0 msgr2=0x7fe9a81998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81036f0 0x7fe9a81998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 -- 172.21.15.55:0/2814122356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 msgr2=0x7fe9a8199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 0x7fe9a8199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 -- 172.21.15.55:0/2814122356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a81a1500 con 0x7fe9a81052a0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.852+0000 7fe9a6800640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000b970 tx=0x7fe9a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.853+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0019070 con 0x7fe9a81052a0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.853+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9a0014440 con 0x7fe9a81052a0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.853+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00075d0 con 0x7fe9a81052a0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.853+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a81a17f0 con 0x7fe9a81052a0 2024-03-28T05:42:04.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.853+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a81a1d70 con 0x7fe9a81052a0 2024-03-28T05:42:04.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.854+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a810aa10 con 0x7fe9a81052a0 2024-03-28T05:42:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.856+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fe9a001c070 con 0x7fe9a81052a0 2024-03-28T05:42:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.857+0000 7fe99f400640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 0x7fe98c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.858+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9a00cdbf0 con 0x7fe9a81052a0 2024-03-28T05:42:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.858+0000 7fe9a5e00640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 0x7fe98c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:04.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.858+0000 7fe9a5e00640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 0x7fe98c0a4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe99802c250 tx=0x7fe998000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:04.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:04.862+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fe9a009b090 con 0x7fe9a81052a0 2024-03-28T05:42:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:boot 2024-03-28T05:42:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: fsmap 1 up:standby 2024-03-28T05:42:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:42:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:04.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:boot 2024-03-28T05:42:04.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: fsmap 1 up:standby 2024-03-28T05:42:04.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:42:04.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:04.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:04.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:04.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:boot 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: fsmap 1 up:standby 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.107+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9a802d070 con 0x7fe9a81052a0 2024-03-28T05:42:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.107+0000 7fe99f400640 1 -- 172.21.15.55:0/2814122356 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fe9a009a990 con 0x7fe9a81052a0 2024-03-28T05:42:05.109 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:05.109 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-28T05:42:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 2 2024-03-28T05:42:05.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 msgr2=0x7fe98c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 0x7fe98c0a4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe99802c250 tx=0x7fe998000bc0 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 msgr2=0x7fe9a81a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000b970 tx=0x7fe9a000be30 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 shutdown_connections 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe98c0a2880 0x7fe98c0a4d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9a81052a0 0x7fe9a81a0e90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a81048e0 0x7fe9a8199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 --2- 172.21.15.55:0/2814122356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9a81036f0 0x7fe9a81998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.110+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 >> 172.21.15.55:0/2814122356 conn(0x7fe9a80fec80 msgr2=0x7fe9a8107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.111+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 shutdown_connections 2024-03-28T05:42:05.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:05.111+0000 7fe9a7200640 1 -- 172.21.15.55:0/2814122356 wait complete. 2024-03-28T05:42:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:05 smithi055 ceph-mon[31863]: Deploying daemon mds.k on smithi086 2024-03-28T05:42:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:05 smithi055 ceph-mon[31863]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:05 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2814122356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:06.013 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:05 smithi086 ceph-mon[35163]: Deploying daemon mds.k on smithi086 2024-03-28T05:42:06.013 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:05 smithi086 ceph-mon[35163]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:06.013 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:05 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2814122356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:05 smithi159 ceph-mon[36109]: Deploying daemon mds.k on smithi086 2024-03-28T05:42:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:05 smithi159 ceph-mon[36109]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:05 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2814122356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:07.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:07.171 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:06 smithi086 systemd[1]: Starting Ceph mds.k for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.364+0000 7fa808a00640 1 -- 172.21.15.55:0/3644366148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804104ad0 msgr2=0x7fa804104f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.364+0000 7fa808a00640 1 --2- 172.21.15.55:0/3644366148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804104ad0 0x7fa804104f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009900 tx=0x7fa7ec02bc40 comp rx=0 tx=0).stop 2024-03-28T05:42:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 -- 172.21.15.55:0/3644366148 shutdown_connections 2024-03-28T05:42:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 --2- 172.21.15.55:0/3644366148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa804105490 0x7fa80410bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 --2- 172.21.15.55:0/3644366148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804104ad0 0x7fa804104f50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 --2- 172.21.15.55:0/3644366148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8041038e0 0x7fa804103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 -- 172.21.15.55:0/3644366148 >> 172.21.15.55:0/3644366148 conn(0x7fa8040fee50 msgr2=0x7fa804101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:07.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 -- 172.21.15.55:0/3644366148 shutdown_connections 2024-03-28T05:42:07.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.365+0000 7fa808a00640 1 -- 172.21.15.55:0/3644366148 wait complete. 2024-03-28T05:42:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.366+0000 7fa808a00640 1 Processor -- start 2024-03-28T05:42:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.366+0000 7fa808a00640 1 -- start start 2024-03-28T05:42:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8041038e0 0x7fa804199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:07.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 0x7fa8041a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80410f410 con 0x7fa804104ad0 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80410f290 con 0x7fa804105490 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa808a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80410f590 con 0x7fa8041038e0 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47596/0 (socket says 172.21.15.55:47596) 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 -- 172.21.15.55:0/1992755354 learned_addr learned my addr 172.21.15.55:0/1992755354 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa802800640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 0x7fa8041a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 -- 172.21.15.55:0/1992755354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8041038e0 msgr2=0x7fa804199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8041038e0 0x7fa804199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 -- 172.21.15.55:0/1992755354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 msgr2=0x7fa8041a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 0x7fa8041a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa7f9400640 1 -- 172.21.15.55:0/1992755354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8041a16f0 con 0x7fa804104ad0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.367+0000 7fa802800640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 0x7fa8041a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa7f9400640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec006010 tx=0x7fa7ec004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec043020 con 0x7fa804104ad0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa7ec004440 con 0x7fa804104ad0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003bf0 con 0x7fa804104ad0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8041a1980 con 0x7fa804104ad0 2024-03-28T05:42:07.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.368+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041a1f20 con 0x7fa804104ad0 2024-03-28T05:42:07.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.369+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80410ac00 con 0x7fa804104ad0 2024-03-28T05:42:07.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.371+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa7ec046020 con 0x7fa804104ad0 2024-03-28T05:42:07.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.373+0000 7fa7fb400640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 0x7fa7e80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:07.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.373+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa7ec0f0a30 con 0x7fa804104ad0 2024-03-28T05:42:07.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.373+0000 7fa801e00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 0x7fa7e80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:07.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.374+0000 7fa801e00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 0x7fa7e80a4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005c40 tx=0x7fa7f4005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:07.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.377+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa7ec04d020 con 0x7fa804104ad0 2024-03-28T05:42:07.494 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 podman[64359]: 2024-03-28 05:42:07.076208267 +0000 UTC m=+0.031804517 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:07.494 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 podman[64359]: 2024-03-28 05:42:07.189847879 +0000 UTC m=+0.145444146 container create 65bbeb2d09f05464a45e009eaf855a874b6c976237f71f74bad253e751ed31b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-k, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:42:07.494 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 podman[64359]: 2024-03-28 05:42:07.493361613 +0000 UTC m=+0.448957930 container init 65bbeb2d09f05464a45e009eaf855a874b6c976237f71f74bad253e751ed31b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-k, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-28T05:42:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.625+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa80402d070 con 0x7fa804104ad0 2024-03-28T05:42:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.626+0000 7fa7fb400640 1 -- 172.21.15.55:0/1992755354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7fa7ec0bded0 con 0x7fa804104ad0 2024-03-28T05:42:07.627 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:07.627 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-03-28T05:42:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 msgr2=0x7fa7e80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 0x7fa7e80a4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005c40 tx=0x7fa7f4005bd0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 msgr2=0x7fa80419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec006010 tx=0x7fa7ec004040 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 shutdown_connections 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa7e80a2880 0x7fa7e80a4d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa804105490 0x7fa8041a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa804104ad0 0x7fa80419a010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 --2- 172.21.15.55:0/1992755354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8041038e0 0x7fa804199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 >> 172.21.15.55:0/1992755354 conn(0x7fa8040fee50 msgr2=0x7fa804107dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.629+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 shutdown_connections 2024-03-28T05:42:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:07.630+0000 7fa808a00640 1 -- 172.21.15.55:0/1992755354 wait complete. 2024-03-28T05:42:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:07 smithi086 ceph-mon[35163]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:07.819 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 podman[64359]: 2024-03-28 05:42:07.504999291 +0000 UTC m=+0.460595538 container start 65bbeb2d09f05464a45e009eaf855a874b6c976237f71f74bad253e751ed31b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:42:07.819 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 ceph-mds[64379]: -- 172.21.15.86:0/49372683 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3a9261a40 con 0x55b3a9235000 2024-03-28T05:42:07.819 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-k[64374]: starting mds.k at 2024-03-28T05:42:07.819 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 bash[64359]: 65bbeb2d09f05464a45e009eaf855a874b6c976237f71f74bad253e751ed31b8 2024-03-28T05:42:07.819 INFO:journalctl@ceph.mds.k.smithi086.stdout:Mar 28 05:42:07 smithi086 systemd[1]: Started Ceph mds.k for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:07 smithi055 ceph-mon[31863]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:07 smithi159 ceph-mon[36109]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6832/3295609155,v1:172.21.15.86:6833/3295609155] up:boot 2024-03-28T05:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: fsmap 2 up:standby 2024-03-28T05:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-28T05:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1992755354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:08.938 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6832/3295609155,v1:172.21.15.86:6833/3295609155] up:boot 2024-03-28T05:42:08.938 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: fsmap 2 up:standby 2024-03-28T05:42:08.938 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1992755354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:08.939 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6832/3295609155,v1:172.21.15.86:6833/3295609155] up:boot 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: fsmap 2 up:standby 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1992755354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:09.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:09 smithi055 ceph-mon[31863]: Deploying daemon mds.j on smithi055 2024-03-28T05:42:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:09 smithi055 ceph-mon[31863]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 -- 172.21.15.55:0/3480018285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65940ff990 msgr2=0x7f65940ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 --2- 172.21.15.55:0/3480018285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65940ff990 0x7f65940ffdb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6584009cd0 tx=0x7f658402c0e0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 -- 172.21.15.55:0/3480018285 shutdown_connections 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 --2- 172.21.15.55:0/3480018285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6594103320 0x7f6594109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 --2- 172.21.15.55:0/3480018285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6594102960 0x7f6594102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 --2- 172.21.15.55:0/3480018285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65940ff990 0x7f65940ffdb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 -- 172.21.15.55:0/3480018285 >> 172.21.15.55:0/3480018285 conn(0x7f65940fb280 msgr2=0x7f65940fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 -- 172.21.15.55:0/3480018285 shutdown_connections 2024-03-28T05:42:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.886+0000 7f659a200640 1 -- 172.21.15.55:0/3480018285 wait complete. 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 Processor -- start 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 -- start start 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65940ff990 0x7f6594199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6594103320 0x7f65941a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659410d1f0 con 0x7f6594102960 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659410d070 con 0x7f6594103320 2024-03-28T05:42:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.887+0000 7f659a200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659410d370 con 0x7f65940ff990 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32808/0 (socket says 172.21.15.55:32808) 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 -- 172.21.15.55:0/462172854 learned_addr learned my addr 172.21.15.55:0/462172854 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6593400640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65940ff990 0x7f6594199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 -- 172.21.15.55:0/462172854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65940ff990 msgr2=0x7f6594199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65940ff990 0x7f6594199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 -- 172.21.15.55:0/462172854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6594103320 msgr2=0x7f65941a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6594103320 0x7f65941a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 -- 172.21.15.55:0/462172854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65941a16c0 con 0x7f6594102960 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f6592a00640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c920 tx=0x7f657c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.888+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c007c70 con 0x7f6594102960 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.889+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f657c007e10 con 0x7f6594102960 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.889+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c018820 con 0x7f6594102960 2024-03-28T05:42:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.889+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65941a19b0 con 0x7f6594102960 2024-03-28T05:42:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.889+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65941a1f00 con 0x7f6594102960 2024-03-28T05:42:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.890+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65941a21f0 con 0x7f6594102960 2024-03-28T05:42:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.892+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f657c0189c0 con 0x7f6594102960 2024-03-28T05:42:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.894+0000 7f658be00640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 0x7f65780a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.894+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f657c0ce860 con 0x7f6594102960 2024-03-28T05:42:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.894+0000 7f6593400640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 0x7f65780a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.895+0000 7f6593400640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 0x7f65780a4cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6584037040 tx=0x7f6584000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:09.899+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f657c014030 con 0x7f6594102960 2024-03-28T05:42:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:09 smithi086 ceph-mon[35163]: Deploying daemon mds.j on smithi055 2024-03-28T05:42:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:09 smithi086 ceph-mon[35163]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:09 smithi159 ceph-mon[36109]: Deploying daemon mds.j on smithi055 2024-03-28T05:42:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:09 smithi159 ceph-mon[36109]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:10.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.148+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65941a23c0 con 0x7f6594102960 2024-03-28T05:42:10.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.149+0000 7f658be00640 1 -- 172.21.15.55:0/462172854 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f657c09bd00 con 0x7f6594102960 2024-03-28T05:42:10.150 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:10.151 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:10.151 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-03-28T05:42:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 msgr2=0x7f65780a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 0x7f65780a4cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6584037040 tx=0x7f6584000f40 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 msgr2=0x7f6594199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c920 tx=0x7f657c00cde0 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 shutdown_connections 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65780a2800 0x7f65780a4cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6594103320 0x7f65941a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6594102960 0x7f6594199fe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 --2- 172.21.15.55:0/462172854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65940ff990 0x7f6594199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 >> 172.21.15.55:0/462172854 conn(0x7f65940fb280 msgr2=0x7f6594100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 shutdown_connections 2024-03-28T05:42:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:10.152+0000 7f659a200640 1 -- 172.21.15.55:0/462172854 wait complete. 2024-03-28T05:42:10.816 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/462172854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/462172854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/462172854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:11.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:10 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:11.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 podman[70477]: 2024-03-28 05:42:11.083495578 +0000 UTC m=+0.038835333 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:11.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 podman[70477]: 2024-03-28 05:42:11.194173281 +0000 UTC m=+0.149513089 container create 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:42:11.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 podman[70477]: 2024-03-28 05:42:11.49164661 +0000 UTC m=+0.446986397 container init 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:42:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:11 smithi055 ceph-mon[31863]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:11.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 podman[70477]: 2024-03-28 05:42:11.502462156 +0000 UTC m=+0.457801957 container start 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:42:11.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 ceph-mds[70496]: -- 172.21.15.55:0/700525195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560a06efba40 con 0x560a06ecec00 2024-03-28T05:42:11.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: starting mds.j at 2024-03-28T05:42:11.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 bash[70477]: 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 2024-03-28T05:42:11.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:42:11 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:11 smithi086 ceph-mon[35163]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:11 smithi159 ceph-mon[36109]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:12.173 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 -- 172.21.15.55:0/360803615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c077c40 msgr2=0x7fc16c0784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 --2- 172.21.15.55:0/360803615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c077c40 0x7fc16c0784e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc164009ca0 tx=0x7fc16402c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 -- 172.21.15.55:0/360803615 shutdown_connections 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 --2- 172.21.15.55:0/360803615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c077c40 0x7fc16c0784e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 --2- 172.21.15.55:0/360803615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c0772a0 0x7fc16c077700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 --2- 172.21.15.55:0/360803615 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 0x7fc16c076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 -- 172.21.15.55:0/360803615 >> 172.21.15.55:0/360803615 conn(0x7fc16c0fee90 msgr2=0x7fc16c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.398+0000 7fc171a00640 1 -- 172.21.15.55:0/360803615 shutdown_connections 2024-03-28T05:42:12.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.399+0000 7fc171a00640 1 -- 172.21.15.55:0/360803615 wait complete. 2024-03-28T05:42:12.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.399+0000 7fc171a00640 1 Processor -- start 2024-03-28T05:42:12.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 -- start start 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 0x7fc16c19de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c077c40 0x7fc16c1a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c113820 con 0x7fc16c0772a0 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c1136a0 con 0x7fc16c077c40 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc171a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c1139a0 con 0x7fc16c076060 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc16a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc16a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32838/0 (socket says 172.21.15.55:32838) 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.400+0000 7fc16a000640 1 -- 172.21.15.55:0/392416591 learned_addr learned my addr 172.21.15.55:0/392416591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:12.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16aa00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 0x7fc16c19de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16b400640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c077c40 0x7fc16c1a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 -- 172.21.15.55:0/392416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 msgr2=0x7fc16c19de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 0x7fc16c19de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 -- 172.21.15.55:0/392416591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c077c40 msgr2=0x7fc16c1a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c077c40 0x7fc16c1a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 -- 172.21.15.55:0/392416591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c1a5a70 con 0x7fc16c0772a0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.401+0000 7fc16a000640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc15800d950 tx=0x7fc15800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.402+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158017070 con 0x7fc16c0772a0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.402+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc158009c30 con 0x7fc16c0772a0 2024-03-28T05:42:12.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.402+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c1a5d60 con 0x7fc16c0772a0 2024-03-28T05:42:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.402+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15800f620 con 0x7fc16c0772a0 2024-03-28T05:42:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.402+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c1a6270 con 0x7fc16c0772a0 2024-03-28T05:42:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.403+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c1103e0 con 0x7fc16c0772a0 2024-03-28T05:42:12.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.406+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc1580109a0 con 0x7fc16c0772a0 2024-03-28T05:42:12.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.408+0000 7fc163400640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 0x7fc1500a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:12.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.408+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc1580ce230 con 0x7fc16c0772a0 2024-03-28T05:42:12.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.408+0000 7fc16aa00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 0x7fc1500a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:12.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.409+0000 7fc16aa00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 0x7fc1500a4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005e10 tx=0x7fc15c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:12.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.412+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc158009de0 con 0x7fc16c0772a0 2024-03-28T05:42:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.668+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc16c02d070 con 0x7fc16c0772a0 2024-03-28T05:42:12.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.669+0000 7fc163400640 1 -- 172.21.15.55:0/392416591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fc15809b770 con 0x7fc16c0772a0 2024-03-28T05:42:12.670 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:12.670 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:12.670 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 4 2024-03-28T05:42:12.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 msgr2=0x7fc1500a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 0x7fc1500a4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005e10 tx=0x7fc15c005da0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 msgr2=0x7fc16c19e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc15800d950 tx=0x7fc15800de10 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 shutdown_connections 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1500a2880 0x7fc1500a4d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc16c077c40 0x7fc16c1a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16c0772a0 0x7fc16c19e390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 --2- 172.21.15.55:0/392416591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc16c076060 0x7fc16c19de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.671+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 >> 172.21.15.55:0/392416591 conn(0x7fc16c0fee90 msgr2=0x7fc16c100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.672+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 shutdown_connections 2024-03-28T05:42:12.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:12.672+0000 7fc171a00640 1 -- 172.21.15.55:0/392416591 wait complete. 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:boot 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: fsmap 3 up:standby 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:12.951 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:12.951 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:boot 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: fsmap 3 up:standby 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:12.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:12.972 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:12.972 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:13.028 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:boot 2024-03-28T05:42:13.028 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: fsmap 3 up:standby 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:13.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:13.795 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:13 smithi055 ceph-mon[31863]: Deploying daemon mds.d on smithi055 2024-03-28T05:42:13.795 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:13 smithi055 ceph-mon[31863]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:13.795 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:13 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/392416591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:13.985 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:13 smithi086 ceph-mon[35163]: Deploying daemon mds.d on smithi055 2024-03-28T05:42:13.985 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:13 smithi086 ceph-mon[35163]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:13.985 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:13 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/392416591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:13 smithi159 ceph-mon[36109]: Deploying daemon mds.d on smithi055 2024-03-28T05:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:13 smithi159 ceph-mon[36109]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:13 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/392416591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:14.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.905+0000 7f77f9200640 1 -- 172.21.15.55:0/3344530418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f41016c0 msgr2=0x7f77f4101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.905+0000 7f77f9200640 1 --2- 172.21.15.55:0/3344530418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f41016c0 0x7f77f4101ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009900 tx=0x7f77e402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 -- 172.21.15.55:0/3344530418 shutdown_connections 2024-03-28T05:42:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 --2- 172.21.15.55:0/3344530418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4103270 0x7f77f4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:14.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 --2- 172.21.15.55:0/3344530418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 0x7f77f4102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 --2- 172.21.15.55:0/3344530418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f41016c0 0x7f77f4101ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 -- 172.21.15.55:0/3344530418 >> 172.21.15.55:0/3344530418 conn(0x7f77f40fcc50 msgr2=0x7f77f40ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 -- 172.21.15.55:0/3344530418 shutdown_connections 2024-03-28T05:42:14.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.906+0000 7f77f9200640 1 -- 172.21.15.55:0/3344530418 wait complete. 2024-03-28T05:42:14.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 Processor -- start 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 -- start start 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f41016c0 0x7f77f41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 0x7f77f4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410d210 con 0x7f77f4103270 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410d090 con 0x7f77f41016c0 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f9200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410d390 con 0x7f77f41028b0 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.907+0000 7f77f2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32856/0 (socket says 172.21.15.55:32856) 2024-03-28T05:42:14.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 -- 172.21.15.55:0/84045169 learned_addr learned my addr 172.21.15.55:0/84045169 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f1e00640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f41016c0 0x7f77f41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77e9400640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 0x7f77f4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 -- 172.21.15.55:0/84045169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 msgr2=0x7f77f4197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 0x7f77f4197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 -- 172.21.15.55:0/84045169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f41016c0 msgr2=0x7f77f41978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f41016c0 0x7f77f41978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.908+0000 7f77f2800640 1 -- 172.21.15.55:0/84045169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f419f4d0 con 0x7f77f4103270 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77f2800640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00cad0 tx=0x7f77ec00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00ad60 con 0x7f77f4103270 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f419f7c0 con 0x7f77f4103270 2024-03-28T05:42:14.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f419fd10 con 0x7f77f4103270 2024-03-28T05:42:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f77ec005020 con 0x7f77f4103270 2024-03-28T05:42:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.909+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00f6b0 con 0x7f77f4103270 2024-03-28T05:42:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.911+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f41089e0 con 0x7f77f4103270 2024-03-28T05:42:14.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.912+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f77ec0051d0 con 0x7f77f4103270 2024-03-28T05:42:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.915+0000 7f77eb400640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 0x7f77d80a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.915+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f77ec0ce510 con 0x7f77f4103270 2024-03-28T05:42:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.915+0000 7f77f1e00640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 0x7f77d80a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:14.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.916+0000 7f77f1e00640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 0x7f77d80a9150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77e402c240 tx=0x7f77e4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:14.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:14.919+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f77ec014030 con 0x7f77f4103270 2024-03-28T05:42:15.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:14 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:15.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.185+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77f40622a0 con 0x7f77f4103270 2024-03-28T05:42:15.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.186+0000 7f77eb400640 1 -- 172.21.15.55:0/84045169 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f77ec09ba50 con 0x7f77f4103270 2024-03-28T05:42:15.187 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:15.187 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:15.188 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 4 2024-03-28T05:42:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 msgr2=0x7f77d80a9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 0x7f77d80a9150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77e402c240 tx=0x7f77e4000bc0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 msgr2=0x7f77f419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00cad0 tx=0x7f77ec00ced0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 shutdown_connections 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a6c90 0x7f77d80a9150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4103270 0x7f77f419ee60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f41028b0 0x7f77f4197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 --2- 172.21.15.55:0/84045169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f41016c0 0x7f77f41978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 >> 172.21.15.55:0/84045169 conn(0x7f77f40fcc50 msgr2=0x7f77f4105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 shutdown_connections 2024-03-28T05:42:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:15.190+0000 7f77f9200640 1 -- 172.21.15.55:0/84045169 wait complete. 2024-03-28T05:42:15.457 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 podman[70858]: 2024-03-28 05:42:15.073978706 +0000 UTC m=+0.042293693 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:15.457 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 podman[70858]: 2024-03-28 05:42:15.207525545 +0000 UTC m=+0.175840573 container create 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-28T05:42:15.458 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 podman[70858]: 2024-03-28 05:42:15.455885541 +0000 UTC m=+0.424200609 container init 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-28T05:42:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:15 smithi055 ceph-mon[31863]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:15 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/84045169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:15.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 podman[70858]: 2024-03-28 05:42:15.46664147 +0000 UTC m=+0.434956466 container start 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:42:15.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 ceph-mds[70879]: -- 172.21.15.55:0/1464459509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a81bcfa40 con 0x564a81ba3000 2024-03-28T05:42:15.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: starting mds.d at 2024-03-28T05:42:15.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 bash[70858]: 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe 2024-03-28T05:42:15.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:42:15 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:15 smithi086 ceph-mon[35163]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:15 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/84045169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:15 smithi159 ceph-mon[36109]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:15 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/84045169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:boot 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: fsmap 4 up:standby 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:16.953 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:16.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:16.954 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:boot 2024-03-28T05:42:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: fsmap 4 up:standby 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:17.075 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:boot 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: fsmap 4 up:standby 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:17.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:17.211 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.416+0000 7fd30ce00640 1 -- 172.21.15.55:0/2749008077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3081074e0 msgr2=0x7fd3081098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.416+0000 7fd30ce00640 1 --2- 172.21.15.55:0/2749008077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3081074e0 0x7fd3081098d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd300009ca0 tx=0x7fd30002c100 comp rx=0 tx=0).stop 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 -- 172.21.15.55:0/2749008077 shutdown_connections 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 --2- 172.21.15.55:0/2749008077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3081074e0 0x7fd3081098d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 --2- 172.21.15.55:0/2749008077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 0x7fd308106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 --2- 172.21.15.55:0/2749008077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd308102280 0x7fd308104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 -- 172.21.15.55:0/2749008077 >> 172.21.15.55:0/2749008077 conn(0x7fd3080fbbd0 msgr2=0x7fd3080fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 -- 172.21.15.55:0/2749008077 shutdown_connections 2024-03-28T05:42:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.417+0000 7fd30ce00640 1 -- 172.21.15.55:0/2749008077 wait complete. 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 Processor -- start 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 -- start start 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 0x7fd30819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3081074e0 0x7fd3081a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30810d230 con 0x7fd308102280 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30810d0b0 con 0x7fd308104bb0 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd30ce00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30810d3b0 con 0x7fd3081074e0 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd305e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd305e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32900/0 (socket says 172.21.15.55:32900) 2024-03-28T05:42:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.418+0000 7fd305e00640 1 -- 172.21.15.55:0/439593725 learned_addr learned my addr 172.21.15.55:0/439593725 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305400640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 0x7fd30819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 -- 172.21.15.55:0/439593725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3081074e0 msgr2=0x7fd3081a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3081074e0 0x7fd3081a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 -- 172.21.15.55:0/439593725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 msgr2=0x7fd30819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 0x7fd30819a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 -- 172.21.15.55:0/439593725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3081a16e0 con 0x7fd308102280 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd305e00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d770 tx=0x7fd2f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.419+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8017070 con 0x7fd308102280 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.420+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd2f80054d0 con 0x7fd308102280 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.420+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3081a19d0 con 0x7fd308102280 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.420+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004cf0 con 0x7fd308102280 2024-03-28T05:42:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.420+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3081a1f20 con 0x7fd308102280 2024-03-28T05:42:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.421+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd308108fd0 con 0x7fd308102280 2024-03-28T05:42:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.423+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd2f8004e90 con 0x7fd308102280 2024-03-28T05:42:17.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.425+0000 7fd2fea00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 0x7fd2ec0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:17.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.425+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd2f80ce0f0 con 0x7fd308102280 2024-03-28T05:42:17.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.425+0000 7fd305400640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 0x7fd2ec0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:17.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.426+0000 7fd305400640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 0x7fd2ec0a4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005fd0 tx=0x7fd2f4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:17.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.428+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd2f809b590 con 0x7fd308102280 2024-03-28T05:42:17.686 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:17 smithi055 ceph-mon[31863]: Deploying daemon mds.e on smithi086 2024-03-28T05:42:17.686 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:17 smithi055 ceph-mon[31863]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:17.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.701+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3080622d0 con 0x7fd308102280 2024-03-28T05:42:17.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.702+0000 7fd2fea00640 1 -- 172.21.15.55:0/439593725 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7fd2f809ae90 con 0x7fd308102280 2024-03-28T05:42:17.703 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:17.704 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 5 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 msgr2=0x7fd2ec0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 0x7fd2ec0a4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005fd0 tx=0x7fd2f4005850 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 msgr2=0x7fd308199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d770 tx=0x7fd2f800dc30 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 shutdown_connections 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd2ec0a2880 0x7fd2ec0a4d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3081074e0 0x7fd3081a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd308104bb0 0x7fd30819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 --2- 172.21.15.55:0/439593725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd308102280 0x7fd308199ac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 >> 172.21.15.55:0/439593725 conn(0x7fd3080fbbd0 msgr2=0x7fd308101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 shutdown_connections 2024-03-28T05:42:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:17.705+0000 7fd30ce00640 1 -- 172.21.15.55:0/439593725 wait complete. 2024-03-28T05:42:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:17 smithi086 ceph-mon[35163]: Deploying daemon mds.e on smithi086 2024-03-28T05:42:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:17 smithi086 ceph-mon[35163]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:17 smithi159 ceph-mon[36109]: Deploying daemon mds.e on smithi086 2024-03-28T05:42:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:17 smithi159 ceph-mon[36109]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:18.979 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:18 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/439593725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:18 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/439593725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:18 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/439593725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:19.318 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:18 smithi086 systemd[1]: Starting Ceph mds.e for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:19.318 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 podman[64672]: 2024-03-28 05:42:19.220743149 +0000 UTC m=+0.030965011 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:19.569 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 podman[64672]: 2024-03-28 05:42:19.346537655 +0000 UTC m=+0.156759553 container create afecc766db3992465bdccf1d62d8b7dd5c7bf65fa9b9809bbd27e3071239627f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-28T05:42:19.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.967+0000 7fd565400640 1 -- 172.21.15.55:0/106822930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 msgr2=0x7fd560109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.967+0000 7fd565400640 1 --2- 172.21.15.55:0/106822930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd560109350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd548009900 tx=0x7fd54802bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 -- 172.21.15.55:0/106822930 shutdown_connections 2024-03-28T05:42:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 --2- 172.21.15.55:0/106822930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560109890 0x7fd560110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 --2- 172.21.15.55:0/106822930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd560109350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 --2- 172.21.15.55:0/106822930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560107ce0 0x7fd560108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 -- 172.21.15.55:0/106822930 >> 172.21.15.55:0/106822930 conn(0x7fd560076cb0 msgr2=0x7fd5600790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 -- 172.21.15.55:0/106822930 shutdown_connections 2024-03-28T05:42:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.968+0000 7fd565400640 1 -- 172.21.15.55:0/106822930 wait complete. 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 Processor -- start 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 -- start start 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 0x7fd56019deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 0x7fd5601a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560113810 con 0x7fd560108ed0 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560113690 con 0x7fd560107ce0 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.969+0000 7fd565400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560113990 con 0x7fd560109890 2024-03-28T05:42:19.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43296/0 (socket says 172.21.15.55:43296) 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 -- 172.21.15.55:0/1384133423 learned_addr learned my addr 172.21.15.55:0/1384133423 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd55f200640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 0x7fd5601a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd55e800640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 0x7fd56019deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 -- 172.21.15.55:0/1384133423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 msgr2=0x7fd5601a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 0x7fd5601a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 -- 172.21.15.55:0/1384133423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 msgr2=0x7fd56019deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 0x7fd56019deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd555e00640 1 -- 172.21.15.55:0/1384133423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5601a5ad0 con 0x7fd560108ed0 2024-03-28T05:42:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd55f200640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 0x7fd5601a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.970+0000 7fd55e800640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 0x7fd56019deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.971+0000 7fd555e00640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd548036040 tx=0x7fd5480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.973+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548043020 con 0x7fd560108ed0 2024-03-28T05:42:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.973+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd5480054c0 con 0x7fd560108ed0 2024-03-28T05:42:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.973+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5601a5d60 con 0x7fd560108ed0 2024-03-28T05:42:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.973+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548003d70 con 0x7fd560108ed0 2024-03-28T05:42:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.973+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601a6270 con 0x7fd560108ed0 2024-03-28T05:42:19.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.975+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56010f080 con 0x7fd560108ed0 2024-03-28T05:42:19.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.976+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd548046020 con 0x7fd560108ed0 2024-03-28T05:42:19.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.978+0000 7fd557e00640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 0x7fd5440a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:19.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.978+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd5480f0af0 con 0x7fd560108ed0 2024-03-28T05:42:19.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.978+0000 7fd55e800640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 0x7fd5440a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.979+0000 7fd55e800640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 0x7fd5440a4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd550005c40 tx=0x7fd55000a430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:19.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:19.982+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd54804d020 con 0x7fd560108ed0 2024-03-28T05:42:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:19 smithi086 ceph-mon[35163]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 podman[64672]: 2024-03-28 05:42:19.671143618 +0000 UTC m=+0.481365523 container init afecc766db3992465bdccf1d62d8b7dd5c7bf65fa9b9809bbd27e3071239627f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 podman[64672]: 2024-03-28 05:42:19.681248668 +0000 UTC m=+0.491470600 container start afecc766db3992465bdccf1d62d8b7dd5c7bf65fa9b9809bbd27e3071239627f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 ceph-mds[64691]: -- 172.21.15.86:0/1053568099 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ced847fa40 con 0x55ced8453000 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-e[64687]: starting mds.e at 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 bash[64672]: afecc766db3992465bdccf1d62d8b7dd5c7bf65fa9b9809bbd27e3071239627f 2024-03-28T05:42:20.070 INFO:journalctl@ceph.mds.e.smithi086.stdout:Mar 28 05:42:19 smithi086 systemd[1]: Started Ceph mds.e for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:19 smithi159 ceph-mon[36109]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:19 smithi055 ceph-mon[31863]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.223+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd560062340 con 0x7fd560108ed0 2024-03-28T05:42:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.225+0000 7fd557e00640 1 -- 172.21.15.55:0/1384133423 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3698 (secure 0 0 0) 0x7fd5480a6e20 con 0x7fd560108ed0 2024-03-28T05:42:20.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:20.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-28T05:42:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 5 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 msgr2=0x7fd5440a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 0x7fd5440a4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd550005c40 tx=0x7fd55000a430 comp rx=0 tx=0).stop 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 msgr2=0x7fd56019e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd548036040 tx=0x7fd5480042f0 comp rx=0 tx=0).stop 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 shutdown_connections 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd5440a2880 0x7fd5440a4d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd560109890 0x7fd5601a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd560108ed0 0x7fd56019e3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 --2- 172.21.15.55:0/1384133423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd560107ce0 0x7fd56019deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 >> 172.21.15.55:0/1384133423 conn(0x7fd560076cb0 msgr2=0x7fd56010c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 shutdown_connections 2024-03-28T05:42:20.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:20.227+0000 7fd565400640 1 -- 172.21.15.55:0/1384133423 wait complete. 2024-03-28T05:42:21.168 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: Deploying daemon mds.f on smithi159 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1384133423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:21.169 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:boot 2024-03-28T05:42:21.170 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: fsmap 5 up:standby 2024-03-28T05:42:21.170 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-28T05:42:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: Deploying daemon mds.f on smithi159 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1384133423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:boot 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: fsmap 5 up:standby 2024-03-28T05:42:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: Deploying daemon mds.f on smithi159 2024-03-28T05:42:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1384133423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:boot 2024-03-28T05:42:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: fsmap 5 up:standby 2024-03-28T05:42:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-28T05:42:22.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 -- 172.21.15.55:0/4037587928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7194104ad0 msgr2=0x7f7194104f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 --2- 172.21.15.55:0/4037587928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7194104ad0 0x7f7194104f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7188009900 tx=0x7f718802bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 -- 172.21.15.55:0/4037587928 shutdown_connections 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 --2- 172.21.15.55:0/4037587928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7194105490 0x7f719410bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 --2- 172.21.15.55:0/4037587928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7194104ad0 0x7f7194104f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 --2- 172.21.15.55:0/4037587928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71941038e0 0x7f7194103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 -- 172.21.15.55:0/4037587928 >> 172.21.15.55:0/4037587928 conn(0x7f71940fee90 msgr2=0x7f71941012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 -- 172.21.15.55:0/4037587928 shutdown_connections 2024-03-28T05:42:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.489+0000 7f719c400640 1 -- 172.21.15.55:0/4037587928 wait complete. 2024-03-28T05:42:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.490+0000 7f719c400640 1 Processor -- start 2024-03-28T05:42:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.490+0000 7f719c400640 1 -- start start 2024-03-28T05:42:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 0x7f7194199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7194105490 0x7f719419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:22.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719410f440 con 0x7f719419f220 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719410f2c0 con 0x7f71941038e0 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719c400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719410f5c0 con 0x7f7194105490 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43310/0 (socket says 172.21.15.55:43310) 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f719a400640 1 -- 172.21.15.55:0/4065480298 learned_addr learned my addr 172.21.15.55:0/4065480298 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f7199000640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7194105490 0x7f719419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:22.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.491+0000 7f7199a00640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 0x7f7194199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 -- 172.21.15.55:0/4065480298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7194105490 msgr2=0x7f719419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7194105490 0x7f719419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 -- 172.21.15.55:0/4065480298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 msgr2=0x7f7194199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 0x7f7194199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 -- 172.21.15.55:0/4065480298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71941a1cb0 con 0x7f719419f220 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f7199a00640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 0x7f7194199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719a400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f718c00eaa0 tx=0x7f718c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00cdb0 con 0x7f719419f220 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f718c005020 con 0x7f719419f220 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.492+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71941a1fa0 con 0x7f719419f220 2024-03-28T05:42:22.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.493+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0116d0 con 0x7f719419f220 2024-03-28T05:42:22.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.493+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71941a2410 con 0x7f719419f220 2024-03-28T05:42:22.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.494+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719410acd0 con 0x7f719419f220 2024-03-28T05:42:22.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.496+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f718c0051d0 con 0x7f719419f220 2024-03-28T05:42:22.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.498+0000 7f7192000640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 0x7f717c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:22.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.498+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f718c0ce870 con 0x7f719419f220 2024-03-28T05:42:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.498+0000 7f7199a00640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 0x7f717c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:22.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.499+0000 7f7199a00640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 0x7f717c0a4cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71840058c0 tx=0x7f7184005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:22.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.503+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f718c016030 con 0x7f719419f220 2024-03-28T05:42:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.746+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f719402d070 con 0x7f719419f220 2024-03-28T05:42:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.748+0000 7f7192000640 1 -- 172.21.15.55:0/4065480298 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f718c09bd10 con 0x7f719419f220 2024-03-28T05:42:22.749 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:22.749 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-28T05:42:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.750+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 msgr2=0x7f717c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 0x7f717c0a4cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71840058c0 tx=0x7f7184005850 comp rx=0 tx=0).stop 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 msgr2=0x7f71941a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f718c00eaa0 tx=0x7f718c00ef60 comp rx=0 tx=0).stop 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 shutdown_connections 2024-03-28T05:42:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f717c0a2800 0x7f717c0a4cc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719419f220 0x7f71941a1610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7194105490 0x7f719419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 --2- 172.21.15.55:0/4065480298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71941038e0 0x7f7194199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 >> 172.21.15.55:0/4065480298 conn(0x7f71940fee90 msgr2=0x7f7194107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 shutdown_connections 2024-03-28T05:42:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:22.751+0000 7f719c400640 1 -- 172.21.15.55:0/4065480298 wait complete. 2024-03-28T05:42:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:22 smithi055 ceph-mon[31863]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:22 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4065480298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:23.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:22 smithi159 ceph-mon[36109]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:23.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4065480298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:23.271 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:22 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:22 smithi086 ceph-mon[35163]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:22 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4065480298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:23.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 podman[66349]: 2024-03-28 05:42:23.178023644 +0000 UTC m=+0.035143786 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:23.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 podman[66349]: 2024-03-28 05:42:23.30590642 +0000 UTC m=+0.163026579 container create c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-28T05:42:23.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 podman[66349]: 2024-03-28 05:42:23.559648428 +0000 UTC m=+0.416768619 container init c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-28T05:42:23.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 podman[66349]: 2024-03-28 05:42:23.572400104 +0000 UTC m=+0.429520224 container start c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-28T05:42:23.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 ceph-mds[66369]: -- 172.21.15.159:0/1879390135 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f4abc3a40 con 0x555f4ab96800 2024-03-28T05:42:23.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: starting mds.f at 2024-03-28T05:42:23.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 bash[66349]: c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c 2024-03-28T05:42:23.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:42:23 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:24.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:25.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 -- 172.21.15.55:0/1922986904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701052a0 msgr2=0x7f037010bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:25.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 --2- 172.21.15.55:0/1922986904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701052a0 0x7f037010bb30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0368009900 tx=0x7f036802bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:25.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 -- 172.21.15.55:0/1922986904 shutdown_connections 2024-03-28T05:42:25.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 --2- 172.21.15.55:0/1922986904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701052a0 0x7f037010bb30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 --2- 172.21.15.55:0/1922986904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701048e0 0x7f0370104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 --2- 172.21.15.55:0/1922986904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 0x7f0370103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 -- 172.21.15.55:0/1922986904 >> 172.21.15.55:0/1922986904 conn(0x7f03700fec80 msgr2=0x7f03701010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:25.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 -- 172.21.15.55:0/1922986904 shutdown_connections 2024-03-28T05:42:25.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.010+0000 7f0376800640 1 -- 172.21.15.55:0/1922986904 wait complete. 2024-03-28T05:42:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.011+0000 7f0376800640 1 Processor -- start 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 -- start start 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 0x7f0370199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 0x7f03701a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037010f250 con 0x7f03701048e0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037010f0d0 con 0x7f03701036f0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0376800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037010f3d0 con 0x7f03701052a0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0374a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0374a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43324/0 (socket says 172.21.15.55:43324) 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0374a00640 1 -- 172.21.15.55:0/4095108435 learned_addr learned my addr 172.21.15.55:0/4095108435 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0375e00640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 0x7f03701a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.012+0000 7f0375400640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 0x7f0370199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 -- 172.21.15.55:0/4095108435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 msgr2=0x7f03701a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:25.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 0x7f03701a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 -- 172.21.15.55:0/4095108435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 msgr2=0x7f0370199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 0x7f0370199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 -- 172.21.15.55:0/4095108435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03701a1490 con 0x7f03701048e0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0375e00640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 0x7f03701a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0374a00640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f035c00d950 tx=0x7f035c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c017030 con 0x7f03701048e0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f035c004020 con 0x7f03701048e0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c0047a0 con 0x7f03701048e0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.013+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03701a1780 con 0x7f03701048e0 2024-03-28T05:42:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.014+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03701a1c80 con 0x7f03701048e0 2024-03-28T05:42:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.015+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037010a9b0 con 0x7f03701048e0 2024-03-28T05:42:25.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.018+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f035c0041d0 con 0x7f03701048e0 2024-03-28T05:42:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.019+0000 7f036e000640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 0x7f03580a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.019+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f035c0ce0b0 con 0x7f03701048e0 2024-03-28T05:42:25.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.019+0000 7f0375400640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 0x7f03580a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:25.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.020+0000 7f0375400640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 0x7f03580a4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0370104740 tx=0x7f0364009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:25.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.024+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f035c09b550 con 0x7f03701048e0 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:25.053 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:25.054 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:25.054 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: Deploying daemon mds.c on smithi159 2024-03-28T05:42:25.054 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:boot 2024-03-28T05:42:25.054 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: fsmap 6 up:standby 2024-03-28T05:42:25.054 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: Deploying daemon mds.c on smithi159 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:boot 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: fsmap 6 up:standby 2024-03-28T05:42:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:42:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: Deploying daemon mds.c on smithi159 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:boot 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: fsmap 6 up:standby 2024-03-28T05:42:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:42:25.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.273+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037002d070 con 0x7f03701048e0 2024-03-28T05:42:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.275+0000 7f036e000640 1 -- 172.21.15.55:0/4095108435 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5277 (secure 0 0 0) 0x7f035c09ae50 con 0x7f03701048e0 2024-03-28T05:42:25.276 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:25.276 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-28T05:42:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.277+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 msgr2=0x7f03580a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.277+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 0x7f03580a4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0370104740 tx=0x7f0364009870 comp rx=0 tx=0).stop 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.277+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 msgr2=0x7f0370199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.277+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f035c00d950 tx=0x7f035c00de10 comp rx=0 tx=0).stop 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 shutdown_connections 2024-03-28T05:42:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03580a2880 0x7f03580a4d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03701052a0 0x7f03701a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03701048e0 0x7f0370199db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 --2- 172.21.15.55:0/4095108435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03701036f0 0x7f0370199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 >> 172.21.15.55:0/4095108435 conn(0x7f03700fec80 msgr2=0x7f0370107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 shutdown_connections 2024-03-28T05:42:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:25.278+0000 7f0376800640 1 -- 172.21.15.55:0/4095108435 wait complete. 2024-03-28T05:42:25.870 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:25 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4095108435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:25 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4095108435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:25 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4095108435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:26 smithi159 ceph-mon[36109]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:26 smithi055 ceph-mon[31863]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:27.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:26 smithi086 ceph-mon[35163]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:27.480 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 podman[66662]: 2024-03-28 05:42:27.192381593 +0000 UTC m=+0.148117436 container create 10e6346e732088883ebc4ca77e6d4289ca52eb4fbce8b8c2f5981307d40593f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-28T05:42:27.480 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 podman[66662]: 2024-03-28 05:42:27.479292411 +0000 UTC m=+0.435028261 container init 10e6346e732088883ebc4ca77e6d4289ca52eb4fbce8b8c2f5981307d40593f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_CLEAN=True) 2024-03-28T05:42:27.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 -- 172.21.15.55:0/2303957271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841052a0 msgr2=0x7f9c8410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:27.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/2303957271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841052a0 0x7f9c8410bb30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009ca0 tx=0x7f9c7c02c100 comp rx=0 tx=0).stop 2024-03-28T05:42:27.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 -- 172.21.15.55:0/2303957271 shutdown_connections 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/2303957271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841052a0 0x7f9c8410bb30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/2303957271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841048e0 0x7f9c84104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/2303957271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841036f0 0x7f9c84103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 -- 172.21.15.55:0/2303957271 >> 172.21.15.55:0/2303957271 conn(0x7f9c840fec80 msgr2=0x7f9c841010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 -- 172.21.15.55:0/2303957271 shutdown_connections 2024-03-28T05:42:27.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.534+0000 7f9c8ac00640 1 -- 172.21.15.55:0/2303957271 wait complete. 2024-03-28T05:42:27.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.535+0000 7f9c8ac00640 1 Processor -- start 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.535+0000 7f9c8ac00640 1 -- start start 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841048e0 0x7f9c84199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 0x7f9c841a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410f220 con 0x7f9c841036f0 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410f0a0 con 0x7f9c841052a0 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8ac00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410f3a0 con 0x7f9c841048e0 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c89800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c89800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43344/0 (socket says 172.21.15.55:43344) 2024-03-28T05:42:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c89800640 1 -- 172.21.15.55:0/1119893971 learned_addr learned my addr 172.21.15.55:0/1119893971 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c88e00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841048e0 0x7f9c84199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c8a200640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 0x7f9c841a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.536+0000 7f9c89800640 1 -- 172.21.15.55:0/1119893971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841048e0 msgr2=0x7f9c84199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c89800640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841048e0 0x7f9c84199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c89800640 1 -- 172.21.15.55:0/1119893971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 msgr2=0x7f9c841a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c89800640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 0x7f9c841a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c89800640 1 -- 172.21.15.55:0/1119893971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c841a14c0 con 0x7f9c841036f0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c8a200640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 0x7f9c841a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c89800640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800d950 tx=0x7f9c7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78017070 con 0x7f9c841036f0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9c78009c30 con 0x7f9c841036f0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800f620 con 0x7f9c841036f0 2024-03-28T05:42:27.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c841a17b0 con 0x7f9c841036f0 2024-03-28T05:42:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.537+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c841a1d00 con 0x7f9c841036f0 2024-03-28T05:42:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.538+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8410aa90 con 0x7f9c841036f0 2024-03-28T05:42:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.540+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f9c7801a070 con 0x7f9c841036f0 2024-03-28T05:42:27.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.541+0000 7f9c82000640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 0x7f9c6c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.542+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9c780cdff0 con 0x7f9c841036f0 2024-03-28T05:42:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.542+0000 7f9c88e00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 0x7f9c6c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.542+0000 7f9c88e00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 0x7f9c6c0a4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9c8419adb0 tx=0x7f9c7000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.546+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9c78009de0 con 0x7f9c841036f0 2024-03-28T05:42:27.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.798+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c8402d070 con 0x7f9c841036f0 2024-03-28T05:42:27.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.799+0000 7f9c82000640 1 -- 172.21.15.55:0/1119893971 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5277 (secure 0 0 0) 0x7f9c7809b4b0 con 0x7f9c841036f0 2024-03-28T05:42:27.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:27.801 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-28T05:42:27.801 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 7 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.801+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 msgr2=0x7f9c6c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.801+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 0x7f9c6c0a4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9c8419adb0 tx=0x7f9c7000b390 comp rx=0 tx=0).stop 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.801+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 msgr2=0x7f9c841998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.801+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800d950 tx=0x7f9c7800de10 comp rx=0 tx=0).stop 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 shutdown_connections 2024-03-28T05:42:27.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9c6c0a2880 0x7f9c6c0a4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c841052a0 0x7f9c841a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c841048e0 0x7f9c84199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 --2- 172.21.15.55:0/1119893971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c841036f0 0x7f9c841998a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 >> 172.21.15.55:0/1119893971 conn(0x7f9c840fec80 msgr2=0x7f9c84107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 shutdown_connections 2024-03-28T05:42:27.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:27.802+0000 7f9c8ac00640 1 -- 172.21.15.55:0/1119893971 wait complete. 2024-03-28T05:42:27.822 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 podman[66662]: 2024-03-28 05:42:27.490030718 +0000 UTC m=+0.445766567 container start 10e6346e732088883ebc4ca77e6d4289ca52eb4fbce8b8c2f5981307d40593f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-c, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-28T05:42:27.822 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 ceph-mds[66681]: -- 172.21.15.159:0/993962010 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574dbb85a40 con 0x5574dbb58800 2024-03-28T05:42:27.822 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-c[66677]: starting mds.c at 2024-03-28T05:42:27.822 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 bash[66662]: 10e6346e732088883ebc4ca77e6d4289ca52eb4fbce8b8c2f5981307d40593f5 2024-03-28T05:42:27.822 INFO:journalctl@ceph.mds.c.smithi159.stdout:Mar 28 05:42:27 smithi159 systemd[1]: Started Ceph mds.c for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1119893971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6836/1347717104,v1:172.21.15.159:6837/1347717104] up:boot 2024-03-28T05:42:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: fsmap 7 up:standby 2024-03-28T05:42:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1119893971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6836/1347717104,v1:172.21.15.159:6837/1347717104] up:boot 2024-03-28T05:42:29.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: fsmap 7 up:standby 2024-03-28T05:42:29.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1119893971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6836/1347717104,v1:172.21.15.159:6837/1347717104] up:boot 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: fsmap 7 up:standby 2024-03-28T05:42:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-28T05:42:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:29 smithi086 ceph-mon[35163]: Deploying daemon mds.h on smithi086 2024-03-28T05:42:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:29 smithi086 ceph-mon[35163]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:29.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.056+0000 7faef0a00640 1 -- 172.21.15.55:0/4081241905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1048e0 msgr2=0x7faeec104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.056+0000 7faef0a00640 1 --2- 172.21.15.55:0/4081241905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1048e0 0x7faeec104d60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faed4009900 tx=0x7faed402bc50 comp rx=0 tx=0).stop 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 -- 172.21.15.55:0/4081241905 shutdown_connections 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 --2- 172.21.15.55:0/4081241905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1052a0 0x7faeec10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 --2- 172.21.15.55:0/4081241905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1048e0 0x7faeec104d60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 --2- 172.21.15.55:0/4081241905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1036f0 0x7faeec103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 -- 172.21.15.55:0/4081241905 >> 172.21.15.55:0/4081241905 conn(0x7faeec0fec80 msgr2=0x7faeec1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 -- 172.21.15.55:0/4081241905 shutdown_connections 2024-03-28T05:42:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.057+0000 7faef0a00640 1 -- 172.21.15.55:0/4081241905 wait complete. 2024-03-28T05:42:30.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.058+0000 7faef0a00640 1 Processor -- start 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.058+0000 7faef0a00640 1 -- start start 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 0x7faeec199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 0x7faeec1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec10f2d0 con 0x7faeec1036f0 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec10f150 con 0x7faeec1048e0 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faef0a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec10f450 con 0x7faeec1052a0 2024-03-28T05:42:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faeeb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faeeb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60182/0 (socket says 172.21.15.55:60182) 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faeeb400640 1 -- 172.21.15.55:0/2302500927 learned_addr learned my addr 172.21.15.55:0/2302500927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faeebe00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 0x7faeec1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.059+0000 7faeeaa00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 0x7faeec199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 -- 172.21.15.55:0/2302500927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 msgr2=0x7faeec1a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 0x7faeec1a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 -- 172.21.15.55:0/2302500927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 msgr2=0x7faeec199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 0x7faeec199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 -- 172.21.15.55:0/2302500927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec1a1500 con 0x7faeec1036f0 2024-03-28T05:42:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeebe00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 0x7faeec1a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeaa00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 0x7faeec199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faeeb400640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faedc00ccb0 tx=0x7faedc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc003b70 con 0x7faeec1036f0 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7faedc00ae50 con 0x7faeec1036f0 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec1a17f0 con 0x7faeec1036f0 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00f6f0 con 0x7faeec1036f0 2024-03-28T05:42:30.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.060+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec1a1dc0 con 0x7faeec1036f0 2024-03-28T05:42:30.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.062+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec10aa10 con 0x7faeec1036f0 2024-03-28T05:42:30.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.064+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7faedc004000 con 0x7faeec1036f0 2024-03-28T05:42:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.066+0000 7faee3e00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 0x7faed00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.066+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faedc0ce900 con 0x7faeec1036f0 2024-03-28T05:42:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.066+0000 7faeeaa00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 0x7faed00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.067+0000 7faeeaa00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 0x7faed00a4cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faed4036040 tx=0x7faed4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:29 smithi159 ceph-mon[36109]: Deploying daemon mds.h on smithi086 2024-03-28T05:42:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:29 smithi159 ceph-mon[36109]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.071+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7faedc014070 con 0x7faeec1036f0 2024-03-28T05:42:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:29 smithi055 ceph-mon[31863]: Deploying daemon mds.h on smithi086 2024-03-28T05:42:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:29 smithi055 ceph-mon[31863]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.312+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faeec02d070 con 0x7faeec1036f0 2024-03-28T05:42:30.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.313+0000 7faee3e00640 1 -- 172.21.15.55:0/2302500927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6071 (secure 0 0 0) 0x7faedc09bda0 con 0x7faeec1036f0 2024-03-28T05:42:30.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:30.315 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-28T05:42:30.315 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.315+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 msgr2=0x7faed00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 0x7faed00a4cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faed4036040 tx=0x7faed4005fd0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 msgr2=0x7faeec1998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faedc00ccb0 tx=0x7faedc00a620 comp rx=0 tx=0).stop 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 shutdown_connections 2024-03-28T05:42:30.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7faed00a2800 0x7faed00a4cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeec1052a0 0x7faeec1a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeec1048e0 0x7faeec199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 --2- 172.21.15.55:0/2302500927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec1036f0 0x7faeec1998e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 >> 172.21.15.55:0/2302500927 conn(0x7faeec0fec80 msgr2=0x7faeec107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 shutdown_connections 2024-03-28T05:42:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:30.316+0000 7faef0a00640 1 -- 172.21.15.55:0/2302500927 wait complete. 2024-03-28T05:42:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:30 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2302500927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:31.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:30 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:30 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2302500927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:30 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2302500927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:31.462 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 podman[64978]: 2024-03-28 05:42:31.076405266 +0000 UTC m=+0.032228861 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:31.463 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 podman[64978]: 2024-03-28 05:42:31.180543447 +0000 UTC m=+0.136367079 container create 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-28T05:42:31.463 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 podman[64978]: 2024-03-28 05:42:31.461317918 +0000 UTC m=+0.417141557 container init 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-28T05:42:31.736 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 podman[64978]: 2024-03-28 05:42:31.470897143 +0000 UTC m=+0.426720744 container start 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux ) 2024-03-28T05:42:31.736 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 ceph-mds[64997]: -- 172.21.15.86:0/3261092586 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d5bb3afa40 con 0x55d5bb383000 2024-03-28T05:42:31.736 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: starting mds.h at 2024-03-28T05:42:31.736 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 bash[64978]: 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 2024-03-28T05:42:31.736 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:42:31 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:31.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:31 smithi159 ceph-mon[36109]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:31.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:31 smithi086 ceph-mon[35163]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:31 smithi055 ceph-mon[31863]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:32.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.571+0000 7f82bb600640 1 -- 172.21.15.55:0/1977990039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b4103270 msgr2=0x7f82b4109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.571+0000 7f82bb600640 1 --2- 172.21.15.55:0/1977990039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b4103270 0x7f82b4109b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009ca0 tx=0x7f82ac02c100 comp rx=0 tx=0).stop 2024-03-28T05:42:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 -- 172.21.15.55:0/1977990039 shutdown_connections 2024-03-28T05:42:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 --2- 172.21.15.55:0/1977990039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b4103270 0x7f82b4109b00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 --2- 172.21.15.55:0/1977990039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41028b0 0x7f82b4102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 --2- 172.21.15.55:0/1977990039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b41016c0 0x7f82b4101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 -- 172.21.15.55:0/1977990039 >> 172.21.15.55:0/1977990039 conn(0x7f82b40fcc50 msgr2=0x7f82b40ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 -- 172.21.15.55:0/1977990039 shutdown_connections 2024-03-28T05:42:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.572+0000 7f82bb600640 1 -- 172.21.15.55:0/1977990039 wait complete. 2024-03-28T05:42:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.573+0000 7f82bb600640 1 Processor -- start 2024-03-28T05:42:32.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.573+0000 7f82bb600640 1 -- start start 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41016c0 0x7f82b4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b41028b0 0x7f82b419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b410d1f0 con 0x7f82b4103270 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b410d070 con 0x7f82b41016c0 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82bb600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b410d370 con 0x7f82b41028b0 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60202/0 (socket says 172.21.15.55:60202) 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 -- 172.21.15.55:0/3018294270 learned_addr learned my addr 172.21.15.55:0/3018294270 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:32.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b3e00640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b41028b0 0x7f82b419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b8c00640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41016c0 0x7f82b4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 -- 172.21.15.55:0/3018294270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b41028b0 msgr2=0x7f82b419a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b41028b0 0x7f82b419a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 -- 172.21.15.55:0/3018294270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41016c0 msgr2=0x7f82b4199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41016c0 0x7f82b4199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.574+0000 7f82b9600640 1 -- 172.21.15.55:0/3018294270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b41a1700 con 0x7f82b4103270 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82b9600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82ac032520 tx=0x7f82ac035ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac039040 con 0x7f82b4103270 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f82ac044070 con 0x7f82b4103270 2024-03-28T05:42:32.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b41a1990 con 0x7f82b4103270 2024-03-28T05:42:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac004330 con 0x7f82b4103270 2024-03-28T05:42:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.575+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b41a1ed0 con 0x7f82b4103270 2024-03-28T05:42:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.576+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b41a21c0 con 0x7f82b4103270 2024-03-28T05:42:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.579+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f82ac0044d0 con 0x7f82b4103270 2024-03-28T05:42:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.580+0000 7f82b1600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 0x7f829c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.580+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f82ac0f11e0 con 0x7f82b4103270 2024-03-28T05:42:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.580+0000 7f82b8c00640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 0x7f829c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.581+0000 7f82b8c00640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 0x7f829c0a4d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82a80095f0 tx=0x7f82a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.583+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f82ac0be680 con 0x7f82b4103270 2024-03-28T05:42:32.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.830+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82b41a2390 con 0x7f82b4103270 2024-03-28T05:42:32.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.831+0000 7f82b1600640 1 -- 172.21.15.55:0/3018294270 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6862 (secure 0 0 0) 0x7f82ac0bdf80 con 0x7f82b4103270 2024-03-28T05:42:32.832 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:32.832 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:32.832 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.834+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 msgr2=0x7f829c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.834+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 0x7f829c0a4d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82a80095f0 tx=0x7f82a8005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.834+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 msgr2=0x7f82b41a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.834+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82ac032520 tx=0x7f82ac035ce0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 shutdown_connections 2024-03-28T05:42:32.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f829c0a2880 0x7f829c0a4d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4103270 0x7f82b41a1090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82b41028b0 0x7f82b419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 --2- 172.21.15.55:0/3018294270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82b41016c0 0x7f82b4199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 >> 172.21.15.55:0/3018294270 conn(0x7f82b40fcc50 msgr2=0x7f82b40738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 shutdown_connections 2024-03-28T05:42:32.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:32.835+0000 7f82bb600640 1 -- 172.21.15.55:0/3018294270 wait complete. 2024-03-28T05:42:33.016 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.016 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:boot 2024-03-28T05:42:33.016 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: fsmap 8 up:standby 2024-03-28T05:42:33.016 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: Deploying daemon mds.i on smithi159 2024-03-28T05:42:33.017 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:32 smithi159 ceph-mon[36109]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:boot 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: fsmap 8 up:standby 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: Deploying daemon mds.i on smithi159 2024-03-28T05:42:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:32 smithi086 ceph-mon[35163]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:boot 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: fsmap 8 up:standby 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: Deploying daemon mds.i on smithi159 2024-03-28T05:42:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:32 smithi055 ceph-mon[31863]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:33 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3018294270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:33 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3018294270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:33 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3018294270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:34.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:34 smithi086 ceph-mon[35163]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:34 smithi159 ceph-mon[36109]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 -- 172.21.15.55:0/4166427289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f4101f70 msgr2=0x7fc5f4104360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/4166427289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f4101f70 0x7fc5f4104360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009900 tx=0x7fc5e402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 -- 172.21.15.55:0/4166427289 shutdown_connections 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/4166427289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f41071d0 0x7fc5f4109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/4166427289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41048a0 0x7fc5f4106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/4166427289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f4101f70 0x7fc5f4104360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 -- 172.21.15.55:0/4166427289 >> 172.21.15.55:0/4166427289 conn(0x7fc5f40fb980 msgr2=0x7fc5f40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 -- 172.21.15.55:0/4166427289 shutdown_connections 2024-03-28T05:42:35.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.086+0000 7fc5f3e00640 1 -- 172.21.15.55:0/4166427289 wait complete. 2024-03-28T05:42:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.087+0000 7fc5f3e00640 1 Processor -- start 2024-03-28T05:42:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 -- start start 2024-03-28T05:42:35.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f4101f70 0x7fc5f41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41071d0 0x7fc5f419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f410d0e0 con 0x7fc5f41048a0 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f410cf60 con 0x7fc5f41071d0 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f410d260 con 0x7fc5f4101f70 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60214/0 (socket says 172.21.15.55:60214) 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f2000640 1 -- 172.21.15.55:0/1804332627 learned_addr learned my addr 172.21.15.55:0/1804332627 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f2a00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f4101f70 0x7fc5f41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.088+0000 7fc5f3400640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41071d0 0x7fc5f419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 -- 172.21.15.55:0/1804332627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f4101f70 msgr2=0x7fc5f41977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f4101f70 0x7fc5f41977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 -- 172.21.15.55:0/1804332627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41071d0 msgr2=0x7fc5f419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41071d0 0x7fc5f419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 -- 172.21.15.55:0/1804332627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f419f370 con 0x7fc5f41048a0 2024-03-28T05:42:35.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f2000640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d770 tx=0x7fc5e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0017070 con 0x7fc5f41048a0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.089+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f419f660 con 0x7fc5f41048a0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.090+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc5e0009c30 con 0x7fc5f41048a0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.090+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000f620 con 0x7fc5f41048a0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.090+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f419fc30 con 0x7fc5f41048a0 2024-03-28T05:42:35.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.091+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f40fd470 con 0x7fc5f41048a0 2024-03-28T05:42:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.094+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc5e001a070 con 0x7fc5f41048a0 2024-03-28T05:42:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.095+0000 7fc5f8a00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 0x7fc5d80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.095+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc5e00ce160 con 0x7fc5f41048a0 2024-03-28T05:42:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.095+0000 7fc5f2a00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 0x7fc5d80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.096+0000 7fc5f2a00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 0x7fc5d80a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5e402c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.100+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc5e0009de0 con 0x7fc5f41048a0 2024-03-28T05:42:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:34 smithi055 ceph-mon[31863]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:35.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.344+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5f40622a0 con 0x7fc5f41048a0 2024-03-28T05:42:35.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.345+0000 7fc5f8a00640 1 -- 172.21.15.55:0/1804332627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6862 (secure 0 0 0) 0x7fc5e009b600 con 0x7fc5f41048a0 2024-03-28T05:42:35.346 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:35.346 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:35.346 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 9 2024-03-28T05:42:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 msgr2=0x7fc5d80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 0x7fc5d80a4cc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5e402c7e0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 msgr2=0x7fc5f4197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d770 tx=0x7fc5e000dc30 comp rx=0 tx=0).stop 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 shutdown_connections 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc5d80a2800 0x7fc5d80a4cc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5f41071d0 0x7fc5f419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f41048a0 0x7fc5f4197d30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 --2- 172.21.15.55:0/1804332627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5f4101f70 0x7fc5f41977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.348+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 >> 172.21.15.55:0/1804332627 conn(0x7fc5f40fb980 msgr2=0x7fc5f41028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.349+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 shutdown_connections 2024-03-28T05:42:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:35.349+0000 7fc5f3e00640 1 -- 172.21.15.55:0/1804332627 wait complete. 2024-03-28T05:42:35.407 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:42:35 smithi159 podman[66962]: 2024-03-28 05:42:35.358656448 +0000 UTC m=+0.368569193 container start cc3bbb7fc4dece217674af95588f490ad1bfc1cd567ebc8e5879f2ab482c92c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-28T05:42:35.788 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mds[66982]: -- 172.21.15.159:0/2975329214 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564605405a40 con 0x5646053d8c00 2024-03-28T05:42:35.788 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: starting mds.i at 2024-03-28T05:42:35.788 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:42:35 smithi159 bash[66962]: cc3bbb7fc4dece217674af95588f490ad1bfc1cd567ebc8e5879f2ab482c92c2 2024-03-28T05:42:35.788 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:42:35 smithi159 systemd[1]: Started Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1804332627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:35 smithi086 ceph-mon[35163]: Deploying daemon mds.g on smithi055 2024-03-28T05:42:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1804332627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:35 smithi159 ceph-mon[36109]: Deploying daemon mds.g on smithi055 2024-03-28T05:42:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1804332627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:35 smithi055 ceph-mon[31863]: Deploying daemon mds.g on smithi055 2024-03-28T05:42:37.014 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:36 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:boot 2024-03-28T05:42:37.015 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:36 smithi055 ceph-mon[31863]: fsmap 9 up:standby 2024-03-28T05:42:37.015 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:42:37.015 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:36 smithi055 ceph-mon[31863]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:36 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:boot 2024-03-28T05:42:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:36 smithi086 ceph-mon[35163]: fsmap 9 up:standby 2024-03-28T05:42:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:42:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:36 smithi086 ceph-mon[35163]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:36 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:boot 2024-03-28T05:42:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:36 smithi159 ceph-mon[36109]: fsmap 9 up:standby 2024-03-28T05:42:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:42:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:36 smithi159 ceph-mon[36109]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:37.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:37.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 -- 172.21.15.55:0/319074630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1052a0 msgr2=0x7fa2ec10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 --2- 172.21.15.55:0/319074630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec10bb30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009ca0 tx=0x7fa2e802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 -- 172.21.15.55:0/319074630 shutdown_connections 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 --2- 172.21.15.55:0/319074630 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec10bb30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 --2- 172.21.15.55:0/319074630 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 --2- 172.21.15.55:0/319074630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 0x7fa2ec103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 -- 172.21.15.55:0/319074630 >> 172.21.15.55:0/319074630 conn(0x7fa2ec0fec80 msgr2=0x7fa2ec1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 -- 172.21.15.55:0/319074630 shutdown_connections 2024-03-28T05:42:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.604+0000 7fa2f3200640 1 -- 172.21.15.55:0/319074630 wait complete. 2024-03-28T05:42:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.605+0000 7fa2f3200640 1 Processor -- start 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.605+0000 7fa2f3200640 1 -- start start 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 0x7fa2ec199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec10f220 con 0x7fa2ec1048e0 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec10f0a0 con 0x7fa2ec1036f0 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f3200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec10f3a0 con 0x7fa2ec1052a0 2024-03-28T05:42:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60220/0 (socket says 172.21.15.55:60220) 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 -- 172.21.15.55:0/2205329359 learned_addr learned my addr 172.21.15.55:0/2205329359 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1e00640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 0x7fa2ec199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f2800640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 -- 172.21.15.55:0/2205329359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 msgr2=0x7fa2ec1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 -- 172.21.15.55:0/2205329359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 msgr2=0x7fa2ec199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:37.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.606+0000 7fa2f1400640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 0x7fa2ec199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2f1400640 1 -- 172.21.15.55:0/2205329359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec1a1490 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2f2800640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2f1400640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d770 tx=0x7fa2dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc017070 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa2dc0054d0 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec1a1780 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc004cf0 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.607+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec1a1c80 con 0x7fa2ec1048e0 2024-03-28T05:42:37.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.609+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec10aa90 con 0x7fa2ec1048e0 2024-03-28T05:42:37.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.612+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa2dc004e90 con 0x7fa2ec1048e0 2024-03-28T05:42:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.613+0000 7fa2e6a00640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 0x7fa2d40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.613+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa2dc0ce170 con 0x7fa2ec1048e0 2024-03-28T05:42:37.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.613+0000 7fa2f1e00640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 0x7fa2d40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:37.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.614+0000 7fa2f1e00640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 0x7fa2d40a4cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0005fd0 tx=0x7fa2e0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:37.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.617+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa2dc09b610 con 0x7fa2ec1048e0 2024-03-28T05:42:37.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.869+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2ec02d070 con 0x7fa2ec1048e0 2024-03-28T05:42:37.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.871+0000 7fa2e6a00640 1 -- 172.21.15.55:0/2205329359 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7fa2dc09af10 con 0x7fa2ec1048e0 2024-03-28T05:42:37.872 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:37.872 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:37.873 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 10 2024-03-28T05:42:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.874+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 msgr2=0x7fa2d40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.874+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 0x7fa2d40a4cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0005fd0 tx=0x7fa2e0005850 comp rx=0 tx=0).stop 2024-03-28T05:42:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.874+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 msgr2=0x7fa2ec199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.874+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d770 tx=0x7fa2dc00dc30 comp rx=0 tx=0).stop 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 shutdown_connections 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa2d40a2800 0x7fa2d40a4cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2ec1052a0 0x7fa2ec1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2ec1048e0 0x7fa2ec199db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 --2- 172.21.15.55:0/2205329359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2ec1036f0 0x7fa2ec199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 >> 172.21.15.55:0/2205329359 conn(0x7fa2ec0fec80 msgr2=0x7fa2ec107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 shutdown_connections 2024-03-28T05:42:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:37.875+0000 7fa2f3200640 1 -- 172.21.15.55:0/2205329359 wait complete. 2024-03-28T05:42:38.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:38 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:38 smithi055 ceph-mon[31863]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:38 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2205329359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:39.124 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:38 smithi055 podman[71542]: 2024-03-28 05:42:38.88782079 +0000 UTC m=+0.036132860 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:39.124 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:38 smithi055 podman[71542]: 2024-03-28 05:42:38.988638551 +0000 UTC m=+0.136950654 container create 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:42:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:38 smithi086 ceph-mon[35163]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:38 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2205329359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:38 smithi159 ceph-mon[36109]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:38 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2205329359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:39.408 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 podman[71542]: 2024-03-28 05:42:39.252431776 +0000 UTC m=+0.400743921 container init 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-28T05:42:39.409 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 podman[71542]: 2024-03-28 05:42:39.26284437 +0000 UTC m=+0.411156484 container start 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:42:39.409 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 ceph-mds[71561]: -- 172.21.15.55:0/1716759514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643c1665a40 con 0x5643c1639000 2024-03-28T05:42:39.409 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: starting mds.g at 2024-03-28T05:42:39.851 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 bash[71542]: 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 2024-03-28T05:42:39.851 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:42:39 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:39.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:40.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.098+0000 7fd397800640 1 -- 172.21.15.55:0/836280115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd390104a90 msgr2=0x7fd390106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:40.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.098+0000 7fd397800640 1 --2- 172.21.15.55:0/836280115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd390104a90 0x7fd390106e80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009900 tx=0x7fd37c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:40.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 -- 172.21.15.55:0/836280115 shutdown_connections 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 --2- 172.21.15.55:0/836280115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3901073c0 0x7fd390109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 --2- 172.21.15.55:0/836280115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd390104a90 0x7fd390106e80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 --2- 172.21.15.55:0/836280115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 0x7fd390104550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 -- 172.21.15.55:0/836280115 >> 172.21.15.55:0/836280115 conn(0x7fd3900fbb50 msgr2=0x7fd3900fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 -- 172.21.15.55:0/836280115 shutdown_connections 2024-03-28T05:42:40.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.099+0000 7fd397800640 1 -- 172.21.15.55:0/836280115 wait complete. 2024-03-28T05:42:40.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 Processor -- start 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 -- start start 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 0x7fd390199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd390104a90 0x7fd39019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39010d250 con 0x7fd3901073c0 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39010d0d0 con 0x7fd390104a90 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.100+0000 7fd397800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39010d3d0 con 0x7fd390102160 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47544/0 (socket says 172.21.15.55:47544) 2024-03-28T05:42:40.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 -- 172.21.15.55:0/2638535411 learned_addr learned my addr 172.21.15.55:0/2638535411 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd38fe00640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd390104a90 0x7fd39019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd394e00640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 0x7fd390199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 -- 172.21.15.55:0/2638535411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 msgr2=0x7fd390199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 0x7fd390199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 -- 172.21.15.55:0/2638535411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd390104a90 msgr2=0x7fd39019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd390104a90 0x7fd39019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.101+0000 7fd395800640 1 -- 172.21.15.55:0/2638535411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3901a1790 con 0x7fd3901073c0 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.102+0000 7fd395800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd38800cad0 tx=0x7fd38800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.102+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800ae20 con 0x7fd3901073c0 2024-03-28T05:42:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.102+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd388005020 con 0x7fd3901073c0 2024-03-28T05:42:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.102+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3901a1a80 con 0x7fd3901073c0 2024-03-28T05:42:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.102+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800f6b0 con 0x7fd3901073c0 2024-03-28T05:42:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.103+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3901a1fa0 con 0x7fd3901073c0 2024-03-28T05:42:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.104+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd390108f10 con 0x7fd3901073c0 2024-03-28T05:42:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.106+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd3880051d0 con 0x7fd3901073c0 2024-03-28T05:42:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.108+0000 7fd38d600640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 0x7fd3780a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.108+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd3880ce5b0 con 0x7fd3901073c0 2024-03-28T05:42:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.109+0000 7fd394e00640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 0x7fd3780a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.109+0000 7fd394e00640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 0x7fd3780a4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3840058c0 tx=0x7fd38400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:40.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.113+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd388014030 con 0x7fd3901073c0 2024-03-28T05:42:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.432+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3900622a0 con 0x7fd3901073c0 2024-03-28T05:42:40.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.433+0000 7fd38d600640 1 -- 172.21.15.55:0/2638535411 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8444 (secure 0 0 0) 0x7fd38809b400 con 0x7fd3901073c0 2024-03-28T05:42:40.433 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:40.434 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:40.434 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 11 2024-03-28T05:42:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 msgr2=0x7fd3780a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 0x7fd3780a4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3840058c0 tx=0x7fd38400a2d0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 msgr2=0x7fd3901a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd38800cad0 tx=0x7fd38800cf90 comp rx=0 tx=0).stop 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 shutdown_connections 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3780a2880 0x7fd3780a4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3901073c0 0x7fd3901a1120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd390104a90 0x7fd39019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 --2- 172.21.15.55:0/2638535411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd390102160 0x7fd390199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 >> 172.21.15.55:0/2638535411 conn(0x7fd3900fbb50 msgr2=0x7fd3901018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 shutdown_connections 2024-03-28T05:42:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:40.436+0000 7fd397800640 1 -- 172.21.15.55:0/2638535411 wait complete. 2024-03-28T05:42:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: Deploying daemon mds.a on smithi055 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:boot 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: fsmap 10 up:standby 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:42:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:40 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2638535411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: Deploying daemon mds.a on smithi055 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:boot 2024-03-28T05:42:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: fsmap 10 up:standby 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:40 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2638535411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: Deploying daemon mds.a on smithi055 2024-03-28T05:42:40.823 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:boot 2024-03-28T05:42:40.824 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: fsmap 10 up:standby 2024-03-28T05:42:40.824 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:42:40.824 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:40 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2638535411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:41.851 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:41 smithi055 ceph-mon[31863]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:42.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:41 smithi159 ceph-mon[36109]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:41 smithi086 ceph-mon[35163]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:42.455 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 -- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0109890 msgr2=0x7f2aa0110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0109890 0x7f2aa0110120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009ca0 tx=0x7f2a9802c100 comp rx=0 tx=0).stop 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 -- 172.21.15.55:0/857284445 shutdown_connections 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0109890 0x7f2aa0110120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0108ed0 0x7f2aa0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/857284445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 0x7f2aa0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.782+0000 7f2aa5c00640 1 -- 172.21.15.55:0/857284445 >> 172.21.15.55:0/857284445 conn(0x7f2aa0076cb0 msgr2=0x7f2aa00790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.783+0000 7f2aa5c00640 1 -- 172.21.15.55:0/857284445 shutdown_connections 2024-03-28T05:42:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.783+0000 7f2aa5c00640 1 -- 172.21.15.55:0/857284445 wait complete. 2024-03-28T05:42:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 Processor -- start 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 -- start start 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 0x7f2aa019dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 0x7f2aa01a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa01137f0 con 0x7f2aa0108ed0 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0113670 con 0x7f2aa0107ce0 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2aa5c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0113970 con 0x7f2aa0109890 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2a9e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2a9e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47558/0 (socket says 172.21.15.55:47558) 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.784+0000 7f2a9e000640 1 -- 172.21.15.55:0/3695737801 learned_addr learned my addr 172.21.15.55:0/3695737801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9ea00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 0x7f2aa019dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9f400640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 0x7f2aa01a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 msgr2=0x7f2aa01a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 0x7f2aa01a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 msgr2=0x7f2aa019dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 0x7f2aa019dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa01a5990 con 0x7f2aa0108ed0 2024-03-28T05:42:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9f400640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 0x7f2aa01a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.785+0000 7f2a9e000640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c920 tx=0x7f2a8c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.786+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c007c70 con 0x7f2aa0108ed0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.786+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2a8c007e10 con 0x7f2aa0108ed0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.786+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa01a5c80 con 0x7f2aa0108ed0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.786+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c018820 con 0x7f2aa0108ed0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.786+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa01a61d0 con 0x7f2aa0108ed0 2024-03-28T05:42:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.787+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa010ef30 con 0x7f2aa0108ed0 2024-03-28T05:42:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.790+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f2a8c0189c0 con 0x7f2aa0108ed0 2024-03-28T05:42:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.792+0000 7f2a97400640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 0x7f2a840a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.792+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2a8c0cea40 con 0x7f2aa0108ed0 2024-03-28T05:42:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.792+0000 7f2a9ea00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 0x7f2a840a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.793+0000 7f2a9ea00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 0x7f2a840a4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0108d30 tx=0x7f2a90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:42.795+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2a8c014030 con 0x7f2aa0108ed0 2024-03-28T05:42:43.034 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:42 smithi055 systemd[1]: Starting Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:43.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.048+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa002d070 con 0x7f2aa0108ed0 2024-03-28T05:42:43.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.049+0000 7f2a97400640 1 -- 172.21.15.55:0/3695737801 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8444 (secure 0 0 0) 0x7f2a8c09bf70 con 0x7f2aa0108ed0 2024-03-28T05:42:43.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:43.050 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:43.050 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 11 2024-03-28T05:42:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 msgr2=0x7f2a840a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 0x7f2a840a4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0108d30 tx=0x7f2a90005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 msgr2=0x7f2aa019e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c920 tx=0x7f2a8c00cde0 comp rx=0 tx=0).stop 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 shutdown_connections 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2a840a2800 0x7f2a840a4cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2aa0109890 0x7f2aa01a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2aa0108ed0 0x7f2aa019e2b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 --2- 172.21.15.55:0/3695737801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aa0107ce0 0x7f2aa019dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.052+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 >> 172.21.15.55:0/3695737801 conn(0x7f2aa0076cb0 msgr2=0x7f2aa010c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.053+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 shutdown_connections 2024-03-28T05:42:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:43.053+0000 7f2aa5c00640 1 -- 172.21.15.55:0/3695737801 wait complete. 2024-03-28T05:42:43.292 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 podman[71936]: 2024-03-28 05:42:42.94248688 +0000 UTC m=+0.037157390 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:43.292 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 podman[71936]: 2024-03-28 05:42:43.043088017 +0000 UTC m=+0.137758532 container create 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:42:43.293 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 podman[71936]: 2024-03-28 05:42:43.281121786 +0000 UTC m=+0.375792320 container init 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-28T05:42:43.293 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 podman[71936]: 2024-03-28 05:42:43.291807451 +0000 UTC m=+0.386478016 container start 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-28T05:42:43.588 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mds[71957]: -- 172.21.15.55:0/346674094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a23bdf1a40 con 0x55a23bdc4800 2024-03-28T05:42:43.588 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: starting mds.a at 2024-03-28T05:42:43.589 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 bash[71936]: 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc 2024-03-28T05:42:43.589 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:42:43 smithi055 systemd[1]: Started Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3695737801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:43.872 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3695737801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3695737801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-28T05:42:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:44 smithi086 ceph-mon[35163]: Deploying daemon mds.b on smithi086 2024-03-28T05:42:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:44 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:boot 2024-03-28T05:42:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:44 smithi086 ceph-mon[35163]: fsmap 11 up:standby 2024-03-28T05:42:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:42:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:44 smithi055 ceph-mon[31863]: Deploying daemon mds.b on smithi086 2024-03-28T05:42:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:44 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:boot 2024-03-28T05:42:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:44 smithi055 ceph-mon[31863]: fsmap 11 up:standby 2024-03-28T05:42:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:42:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:44 smithi159 ceph-mon[36109]: Deploying daemon mds.b on smithi086 2024-03-28T05:42:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:44 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:boot 2024-03-28T05:42:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:44 smithi159 ceph-mon[36109]: fsmap 11 up:standby 2024-03-28T05:42:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:42:45.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.305+0000 7f0f0b200640 1 -- 172.21.15.55:0/195156513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041028b0 msgr2=0x7f0f04102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.305+0000 7f0f0b200640 1 --2- 172.21.15.55:0/195156513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041028b0 0x7f0f04102d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009900 tx=0x7f0eec02bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 -- 172.21.15.55:0/195156513 shutdown_connections 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 --2- 172.21.15.55:0/195156513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f04103270 0x7f0f04109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 --2- 172.21.15.55:0/195156513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041028b0 0x7f0f04102d30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 --2- 172.21.15.55:0/195156513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f041016c0 0x7f0f04101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 -- 172.21.15.55:0/195156513 >> 172.21.15.55:0/195156513 conn(0x7f0f040fcc50 msgr2=0x7f0f040ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 -- 172.21.15.55:0/195156513 shutdown_connections 2024-03-28T05:42:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.306+0000 7f0f0b200640 1 -- 172.21.15.55:0/195156513 wait complete. 2024-03-28T05:42:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 Processor -- start 2024-03-28T05:42:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 -- start start 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f041028b0 0x7f0f04197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f04103270 0x7f0f0419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0410d220 con 0x7f0f041016c0 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0410d0a0 con 0x7f0f04103270 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f0b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0410d3a0 con 0x7f0f041028b0 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.307+0000 7f0f03e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47600/0 (socket says 172.21.15.55:47600) 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 -- 172.21.15.55:0/275347926 learned_addr learned my addr 172.21.15.55:0/275347926 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f09200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f04103270 0x7f0f0419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03400640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f041028b0 0x7f0f04197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 -- 172.21.15.55:0/275347926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f041028b0 msgr2=0x7f0f04197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f041028b0 0x7f0f04197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 -- 172.21.15.55:0/275347926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f04103270 msgr2=0x7f0f0419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f04103270 0x7f0f0419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 -- 172.21.15.55:0/275347926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0419f540 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f03e00640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400d770 tx=0x7f0ef400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4017070 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0ef4009c30 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.308+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4003d00 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.309+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0419f830 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.309+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0419fdd0 con 0x7f0f041016c0 2024-03-28T05:42:45.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.310+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f04108a60 con 0x7f0f041016c0 2024-03-28T05:42:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.312+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f0ef4003ea0 con 0x7f0f041016c0 2024-03-28T05:42:45.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.313+0000 7f0f00c00640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 0x7f0ee80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:45.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.313+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0ef40ce3e0 con 0x7f0f041016c0 2024-03-28T05:42:45.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.313+0000 7f0f03400640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 0x7f0ee80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:45.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.314+0000 7f0f03400640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 0x7f0ee80a4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0096c0 tx=0x7f0eec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:45.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.318+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f0ef409b880 con 0x7f0f041016c0 2024-03-28T05:42:45.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.569+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f0402d070 con 0x7f0f041016c0 2024-03-28T05:42:45.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.570+0000 7f0f00c00640 1 -- 172.21.15.55:0/275347926 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9236 (secure 0 0 0) 0x7f0ef4009de0 con 0x7f0f041016c0 2024-03-28T05:42:45.572 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:45.572 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2024-03-28T05:42:45.572 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 12 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 msgr2=0x7f0ee80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 0x7f0ee80a4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0096c0 tx=0x7f0eec005fd0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 msgr2=0x7f0f04197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400d770 tx=0x7f0ef400dc30 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 shutdown_connections 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0ee80a2880 0x7f0ee80a4d40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f04103270 0x7f0f0419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f041028b0 0x7f0f04197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 --2- 172.21.15.55:0/275347926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f041016c0 0x7f0f04197920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.573+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 >> 172.21.15.55:0/275347926 conn(0x7f0f040fcc50 msgr2=0x7f0f04105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.574+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 shutdown_connections 2024-03-28T05:42:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:45.574+0000 7f0f0b200640 1 -- 172.21.15.55:0/275347926 wait complete. 2024-03-28T05:42:45.612 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:45 smithi086 ceph-mon[35163]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:45.613 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:45 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/275347926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:45 smithi055 ceph-mon[31863]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:45 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/275347926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:45 smithi159 ceph-mon[36109]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:45 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/275347926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:47.028 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:46 smithi086 systemd[1]: Starting Ceph mds.b for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:42:47.288 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 podman[65294]: 2024-03-28 05:42:46.931323679 +0000 UTC m=+0.030417327 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:42:47.288 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 podman[65294]: 2024-03-28 05:42:47.033536897 +0000 UTC m=+0.132630584 container create 9bf966e88f6ccff940abc3902e5afda979f174527253c27672ff4cd54efe1929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=) 2024-03-28T05:42:47.288 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 podman[65294]: 2024-03-28 05:42:47.286917565 +0000 UTC m=+0.386011258 container init 9bf966e88f6ccff940abc3902e5afda979f174527253c27672ff4cd54efe1929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b, ceph=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-28T05:42:47.569 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 podman[65294]: 2024-03-28 05:42:47.295775735 +0000 UTC m=+0.394869392 container start 9bf966e88f6ccff940abc3902e5afda979f174527253c27672ff4cd54efe1929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:42:47.569 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mds[65313]: -- 172.21.15.86:0/3914740194 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56540f25da40 con 0x56540f230800 2024-03-28T05:42:47.569 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: starting mds.b at 2024-03-28T05:42:47.569 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 bash[65294]: 9bf966e88f6ccff940abc3902e5afda979f174527253c27672ff4cd54efe1929 2024-03-28T05:42:47.569 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:47 smithi086 systemd[1]: Started Ceph mds.b for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:42:47.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 -- 172.21.15.55:0/3039322237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 msgr2=0x7fefb8077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3039322237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb8077700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009900 tx=0x7fefa002bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 -- 172.21.15.55:0/3039322237 shutdown_connections 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3039322237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8077c40 0x7fefb80784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3039322237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb8077700 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3039322237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8076060 0x7fefb8076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 -- 172.21.15.55:0/3039322237 >> 172.21.15.55:0/3039322237 conn(0x7fefb80fee50 msgr2=0x7fefb8101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 -- 172.21.15.55:0/3039322237 shutdown_connections 2024-03-28T05:42:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.794+0000 7fefbfc00640 1 -- 172.21.15.55:0/3039322237 wait complete. 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 Processor -- start 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 -- start start 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8076060 0x7fefb819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8077c40 0x7fefb81a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8113860 con 0x7fefb80772a0 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81136e0 con 0x7fefb8077c40 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.795+0000 7fefbfc00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81139e0 con 0x7fefb8076060 2024-03-28T05:42:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47618/0 (socket says 172.21.15.55:47618) 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 -- 172.21.15.55:0/3595591285 learned_addr learned my addr 172.21.15.55:0/3595591285 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefbdc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8077c40 0x7fefb81a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefbd200640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8076060 0x7fefb819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 -- 172.21.15.55:0/3595591285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8076060 msgr2=0x7fefb819def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8076060 0x7fefb819def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 -- 172.21.15.55:0/3595591285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8077c40 msgr2=0x7fefb81a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8077c40 0x7fefb81a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 -- 172.21.15.55:0/3595591285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb81a5b10 con 0x7fefb80772a0 2024-03-28T05:42:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.796+0000 7fefafe00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.797+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0043020 con 0x7fefb80772a0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.797+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fefa0004aa0 con 0x7fefb80772a0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.797+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb81a5da0 con 0x7fefb80772a0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.797+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0003d70 con 0x7fefb80772a0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.797+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81a6270 con 0x7fefb80772a0 2024-03-28T05:42:47.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.798+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb81103d0 con 0x7fefb80772a0 2024-03-28T05:42:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.800+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fefa0046020 con 0x7fefb80772a0 2024-03-28T05:42:47.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.801+0000 7fefb6000640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 0x7fef9c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:47.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.801+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fefa00f0940 con 0x7fefb80772a0 2024-03-28T05:42:47.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.802+0000 7fefbd200640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 0x7fef9c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:47.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.802+0000 7fefbd200640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 0x7fef9c0a4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009b60 tx=0x7fefa8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:47.806+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fefa004d020 con 0x7fefb80772a0 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.047+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefb802d070 con 0x7fefb80772a0 2024-03-28T05:42:48.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.049+0000 7fefb6000640 1 -- 172.21.15.55:0/3595591285 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10028 (secure 0 0 0) 0x7fefa00bdde0 con 0x7fefb80772a0 2024-03-28T05:42:48.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:48.050 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":34433,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34457,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":34490,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":34535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2024-03-28T05:42:48.051 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 13 2024-03-28T05:42:48.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.051+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 msgr2=0x7fef9c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.051+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 0x7fef9c0a4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009b60 tx=0x7fefa8005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.051+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 msgr2=0x7fefb819e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.051+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa00042f0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 shutdown_connections 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fef9c0a2880 0x7fef9c0a4d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefb8077c40 0x7fefb81a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefb80772a0 0x7fefb819e430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 --2- 172.21.15.55:0/3595591285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fefb8076060 0x7fefb819def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 >> 172.21.15.55:0/3595591285 conn(0x7fefb80fee50 msgr2=0x7fefb8100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 shutdown_connections 2024-03-28T05:42:48.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.052+0000 7fefbfc00640 1 -- 172.21.15.55:0/3595591285 wait complete. 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 -- 172.21.15.55:0/1375152062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36401030b0 msgr2=0x7f3640109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 --2- 172.21.15.55:0/1375152062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36401030b0 0x7f3640109940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f363802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 -- 172.21.15.55:0/1375152062 shutdown_connections 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 --2- 172.21.15.55:0/1375152062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36401030b0 0x7f3640109940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 --2- 172.21.15.55:0/1375152062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401026f0 0x7f3640102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 --2- 172.21.15.55:0/1375152062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3640101500 0x7f3640101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 -- 172.21.15.55:0/1375152062 >> 172.21.15.55:0/1375152062 conn(0x7f36400fca70 msgr2=0x7f36400feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 -- 172.21.15.55:0/1375152062 shutdown_connections 2024-03-28T05:42:48.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.272+0000 7f363f200640 1 -- 172.21.15.55:0/1375152062 wait complete. 2024-03-28T05:42:48.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 Processor -- start 2024-03-28T05:42:48.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 -- start start 2024-03-28T05:42:48.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36401026f0 0x7f3640199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401030b0 0x7f36401a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364010d040 con 0x7f3640101500 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364010cec0 con 0x7f36401030b0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363f200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364010d1c0 con 0x7f36401026f0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47650/0 (socket says 172.21.15.55:47650) 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.273+0000 7f363de00640 1 -- 172.21.15.55:0/1305365863 learned_addr learned my addr 172.21.15.55:0/1305365863 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363e800640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401030b0 0x7f36401a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363d400640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36401026f0 0x7f3640199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 -- 172.21.15.55:0/1305365863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36401026f0 msgr2=0x7f3640199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36401026f0 0x7f3640199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 -- 172.21.15.55:0/1305365863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401030b0 msgr2=0x7f36401a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401030b0 0x7f36401a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 -- 172.21.15.55:0/1305365863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36401a14a0 con 0x7f3640101500 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363de00640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f363000d770 tx=0x7f363000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630017070 con 0x7f3640101500 2024-03-28T05:42:48.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3630009c30 con 0x7f3640101500 2024-03-28T05:42:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.274+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36401a1790 con 0x7f3640101500 2024-03-28T05:42:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.275+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630003d00 con 0x7f3640101500 2024-03-28T05:42:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.275+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36401a1ce0 con 0x7f3640101500 2024-03-28T05:42:48.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.276+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36401a1f40 con 0x7f3640101500 2024-03-28T05:42:48.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.278+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3630003ea0 con 0x7f3640101500 2024-03-28T05:42:48.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.279+0000 7f3636a00640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 0x7f36240a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.279+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f36300ce2e0 con 0x7f3640101500 2024-03-28T05:42:48.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.279+0000 7f363d400640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 0x7f36240a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.280+0000 7f363d400640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 0x7f36240a4cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f364019ad90 tx=0x7f362c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:48.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.284+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f3630009de0 con 0x7f3640101500 2024-03-28T05:42:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.514+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36401a21b0 con 0x7f3640101500 2024-03-28T05:42:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.515+0000 7f3636a00640 1 -- 172.21.15.55:0/1305365863 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18407 (secure 0 0 0) 0x7f363009b130 con 0x7f3640101500 2024-03-28T05:42:48.516 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:48.516 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:41:49.723408+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 msgr2=0x7f36240a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 0x7f36240a4cc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f364019ad90 tx=0x7f362c00b390 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 msgr2=0x7f3640199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f363000d770 tx=0x7f363000dc30 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 shutdown_connections 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36240a2800 0x7f36240a4cc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36401030b0 0x7f36401a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36401026f0 0x7f3640199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 --2- 172.21.15.55:0/1305365863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3640101500 0x7f3640199920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 >> 172.21.15.55:0/1305365863 conn(0x7f36400fca70 msgr2=0x7f36400738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 shutdown_connections 2024-03-28T05:42:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.518+0000 7f363f200640 1 -- 172.21.15.55:0/1305365863 wait complete. 2024-03-28T05:42:48.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:42:48.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 -- 172.21.15.55:0/2856705213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40104ab0 msgr2=0x7f5c40106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 --2- 172.21.15.55:0/2856705213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40104ab0 0x7f5c40106ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009900 tx=0x7f5c2c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 -- 172.21.15.55:0/2856705213 shutdown_connections 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 --2- 172.21.15.55:0/2856705213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c401073e0 0x7f5c401097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 --2- 172.21.15.55:0/2856705213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40104ab0 0x7f5c40106ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 --2- 172.21.15.55:0/2856705213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c40102180 0x7f5c40104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 -- 172.21.15.55:0/2856705213 >> 172.21.15.55:0/2856705213 conn(0x7f5c400fbb30 msgr2=0x7f5c400fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 -- 172.21.15.55:0/2856705213 shutdown_connections 2024-03-28T05:42:48.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.766+0000 7f5c45600640 1 -- 172.21.15.55:0/2856705213 wait complete. 2024-03-28T05:42:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 Processor -- start 2024-03-28T05:42:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 -- start start 2024-03-28T05:42:48.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 0x7f5c4019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c401073e0 0x7f5c401a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4010d1f0 con 0x7f5c40102180 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4010d070 con 0x7f5c40104ab0 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c45600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4010d370 con 0x7f5c401073e0 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c3ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c3ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47672/0 (socket says 172.21.15.55:47672) 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.767+0000 7f5c3ea00640 1 -- 172.21.15.55:0/3903764833 learned_addr learned my addr 172.21.15.55:0/3903764833 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3f400640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c401073e0 0x7f5c401a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3e000640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 0x7f5c4019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 -- 172.21.15.55:0/3903764833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c401073e0 msgr2=0x7f5c401a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c401073e0 0x7f5c401a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 -- 172.21.15.55:0/3903764833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 msgr2=0x7f5c4019a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 0x7f5c4019a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 -- 172.21.15.55:0/3903764833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c401a1760 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3e000640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 0x7f5c4019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.768+0000 7f5c3ea00640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000e9f0 tx=0x7f5c3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.769+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000cd80 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.769+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c300108e0 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.769+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c401a1a50 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.769+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30018920 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.769+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401a1fc0 con 0x7f5c40102180 2024-03-28T05:42:48.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.770+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40108ed0 con 0x7f5c40102180 2024-03-28T05:42:48.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.772+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f5c30010a90 con 0x7f5c40102180 2024-03-28T05:42:48.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.774+0000 7f5c37400640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 0x7f5c240a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:48.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.775+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5c300ce9a0 con 0x7f5c40102180 2024-03-28T05:42:48.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.775+0000 7f5c3e000640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 0x7f5c240a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:48.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.776+0000 7f5c3e000640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 0x7f5c240a4d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c02c240 tx=0x7f5c2c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:48.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:48.779+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5c3009be40 con 0x7f5c40102180 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:boot 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: fsmap 12 up:standby 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3595591285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:48 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1305365863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.007+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c4002d070 con 0x7f5c40102180 2024-03-28T05:42:49.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.008+0000 7f5c37400640 1 -- 172.21.15.55:0/3903764833 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c4002d070 con 0x7f5c40102180 2024-03-28T05:42:49.009 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:42:49.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 msgr2=0x7f5c240a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 0x7f5c240a4d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c02c240 tx=0x7f5c2c005fd0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 msgr2=0x7f5c40199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000e9f0 tx=0x7f5c3000eeb0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 shutdown_connections 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c240a2880 0x7f5c240a4d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c401073e0 0x7f5c401a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40104ab0 0x7f5c4019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 --2- 172.21.15.55:0/3903764833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c40102180 0x7f5c40199b40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 >> 172.21.15.55:0/3903764833 conn(0x7f5c400fbb30 msgr2=0x7f5c401019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 shutdown_connections 2024-03-28T05:42:49.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.011+0000 7f5c45600640 1 -- 172.21.15.55:0/3903764833 wait complete. 2024-03-28T05:42:49.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:boot 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: fsmap 12 up:standby 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3595591285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:48 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1305365863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:boot 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: fsmap 12 up:standby 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3595591285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:48 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1305365863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 -- 172.21.15.55:0/3307015858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 msgr2=0x7fea44104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 --2- 172.21.15.55:0/3307015858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44104d60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea30009900 tx=0x7fea3002bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 -- 172.21.15.55:0/3307015858 shutdown_connections 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 --2- 172.21.15.55:0/3307015858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea4410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 --2- 172.21.15.55:0/3307015858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44104d60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 --2- 172.21.15.55:0/3307015858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea44103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 -- 172.21.15.55:0/3307015858 >> 172.21.15.55:0/3307015858 conn(0x7fea440fec80 msgr2=0x7fea441010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 -- 172.21.15.55:0/3307015858 shutdown_connections 2024-03-28T05:42:49.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.224+0000 7fea4a200640 1 -- 172.21.15.55:0/3307015858 wait complete. 2024-03-28T05:42:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.225+0000 7fea4a200640 1 Processor -- start 2024-03-28T05:42:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.225+0000 7fea4a200640 1 -- start start 2024-03-28T05:42:49.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.225+0000 7fea4a200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea441998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.225+0000 7fea4a200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea4a200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea441a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea4a200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4410f270 con 0x7fea441048e0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea4a200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4410f0f0 con 0x7fea441036f0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea4a200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4410f3f0 con 0x7fea441052a0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36794/0 (socket says 172.21.15.55:36794) 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 -- 172.21.15.55:0/3416895954 learned_addr learned my addr 172.21.15.55:0/3416895954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea48e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea441998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea49800640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea441a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 -- 172.21.15.55:0/3416895954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 msgr2=0x7fea441a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea441a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 -- 172.21.15.55:0/3416895954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 msgr2=0x7fea441998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea441998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea43e00640 1 -- 172.21.15.55:0/3416895954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea441a14e0 con 0x7fea441048e0 2024-03-28T05:42:49.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea49800640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea441a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:49.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.226+0000 7fea48e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea441998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:49.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea43e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea30000c00 tx=0x7fea300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30043020 con 0x7fea441048e0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fea300054c0 con 0x7fea441048e0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea441a1770 con 0x7fea441048e0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30003d40 con 0x7fea441048e0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.227+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea441a1cc0 con 0x7fea441048e0 2024-03-28T05:42:49.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.228+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4410aa10 con 0x7fea441048e0 2024-03-28T05:42:49.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.232+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fea30046020 con 0x7fea441048e0 2024-03-28T05:42:49.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.233+0000 7fea41600640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 0x7fea280a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.233+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fea300f0b00 con 0x7fea441048e0 2024-03-28T05:42:49.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.233+0000 7fea48e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 0x7fea280a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.234+0000 7fea48e00640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 0x7fea280a4cc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea44104740 tx=0x7fea3c0095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:49.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.238+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fea3004d020 con 0x7fea441048e0 2024-03-28T05:42:49.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.457+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea440622a0 con 0x7fea441048e0 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.458+0000 7fea41600640 1 -- 172.21.15.55:0/3416895954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7fea300f0e20 con 0x7fea441048e0 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:42:49.459 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-03-28T05:42:49.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 msgr2=0x7fea280a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 0x7fea280a4cc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea44104740 tx=0x7fea3c0095c0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 msgr2=0x7fea44199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea30000c00 tx=0x7fea300042f0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 shutdown_connections 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fea280a2800 0x7fea280a4cc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea441052a0 0x7fea441a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea441048e0 0x7fea44199e00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 --2- 172.21.15.55:0/3416895954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea441036f0 0x7fea441998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 >> 172.21.15.55:0/3416895954 conn(0x7fea440fec80 msgr2=0x7fea44107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 shutdown_connections 2024-03-28T05:42:49.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.461+0000 7fea4a200640 1 -- 172.21.15.55:0/3416895954 wait complete. 2024-03-28T05:42:49.481 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-28T05:42:49.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-28T05:42:49.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 -- 172.21.15.55:0/2713020063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b0103260 msgr2=0x7f68b0109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 --2- 172.21.15.55:0/2713020063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b0103260 0x7f68b0109af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ca0 tx=0x7f68a802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 -- 172.21.15.55:0/2713020063 shutdown_connections 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 --2- 172.21.15.55:0/2713020063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b0103260 0x7f68b0109af0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 --2- 172.21.15.55:0/2713020063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 0x7f68b0102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 --2- 172.21.15.55:0/2713020063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b01016b0 0x7f68b0101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.708+0000 7f68b5400640 1 -- 172.21.15.55:0/2713020063 >> 172.21.15.55:0/2713020063 conn(0x7f68b00fcc40 msgr2=0x7f68b00ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.709+0000 7f68b5400640 1 -- 172.21.15.55:0/2713020063 shutdown_connections 2024-03-28T05:42:49.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.709+0000 7f68b5400640 1 -- 172.21.15.55:0/2713020063 wait complete. 2024-03-28T05:42:49.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 Processor -- start 2024-03-28T05:42:49.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 -- start start 2024-03-28T05:42:49.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 0x7f68b0073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 0x7f68b0073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b010d1c0 con 0x7f68b01016b0 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b010d040 con 0x7f68b0103260 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.710+0000 7f68b5400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b010d340 con 0x7f68b01028a0 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36804/0 (socket says 172.21.15.55:36804) 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 -- 172.21.15.55:0/1149906827 learned_addr learned my addr 172.21.15.55:0/1149906827 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68a5e00640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 0x7f68b0073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68af200640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 0x7f68b0073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 -- 172.21.15.55:0/1149906827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 msgr2=0x7f68b0073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 0x7f68b0073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 -- 172.21.15.55:0/1149906827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 msgr2=0x7f68b0073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 0x7f68b0073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68ae800640 1 -- 172.21.15.55:0/1149906827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0074860 con 0x7f68b01016b0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.711+0000 7f68af200640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 0x7f68b0073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68ae800640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d950 tx=0x7f68a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0017020 con 0x7f68b01016b0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f68a0009c30 con 0x7f68b01016b0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b01a19b0 con 0x7f68b01016b0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a000f6b0 con 0x7f68b01016b0 2024-03-28T05:42:49.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.712+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b01a1f00 con 0x7f68b01016b0 2024-03-28T05:42:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.713+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b00688e0 con 0x7f68b01016b0 2024-03-28T05:42:49.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.715+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f68a001a020 con 0x7f68b01016b0 2024-03-28T05:42:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.716+0000 7f68a7e00640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 0x7f68940a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:49.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.717+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f68a00ce680 con 0x7f68b01016b0 2024-03-28T05:42:49.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.717+0000 7f68a5e00640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 0x7f68940a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:49.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.717+0000 7f68a5e00640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 0x7f68940a4cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f68b00751c0 tx=0x7f689800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:49.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.721+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f68a0021020 con 0x7f68b01016b0 2024-03-28T05:42:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:49 smithi055 ceph-mon[31863]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:49 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3903764833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:49 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3416895954' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-28T05:42:49.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:49.928+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f68b0108a50 con 0x7f68b01016b0 2024-03-28T05:42:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:49 smithi086 ceph-mon[35163]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:49 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3903764833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:49 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3416895954' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-28T05:42:50.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:49 smithi159 ceph-mon[36109]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:50.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:49 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3903764833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:42:50.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:49 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3416895954' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-28T05:42:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.639+0000 7f68a7e00640 1 -- 172.21.15.55:0/1149906827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68a0009de0 con 0x7f68b01016b0 2024-03-28T05:42:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 msgr2=0x7f68940a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 0x7f68940a4cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f68b00751c0 tx=0x7f689800b390 comp rx=0 tx=0).stop 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 msgr2=0x7f68b0075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d950 tx=0x7f68a000de10 comp rx=0 tx=0).stop 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 shutdown_connections 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f68940a2800 0x7f68940a4cc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b0103260 0x7f68b0073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.641+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b01028a0 0x7f68b0073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.642+0000 7f68b5400640 1 --2- 172.21.15.55:0/1149906827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68b01016b0 0x7f68b0075450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.642+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 >> 172.21.15.55:0/1149906827 conn(0x7f68b00fcc40 msgr2=0x7f68b0105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.642+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 shutdown_connections 2024-03-28T05:42:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.642+0000 7f68b5400640 1 -- 172.21.15.55:0/1149906827 wait complete. 2024-03-28T05:42:50.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 -- 172.21.15.55:0/2849852146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d88102790 msgr2=0x7f5d88102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/2849852146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d88102790 0x7f5d88102c10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009900 tx=0x7f5d7002bc40 comp rx=0 tx=0).stop 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 -- 172.21.15.55:0/2849852146 shutdown_connections 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/2849852146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 0x7f5d881099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/2849852146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d88102790 0x7f5d88102c10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/2849852146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d881015a0 0x7f5d881019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 -- 172.21.15.55:0/2849852146 >> 172.21.15.55:0/2849852146 conn(0x7f5d880fcb10 msgr2=0x7f5d880fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.865+0000 7f5d8ca00640 1 -- 172.21.15.55:0/2849852146 shutdown_connections 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.866+0000 7f5d8ca00640 1 -- 172.21.15.55:0/2849852146 wait complete. 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.866+0000 7f5d8ca00640 1 Processor -- start 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 -- start start 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 0x7f5d88199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 0x7f5d881a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8810d120 con 0x7f5d881015a0 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8810cfa0 con 0x7f5d88103150 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d8ca00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8810d2a0 con 0x7f5d88102790 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36816/0 (socket says 172.21.15.55:36816) 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d86800640 1 -- 172.21.15.55:0/3071940259 learned_addr learned my addr 172.21.15.55:0/3071940259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.867+0000 7f5d85e00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 0x7f5d88199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d87200640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 0x7f5d881a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 -- 172.21.15.55:0/3071940259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 msgr2=0x7f5d88199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 0x7f5d88199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 -- 172.21.15.55:0/3071940259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 msgr2=0x7f5d881a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 0x7f5d881a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 -- 172.21.15.55:0/3071940259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d881a15a0 con 0x7f5d881015a0 2024-03-28T05:42:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d85e00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 0x7f5d88199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.868+0000 7f5d86800640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ccb0 tx=0x7f5d7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:50.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.871+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78003b70 con 0x7f5d881015a0 2024-03-28T05:42:50.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.871+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5d7800ae50 con 0x7f5d881015a0 2024-03-28T05:42:50.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.871+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d881a1890 con 0x7f5d881015a0 2024-03-28T05:42:50.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.871+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800f6b0 con 0x7f5d881015a0 2024-03-28T05:42:50.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.871+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d881a1e60 con 0x7f5d881015a0 2024-03-28T05:42:50.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.873+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d881a20f0 con 0x7f5d881015a0 2024-03-28T05:42:50.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.875+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f5d78004000 con 0x7f5d881015a0 2024-03-28T05:42:50.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.876+0000 7f5d7f400640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 0x7f5d6c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:50.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.876+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f5d780cedb0 con 0x7f5d881015a0 2024-03-28T05:42:50.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.876+0000 7f5d85e00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 0x7f5d6c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:50.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.877+0000 7f5d85e00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 0x7f5d6c0a4cc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d700096c0 tx=0x7f5d70000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:50.880+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5d78014070 con 0x7f5d881015a0 2024-03-28T05:42:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:50 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-28T05:42:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:50 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-28T05:42:51.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.087+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5d881a22c0 con 0x7f5d881015a0 2024-03-28T05:42:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:50 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-28T05:42:51.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.647+0000 7f5d7f400640 1 -- 172.21.15.55:0/3071940259 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5d7809c0e0 con 0x7f5d881015a0 2024-03-28T05:42:51.648 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-03-28T05:42:51.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 msgr2=0x7f5d6c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 0x7f5d6c0a4cc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d700096c0 tx=0x7f5d70000bc0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 msgr2=0x7f5d88199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ccb0 tx=0x7f5d7800a620 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 shutdown_connections 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5d6c0a2800 0x7f5d6c0a4cc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d88103150 0x7f5d881a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d88102790 0x7f5d88199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 --2- 172.21.15.55:0/3071940259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d881015a0 0x7f5d88199980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 >> 172.21.15.55:0/3071940259 conn(0x7f5d880fcb10 msgr2=0x7f5d880738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 shutdown_connections 2024-03-28T05:42:51.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.650+0000 7f5d8ca00640 1 -- 172.21.15.55:0/3071940259 wait complete. 2024-03-28T05:42:51.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 -- 172.21.15.55:0/2281238793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4100480 msgr2=0x7f2fb41008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 --2- 172.21.15.55:0/2281238793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4100480 0x7f2fb41008a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009900 tx=0x7f2fa402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 -- 172.21.15.55:0/2281238793 shutdown_connections 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 --2- 172.21.15.55:0/2281238793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4102030 0x7f2fb41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 --2- 172.21.15.55:0/2281238793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4101670 0x7f2fb4101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 --2- 172.21.15.55:0/2281238793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4100480 0x7f2fb41008a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.868+0000 7f2fb3200640 1 -- 172.21.15.55:0/2281238793 >> 172.21.15.55:0/2281238793 conn(0x7f2fb40fba10 msgr2=0x7f2fb40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:51.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.869+0000 7f2fb3200640 1 -- 172.21.15.55:0/2281238793 shutdown_connections 2024-03-28T05:42:51.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.869+0000 7f2fb3200640 1 -- 172.21.15.55:0/2281238793 wait complete. 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 Processor -- start 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 -- start start 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4100480 0x7f2fb4197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4102030 0x7f2fb419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:51.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb410c050 con 0x7f2fb4101670 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb410bed0 con 0x7f2fb4100480 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb3200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb410c1d0 con 0x7f2fb4102030 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36832/0 (socket says 172.21.15.55:36832) 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.870+0000 7f2fb1400640 1 -- 172.21.15.55:0/1979459691 learned_addr learned my addr 172.21.15.55:0/1979459691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1e00640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4100480 0x7f2fb4197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb2800640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4102030 0x7f2fb419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 -- 172.21.15.55:0/1979459691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4102030 msgr2=0x7f2fb419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4102030 0x7f2fb419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 -- 172.21.15.55:0/1979459691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4100480 msgr2=0x7f2fb4197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:51.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4100480 0x7f2fb4197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 -- 172.21.15.55:0/1979459691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb419f420 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb1400640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000b4a0 tx=0x7f2fa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0014070 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2fa0010ac0 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0017c30 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.871+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb419f710 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.872+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb419fce0 con 0x7f2fb4101670 2024-03-28T05:42:51.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.873+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb419ffa0 con 0x7f2fb4101670 2024-03-28T05:42:51.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.878+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f2fa0017070 con 0x7f2fb4101670 2024-03-28T05:42:51.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.879+0000 7f2faaa00640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 0x7f2f980a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:51.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.879+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f2fa00ce0b0 con 0x7f2fb4101670 2024-03-28T05:42:51.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.879+0000 7f2fb1e00640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 0x7f2f980a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:51.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.880+0000 7f2fb1e00640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 0x7f2f980a4d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2fa402c240 tx=0x7f2fa4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:51.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:51.882+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2fa009b300 con 0x7f2fb4101670 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: osdmap e87: 12 total, 12 up, 12 in 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:51 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-28T05:42:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: osdmap e87: 12 total, 12 up, 12 in 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:51 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-28T05:42:52.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:52.120+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2fb41a0320 con 0x7f2fb4101670 2024-03-28T05:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1149906827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-28T05:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: osdmap e87: 12 total, 12 up, 12 in 2024-03-28T05:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:51 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-28T05:42:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.062+0000 7f2faaa00640 1 -- 172.21.15.55:0/1979459691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2fa009ac00 con 0x7f2fb4101670 2024-03-28T05:42:53.064 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 2 and data pool 3 2024-03-28T05:42:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 msgr2=0x7f2f980a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 0x7f2f980a4d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2fa402c240 tx=0x7f2fa4000bc0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 msgr2=0x7f2fb4197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000b4a0 tx=0x7f2fa000b960 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 shutdown_connections 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2f980a2880 0x7f2f980a4d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb4102030 0x7f2fb419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb4101670 0x7f2fb4197d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 --2- 172.21.15.55:0/1979459691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fb4100480 0x7f2fb4197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 >> 172.21.15.55:0/1979459691 conn(0x7f2fb40fba10 msgr2=0x7f2fb4068800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 shutdown_connections 2024-03-28T05:42:53.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.066+0000 7f2fb3200640 1 -- 172.21.15.55:0/1979459691 wait complete. 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: osdmap e88: 12 total, 12 up, 12 in 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-28T05:42:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-28T05:42:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: osdmap e88: 12 total, 12 up, 12 in 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-28T05:42:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3071940259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: osdmap e88: 12 total, 12 up, 12 in 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-28T05:42:53.089 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-28T05:42:53.090 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:42:53.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:42:53.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 -- 172.21.15.55:0/1457767650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac101f70 msgr2=0x7fa1ac104360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/1457767650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac101f70 0x7fa1ac104360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009900 tx=0x7fa19c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 -- 172.21.15.55:0/1457767650 shutdown_connections 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/1457767650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac1071d0 0x7fa1ac109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/1457767650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/1457767650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac101f70 0x7fa1ac104360 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 -- 172.21.15.55:0/1457767650 >> 172.21.15.55:0/1457767650 conn(0x7fa1ac0fb980 msgr2=0x7fa1ac0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 -- 172.21.15.55:0/1457767650 shutdown_connections 2024-03-28T05:42:53.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.285+0000 7fa1b1a00640 1 -- 172.21.15.55:0/1457767650 wait complete. 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.286+0000 7fa1b1a00640 1 Processor -- start 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.286+0000 7fa1b1a00640 1 -- start start 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1071d0 0x7fa1ac1a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac10d080 con 0x7fa1ac1048a0 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac10cf00 con 0x7fa1ac1071d0 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac10d200 con 0x7fa1ac101f70 2024-03-28T05:42:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1abe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1abe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:44526/0 (socket says 172.21.15.55:44526) 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1abe00640 1 -- 172.21.15.55:0/612616782 learned_addr learned my addr 172.21.15.55:0/612616782 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1b1000640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1071d0 0x7fa1ac1a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.287+0000 7fa1ab400640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 -- 172.21.15.55:0/612616782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1071d0 msgr2=0x7fa1ac1a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1071d0 0x7fa1ac1a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 -- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 msgr2=0x7fa1ac199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 -- 172.21.15.55:0/612616782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac1a1590 con 0x7fa1ac101f70 2024-03-28T05:42:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1ab400640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1abe00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000c00 tx=0x7fa19c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c043020 con 0x7fa1ac101f70 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac1a1820 con 0x7fa1ac101f70 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa19c0044c0 con 0x7fa1ac101f70 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.288+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c003c60 con 0x7fa1ac101f70 2024-03-28T05:42:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.289+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac1a1dc0 con 0x7fa1ac101f70 2024-03-28T05:42:53.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.289+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac108d20 con 0x7fa1ac101f70 2024-03-28T05:42:53.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.292+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa19c046020 con 0x7fa1ac101f70 2024-03-28T05:42:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.293+0000 7fa1a8c00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 0x7fa1900a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.293+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa19c0f10d0 con 0x7fa1ac101f70 2024-03-28T05:42:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.293+0000 7fa1ab400640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 0x7fa1900a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.294+0000 7fa1ab400640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 0x7fa1900a4cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac19ae80 tx=0x7fa198005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:53.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.297+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa19c04d020 con 0x7fa1ac101f70 2024-03-28T05:42:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.508+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1ac0622a0 con 0x7fa1ac101f70 2024-03-28T05:42:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.511+0000 7fa1a8c00640 1 -- 172.21.15.55:0/612616782 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22183 (secure 0 0 0) 0x7fa19c0be220 con 0x7fa1ac101f70 2024-03-28T05:42:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:53.512 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:42:52.122800+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:42:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 msgr2=0x7fa1900a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 0x7fa1900a4cc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac19ae80 tx=0x7fa198005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 msgr2=0x7fa1ac199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa19c000c00 tx=0x7fa19c0040c0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 shutdown_connections 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa1900a2800 0x7fa1900a4cc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac1071d0 0x7fa1ac1a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ac1048a0 0x7fa1ac199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 --2- 172.21.15.55:0/612616782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1ac101f70 0x7fa1ac199970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 >> 172.21.15.55:0/612616782 conn(0x7fa1ac0fb980 msgr2=0x7fa1ac101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 shutdown_connections 2024-03-28T05:42:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.513+0000 7fa1b1a00640 1 -- 172.21.15.55:0/612616782 wait complete. 2024-03-28T05:42:53.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:42:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 -- 172.21.15.55:0/2442565901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8108ed0 msgr2=0x7f81f8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 --2- 172.21.15.55:0/2442565901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8108ed0 0x7f81f8109350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009900 tx=0x7f81e002bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:53.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 -- 172.21.15.55:0/2442565901 shutdown_connections 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 --2- 172.21.15.55:0/2442565901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8109890 0x7f81f8110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 --2- 172.21.15.55:0/2442565901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8108ed0 0x7f81f8109350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 --2- 172.21.15.55:0/2442565901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8107ce0 0x7f81f8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 -- 172.21.15.55:0/2442565901 >> 172.21.15.55:0/2442565901 conn(0x7f81f8076cb0 msgr2=0x7f81f80790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 -- 172.21.15.55:0/2442565901 shutdown_connections 2024-03-28T05:42:53.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.744+0000 7f81fd200640 1 -- 172.21.15.55:0/2442565901 wait complete. 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.745+0000 7f81fd200640 1 Processor -- start 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 -- start start 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8108ed0 0x7f81f819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8109890 0x7f81f81a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8113840 con 0x7f81f8107ce0 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81136c0 con 0x7f81f8109890 2024-03-28T05:42:53.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81fd200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81139c0 con 0x7f81f8108ed0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81f5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81f5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36866/0 (socket says 172.21.15.55:36866) 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.746+0000 7f81f5e00640 1 -- 172.21.15.55:0/732057143 learned_addr learned my addr 172.21.15.55:0/732057143 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f6800640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8109890 0x7f81f81a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81ed400640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8108ed0 0x7f81f819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 -- 172.21.15.55:0/732057143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8108ed0 msgr2=0x7f81f819e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8108ed0 0x7f81f819e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 -- 172.21.15.55:0/732057143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8109890 msgr2=0x7f81f81a54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8109890 0x7f81f81a54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 -- 172.21.15.55:0/732057143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f81a5b60 con 0x7f81f8107ce0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81f5e00640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81e800ea80 tx=0x7f81e800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e800ce40 con 0x7f81f8107ce0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f81a5e50 con 0x7f81f8107ce0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f81e8011920 con 0x7f81f8107ce0 2024-03-28T05:42:53.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.747+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e801aaa0 con 0x7f81f8107ce0 2024-03-28T05:42:53.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.748+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f81a62c0 con 0x7f81f8107ce0 2024-03-28T05:42:53.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.749+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f810f050 con 0x7f81f8107ce0 2024-03-28T05:42:53.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.751+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f81e8011ad0 con 0x7f81f8107ce0 2024-03-28T05:42:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.752+0000 7f81ef400640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 0x7f81dc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.752+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f81e80cf280 con 0x7f81f8107ce0 2024-03-28T05:42:53.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.752+0000 7f81ed400640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 0x7f81dc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:53.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.753+0000 7f81ed400640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 0x7f81dc0a4cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006010 tx=0x7f81e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:53.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.755+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f81e8016030 con 0x7f81f8107ce0 2024-03-28T05:42:53.834 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: pgmap v365: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:53.834 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-28T05:42:53.834 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: osdmap e89: 12 total, 12 up, 12 in 2024-03-28T05:42:53.834 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-28T05:42:53.834 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-28T05:42:53.835 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-28T05:42:53.835 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:53 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/612616782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:53.940 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: pgmap v365: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:53.940 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-28T05:42:53.940 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: osdmap e89: 12 total, 12 up, 12 in 2024-03-28T05:42:53.941 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-28T05:42:53.941 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-28T05:42:53.941 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-28T05:42:53.941 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:53 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/612616782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:53.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.966+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81f802d1f0 con 0x7f81f8107ce0 2024-03-28T05:42:53.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.968+0000 7f81ef400640 1 -- 172.21.15.55:0/732057143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+22170 (secure 0 0 0) 0x7f81e809c3d0 con 0x7f81f8107ce0 2024-03-28T05:42:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:42:53.969 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:42:53.691653+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 msgr2=0x7f81dc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 0x7f81dc0a4cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006010 tx=0x7f81e0000bc0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 msgr2=0x7f81f819df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81e800ea80 tx=0x7f81e800ef40 comp rx=0 tx=0).stop 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 shutdown_connections 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f81dc0a2800 0x7f81dc0a4cc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81f8109890 0x7f81f81a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81f8108ed0 0x7f81f819e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 --2- 172.21.15.55:0/732057143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81f8107ce0 0x7f81f819df40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:53.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 >> 172.21.15.55:0/732057143 conn(0x7f81f8076cb0 msgr2=0x7f81f810c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:53.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 shutdown_connections 2024-03-28T05:42:53.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:53.971+0000 7f81fd200640 1 -- 172.21.15.55:0/732057143 wait complete. 2024-03-28T05:42:53.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: pgmap v365: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: osdmap e89: 12 total, 12 up, 12 in 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1979459691' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-28T05:42:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:53 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/612616782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 -- 172.21.15.55:0/2056747527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c076060 msgr2=0x7f889c076480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 --2- 172.21.15.55:0/2056747527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c076060 0x7f889c076480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f888c009ca0 tx=0x7f888c02c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 -- 172.21.15.55:0/2056747527 shutdown_connections 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 --2- 172.21.15.55:0/2056747527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c077c40 0x7f889c0784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 --2- 172.21.15.55:0/2056747527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c0772a0 0x7f889c077700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 --2- 172.21.15.55:0/2056747527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c076060 0x7f889c076480 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 -- 172.21.15.55:0/2056747527 >> 172.21.15.55:0/2056747527 conn(0x7f889c0fee50 msgr2=0x7f889c101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:54.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 -- 172.21.15.55:0/2056747527 shutdown_connections 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.182+0000 7f88a2600640 1 -- 172.21.15.55:0/2056747527 wait complete. 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.183+0000 7f88a2600640 1 Processor -- start 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.183+0000 7f88a2600640 1 -- start start 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.183+0000 7f88a2600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c076060 0x7f889c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f88a2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c0772a0 0x7f889c19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f88a2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f88a2600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c113820 con 0x7f889c077c40 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f88a2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1136a0 con 0x7f889c0772a0 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f88a2600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1139a0 con 0x7f889c076060 2024-03-28T05:42:54.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36872/0 (socket says 172.21.15.55:36872) 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 -- 172.21.15.55:0/2794868710 learned_addr learned my addr 172.21.15.55:0/2794868710 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889aa00640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c0772a0 0x7f889c19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889b400640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c076060 0x7f889c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 -- 172.21.15.55:0/2794868710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c076060 msgr2=0x7f889c19df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c076060 0x7f889c19df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 -- 172.21.15.55:0/2794868710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c0772a0 msgr2=0x7f889c19e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c0772a0 0x7f889c19e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.184+0000 7f889be00640 1 -- 172.21.15.55:0/2794868710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c1a5b90 con 0x7f889c077c40 2024-03-28T05:42:54.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f889be00640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f889400e970 tx=0x7f889400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400ccc0 con 0x7f889c077c40 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f889400ce60 con 0x7f889c077c40 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894010430 con 0x7f889c077c40 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c1a5e80 con 0x7f889c077c40 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.185+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c1a62f0 con 0x7f889c077c40 2024-03-28T05:42:54.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.186+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c110250 con 0x7f889c077c40 2024-03-28T05:42:54.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.188+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8894004ff0 con 0x7f889c077c40 2024-03-28T05:42:54.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.189+0000 7f8893e00640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 0x7f88800a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:54.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.190+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f88940cee70 con 0x7f889c077c40 2024-03-28T05:42:54.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.190+0000 7f889b400640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 0x7f88800a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:54.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.190+0000 7f889b400640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 0x7f88800a4cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c02c700 tx=0x7f888c000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:54.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.194+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f889409bfc0 con 0x7f889c077c40 2024-03-28T05:42:54.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:54.479+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f889c062340 con 0x7f889c077c40 2024-03-28T05:42:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: osdmap e90: 12 total, 12 up, 12 in 2024-03-28T05:42:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/732057143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T05:42:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:54 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-28T05:42:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: osdmap e90: 12 total, 12 up, 12 in 2024-03-28T05:42:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/732057143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T05:42:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:54 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-28T05:42:55.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.081+0000 7f8893e00640 1 -- 172.21.15.55:0/2794868710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f889409b8c0 con 0x7f889c077c40 2024-03-28T05:42:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 msgr2=0x7f88800a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 0x7f88800a4cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c02c700 tx=0x7f888c000f40 comp rx=0 tx=0).stop 2024-03-28T05:42:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 msgr2=0x7f889c1a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f889400e970 tx=0x7f889400ed70 comp rx=0 tx=0).stop 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 shutdown_connections 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f88800a2800 0x7f88800a4cc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889c077c40 0x7f889c1a5520 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f889c0772a0 0x7f889c19e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 --2- 172.21.15.55:0/2794868710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f889c076060 0x7f889c19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 >> 172.21.15.55:0/2794868710 conn(0x7f889c0fee50 msgr2=0x7f889c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 shutdown_connections 2024-03-28T05:42:55.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.084+0000 7f88a2600640 1 -- 172.21.15.55:0/2794868710 wait complete. 2024-03-28T05:42:55.102 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: osdmap e90: 12 total, 12 up, 12 in 2024-03-28T05:42:55.102 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/732057143' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:42:55.103 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T05:42:55.103 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.103 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:55.103 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:54 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-28T05:42:55.105 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-03-28T05:42:55.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.306+0000 7f1ddf400640 1 -- 172.21.15.55:0/3996818510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81028a0 msgr2=0x7f1dd8102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.306+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3996818510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81028a0 0x7f1dd8102d20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009900 tx=0x7f1dc402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 -- 172.21.15.55:0/3996818510 shutdown_connections 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3996818510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd8103260 0x7f1dd8109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3996818510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81028a0 0x7f1dd8102d20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3996818510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd81016b0 0x7f1dd8101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 -- 172.21.15.55:0/3996818510 >> 172.21.15.55:0/3996818510 conn(0x7f1dd80fcc40 msgr2=0x7f1dd80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 -- 172.21.15.55:0/3996818510 shutdown_connections 2024-03-28T05:42:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.307+0000 7f1ddf400640 1 -- 172.21.15.55:0/3996818510 wait complete. 2024-03-28T05:42:55.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.308+0000 7f1ddf400640 1 Processor -- start 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.308+0000 7f1ddf400640 1 -- start start 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 0x7f1dd8073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8103260 0x7f1dd8073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd810d230 con 0x7f1dd81016b0 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd810d0b0 con 0x7f1dd81028a0 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddf400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd810d3b0 con 0x7f1dd8103260 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:55.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36888/0 (socket says 172.21.15.55:36888) 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddca00640 1 -- 172.21.15.55:0/3191690364 learned_addr learned my addr 172.21.15.55:0/3191690364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1dd7e00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 0x7f1dd8073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.309+0000 7f1ddd400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8103260 0x7f1dd8073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 -- 172.21.15.55:0/3191690364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8103260 msgr2=0x7f1dd8073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8103260 0x7f1dd8073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 -- 172.21.15.55:0/3191690364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 msgr2=0x7f1dd8073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 0x7f1dd8073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 -- 172.21.15.55:0/3191690364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8074510 con 0x7f1dd81016b0 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1dd7e00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 0x7f1dd8073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddca00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d950 tx=0x7f1dcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc017070 con 0x7f1dd81016b0 2024-03-28T05:42:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1dcc009c30 con 0x7f1dd81016b0 2024-03-28T05:42:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd8074800 con 0x7f1dd81016b0 2024-03-28T05:42:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00f620 con 0x7f1dd81016b0 2024-03-28T05:42:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.310+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd81a6370 con 0x7f1dd81016b0 2024-03-28T05:42:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.312+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd8108ac0 con 0x7f1dd81016b0 2024-03-28T05:42:55.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.314+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f1dcc01a070 con 0x7f1dd81016b0 2024-03-28T05:42:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.316+0000 7f1dd5600640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 0x7f1dc00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.316+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1dcc0ce490 con 0x7f1dd81016b0 2024-03-28T05:42:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.316+0000 7f1dd7e00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 0x7f1dc00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:55.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.317+0000 7f1dd7e00640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 0x7f1dc00a4cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4006010 tx=0x7f1dc402c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:55.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.320+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f1dcc009de0 con 0x7f1dd81016b0 2024-03-28T05:42:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:55.584+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f1dd80622a0 con 0x7f1dd81016b0 2024-03-28T05:42:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: pgmap v368: 97 pgs: 4 creating+activating, 20 creating+peering, 31 active+clean, 42 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:55 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-28T05:42:56.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: pgmap v368: 97 pgs: 4 creating+activating, 20 creating+peering, 31 active+clean, 42 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:55 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-28T05:42:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: pgmap v368: 97 pgs: 4 creating+activating, 20 creating+peering, 31 active+clean, 42 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-03-28T05:42:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-28T05:42:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:42:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2794868710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:42:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:55 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-28T05:42:56.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.443+0000 7f1dd5600640 1 -- 172.21.15.55:0/3191690364 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1dcc09b5e0 con 0x7f1dd81016b0 2024-03-28T05:42:56.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.448+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 msgr2=0x7f1dc00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:56.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.448+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 0x7f1dc00a4cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4006010 tx=0x7f1dc402c7e0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.448+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 msgr2=0x7f1dd8075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:56.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.448+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d950 tx=0x7f1dcc00de10 comp rx=0 tx=0).stop 2024-03-28T05:42:56.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.448+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 shutdown_connections 2024-03-28T05:42:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1dc00a2800 0x7f1dc00a4cc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dd8103260 0x7f1dd8073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dd81028a0 0x7f1dd8073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 --2- 172.21.15.55:0/3191690364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dd81016b0 0x7f1dd8075450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 >> 172.21.15.55:0/3191690364 conn(0x7f1dd80fcc40 msgr2=0x7f1dd8105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:56.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 shutdown_connections 2024-03-28T05:42:56.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.449+0000 7f1ddf400640 1 -- 172.21.15.55:0/3191690364 wait complete. 2024-03-28T05:42:56.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-28T05:42:56.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 -- 172.21.15.55:0/2324073336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c0772a0 msgr2=0x7fd22c077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 --2- 172.21.15.55:0/2324073336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c0772a0 0x7fd22c077700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd214009900 tx=0x7fd21402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 -- 172.21.15.55:0/2324073336 shutdown_connections 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 --2- 172.21.15.55:0/2324073336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c077c40 0x7fd22c0784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 --2- 172.21.15.55:0/2324073336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c0772a0 0x7fd22c077700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 --2- 172.21.15.55:0/2324073336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 0x7fd22c076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.696+0000 7fd231000640 1 -- 172.21.15.55:0/2324073336 >> 172.21.15.55:0/2324073336 conn(0x7fd22c0fee50 msgr2=0x7fd22c101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.697+0000 7fd231000640 1 -- 172.21.15.55:0/2324073336 shutdown_connections 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.697+0000 7fd231000640 1 -- 172.21.15.55:0/2324073336 wait complete. 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 Processor -- start 2024-03-28T05:42:56.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 -- start start 2024-03-28T05:42:56.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 0x7fd22c19df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:56.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 0x7fd22c19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:56.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c113860 con 0x7fd22c077c40 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1136e0 con 0x7fd22c076060 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd231000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1139e0 con 0x7fd22c0772a0 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd22a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd22a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36896/0 (socket says 172.21.15.55:36896) 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.698+0000 7fd22a800640 1 -- 172.21.15.55:0/589894871 learned_addr learned my addr 172.21.15.55:0/589894871 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd229e00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 0x7fd22c19df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd223e00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 0x7fd22c19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 -- 172.21.15.55:0/589894871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 msgr2=0x7fd22c19e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:56.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 0x7fd22c19e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 -- 172.21.15.55:0/589894871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 msgr2=0x7fd22c19df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 0x7fd22c19df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 -- 172.21.15.55:0/589894871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c1a5b30 con 0x7fd22c077c40 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd223e00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 0x7fd22c19e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd22a800640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd22400eaa0 tx=0x7fd22400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400cdb0 con 0x7fd22c077c40 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd224005020 con 0x7fd22c077c40 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240116d0 con 0x7fd22c077c40 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.699+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1a5e20 con 0x7fd22c077c40 2024-03-28T05:42:56.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.700+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1a6330 con 0x7fd22c077c40 2024-03-28T05:42:56.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.701+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c110250 con 0x7fd22c077c40 2024-03-28T05:42:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.703+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd2240051d0 con 0x7fd22c077c40 2024-03-28T05:42:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.704+0000 7fd222a00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 0x7fd20c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.704+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2240ceb80 con 0x7fd22c077c40 2024-03-28T05:42:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.705+0000 7fd229e00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 0x7fd20c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.705+0000 7fd229e00640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 0x7fd20c0a4d40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009b60 tx=0x7fd21c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:56.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.711+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd224016030 con 0x7fd22c077c40 2024-03-28T05:42:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-28T05:42:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-28T05:42:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-28T05:42:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-28T05:42:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:56 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:42:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:56.956+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd22c062340 con 0x7fd22c077c40 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-28T05:42:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:56 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:42:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-28T05:42:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3191690364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-28T05:42:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-28T05:42:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-28T05:42:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-28T05:42:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:56 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:42:57.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.457+0000 7fd222a00640 1 -- 172.21.15.55:0/589894871 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd22409bcd0 con 0x7fd22c077c40 2024-03-28T05:42:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.461+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 msgr2=0x7fd20c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.461+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 0x7fd20c0a4d40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009b60 tx=0x7fd21c005f90 comp rx=0 tx=0).stop 2024-03-28T05:42:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.461+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 msgr2=0x7fd22c1a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.461+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd22400eaa0 tx=0x7fd22400ef60 comp rx=0 tx=0).stop 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 shutdown_connections 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd20c0a2880 0x7fd20c0a4d40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd22c077c40 0x7fd22c1a54c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd22c0772a0 0x7fd22c19e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 --2- 172.21.15.55:0/589894871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd22c076060 0x7fd22c19df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 >> 172.21.15.55:0/589894871 conn(0x7fd22c0fee50 msgr2=0x7fd22c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 shutdown_connections 2024-03-28T05:42:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.462+0000 7fd231000640 1 -- 172.21.15.55:0/589894871 wait complete. 2024-03-28T05:42:57.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 -- 172.21.15.55:0/3820426305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 msgr2=0x7f71000784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 --2- 172.21.15.55:0/3820426305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71000784e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009ca0 tx=0x7f70f802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 -- 172.21.15.55:0/3820426305 shutdown_connections 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 --2- 172.21.15.55:0/3820426305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71000784e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 --2- 172.21.15.55:0/3820426305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71000772a0 0x7f7100077700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 --2- 172.21.15.55:0/3820426305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7100076060 0x7f7100076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 -- 172.21.15.55:0/3820426305 >> 172.21.15.55:0/3820426305 conn(0x7f71000fee50 msgr2=0x7f7100101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:57.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 -- 172.21.15.55:0/3820426305 shutdown_connections 2024-03-28T05:42:57.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.706+0000 7f7104a00640 1 -- 172.21.15.55:0/3820426305 wait complete. 2024-03-28T05:42:57.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.707+0000 7f7104a00640 1 Processor -- start 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 -- start start 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100076060 0x7f710019def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71000772a0 0x7f710019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100113800 con 0x7f7100077c40 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100113680 con 0x7f71000772a0 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f7104a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100113980 con 0x7f7100076060 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f70fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f70fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36910/0 (socket says 172.21.15.55:36910) 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f70fe800640 1 -- 172.21.15.55:0/2577760103 learned_addr learned my addr 172.21.15.55:0/2577760103 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f70fde00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100076060 0x7f710019def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.708+0000 7f70fd400640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71000772a0 0x7f710019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 -- 172.21.15.55:0/2577760103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100076060 msgr2=0x7f710019def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100076060 0x7f710019def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 -- 172.21.15.55:0/2577760103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71000772a0 msgr2=0x7f710019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71000772a0 0x7f710019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 -- 172.21.15.55:0/2577760103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71001a5b10 con 0x7f7100077c40 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70fe800640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70f8032550 tx=0x7f70f8034880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8041020 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f70f8003e20 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001a5da0 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.709+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8039040 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.710+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71001a6280 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.711+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100110230 con 0x7f7100077c40 2024-03-28T05:42:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.713+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f70f8044020 con 0x7f7100077c40 2024-03-28T05:42:57.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.714+0000 7f70f6a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 0x7f70e40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:57.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.714+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70f80f0ca0 con 0x7f7100077c40 2024-03-28T05:42:57.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.715+0000 7f70fde00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 0x7f70e40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.715+0000 7f70fde00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 0x7f70e40a4d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005fd0 tx=0x7f70f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.718+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f70f804b020 con 0x7f7100077c40 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: pgmap v369: 97 pgs: 4 creating+activating, 17 creating+peering, 70 active+clean, 6 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:active 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-28T05:42:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-28T05:42:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:57 smithi055 ceph-mon[31863]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-28T05:42:57.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:57.975+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f71000622a0 con 0x7f7100077c40 2024-03-28T05:42:58.068 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:42:57.635+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-28T05:42:58.068 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:42:57.635+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: pgmap v369: 97 pgs: 4 creating+activating, 17 creating+peering, 70 active+clean, 6 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:active 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-28T05:42:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:42:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-28T05:42:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-28T05:42:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:57 smithi086 ceph-mon[35163]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-28T05:42:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: pgmap v369: 97 pgs: 4 creating+activating, 17 creating+peering, 70 active+clean, 6 unknown; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/589894871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] up:active 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-28T05:42:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:57 smithi159 ceph-mon[36109]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-28T05:42:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.796+0000 7f70f6a00640 1 -- 172.21.15.55:0/2577760103 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f70f80bddf0 con 0x7f7100077c40 2024-03-28T05:42:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 msgr2=0x7f70e40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 0x7f70e40a4d40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005fd0 tx=0x7f70f0005850 comp rx=0 tx=0).stop 2024-03-28T05:42:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 msgr2=0x7f71001a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70f8032550 tx=0x7f70f8034880 comp rx=0 tx=0).stop 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 shutdown_connections 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f70e40a2880 0x7f70e40a4d40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7100077c40 0x7f71001a54a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71000772a0 0x7f710019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 --2- 172.21.15.55:0/2577760103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100076060 0x7f710019def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.800+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 >> 172.21.15.55:0/2577760103 conn(0x7f71000fee50 msgr2=0x7f7100100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.801+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 shutdown_connections 2024-03-28T05:42:58.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:58.801+0000 7f7104a00640 1 -- 172.21.15.55:0/2577760103 wait complete. 2024-03-28T05:42:58.824 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-03-28T05:42:58.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-28T05:42:59.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 -- 172.21.15.55:0/2308146674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6401038c0 msgr2=0x7fe640103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 --2- 172.21.15.55:0/2308146674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6401038c0 0x7fe640103ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe638009900 tx=0x7fe63802bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 -- 172.21.15.55:0/2308146674 shutdown_connections 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 --2- 172.21.15.55:0/2308146674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 0x7fe64010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 --2- 172.21.15.55:0/2308146674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe640104ab0 0x7fe640104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 --2- 172.21.15.55:0/2308146674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6401038c0 0x7fe640103ce0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 -- 172.21.15.55:0/2308146674 >> 172.21.15.55:0/2308146674 conn(0x7fe6400fee50 msgr2=0x7fe640101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 -- 172.21.15.55:0/2308146674 shutdown_connections 2024-03-28T05:42:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.055+0000 7fe645e00640 1 -- 172.21.15.55:0/2308146674 wait complete. 2024-03-28T05:42:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.056+0000 7fe645e00640 1 Processor -- start 2024-03-28T05:42:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 -- start start 2024-03-28T05:42:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6401038c0 0x7fe640199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 0x7fe6401a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64010f440 con 0x7fe640104ab0 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64010f2c0 con 0x7fe6401038c0 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe645e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64010f5c0 con 0x7fe640105470 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe63e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe63e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60274/0 (socket says 172.21.15.55:60274) 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.057+0000 7fe63e000640 1 -- 172.21.15.55:0/2081997811 learned_addr learned my addr 172.21.15.55:0/2081997811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63ea00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6401038c0 0x7fe640199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63f400640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 0x7fe6401a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 -- 172.21.15.55:0/2081997811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 msgr2=0x7fe6401a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 0x7fe6401a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 -- 172.21.15.55:0/2081997811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6401038c0 msgr2=0x7fe640199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6401038c0 0x7fe640199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 -- 172.21.15.55:0/2081997811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6401a16f0 con 0x7fe640104ab0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe63e000640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe62800ea60 tx=0x7fe62800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.058+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800cde0 con 0x7fe640104ab0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.059+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe6280035f0 con 0x7fe640104ab0 2024-03-28T05:42:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.059+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6401a19e0 con 0x7fe640104ab0 2024-03-28T05:42:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.059+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628010690 con 0x7fe640104ab0 2024-03-28T05:42:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.059+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6401a1f30 con 0x7fe640104ab0 2024-03-28T05:42:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.060+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64010abe0 con 0x7fe640104ab0 2024-03-28T05:42:59.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.065+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fe6280037a0 con 0x7fe640104ab0 2024-03-28T05:42:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.067+0000 7fe644a00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 0x7fe6240a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.067+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe6280cef70 con 0x7fe640104ab0 2024-03-28T05:42:59.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.067+0000 7fe63ea00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 0x7fe6240a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:active 2024-03-28T05:42:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:42:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:58 smithi086 ceph-mon[35163]: pgmap v370: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 9 op/s 2024-03-28T05:42:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:58 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-28T05:42:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.068+0000 7fe63ea00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 0x7fe6240a4cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe63802c240 tx=0x7fe63802c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:59.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.068+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fe628053740 con 0x7fe640104ab0 2024-03-28T05:42:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:active 2024-03-28T05:42:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:42:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:58 smithi159 ceph-mon[36109]: pgmap v370: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 9 op/s 2024-03-28T05:42:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:58 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-28T05:42:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] up:active 2024-03-28T05:42:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:42:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:58 smithi055 ceph-mon[31863]: pgmap v370: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 9 op/s 2024-03-28T05:42:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:58 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-28T05:42:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.297+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fe640061ae0 con 0x7fe6240a2800 2024-03-28T05:42:59.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.353+0000 7fe644a00640 1 -- 172.21.15.55:0/2081997811 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe640061ae0 con 0x7fe6240a2800 2024-03-28T05:42:59.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 msgr2=0x7fe6240a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 0x7fe6240a4cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe63802c240 tx=0x7fe63802c7e0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 msgr2=0x7fe64019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe62800ea60 tx=0x7fe62800ef20 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 shutdown_connections 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe6240a2800 0x7fe6240a4cc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe640105470 0x7fe6401a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe640104ab0 0x7fe64019a0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 --2- 172.21.15.55:0/2081997811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6401038c0 0x7fe640199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 >> 172.21.15.55:0/2081997811 conn(0x7fe6400fee50 msgr2=0x7fe640107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:59.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 shutdown_connections 2024-03-28T05:42:59.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.357+0000 7fe645e00640 1 -- 172.21.15.55:0/2081997811 wait complete. 2024-03-28T05:42:59.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 -- 172.21.15.55:0/623383542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc10db70 msgr2=0x7fa3cc10ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/623383542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc10db70 0x7fa3cc10ff60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009930 tx=0x7fa3c402bc30 comp rx=0 tx=0).stop 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 -- 172.21.15.55:0/623383542 shutdown_connections 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/623383542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc10db70 0x7fa3cc10ff60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/623383542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc074100 0x7fa3cc074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/623383542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 -- 172.21.15.55:0/623383542 >> 172.21.15.55:0/623383542 conn(0x7fa3cc0fcb10 msgr2=0x7fa3cc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.593+0000 7fa3cbe00640 1 -- 172.21.15.55:0/623383542 shutdown_connections 2024-03-28T05:42:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.594+0000 7fa3cbe00640 1 -- 172.21.15.55:0/623383542 wait complete. 2024-03-28T05:42:59.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.594+0000 7fa3cbe00640 1 Processor -- start 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 -- start start 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 0x7fa3cc19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc10db70 0x7fa3cc1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc113710 con 0x7fa3cc074100 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc113590 con 0x7fa3cc0756e0 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3cbe00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc113890 con 0x7fa3cc10db70 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3caa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 0x7fa3cc19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3ca000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3caa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 0x7fa3cc19dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60318/0 (socket says 172.21.15.55:60318) 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.595+0000 7fa3caa00640 1 -- 172.21.15.55:0/2751188206 learned_addr learned my addr 172.21.15.55:0/2751188206 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3cb400640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc10db70 0x7fa3cc1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 -- 172.21.15.55:0/2751188206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc10db70 msgr2=0x7fa3cc1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc10db70 0x7fa3cc1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 -- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 msgr2=0x7fa3cc19dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 0x7fa3cc19dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 -- 172.21.15.55:0/2751188206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc1a5a00 con 0x7fa3cc0756e0 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3ca000640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc19e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d720 tx=0x7fa3b400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4017070 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa3b400de30 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40047a0 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.596+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc1a5cf0 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.597+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc1a6190 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.598+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc103d40 con 0x7fa3cc0756e0 2024-03-28T05:42:59.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.600+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa3b40099d0 con 0x7fa3cc0756e0 2024-03-28T05:42:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.601+0000 7fa3c3400640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 0x7fa3b00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:42:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.601+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3b40ce5f0 con 0x7fa3cc0756e0 2024-03-28T05:42:59.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.601+0000 7fa3caa00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 0x7fa3b00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:42:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.602+0000 7fa3caa00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 0x7fa3b00a4d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0099a0 tx=0x7fa3bc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:42:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.611+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa3b4020020 con 0x7fa3cc0756e0 2024-03-28T05:42:59.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:42:59.309+0000 7ff74e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-28T05:42:59.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:42:59.309+0000 7ff74e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-28T05:42:59.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:42:59.309+0000 7ff74e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-28T05:42:59.623 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:42:59.309+0000 7ff74e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-28T05:42:59.624 INFO:journalctl@ceph.mgr.x.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mgr-x[32101]: 2024-03-28T05:42:59.309+0000 7ff74e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-28T05:42:59.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.850+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3cc061b70 con 0x7fa3b00a2880 2024-03-28T05:42:59.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.905+0000 7fa3c3400640 1 -- 172.21.15.55:0/2751188206 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa3cc061b70 con 0x7fa3b00a2880 2024-03-28T05:42:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 msgr2=0x7fa3b00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 0x7fa3b00a4d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0099a0 tx=0x7fa3bc009500 comp rx=0 tx=0).stop 2024-03-28T05:42:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 msgr2=0x7fa3cc19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:42:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc19e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d720 tx=0x7fa3b400dbe0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 shutdown_connections 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa3b00a2880 0x7fa3b00a4d40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3cc10db70 0x7fa3cc1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3cc0756e0 0x7fa3cc19e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 --2- 172.21.15.55:0/2751188206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3cc074100 0x7fa3cc19dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 >> 172.21.15.55:0/2751188206 conn(0x7fa3cc0fcb10 msgr2=0x7fa3cc100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 shutdown_connections 2024-03-28T05:42:59.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:42:59.908+0000 7fa3cbe00640 1 -- 172.21.15.55:0/2751188206 wait complete. 2024-03-28T05:42:59.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-28T05:43:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:59 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-28T05:43:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:59 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:43:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:42:59 smithi086 ceph-mon[35163]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:59 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-28T05:43:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:59 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:43:00.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:42:59 smithi159 ceph-mon[36109]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2577760103' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-28T05:43:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:43:00.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:42:59 smithi055 ceph-mon[31863]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.151+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3888719733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 msgr2=0x7f1ef0110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.151+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3888719733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef0110070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009930 tx=0x7f1ee802bc30 comp rx=0 tx=0).stop 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3888719733 shutdown_connections 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3888719733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef0110070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3888719733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 0x7f1ef0074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3888719733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 0x7f1ef0073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3888719733 >> 172.21.15.55:0/3888719733 conn(0x7f1ef00fcc40 msgr2=0x7f1ef00ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3888719733 shutdown_connections 2024-03-28T05:43:00.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.152+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3888719733 wait complete. 2024-03-28T05:43:00.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.153+0000 7f1ef7e00640 1 Processor -- start 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.153+0000 7f1ef7e00640 1 -- start start 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 0x7f1ef019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 0x7f1ef019e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0113820 con 0x7f1ef010dc80 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01136a0 con 0x7f1ef00756e0 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01139a0 con 0x7f1ef0074100 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60344/0 (socket says 172.21.15.55:60344) 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 0x7f1ef019e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef5e00640 1 -- 172.21.15.55:0/3642824840 learned_addr learned my addr 172.21.15.55:0/3642824840 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.154+0000 7f1ef5400640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 0x7f1ef019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 -- 172.21.15.55:0/3642824840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 msgr2=0x7f1ef019ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 0x7f1ef019ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 -- 172.21.15.55:0/3642824840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 msgr2=0x7f1ef019e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 0x7f1ef019e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 -- 172.21.15.55:0/3642824840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef01a5af0 con 0x7f1ef010dc80 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef5e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8036040 tx=0x7f1ee8005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8043020 con 0x7f1ef010dc80 2024-03-28T05:43:00.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1ee8004410 con 0x7f1ef010dc80 2024-03-28T05:43:00.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8003b50 con 0x7f1ef010dc80 2024-03-28T05:43:00.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.155+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef01a5d80 con 0x7f1ef010dc80 2024-03-28T05:43:00.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.156+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef01a6220 con 0x7f1ef010dc80 2024-03-28T05:43:00.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.157+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef0103e50 con 0x7f1ef010dc80 2024-03-28T05:43:00.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.160+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f1ee8046020 con 0x7f1ef010dc80 2024-03-28T05:43:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.162+0000 7f1eee000640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 0x7f1ed40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.162+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1ee80f0a50 con 0x7f1ef010dc80 2024-03-28T05:43:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.162+0000 7f1ef5400640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 0x7f1ed40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.163+0000 7f1ef5400640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 0x7f1ed40a4d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0005fd0 tx=0x7f1ee0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.167+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f1ee804d020 con 0x7f1ef010dc80 2024-03-28T05:43:00.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.401+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ef0061b70 con 0x7f1ed40a2880 2024-03-28T05:43:00.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.417+0000 7f1eee000640 1 -- 172.21.15.55:0/3642824840 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f1ef0061b70 con 0x7f1ed40a2880 2024-03-28T05:43:00.419 INFO:teuthology.orchestra.run.smithi055.stdout:/volumes/qa/sv_0/e7fce19b-124f-4268-836a-e7c30d9424d8 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 msgr2=0x7f1ed40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 0x7f1ed40a4d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0005fd0 tx=0x7f1ee0009500 comp rx=0 tx=0).stop 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 msgr2=0x7f1ef01a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8036040 tx=0x7f1ee8005dd0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 shutdown_connections 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1ed40a2880 0x7f1ed40a4d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ef010dc80 0x7f1ef01a5480 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef00756e0 0x7f1ef019e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 --2- 172.21.15.55:0/3642824840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ef0074100 0x7f1ef019ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.420+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 >> 172.21.15.55:0/3642824840 conn(0x7f1ef00fcc40 msgr2=0x7f1ef0101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.421+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 shutdown_connections 2024-03-28T05:43:00.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.421+0000 7f1ef7e00640 1 -- 172.21.15.55:0/3642824840 wait complete. 2024-03-28T05:43:00.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-28T05:43:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 -- 172.21.15.55:0/2607364188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 msgr2=0x7f04e41019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 --2- 172.21.15.55:0/2607364188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41019a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009900 tx=0x7f04d402bc30 comp rx=0 tx=0).stop 2024-03-28T05:43:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 -- 172.21.15.55:0/2607364188 shutdown_connections 2024-03-28T05:43:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 --2- 172.21.15.55:0/2607364188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 0x7f04e41099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 --2- 172.21.15.55:0/2607364188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 --2- 172.21.15.55:0/2607364188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41019a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 -- 172.21.15.55:0/2607364188 >> 172.21.15.55:0/2607364188 conn(0x7f04e40fcb10 msgr2=0x7f04e40fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 -- 172.21.15.55:0/2607364188 shutdown_connections 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.665+0000 7f04e8e00640 1 -- 172.21.15.55:0/2607364188 wait complete. 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 Processor -- start 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 -- start start 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 0x7f04e41a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e410d0f0 con 0x7f04e4101580 2024-03-28T05:43:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e410cf70 con 0x7f04e4102770 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.666+0000 7f04e8e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e410d270 con 0x7f04e4103130 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60356/0 (socket says 172.21.15.55:60356) 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 -- 172.21.15.55:0/1808869595 learned_addr learned my addr 172.21.15.55:0/1808869595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e2a00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 0x7f04e41a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 -- 172.21.15.55:0/1808869595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 msgr2=0x7f04e41a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 0x7f04e41a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 -- 172.21.15.55:0/1808869595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 msgr2=0x7f04e4199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e3400640 1 -- 172.21.15.55:0/1808869595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e41a1600 con 0x7f04e4101580 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.667+0000 7f04e2a00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04e3400640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d4000c00 tx=0x7f04d40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4043020 con 0x7f04e4101580 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f04d40044c0 con 0x7f04e4101580 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e41a1890 con 0x7f04e4101580 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4003c60 con 0x7f04e4101580 2024-03-28T05:43:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.668+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e41a1e30 con 0x7f04e4101580 2024-03-28T05:43:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.669+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e4068800 con 0x7f04e4101580 2024-03-28T05:43:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.671+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f04d4046020 con 0x7f04e4101580 2024-03-28T05:43:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.672+0000 7f04dbe00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 0x7f04c80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.673+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f04d40f0c60 con 0x7f04e4101580 2024-03-28T05:43:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.673+0000 7f04e2a00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 0x7f04c80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.673+0000 7f04e2a00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 0x7f04c80a4d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04e419aef0 tx=0x7f04d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.678+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f04d404d020 con 0x7f04e4101580 2024-03-28T05:43:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.832+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f04d40b9d20 con 0x7f04e4101580 2024-03-28T05:43:00.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.933+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f04e4074ff0 con 0x7f04c80a2880 2024-03-28T05:43:00.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.990+0000 7f04dbe00640 1 -- 172.21.15.55:0/1808869595 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f04e4074ff0 con 0x7f04c80a2880 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 msgr2=0x7f04c80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 0x7f04c80a4d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04e419aef0 tx=0x7f04d0005f90 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 msgr2=0x7f04e41999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d4000c00 tx=0x7f04d40040c0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 shutdown_connections 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f04c80a2880 0x7f04c80a4d40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04e4103130 0x7f04e41a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e4102770 0x7f04e4199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 --2- 172.21.15.55:0/1808869595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04e4101580 0x7f04e41999e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.993+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 >> 172.21.15.55:0/1808869595 conn(0x7f04e40fcb10 msgr2=0x7f04e40738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:00.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.994+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 shutdown_connections 2024-03-28T05:43:00.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:00.994+0000 7f04e8e00640 1 -- 172.21.15.55:0/1808869595 wait complete. 2024-03-28T05:43:01.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-28T05:43:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:00 smithi086 ceph-mon[35163]: pgmap v371: 97 pgs: 97 active+clean; 580 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-03-28T05:43:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:00 smithi086 ceph-mon[35163]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:00 smithi086 ceph-mon[35163]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:00 smithi159 ceph-mon[36109]: pgmap v371: 97 pgs: 97 active+clean; 580 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-03-28T05:43:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:00 smithi159 ceph-mon[36109]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:00 smithi159 ceph-mon[36109]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.097 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:00 smithi055 ceph-mon[31863]: pgmap v371: 97 pgs: 97 active+clean; 580 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 13 op/s 2024-03-28T05:43:01.097 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:00 smithi055 ceph-mon[31863]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.097 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:00 smithi055 ceph-mon[31863]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 -- 172.21.15.55:0/3574695712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc102880 msgr2=0x7f8adc104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3574695712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc102880 0x7f8adc104cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009900 tx=0x7f8ac402bc30 comp rx=0 tx=0).stop 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 -- 172.21.15.55:0/3574695712 shutdown_connections 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3574695712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc105230 0x7f8adc1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3574695712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc102880 0x7f8adc104cf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3574695712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 0x7f8adc102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.242+0000 7f8ae2800640 1 -- 172.21.15.55:0/3574695712 >> 172.21.15.55:0/3574695712 conn(0x7f8adc0fbb30 msgr2=0x7f8adc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.243+0000 7f8ae2800640 1 -- 172.21.15.55:0/3574695712 shutdown_connections 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.243+0000 7f8ae2800640 1 -- 172.21.15.55:0/3574695712 wait complete. 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 Processor -- start 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 -- start start 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 0x7f8adc19df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 0x7f8adc1a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc113810 con 0x7f8adc105230 2024-03-28T05:43:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc113690 con 0x7f8adc102880 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8ae2800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc113990 con 0x7f8adc0fff10 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8adbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 0x7f8adc1a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8adaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.244+0000 7f8adaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:33908/0 (socket says 172.21.15.55:33908) 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 -- 172.21.15.55:0/3658781843 learned_addr learned my addr 172.21.15.55:0/3658781843 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adb400640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 0x7f8adc19df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 -- 172.21.15.55:0/3658781843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 msgr2=0x7f8adc19df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 0x7f8adc19df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 -- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 msgr2=0x7f8adc1a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 0x7f8adc1a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 -- 172.21.15.55:0/3658781843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc1a5b30 con 0x7f8adc102880 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adbe00640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 0x7f8adc1a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.245+0000 7f8adaa00640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.246+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4043020 con 0x7f8adc102880 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.246+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc1a5dc0 con 0x7f8adc102880 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.246+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ac4004aa0 con 0x7f8adc102880 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.246+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003d00 con 0x7f8adc102880 2024-03-28T05:43:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.246+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc1a6290 con 0x7f8adc102880 2024-03-28T05:43:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.247+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc0fd620 con 0x7f8adc102880 2024-03-28T05:43:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.249+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f8ac4046020 con 0x7f8adc102880 2024-03-28T05:43:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.251+0000 7f8ad3e00640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 0x7f8ac00a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.251+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ac40f0fa0 con 0x7f8adc102880 2024-03-28T05:43:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.251+0000 7f8adb400640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 0x7f8ac00a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.252+0000 7f8adb400640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 0x7f8ac00a4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005fd0 tx=0x7f8acc009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:01.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.261+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8ac404d020 con 0x7f8adc102880 2024-03-28T05:43:01.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.491+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8adc061b70 con 0x7f8ac00a2910 2024-03-28T05:43:01.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.509+0000 7f8ad3e00640 1 -- 172.21.15.55:0/3658781843 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f8adc061b70 con 0x7f8ac00a2910 2024-03-28T05:43:01.510 INFO:teuthology.orchestra.run.smithi055.stdout:/volumes/qa/sv_1/f405d2a4-cb80-4226-8ce8-7f6e6ca8313c 2024-03-28T05:43:01.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 msgr2=0x7f8ac00a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 0x7f8ac00a4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005fd0 tx=0x7f8acc009680 comp rx=0 tx=0).stop 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 msgr2=0x7f8adc19e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac40042f0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 shutdown_connections 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8ac00a2910 0x7f8ac00a4dd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8adc105230 0x7f8adc1a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8adc102880 0x7f8adc19e450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 --2- 172.21.15.55:0/3658781843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8adc0fff10 0x7f8adc19df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 >> 172.21.15.55:0/3658781843 conn(0x7f8adc0fbb30 msgr2=0x7f8adc100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:01.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 shutdown_connections 2024-03-28T05:43:01.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.512+0000 7f8ae2800640 1 -- 172.21.15.55:0/3658781843 wait complete. 2024-03-28T05:43:01.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:43:01.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 -- 172.21.15.55:0/3164886548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c107b00 msgr2=0x7f6f0c107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 --2- 172.21.15.55:0/3164886548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c107b00 0x7f6f0c107f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009900 tx=0x7f6f0002bc30 comp rx=0 tx=0).stop 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 -- 172.21.15.55:0/3164886548 shutdown_connections 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 --2- 172.21.15.55:0/3164886548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 0x7f6f0c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 --2- 172.21.15.55:0/3164886548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 --2- 172.21.15.55:0/3164886548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c107b00 0x7f6f0c107f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 -- 172.21.15.55:0/3164886548 >> 172.21.15.55:0/3164886548 conn(0x7f6f0c076ab0 msgr2=0x7f6f0c078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 -- 172.21.15.55:0/3164886548 shutdown_connections 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.748+0000 7f6f13200640 1 -- 172.21.15.55:0/3164886548 wait complete. 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 Processor -- start 2024-03-28T05:43:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 -- start start 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c107b00 0x7f6f0c19dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 0x7f6f0c1a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c113670 con 0x7f6f0c108cf0 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c1134f0 con 0x7f6f0c1096b0 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f13200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c1137f0 con 0x7f6f0c107b00 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.749+0000 7f6f11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60382/0 (socket says 172.21.15.55:60382) 2024-03-28T05:43:01.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 -- 172.21.15.55:0/3699215265 learned_addr learned my addr 172.21.15.55:0/3699215265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11e00640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c107b00 0x7f6f0c19dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f12800640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 0x7f6f0c1a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 -- 172.21.15.55:0/3699215265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c107b00 msgr2=0x7f6f0c19dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c107b00 0x7f6f0c19dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 -- 172.21.15.55:0/3699215265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 msgr2=0x7f6f0c1a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 0x7f6f0c1a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 -- 172.21.15.55:0/3699215265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c1a58f0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f11400640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00d770 tx=0x7f6efc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.750+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc017070 con 0x7f6f0c108cf0 2024-03-28T05:43:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.751+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6efc0054d0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.751+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc004cf0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.751+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c1a5be0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.751+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c1a60b0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.753+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c10ee20 con 0x7f6f0c108cf0 2024-03-28T05:43:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.755+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f6efc004e90 con 0x7f6f0c108cf0 2024-03-28T05:43:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.756+0000 7f6f06a00640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 0x7f6ef40a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.757+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6efc0ce5d0 con 0x7f6f0c108cf0 2024-03-28T05:43:01.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.757+0000 7f6f11e00640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 0x7f6ef40a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:01.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.757+0000 7f6f11e00640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 0x7f6ef40a4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f0002c240 tx=0x7f6f00005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:01.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:01.761+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f6efc09b5c0 con 0x7f6f0c108cf0 2024-03-28T05:43:02.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.009+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f0c02d2c0 con 0x7f6f0c108cf0 2024-03-28T05:43:02.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.010+0000 7f6f06a00640 1 -- 172.21.15.55:0/3699215265 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f6efc09aec0 con 0x7f6f0c108cf0 2024-03-28T05:43:02.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:02.011 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:43:02.011 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 msgr2=0x7f6ef40a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 0x7f6ef40a4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f0002c240 tx=0x7f6f00005fd0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 msgr2=0x7f6f0c19e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00d770 tx=0x7f6efc00dc30 comp rx=0 tx=0).stop 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 shutdown_connections 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6ef40a2910 0x7f6ef40a4dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f0c1096b0 0x7f6f0c1a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0c108cf0 0x7f6f0c19e1f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 --2- 172.21.15.55:0/3699215265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f0c107b00 0x7f6f0c19dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 >> 172.21.15.55:0/3699215265 conn(0x7f6f0c076ab0 msgr2=0x7f6f0c10bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 shutdown_connections 2024-03-28T05:43:02.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.013+0000 7f6f13200640 1 -- 172.21.15.55:0/3699215265 wait complete. 2024-03-28T05:43:02.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:43:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:01 smithi086 ceph-mon[35163]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-28T05:43:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:01 smithi086 ceph-mon[35163]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:01 smithi086 ceph-mon[35163]: from='client.34637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:01 smithi159 ceph-mon[36109]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-28T05:43:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:01 smithi159 ceph-mon[36109]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:01 smithi159 ceph-mon[36109]: from='client.34637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:01 smithi055 ceph-mon[31863]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-28T05:43:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:01 smithi055 ceph-mon[31863]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:01 smithi055 ceph-mon[31863]: from='client.34637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:43:02.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.252+0000 7f4456e00640 1 -- 172.21.15.55:0/2503537719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 msgr2=0x7f4450105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.252+0000 7f4456e00640 1 --2- 172.21.15.55:0/2503537719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f4450105500 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4448009ca0 tx=0x7f444802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 -- 172.21.15.55:0/2503537719 shutdown_connections 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 --2- 172.21.15.55:0/2503537719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f4450105500 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 --2- 172.21.15.55:0/2503537719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44501026d0 0x7f4450104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 --2- 172.21.15.55:0/2503537719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44500ffd60 0x7f4450102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 -- 172.21.15.55:0/2503537719 >> 172.21.15.55:0/2503537719 conn(0x7f44500fb980 msgr2=0x7f44500fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 -- 172.21.15.55:0/2503537719 shutdown_connections 2024-03-28T05:43:02.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.253+0000 7f4456e00640 1 -- 172.21.15.55:0/2503537719 wait complete. 2024-03-28T05:43:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 Processor -- start 2024-03-28T05:43:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 -- start start 2024-03-28T05:43:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44500ffd60 0x7f445019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 0x7f445019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501135f0 con 0x7f4450105080 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450113470 con 0x7f44501026d0 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450113770 con 0x7f44500ffd60 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60396/0 (socket says 172.21.15.55:60396) 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.254+0000 7f4456400640 1 -- 172.21.15.55:0/459430621 learned_addr learned my addr 172.21.15.55:0/459430621 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4455a00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44500ffd60 0x7f445019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4455000640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 0x7f445019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 -- 172.21.15.55:0/459430621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44500ffd60 msgr2=0x7f445019dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44500ffd60 0x7f445019dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 -- 172.21.15.55:0/459430621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 msgr2=0x7f445019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 0x7f445019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 -- 172.21.15.55:0/459430621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44501a58e0 con 0x7f4450105080 2024-03-28T05:43:02.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4455000640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 0x7f445019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456400640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4448032380 tx=0x7f4448032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448041020 con 0x7f4450105080 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4448003e20 con 0x7f4450105080 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448039040 con 0x7f4450105080 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.255+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44501a5b70 con 0x7f4450105080 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.256+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44501a6010 con 0x7f4450105080 2024-03-28T05:43:02.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.257+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44500fd470 con 0x7f4450105080 2024-03-28T05:43:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.258+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f4448044020 con 0x7f4450105080 2024-03-28T05:43:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.260+0000 7f444e000640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 0x7f44380a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.260+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f44480f0c10 con 0x7f4450105080 2024-03-28T05:43:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.260+0000 7f4455a00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 0x7f44380a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.261+0000 7f4455a00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 0x7f44380a4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f445019eb70 tx=0x7f4440005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:02.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.264+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f444804b020 con 0x7f4450105080 2024-03-28T05:43:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.461+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445002d290 con 0x7f4450105080 2024-03-28T05:43:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.464+0000 7f444e000640 1 -- 172.21.15.55:0/459430621 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+22170 (secure 0 0 0) 0x7f444803b2f0 con 0x7f4450105080 2024-03-28T05:43:02.465 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:02.466 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:42:53.691653+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 msgr2=0x7f44380a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 0x7f44380a4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f445019eb70 tx=0x7f4440005f90 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 msgr2=0x7f44501a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4448032380 tx=0x7f4448032820 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 shutdown_connections 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44380a2910 0x7f44380a4dd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4450105080 0x7f44501a5240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44501026d0 0x7f445019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 --2- 172.21.15.55:0/459430621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44500ffd60 0x7f445019dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 >> 172.21.15.55:0/459430621 conn(0x7f44500fb980 msgr2=0x7f44501007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 shutdown_connections 2024-03-28T05:43:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.467+0000 7f4456e00640 1 -- 172.21.15.55:0/459430621 wait complete. 2024-03-28T05:43:02.486 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-28T05:43:02.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 -- 172.21.15.55:0/1882047729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841048e0 msgr2=0x7f8984104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 --2- 172.21.15.55:0/1882047729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841048e0 0x7f8984104d60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8970009860 tx=0x7f897002bb70 comp rx=0 tx=0).stop 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 -- 172.21.15.55:0/1882047729 shutdown_connections 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 --2- 172.21.15.55:0/1882047729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841052a0 0x7f898410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 --2- 172.21.15.55:0/1882047729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841048e0 0x7f8984104d60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 --2- 172.21.15.55:0/1882047729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 0x7f8984103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 -- 172.21.15.55:0/1882047729 >> 172.21.15.55:0/1882047729 conn(0x7f89840fec80 msgr2=0x7f89841010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:02.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 -- 172.21.15.55:0/1882047729 shutdown_connections 2024-03-28T05:43:02.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.694+0000 7f8983200640 1 -- 172.21.15.55:0/1882047729 wait complete. 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.695+0000 7f8983200640 1 Processor -- start 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.695+0000 7f8983200640 1 -- start start 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 0x7f8984199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841048e0 0x7f8984199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898410f220 con 0x7f89841052a0 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898410f0a0 con 0x7f89841048e0 2024-03-28T05:43:02.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8983200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898410f3a0 con 0x7f89841036f0 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60412/0 (socket says 172.21.15.55:60412) 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 -- 172.21.15.55:0/2841970742 learned_addr learned my addr 172.21.15.55:0/2841970742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8981400640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841048e0 0x7f8984199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8981e00640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 0x7f8984199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 -- 172.21.15.55:0/2841970742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 msgr2=0x7f8984199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 0x7f8984199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 -- 172.21.15.55:0/2841970742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841048e0 msgr2=0x7f8984199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841048e0 0x7f8984199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.696+0000 7f8982800640 1 -- 172.21.15.55:0/2841970742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89841a1520 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f8982800640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f897c009fd0 tx=0x7f897c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c004b20 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f897c003e20 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c004820 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89841a1810 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.697+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89841a1ce0 con 0x7f89841052a0 2024-03-28T05:43:02.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.698+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898410aa30 con 0x7f89841052a0 2024-03-28T05:43:02.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.700+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f897c01d020 con 0x7f89841052a0 2024-03-28T05:43:02.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.702+0000 7f897aa00640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 0x7f89680a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:02.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.702+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f897c0ceb00 con 0x7f89841052a0 2024-03-28T05:43:02.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.702+0000 7f8981e00640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 0x7f89680a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:02.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.703+0000 7f8981e00640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 0x7f89680a4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8984104740 tx=0x7f8974005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:02.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.706+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f897c01d310 con 0x7f89841052a0 2024-03-28T05:43:02.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.913+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8984061ae0 con 0x7f89680a2910 2024-03-28T05:43:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.940+0000 7f897aa00640 1 -- 172.21.15.55:0/2841970742 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258798 (secure 0 0 0) 0x7f8984061ae0 con 0x7f89680a2910 2024-03-28T05:43:02.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 msgr2=0x7f89680a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 0x7f89680a4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8984104740 tx=0x7f8974005f90 comp rx=0 tx=0).stop 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 msgr2=0x7f89841a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f897c009fd0 tx=0x7f897c00c800 comp rx=0 tx=0).stop 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 shutdown_connections 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89680a2910 0x7f89680a4dd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89841052a0 0x7f89841a0eb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89841048e0 0x7f8984199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 --2- 172.21.15.55:0/2841970742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89841036f0 0x7f8984199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 >> 172.21.15.55:0/2841970742 conn(0x7f89840fec80 msgr2=0x7f8984107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 shutdown_connections 2024-03-28T05:43:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:02.946+0000 7f8983200640 1 -- 172.21.15.55:0/2841970742 wait complete. 2024-03-28T05:43:02.968 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-03-28T05:43:01.819760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595981,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":152,"num_read_kb":131,"num_write":306,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387484,"kb_used_data":13368,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554340,"statfs":{"total":1151940427776,"available":1151543644160,"internally_reserved":0,"allocated":13688832,"data_stored":7387147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5613,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":125,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.143819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900872+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:42:54.900872+0000","last_peered":"2024-03-28T05:42:54.900872+0000","last_clean":"2024-03-28T05:42:54.900872+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:42:54.900872+0000","last_undegraded":"2024-03-28T05:42:54.900872+0000","last_fullsized":"2024-03-28T05:42:54.900872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283834+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:42:54.283834+0000","last_peered":"2024-03-28T05:42:54.283834+0000","last_clean":"2024-03-28T05:42:54.283834+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:42:54.283834+0000","last_undegraded":"2024-03-28T05:42:54.283834+0000","last_fullsized":"2024-03-28T05:42:54.283834+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283671+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:42:54.283671+0000","last_peered":"2024-03-28T05:42:54.283671+0000","last_clean":"2024-03-28T05:42:54.283671+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:42:54.283671+0000","last_undegraded":"2024-03-28T05:42:54.283671+0000","last_fullsized":"2024-03-28T05:42:54.283671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656070+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:42:54.656070+0000","last_peered":"2024-03-28T05:42:54.656070+0000","last_clean":"2024-03-28T05:42:54.656070+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:42:54.656070+0000","last_undegraded":"2024-03-28T05:42:54.656070+0000","last_fullsized":"2024-03-28T05:42:54.656070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082922+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:42:54.082922+0000","last_peered":"2024-03-28T05:42:54.082922+0000","last_clean":"2024-03-28T05:42:54.082922+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:42:54.082922+0000","last_undegraded":"2024-03-28T05:42:54.082922+0000","last_fullsized":"2024-03-28T05:42:54.082922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656713+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:42:54.656713+0000","last_peered":"2024-03-28T05:42:54.656713+0000","last_clean":"2024-03-28T05:42:54.656713+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:42:54.656713+0000","last_undegraded":"2024-03-28T05:42:54.656713+0000","last_fullsized":"2024-03-28T05:42:54.656713+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701838+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:42:53.701838+0000","last_peered":"2024-03-28T05:42:53.701838+0000","last_clean":"2024-03-28T05:42:53.701838+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:42:53.701838+0000","last_undegraded":"2024-03-28T05:42:53.701838+0000","last_fullsized":"2024-03-28T05:42:53.701838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081479+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:42:54.081479+0000","last_peered":"2024-03-28T05:42:54.081479+0000","last_clean":"2024-03-28T05:42:54.081479+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:42:54.081479+0000","last_undegraded":"2024-03-28T05:42:54.081479+0000","last_fullsized":"2024-03-28T05:42:54.081479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657196+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:42:54.657196+0000","last_peered":"2024-03-28T05:42:54.657196+0000","last_clean":"2024-03-28T05:42:54.657196+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:42:54.657196+0000","last_undegraded":"2024-03-28T05:42:54.657196+0000","last_fullsized":"2024-03-28T05:42:54.657196+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657350+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:42:54.657350+0000","last_peered":"2024-03-28T05:42:54.657350+0000","last_clean":"2024-03-28T05:42:54.657350+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:42:54.657350+0000","last_undegraded":"2024-03-28T05:42:54.657350+0000","last_fullsized":"2024-03-28T05:42:54.657350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702996+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:42:53.702996+0000","last_peered":"2024-03-28T05:42:53.702996+0000","last_clean":"2024-03-28T05:42:53.702996+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:42:53.702996+0000","last_undegraded":"2024-03-28T05:42:53.702996+0000","last_fullsized":"2024-03-28T05:42:53.702996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655898+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:42:54.655898+0000","last_peered":"2024-03-28T05:42:54.655898+0000","last_clean":"2024-03-28T05:42:54.655898+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:42:54.655898+0000","last_undegraded":"2024-03-28T05:42:54.655898+0000","last_fullsized":"2024-03-28T05:42:54.655898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700277+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:42:53.700277+0000","last_peered":"2024-03-28T05:42:53.700277+0000","last_clean":"2024-03-28T05:42:53.700277+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:42:53.700277+0000","last_undegraded":"2024-03-28T05:42:53.700277+0000","last_fullsized":"2024-03-28T05:42:53.700277+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.282670+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:42:54.282670+0000","last_peered":"2024-03-28T05:42:54.282670+0000","last_clean":"2024-03-28T05:42:54.282670+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:42:54.282670+0000","last_undegraded":"2024-03-28T05:42:54.282670+0000","last_fullsized":"2024-03-28T05:42:54.282670+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.282782+0000","last_change":"2024-03-28T05:42:52.710997+0000","last_active":"2024-03-28T05:42:54.282782+0000","last_peered":"2024-03-28T05:42:54.282782+0000","last_clean":"2024-03-28T05:42:54.282782+0000","last_became_active":"2024-03-28T05:42:52.710638+0000","last_became_peered":"2024-03-28T05:42:52.710638+0000","last_unstale":"2024-03-28T05:42:54.282782+0000","last_undegraded":"2024-03-28T05:42:54.282782+0000","last_fullsized":"2024-03-28T05:42:54.282782+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:54:01.612358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655220+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:42:54.655220+0000","last_peered":"2024-03-28T05:42:54.655220+0000","last_clean":"2024-03-28T05:42:54.655220+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:42:54.655220+0000","last_undegraded":"2024-03-28T05:42:54.655220+0000","last_fullsized":"2024-03-28T05:42:54.655220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900959+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:42:54.900959+0000","last_peered":"2024-03-28T05:42:54.900959+0000","last_clean":"2024-03-28T05:42:54.900959+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:42:54.900959+0000","last_undegraded":"2024-03-28T05:42:54.900959+0000","last_fullsized":"2024-03-28T05:42:54.900959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.078017+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:42:54.078017+0000","last_peered":"2024-03-28T05:42:54.078017+0000","last_clean":"2024-03-28T05:42:54.078017+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:42:54.078017+0000","last_undegraded":"2024-03-28T05:42:54.078017+0000","last_fullsized":"2024-03-28T05:42:54.078017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656855+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:42:54.656855+0000","last_peered":"2024-03-28T05:42:54.656855+0000","last_clean":"2024-03-28T05:42:54.656855+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:42:54.656855+0000","last_undegraded":"2024-03-28T05:42:54.656855+0000","last_fullsized":"2024-03-28T05:42:54.656855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.495525+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:42:57.495525+0000","last_peered":"2024-03-28T05:42:57.495525+0000","last_clean":"2024-03-28T05:42:57.495525+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:42:57.495525+0000","last_undegraded":"2024-03-28T05:42:57.495525+0000","last_fullsized":"2024-03-28T05:42:57.495525+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081859+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:42:54.081859+0000","last_peered":"2024-03-28T05:42:54.081859+0000","last_clean":"2024-03-28T05:42:54.081859+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:42:54.081859+0000","last_undegraded":"2024-03-28T05:42:54.081859+0000","last_fullsized":"2024-03-28T05:42:54.081859+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082156+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:42:54.082156+0000","last_peered":"2024-03-28T05:42:54.082156+0000","last_clean":"2024-03-28T05:42:54.082156+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:42:54.082156+0000","last_undegraded":"2024-03-28T05:42:54.082156+0000","last_fullsized":"2024-03-28T05:42:54.082156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.284071+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:42:54.284071+0000","last_peered":"2024-03-28T05:42:54.284071+0000","last_clean":"2024-03-28T05:42:54.284071+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:42:54.284071+0000","last_undegraded":"2024-03-28T05:42:54.284071+0000","last_fullsized":"2024-03-28T05:42:54.284071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491583+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:42:57.491583+0000","last_peered":"2024-03-28T05:42:57.491583+0000","last_clean":"2024-03-28T05:42:57.491583+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:42:57.491583+0000","last_undegraded":"2024-03-28T05:42:57.491583+0000","last_fullsized":"2024-03-28T05:42:57.491583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656138+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:42:54.656138+0000","last_peered":"2024-03-28T05:42:54.656138+0000","last_clean":"2024-03-28T05:42:54.656138+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:42:54.656138+0000","last_undegraded":"2024-03-28T05:42:54.656138+0000","last_fullsized":"2024-03-28T05:42:54.656138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083070+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:42:54.083070+0000","last_peered":"2024-03-28T05:42:54.083070+0000","last_clean":"2024-03-28T05:42:54.083070+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:42:54.083070+0000","last_undegraded":"2024-03-28T05:42:54.083070+0000","last_fullsized":"2024-03-28T05:42:54.083070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701429+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:42:53.701429+0000","last_peered":"2024-03-28T05:42:53.701429+0000","last_clean":"2024-03-28T05:42:53.701429+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:42:53.701429+0000","last_undegraded":"2024-03-28T05:42:53.701429+0000","last_fullsized":"2024-03-28T05:42:53.701429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.788453+0000","last_change":"2024-03-28T05:42:51.680287+0000","last_active":"2024-03-28T05:42:57.788453+0000","last_peered":"2024-03-28T05:42:57.788453+0000","last_clean":"2024-03-28T05:42:57.788453+0000","last_became_active":"2024-03-28T05:42:51.679943+0000","last_became_peered":"2024-03-28T05:42:51.679943+0000","last_unstale":"2024-03-28T05:42:57.788453+0000","last_undegraded":"2024-03-28T05:42:57.788453+0000","last_fullsized":"2024-03-28T05:42:57.788453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:13:49.701714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082848+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:42:54.082848+0000","last_peered":"2024-03-28T05:42:54.082848+0000","last_clean":"2024-03-28T05:42:54.082848+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:42:54.082848+0000","last_undegraded":"2024-03-28T05:42:54.082848+0000","last_fullsized":"2024-03-28T05:42:54.082848+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.490112+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:42:57.490112+0000","last_peered":"2024-03-28T05:42:57.490112+0000","last_clean":"2024-03-28T05:42:57.490112+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:42:57.490112+0000","last_undegraded":"2024-03-28T05:42:57.490112+0000","last_fullsized":"2024-03-28T05:42:57.490112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701849+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:42:53.701849+0000","last_peered":"2024-03-28T05:42:53.701849+0000","last_clean":"2024-03-28T05:42:53.701849+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:42:53.701849+0000","last_undegraded":"2024-03-28T05:42:53.701849+0000","last_fullsized":"2024-03-28T05:42:53.701849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491680+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:42:57.491680+0000","last_peered":"2024-03-28T05:42:57.491680+0000","last_clean":"2024-03-28T05:42:57.491680+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:42:57.491680+0000","last_undegraded":"2024-03-28T05:42:57.491680+0000","last_fullsized":"2024-03-28T05:42:57.491680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081363+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:42:54.081363+0000","last_peered":"2024-03-28T05:42:54.081363+0000","last_clean":"2024-03-28T05:42:54.081363+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:42:54.081363+0000","last_undegraded":"2024-03-28T05:42:54.081363+0000","last_fullsized":"2024-03-28T05:42:54.081363+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.723239+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:42:53.723239+0000","last_peered":"2024-03-28T05:42:53.723239+0000","last_clean":"2024-03-28T05:42:53.723239+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:42:53.723239+0000","last_undegraded":"2024-03-28T05:42:53.723239+0000","last_fullsized":"2024-03-28T05:42:53.723239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.077453+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:42:54.077453+0000","last_peered":"2024-03-28T05:42:54.077453+0000","last_clean":"2024-03-28T05:42:54.077453+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:42:54.077453+0000","last_undegraded":"2024-03-28T05:42:54.077453+0000","last_fullsized":"2024-03-28T05:42:54.077453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482211+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:42:56.482211+0000","last_peered":"2024-03-28T05:42:56.482211+0000","last_clean":"2024-03-28T05:42:56.482211+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:42:56.482211+0000","last_undegraded":"2024-03-28T05:42:56.482211+0000","last_fullsized":"2024-03-28T05:42:56.482211+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656954+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:42:54.656954+0000","last_peered":"2024-03-28T05:42:54.656954+0000","last_clean":"2024-03-28T05:42:54.656954+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:42:54.656954+0000","last_undegraded":"2024-03-28T05:42:54.656954+0000","last_fullsized":"2024-03-28T05:42:54.656954+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477936+0000","last_change":"2024-03-28T05:42:51.686887+0000","last_active":"2024-03-28T05:42:56.477936+0000","last_peered":"2024-03-28T05:42:56.477936+0000","last_clean":"2024-03-28T05:42:56.477936+0000","last_became_active":"2024-03-28T05:42:51.683347+0000","last_became_peered":"2024-03-28T05:42:51.683347+0000","last_unstale":"2024-03-28T05:42:56.477936+0000","last_undegraded":"2024-03-28T05:42:56.477936+0000","last_fullsized":"2024-03-28T05:42:56.477936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:34.855035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.284151+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:42:54.284151+0000","last_peered":"2024-03-28T05:42:54.284151+0000","last_clean":"2024-03-28T05:42:54.284151+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:42:54.284151+0000","last_undegraded":"2024-03-28T05:42:54.284151+0000","last_fullsized":"2024-03-28T05:42:54.284151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.479429+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:42:56.479429+0000","last_peered":"2024-03-28T05:42:56.479429+0000","last_clean":"2024-03-28T05:42:56.479429+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:42:56.479429+0000","last_undegraded":"2024-03-28T05:42:56.479429+0000","last_fullsized":"2024-03-28T05:42:56.479429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656383+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:42:54.656383+0000","last_peered":"2024-03-28T05:42:54.656383+0000","last_clean":"2024-03-28T05:42:54.656383+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:42:54.656383+0000","last_undegraded":"2024-03-28T05:42:54.656383+0000","last_fullsized":"2024-03-28T05:42:54.656383+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477916+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:42:56.477916+0000","last_peered":"2024-03-28T05:42:56.477916+0000","last_clean":"2024-03-28T05:42:56.477916+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:42:56.477916+0000","last_undegraded":"2024-03-28T05:42:56.477916+0000","last_fullsized":"2024-03-28T05:42:56.477916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083680+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:42:54.083680+0000","last_peered":"2024-03-28T05:42:54.083680+0000","last_clean":"2024-03-28T05:42:54.083680+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:42:54.083680+0000","last_undegraded":"2024-03-28T05:42:54.083680+0000","last_fullsized":"2024-03-28T05:42:54.083680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491274+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:42:57.491274+0000","last_peered":"2024-03-28T05:42:57.491274+0000","last_clean":"2024-03-28T05:42:57.491274+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:42:57.491274+0000","last_undegraded":"2024-03-28T05:42:57.491274+0000","last_fullsized":"2024-03-28T05:42:57.491274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700323+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:42:53.700323+0000","last_peered":"2024-03-28T05:42:53.700323+0000","last_clean":"2024-03-28T05:42:53.700323+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:42:53.700323+0000","last_undegraded":"2024-03-28T05:42:53.700323+0000","last_fullsized":"2024-03-28T05:42:53.700323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482580+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:42:56.482580+0000","last_peered":"2024-03-28T05:42:56.482580+0000","last_clean":"2024-03-28T05:42:56.482580+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:42:56.482580+0000","last_undegraded":"2024-03-28T05:42:56.482580+0000","last_fullsized":"2024-03-28T05:42:56.482580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702744+0000","last_change":"2024-03-28T05:42:52.724299+0000","last_active":"2024-03-28T05:42:53.702744+0000","last_peered":"2024-03-28T05:42:53.702744+0000","last_clean":"2024-03-28T05:42:53.702744+0000","last_became_active":"2024-03-28T05:42:52.722695+0000","last_became_peered":"2024-03-28T05:42:52.722695+0000","last_unstale":"2024-03-28T05:42:53.702744+0000","last_undegraded":"2024-03-28T05:42:53.702744+0000","last_fullsized":"2024-03-28T05:42:53.702744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:46.161459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:59.798667+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:42:59.798667+0000","last_peered":"2024-03-28T05:42:59.798667+0000","last_clean":"2024-03-28T05:42:59.798667+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:42:59.798667+0000","last_undegraded":"2024-03-28T05:42:59.798667+0000","last_fullsized":"2024-03-28T05:42:59.798667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701727+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:42:53.701727+0000","last_peered":"2024-03-28T05:42:53.701727+0000","last_clean":"2024-03-28T05:42:53.701727+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:42:53.701727+0000","last_undegraded":"2024-03-28T05:42:53.701727+0000","last_fullsized":"2024-03-28T05:42:53.701727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.495249+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:42:57.495249+0000","last_peered":"2024-03-28T05:42:57.495249+0000","last_clean":"2024-03-28T05:42:57.495249+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:42:57.495249+0000","last_undegraded":"2024-03-28T05:42:57.495249+0000","last_fullsized":"2024-03-28T05:42:57.495249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700855+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:42:53.700855+0000","last_peered":"2024-03-28T05:42:53.700855+0000","last_clean":"2024-03-28T05:42:53.700855+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:42:53.700855+0000","last_undegraded":"2024-03-28T05:42:53.700855+0000","last_fullsized":"2024-03-28T05:42:53.700855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083771+0000","last_change":"2024-03-28T05:42:51.682723+0000","last_active":"2024-03-28T05:42:54.083771+0000","last_peered":"2024-03-28T05:42:54.083771+0000","last_clean":"2024-03-28T05:42:54.083771+0000","last_became_active":"2024-03-28T05:42:51.682308+0000","last_became_peered":"2024-03-28T05:42:51.682308+0000","last_unstale":"2024-03-28T05:42:54.083771+0000","last_undegraded":"2024-03-28T05:42:54.083771+0000","last_fullsized":"2024-03-28T05:42:54.083771+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:57.539722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900546+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:42:54.900546+0000","last_peered":"2024-03-28T05:42:54.900546+0000","last_clean":"2024-03-28T05:42:54.900546+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:42:54.900546+0000","last_undegraded":"2024-03-28T05:42:54.900546+0000","last_fullsized":"2024-03-28T05:42:54.900546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.077612+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:42:54.077612+0000","last_peered":"2024-03-28T05:42:54.077612+0000","last_clean":"2024-03-28T05:42:54.077612+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:42:54.077612+0000","last_undegraded":"2024-03-28T05:42:54.077612+0000","last_fullsized":"2024-03-28T05:42:54.077612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656968+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:42:54.656968+0000","last_peered":"2024-03-28T05:42:54.656968+0000","last_clean":"2024-03-28T05:42:54.656968+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:42:54.656968+0000","last_undegraded":"2024-03-28T05:42:54.656968+0000","last_fullsized":"2024-03-28T05:42:54.656968+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.636145+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:42:54.636145+0000","last_peered":"2024-03-28T05:42:54.636145+0000","last_clean":"2024-03-28T05:42:54.636145+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:42:54.636145+0000","last_undegraded":"2024-03-28T05:42:54.636145+0000","last_fullsized":"2024-03-28T05:42:54.636145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657088+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:42:54.657088+0000","last_peered":"2024-03-28T05:42:54.657088+0000","last_clean":"2024-03-28T05:42:54.657088+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:42:54.657088+0000","last_undegraded":"2024-03-28T05:42:54.657088+0000","last_fullsized":"2024-03-28T05:42:54.657088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701922+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:42:53.701922+0000","last_peered":"2024-03-28T05:42:53.701922+0000","last_clean":"2024-03-28T05:42:53.701922+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:42:53.701922+0000","last_undegraded":"2024-03-28T05:42:53.701922+0000","last_fullsized":"2024-03-28T05:42:53.701922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:58.795300+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:42:58.795300+0000","last_peered":"2024-03-28T05:42:58.795300+0000","last_clean":"2024-03-28T05:42:58.795300+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:42:58.795300+0000","last_undegraded":"2024-03-28T05:42:58.795300+0000","last_fullsized":"2024-03-28T05:42:58.795300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081687+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:42:54.081687+0000","last_peered":"2024-03-28T05:42:54.081687+0000","last_clean":"2024-03-28T05:42:54.081687+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:42:54.081687+0000","last_undegraded":"2024-03-28T05:42:54.081687+0000","last_fullsized":"2024-03-28T05:42:54.081687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.782978+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:42:57.782978+0000","last_peered":"2024-03-28T05:42:57.782978+0000","last_clean":"2024-03-28T05:42:57.782978+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:42:57.782978+0000","last_undegraded":"2024-03-28T05:42:57.782978+0000","last_fullsized":"2024-03-28T05:42:57.782978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":343,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701484+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:42:53.701484+0000","last_peered":"2024-03-28T05:42:53.701484+0000","last_clean":"2024-03-28T05:42:53.701484+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:42:53.701484+0000","last_undegraded":"2024-03-28T05:42:53.701484+0000","last_fullsized":"2024-03-28T05:42:53.701484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.699844+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:42:53.699844+0000","last_peered":"2024-03-28T05:42:53.699844+0000","last_clean":"2024-03-28T05:42:53.699844+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:42:53.699844+0000","last_undegraded":"2024-03-28T05:42:53.699844+0000","last_fullsized":"2024-03-28T05:42:53.699844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.493521+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:42:57.493521+0000","last_peered":"2024-03-28T05:42:57.493521+0000","last_clean":"2024-03-28T05:42:57.493521+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:42:57.493521+0000","last_undegraded":"2024-03-28T05:42:57.493521+0000","last_fullsized":"2024-03-28T05:42:57.493521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.476586+0000","last_change":"2024-03-28T05:42:51.684247+0000","last_active":"2024-03-28T05:42:56.476586+0000","last_peered":"2024-03-28T05:42:56.476586+0000","last_clean":"2024-03-28T05:42:56.476586+0000","last_became_active":"2024-03-28T05:42:51.683860+0000","last_became_peered":"2024-03-28T05:42:51.683860+0000","last_unstale":"2024-03-28T05:42:56.476586+0000","last_undegraded":"2024-03-28T05:42:56.476586+0000","last_fullsized":"2024-03-28T05:42:56.476586+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:14.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700758+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:42:53.700758+0000","last_peered":"2024-03-28T05:42:53.700758+0000","last_clean":"2024-03-28T05:42:53.700758+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:42:53.700758+0000","last_undegraded":"2024-03-28T05:42:53.700758+0000","last_fullsized":"2024-03-28T05:42:53.700758+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.493429+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:42:57.493429+0000","last_peered":"2024-03-28T05:42:57.493429+0000","last_clean":"2024-03-28T05:42:57.493429+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:42:57.493429+0000","last_undegraded":"2024-03-28T05:42:57.493429+0000","last_fullsized":"2024-03-28T05:42:57.493429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082163+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:42:54.082163+0000","last_peered":"2024-03-28T05:42:54.082163+0000","last_clean":"2024-03-28T05:42:54.082163+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:42:54.082163+0000","last_undegraded":"2024-03-28T05:42:54.082163+0000","last_fullsized":"2024-03-28T05:42:54.082163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.478423+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:42:56.478423+0000","last_peered":"2024-03-28T05:42:56.478423+0000","last_clean":"2024-03-28T05:42:56.478423+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:42:56.478423+0000","last_undegraded":"2024-03-28T05:42:56.478423+0000","last_fullsized":"2024-03-28T05:42:56.478423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283872+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:42:54.283872+0000","last_peered":"2024-03-28T05:42:54.283872+0000","last_clean":"2024-03-28T05:42:54.283872+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:42:54.283872+0000","last_undegraded":"2024-03-28T05:42:54.283872+0000","last_fullsized":"2024-03-28T05:42:54.283872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477783+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:42:56.477783+0000","last_peered":"2024-03-28T05:42:56.477783+0000","last_clean":"2024-03-28T05:42:56.477783+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:42:56.477783+0000","last_undegraded":"2024-03-28T05:42:56.477783+0000","last_fullsized":"2024-03-28T05:42:56.477783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082308+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:42:54.082308+0000","last_peered":"2024-03-28T05:42:54.082308+0000","last_clean":"2024-03-28T05:42:54.082308+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:42:54.082308+0000","last_undegraded":"2024-03-28T05:42:54.082308+0000","last_fullsized":"2024-03-28T05:42:54.082308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.475519+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:42:56.475519+0000","last_peered":"2024-03-28T05:42:56.475519+0000","last_clean":"2024-03-28T05:42:56.475519+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:42:56.475519+0000","last_undegraded":"2024-03-28T05:42:56.475519+0000","last_fullsized":"2024-03-28T05:42:56.475519+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900426+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:42:54.900426+0000","last_peered":"2024-03-28T05:42:54.900426+0000","last_clean":"2024-03-28T05:42:54.900426+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:42:54.900426+0000","last_undegraded":"2024-03-28T05:42:54.900426+0000","last_fullsized":"2024-03-28T05:42:54.900426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:55.414893+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:42:55.414893+0000","last_peered":"2024-03-28T05:42:55.414893+0000","last_clean":"2024-03-28T05:42:55.414893+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:42:55.414893+0000","last_undegraded":"2024-03-28T05:42:55.414893+0000","last_fullsized":"2024-03-28T05:42:55.414893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081476+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:42:54.081476+0000","last_peered":"2024-03-28T05:42:54.081476+0000","last_clean":"2024-03-28T05:42:54.081476+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:42:54.081476+0000","last_undegraded":"2024-03-28T05:42:54.081476+0000","last_fullsized":"2024-03-28T05:42:54.081476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482775+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:42:56.482775+0000","last_peered":"2024-03-28T05:42:56.482775+0000","last_clean":"2024-03-28T05:42:56.482775+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:42:56.482775+0000","last_undegraded":"2024-03-28T05:42:56.482775+0000","last_fullsized":"2024-03-28T05:42:56.482775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702683+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:42:53.702683+0000","last_peered":"2024-03-28T05:42:53.702683+0000","last_clean":"2024-03-28T05:42:53.702683+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:42:53.702683+0000","last_undegraded":"2024-03-28T05:42:53.702683+0000","last_fullsized":"2024-03-28T05:42:53.702683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.492080+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:42:57.492080+0000","last_peered":"2024-03-28T05:42:57.492080+0000","last_clean":"2024-03-28T05:42:57.492080+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:42:57.492080+0000","last_undegraded":"2024-03-28T05:42:57.492080+0000","last_fullsized":"2024-03-28T05:42:57.492080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.703181+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:42:53.703181+0000","last_peered":"2024-03-28T05:42:53.703181+0000","last_clean":"2024-03-28T05:42:53.703181+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:42:53.703181+0000","last_undegraded":"2024-03-28T05:42:53.703181+0000","last_fullsized":"2024-03-28T05:42:53.703181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.723384+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:42:53.723384+0000","last_peered":"2024-03-28T05:42:53.723384+0000","last_clean":"2024-03-28T05:42:53.723384+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:42:53.723384+0000","last_undegraded":"2024-03-28T05:42:53.723384+0000","last_fullsized":"2024-03-28T05:42:53.723384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702159+0000","last_change":"2024-03-28T05:42:52.717175+0000","last_active":"2024-03-28T05:42:53.702159+0000","last_peered":"2024-03-28T05:42:53.702159+0000","last_clean":"2024-03-28T05:42:53.702159+0000","last_became_active":"2024-03-28T05:42:52.716824+0000","last_became_peered":"2024-03-28T05:42:52.716824+0000","last_unstale":"2024-03-28T05:42:53.702159+0000","last_undegraded":"2024-03-28T05:42:53.702159+0000","last_fullsized":"2024-03-28T05:42:53.702159+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:40:01.206355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700808+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:42:53.700808+0000","last_peered":"2024-03-28T05:42:53.700808+0000","last_clean":"2024-03-28T05:42:53.700808+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:42:53.700808+0000","last_undegraded":"2024-03-28T05:42:53.700808+0000","last_fullsized":"2024-03-28T05:42:53.700808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.703161+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:42:53.703161+0000","last_peered":"2024-03-28T05:42:53.703161+0000","last_clean":"2024-03-28T05:42:53.703161+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:42:53.703161+0000","last_undegraded":"2024-03-28T05:42:53.703161+0000","last_fullsized":"2024-03-28T05:42:53.703161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900623+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:42:54.900623+0000","last_peered":"2024-03-28T05:42:54.900623+0000","last_clean":"2024-03-28T05:42:54.900623+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:42:54.900623+0000","last_undegraded":"2024-03-28T05:42:54.900623+0000","last_fullsized":"2024-03-28T05:42:54.900623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656644+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:42:54.656644+0000","last_peered":"2024-03-28T05:42:54.656644+0000","last_clean":"2024-03-28T05:42:54.656644+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:42:54.656644+0000","last_undegraded":"2024-03-28T05:42:54.656644+0000","last_fullsized":"2024-03-28T05:42:54.656644+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656646+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:42:54.656646+0000","last_peered":"2024-03-28T05:42:54.656646+0000","last_clean":"2024-03-28T05:42:54.656646+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:42:54.656646+0000","last_undegraded":"2024-03-28T05:42:54.656646+0000","last_fullsized":"2024-03-28T05:42:54.656646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283325+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:42:54.283325+0000","last_peered":"2024-03-28T05:42:54.283325+0000","last_clean":"2024-03-28T05:42:54.283325+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:42:54.283325+0000","last_undegraded":"2024-03-28T05:42:54.283325+0000","last_fullsized":"2024-03-28T05:42:54.283325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701060+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:42:53.701060+0000","last_peered":"2024-03-28T05:42:53.701060+0000","last_clean":"2024-03-28T05:42:53.701060+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:42:53.701060+0000","last_undegraded":"2024-03-28T05:42:53.701060+0000","last_fullsized":"2024-03-28T05:42:53.701060+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900743+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:42:54.900743+0000","last_peered":"2024-03-28T05:42:54.900743+0000","last_clean":"2024-03-28T05:42:54.900743+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:42:54.900743+0000","last_undegraded":"2024-03-28T05:42:54.900743+0000","last_fullsized":"2024-03-28T05:42:54.900743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.658015+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:42:54.658015+0000","last_peered":"2024-03-28T05:42:54.658015+0000","last_clean":"2024-03-28T05:42:54.658015+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:42:54.658015+0000","last_undegraded":"2024-03-28T05:42:54.658015+0000","last_fullsized":"2024-03-28T05:42:54.658015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082122+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:42:54.082122+0000","last_peered":"2024-03-28T05:42:54.082122+0000","last_clean":"2024-03-28T05:42:54.082122+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:42:54.082122+0000","last_undegraded":"2024-03-28T05:42:54.082122+0000","last_fullsized":"2024-03-28T05:42:54.082122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701582+0000","last_change":"2024-03-28T05:42:52.724538+0000","last_active":"2024-03-28T05:42:53.701582+0000","last_peered":"2024-03-28T05:42:53.701582+0000","last_clean":"2024-03-28T05:42:53.701582+0000","last_became_active":"2024-03-28T05:42:52.723882+0000","last_became_peered":"2024-03-28T05:42:52.723882+0000","last_unstale":"2024-03-28T05:42:53.701582+0000","last_undegraded":"2024-03-28T05:42:53.701582+0000","last_fullsized":"2024-03-28T05:42:53.701582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:45:38.923552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081651+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:42:54.081651+0000","last_peered":"2024-03-28T05:42:54.081651+0000","last_clean":"2024-03-28T05:42:54.081651+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:42:54.081651+0000","last_undegraded":"2024-03-28T05:42:54.081651+0000","last_fullsized":"2024-03-28T05:42:54.081651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655896+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:42:54.655896+0000","last_peered":"2024-03-28T05:42:54.655896+0000","last_clean":"2024-03-28T05:42:54.655896+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:42:54.655896+0000","last_undegraded":"2024-03-28T05:42:54.655896+0000","last_fullsized":"2024-03-28T05:42:54.655896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700410+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:42:53.700410+0000","last_peered":"2024-03-28T05:42:53.700410+0000","last_clean":"2024-03-28T05:42:53.700410+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:42:53.700410+0000","last_undegraded":"2024-03-28T05:42:53.700410+0000","last_fullsized":"2024-03-28T05:42:53.700410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900418+0000","last_change":"2024-03-28T05:42:52.708496+0000","last_active":"2024-03-28T05:42:54.900418+0000","last_peered":"2024-03-28T05:42:54.900418+0000","last_clean":"2024-03-28T05:42:54.900418+0000","last_became_active":"2024-03-28T05:42:52.702136+0000","last_became_peered":"2024-03-28T05:42:52.702136+0000","last_unstale":"2024-03-28T05:42:54.900418+0000","last_undegraded":"2024-03-28T05:42:54.900418+0000","last_fullsized":"2024-03-28T05:42:54.900418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:34:17.447670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5613,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":125,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":96810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220177,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":974848,"data_stored":464451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481815,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32744,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712408,"statfs":{"total":95995035648,"available":95961505792,"internally_reserved":0,"allocated":1601536,"data_stored":1056805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678047,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":464687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939686,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":464607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1581056,"data_stored":1056029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430259,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":463959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":493337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":464563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1011712,"data_stored":473822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":464270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":464904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1593344,"data_stored":1055713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":31209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:43:02.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T05:43:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:02 smithi159 ceph-mon[36109]: pgmap v372: 97 pgs: 97 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-03-28T05:43:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3699215265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/459430621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.094 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:02 smithi055 ceph-mon[31863]: pgmap v372: 97 pgs: 97 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-03-28T05:43:03.094 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3699215265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.094 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/459430621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 -- 172.21.15.55:0/229850030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 msgr2=0x7f5a78110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 --2- 172.21.15.55:0/229850030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a78110120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009ca0 tx=0x7f5a7002c100 comp rx=0 tx=0).stop 2024-03-28T05:43:03.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 -- 172.21.15.55:0/229850030 shutdown_connections 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 --2- 172.21.15.55:0/229850030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a78110120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 --2- 172.21.15.55:0/229850030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a78109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 --2- 172.21.15.55:0/229850030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a78108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 -- 172.21.15.55:0/229850030 >> 172.21.15.55:0/229850030 conn(0x7f5a78076cb0 msgr2=0x7f5a780790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 -- 172.21.15.55:0/229850030 shutdown_connections 2024-03-28T05:43:03.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.235+0000 7f5a80000640 1 -- 172.21.15.55:0/229850030 wait complete. 2024-03-28T05:43:03.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.236+0000 7f5a80000640 1 Processor -- start 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.236+0000 7f5a80000640 1 -- start start 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a7819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a7819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a781137f0 con 0x7f5a78109890 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78113670 con 0x7f5a78108ed0 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a80000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78113970 con 0x7f5a78107ce0 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60426/0 (socket says 172.21.15.55:60426) 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7e000640 1 -- 172.21.15.55:0/470476596 learned_addr learned my addr 172.21.15.55:0/470476596 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7cc00640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a7819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7d600640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a7819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.237+0000 7f5a7e000640 1 -- 172.21.15.55:0/470476596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 msgr2=0x7f5a7819de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7e000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a7819de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7e000640 1 -- 172.21.15.55:0/470476596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 msgr2=0x7f5a7819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7e000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a7819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7e000640 1 -- 172.21.15.55:0/470476596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a781a5ab0 con 0x7f5a78109890 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7cc00640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a7819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7d600640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a7819de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a7e000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a70032520 tx=0x7f5a70034880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70039040 con 0x7f5a78109890 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5a70044070 con 0x7f5a78109890 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a700043c0 con 0x7f5a78109890 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a781a5d40 con 0x7f5a78109890 2024-03-28T05:43:03.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.238+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a781a6220 con 0x7f5a78109890 2024-03-28T05:43:03.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.240+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7810f000 con 0x7f5a78109890 2024-03-28T05:43:03.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.242+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f5a70004560 con 0x7f5a78109890 2024-03-28T05:43:03.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.243+0000 7f5a76000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 0x7f5a600a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:03.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.243+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5a700f1110 con 0x7f5a78109890 2024-03-28T05:43:03.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.243+0000 7f5a7d600640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 0x7f5a600a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:03.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.244+0000 7f5a7d600640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 0x7f5a600a4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0058c0 tx=0x7f5a6c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:03.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.247+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5a700333a0 con 0x7f5a78109890 2024-03-28T05:43:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:02 smithi086 ceph-mon[35163]: pgmap v372: 97 pgs: 97 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-03-28T05:43:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3699215265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/459430621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:03.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.448+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a78061ae0 con 0x7f5a600a2910 2024-03-28T05:43:03.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.457+0000 7f5a76000640 1 -- 172.21.15.55:0/470476596 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258798 (secure 0 0 0) 0x7f5a78061ae0 con 0x7f5a600a2910 2024-03-28T05:43:03.462 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:03.464 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 msgr2=0x7f5a600a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 0x7f5a600a4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0058c0 tx=0x7f5a6c005850 comp rx=0 tx=0).stop 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 msgr2=0x7f5a781a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a70032520 tx=0x7f5a70034880 comp rx=0 tx=0).stop 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 shutdown_connections 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5a600a2910 0x7f5a600a4dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a78109890 0x7f5a781a5440 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a78108ed0 0x7f5a7819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 --2- 172.21.15.55:0/470476596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a78107ce0 0x7f5a7819de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 >> 172.21.15.55:0/470476596 conn(0x7f5a78076cb0 msgr2=0x7f5a7810c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 shutdown_connections 2024-03-28T05:43:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:03.463+0000 7f5a80000640 1 -- 172.21.15.55:0/470476596 wait complete. 2024-03-28T05:43:03.485 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-03-28T05:43:01.819760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595981,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":152,"num_read_kb":131,"num_write":306,"num_write_kb":2977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387484,"kb_used_data":13368,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554340,"statfs":{"total":1151940427776,"available":1151543644160,"internally_reserved":0,"allocated":13688832,"data_stored":7387147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5613,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":125,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.143819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900872+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:42:54.900872+0000","last_peered":"2024-03-28T05:42:54.900872+0000","last_clean":"2024-03-28T05:42:54.900872+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:42:54.900872+0000","last_undegraded":"2024-03-28T05:42:54.900872+0000","last_fullsized":"2024-03-28T05:42:54.900872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283834+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:42:54.283834+0000","last_peered":"2024-03-28T05:42:54.283834+0000","last_clean":"2024-03-28T05:42:54.283834+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:42:54.283834+0000","last_undegraded":"2024-03-28T05:42:54.283834+0000","last_fullsized":"2024-03-28T05:42:54.283834+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283671+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:42:54.283671+0000","last_peered":"2024-03-28T05:42:54.283671+0000","last_clean":"2024-03-28T05:42:54.283671+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:42:54.283671+0000","last_undegraded":"2024-03-28T05:42:54.283671+0000","last_fullsized":"2024-03-28T05:42:54.283671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656070+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:42:54.656070+0000","last_peered":"2024-03-28T05:42:54.656070+0000","last_clean":"2024-03-28T05:42:54.656070+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:42:54.656070+0000","last_undegraded":"2024-03-28T05:42:54.656070+0000","last_fullsized":"2024-03-28T05:42:54.656070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082922+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:42:54.082922+0000","last_peered":"2024-03-28T05:42:54.082922+0000","last_clean":"2024-03-28T05:42:54.082922+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:42:54.082922+0000","last_undegraded":"2024-03-28T05:42:54.082922+0000","last_fullsized":"2024-03-28T05:42:54.082922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656713+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:42:54.656713+0000","last_peered":"2024-03-28T05:42:54.656713+0000","last_clean":"2024-03-28T05:42:54.656713+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:42:54.656713+0000","last_undegraded":"2024-03-28T05:42:54.656713+0000","last_fullsized":"2024-03-28T05:42:54.656713+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701838+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:42:53.701838+0000","last_peered":"2024-03-28T05:42:53.701838+0000","last_clean":"2024-03-28T05:42:53.701838+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:42:53.701838+0000","last_undegraded":"2024-03-28T05:42:53.701838+0000","last_fullsized":"2024-03-28T05:42:53.701838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081479+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:42:54.081479+0000","last_peered":"2024-03-28T05:42:54.081479+0000","last_clean":"2024-03-28T05:42:54.081479+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:42:54.081479+0000","last_undegraded":"2024-03-28T05:42:54.081479+0000","last_fullsized":"2024-03-28T05:42:54.081479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657196+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:42:54.657196+0000","last_peered":"2024-03-28T05:42:54.657196+0000","last_clean":"2024-03-28T05:42:54.657196+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:42:54.657196+0000","last_undegraded":"2024-03-28T05:42:54.657196+0000","last_fullsized":"2024-03-28T05:42:54.657196+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657350+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:42:54.657350+0000","last_peered":"2024-03-28T05:42:54.657350+0000","last_clean":"2024-03-28T05:42:54.657350+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:42:54.657350+0000","last_undegraded":"2024-03-28T05:42:54.657350+0000","last_fullsized":"2024-03-28T05:42:54.657350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702996+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:42:53.702996+0000","last_peered":"2024-03-28T05:42:53.702996+0000","last_clean":"2024-03-28T05:42:53.702996+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:42:53.702996+0000","last_undegraded":"2024-03-28T05:42:53.702996+0000","last_fullsized":"2024-03-28T05:42:53.702996+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655898+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:42:54.655898+0000","last_peered":"2024-03-28T05:42:54.655898+0000","last_clean":"2024-03-28T05:42:54.655898+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:42:54.655898+0000","last_undegraded":"2024-03-28T05:42:54.655898+0000","last_fullsized":"2024-03-28T05:42:54.655898+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700277+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:42:53.700277+0000","last_peered":"2024-03-28T05:42:53.700277+0000","last_clean":"2024-03-28T05:42:53.700277+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:42:53.700277+0000","last_undegraded":"2024-03-28T05:42:53.700277+0000","last_fullsized":"2024-03-28T05:42:53.700277+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.282670+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:42:54.282670+0000","last_peered":"2024-03-28T05:42:54.282670+0000","last_clean":"2024-03-28T05:42:54.282670+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:42:54.282670+0000","last_undegraded":"2024-03-28T05:42:54.282670+0000","last_fullsized":"2024-03-28T05:42:54.282670+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.282782+0000","last_change":"2024-03-28T05:42:52.710997+0000","last_active":"2024-03-28T05:42:54.282782+0000","last_peered":"2024-03-28T05:42:54.282782+0000","last_clean":"2024-03-28T05:42:54.282782+0000","last_became_active":"2024-03-28T05:42:52.710638+0000","last_became_peered":"2024-03-28T05:42:52.710638+0000","last_unstale":"2024-03-28T05:42:54.282782+0000","last_undegraded":"2024-03-28T05:42:54.282782+0000","last_fullsized":"2024-03-28T05:42:54.282782+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:54:01.612358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655220+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:42:54.655220+0000","last_peered":"2024-03-28T05:42:54.655220+0000","last_clean":"2024-03-28T05:42:54.655220+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:42:54.655220+0000","last_undegraded":"2024-03-28T05:42:54.655220+0000","last_fullsized":"2024-03-28T05:42:54.655220+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900959+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:42:54.900959+0000","last_peered":"2024-03-28T05:42:54.900959+0000","last_clean":"2024-03-28T05:42:54.900959+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:42:54.900959+0000","last_undegraded":"2024-03-28T05:42:54.900959+0000","last_fullsized":"2024-03-28T05:42:54.900959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.078017+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:42:54.078017+0000","last_peered":"2024-03-28T05:42:54.078017+0000","last_clean":"2024-03-28T05:42:54.078017+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:42:54.078017+0000","last_undegraded":"2024-03-28T05:42:54.078017+0000","last_fullsized":"2024-03-28T05:42:54.078017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656855+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:42:54.656855+0000","last_peered":"2024-03-28T05:42:54.656855+0000","last_clean":"2024-03-28T05:42:54.656855+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:42:54.656855+0000","last_undegraded":"2024-03-28T05:42:54.656855+0000","last_fullsized":"2024-03-28T05:42:54.656855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.495525+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:42:57.495525+0000","last_peered":"2024-03-28T05:42:57.495525+0000","last_clean":"2024-03-28T05:42:57.495525+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:42:57.495525+0000","last_undegraded":"2024-03-28T05:42:57.495525+0000","last_fullsized":"2024-03-28T05:42:57.495525+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081859+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:42:54.081859+0000","last_peered":"2024-03-28T05:42:54.081859+0000","last_clean":"2024-03-28T05:42:54.081859+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:42:54.081859+0000","last_undegraded":"2024-03-28T05:42:54.081859+0000","last_fullsized":"2024-03-28T05:42:54.081859+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082156+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:42:54.082156+0000","last_peered":"2024-03-28T05:42:54.082156+0000","last_clean":"2024-03-28T05:42:54.082156+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:42:54.082156+0000","last_undegraded":"2024-03-28T05:42:54.082156+0000","last_fullsized":"2024-03-28T05:42:54.082156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.284071+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:42:54.284071+0000","last_peered":"2024-03-28T05:42:54.284071+0000","last_clean":"2024-03-28T05:42:54.284071+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:42:54.284071+0000","last_undegraded":"2024-03-28T05:42:54.284071+0000","last_fullsized":"2024-03-28T05:42:54.284071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491583+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:42:57.491583+0000","last_peered":"2024-03-28T05:42:57.491583+0000","last_clean":"2024-03-28T05:42:57.491583+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:42:57.491583+0000","last_undegraded":"2024-03-28T05:42:57.491583+0000","last_fullsized":"2024-03-28T05:42:57.491583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656138+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:42:54.656138+0000","last_peered":"2024-03-28T05:42:54.656138+0000","last_clean":"2024-03-28T05:42:54.656138+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:42:54.656138+0000","last_undegraded":"2024-03-28T05:42:54.656138+0000","last_fullsized":"2024-03-28T05:42:54.656138+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083070+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:42:54.083070+0000","last_peered":"2024-03-28T05:42:54.083070+0000","last_clean":"2024-03-28T05:42:54.083070+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:42:54.083070+0000","last_undegraded":"2024-03-28T05:42:54.083070+0000","last_fullsized":"2024-03-28T05:42:54.083070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701429+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:42:53.701429+0000","last_peered":"2024-03-28T05:42:53.701429+0000","last_clean":"2024-03-28T05:42:53.701429+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:42:53.701429+0000","last_undegraded":"2024-03-28T05:42:53.701429+0000","last_fullsized":"2024-03-28T05:42:53.701429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.788453+0000","last_change":"2024-03-28T05:42:51.680287+0000","last_active":"2024-03-28T05:42:57.788453+0000","last_peered":"2024-03-28T05:42:57.788453+0000","last_clean":"2024-03-28T05:42:57.788453+0000","last_became_active":"2024-03-28T05:42:51.679943+0000","last_became_peered":"2024-03-28T05:42:51.679943+0000","last_unstale":"2024-03-28T05:42:57.788453+0000","last_undegraded":"2024-03-28T05:42:57.788453+0000","last_fullsized":"2024-03-28T05:42:57.788453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:13:49.701714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082848+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:42:54.082848+0000","last_peered":"2024-03-28T05:42:54.082848+0000","last_clean":"2024-03-28T05:42:54.082848+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:42:54.082848+0000","last_undegraded":"2024-03-28T05:42:54.082848+0000","last_fullsized":"2024-03-28T05:42:54.082848+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.490112+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:42:57.490112+0000","last_peered":"2024-03-28T05:42:57.490112+0000","last_clean":"2024-03-28T05:42:57.490112+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:42:57.490112+0000","last_undegraded":"2024-03-28T05:42:57.490112+0000","last_fullsized":"2024-03-28T05:42:57.490112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701849+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:42:53.701849+0000","last_peered":"2024-03-28T05:42:53.701849+0000","last_clean":"2024-03-28T05:42:53.701849+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:42:53.701849+0000","last_undegraded":"2024-03-28T05:42:53.701849+0000","last_fullsized":"2024-03-28T05:42:53.701849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491680+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:42:57.491680+0000","last_peered":"2024-03-28T05:42:57.491680+0000","last_clean":"2024-03-28T05:42:57.491680+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:42:57.491680+0000","last_undegraded":"2024-03-28T05:42:57.491680+0000","last_fullsized":"2024-03-28T05:42:57.491680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081363+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:42:54.081363+0000","last_peered":"2024-03-28T05:42:54.081363+0000","last_clean":"2024-03-28T05:42:54.081363+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:42:54.081363+0000","last_undegraded":"2024-03-28T05:42:54.081363+0000","last_fullsized":"2024-03-28T05:42:54.081363+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.723239+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:42:53.723239+0000","last_peered":"2024-03-28T05:42:53.723239+0000","last_clean":"2024-03-28T05:42:53.723239+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:42:53.723239+0000","last_undegraded":"2024-03-28T05:42:53.723239+0000","last_fullsized":"2024-03-28T05:42:53.723239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.077453+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:42:54.077453+0000","last_peered":"2024-03-28T05:42:54.077453+0000","last_clean":"2024-03-28T05:42:54.077453+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:42:54.077453+0000","last_undegraded":"2024-03-28T05:42:54.077453+0000","last_fullsized":"2024-03-28T05:42:54.077453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482211+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:42:56.482211+0000","last_peered":"2024-03-28T05:42:56.482211+0000","last_clean":"2024-03-28T05:42:56.482211+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:42:56.482211+0000","last_undegraded":"2024-03-28T05:42:56.482211+0000","last_fullsized":"2024-03-28T05:42:56.482211+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656954+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:42:54.656954+0000","last_peered":"2024-03-28T05:42:54.656954+0000","last_clean":"2024-03-28T05:42:54.656954+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:42:54.656954+0000","last_undegraded":"2024-03-28T05:42:54.656954+0000","last_fullsized":"2024-03-28T05:42:54.656954+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477936+0000","last_change":"2024-03-28T05:42:51.686887+0000","last_active":"2024-03-28T05:42:56.477936+0000","last_peered":"2024-03-28T05:42:56.477936+0000","last_clean":"2024-03-28T05:42:56.477936+0000","last_became_active":"2024-03-28T05:42:51.683347+0000","last_became_peered":"2024-03-28T05:42:51.683347+0000","last_unstale":"2024-03-28T05:42:56.477936+0000","last_undegraded":"2024-03-28T05:42:56.477936+0000","last_fullsized":"2024-03-28T05:42:56.477936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:34.855035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.284151+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:42:54.284151+0000","last_peered":"2024-03-28T05:42:54.284151+0000","last_clean":"2024-03-28T05:42:54.284151+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:42:54.284151+0000","last_undegraded":"2024-03-28T05:42:54.284151+0000","last_fullsized":"2024-03-28T05:42:54.284151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.479429+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:42:56.479429+0000","last_peered":"2024-03-28T05:42:56.479429+0000","last_clean":"2024-03-28T05:42:56.479429+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:42:56.479429+0000","last_undegraded":"2024-03-28T05:42:56.479429+0000","last_fullsized":"2024-03-28T05:42:56.479429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656383+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:42:54.656383+0000","last_peered":"2024-03-28T05:42:54.656383+0000","last_clean":"2024-03-28T05:42:54.656383+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:42:54.656383+0000","last_undegraded":"2024-03-28T05:42:54.656383+0000","last_fullsized":"2024-03-28T05:42:54.656383+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477916+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:42:56.477916+0000","last_peered":"2024-03-28T05:42:56.477916+0000","last_clean":"2024-03-28T05:42:56.477916+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:42:56.477916+0000","last_undegraded":"2024-03-28T05:42:56.477916+0000","last_fullsized":"2024-03-28T05:42:56.477916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083680+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:42:54.083680+0000","last_peered":"2024-03-28T05:42:54.083680+0000","last_clean":"2024-03-28T05:42:54.083680+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:42:54.083680+0000","last_undegraded":"2024-03-28T05:42:54.083680+0000","last_fullsized":"2024-03-28T05:42:54.083680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.491274+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:42:57.491274+0000","last_peered":"2024-03-28T05:42:57.491274+0000","last_clean":"2024-03-28T05:42:57.491274+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:42:57.491274+0000","last_undegraded":"2024-03-28T05:42:57.491274+0000","last_fullsized":"2024-03-28T05:42:57.491274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700323+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:42:53.700323+0000","last_peered":"2024-03-28T05:42:53.700323+0000","last_clean":"2024-03-28T05:42:53.700323+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:42:53.700323+0000","last_undegraded":"2024-03-28T05:42:53.700323+0000","last_fullsized":"2024-03-28T05:42:53.700323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482580+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:42:56.482580+0000","last_peered":"2024-03-28T05:42:56.482580+0000","last_clean":"2024-03-28T05:42:56.482580+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:42:56.482580+0000","last_undegraded":"2024-03-28T05:42:56.482580+0000","last_fullsized":"2024-03-28T05:42:56.482580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702744+0000","last_change":"2024-03-28T05:42:52.724299+0000","last_active":"2024-03-28T05:42:53.702744+0000","last_peered":"2024-03-28T05:42:53.702744+0000","last_clean":"2024-03-28T05:42:53.702744+0000","last_became_active":"2024-03-28T05:42:52.722695+0000","last_became_peered":"2024-03-28T05:42:52.722695+0000","last_unstale":"2024-03-28T05:42:53.702744+0000","last_undegraded":"2024-03-28T05:42:53.702744+0000","last_fullsized":"2024-03-28T05:42:53.702744+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:46.161459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:59.798667+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:42:59.798667+0000","last_peered":"2024-03-28T05:42:59.798667+0000","last_clean":"2024-03-28T05:42:59.798667+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:42:59.798667+0000","last_undegraded":"2024-03-28T05:42:59.798667+0000","last_fullsized":"2024-03-28T05:42:59.798667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701727+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:42:53.701727+0000","last_peered":"2024-03-28T05:42:53.701727+0000","last_clean":"2024-03-28T05:42:53.701727+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:42:53.701727+0000","last_undegraded":"2024-03-28T05:42:53.701727+0000","last_fullsized":"2024-03-28T05:42:53.701727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.495249+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:42:57.495249+0000","last_peered":"2024-03-28T05:42:57.495249+0000","last_clean":"2024-03-28T05:42:57.495249+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:42:57.495249+0000","last_undegraded":"2024-03-28T05:42:57.495249+0000","last_fullsized":"2024-03-28T05:42:57.495249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700855+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:42:53.700855+0000","last_peered":"2024-03-28T05:42:53.700855+0000","last_clean":"2024-03-28T05:42:53.700855+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:42:53.700855+0000","last_undegraded":"2024-03-28T05:42:53.700855+0000","last_fullsized":"2024-03-28T05:42:53.700855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.083771+0000","last_change":"2024-03-28T05:42:51.682723+0000","last_active":"2024-03-28T05:42:54.083771+0000","last_peered":"2024-03-28T05:42:54.083771+0000","last_clean":"2024-03-28T05:42:54.083771+0000","last_became_active":"2024-03-28T05:42:51.682308+0000","last_became_peered":"2024-03-28T05:42:51.682308+0000","last_unstale":"2024-03-28T05:42:54.083771+0000","last_undegraded":"2024-03-28T05:42:54.083771+0000","last_fullsized":"2024-03-28T05:42:54.083771+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:57.539722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900546+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:42:54.900546+0000","last_peered":"2024-03-28T05:42:54.900546+0000","last_clean":"2024-03-28T05:42:54.900546+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:42:54.900546+0000","last_undegraded":"2024-03-28T05:42:54.900546+0000","last_fullsized":"2024-03-28T05:42:54.900546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.077612+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:42:54.077612+0000","last_peered":"2024-03-28T05:42:54.077612+0000","last_clean":"2024-03-28T05:42:54.077612+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:42:54.077612+0000","last_undegraded":"2024-03-28T05:42:54.077612+0000","last_fullsized":"2024-03-28T05:42:54.077612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656968+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:42:54.656968+0000","last_peered":"2024-03-28T05:42:54.656968+0000","last_clean":"2024-03-28T05:42:54.656968+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:42:54.656968+0000","last_undegraded":"2024-03-28T05:42:54.656968+0000","last_fullsized":"2024-03-28T05:42:54.656968+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.636145+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:42:54.636145+0000","last_peered":"2024-03-28T05:42:54.636145+0000","last_clean":"2024-03-28T05:42:54.636145+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:42:54.636145+0000","last_undegraded":"2024-03-28T05:42:54.636145+0000","last_fullsized":"2024-03-28T05:42:54.636145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.657088+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:42:54.657088+0000","last_peered":"2024-03-28T05:42:54.657088+0000","last_clean":"2024-03-28T05:42:54.657088+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:42:54.657088+0000","last_undegraded":"2024-03-28T05:42:54.657088+0000","last_fullsized":"2024-03-28T05:42:54.657088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701922+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:42:53.701922+0000","last_peered":"2024-03-28T05:42:53.701922+0000","last_clean":"2024-03-28T05:42:53.701922+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:42:53.701922+0000","last_undegraded":"2024-03-28T05:42:53.701922+0000","last_fullsized":"2024-03-28T05:42:53.701922+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:58.795300+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:42:58.795300+0000","last_peered":"2024-03-28T05:42:58.795300+0000","last_clean":"2024-03-28T05:42:58.795300+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:42:58.795300+0000","last_undegraded":"2024-03-28T05:42:58.795300+0000","last_fullsized":"2024-03-28T05:42:58.795300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081687+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:42:54.081687+0000","last_peered":"2024-03-28T05:42:54.081687+0000","last_clean":"2024-03-28T05:42:54.081687+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:42:54.081687+0000","last_undegraded":"2024-03-28T05:42:54.081687+0000","last_fullsized":"2024-03-28T05:42:54.081687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.782978+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:42:57.782978+0000","last_peered":"2024-03-28T05:42:57.782978+0000","last_clean":"2024-03-28T05:42:57.782978+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:42:57.782978+0000","last_undegraded":"2024-03-28T05:42:57.782978+0000","last_fullsized":"2024-03-28T05:42:57.782978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":343,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701484+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:42:53.701484+0000","last_peered":"2024-03-28T05:42:53.701484+0000","last_clean":"2024-03-28T05:42:53.701484+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:42:53.701484+0000","last_undegraded":"2024-03-28T05:42:53.701484+0000","last_fullsized":"2024-03-28T05:42:53.701484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.699844+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:42:53.699844+0000","last_peered":"2024-03-28T05:42:53.699844+0000","last_clean":"2024-03-28T05:42:53.699844+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:42:53.699844+0000","last_undegraded":"2024-03-28T05:42:53.699844+0000","last_fullsized":"2024-03-28T05:42:53.699844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.493521+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:42:57.493521+0000","last_peered":"2024-03-28T05:42:57.493521+0000","last_clean":"2024-03-28T05:42:57.493521+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:42:57.493521+0000","last_undegraded":"2024-03-28T05:42:57.493521+0000","last_fullsized":"2024-03-28T05:42:57.493521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.476586+0000","last_change":"2024-03-28T05:42:51.684247+0000","last_active":"2024-03-28T05:42:56.476586+0000","last_peered":"2024-03-28T05:42:56.476586+0000","last_clean":"2024-03-28T05:42:56.476586+0000","last_became_active":"2024-03-28T05:42:51.683860+0000","last_became_peered":"2024-03-28T05:42:51.683860+0000","last_unstale":"2024-03-28T05:42:56.476586+0000","last_undegraded":"2024-03-28T05:42:56.476586+0000","last_fullsized":"2024-03-28T05:42:56.476586+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:14.412857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700758+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:42:53.700758+0000","last_peered":"2024-03-28T05:42:53.700758+0000","last_clean":"2024-03-28T05:42:53.700758+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:42:53.700758+0000","last_undegraded":"2024-03-28T05:42:53.700758+0000","last_fullsized":"2024-03-28T05:42:53.700758+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.493429+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:42:57.493429+0000","last_peered":"2024-03-28T05:42:57.493429+0000","last_clean":"2024-03-28T05:42:57.493429+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:42:57.493429+0000","last_undegraded":"2024-03-28T05:42:57.493429+0000","last_fullsized":"2024-03-28T05:42:57.493429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082163+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:42:54.082163+0000","last_peered":"2024-03-28T05:42:54.082163+0000","last_clean":"2024-03-28T05:42:54.082163+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:42:54.082163+0000","last_undegraded":"2024-03-28T05:42:54.082163+0000","last_fullsized":"2024-03-28T05:42:54.082163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.478423+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:42:56.478423+0000","last_peered":"2024-03-28T05:42:56.478423+0000","last_clean":"2024-03-28T05:42:56.478423+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:42:56.478423+0000","last_undegraded":"2024-03-28T05:42:56.478423+0000","last_fullsized":"2024-03-28T05:42:56.478423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283872+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:42:54.283872+0000","last_peered":"2024-03-28T05:42:54.283872+0000","last_clean":"2024-03-28T05:42:54.283872+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:42:54.283872+0000","last_undegraded":"2024-03-28T05:42:54.283872+0000","last_fullsized":"2024-03-28T05:42:54.283872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.477783+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:42:56.477783+0000","last_peered":"2024-03-28T05:42:56.477783+0000","last_clean":"2024-03-28T05:42:56.477783+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:42:56.477783+0000","last_undegraded":"2024-03-28T05:42:56.477783+0000","last_fullsized":"2024-03-28T05:42:56.477783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082308+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:42:54.082308+0000","last_peered":"2024-03-28T05:42:54.082308+0000","last_clean":"2024-03-28T05:42:54.082308+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:42:54.082308+0000","last_undegraded":"2024-03-28T05:42:54.082308+0000","last_fullsized":"2024-03-28T05:42:54.082308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.475519+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:42:56.475519+0000","last_peered":"2024-03-28T05:42:56.475519+0000","last_clean":"2024-03-28T05:42:56.475519+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:42:56.475519+0000","last_undegraded":"2024-03-28T05:42:56.475519+0000","last_fullsized":"2024-03-28T05:42:56.475519+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900426+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:42:54.900426+0000","last_peered":"2024-03-28T05:42:54.900426+0000","last_clean":"2024-03-28T05:42:54.900426+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:42:54.900426+0000","last_undegraded":"2024-03-28T05:42:54.900426+0000","last_fullsized":"2024-03-28T05:42:54.900426+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:55.414893+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:42:55.414893+0000","last_peered":"2024-03-28T05:42:55.414893+0000","last_clean":"2024-03-28T05:42:55.414893+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:42:55.414893+0000","last_undegraded":"2024-03-28T05:42:55.414893+0000","last_fullsized":"2024-03-28T05:42:55.414893+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081476+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:42:54.081476+0000","last_peered":"2024-03-28T05:42:54.081476+0000","last_clean":"2024-03-28T05:42:54.081476+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:42:54.081476+0000","last_undegraded":"2024-03-28T05:42:54.081476+0000","last_fullsized":"2024-03-28T05:42:54.081476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:56.482775+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:42:56.482775+0000","last_peered":"2024-03-28T05:42:56.482775+0000","last_clean":"2024-03-28T05:42:56.482775+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:42:56.482775+0000","last_undegraded":"2024-03-28T05:42:56.482775+0000","last_fullsized":"2024-03-28T05:42:56.482775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702683+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:42:53.702683+0000","last_peered":"2024-03-28T05:42:53.702683+0000","last_clean":"2024-03-28T05:42:53.702683+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:42:53.702683+0000","last_undegraded":"2024-03-28T05:42:53.702683+0000","last_fullsized":"2024-03-28T05:42:53.702683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:57.492080+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:42:57.492080+0000","last_peered":"2024-03-28T05:42:57.492080+0000","last_clean":"2024-03-28T05:42:57.492080+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:42:57.492080+0000","last_undegraded":"2024-03-28T05:42:57.492080+0000","last_fullsized":"2024-03-28T05:42:57.492080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.703181+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:42:53.703181+0000","last_peered":"2024-03-28T05:42:53.703181+0000","last_clean":"2024-03-28T05:42:53.703181+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:42:53.703181+0000","last_undegraded":"2024-03-28T05:42:53.703181+0000","last_fullsized":"2024-03-28T05:42:53.703181+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.723384+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:42:53.723384+0000","last_peered":"2024-03-28T05:42:53.723384+0000","last_clean":"2024-03-28T05:42:53.723384+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:42:53.723384+0000","last_undegraded":"2024-03-28T05:42:53.723384+0000","last_fullsized":"2024-03-28T05:42:53.723384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.702159+0000","last_change":"2024-03-28T05:42:52.717175+0000","last_active":"2024-03-28T05:42:53.702159+0000","last_peered":"2024-03-28T05:42:53.702159+0000","last_clean":"2024-03-28T05:42:53.702159+0000","last_became_active":"2024-03-28T05:42:52.716824+0000","last_became_peered":"2024-03-28T05:42:52.716824+0000","last_unstale":"2024-03-28T05:42:53.702159+0000","last_undegraded":"2024-03-28T05:42:53.702159+0000","last_fullsized":"2024-03-28T05:42:53.702159+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:40:01.206355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700808+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:42:53.700808+0000","last_peered":"2024-03-28T05:42:53.700808+0000","last_clean":"2024-03-28T05:42:53.700808+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:42:53.700808+0000","last_undegraded":"2024-03-28T05:42:53.700808+0000","last_fullsized":"2024-03-28T05:42:53.700808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.703161+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:42:53.703161+0000","last_peered":"2024-03-28T05:42:53.703161+0000","last_clean":"2024-03-28T05:42:53.703161+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:42:53.703161+0000","last_undegraded":"2024-03-28T05:42:53.703161+0000","last_fullsized":"2024-03-28T05:42:53.703161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900623+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:42:54.900623+0000","last_peered":"2024-03-28T05:42:54.900623+0000","last_clean":"2024-03-28T05:42:54.900623+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:42:54.900623+0000","last_undegraded":"2024-03-28T05:42:54.900623+0000","last_fullsized":"2024-03-28T05:42:54.900623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656644+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:42:54.656644+0000","last_peered":"2024-03-28T05:42:54.656644+0000","last_clean":"2024-03-28T05:42:54.656644+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:42:54.656644+0000","last_undegraded":"2024-03-28T05:42:54.656644+0000","last_fullsized":"2024-03-28T05:42:54.656644+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.656646+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:42:54.656646+0000","last_peered":"2024-03-28T05:42:54.656646+0000","last_clean":"2024-03-28T05:42:54.656646+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:42:54.656646+0000","last_undegraded":"2024-03-28T05:42:54.656646+0000","last_fullsized":"2024-03-28T05:42:54.656646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.283325+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:42:54.283325+0000","last_peered":"2024-03-28T05:42:54.283325+0000","last_clean":"2024-03-28T05:42:54.283325+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:42:54.283325+0000","last_undegraded":"2024-03-28T05:42:54.283325+0000","last_fullsized":"2024-03-28T05:42:54.283325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701060+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:42:53.701060+0000","last_peered":"2024-03-28T05:42:53.701060+0000","last_clean":"2024-03-28T05:42:53.701060+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:42:53.701060+0000","last_undegraded":"2024-03-28T05:42:53.701060+0000","last_fullsized":"2024-03-28T05:42:53.701060+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900743+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:42:54.900743+0000","last_peered":"2024-03-28T05:42:54.900743+0000","last_clean":"2024-03-28T05:42:54.900743+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:42:54.900743+0000","last_undegraded":"2024-03-28T05:42:54.900743+0000","last_fullsized":"2024-03-28T05:42:54.900743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.658015+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:42:54.658015+0000","last_peered":"2024-03-28T05:42:54.658015+0000","last_clean":"2024-03-28T05:42:54.658015+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:42:54.658015+0000","last_undegraded":"2024-03-28T05:42:54.658015+0000","last_fullsized":"2024-03-28T05:42:54.658015+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.082122+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:42:54.082122+0000","last_peered":"2024-03-28T05:42:54.082122+0000","last_clean":"2024-03-28T05:42:54.082122+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:42:54.082122+0000","last_undegraded":"2024-03-28T05:42:54.082122+0000","last_fullsized":"2024-03-28T05:42:54.082122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.701582+0000","last_change":"2024-03-28T05:42:52.724538+0000","last_active":"2024-03-28T05:42:53.701582+0000","last_peered":"2024-03-28T05:42:53.701582+0000","last_clean":"2024-03-28T05:42:53.701582+0000","last_became_active":"2024-03-28T05:42:52.723882+0000","last_became_peered":"2024-03-28T05:42:52.723882+0000","last_unstale":"2024-03-28T05:42:53.701582+0000","last_undegraded":"2024-03-28T05:42:53.701582+0000","last_fullsized":"2024-03-28T05:42:53.701582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:45:38.923552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.081651+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:42:54.081651+0000","last_peered":"2024-03-28T05:42:54.081651+0000","last_clean":"2024-03-28T05:42:54.081651+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:42:54.081651+0000","last_undegraded":"2024-03-28T05:42:54.081651+0000","last_fullsized":"2024-03-28T05:42:54.081651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.655896+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:42:54.655896+0000","last_peered":"2024-03-28T05:42:54.655896+0000","last_clean":"2024-03-28T05:42:54.655896+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:42:54.655896+0000","last_undegraded":"2024-03-28T05:42:54.655896+0000","last_fullsized":"2024-03-28T05:42:54.655896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:53.700410+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:42:53.700410+0000","last_peered":"2024-03-28T05:42:53.700410+0000","last_clean":"2024-03-28T05:42:53.700410+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:42:53.700410+0000","last_undegraded":"2024-03-28T05:42:53.700410+0000","last_fullsized":"2024-03-28T05:42:53.700410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-28T05:42:54.900418+0000","last_change":"2024-03-28T05:42:52.708496+0000","last_active":"2024-03-28T05:42:54.900418+0000","last_peered":"2024-03-28T05:42:54.900418+0000","last_clean":"2024-03-28T05:42:54.900418+0000","last_became_active":"2024-03-28T05:42:52.702136+0000","last_became_peered":"2024-03-28T05:42:52.702136+0000","last_unstale":"2024-03-28T05:42:54.900418+0000","last_undegraded":"2024-03-28T05:42:54.900418+0000","last_fullsized":"2024-03-28T05:42:54.900418+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:34:17.447670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5613,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":125,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":96810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220177,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":974848,"data_stored":464451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481815,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32744,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712408,"statfs":{"total":95995035648,"available":95961505792,"internally_reserved":0,"allocated":1601536,"data_stored":1056805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678047,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":464687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939686,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":464607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1581056,"data_stored":1056029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430259,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":463959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":493337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":464563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1011712,"data_stored":473822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":464270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":464904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1593344,"data_stored":1055713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":31209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:43:03.491 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-28T05:43:03.492 INFO:tasks.cephadm:Setting up client nodes... 2024-03-28T05:43:03.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-28T05:43:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:03 smithi055 ceph-mon[31863]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:03 smithi055 ceph-mon[31863]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:03 smithi086 ceph-mon[35163]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:03 smithi086 ceph-mon[35163]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:03 smithi159 ceph-mon[36109]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:03 smithi159 ceph-mon[36109]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:43:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:04 smithi055 ceph-mon[31863]: pgmap v373: 97 pgs: 97 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 17 op/s 2024-03-28T05:43:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:04 smithi086 ceph-mon[35163]: pgmap v373: 97 pgs: 97 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 17 op/s 2024-03-28T05:43:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:04 smithi159 ceph-mon[36109]: pgmap v373: 97 pgs: 97 active+clean; 636 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.8 KiB/s wr, 17 op/s 2024-03-28T05:43:06.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 -- 172.21.15.55:0/3664778899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c1055a0 msgr2=0x7f742c107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:06.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 --2- 172.21.15.55:0/3664778899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c1055a0 0x7f742c107990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7418009990 tx=0x7f7418009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 -- 172.21.15.55:0/3664778899 shutdown_connections 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 --2- 172.21.15.55:0/3664778899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 0x7f742c10a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 --2- 172.21.15.55:0/3664778899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c102c70 0x7f742c105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 --2- 172.21.15.55:0/3664778899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c1055a0 0x7f742c107990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.104+0000 7f7432c00700 1 -- 172.21.15.55:0/3664778899 >> 172.21.15.55:0/3664778899 conn(0x7f742c0fc680 msgr2=0x7f742c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.105+0000 7f7432c00700 1 -- 172.21.15.55:0/3664778899 shutdown_connections 2024-03-28T05:43:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.105+0000 7f7432c00700 1 -- 172.21.15.55:0/3664778899 wait complete. 2024-03-28T05:43:06.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 Processor -- start 2024-03-28T05:43:06.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 -- start start 2024-03-28T05:43:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 0x7f742c100c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 0x7f742c101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c10dcf0 con 0x7f742c102c70 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c10db70 con 0x7f742c107ed0 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.107+0000 7f7432c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c10de70 con 0x7f742c1055a0 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60444/0 (socket says 172.21.15.55:60444) 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 -- 172.21.15.55:0/3570769193 learned_addr learned my addr 172.21.15.55:0/3570769193 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742b400700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 0x7f742c100c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f7430c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 0x7f742c101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 -- 172.21.15.55:0/3570769193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 msgr2=0x7f742c100c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 0x7f742c100c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 -- 172.21.15.55:0/3570769193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 msgr2=0x7f742c101160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 0x7f742c101160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742be00700 1 -- 172.21.15.55:0/3570769193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c101a10 con 0x7f742c102c70 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.108+0000 7f742b400700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 0x7f742c100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f742be00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c970 tx=0x7f741c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c007aa0 con 0x7f742c102c70 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f741c004ce0 con 0x7f742c102c70 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c005620 con 0x7f742c102c70 2024-03-28T05:43:06.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c1a23b0 con 0x7f742c102c70 2024-03-28T05:43:06.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.109+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c1a2870 con 0x7f742c102c70 2024-03-28T05:43:06.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.110+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c0506a0 con 0x7f742c102c70 2024-03-28T05:43:06.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.112+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f741c004750 con 0x7f742c102c70 2024-03-28T05:43:06.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.114+0000 7f7428c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 0x7f74100a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:06.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.114+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f741c0ce9b0 con 0x7f742c102c70 2024-03-28T05:43:06.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.114+0000 7f742b400700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 0x7f74100a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:06.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.115+0000 7f742b400700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 0x7f74100a4e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7418005f50 tx=0x7f7418005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:06.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.118+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f741c09ba30 con 0x7f742c102c70 2024-03-28T05:43:06.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.434+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f742c02da30 con 0x7f742c102c70 2024-03-28T05:43:06.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.440+0000 7f7428c00700 1 -- 172.21.15.55:0/3570769193 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) v1 ==== 170+0+59 (secure 0 0 0) 0x7f741c09b330 con 0x7f742c102c70 2024-03-28T05:43:06.441 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-03-28T05:43:06.442 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBqAwVmadkGGhAA1XxN+BWEpa1U3mxQOIXDhQ== 2024-03-28T05:43:06.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 msgr2=0x7f74100a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 0x7f74100a4e90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7418005f50 tx=0x7f7418005e80 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 msgr2=0x7f742c1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c970 tx=0x7f741c00cd30 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 shutdown_connections 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74100a29d0 0x7f74100a4e90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f742c102c70 0x7f742c1025d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f742c107ed0 0x7f742c101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 --2- 172.21.15.55:0/3570769193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f742c1055a0 0x7f742c100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.443+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 >> 172.21.15.55:0/3570769193 conn(0x7f742c0fc680 msgr2=0x7f742c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:06.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.444+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 shutdown_connections 2024-03-28T05:43:06.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:06.444+0000 7f7432c00700 1 -- 172.21.15.55:0/3570769193 wait complete. 2024-03-28T05:43:07.044 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:06 smithi055 ceph-mon[31863]: pgmap v374: 97 pgs: 97 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-03-28T05:43:07.045 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:06 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-28T05:43:07.045 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:06 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-28T05:43:07.122 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:43:07.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-28T05:43:07.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-28T05:43:07.292 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-28T05:43:07.292 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-28T05:43:07.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph mgr dump --format=json 2024-03-28T05:43:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:06 smithi086 ceph-mon[35163]: pgmap v374: 97 pgs: 97 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-03-28T05:43:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:06 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-28T05:43:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:06 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-28T05:43:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:06 smithi159 ceph-mon[36109]: pgmap v374: 97 pgs: 97 active+clean; 636 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-03-28T05:43:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:06 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-28T05:43:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:06 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3570769193' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-28T05:43:07.804 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:08 smithi055 ceph-mon[31863]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-03-28T05:43:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:08 smithi086 ceph-mon[35163]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-03-28T05:43:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:08 smithi159 ceph-mon[36109]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-03-28T05:43:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 -- 172.21.15.55:0/2235951759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff560102da0 msgr2=0x7ff560106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 --2- 172.21.15.55:0/2235951759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff560102da0 0x7ff560106df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0099c0 tx=0x7ff54c009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 -- 172.21.15.55:0/2235951759 shutdown_connections 2024-03-28T05:43:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 --2- 172.21.15.55:0/2235951759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5601074d0 0x7ff56010f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 --2- 172.21.15.55:0/2235951759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601023f0 0x7ff5601027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 --2- 172.21.15.55:0/2235951759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff560102da0 0x7ff560106df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 -- 172.21.15.55:0/2235951759 >> 172.21.15.55:0/2235951759 conn(0x7ff5600fdc60 msgr2=0x7ff560100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 -- 172.21.15.55:0/2235951759 shutdown_connections 2024-03-28T05:43:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.804+0000 7ff566200700 1 -- 172.21.15.55:0/2235951759 wait complete. 2024-03-28T05:43:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 Processor -- start 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 -- start start 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 0x7ff5600749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601074d0 0x7ff560074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5601123b0 con 0x7ff5601023f0 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560112230 con 0x7ff560102da0 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff566200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560112530 con 0x7ff5601074d0 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.805+0000 7ff55f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48278/0 (socket says 172.21.15.55:48278) 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 -- 172.21.15.55:0/2109922081 learned_addr learned my addr 172.21.15.55:0/2109922081 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55ea00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 0x7ff5600749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55fe00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601074d0 0x7ff560074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 -- 172.21.15.55:0/2109922081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601074d0 msgr2=0x7ff560074f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601074d0 0x7ff560074f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 -- 172.21.15.55:0/2109922081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 msgr2=0x7ff5600749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 0x7ff5600749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 -- 172.21.15.55:0/2109922081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5601a6e70 con 0x7ff5601023f0 2024-03-28T05:43:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55ea00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 0x7ff5600749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.806+0000 7ff55f400700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff55000d980 tx=0x7ff55000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.807+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550017070 con 0x7ff5601023f0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.807+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5601a7160 con 0x7ff5601023f0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.807+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff550004830 con 0x7ff5601023f0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.807+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550005440 con 0x7ff5601023f0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.807+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5601a7650 con 0x7ff5601023f0 2024-03-28T05:43:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.808+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560068e50 con 0x7ff5601023f0 2024-03-28T05:43:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.810+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7ff5500055e0 con 0x7ff5601023f0 2024-03-28T05:43:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.811+0000 7ff557e00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 0x7ff5440a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.811+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5500cea80 con 0x7ff5601023f0 2024-03-28T05:43:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.811+0000 7ff55ea00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 0x7ff5440a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.812+0000 7ff55ea00700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 0x7ff5440a4de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff54c006010 tx=0x7ff54c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:09.816+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7ff5500d0e20 con 0x7ff5601023f0 2024-03-28T05:43:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.112+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff56002db50 con 0x7ff5601023f0 2024-03-28T05:43:10.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.121+0000 7ff557e00700 1 -- 172.21.15.55:0/2109922081 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+262661 (secure 0 0 0) 0x7ff550020020 con 0x7ff5601023f0 2024-03-28T05:43:10.126 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.127+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 msgr2=0x7ff5440a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.127+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 0x7ff5440a4de0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff54c006010 tx=0x7ff54c000bc0 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.127+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 msgr2=0x7ff560074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.127+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff55000d980 tx=0x7ff55000dd40 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 shutdown_connections 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff5440a2920 0x7ff5440a4de0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5601023f0 0x7ff560074490 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff5601074d0 0x7ff560074f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 --2- 172.21.15.55:0/2109922081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff560102da0 0x7ff5600749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 >> 172.21.15.55:0/2109922081 conn(0x7ff5600fdc60 msgr2=0x7ff5600fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 shutdown_connections 2024-03-28T05:43:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:10.128+0000 7ff566200700 1 -- 172.21.15.55:0/2109922081 wait complete. 2024-03-28T05:43:10.944 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3012677107},{"type":"v1","addr":"172.21.15.55:6801","nonce":3012677107}]},"active_addr":"172.21.15.55:6801/3012677107","active_change":"2024-03-28T05:33:17.649494+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.55:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":4121171523}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2922956381}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":3375569098}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2879029074}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":3249780088}]}]} 2024-03-28T05:43:10.950 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-28T05:43:10.950 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-28T05:43:10.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-28T05:43:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:10 smithi055 ceph-mon[31863]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.7 KiB/s wr, 14 op/s 2024-03-28T05:43:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:10 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2109922081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-28T05:43:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:10 smithi086 ceph-mon[35163]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.7 KiB/s wr, 14 op/s 2024-03-28T05:43:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:10 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2109922081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-28T05:43:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:10 smithi159 ceph-mon[36109]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.7 KiB/s wr, 14 op/s 2024-03-28T05:43:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:10 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2109922081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-28T05:43:11.420 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:12 smithi055 ceph-mon[31863]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-03-28T05:43:13.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:12 smithi086 ceph-mon[35163]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-03-28T05:43:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:12 smithi159 ceph-mon[36109]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-03-28T05:43:13.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 -- 172.21.15.55:0/1381288516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 msgr2=0x7faeac10efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 --2- 172.21.15.55:0/1381288516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac10efe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faea400b0d0 tx=0x7faea400b3e0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 -- 172.21.15.55:0/1381288516 shutdown_connections 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 --2- 172.21.15.55:0/1381288516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac10efe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 --2- 172.21.15.55:0/1381288516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac1085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 --2- 172.21.15.55:0/1381288516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 0x7faeac102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 -- 172.21.15.55:0/1381288516 >> 172.21.15.55:0/1381288516 conn(0x7faeac0792c0 msgr2=0x7faeac0796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 -- 172.21.15.55:0/1381288516 shutdown_connections 2024-03-28T05:43:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.447+0000 7faeb1e00700 1 -- 172.21.15.55:0/1381288516 wait complete. 2024-03-28T05:43:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.449+0000 7faeb1e00700 1 Processor -- start 2024-03-28T05:43:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.449+0000 7faeb1e00700 1 -- start start 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 0x7faeac1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1122f0 con 0x7faeac102ba0 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac112170 con 0x7faeac1021e0 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeb1e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac112470 con 0x7faeac1081c0 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeaa000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeaa000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48290/0 (socket says 172.21.15.55:48290) 2024-03-28T05:43:13.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeaa000700 1 -- 172.21.15.55:0/2448503296 learned_addr learned my addr 172.21.15.55:0/2448503296 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:13.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeaaa00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 0x7faeac1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:13.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.450+0000 7faeab400700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 -- 172.21.15.55:0/2448503296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 msgr2=0x7faeac19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 -- 172.21.15.55:0/2448503296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 msgr2=0x7faeac1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 0x7faeac1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 -- 172.21.15.55:0/2448503296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac19d6b0 con 0x7faeac102ba0 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeab400700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeaa000700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9a0 tx=0x7fae9800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9800cbd0 con 0x7faeac102ba0 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fae9800cd70 con 0x7faeac102ba0 2024-03-28T05:43:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98018680 con 0x7faeac102ba0 2024-03-28T05:43:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.451+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac19d9a0 con 0x7faeac102ba0 2024-03-28T05:43:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.452+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac1a5220 con 0x7faeac102ba0 2024-03-28T05:43:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.453+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac068e50 con 0x7faeac102ba0 2024-03-28T05:43:13.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.455+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fae98010430 con 0x7faeac102ba0 2024-03-28T05:43:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.456+0000 7faeb0a00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 0x7fae900a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.456+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fae980ced10 con 0x7faeac102ba0 2024-03-28T05:43:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.456+0000 7faeaaa00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 0x7fae900a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.457+0000 7faeaaa00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 0x7fae900a4e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00ac50 tx=0x7fae9c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.460+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fae980d4020 con 0x7faeac102ba0 2024-03-28T05:43:13.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.685+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeac02da30 con 0x7faeac102ba0 2024-03-28T05:43:13.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.688+0000 7faeb0a00700 1 -- 172.21.15.55:0/2448503296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+22170 (secure 0 0 0) 0x7fae9809bd00 con 0x7faeac102ba0 2024-03-28T05:43:13.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:42:53.691653+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 msgr2=0x7fae900a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 0x7fae900a4e60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00ac50 tx=0x7fae9c00a380 comp rx=0 tx=0).stop 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 msgr2=0x7faeac198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9a0 tx=0x7fae9800ecb0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 shutdown_connections 2024-03-28T05:43:13.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fae900a29a0 0x7fae900a4e60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faeac1081c0 0x7faeac19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faeac1021e0 0x7faeac1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 --2- 172.21.15.55:0/2448503296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeac102ba0 0x7faeac198be0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 >> 172.21.15.55:0/2448503296 conn(0x7faeac0792c0 msgr2=0x7faeac100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.691+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 shutdown_connections 2024-03-28T05:43:13.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:13.692+0000 7faeb1e00700 1 -- 172.21.15.55:0/2448503296 wait complete. 2024-03-28T05:43:14.051 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:13 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2448503296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:13 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2448503296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:14.144 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:13 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2448503296' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:14.437 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-28T05:43:14.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-28T05:43:14.909 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:15.244 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:14 smithi055 ceph-mon[31863]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-28T05:43:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:14 smithi086 ceph-mon[35163]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-28T05:43:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:14 smithi159 ceph-mon[36109]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-28T05:43:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 -- 172.21.15.55:0/2055150834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 msgr2=0x7f8fdc106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/2055150834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc106cd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80099c0 tx=0x7f8fc8009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 -- 172.21.15.55:0/2055150834 shutdown_connections 2024-03-28T05:43:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/2055150834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc10ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/2055150834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 0x7f8fdc1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/2055150834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc106cd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.922+0000 7f8fe1a00700 1 -- 172.21.15.55:0/2055150834 >> 172.21.15.55:0/2055150834 conn(0x7f8fdc0fdb60 msgr2=0x7f8fdc0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.923+0000 7f8fe1a00700 1 -- 172.21.15.55:0/2055150834 shutdown_connections 2024-03-28T05:43:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.923+0000 7f8fe1a00700 1 -- 172.21.15.55:0/2055150834 wait complete. 2024-03-28T05:43:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 Processor -- start 2024-03-28T05:43:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 -- start start 2024-03-28T05:43:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 0x7f8fdc198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc19cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc112270 con 0x7f8fdc102c80 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1120f0 con 0x7f8fdc1073b0 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fe1a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1123f0 con 0x7f8fdc1022d0 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fdb400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fdb400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48320/0 (socket says 172.21.15.55:48320) 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.924+0000 7f8fdb400700 1 -- 172.21.15.55:0/3757841737 learned_addr learned my addr 172.21.15.55:0/3757841737 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdbe00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 0x7f8fdc198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fe1000700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc19cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:16.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 -- 172.21.15.55:0/3757841737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 msgr2=0x7f8fdc198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 0x7f8fdc198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 -- 172.21.15.55:0/3757841737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 msgr2=0x7f8fdc19cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc19cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 -- 172.21.15.55:0/3757841737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc19d710 con 0x7f8fdc102c80 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fe1000700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc19cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.925+0000 7f8fdb400700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8005b40 tx=0x7f8fc80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.926+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8027070 con 0x7f8fdc102c80 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.926+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8fc8003f50 con 0x7f8fdc102c80 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.926+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc19d9a0 con 0x7f8fdc102c80 2024-03-28T05:43:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.926+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8022cd0 con 0x7f8fdc102c80 2024-03-28T05:43:16.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.926+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc1a5280 con 0x7f8fdc102c80 2024-03-28T05:43:16.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.927+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc068e50 con 0x7f8fdc102c80 2024-03-28T05:43:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.929+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f8fc802a070 con 0x7f8fdc102c80 2024-03-28T05:43:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.930+0000 7f8fd8c00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 0x7f8fc00a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.931+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8fc80d0100 con 0x7f8fdc102c80 2024-03-28T05:43:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.931+0000 7f8fdbe00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 0x7f8fc00a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:16.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.931+0000 7f8fdbe00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 0x7f8fc00a4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00ac50 tx=0x7f8fcc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:16.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:16.933+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8fc8031020 con 0x7f8fdc102c80 2024-03-28T05:43:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:16 smithi055 ceph-mon[31863]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:43:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.161+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fdc02da30 con 0x7f8fdc102c80 2024-03-28T05:43:17.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.165+0000 7f8fd8c00700 1 -- 172.21.15.55:0/3757841737 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+22170 (secure 0 0 0) 0x7f8fc8013070 con 0x7f8fdc102c80 2024-03-28T05:43:17.168 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:43:17.168 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:42:53.691653+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 msgr2=0x7f8fc00a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 0x7f8fc00a4e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00ac50 tx=0x7f8fcc00a380 comp rx=0 tx=0).stop 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 msgr2=0x7f8fdc198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8005b40 tx=0x7f8fc80057a0 comp rx=0 tx=0).stop 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 shutdown_connections 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8fc00a29a0 0x7f8fc00a4e60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fdc1073b0 0x7f8fdc19cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:17.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fdc1022d0 0x7f8fdc198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 --2- 172.21.15.55:0/3757841737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fdc102c80 0x7f8fdc198c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 >> 172.21.15.55:0/3757841737 conn(0x7f8fdc0fdb60 msgr2=0x7f8fdc0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 shutdown_connections 2024-03-28T05:43:17.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:17.168+0000 7f8fe1a00700 1 -- 172.21.15.55:0/3757841737 wait complete. 2024-03-28T05:43:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:16 smithi086 ceph-mon[35163]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:43:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:16 smithi159 ceph-mon[36109]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:43:18.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-28T05:43:18.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-28T05:43:18.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-28T05:43:18.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-28T05:43:18.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-28T05:43:18.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-28T05:43:18.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-28T05:43:18.014 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-28T05:43:18.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-28T05:43:18.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-28T05:43:18.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-28T05:43:18.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3757841737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.155 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-28T05:43:18.156 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.156 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-28T05:43:18.156 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.156 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3757841737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-28T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3757841737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-03-28T05:43:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-03-28T05:43:18.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-28T05:43:19.102 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:19.196 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-03-28T05:43:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-28T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-28T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-28T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-03-28T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-28T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:18 smithi086 ceph-mon[35163]: osdmap e91: 12 total, 12 up, 12 in 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-28T05:43:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-03-28T05:43:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-28T05:43:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:18 smithi159 ceph-mon[36109]: osdmap e91: 12 total, 12 up, 12 in 2024-03-28T05:43:19.327 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 7 op/s 2024-03-28T05:43:19.327 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-28T05:43:19.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:18 smithi055 ceph-mon[31863]: osdmap e91: 12 total, 12 up, 12 in 2024-03-28T05:43:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:19 smithi055 ceph-mon[31863]: osdmap e92: 12 total, 12 up, 12 in 2024-03-28T05:43:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:19 smithi086 ceph-mon[35163]: osdmap e92: 12 total, 12 up, 12 in 2024-03-28T05:43:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:19 smithi159 ceph-mon[36109]: osdmap e92: 12 total, 12 up, 12 in 2024-03-28T05:43:21.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:20 smithi055 ceph-mon[31863]: pgmap v383: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:20 smithi086 ceph-mon[35163]: pgmap v383: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:20 smithi159 ceph-mon[36109]: pgmap v383: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.697 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.697 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.700 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.701 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:23.286 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:22 smithi055 ceph-mon[31863]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 639 B/s wr, 4 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:22 smithi086 ceph-mon[35163]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 639 B/s wr, 4 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:22 smithi159 ceph-mon[36109]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 639 B/s wr, 4 op/s; 20 B/s, 0 objects/s recovering 2024-03-28T05:43:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:24 smithi086 ceph-mon[35163]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:24 smithi159 ceph-mon[36109]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:25.330 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:24 smithi055 ceph-mon[31863]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:26 smithi055 ceph-mon[31863]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:26 smithi086 ceph-mon[35163]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:26 smithi159 ceph-mon[36109]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 146 B/s, 0 objects/s recovering 2024-03-28T05:43:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:28 smithi086 ceph-mon[35163]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 5 op/s; 118 B/s, 0 objects/s recovering 2024-03-28T05:43:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:28 smithi159 ceph-mon[36109]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 5 op/s; 118 B/s, 0 objects/s recovering 2024-03-28T05:43:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:28 smithi055 ceph-mon[31863]: pgmap v387: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 5 op/s; 118 B/s, 0 objects/s recovering 2024-03-28T05:43:29.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 -- 172.21.15.55:0/3878417000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 msgr2=0x7fcfd810f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 --2- 172.21.15.55:0/3878417000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd810f040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b0a0 tx=0x7fcfd000b3b0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 -- 172.21.15.55:0/3878417000 shutdown_connections 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 --2- 172.21.15.55:0/3878417000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd810f040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 --2- 172.21.15.55:0/3878417000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd8108290 0x7fcfd8108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 --2- 172.21.15.55:0/3878417000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfd81021e0 0x7fcfd8102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 -- 172.21.15.55:0/3878417000 >> 172.21.15.55:0/3878417000 conn(0x7fcfd80792c0 msgr2=0x7fcfd80796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 -- 172.21.15.55:0/3878417000 shutdown_connections 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.021+0000 7fcfe0000700 1 -- 172.21.15.55:0/3878417000 wait complete. 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.022+0000 7fcfe0000700 1 Processor -- start 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.022+0000 7fcfe0000700 1 -- start start 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd81021e0 0x7fcfd819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:29.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfd8108290 0x7fcfd81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd8112350 con 0x7fcfd8102ba0 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd81121d0 con 0x7fcfd81021e0 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfe0000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd81124d0 con 0x7fcfd8108290 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfdcc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfdcc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41234/0 (socket says 172.21.15.55:41234) 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfdcc00700 1 -- 172.21.15.55:0/2916416485 learned_addr learned my addr 172.21.15.55:0/2916416485 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.023+0000 7fcfdd600700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd81021e0 0x7fcfd819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfde000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfd8108290 0x7fcfd81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 -- 172.21.15.55:0/2916416485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfd8108290 msgr2=0x7fcfd81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfd8108290 0x7fcfd81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 -- 172.21.15.55:0/2916416485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd81021e0 msgr2=0x7fcfd819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd81021e0 0x7fcfd819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8198d50 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdd600700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfd81021e0 0x7fcfd819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.024+0000 7fcfdcc00700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd819e970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c920 tx=0x7fcfc400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.025+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4007b00 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.025+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd8199040 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.025+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcfc4004ce0 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.025+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40054b0 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.025+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd81a5300 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.026+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfd80628a0 con 0x7fcfd8102ba0 2024-03-28T05:43:29.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.029+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fcfc4004750 con 0x7fcfd8102ba0 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.031+0000 7fcfd6000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcfc00a29a0 0x7fcfc00a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.031+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcfc40ceb40 con 0x7fcfd8102ba0 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.031+0000 7fcfd6000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] conn(0x7fcfc00ac560 0x7fcfc00aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.031+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfc401ae50 con 0x7fcfc00ac560 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.032+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc40ceef0 con 0x7fcfd8102ba0 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.032+0000 7fcfdd600700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcfc00a29a0 0x7fcfc00a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:29.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.032+0000 7fcfde000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] conn(0x7fcfc00ac560 0x7fcfc00aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.033+0000 7fcfdd600700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcfc00a29a0 0x7fcfc00a4e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc005950 tx=0x7fcfcc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.033+0000 7fcfde000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] conn(0x7fcfc00ac560 0x7fcfc00aea00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.034+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== osd.0 v2:172.21.15.55:6802/2006201392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcfc401ae50 con 0x7fcfc00ac560 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.052+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 --> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfd8062ca0 con 0x7fcfc00ac560 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfd6000700 1 -- 172.21.15.55:0/2916416485 <== osd.0 v2:172.21.15.55:6802/2006201392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfd8062ca0 con 0x7fcfc00ac560 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] conn(0x7fcfc00ac560 msgr2=0x7fcfc00aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] conn(0x7fcfc00ac560 0x7fcfc00aea00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcfc00a29a0 msgr2=0x7fcfc00a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcfc00a29a0 0x7fcfc00a4e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc005950 tx=0x7fcfcc0058e0 comp rx=0 tx=0).stop 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 msgr2=0x7fcfd819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:29.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 --2- 172.21.15.55:0/2916416485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfd8102ba0 0x7fcfd819e970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c920 tx=0x7fcfc400cc30 comp rx=0 tx=0).stop 2024-03-28T05:43:29.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfde000700 1 -- 172.21.15.55:0/2916416485 reap_dead start 2024-03-28T05:43:29.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 shutdown_connections 2024-03-28T05:43:29.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.053+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 >> 172.21.15.55:0/2916416485 conn(0x7fcfd80792c0 msgr2=0x7fcfd81010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:29.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.054+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 shutdown_connections 2024-03-28T05:43:29.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:27.054+0000 7fcfe0000700 1 -- 172.21.15.55:0/2916416485 wait complete. 2024-03-28T05:43:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 -- 172.21.15.55:0/3206170374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c107080 msgr2=0x7ff46c069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 --2- 172.21.15.55:0/3206170374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c107080 0x7ff46c069e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00b0a0 tx=0x7ff45c00b3b0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 -- 172.21.15.55:0/3206170374 shutdown_connections 2024-03-28T05:43:31.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 --2- 172.21.15.55:0/3206170374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c107080 0x7ff46c069e40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 --2- 172.21.15.55:0/3206170374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff46c104b90 0x7ff46c105020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 --2- 172.21.15.55:0/3206170374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46c06a380 0x7ff46c06a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 -- 172.21.15.55:0/3206170374 >> 172.21.15.55:0/3206170374 conn(0x7ff46c077fc0 msgr2=0x7ff46c0783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 -- 172.21.15.55:0/3206170374 shutdown_connections 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.609+0000 7ff473000700 1 -- 172.21.15.55:0/3206170374 wait complete. 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.610+0000 7ff473000700 1 Processor -- start 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 -- start start 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 0x7ff46c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff46c104b90 0x7ff46c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46c107080 0x7ff46c1a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c118990 con 0x7ff46c06a380 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c118810 con 0x7ff46c104b90 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.611+0000 7ff473000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c118b10 con 0x7ff46c107080 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 0x7ff46c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 0x7ff46c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51426/0 (socket says 172.21.15.55:51426) 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 -- 172.21.15.55:0/4037195554 learned_addr learned my addr 172.21.15.55:0/4037195554 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff463400700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff46c104b90 0x7ff46c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff471000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46c107080 0x7ff46c1a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 -- 172.21.15.55:0/4037195554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46c107080 msgr2=0x7ff46c1a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff46c107080 0x7ff46c1a3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 -- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff46c104b90 msgr2=0x7ff46c19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff46c104b90 0x7ff46c19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c1a3eb0 con 0x7ff46c06a380 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.612+0000 7ff46be00700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 0x7ff46c19ef40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00b070 tx=0x7ff45c004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.613+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c021070 con 0x7ff46c06a380 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.613+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff45c007db0 con 0x7ff46c06a380 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.613+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c1a4140 con 0x7ff46c06a380 2024-03-28T05:43:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.613+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c1aba20 con 0x7ff46c06a380 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.613+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c01d450 con 0x7ff46c06a380 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.614+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff46c100ae0 con 0x7ff46c06a380 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.616+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7ff45c004140 con 0x7ff46c06a380 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.617+0000 7ff469600700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff4500a29a0 0x7ff4500a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff45c00f020 con 0x7ff46c06a380 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff463400700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff4500a29a0 0x7ff4500a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff469600700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] conn(0x7ff4500ac430 0x7ff4500ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff45c026e50 con 0x7ff4500ac430 2024-03-28T05:43:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff45c0d0870 con 0x7ff46c06a380 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.618+0000 7ff463400700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff4500a29a0 0x7ff4500a4e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.619+0000 7ff471000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] conn(0x7ff4500ac430 0x7ff4500ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.619+0000 7ff471000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] conn(0x7ff4500ac430 0x7ff4500ae8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.622+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== osd.7 v2:172.21.15.86:6816/3390667682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff45c026e50 con 0x7ff4500ac430 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.640+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 --> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff46c101670 con 0x7ff4500ac430 2024-03-28T05:43:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.641+0000 7ff469600700 1 -- 172.21.15.55:0/4037195554 <== osd.7 v2:172.21.15.86:6816/3390667682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff46c101670 con 0x7ff4500ac430 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] conn(0x7ff4500ac430 msgr2=0x7ff4500ae8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] conn(0x7ff4500ac430 0x7ff4500ae8d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff4500a29a0 msgr2=0x7ff4500a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff4500a29a0 0x7ff4500a4e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).stop 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 msgr2=0x7ff46c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 --2- 172.21.15.55:0/4037195554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff46c06a380 0x7ff46c19ef40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00b070 tx=0x7ff45c004ef0 comp rx=0 tx=0).stop 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff471000700 1 -- 172.21.15.55:0/4037195554 reap_dead start 2024-03-28T05:43:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 shutdown_connections 2024-03-28T05:43:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 >> 172.21.15.55:0/4037195554 conn(0x7ff46c077fc0 msgr2=0x7ff46c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 shutdown_connections 2024-03-28T05:43:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:30.642+0000 7ff473000700 1 -- 172.21.15.55:0/4037195554 wait complete. 2024-03-28T05:43:31.304 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:31 smithi055 ceph-mon[31863]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 5 op/s; 107 B/s, 0 objects/s recovering 2024-03-28T05:43:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:31 smithi086 ceph-mon[35163]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 5 op/s; 107 B/s, 0 objects/s recovering 2024-03-28T05:43:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:31 smithi159 ceph-mon[36109]: pgmap v388: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 5 op/s; 107 B/s, 0 objects/s recovering 2024-03-28T05:43:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 -- 172.21.15.55:0/2668926003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce0109160 msgr2=0x7fbce0115670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2668926003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce0109160 0x7fbce0115670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b0a0 tx=0x7fbcd800b3b0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 -- 172.21.15.55:0/2668926003 shutdown_connections 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2668926003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce0109160 0x7fbce0115670 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2668926003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbce010e7a0 0x7fbce010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2668926003 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce01087a0 0x7fbce0108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 -- 172.21.15.55:0/2668926003 >> 172.21.15.55:0/2668926003 conn(0x7fbce0075960 msgr2=0x7fbce0077d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 -- 172.21.15.55:0/2668926003 shutdown_connections 2024-03-28T05:43:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.558+0000 7fbce5c00700 1 -- 172.21.15.55:0/2668926003 wait complete. 2024-03-28T05:43:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 Processor -- start 2024-03-28T05:43:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 -- start start 2024-03-28T05:43:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce01087a0 0x7fbce019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbce0109160 0x7fbce019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 0x7fbce01a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0118980 con 0x7fbce010e7a0 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0118800 con 0x7fbce0109160 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbce5c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0118b00 con 0x7fbce01087a0 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.560+0000 7fbcdf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 0x7fbce01a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 0x7fbce01a35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51442/0 (socket says 172.21.15.55:51442) 2024-03-28T05:43:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 -- 172.21.15.55:0/2458227228 learned_addr learned my addr 172.21.15.55:0/2458227228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcde000700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbce0109160 0x7fbce019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdea00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce01087a0 0x7fbce019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 -- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce01087a0 msgr2=0x7fbce019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce01087a0 0x7fbce019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 -- 172.21.15.55:0/2458227228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbce0109160 msgr2=0x7fbce019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbce0109160 0x7fbce019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce01a3d20 con 0x7fbce010e7a0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.561+0000 7fbcdf400700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 0x7fbce01a35e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b830 tx=0x7fbcd8004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.562+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8021070 con 0x7fbce010e7a0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.562+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbcd8003c00 con 0x7fbce010e7a0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.562+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce01a3fb0 con 0x7fbce010e7a0 2024-03-28T05:43:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.562+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8004790 con 0x7fbce010e7a0 2024-03-28T05:43:32.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.562+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce01ab890 con 0x7fbce010e7a0 2024-03-28T05:43:32.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.563+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbce0076840 con 0x7fbce010e7a0 2024-03-28T05:43:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.565+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fbcd8007a00 con 0x7fbce010e7a0 2024-03-28T05:43:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.566+0000 7fbcd7400700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbcc40a29a0 0x7fbcc40a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbcd80d0210 con 0x7fbce010e7a0 2024-03-28T05:43:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcdea00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbcc40a29a0 0x7fbcc40a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcd7400700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] conn(0x7fbcc40ac560 0x7fbcc40aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcc40af0d0 con 0x7fbcc40ac560 2024-03-28T05:43:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcd80d05c0 con 0x7fbce010e7a0 2024-03-28T05:43:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.567+0000 7fbcdea00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbcc40a29a0 0x7fbcc40a4e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005950 tx=0x7fbcd00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.568+0000 7fbcde000700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] conn(0x7fbcc40ac560 0x7fbcc40aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.568+0000 7fbcde000700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] conn(0x7fbcc40ac560 0x7fbcc40aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:32.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.570+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== osd.5 v2:172.21.15.159:6808/2204866007 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbcc40af0d0 con 0x7fbcc40ac560 2024-03-28T05:43:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.589+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 --> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbce0109ee0 con 0x7fbcc40ac560 2024-03-28T05:43:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbcd7400700 1 -- 172.21.15.55:0/2458227228 <== osd.5 v2:172.21.15.159:6808/2204866007 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbce0109ee0 con 0x7fbcc40ac560 2024-03-28T05:43:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] conn(0x7fbcc40ac560 msgr2=0x7fbcc40aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] conn(0x7fbcc40ac560 0x7fbcc40aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbcc40a29a0 msgr2=0x7fbcc40a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbcc40a29a0 0x7fbcc40a4e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005950 tx=0x7fbcd00058e0 comp rx=0 tx=0).stop 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 msgr2=0x7fbce01a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 --2- 172.21.15.55:0/2458227228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbce010e7a0 0x7fbce01a35e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b830 tx=0x7fbcd8004d90 comp rx=0 tx=0).stop 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbcdf400700 1 -- 172.21.15.55:0/2458227228 reap_dead start 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 shutdown_connections 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.590+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 >> 172.21.15.55:0/2458227228 conn(0x7fbce0075960 msgr2=0x7fbce0075de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.591+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 shutdown_connections 2024-03-28T05:43:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:32.591+0000 7fbce5c00700 1 -- 172.21.15.55:0/2458227228 wait complete. 2024-03-28T05:43:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:33 smithi086 ceph-mon[35163]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:33 smithi159 ceph-mon[36109]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:33.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:33 smithi055 ceph-mon[31863]: pgmap v389: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:33.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 -- 172.21.15.55:0/470187946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 msgr2=0x7effa41085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 --2- 172.21.15.55:0/470187946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa41085c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff940099c0 tx=0x7eff94009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 -- 172.21.15.55:0/470187946 shutdown_connections 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 --2- 172.21.15.55:0/470187946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa41085c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 --2- 172.21.15.55:0/470187946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa406a7e0 0x7effa410f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 --2- 172.21.15.55:0/470187946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effa4069e40 0x7effa406a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.565+0000 7effa8e00700 1 -- 172.21.15.55:0/470187946 >> 172.21.15.55:0/470187946 conn(0x7effa4077fc0 msgr2=0x7effa40783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.566+0000 7effa8e00700 1 -- 172.21.15.55:0/470187946 shutdown_connections 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.566+0000 7effa8e00700 1 -- 172.21.15.55:0/470187946 wait complete. 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 Processor -- start 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 -- start start 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effa4069e40 0x7effa41a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa406a7e0 0x7effa41a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:33.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4112320 con 0x7effa41081e0 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa41121a0 con 0x7effa4069e40 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.567+0000 7effa8e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa41124a0 con 0x7effa406a7e0 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51460/0 (socket says 172.21.15.55:51460) 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 -- 172.21.15.55:0/1302839034 learned_addr learned my addr 172.21.15.55:0/1302839034 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa1e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effa4069e40 0x7effa41a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa1400700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa406a7e0 0x7effa41a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 -- 172.21.15.55:0/1302839034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa406a7e0 msgr2=0x7effa41a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effa406a7e0 0x7effa41a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 -- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effa4069e40 msgr2=0x7effa41a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7effa4069e40 0x7effa41a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.568+0000 7effa2800700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa419b000 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7effa2800700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa419a8a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00ada0 tx=0x7eff9c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c017020 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7eff9c00ce30 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa419b2f0 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c005460 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.569+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa41a75b0 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.570+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effa410ddd0 con 0x7effa41081e0 2024-03-28T05:43:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.573+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7eff9c00c980 con 0x7effa41081e0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.574+0000 7eff9aa00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7eff880a29a0 0x7eff880a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.574+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7eff9c0ced80 con 0x7effa41081e0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.575+0000 7effa1e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7eff880a29a0 0x7eff880a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.575+0000 7eff9aa00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] conn(0x7eff880ac560 0x7eff880aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.575+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff9c022e50 con 0x7eff880ac560 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.575+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff9c0cf130 con 0x7effa41081e0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.575+0000 7effa1400700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] conn(0x7eff880ac560 0x7eff880aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.576+0000 7effa1e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7eff880a29a0 0x7eff880a4e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff94000c00 tx=0x7eff94005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.576+0000 7effa1400700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] conn(0x7eff880ac560 0x7eff880aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:33.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.578+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== osd.1 v2:172.21.15.86:6800/2855371338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7eff9c022e50 con 0x7eff880ac560 2024-03-28T05:43:33.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.599+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 --> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7effa4103890 con 0x7eff880ac560 2024-03-28T05:43:33.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7eff9aa00700 1 -- 172.21.15.55:0/1302839034 <== osd.1 v2:172.21.15.86:6800/2855371338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7effa4103890 con 0x7eff880ac560 2024-03-28T05:43:33.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] conn(0x7eff880ac560 msgr2=0x7eff880aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] conn(0x7eff880ac560 0x7eff880aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7eff880a29a0 msgr2=0x7eff880a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7eff880a29a0 0x7eff880a4e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff94000c00 tx=0x7eff94005fb0 comp rx=0 tx=0).stop 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 msgr2=0x7effa419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa8e00700 1 --2- 172.21.15.55:0/1302839034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effa41081e0 0x7effa419a8a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00ada0 tx=0x7eff9c00c330 comp rx=0 tx=0).stop 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.600+0000 7effa2800700 1 -- 172.21.15.55:0/1302839034 reap_dead start 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.601+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 shutdown_connections 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.601+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 >> 172.21.15.55:0/1302839034 conn(0x7effa4077fc0 msgr2=0x7effa410d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.601+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 shutdown_connections 2024-03-28T05:43:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:33.601+0000 7effa8e00700 1 -- 172.21.15.55:0/1302839034 wait complete. 2024-03-28T05:43:35.019 INFO:teuthology.orchestra.run.smithi055.stdout:34359738466 2024-03-28T05:43:35.019 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-28T05:43:35.234 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:35 smithi055 ceph-mon[31863]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 -- 172.21.15.55:0/3188009697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0560069e40 msgr2=0x7f056006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 --2- 172.21.15.55:0/3188009697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0560069e40 0x7f056006a220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0550009990 tx=0x7f0550009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 -- 172.21.15.55:0/3188009697 shutdown_connections 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 --2- 172.21.15.55:0/3188009697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0560069e40 0x7f056006a220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 --2- 172.21.15.55:0/3188009697 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f056010ec40 0x7f0560111030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 --2- 172.21.15.55:0/3188009697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056006a760 0x7f056010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 -- 172.21.15.55:0/3188009697 >> 172.21.15.55:0/3188009697 conn(0x7f0560077fc0 msgr2=0x7f05600783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 -- 172.21.15.55:0/3188009697 shutdown_connections 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.232+0000 7f0564e00700 1 -- 172.21.15.55:0/3188009697 wait complete. 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.233+0000 7f0564e00700 1 Processor -- start 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.233+0000 7f0564e00700 1 -- start start 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0560069e40 0x7f05601a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056006a760 0x7f05601a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 0x7f056019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0560114570 con 0x7f056010ec40 2024-03-28T05:43:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601143f0 con 0x7f056006a760 2024-03-28T05:43:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f0564e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601146f0 con 0x7f0560069e40 2024-03-28T05:43:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f055e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 0x7f056019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f055d400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056006a760 0x7f05601a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f055e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 0x7f056019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51482/0 (socket says 172.21.15.55:51482) 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.234+0000 7f055e800700 1 -- 172.21.15.55:0/4189561737 learned_addr learned my addr 172.21.15.55:0/4189561737 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055de00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0560069e40 0x7f05601a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 -- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0560069e40 msgr2=0x7f05601a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0560069e40 0x7f05601a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 -- 172.21.15.55:0/4189561737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056006a760 msgr2=0x7f05601a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056006a760 0x7f05601a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056019b0d0 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.235+0000 7f055e800700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 0x7f056019a970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05580094f0 tx=0x7f055800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.236+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558004db0 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.236+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0558009e20 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.236+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558015400 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.236+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056019b3c0 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.236+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601a7680 con 0x7f056010ec40 2024-03-28T05:43:35.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.237+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05600628a0 con 0x7f056010ec40 2024-03-28T05:43:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.239+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f05580052d0 con 0x7f056010ec40 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.240+0000 7f0556a00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f05440a29a0 0x7f05440a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f05580cef90 con 0x7f056010ec40 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f055de00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f05440a29a0 0x7f05440a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f0556a00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] conn(0x7f05440ac560 0x7f05440aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0558025e50 con 0x7f05440ac560 2024-03-28T05:43:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05580cf470 con 0x7f056010ec40 2024-03-28T05:43:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.241+0000 7f055de00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f05440a29a0 0x7f05440a4e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f056019bab0 tx=0x7f055000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.242+0000 7f055d400700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] conn(0x7f05440ac560 0x7f05440aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.242+0000 7f055d400700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] conn(0x7f05440ac560 0x7f05440aea00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:35.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.245+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== osd.2 v2:172.21.15.159:6800/1186747066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0558025e50 con 0x7f05440ac560 2024-03-28T05:43:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.264+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 --> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0560062d20 con 0x7f05440ac560 2024-03-28T05:43:35.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.265+0000 7f0556a00700 1 -- 172.21.15.55:0/4189561737 <== osd.2 v2:172.21.15.159:6800/1186747066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0560062d20 con 0x7f05440ac560 2024-03-28T05:43:35.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] conn(0x7f05440ac560 msgr2=0x7f05440aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] conn(0x7f05440ac560 0x7f05440aea00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f05440a29a0 msgr2=0x7f05440a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f05440a29a0 0x7f05440a4e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f056019bab0 tx=0x7f055000b540 comp rx=0 tx=0).stop 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 msgr2=0x7f056019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 --2- 172.21.15.55:0/4189561737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056010ec40 0x7f056019a970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f05580094f0 tx=0x7f055800d3b0 comp rx=0 tx=0).stop 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f055e800700 1 -- 172.21.15.55:0/4189561737 reap_dead start 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 shutdown_connections 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 >> 172.21.15.55:0/4189561737 conn(0x7f0560077fc0 msgr2=0x7f05601103b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 shutdown_connections 2024-03-28T05:43:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.266+0000 7f0564e00700 1 -- 172.21.15.55:0/4189561737 wait complete. 2024-03-28T05:43:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:35 smithi086 ceph-mon[35163]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:35 smithi159 ceph-mon[36109]: pgmap v390: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s; 84 B/s, 0 objects/s recovering 2024-03-28T05:43:36.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 -- 172.21.15.55:0/4231431091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 msgr2=0x7f973c108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 --2- 172.21.15.55:0/4231431091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c108690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f972c009990 tx=0x7f972c009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 -- 172.21.15.55:0/4231431091 shutdown_connections 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 --2- 172.21.15.55:0/4231431091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c108690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 --2- 172.21.15.55:0/4231431091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102c00 0x7f973c10eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 --2- 172.21.15.55:0/4231431091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f973c102240 0x7f973c1026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 -- 172.21.15.55:0/4231431091 >> 172.21.15.55:0/4231431091 conn(0x7f973c079260 msgr2=0x7f973c079670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 -- 172.21.15.55:0/4231431091 shutdown_connections 2024-03-28T05:43:36.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.859+0000 7f9741800700 1 -- 172.21.15.55:0/4231431091 wait complete. 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.860+0000 7f9741800700 1 Processor -- start 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 -- start start 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102240 0x7f973c074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f973c102c00 0x7f973c0749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c112470 con 0x7f973c1082b0 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1122f0 con 0x7f973c102c00 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f9741800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1125f0 con 0x7f973c102240 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.861+0000 7f973b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:36.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c074f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51498/0 (socket says 172.21.15.55:51498) 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 -- 172.21.15.55:0/3852311008 learned_addr learned my addr 172.21.15.55:0/3852311008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973a000700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f973c102c00 0x7f973c0749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973aa00700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102240 0x7f973c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 -- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102240 msgr2=0x7f973c074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102240 0x7f973c074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 -- 172.21.15.55:0/3852311008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f973c102c00 msgr2=0x7f973c0749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f973c102c00 0x7f973c0749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c1a6ed0 con 0x7f973c1082b0 2024-03-28T05:43:36.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973aa00700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f973c102240 0x7f973c074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.862+0000 7f973b400700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c074f10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f973400ada0 tx=0x7f973400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.863+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734017020 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.863+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f973400ce30 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.863+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734005350 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.863+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c1a71c0 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.863+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1a7750 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.864+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f973c062860 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.866+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f973400c980 con 0x7f973c1082b0 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.867+0000 7f9733400700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f97200a29a0 0x7f97200a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:36.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f97340ceca0 con 0x7f973c1082b0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f973aa00700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f97200a29a0 0x7f97200a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f9733400700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] conn(0x7f97200ac560 0x7f97200aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9734022e50 con 0x7f97200ac560 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97340cf050 con 0x7f973c1082b0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.868+0000 7f973a000700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] conn(0x7f97200ac560 0x7f97200aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.869+0000 7f973aa00700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f97200a29a0 0x7f97200a4e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f972c00b5c0 tx=0x7f972c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.869+0000 7f973a000700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] conn(0x7f97200ac560 0x7f97200aea00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.872+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== osd.8 v2:172.21.15.159:6816/4245320261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9734022e50 con 0x7f97200ac560 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.890+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 --> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f973c062c90 con 0x7f97200ac560 2024-03-28T05:43:36.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.891+0000 7f9733400700 1 -- 172.21.15.55:0/3852311008 <== osd.8 v2:172.21.15.159:6816/4245320261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f973c062c90 con 0x7f97200ac560 2024-03-28T05:43:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.891+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] conn(0x7f97200ac560 msgr2=0x7f97200aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.891+0000 7f9741800700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] conn(0x7f97200ac560 0x7f97200aea00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:36.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f97200a29a0 msgr2=0x7f97200a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f97200a29a0 0x7f97200a4e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f972c00b5c0 tx=0x7f972c01a040 comp rx=0 tx=0).stop 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 msgr2=0x7f973c074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 --2- 172.21.15.55:0/3852311008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f973c1082b0 0x7f973c074f10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f973400ada0 tx=0x7f973400c330 comp rx=0 tx=0).stop 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f973b400700 1 -- 172.21.15.55:0/3852311008 reap_dead start 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 shutdown_connections 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 >> 172.21.15.55:0/3852311008 conn(0x7f973c079260 msgr2=0x7f973c101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 shutdown_connections 2024-03-28T05:43:36.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:35.892+0000 7f9741800700 1 -- 172.21.15.55:0/3852311008 wait complete. 2024-03-28T05:43:37.006 INFO:teuthology.orchestra.run.smithi055.stdout:171798691906 2024-03-28T05:43:37.007 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-28T05:43:37.220 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:37 smithi055 ceph-mon[31863]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-28T05:43:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:37 smithi086 ceph-mon[35163]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-28T05:43:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:37 smithi159 ceph-mon[36109]: pgmap v391: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-28T05:43:37.358 INFO:teuthology.orchestra.run.smithi055.stdout:231928234036 2024-03-28T05:43:37.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 -- 172.21.15.55:0/2586696192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e4074e80 msgr2=0x7f74e410e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 --2- 172.21.15.55:0/2586696192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e4074e80 0x7f74e410e510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009990 tx=0x7f74d0009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 -- 172.21.15.55:0/2586696192 shutdown_connections 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 --2- 172.21.15.55:0/2586696192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e410ea50 0x7f74e4110e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 --2- 172.21.15.55:0/2586696192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e4074560 0x7f74e4074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 --2- 172.21.15.55:0/2586696192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e4074e80 0x7f74e410e510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 -- 172.21.15.55:0/2586696192 >> 172.21.15.55:0/2586696192 conn(0x7f74e40fdc60 msgr2=0x7f74e4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.660+0000 7f74e9800700 1 -- 172.21.15.55:0/2586696192 shutdown_connections 2024-03-28T05:43:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.661+0000 7f74e9800700 1 -- 172.21.15.55:0/2586696192 wait complete. 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.662+0000 7f74e9800700 1 Processor -- start 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.662+0000 7f74e9800700 1 -- start start 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.662+0000 7f74e9800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e4074560 0x7f74e41a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.662+0000 7f74e9800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e4074e80 0x7f74e41a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e9800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 0x7f74e419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e9800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4114610 con 0x7f74e410ea50 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e9800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4114490 con 0x7f74e4074560 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e9800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4114790 con 0x7f74e4074e80 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 0x7f74e419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 0x7f74e419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51470/0 (socket says 172.21.15.55:51470) 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 -- 172.21.15.55:0/2716925423 learned_addr learned my addr 172.21.15.55:0/2716925423 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e2a00700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e4074560 0x7f74e41a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e2000700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e4074e80 0x7f74e41a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:37.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 -- 172.21.15.55:0/2716925423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e4074e80 msgr2=0x7f74e41a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74e4074e80 0x7f74e41a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 -- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e4074560 msgr2=0x7f74e41a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e4074560 0x7f74e41a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.663+0000 7f74e3400700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e419b030 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74e3400700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 0x7f74e419a8d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00b9e0 tx=0x7f74dc00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc019070 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f74dc00cde0 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc012340 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e419b320 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.664+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e41a75e0 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.665+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74e40628e0 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.667+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f74dc01c070 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74db400700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74c80a2920 0x7f74c80a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f74dc0cdff0 con 0x7f74e410ea50 2024-03-28T05:43:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74e2a00700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74c80a2920 0x7f74c80a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74db400700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] conn(0x7f74c80ac4e0 0x7f74c80ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74dc015e80 con 0x7f74c80ac4e0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.669+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74dc0d5050 con 0x7f74e410ea50 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.670+0000 7f74e2a00700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74c80a2920 0x7f74c80a4de0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74e419ba10 tx=0x7f74d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.670+0000 7f74e2000700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] conn(0x7f74c80ac4e0 0x7f74c80ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.671+0000 7f74e2000700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] conn(0x7f74c80ac4e0 0x7f74c80ae980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.674+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== osd.4 v2:172.21.15.86:6808/3228408788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f74dc015e80 con 0x7f74c80ac4e0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.693+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 --> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74e4062d60 con 0x7f74c80ac4e0 2024-03-28T05:43:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.693+0000 7f74db400700 1 -- 172.21.15.55:0/2716925423 <== osd.4 v2:172.21.15.86:6808/3228408788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f74e4062d60 con 0x7f74c80ac4e0 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] conn(0x7f74c80ac4e0 msgr2=0x7f74c80ae980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] conn(0x7f74c80ac4e0 0x7f74c80ae980 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74c80a2920 msgr2=0x7f74c80a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f74c80a2920 0x7f74c80a4de0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74e419ba10 tx=0x7f74d400b410 comp rx=0 tx=0).stop 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 msgr2=0x7f74e419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e9800700 1 --2- 172.21.15.55:0/2716925423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74e410ea50 0x7f74e419a8d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00b9e0 tx=0x7f74dc00bcf0 comp rx=0 tx=0).stop 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.694+0000 7f74e3400700 1 -- 172.21.15.55:0/2716925423 reap_dead start 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.695+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 shutdown_connections 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.695+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 >> 172.21.15.55:0/2716925423 conn(0x7f74e40fdc60 msgr2=0x7f74e40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.695+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 shutdown_connections 2024-03-28T05:43:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:34.695+0000 7f74e9800700 1 -- 172.21.15.55:0/2716925423 wait complete. 2024-03-28T05:43:38.690 INFO:teuthology.orchestra.run.smithi055.stdout:55834574942 2024-03-28T05:43:38.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-28T05:43:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:39 smithi086 ceph-mon[35163]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-28T05:43:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:39 smithi159 ceph-mon[36109]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-28T05:43:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:39 smithi055 ceph-mon[31863]: pgmap v392: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.249+0000 7f515f800700 1 -- 172.21.15.55:0/3276174920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5158102d80 msgr2=0x7f5158106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.249+0000 7f515f800700 1 --2- 172.21.15.55:0/3276174920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5158102d80 0x7f5158106dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51440099c0 tx=0x7f5144009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 -- 172.21.15.55:0/3276174920 shutdown_connections 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 --2- 172.21.15.55:0/3276174920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51581074b0 0x7f515810f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 --2- 172.21.15.55:0/3276174920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51581023d0 0x7f51581027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 --2- 172.21.15.55:0/3276174920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5158102d80 0x7f5158106dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 -- 172.21.15.55:0/3276174920 >> 172.21.15.55:0/3276174920 conn(0x7f51580fdc40 msgr2=0x7f5158100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 -- 172.21.15.55:0/3276174920 shutdown_connections 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.250+0000 7f515f800700 1 -- 172.21.15.55:0/3276174920 wait complete. 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 Processor -- start 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 -- start start 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51581023d0 0x7f51581a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5158102d80 0x7f51581a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 0x7f515819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158112370 con 0x7f51581074b0 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51581121f0 con 0x7f51581023d0 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.251+0000 7f515f800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51581124f0 con 0x7f5158102d80 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 0x7f515819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 0x7f515819a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51518/0 (socket says 172.21.15.55:51518) 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 -- 172.21.15.55:0/3564409210 learned_addr learned my addr 172.21.15.55:0/3564409210 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515ce00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51581023d0 0x7f51581a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f5157e00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5158102d80 0x7f51581a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:39.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 -- 172.21.15.55:0/3564409210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5158102d80 msgr2=0x7f51581a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5158102d80 0x7f51581a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 -- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51581023d0 msgr2=0x7f51581a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51581023d0 0x7f51581a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515819b000 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.252+0000 7f515d800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 0x7f515819a820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f515000ada0 tx=0x7f515000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.253+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150017020 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.253+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515819b2f0 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.253+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f515000ce30 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.253+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150005460 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.253+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51581a7500 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.254+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51581002b0 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.256+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f515000c980 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.257+0000 7f5155600700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f51400a2920 0x7f51400a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.257+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f51500ce440 con 0x7f51581074b0 2024-03-28T05:43:39.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f515ce00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f51400a2920 0x7f51400a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f5155600700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] conn(0x7f51400ac4e0 0x7f51400ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51400af050 con 0x7f51400ac4e0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51500d5050 con 0x7f51581074b0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f515ce00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f51400a2920 0x7f51400a4de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f514c005ea0 tx=0x7f514c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.258+0000 7f5157e00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] conn(0x7f51400ac4e0 0x7f51400ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.259+0000 7f5157e00700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] conn(0x7f51400ac4e0 0x7f51400ae980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.262+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== osd.10 v2:172.21.15.86:6824/3742760056 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f51400af050 con 0x7f51400ac4e0 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.281+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 --> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51581038b0 con 0x7f51400ac4e0 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.282+0000 7f5155600700 1 -- 172.21.15.55:0/3564409210 <== osd.10 v2:172.21.15.86:6824/3742760056 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f51581038b0 con 0x7f51400ac4e0 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.282+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] conn(0x7f51400ac4e0 msgr2=0x7f51400ae980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.282+0000 7f515f800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] conn(0x7f51400ac4e0 0x7f51400ae980 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f51400a2920 msgr2=0x7f51400a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f51400a2920 0x7f51400a4de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f514c005ea0 tx=0x7f514c005e30 comp rx=0 tx=0).stop 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 msgr2=0x7f515819a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 --2- 172.21.15.55:0/3564409210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51581074b0 0x7f515819a820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f515000ada0 tx=0x7f515000c330 comp rx=0 tx=0).stop 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515d800700 1 -- 172.21.15.55:0/3564409210 reap_dead start 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 shutdown_connections 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 >> 172.21.15.55:0/3564409210 conn(0x7f51580fdc40 msgr2=0x7f51580fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 shutdown_connections 2024-03-28T05:43:39.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:38.283+0000 7f515f800700 1 -- 172.21.15.55:0/3564409210 wait complete. 2024-03-28T05:43:40.780 INFO:teuthology.orchestra.run.smithi055.stdout:146028888136 2024-03-28T05:43:40.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-28T05:43:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:41 smithi086 ceph-mon[35163]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:41 smithi159 ceph-mon[36109]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:41 smithi055 ceph-mon[31863]: pgmap v393: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 -- 172.21.15.55:0/2838461757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c0743c0 msgr2=0x7ff15c0747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 --2- 172.21.15.55:0/2838461757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c0743c0 0x7ff15c0747a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b0d0 tx=0x7ff14c00b3e0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 -- 172.21.15.55:0/2838461757 shutdown_connections 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 --2- 172.21.15.55:0/2838461757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c0743c0 0x7ff15c0747a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 --2- 172.21.15.55:0/2838461757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c113360 0x7ff15c115750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 --2- 172.21.15.55:0/2838461757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff15c074ce0 0x7ff15c112e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.595+0000 7ff163a00700 1 -- 172.21.15.55:0/2838461757 >> 172.21.15.55:0/2838461757 conn(0x7ff15c0792f0 msgr2=0x7ff15c079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.596+0000 7ff163a00700 1 -- 172.21.15.55:0/2838461757 shutdown_connections 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.596+0000 7ff163a00700 1 -- 172.21.15.55:0/2838461757 wait complete. 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 Processor -- start 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 -- start start 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff15c0743c0 0x7ff15c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 0x7ff15c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c113360 0x7ff15c1a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c118a90 con 0x7ff15c074ce0 2024-03-28T05:43:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c118910 con 0x7ff15c113360 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff163a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c118c10 con 0x7ff15c0743c0 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff153e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 0x7ff15c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.597+0000 7ff153e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 0x7ff15c19f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47418/0 (socket says 172.21.15.55:47418) 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 -- 172.21.15.55:0/267590574 learned_addr learned my addr 172.21.15.55:0/267590574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff161a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c113360 0x7ff15c1a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff161000700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff15c0743c0 0x7ff15c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 -- 172.21.15.55:0/267590574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff15c0743c0 msgr2=0x7ff15c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff15c0743c0 0x7ff15c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 -- 172.21.15.55:0/267590574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c113360 msgr2=0x7ff15c1a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c113360 0x7ff15c1a3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c1a3f70 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.598+0000 7ff153e00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 0x7ff15c19f4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b500 tx=0x7ff14400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.599+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144015020 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.599+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff144011ce0 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.599+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144010d60 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.599+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c1a4260 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.599+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1abae0 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.600+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff15c112be0 con 0x7ff15c074ce0 2024-03-28T05:43:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.602+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7ff144018020 con 0x7ff15c074ce0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff15a000700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff1400a29a0 0x7ff1400a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff1440ce920 con 0x7ff15c074ce0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff161000700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff1400a29a0 0x7ff1400a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff15a000700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] conn(0x7ff1400ac560 0x7ff1400aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff14401deb0 con 0x7ff1400ac560 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1440cecd0 con 0x7ff15c074ce0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.604+0000 7ff161a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] conn(0x7ff1400ac560 0x7ff1400aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.605+0000 7ff161000700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff1400a29a0 0x7ff1400a4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00d010 tx=0x7ff14c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.605+0000 7ff161a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] conn(0x7ff1400ac560 0x7ff1400aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.606+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== osd.6 v2:172.21.15.55:6818/3781986926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff14401deb0 con 0x7ff1400ac560 2024-03-28T05:43:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.624+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 --> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff15c075af0 con 0x7ff1400ac560 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.625+0000 7ff15a000700 1 -- 172.21.15.55:0/267590574 <== osd.6 v2:172.21.15.55:6818/3781986926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff15c075af0 con 0x7ff1400ac560 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.625+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] conn(0x7ff1400ac560 msgr2=0x7ff1400aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] conn(0x7ff1400ac560 0x7ff1400aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff1400a29a0 msgr2=0x7ff1400a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff1400a29a0 0x7ff1400a4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00d010 tx=0x7ff14c00b040 comp rx=0 tx=0).stop 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 msgr2=0x7ff15c19f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 --2- 172.21.15.55:0/267590574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15c074ce0 0x7ff15c19f4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff14400b500 tx=0x7ff14400b810 comp rx=0 tx=0).stop 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff161a00700 1 -- 172.21.15.55:0/267590574 reap_dead start 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 shutdown_connections 2024-03-28T05:43:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 >> 172.21.15.55:0/267590574 conn(0x7ff15c0792f0 msgr2=0x7ff15c112200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 shutdown_connections 2024-03-28T05:43:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:41.626+0000 7ff163a00700 1 -- 172.21.15.55:0/267590574 wait complete. 2024-03-28T05:43:42.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 -- 172.21.15.55:0/1247653895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460074530 msgr2=0x7fb460074910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 --2- 172.21.15.55:0/1247653895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460074530 0x7fb460074910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb454009990 tx=0x7fb454009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 -- 172.21.15.55:0/1247653895 shutdown_connections 2024-03-28T05:43:42.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 --2- 172.21.15.55:0/1247653895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460074530 0x7fb460074910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 --2- 172.21.15.55:0/1247653895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb460113080 0x7fb460115470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 --2- 172.21.15.55:0/1247653895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb460074e50 0x7fb460112b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 -- 172.21.15.55:0/1247653895 >> 172.21.15.55:0/1247653895 conn(0x7fb4600fdb60 msgr2=0x7fb4600fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 -- 172.21.15.55:0/1247653895 shutdown_connections 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.130+0000 7fb467200700 1 -- 172.21.15.55:0/1247653895 wait complete. 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.131+0000 7fb467200700 1 Processor -- start 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.131+0000 7fb467200700 1 -- start start 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb460074530 0x7fb46019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb460074e50 0x7fb46019f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 0x7fb4601a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4601188c0 con 0x7fb460113080 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460118740 con 0x7fb460074e50 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb467200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460118a40 con 0x7fb460074530 2024-03-28T05:43:42.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb466800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 0x7fb4601a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb466800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 0x7fb4601a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47438/0 (socket says 172.21.15.55:47438) 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb466800700 1 -- 172.21.15.55:0/1687344960 learned_addr learned my addr 172.21.15.55:0/1687344960 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.132+0000 7fb465e00700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb460074530 0x7fb46019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb465400700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb460074e50 0x7fb46019f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 -- 172.21.15.55:0/1687344960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb460074530 msgr2=0x7fb46019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb460074530 0x7fb46019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 -- 172.21.15.55:0/1687344960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb460074e50 msgr2=0x7fb46019f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb460074e50 0x7fb46019f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4601a3dd0 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb466800700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 0x7fb4601a3690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00ada0 tx=0x7fb45c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c017020 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb45c007e30 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4601a40c0 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.133+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005420 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.134+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4601ab940 con 0x7fb460113080 2024-03-28T05:43:42.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.134+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb460062920 con 0x7fb460113080 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.137+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fb45c00c980 con 0x7fb460113080 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.138+0000 7fb45aa00700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb4480a2920 0x7fb4480a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.138+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb45c0ced50 con 0x7fb460113080 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.139+0000 7fb465e00700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb4480a2920 0x7fb4480a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.139+0000 7fb45aa00700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] conn(0x7fb4480ac4e0 0x7fb4480ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.139+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb45c019e50 con 0x7fb4480ac4e0 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.139+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb45c0cf180 con 0x7fb460113080 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.139+0000 7fb465400700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] conn(0x7fb4480ac4e0 0x7fb4480ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.140+0000 7fb465e00700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb4480a2920 0x7fb4480a4de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b5c0 tx=0x7fb45401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.140+0000 7fb465400700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] conn(0x7fb4480ac4e0 0x7fb4480ae980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:42.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.141+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== osd.3 v2:172.21.15.55:6810/680016669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb45c019e50 con 0x7fb4480ac4e0 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.160+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 --> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb460062da0 con 0x7fb4480ac4e0 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb45aa00700 1 -- 172.21.15.55:0/1687344960 <== osd.3 v2:172.21.15.55:6810/680016669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb460062da0 con 0x7fb4480ac4e0 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] conn(0x7fb4480ac4e0 msgr2=0x7fb4480ae980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] conn(0x7fb4480ac4e0 0x7fb4480ae980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb4480a2920 msgr2=0x7fb4480a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb4480a2920 0x7fb4480a4de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b5c0 tx=0x7fb45401a040 comp rx=0 tx=0).stop 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 msgr2=0x7fb4601a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb467200700 1 --2- 172.21.15.55:0/1687344960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb460113080 0x7fb4601a3690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00ada0 tx=0x7fb45c00c330 comp rx=0 tx=0).stop 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.161+0000 7fb466800700 1 -- 172.21.15.55:0/1687344960 reap_dead start 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.162+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 shutdown_connections 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.162+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 >> 172.21.15.55:0/1687344960 conn(0x7fb4600fdb60 msgr2=0x7fb4600ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.162+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 shutdown_connections 2024-03-28T05:43:42.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.162+0000 7fb467200700 1 -- 172.21.15.55:0/1687344960 wait complete. 2024-03-28T05:43:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:43 smithi055 ceph-mon[31863]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:43 smithi086 ceph-mon[35163]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:43 smithi159 ceph-mon[36109]: pgmap v394: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:43.699 INFO:teuthology.orchestra.run.smithi055.stdout:77309411414 2024-03-28T05:43:43.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-28T05:43:44.400 INFO:teuthology.orchestra.run.smithi055.stdout:270582939694 2024-03-28T05:43:44.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-28T05:43:45.235 INFO:teuthology.orchestra.run.smithi055.stdout:111669149778 2024-03-28T05:43:45.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-28T05:43:45.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 -- 172.21.15.55:0/3827579488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec0761c0 msgr2=0x7f54ec0743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 --2- 172.21.15.55:0/3827579488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec0761c0 0x7f54ec0743c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009990 tx=0x7f54e0009ca0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 -- 172.21.15.55:0/3827579488 shutdown_connections 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 --2- 172.21.15.55:0/3827579488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec0761c0 0x7f54ec0743c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 --2- 172.21.15.55:0/3827579488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54ec112e20 0x7f54ec115210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 --2- 172.21.15.55:0/3827579488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54ec074900 0x7f54ec074d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 -- 172.21.15.55:0/3827579488 >> 172.21.15.55:0/3827579488 conn(0x7f54ec0792c0 msgr2=0x7f54ec0796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.229+0000 7f54f3a00700 1 -- 172.21.15.55:0/3827579488 shutdown_connections 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.230+0000 7f54f3a00700 1 -- 172.21.15.55:0/3827579488 wait complete. 2024-03-28T05:43:45.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 Processor -- start 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 -- start start 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 0x7f54ec19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54ec0761c0 0x7f54ec19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54ec112e20 0x7f54ec1a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec118900 con 0x7f54ec074900 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec118780 con 0x7f54ec112e20 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.231+0000 7f54f3a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec118a80 con 0x7f54ec0761c0 2024-03-28T05:43:45.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 0x7f54ec19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 0x7f54ec19ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47464/0 (socket says 172.21.15.55:47464) 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 -- 172.21.15.55:0/4178319793 learned_addr learned my addr 172.21.15.55:0/4178319793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54ec112e20 0x7f54ec1a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54ebe00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54ec0761c0 0x7f54ec19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 -- 172.21.15.55:0/4178319793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54ec0761c0 msgr2=0x7f54ec19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54ec0761c0 0x7f54ec19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 -- 172.21.15.55:0/4178319793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54ec112e20 msgr2=0x7f54ec1a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54ec112e20 0x7f54ec1a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.232+0000 7f54f1000700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec1a3e60 con 0x7f54ec074900 2024-03-28T05:43:45.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54f1000700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 0x7f54ec19ee50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54e0000c00 tx=0x7f54e0003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0027070 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec1a40f0 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f54e000bdc0 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000f460 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.233+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec1ab9d0 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.234+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54ec111870 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.236+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f54e002a070 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54e9600700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f54d40a29a0 0x7f54d40a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f54e00d0040 con 0x7f54ec074900 2024-03-28T05:43:45.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54ebe00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f54d40a29a0 0x7f54d40a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54e9600700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] conn(0x7f54d40ac560 0x7f54d40aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54e002be50 con 0x7f54d40ac560 2024-03-28T05:43:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.238+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54e00d03f0 con 0x7f54ec074900 2024-03-28T05:43:45.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.239+0000 7f54f1a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] conn(0x7f54d40ac560 0x7f54d40aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.239+0000 7f54ebe00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f54d40a29a0 0x7f54d40a4e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005fd0 tx=0x7f54d8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.239+0000 7f54f1a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] conn(0x7f54d40ac560 0x7f54d40aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.240+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== osd.9 v2:172.21.15.55:6826/443330436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f54e002be50 con 0x7f54d40ac560 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.258+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 --> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54ec075a70 con 0x7f54d40ac560 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.259+0000 7f54e9600700 1 -- 172.21.15.55:0/4178319793 <== osd.9 v2:172.21.15.55:6826/443330436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f54ec075a70 con 0x7f54d40ac560 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.259+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] conn(0x7f54d40ac560 msgr2=0x7f54d40aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.259+0000 7f54f3a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] conn(0x7f54d40ac560 0x7f54d40aea00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:45.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.259+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f54d40a29a0 msgr2=0x7f54d40a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.259+0000 7f54f3a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f54d40a29a0 0x7f54d40a4e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54d8005fd0 tx=0x7f54d8005f60 comp rx=0 tx=0).stop 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 msgr2=0x7f54ec19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 --2- 172.21.15.55:0/4178319793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54ec074900 0x7f54ec19ee50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54e0000c00 tx=0x7f54e0003b30 comp rx=0 tx=0).stop 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f1a00700 1 -- 172.21.15.55:0/4178319793 reap_dead start 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 shutdown_connections 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 >> 172.21.15.55:0/4178319793 conn(0x7f54ec0792c0 msgr2=0x7f54ec110e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 shutdown_connections 2024-03-28T05:43:45.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:42.260+0000 7f54f3a00700 1 -- 172.21.15.55:0/4178319793 wait complete. 2024-03-28T05:43:45.311 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:45 smithi055 ceph-mon[31863]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-03-28T05:43:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:45 smithi086 ceph-mon[35163]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-03-28T05:43:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:45 smithi159 ceph-mon[36109]: pgmap v395: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-03-28T05:43:46.250 INFO:teuthology.orchestra.run.smithi055.stdout:206158430268 2024-03-28T05:43:46.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-28T05:43:46.263 INFO:teuthology.orchestra.run.smithi055.stdout:330712481824 2024-03-28T05:43:46.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-28T05:43:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 -- 172.21.15.55:0/240653179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1023d0 msgr2=0x7f155c1027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 --2- 172.21.15.55:0/240653179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1023d0 0x7f155c1027b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f154c0099c0 tx=0x7f154c009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 -- 172.21.15.55:0/240653179 shutdown_connections 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 --2- 172.21.15.55:0/240653179 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1023d0 0x7f155c1027b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 --2- 172.21.15.55:0/240653179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1074b0 0x7f155c10f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 --2- 172.21.15.55:0/240653179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155c102d80 0x7f155c106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.070+0000 7f1561400700 1 -- 172.21.15.55:0/240653179 >> 172.21.15.55:0/240653179 conn(0x7f155c0fdc40 msgr2=0x7f155c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.071+0000 7f1561400700 1 -- 172.21.15.55:0/240653179 shutdown_connections 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.071+0000 7f1561400700 1 -- 172.21.15.55:0/240653179 wait complete. 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.072+0000 7f1561400700 1 Processor -- start 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 -- start start 2024-03-28T05:43:46.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1023d0 0x7f155c074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155c102d80 0x7f155c0749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 0x7f155c074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1123c0 con 0x7f155c1074b0 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c112240 con 0x7f155c102d80 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.073+0000 7f1561400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c112540 con 0x7f155c1023d0 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 0x7f155c074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 0x7f155c074f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47476/0 (socket says 172.21.15.55:47476) 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 -- 172.21.15.55:0/2886955397 learned_addr learned my addr 172.21.15.55:0/2886955397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:46.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155a800700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1023d0 0x7f155c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f1559e00700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155c102d80 0x7f155c0749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 -- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1023d0 msgr2=0x7f155c074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1023d0 0x7f155c074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 -- 172.21.15.55:0/2886955397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155c102d80 msgr2=0x7f155c0749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f155c102d80 0x7f155c0749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155b200700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c1a6df0 con 0x7f155c1074b0 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.074+0000 7f155a800700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f155c1023d0 0x7f155c074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f155b200700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 0x7f155c074f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1554007ee0 tx=0x7f155400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400dbd0 con 0x7f155c1074b0 2024-03-28T05:43:46.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f155400dd70 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554005990 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c1a70e0 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.075+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c1a7620 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.076+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f155c062860 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.079+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f155401a020 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f1553400700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15400a29a0 0x7f15400a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f15540ce8b0 con 0x7f155c1074b0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f155a800700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15400a29a0 0x7f15400a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:46.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f1553400700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] conn(0x7f15400ac560 0x7f15400aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f155400be50 con 0x7f15400ac560 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.080+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15540cece0 con 0x7f155c1074b0 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.081+0000 7f155a800700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15400a29a0 0x7f15400a4e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f154c009f50 tx=0x7f154c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.081+0000 7f1559e00700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] conn(0x7f15400ac560 0x7f15400aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.082+0000 7f1559e00700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] conn(0x7f15400ac560 0x7f15400aea00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.084+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== osd.11 v2:172.21.15.159:6824/535297782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f155400be50 con 0x7f15400ac560 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.103+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 --> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f155c062c90 con 0x7f15400ac560 2024-03-28T05:43:46.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.104+0000 7f1553400700 1 -- 172.21.15.55:0/2886955397 <== osd.11 v2:172.21.15.159:6824/535297782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f155c062c90 con 0x7f15400ac560 2024-03-28T05:43:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] conn(0x7f15400ac560 msgr2=0x7f15400aea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] conn(0x7f15400ac560 0x7f15400aea00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15400a29a0 msgr2=0x7f15400a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15400a29a0 0x7f15400a4e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f154c009f50 tx=0x7f154c005fb0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 msgr2=0x7f155c074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 --2- 172.21.15.55:0/2886955397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c1074b0 0x7f155c074f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1554007ee0 tx=0x7f155400d3b0 comp rx=0 tx=0).stop 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f155b200700 1 -- 172.21.15.55:0/2886955397 reap_dead start 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 shutdown_connections 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 >> 172.21.15.55:0/2886955397 conn(0x7f155c0fdc40 msgr2=0x7f155c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 shutdown_connections 2024-03-28T05:43:46.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:45.105+0000 7f1561400700 1 -- 172.21.15.55:0/2886955397 wait complete. 2024-03-28T05:43:46.981 INFO:teuthology.orchestra.run.smithi055.stdout:365072220187 2024-03-28T05:43:46.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-28T05:43:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:47 smithi086 ceph-mon[35163]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:43:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:47 smithi159 ceph-mon[36109]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:43:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:47 smithi055 ceph-mon[31863]: pgmap v396: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:43:47.516 INFO:teuthology.orchestra.run.smithi055.stdout:304942678056 2024-03-28T05:43:47.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-28T05:43:47.540 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:47.692 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:49 smithi086 ceph-mon[35163]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:49 smithi159 ceph-mon[36109]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.349 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.358 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.361 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.361 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.362 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.366 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:49 smithi055 ceph-mon[31863]: pgmap v397: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:43:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:51 smithi055 ceph-mon[31863]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:43:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:51 smithi086 ceph-mon[35163]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:43:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:51 smithi159 ceph-mon[36109]: pgmap v398: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:43:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 -- 172.21.15.55:0/2459833587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 msgr2=0x7fc270111290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 --2- 172.21.15.55:0/2459833587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc270111290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc26800b0d0 tx=0x7fc26800b3e0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 -- 172.21.15.55:0/2459833587 shutdown_connections 2024-03-28T05:43:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 --2- 172.21.15.55:0/2459833587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc270111290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 --2- 172.21.15.55:0/2459833587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2701045e0 0x7fc2701049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 --2- 172.21.15.55:0/2459833587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc270104f90 0x7fc270108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 -- 172.21.15.55:0/2459833587 >> 172.21.15.55:0/2459833587 conn(0x7fc2700ffe70 msgr2=0x7fc270102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 -- 172.21.15.55:0/2459833587 shutdown_connections 2024-03-28T05:43:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.085+0000 7fc275200700 1 -- 172.21.15.55:0/2459833587 wait complete. 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.086+0000 7fc275200700 1 Processor -- start 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 -- start start 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2701045e0 0x7fc2701a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 0x7fc2701a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701145b0 con 0x7fc2701096c0 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270114430 con 0x7fc2701045e0 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc275200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270114730 con 0x7fc270104f90 2024-03-28T05:43:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc26e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc26e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33696/0 (socket says 172.21.15.55:33696) 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc26e800700 1 -- 172.21.15.55:0/1137099099 learned_addr learned my addr 172.21.15.55:0/1137099099 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.087+0000 7fc26de00700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2701045e0 0x7fc2701a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26d400700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 0x7fc2701a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 -- 172.21.15.55:0/1137099099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 msgr2=0x7fc2701a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 0x7fc2701a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 -- 172.21.15.55:0/1137099099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2701045e0 msgr2=0x7fc2701a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2701045e0 0x7fc2701a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 -- 172.21.15.55:0/1137099099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27019b010 con 0x7fc2701096c0 2024-03-28T05:43:52.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26d400700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 0x7fc2701a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc26e800700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2680079a0 tx=0x7fc2680079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26801f070 con 0x7fc2701096c0 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc268003c00 con 0x7fc2701096c0 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.088+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27019b2a0 con 0x7fc2701096c0 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.089+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26801b690 con 0x7fc2701096c0 2024-03-28T05:43:52.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.089+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2701a74c0 con 0x7fc2701096c0 2024-03-28T05:43:52.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.090+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc270105ac0 con 0x7fc2701096c0 2024-03-28T05:43:52.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.092+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fc268022070 con 0x7fc2701096c0 2024-03-28T05:43:52.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.093+0000 7fc266a00700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 0x7fc2540a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:52.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.093+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc26800f020 con 0x7fc2701096c0 2024-03-28T05:43:52.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.094+0000 7fc26de00700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 0x7fc2540a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:52.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.094+0000 7fc26de00700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 0x7fc2540a4e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc26000ac50 tx=0x7fc26000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:52.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.098+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc268029020 con 0x7fc2701096c0 2024-03-28T05:43:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.334+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc27019bd10 con 0x7fc2701096c0 2024-03-28T05:43:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.335+0000 7fc266a00700 1 -- 172.21.15.55:0/1137099099 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc26809cce0 con 0x7fc2701096c0 2024-03-28T05:43:52.336 INFO:teuthology.orchestra.run.smithi055.stdout:171798691910 2024-03-28T05:43:52.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.337+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 msgr2=0x7fc2540a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:52.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.337+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 0x7fc2540a4e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc26000ac50 tx=0x7fc26000a380 comp rx=0 tx=0).stop 2024-03-28T05:43:52.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.337+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 msgr2=0x7fc27019a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.337+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2680079a0 tx=0x7fc2680079d0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 shutdown_connections 2024-03-28T05:43:52.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc2540a29a0 0x7fc2540a4e60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2701096c0 0x7fc27019a830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2701045e0 0x7fc2701a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 --2- 172.21.15.55:0/1137099099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc270104f90 0x7fc2701a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 >> 172.21.15.55:0/1137099099 conn(0x7fc2700ffe70 msgr2=0x7fc270100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 shutdown_connections 2024-03-28T05:43:52.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:52.338+0000 7fc275200700 1 -- 172.21.15.55:0/1137099099 wait complete. 2024-03-28T05:43:53.353 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:53 smithi055 ceph-mon[31863]: pgmap v399: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:43:53.353 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:53 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1137099099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-28T05:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:53 smithi086 ceph-mon[35163]: pgmap v399: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:53 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1137099099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-28T05:43:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:53 smithi159 ceph-mon[36109]: pgmap v399: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:43:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:53 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1137099099' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-28T05:43:55.154 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:55 smithi055 ceph-mon[31863]: pgmap v400: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:43:55.154 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:55 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/543113413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-28T05:43:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:55 smithi086 ceph-mon[35163]: pgmap v400: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:43:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:55 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/543113413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-28T05:43:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:55 smithi159 ceph-mon[36109]: pgmap v400: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:43:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:55 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/543113413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.481+0000 7f85ef200700 1 -- 172.21.15.55:0/2263798686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f01022d0 msgr2=0x7f85f01026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.481+0000 7f85ef200700 1 --2- 172.21.15.55:0/2263798686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f01022d0 0x7f85f01026b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85e00099c0 tx=0x7f85e0009cd0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.481+0000 7f85ef200700 1 -- 172.21.15.55:0/2263798686 shutdown_connections 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.481+0000 7f85ef200700 1 --2- 172.21.15.55:0/2263798686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f01022d0 0x7f85f01026b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.482+0000 7f85ef200700 1 --2- 172.21.15.55:0/2263798686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01073b0 0x7f85f010ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.482+0000 7f85ef200700 1 --2- 172.21.15.55:0/2263798686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f0102c80 0x7f85f0106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.482+0000 7f85ef200700 1 -- 172.21.15.55:0/2263798686 >> 172.21.15.55:0/2263798686 conn(0x7f85f00fdb80 msgr2=0x7f85f00fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.482+0000 7f85ef200700 1 -- 172.21.15.55:0/2263798686 shutdown_connections 2024-03-28T05:43:55.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.482+0000 7f85ef200700 1 -- 172.21.15.55:0/2263798686 wait complete. 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 Processor -- start 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 -- start start 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 0x7f85f01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f01073b0 0x7f85f019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f01122b0 con 0x7f85f0102c80 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0112130 con 0x7f85f01022d0 2024-03-28T05:43:55.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85ef200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0112430 con 0x7f85f01073b0 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85e7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85e7e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33728/0 (socket says 172.21.15.55:33728) 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.483+0000 7f85e7e00700 1 -- 172.21.15.55:0/543113413 learned_addr learned my addr 172.21.15.55:0/543113413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85ede00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 0x7f85f01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85ee800700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f01073b0 0x7f85f019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 -- 172.21.15.55:0/543113413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f01073b0 msgr2=0x7f85f019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f01073b0 0x7f85f019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 -- 172.21.15.55:0/543113413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 msgr2=0x7f85f01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 0x7f85f01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 -- 172.21.15.55:0/543113413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f019aff0 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85ede00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 0x7f85f01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e7e00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85d800d950 tx=0x7f85d800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8017070 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f85d800de30 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8005440 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.484+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f019b2e0 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.485+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f01a74f0 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.486+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f01037b0 con 0x7f85f0102c80 2024-03-28T05:43:55.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.488+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f85d8004750 con 0x7f85f0102c80 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.489+0000 7f85e6a00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 0x7f85d40a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.489+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f85d80ce480 con 0x7f85f0102c80 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.489+0000 7f85ede00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 0x7f85d40a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.490+0000 7f85ede00700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 0x7f85d40a4e60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.494+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f85d809b380 con 0x7f85f0102c80 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.731+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85f019bd70 con 0x7f85f0102c80 2024-03-28T05:43:55.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.731+0000 7f85e6a00700 1 -- 172.21.15.55:0/543113413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85f019bd70 con 0x7f85f0102c80 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stdout:34359738472 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.734+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 msgr2=0x7f85d40a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.734+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 0x7f85d40a4e60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c00 tx=0x7f85e0005fd0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.734+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 msgr2=0x7f85f01a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.734+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85d800d950 tx=0x7f85d800dd10 comp rx=0 tx=0).stop 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 shutdown_connections 2024-03-28T05:43:55.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85d40a29a0 0x7f85d40a4e60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85f01073b0 0x7f85f019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85f01022d0 0x7f85f01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 --2- 172.21.15.55:0/543113413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0102c80 0x7f85f01a0bd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 >> 172.21.15.55:0/543113413 conn(0x7f85f00fdb80 msgr2=0x7f85f00fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 shutdown_connections 2024-03-28T05:43:55.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:43:54.735+0000 7f85ef200700 1 -- 172.21.15.55:0/543113413 wait complete. 2024-03-28T05:43:56.358 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:43:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:43:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:43:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:43:57.957 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:57 smithi055 ceph-mon[31863]: pgmap v401: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:57.957 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:57.958 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:57.958 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:57.958 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:57 smithi086 ceph-mon[35163]: pgmap v401: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:57 smithi159 ceph-mon[36109]: pgmap v401: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:43:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:43:59.772 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691906 got 171798691910 for osd.5 2024-03-28T05:43:59.772 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:00.011 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:59 smithi055 ceph-mon[31863]: pgmap v402: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:00.011 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.011 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.011 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.011 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:43:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:59 smithi086 ceph-mon[35163]: pgmap v402: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:43:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:59 smithi159 ceph-mon[36109]: pgmap v402: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:00.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:43:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:01.052 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:00 smithi055 ceph-mon[31863]: pgmap v403: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:00 smithi086 ceph-mon[35163]: pgmap v403: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:00 smithi159 ceph-mon[36109]: pgmap v403: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 -- 172.21.15.55:0/3256772356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104500 msgr2=0x7f2e3c1048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3256772356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104500 0x7f2e3c1048e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2e300099c0 tx=0x7f2e30009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 -- 172.21.15.55:0/3256772356 shutdown_connections 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3256772356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104500 0x7f2e3c1048e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3256772356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 0x7f2e3c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3256772356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 -- 172.21.15.55:0/3256772356 >> 172.21.15.55:0/3256772356 conn(0x7f2e3c0ffd70 msgr2=0x7f2e3c102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 -- 172.21.15.55:0/3256772356 shutdown_connections 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.908+0000 7f2e42a00700 1 -- 172.21.15.55:0/3256772356 wait complete. 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.909+0000 7f2e42a00700 1 Processor -- start 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.909+0000 7f2e42a00700 1 -- start start 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104500 0x7f2e3c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 0x7f2e3c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1144c0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c114340 con 0x7f2e3c1095e0 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c114640 con 0x7f2e3c104500 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e40c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e40c00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52028/0 (socket says 172.21.15.55:52028) 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e40c00700 1 -- 172.21.15.55:0/3849972066 learned_addr learned my addr 172.21.15.55:0/3849972066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.910+0000 7f2e42000700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 0x7f2e3c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e41600700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104500 0x7f2e3c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 -- 172.21.15.55:0/3849972066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104500 msgr2=0x7f2e3c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104500 0x7f2e3c1a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 -- 172.21.15.55:0/3849972066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 msgr2=0x7f2e3c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:01.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 0x7f2e3c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 -- 172.21.15.55:0/3849972066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c19b0a0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e40c00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c8f0 tx=0x7f2e2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28007b00 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2e28007ca0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c19b390 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28018660 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.911+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c1a7620 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.912+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c1059e0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.915+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f2e2800f450 con 0x7f2e3c104eb0 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.916+0000 7f2e3a000700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 0x7f2e240a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:01.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.916+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2e280cecd0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.916+0000 7f2e41600700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 0x7f2e240a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:01.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.917+0000 7f2e41600700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 0x7f2e240a4de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e30006010 tx=0x7f2e30000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:01.205 INFO:teuthology.orchestra.run.smithi055.stdout:55834574947 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:00.919+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2e28014030 con 0x7f2e3c104eb0 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.158+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e3c19bca0 con 0x7f2e3c104eb0 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.158+0000 7f2e3a000700 1 -- 172.21.15.55:0/3849972066 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e2809bc60 con 0x7f2e3c104eb0 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 msgr2=0x7f2e240a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 0x7f2e240a4de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e30006010 tx=0x7f2e30000bc0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 msgr2=0x7f2e3c1a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c8f0 tx=0x7f2e2800ccb0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 shutdown_connections 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2e240a2920 0x7f2e240a4de0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c1095e0 0x7f2e3c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e3c104500 0x7f2e3c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 --2- 172.21.15.55:0/3849972066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e3c104eb0 0x7f2e3c1a0be0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.161+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 >> 172.21.15.55:0/3849972066 conn(0x7f2e3c0ffd70 msgr2=0x7f2e3c102120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.162+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 shutdown_connections 2024-03-28T05:44:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:01.162+0000 7f2e42a00700 1 -- 172.21.15.55:0/3849972066 wait complete. 2024-03-28T05:44:01.956 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3849972066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 -- 172.21.15.55:0/2241508309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc106950 msgr2=0x7f07bc111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 --2- 172.21.15.55:0/2241508309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc106950 0x7f07bc111330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f07b400b0d0 tx=0x7f07b400b3e0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 -- 172.21.15.55:0/2241508309 shutdown_connections 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 --2- 172.21.15.55:0/2241508309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc106950 0x7f07bc111330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 --2- 172.21.15.55:0/2241508309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 --2- 172.21.15.55:0/2241508309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc105f90 0x7f07bc106410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.012+0000 7f07c2000700 1 -- 172.21.15.55:0/2241508309 >> 172.21.15.55:0/2241508309 conn(0x7f07bc0ffe30 msgr2=0x7f07bc102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.013+0000 7f07c2000700 1 -- 172.21.15.55:0/2241508309 shutdown_connections 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.013+0000 7f07c2000700 1 -- 172.21.15.55:0/2241508309 wait complete. 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 Processor -- start 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 -- start start 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 0x7f07bc19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc114670 con 0x7f07bc105f90 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc1144f0 con 0x7f07bc106950 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.014+0000 7f07c2000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc1147f0 con 0x7f07bc1046a0 2024-03-28T05:44:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52044/0 (socket says 172.21.15.55:52044) 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 -- 172.21.15.55:0/925231318 learned_addr learned my addr 172.21.15.55:0/925231318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07bb400700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07bbe00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 0x7f07bc19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 -- 172.21.15.55:0/925231318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 msgr2=0x7f07bc1a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc1a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 -- 172.21.15.55:0/925231318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 msgr2=0x7f07bc19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 0x7f07bc19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 -- 172.21.15.55:0/925231318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc19b010 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07bbe00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 0x7f07bc19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07bb400700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.015+0000 7f07baa00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d980 tx=0x7f07a800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.016+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8016070 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.016+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f07a80044d0 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.016+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc19b300 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.016+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8004cf0 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.016+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc1a75c0 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.017+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc068e50 con 0x7f07bc105f90 2024-03-28T05:44:02.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.019+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f07a8004020 con 0x7f07bc105f90 2024-03-28T05:44:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.020+0000 7f07b3e00700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 0x7f07a00a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.021+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f07a80cea20 con 0x7f07bc105f90 2024-03-28T05:44:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.021+0000 7f07bb400700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 0x7f07a00a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.021+0000 7f07bb400700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 0x7f07a00a4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f07ac005fd0 tx=0x7f07ac005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.025+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f07a801f020 con 0x7f07bc105f90 2024-03-28T05:44:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3849972066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-28T05:44:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3849972066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-28T05:44:02.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.254+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f07bc02da30 con 0x7f07bc105f90 2024-03-28T05:44:02.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.255+0000 7f07b3e00700 1 -- 172.21.15.55:0/925231318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a809b920 con 0x7f07bc105f90 2024-03-28T05:44:02.256 INFO:teuthology.orchestra.run.smithi055.stdout:270582939699 2024-03-28T05:44:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 msgr2=0x7f07a00a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 0x7f07a00a4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f07ac005fd0 tx=0x7f07ac005f00 comp rx=0 tx=0).stop 2024-03-28T05:44:02.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 msgr2=0x7f07bc1a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d980 tx=0x7f07a800dd40 comp rx=0 tx=0).stop 2024-03-28T05:44:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 shutdown_connections 2024-03-28T05:44:02.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f07a00a29a0 0x7f07a00a4e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07bc106950 0x7f07bc19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07bc1046a0 0x7f07bc1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.258+0000 7f07c2000700 1 --2- 172.21.15.55:0/925231318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07bc105f90 0x7f07bc1a0c30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.259+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 >> 172.21.15.55:0/925231318 conn(0x7f07bc0ffe30 msgr2=0x7f07bc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.259+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 shutdown_connections 2024-03-28T05:44:02.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:02.259+0000 7f07c2000700 1 -- 172.21.15.55:0/925231318 wait complete. 2024-03-28T05:44:02.877 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738466 got 34359738472 for osd.0 2024-03-28T05:44:02.877 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:02 smithi055 ceph-mon[31863]: pgmap v404: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/925231318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-28T05:44:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:02 smithi086 ceph-mon[35163]: pgmap v404: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/925231318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-28T05:44:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:02 smithi159 ceph-mon[36109]: pgmap v404: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/925231318' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-28T05:44:03.843 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939694 got 270582939699 for osd.8 2024-03-28T05:44:03.844 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.173+0000 7fc8fba00700 1 -- 172.21.15.55:0/585972056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406a930 msgr2=0x7fc8f406ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.173+0000 7fc8fba00700 1 --2- 172.21.15.55:0/585972056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406a930 0x7fc8f406ad10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80099c0 tx=0x7fc8e8009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 -- 172.21.15.55:0/585972056 shutdown_connections 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 --2- 172.21.15.55:0/585972056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406a930 0x7fc8f406ad10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 --2- 172.21.15.55:0/585972056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f4107510 0x7fc8f410f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 --2- 172.21.15.55:0/585972056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f406b2e0 0x7fc8f4106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 -- 172.21.15.55:0/585972056 >> 172.21.15.55:0/585972056 conn(0x7fc8f40770e0 msgr2=0x7fc8f40774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 -- 172.21.15.55:0/585972056 shutdown_connections 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.174+0000 7fc8fba00700 1 -- 172.21.15.55:0/585972056 wait complete. 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 Processor -- start 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 -- start start 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f406a930 0x7fc8f41a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f4107510 0x7fc8f419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41123b0 con 0x7fc8f406b2e0 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4112230 con 0x7fc8f406a930 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.175+0000 7fc8fba00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4112530 con 0x7fc8f4107510 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52060/0 (socket says 172.21.15.55:52060) 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 -- 172.21.15.55:0/881143566 learned_addr learned my addr 172.21.15.55:0/881143566 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f9000700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f406a930 0x7fc8f41a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 -- 172.21.15.55:0/881143566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f4107510 msgr2=0x7fc8f419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f4107510 0x7fc8f419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 -- 172.21.15.55:0/881143566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f406a930 msgr2=0x7fc8f41a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f406a930 0x7fc8f41a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 -- 172.21.15.55:0/881143566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f419b090 con 0x7fc8f406b2e0 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.176+0000 7fc8f3e00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b4d0 tx=0x7fc8e000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.177+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0015020 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.177+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc8e0011ce0 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.177+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f419b380 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.177+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0010cd0 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.177+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f41a7640 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.178+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f4068e50 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.180+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fc8e0018020 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.181+0000 7fc8f1600700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 0x7fc8dc0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.182+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8e00ce390 con 0x7fc8f406b2e0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.182+0000 7fc8f9000700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 0x7fc8dc0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.183+0000 7fc8f9000700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 0x7fc8dc0a4de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009990 tx=0x7fc8e8005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.186+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc8e001f020 con 0x7fc8f406b2e0 2024-03-28T05:44:04.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.422+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8f419be60 con 0x7fc8f406b2e0 2024-03-28T05:44:04.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.423+0000 7fc8f1600700 1 -- 172.21.15.55:0/881143566 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8f419be60 con 0x7fc8f406b2e0 2024-03-28T05:44:04.424 INFO:teuthology.orchestra.run.smithi055.stdout:111669149782 2024-03-28T05:44:04.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 msgr2=0x7fc8dc0a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 0x7fc8dc0a4de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009990 tx=0x7fc8e8005ab0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 msgr2=0x7fc8f41a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b4d0 tx=0x7fc8e000b890 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 shutdown_connections 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8dc0a2920 0x7fc8dc0a4de0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8f4107510 0x7fc8f419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8f406a930 0x7fc8f41a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 --2- 172.21.15.55:0/881143566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8f406b2e0 0x7fc8f41a0cb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 >> 172.21.15.55:0/881143566 conn(0x7fc8f40770e0 msgr2=0x7fc8f4108640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:04.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 shutdown_connections 2024-03-28T05:44:04.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:04.426+0000 7fc8fba00700 1 -- 172.21.15.55:0/881143566 wait complete. 2024-03-28T05:44:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:04 smithi055 ceph-mon[31863]: pgmap v405: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:04 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/881143566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-28T05:44:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:04 smithi086 ceph-mon[35163]: pgmap v405: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:04 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/881143566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-28T05:44:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:04 smithi159 ceph-mon[36109]: pgmap v405: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:04 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/881143566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-28T05:44:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 -- 172.21.15.55:0/3503390781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c1074a0 msgr2=0x7f949c10f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 --2- 172.21.15.55:0/3503390781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c1074a0 0x7f949c10f070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f949400b0a0 tx=0x7f949400b3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 -- 172.21.15.55:0/3503390781 shutdown_connections 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 --2- 172.21.15.55:0/3503390781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c1074a0 0x7f949c10f070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 --2- 172.21.15.55:0/3503390781 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 0x7f949c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 --2- 172.21.15.55:0/3503390781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c102e20 0x7f949c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 -- 172.21.15.55:0/3503390781 >> 172.21.15.55:0/3503390781 conn(0x7f949c079220 msgr2=0x7f949c079630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 -- 172.21.15.55:0/3503390781 shutdown_connections 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.691+0000 7f94a4600700 1 -- 172.21.15.55:0/3503390781 wait complete. 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.692+0000 7f94a4600700 1 Processor -- start 2024-03-28T05:44:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.692+0000 7f94a4600700 1 -- start start 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.692+0000 7f94a4600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 0x7f949c074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a4600700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a4600700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 0x7f949c074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a4600700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c112330 con 0x7f949c102e20 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a4600700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1121b0 con 0x7f949c1074a0 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a4600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1124b0 con 0x7f949c102470 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52080/0 (socket says 172.21.15.55:52080) 2024-03-28T05:44:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 -- 172.21.15.55:0/3101731215 learned_addr learned my addr 172.21.15.55:0/3101731215 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a2600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 0x7f949c074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:06.659 INFO:teuthology.orchestra.run.smithi055.stdout:231928234043 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1c00700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 0x7f949c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 -- 172.21.15.55:0/3101731215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 msgr2=0x7f949c074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 0x7f949c074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 -- 172.21.15.55:0/3101731215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 msgr2=0x7f949c074f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 0x7f949c074f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a1200700 1 -- 172.21.15.55:0/3101731215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c1a6c50 con 0x7f949c102e20 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.693+0000 7f94a2600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 0x7f949c074f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f94a1200700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f948800d980 tx=0x7f948800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488017070 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9488010460 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1a6f40 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800de60 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.694+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a7440 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.696+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c068e50 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.698+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f9488010610 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.699+0000 7f949a000700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 0x7f94840a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.699+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f94880ce680 con 0x7f949c102e20 2024-03-28T05:44:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.699+0000 7f94a1c00700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 0x7f94840a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.700+0000 7f94a1c00700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 0x7f94840a4e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9490005ea0 tx=0x7f9490005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.703+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f948809b5c0 con 0x7f949c102e20 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.938+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f949c02dc90 con 0x7f949c102e20 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.939+0000 7f949a000700 1 -- 172.21.15.55:0/3101731215 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f948809aec0 con 0x7f949c102e20 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 msgr2=0x7f94840a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 0x7f94840a4e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9490005ea0 tx=0x7f9490005e30 comp rx=0 tx=0).stop 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 msgr2=0x7f949c0749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f948800d980 tx=0x7f948800dd40 comp rx=0 tx=0).stop 2024-03-28T05:44:06.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 shutdown_connections 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f94840a29a0 0x7f94840a4e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c1074a0 0x7f949c074f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c102470 0x7f949c074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 --2- 172.21.15.55:0/3101731215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f949c102e20 0x7f949c0749d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.941+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 >> 172.21.15.55:0/3101731215 conn(0x7f949c079220 msgr2=0x7f949c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.942+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 shutdown_connections 2024-03-28T05:44:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:05.942+0000 7f94a4600700 1 -- 172.21.15.55:0/3101731215 wait complete. 2024-03-28T05:44:07.049 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574942 got 55834574947 for osd.1 2024-03-28T05:44:07.050 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:07.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:06 smithi055 ceph-mon[31863]: pgmap v406: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:07.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:06 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3101731215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-28T05:44:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:06 smithi086 ceph-mon[35163]: pgmap v406: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:06 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3101731215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-28T05:44:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:06 smithi159 ceph-mon[36109]: pgmap v406: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:06 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3101731215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-28T05:44:08.216 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:07 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4213080144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-28T05:44:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:07 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4213080144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-28T05:44:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:07 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4213080144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.420+0000 7fc82ca00700 1 -- 172.21.15.55:0/4058540687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc828104e90 msgr2=0x7fc828108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.420+0000 7fc82ca00700 1 --2- 172.21.15.55:0/4058540687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc828104e90 0x7fc828108ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc8140099c0 tx=0x7fc814009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 -- 172.21.15.55:0/4058540687 shutdown_connections 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 --2- 172.21.15.55:0/4058540687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc8281095c0 0x7fc828111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 --2- 172.21.15.55:0/4058540687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 0x7fc8281048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 --2- 172.21.15.55:0/4058540687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc828104e90 0x7fc828108ee0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 -- 172.21.15.55:0/4058540687 >> 172.21.15.55:0/4058540687 conn(0x7fc8280ffdb0 msgr2=0x7fc8281021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 -- 172.21.15.55:0/4058540687 shutdown_connections 2024-03-28T05:44:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.421+0000 7fc82ca00700 1 -- 172.21.15.55:0/4058540687 wait complete. 2024-03-28T05:44:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.422+0000 7fc82ca00700 1 Processor -- start 2024-03-28T05:44:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.422+0000 7fc82ca00700 1 -- start start 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 0x7fc8281a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 0x7fc8281a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8281144a0 con 0x7fc8281095c0 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc828114320 con 0x7fc8281044e0 2024-03-28T05:44:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc82ca00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc828114620 con 0x7fc828104e90 2024-03-28T05:44:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc827200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc826800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 0x7fc8281a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc827200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52128/0 (socket says 172.21.15.55:52128) 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.423+0000 7fc827200700 1 -- 172.21.15.55:0/2524303756 learned_addr learned my addr 172.21.15.55:0/2524303756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc825e00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 0x7fc8281a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 -- 172.21.15.55:0/2524303756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 msgr2=0x7fc8281a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 0x7fc8281a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 -- 172.21.15.55:0/2524303756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 msgr2=0x7fc8281a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 0x7fc8281a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 -- 172.21.15.55:0/2524303756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82819af80 con 0x7fc8281095c0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc825e00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 0x7fc8281a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc827200700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc82000ada0 tx=0x7fc82000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.424+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820017020 con 0x7fc8281095c0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.425+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc82000ce30 con 0x7fc8281095c0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.425+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820005350 con 0x7fc8281095c0 2024-03-28T05:44:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.425+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82819b270 con 0x7fc8281095c0 2024-03-28T05:44:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.425+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8281a7480 con 0x7fc8281095c0 2024-03-28T05:44:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.426+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8281059c0 con 0x7fc8281095c0 2024-03-28T05:44:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.428+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fc82000c980 con 0x7fc8281095c0 2024-03-28T05:44:08.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.430+0000 7fc81f400700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 0x7fc80c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.430+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8200ce200 con 0x7fc8281095c0 2024-03-28T05:44:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.430+0000 7fc826800700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 0x7fc80c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.431+0000 7fc826800700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 0x7fc80c0a4e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc818005950 tx=0x7fc81800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:08.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.435+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc820021020 con 0x7fc8281095c0 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 -- 172.21.15.55:0/2568608061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc41081c0 msgr2=0x7fcbc41085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2568608061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc41081c0 0x7fcbc41085a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40099c0 tx=0x7fcbb4009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 -- 172.21.15.55:0/2568608061 shutdown_connections 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2568608061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc41081c0 0x7fcbc41085a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2568608061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc4102ba0 0x7fcbc410efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2568608061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 0x7fcbc4102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 -- 172.21.15.55:0/2568608061 >> 172.21.15.55:0/2568608061 conn(0x7fcbc40792c0 msgr2=0x7fcbc40796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 -- 172.21.15.55:0/2568608061 shutdown_connections 2024-03-28T05:44:08.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.965+0000 7fcbc9800700 1 -- 172.21.15.55:0/2568608061 wait complete. 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.966+0000 7fcbc9800700 1 Processor -- start 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.966+0000 7fcbc9800700 1 -- start start 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.966+0000 7fcbc9800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 0x7fcbc41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.966+0000 7fcbc9800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc9800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 0x7fcbc419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc9800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41123c0 con 0x7fcbc4102ba0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc9800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4112240 con 0x7fcbc41021e0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc9800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4112540 con 0x7fcbc41081c0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52118/0 (socket says 172.21.15.55:52118) 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 -- 172.21.15.55:0/2701209303 learned_addr learned my addr 172.21.15.55:0/2701209303 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2a00700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 0x7fcbc41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc3400700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 0x7fcbc419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 -- 172.21.15.55:0/2701209303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 msgr2=0x7fcbc419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 0x7fcbc419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 -- 172.21.15.55:0/2701209303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 msgr2=0x7fcbc41a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 0x7fcbc41a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc2000700 1 -- 172.21.15.55:0/2701209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc419b080 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.967+0000 7fcbc3400700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 0x7fcbc419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbc2000700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000d950 tx=0x7fcbb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0016070 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc419b370 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcbb0009df0 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000f3c0 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.968+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc41a75b0 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.969+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4103870 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.972+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fcbb0019070 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.973+0000 7fcbbb400700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 0x7fcba80a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.973+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcbb00ce850 con 0x7fcbc4102ba0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.974+0000 7fcbc2a00700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 0x7fcba80a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:08.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.974+0000 7fcbc2a00700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 0x7fcba80a4de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4000c00 tx=0x7fcbb4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.975+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fcbb009b750 con 0x7fcbc4102ba0 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.214+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbc402da30 con 0x7fcbc4102ba0 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.215+0000 7fcbbb400700 1 -- 172.21.15.55:0/2701209303 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbb009b050 con 0x7fcbc4102ba0 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stdout:77309411421 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 msgr2=0x7fcba80a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 0x7fcba80a4de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4000c00 tx=0x7fcbb4005fb0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 msgr2=0x7fcbc41a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000d950 tx=0x7fcbb000dc60 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 shutdown_connections 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fcba80a2920 0x7fcba80a4de0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbc41081c0 0x7fcbc419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc41021e0 0x7fcbc41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 --2- 172.21.15.55:0/2701209303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbc4102ba0 0x7fcbc41a0c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.218+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 >> 172.21.15.55:0/2701209303 conn(0x7fcbc40792c0 msgr2=0x7fcbc4074730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.219+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 shutdown_connections 2024-03-28T05:44:08.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.219+0000 7fcbc9800700 1 -- 172.21.15.55:0/2701209303 wait complete. 2024-03-28T05:44:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.680+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fc82819bcd0 con 0x7fc8281095c0 2024-03-28T05:44:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.680+0000 7fc81f400700 1 -- 172.21.15.55:0/2524303756 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fc82009b1d0 con 0x7fc8281095c0 2024-03-28T05:44:08.681 INFO:teuthology.orchestra.run.smithi055.stdout:330712481830 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 msgr2=0x7fc80c0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 0x7fc80c0a4e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc818005950 tx=0x7fc81800b410 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 msgr2=0x7fc82819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc82000ada0 tx=0x7fc82000c330 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 shutdown_connections 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc80c0a29a0 0x7fc80c0a4e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8281095c0 0x7fc82819a7a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8281044e0 0x7fc8281a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 --2- 172.21.15.55:0/2524303756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc828104e90 0x7fc8281a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.683+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 >> 172.21.15.55:0/2524303756 conn(0x7fc8280ffdb0 msgr2=0x7fc8281020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.684+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 shutdown_connections 2024-03-28T05:44:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.684+0000 7fc82ca00700 1 -- 172.21.15.55:0/2524303756 wait complete. 2024-03-28T05:44:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.998+0000 7fafe6000700 1 -- 172.21.15.55:0/2009322382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe01021e0 msgr2=0x7fafe0102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.998+0000 7fafe6000700 1 --2- 172.21.15.55:0/2009322382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe01021e0 0x7fafe0102660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0099c0 tx=0x7fafcc009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 -- 172.21.15.55:0/2009322382 shutdown_connections 2024-03-28T05:44:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 --2- 172.21.15.55:0/2009322382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe0102ba0 0x7fafe010efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 --2- 172.21.15.55:0/2009322382 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe01081c0 0x7fafe01085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 --2- 172.21.15.55:0/2009322382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe01021e0 0x7fafe0102660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 -- 172.21.15.55:0/2009322382 >> 172.21.15.55:0/2009322382 conn(0x7fafe00792c0 msgr2=0x7fafe00796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 -- 172.21.15.55:0/2009322382 shutdown_connections 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:08.999+0000 7fafe6000700 1 -- 172.21.15.55:0/2009322382 wait complete. 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 Processor -- start 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 -- start start 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe01021e0 0x7fafe01a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe01081c0 0x7fafe019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0112360 con 0x7fafe0102ba0 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01121e0 con 0x7fafe01081c0 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.000+0000 7fafe6000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01124e0 con 0x7fafe01021e0 2024-03-28T05:44:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33798/0 (socket says 172.21.15.55:33798) 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 -- 172.21.15.55:0/1096766714 learned_addr learned my addr 172.21.15.55:0/1096766714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdfe00700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe01081c0 0x7fafe019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 -- 172.21.15.55:0/1096766714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe01021e0 msgr2=0x7fafe01a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe01021e0 0x7fafe01a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 -- 172.21.15.55:0/1096766714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe01081c0 msgr2=0x7fafe019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe01081c0 0x7fafe019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.001+0000 7fafdea00700 1 -- 172.21.15.55:0/1096766714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe019b080 con 0x7fafe0102ba0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafdea00700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005b40 tx=0x7fafcc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc027070 con 0x7fafe0102ba0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fafcc003fd0 con 0x7fafe0102ba0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe019b310 con 0x7fafe0102ba0 2024-03-28T05:44:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc022c60 con 0x7fafe0102ba0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.002+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe01a7630 con 0x7fafe0102ba0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.003+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0068e50 con 0x7fafe0102ba0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.005+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fafcc02a070 con 0x7fafe0102ba0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.006+0000 7fafd7e00700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 0x7fafc40a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.007+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fafcc022e00 con 0x7fafe0102ba0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.007+0000 7fafdf400700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 0x7fafc40a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.007+0000 7fafdf400700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 0x7fafc40a4de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafd0005fd0 tx=0x7fafd0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.009+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fafcc031020 con 0x7fafe0102ba0 2024-03-28T05:44:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:08 smithi055 ceph-mon[31863]: pgmap v407: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2701209303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-28T05:44:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2524303756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-28T05:44:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.250+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fafe01a7800 con 0x7fafe0102ba0 2024-03-28T05:44:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.251+0000 7fafd7e00700 1 -- 172.21.15.55:0/1096766714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fafcc013070 con 0x7fafe0102ba0 2024-03-28T05:44:09.253 INFO:teuthology.orchestra.run.smithi055.stdout:365072220191 2024-03-28T05:44:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.254+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 msgr2=0x7fafc40a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.254+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 0x7fafc40a4de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fafd0005fd0 tx=0x7fafd0005ee0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.254+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 msgr2=0x7fafe01a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.254+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005b40 tx=0x7fafcc005e80 comp rx=0 tx=0).stop 2024-03-28T05:44:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.254+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 shutdown_connections 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fafc40a2920 0x7fafc40a4de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe01081c0 0x7fafe019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe01021e0 0x7fafe01a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 --2- 172.21.15.55:0/1096766714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafe0102ba0 0x7fafe01a0ca0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 >> 172.21.15.55:0/1096766714 conn(0x7fafe00792c0 msgr2=0x7fafe00746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 shutdown_connections 2024-03-28T05:44:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:09.255+0000 7fafe6000700 1 -- 172.21.15.55:0/1096766714 wait complete. 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.932+0000 7f169be00700 1 -- 172.21.15.55:0/2408880667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c10e8f0 msgr2=0x7f169c110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.932+0000 7f169be00700 1 --2- 172.21.15.55:0/2408880667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c10e8f0 0x7f169c110d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f169400b0a0 tx=0x7f169400b3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 -- 172.21.15.55:0/2408880667 shutdown_connections 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 --2- 172.21.15.55:0/2408880667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c10e8f0 0x7f169c110d20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 --2- 172.21.15.55:0/2408880667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c074580 0x7f169c074960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 --2- 172.21.15.55:0/2408880667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 0x7f169c10e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 -- 172.21.15.55:0/2408880667 >> 172.21.15.55:0/2408880667 conn(0x7f169c0fdb60 msgr2=0x7f169c0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:09.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 -- 172.21.15.55:0/2408880667 shutdown_connections 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.933+0000 7f169be00700 1 -- 172.21.15.55:0/2408880667 wait complete. 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.934+0000 7f169be00700 1 Processor -- start 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.934+0000 7f169be00700 1 -- start start 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 0x7f169c1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c10e8f0 0x7f169c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c114480 con 0x7f169c074580 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c114300 con 0x7f169c074ea0 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169be00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c114600 con 0x7f169c10e8f0 2024-03-28T05:44:09.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52098/0 (socket says 172.21.15.55:52098) 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169aa00700 1 -- 172.21.15.55:0/4213080144 learned_addr learned my addr 172.21.15.55:0/4213080144 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169a000700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 0x7f169c1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.935+0000 7f169b400700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c10e8f0 0x7f169c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 -- 172.21.15.55:0/4213080144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c10e8f0 msgr2=0x7f169c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c10e8f0 0x7f169c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 -- 172.21.15.55:0/4213080144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 msgr2=0x7f169c1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 0x7f169c1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 -- 172.21.15.55:0/4213080144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c19b080 con 0x7f169c074580 2024-03-28T05:44:09.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169aa00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c920 tx=0x7f168c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c007b00 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f168c004ce0 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.936+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c19b370 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.937+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c005550 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.937+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c1a7600 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.939+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c075c30 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.940+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f168c004750 con 0x7f169c074580 2024-03-28T05:44:09.295 INFO:teuthology.orchestra.run.smithi055.stdout:146028888143 2024-03-28T05:44:09.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.941+0000 7f1693400700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 0x7f16800a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:09.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.942+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f168c0ceb50 con 0x7f169c074580 2024-03-28T05:44:09.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.942+0000 7f169a000700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 0x7f16800a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:09.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.942+0000 7f169a000700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 0x7f16800a4de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f169c19bf10 tx=0x7f168800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:09.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:06.946+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f168c014030 con 0x7f169c074580 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.179+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f169c19bc80 con 0x7f169c074580 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.180+0000 7f1693400700 1 -- 172.21.15.55:0/4213080144 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f168c09ba50 con 0x7f169c074580 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.182+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 msgr2=0x7f16800a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 0x7f16800a4de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f169c19bf10 tx=0x7f168800b410 comp rx=0 tx=0).stop 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 msgr2=0x7f169c1a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c920 tx=0x7f168c00cc30 comp rx=0 tx=0).stop 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 shutdown_connections 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16800a2920 0x7f16800a4de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169c074580 0x7f169c1a0680 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f169c10e8f0 0x7f169c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 --2- 172.21.15.55:0/4213080144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f169c074ea0 0x7f169c1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:09.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 >> 172.21.15.55:0/4213080144 conn(0x7f169c0fdb60 msgr2=0x7f169c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:09.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 shutdown_connections 2024-03-28T05:44:09.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:07.183+0000 7f169be00700 1 -- 172.21.15.55:0/4213080144 wait complete. 2024-03-28T05:44:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:08 smithi086 ceph-mon[35163]: pgmap v407: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:08 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2701209303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-28T05:44:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:08 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2524303756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-28T05:44:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:08 smithi159 ceph-mon[36109]: pgmap v407: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:08 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2701209303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-28T05:44:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:08 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2524303756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-28T05:44:10.240 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:09 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1096766714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-28T05:44:10.299 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149778 got 111669149782 for osd.3 2024-03-28T05:44:10.299 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:09 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1096766714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-28T05:44:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:09 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1096766714' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-28T05:44:10.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411414 got 77309411421 for osd.2 2024-03-28T05:44:10.905 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:11.007 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:10 smithi055 ceph-mon[31863]: pgmap v408: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:10 smithi086 ceph-mon[35163]: pgmap v408: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:10 smithi159 ceph-mon[36109]: pgmap v408: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 -- 172.21.15.55:0/2518748492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67006a7e0 msgr2=0x7fb67010f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 --2- 172.21.15.55:0/2518748492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67006a7e0 0x7fb67010f020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb66800b0d0 tx=0x7fb66800b3e0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 -- 172.21.15.55:0/2518748492 shutdown_connections 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 --2- 172.21.15.55:0/2518748492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67006a7e0 0x7fb67010f020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 --2- 172.21.15.55:0/2518748492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6701081e0 0x7fb6701085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 --2- 172.21.15.55:0/2518748492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb670069e40 0x7fb67006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.816+0000 7fb676000700 1 -- 172.21.15.55:0/2518748492 >> 172.21.15.55:0/2518748492 conn(0x7fb670077fc0 msgr2=0x7fb6700783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.817+0000 7fb676000700 1 -- 172.21.15.55:0/2518748492 shutdown_connections 2024-03-28T05:44:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.817+0000 7fb676000700 1 -- 172.21.15.55:0/2518748492 wait complete. 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.818+0000 7fb676000700 1 Processor -- start 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.818+0000 7fb676000700 1 -- start start 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.818+0000 7fb676000700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb670069e40 0x7fb6701a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.818+0000 7fb676000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb67006a7e0 0x7fb6701a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.818+0000 7fb676000700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb676000700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670112310 con 0x7fb670069e40 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb676000700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670112190 con 0x7fb6701081e0 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb676000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670112490 con 0x7fb67006a7e0 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb66fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb66ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb67006a7e0 0x7fb6701a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb66fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:42668/0 (socket says 172.21.15.55:42668) 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb66fe00700 1 -- 172.21.15.55:0/773450347 learned_addr learned my addr 172.21.15.55:0/773450347 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.819+0000 7fb66f400700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb670069e40 0x7fb6701a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 -- 172.21.15.55:0/773450347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb67006a7e0 msgr2=0x7fb6701a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb67006a7e0 0x7fb6701a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 -- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb670069e40 msgr2=0x7fb6701a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb670069e40 0x7fb6701a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 -- 172.21.15.55:0/773450347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67019aff0 con 0x7fb6701081e0 2024-03-28T05:44:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.820+0000 7fb66fe00700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6680095c0 tx=0x7fb668007a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.821+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66801f070 con 0x7fb6701081e0 2024-03-28T05:44:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.821+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67019b280 con 0x7fb6701081e0 2024-03-28T05:44:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.821+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6701a74f0 con 0x7fb6701081e0 2024-03-28T05:44:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.821+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb668003c00 con 0x7fb6701081e0 2024-03-28T05:44:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.821+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668024450 con 0x7fb6701081e0 2024-03-28T05:44:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.822+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb670103890 con 0x7fb6701081e0 2024-03-28T05:44:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.825+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fb668022070 con 0x7fb6701081e0 2024-03-28T05:44:11.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.826+0000 7fb667e00700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 0x7fb6540a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.826+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6680cff70 con 0x7fb6701081e0 2024-03-28T05:44:11.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.827+0000 7fb66f400700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 0x7fb6540a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.827+0000 7fb66f400700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 0x7fb6540a4e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6600045b0 tx=0x7fb66000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:11.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.840+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb668029020 con 0x7fb6701081e0 2024-03-28T05:44:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 -- 172.21.15.55:0/200972581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 msgr2=0x7f2dfc10e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 --2- 172.21.15.55:0/200972581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc10e370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009990 tx=0x7f2de8009ca0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 -- 172.21.15.55:0/200972581 shutdown_connections 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 --2- 172.21.15.55:0/200972581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 0x7f2dfc110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 --2- 172.21.15.55:0/200972581 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 0x7f2dfc0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 --2- 172.21.15.55:0/200972581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc10e370 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 -- 172.21.15.55:0/200972581 >> 172.21.15.55:0/200972581 conn(0x7f2dfc0fdb60 msgr2=0x7f2dfc0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 -- 172.21.15.55:0/200972581 shutdown_connections 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.718+0000 7f2e01e00700 1 -- 172.21.15.55:0/200972581 wait complete. 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.719+0000 7f2e01e00700 1 Processor -- start 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.719+0000 7f2e01e00700 1 -- start start 2024-03-28T05:44:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 0x7f2dfc1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 0x7f2dfc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc1144a0 con 0x7f2dfc074ee0 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc114320 con 0x7f2dfc10e8b0 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc114620 con 0x7f2dfc0745c0 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2dfbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2dfbe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33810/0 (socket says 172.21.15.55:33810) 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2dfbe00700 1 -- 172.21.15.55:0/2138900651 learned_addr learned my addr 172.21.15.55:0/2138900651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.720+0000 7f2e01400700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 0x7f2dfc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2e00a00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 0x7f2dfc1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 -- 172.21.15.55:0/2138900651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 msgr2=0x7f2dfc1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 0x7f2dfc1a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 -- 172.21.15.55:0/2138900651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 msgr2=0x7f2dfc19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 0x7f2dfc19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 -- 172.21.15.55:0/2138900651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc19b000 con 0x7f2dfc074ee0 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.721+0000 7f2dfbe00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.722+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8027070 con 0x7f2dfc074ee0 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.722+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc19b290 con 0x7f2dfc074ee0 2024-03-28T05:44:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.722+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2de8003f10 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.722+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8022cd0 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.722+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc1a74b0 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.723+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc075c70 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.725+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7f2de802a070 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.726+0000 7f2df9600700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 0x7f2de40a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.727+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2de80d0280 con 0x7f2dfc074ee0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.727+0000 7f2e00a00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 0x7f2de40a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.727+0000 7f2e00a00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 0x7f2de40a4de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2df0005950 tx=0x7f2df0005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.729+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2de8031020 con 0x7f2dfc074ee0 2024-03-28T05:44:11.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.971+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2dfc02da30 con 0x7f2dfc074ee0 2024-03-28T05:44:11.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.972+0000 7f2df9600700 1 -- 172.21.15.55:0/2138900651 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2de8013070 con 0x7f2dfc074ee0 2024-03-28T05:44:11.973 INFO:teuthology.orchestra.run.smithi055.stdout:206158430274 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.974+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 msgr2=0x7f2de40a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.974+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 0x7f2de40a4de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2df0005950 tx=0x7f2df0005eb0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.974+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 msgr2=0x7f2dfc1a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.974+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de80057c0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 shutdown_connections 2024-03-28T05:44:11.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2de40a2920 0x7f2de40a4de0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc10e8b0 0x7f2dfc19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dfc0745c0 0x7f2dfc1a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 --2- 172.21.15.55:0/2138900651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dfc074ee0 0x7f2dfc1a0b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 >> 172.21.15.55:0/2138900651 conn(0x7f2dfc0fdb60 msgr2=0x7f2dfc0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 shutdown_connections 2024-03-28T05:44:11.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:11.975+0000 7f2e01e00700 1 -- 172.21.15.55:0/2138900651 wait complete. 2024-03-28T05:44:12.074 INFO:tasks.cephadm.ceph_manager.ceph:need seq 365072220187 got 365072220191 for osd.11 2024-03-28T05:44:12.074 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.090+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fb6701a76c0 con 0x7fb6701081e0 2024-03-28T05:44:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.091+0000 7fb667e00700 1 -- 172.21.15.55:0/773450347 <== mon.2 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb66809cf40 con 0x7fb6701081e0 2024-03-28T05:44:12.092 INFO:teuthology.orchestra.run.smithi055.stdout:304942678062 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 msgr2=0x7fb6540a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 0x7fb6540a4e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6600045b0 tx=0x7fb66000b3c0 comp rx=0 tx=0).stop 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 msgr2=0x7fb67019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6680095c0 tx=0x7fb668007a20 comp rx=0 tx=0).stop 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 shutdown_connections 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6540a29a0 0x7fb6540a4e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb670069e40 0x7fb6701a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6701081e0 0x7fb67019a810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 --2- 172.21.15.55:0/773450347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb67006a7e0 0x7fb6701a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 >> 172.21.15.55:0/773450347 conn(0x7fb670077fc0 msgr2=0x7fb6700ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.094+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 shutdown_connections 2024-03-28T05:44:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:12.095+0000 7fb676000700 1 -- 172.21.15.55:0/773450347 wait complete. 2024-03-28T05:44:13.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234036 got 231928234043 for osd.7 2024-03-28T05:44:13.022 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:12 smithi086 ceph-mon[35163]: pgmap v409: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:12 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2138900651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-28T05:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:12 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/773450347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-28T05:44:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:12 smithi159 ceph-mon[36109]: pgmap v409: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:12 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2138900651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-28T05:44:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:12 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/773450347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-28T05:44:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:12 smithi055 ceph-mon[31863]: pgmap v409: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:12 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2138900651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-28T05:44:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:12 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/773450347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-28T05:44:13.978 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430268 got 206158430274 for osd.6 2024-03-28T05:44:13.979 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:14.725 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481824 got 330712481830 for osd.10 2024-03-28T05:44:14.726 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:14.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888136 got 146028888143 for osd.4 2024-03-28T05:44:14.849 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:15.248 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:14 smithi055 ceph-mon[31863]: pgmap v410: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:15.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678056 got 304942678062 for osd.9 2024-03-28T05:44:15.253 DEBUG:teuthology.parallel:result is None 2024-03-28T05:44:15.253 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-28T05:44:15.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-28T05:44:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:14 smithi086 ceph-mon[35163]: pgmap v410: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:14 smithi159 ceph-mon[36109]: pgmap v410: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:16.131 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:16 smithi086 ceph-mon[35163]: pgmap v411: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:16 smithi159 ceph-mon[36109]: pgmap v411: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:16 smithi055 ceph-mon[31863]: pgmap v411: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 -- 172.21.15.55:0/2479192652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 msgr2=0x7fb92810f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2479192652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb92810f0e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb92000b0d0 tx=0x7fb92000b3e0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 -- 172.21.15.55:0/2479192652 shutdown_connections 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2479192652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb92810f0e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2479192652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102440 0x7fb928102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2479192652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102df0 0x7fb928106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 -- 172.21.15.55:0/2479192652 >> 172.21.15.55:0/2479192652 conn(0x7fb9280792f0 msgr2=0x7fb928079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:18.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 -- 172.21.15.55:0/2479192652 shutdown_connections 2024-03-28T05:44:18.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.211+0000 7fb92ca00700 1 -- 172.21.15.55:0/2479192652 wait complete. 2024-03-28T05:44:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 Processor -- start 2024-03-28T05:44:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 -- start start 2024-03-28T05:44:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 0x7fb928074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102df0 0x7fb9280749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928112410 con 0x7fb928107510 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928112290 con 0x7fb928102440 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.213+0000 7fb92ca00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928112590 con 0x7fb928102df0 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33858/0 (socket says 172.21.15.55:33858) 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 -- 172.21.15.55:0/2237604239 learned_addr learned my addr 172.21.15.55:0/2237604239 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb925e00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 0x7fb928074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:18.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb925400700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102df0 0x7fb9280749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 -- 172.21.15.55:0/2237604239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102df0 msgr2=0x7fb9280749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102df0 0x7fb9280749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 -- 172.21.15.55:0/2237604239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 msgr2=0x7fb928074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 0x7fb928074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb926800700 1 -- 172.21.15.55:0/2237604239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9281a6e40 con 0x7fb928107510 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.214+0000 7fb925e00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 0x7fb928074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb926800700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb9200079a0 tx=0x7fb920007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92001f070 con 0x7fb928107510 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb920007d90 con 0x7fb928107510 2024-03-28T05:44:18.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92001b690 con 0x7fb928107510 2024-03-28T05:44:18.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9281a70d0 con 0x7fb928107510 2024-03-28T05:44:18.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.215+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9281a7580 con 0x7fb928107510 2024-03-28T05:44:18.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.217+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb928068e50 con 0x7fb928107510 2024-03-28T05:44:18.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.220+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 137341+0+0 (secure 0 0 0) 0x7fb920022070 con 0x7fb928107510 2024-03-28T05:44:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.221+0000 7fb91ea00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 0x7fb90c0a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.222+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb92000f020 con 0x7fb928107510 2024-03-28T05:44:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.222+0000 7fb925e00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 0x7fb90c0a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.223+0000 7fb925e00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 0x7fb90c0a4e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb918005950 tx=0x7fb9180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.224+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb920029020 con 0x7fb928107510 2024-03-28T05:44:18.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.449+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9280625d0 con 0x7fb90c0a29a0 2024-03-28T05:44:18.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.459+0000 7fb91ea00700 1 -- 172.21.15.55:0/2237604239 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258744 (secure 0 0 0) 0x7fb9280625d0 con 0x7fb90c0a29a0 2024-03-28T05:44:18.468 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:18.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.466+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 msgr2=0x7fb90c0a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:18.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.466+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 0x7fb90c0a4e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb918005950 tx=0x7fb9180058e0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.466+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 msgr2=0x7fb928074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:18.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.466+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb9200079a0 tx=0x7fb920007a80 comp rx=0 tx=0).stop 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 shutdown_connections 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb90c0a29a0 0x7fb90c0a4e60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb928107510 0x7fb928074f10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb928102440 0x7fb928074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 --2- 172.21.15.55:0/2237604239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb928102df0 0x7fb9280749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 >> 172.21.15.55:0/2237604239 conn(0x7fb9280792f0 msgr2=0x7fb928100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 shutdown_connections 2024-03-28T05:44:18.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:18.467+0000 7fb92ca00700 1 -- 172.21.15.55:0/2237604239 wait complete. 2024-03-28T05:44:18.473 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:44:19.248 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-03-28T05:44:17.853679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660246,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":622,"num_read_kb":432,"num_write":341,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181910,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388144,"kb_used_data":13944,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553680,"statfs":{"total":1151940427776,"available":1151542968320,"internally_reserved":0,"allocated":14278656,"data_stored":7753338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004899"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933331+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:43:18.933331+0000","last_peered":"2024-03-28T05:43:18.933331+0000","last_clean":"2024-03-28T05:43:18.933331+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:43:18.933331+0000","last_undegraded":"2024-03-28T05:43:18.933331+0000","last_fullsized":"2024-03-28T05:43:18.933331+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926923+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:43:18.926923+0000","last_peered":"2024-03-28T05:43:18.926923+0000","last_clean":"2024-03-28T05:43:18.926923+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:43:18.926923+0000","last_undegraded":"2024-03-28T05:43:18.926923+0000","last_fullsized":"2024-03-28T05:43:18.926923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926728+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:43:18.926728+0000","last_peered":"2024-03-28T05:43:18.926728+0000","last_clean":"2024-03-28T05:43:18.926728+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:43:18.926728+0000","last_undegraded":"2024-03-28T05:43:18.926728+0000","last_fullsized":"2024-03-28T05:43:18.926728+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923565+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:43:18.923565+0000","last_peered":"2024-03-28T05:43:18.923565+0000","last_clean":"2024-03-28T05:43:18.923565+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:43:18.923565+0000","last_undegraded":"2024-03-28T05:43:18.923565+0000","last_fullsized":"2024-03-28T05:43:18.923565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925715+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:43:18.925715+0000","last_peered":"2024-03-28T05:43:18.925715+0000","last_clean":"2024-03-28T05:43:18.925715+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:43:18.925715+0000","last_undegraded":"2024-03-28T05:43:18.925715+0000","last_fullsized":"2024-03-28T05:43:18.925715+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968643+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:43:18.968643+0000","last_peered":"2024-03-28T05:43:18.968643+0000","last_clean":"2024-03-28T05:43:18.968643+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:43:18.968643+0000","last_undegraded":"2024-03-28T05:43:18.968643+0000","last_fullsized":"2024-03-28T05:43:18.968643+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926410+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:43:18.926410+0000","last_peered":"2024-03-28T05:43:18.926410+0000","last_clean":"2024-03-28T05:43:18.926410+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:43:18.926410+0000","last_undegraded":"2024-03-28T05:43:18.926410+0000","last_fullsized":"2024-03-28T05:43:18.926410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930019+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:43:18.930019+0000","last_peered":"2024-03-28T05:43:18.930019+0000","last_clean":"2024-03-28T05:43:18.930019+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:43:18.930019+0000","last_undegraded":"2024-03-28T05:43:18.930019+0000","last_fullsized":"2024-03-28T05:43:18.930019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930853+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:43:18.930853+0000","last_peered":"2024-03-28T05:43:18.930853+0000","last_clean":"2024-03-28T05:43:18.930853+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:43:18.930853+0000","last_undegraded":"2024-03-28T05:43:18.930853+0000","last_fullsized":"2024-03-28T05:43:18.930853+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.969043+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:43:18.969043+0000","last_peered":"2024-03-28T05:43:18.969043+0000","last_clean":"2024-03-28T05:43:18.969043+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:43:18.969043+0000","last_undegraded":"2024-03-28T05:43:18.969043+0000","last_fullsized":"2024-03-28T05:43:18.969043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927069+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:43:18.927069+0000","last_peered":"2024-03-28T05:43:18.927069+0000","last_clean":"2024-03-28T05:43:18.927069+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:43:18.927069+0000","last_undegraded":"2024-03-28T05:43:18.927069+0000","last_fullsized":"2024-03-28T05:43:18.927069+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923453+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:43:18.923453+0000","last_peered":"2024-03-28T05:43:18.923453+0000","last_clean":"2024-03-28T05:43:18.923453+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:43:18.923453+0000","last_undegraded":"2024-03-28T05:43:18.923453+0000","last_fullsized":"2024-03-28T05:43:18.923453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932391+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:43:18.932391+0000","last_peered":"2024-03-28T05:43:18.932391+0000","last_clean":"2024-03-28T05:43:18.932391+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:43:18.932391+0000","last_undegraded":"2024-03-28T05:43:18.932391+0000","last_fullsized":"2024-03-28T05:43:18.932391+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926207+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:43:18.926207+0000","last_peered":"2024-03-28T05:43:18.926207+0000","last_clean":"2024-03-28T05:43:18.926207+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:43:18.926207+0000","last_undegraded":"2024-03-28T05:43:18.926207+0000","last_fullsized":"2024-03-28T05:43:18.926207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.941455+0000","last_change":"2024-03-28T05:43:18.941455+0000","last_active":"2024-03-28T05:43:18.941455+0000","last_peered":"2024-03-28T05:43:18.941455+0000","last_clean":"2024-03-28T05:43:18.941455+0000","last_became_active":"2024-03-28T05:43:18.941092+0000","last_became_peered":"2024-03-28T05:43:18.941092+0000","last_unstale":"2024-03-28T05:43:18.941455+0000","last_undegraded":"2024-03-28T05:43:18.941455+0000","last_fullsized":"2024-03-28T05:43:18.941455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:44:55.741140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929533+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:43:18.929533+0000","last_peered":"2024-03-28T05:43:18.929533+0000","last_clean":"2024-03-28T05:43:18.929533+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:43:18.929533+0000","last_undegraded":"2024-03-28T05:43:18.929533+0000","last_fullsized":"2024-03-28T05:43:18.929533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933039+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:43:18.933039+0000","last_peered":"2024-03-28T05:43:18.933039+0000","last_clean":"2024-03-28T05:43:18.933039+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:43:18.933039+0000","last_undegraded":"2024-03-28T05:43:18.933039+0000","last_fullsized":"2024-03-28T05:43:18.933039+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931883+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:43:18.931883+0000","last_peered":"2024-03-28T05:43:18.931883+0000","last_clean":"2024-03-28T05:43:18.931883+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:43:18.931883+0000","last_undegraded":"2024-03-28T05:43:18.931883+0000","last_fullsized":"2024-03-28T05:43:18.931883+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.934277+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:43:18.934277+0000","last_peered":"2024-03-28T05:43:18.934277+0000","last_clean":"2024-03-28T05:43:18.934277+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:43:18.934277+0000","last_undegraded":"2024-03-28T05:43:18.934277+0000","last_fullsized":"2024-03-28T05:43:18.934277+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933520+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:43:18.933520+0000","last_peered":"2024-03-28T05:43:18.933520+0000","last_clean":"2024-03-28T05:43:18.933520+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:43:18.933520+0000","last_undegraded":"2024-03-28T05:43:18.933520+0000","last_fullsized":"2024-03-28T05:43:18.933520+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932560+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:43:18.932560+0000","last_peered":"2024-03-28T05:43:18.932560+0000","last_clean":"2024-03-28T05:43:18.932560+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:43:18.932560+0000","last_undegraded":"2024-03-28T05:43:18.932560+0000","last_fullsized":"2024-03-28T05:43:18.932560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932799+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:43:18.932799+0000","last_peered":"2024-03-28T05:43:18.932799+0000","last_clean":"2024-03-28T05:43:18.932799+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:43:18.932799+0000","last_undegraded":"2024-03-28T05:43:18.932799+0000","last_fullsized":"2024-03-28T05:43:18.932799+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927152+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:43:18.927152+0000","last_peered":"2024-03-28T05:43:18.927152+0000","last_clean":"2024-03-28T05:43:18.927152+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:43:18.927152+0000","last_undegraded":"2024-03-28T05:43:18.927152+0000","last_fullsized":"2024-03-28T05:43:18.927152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926528+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:43:18.926528+0000","last_peered":"2024-03-28T05:43:18.926528+0000","last_clean":"2024-03-28T05:43:18.926528+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:43:18.926528+0000","last_undegraded":"2024-03-28T05:43:18.926528+0000","last_fullsized":"2024-03-28T05:43:18.926528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930286+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:43:18.930286+0000","last_peered":"2024-03-28T05:43:18.930286+0000","last_clean":"2024-03-28T05:43:18.930286+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:43:18.930286+0000","last_undegraded":"2024-03-28T05:43:18.930286+0000","last_fullsized":"2024-03-28T05:43:18.930286+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926797+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:43:18.926797+0000","last_peered":"2024-03-28T05:43:18.926797+0000","last_clean":"2024-03-28T05:43:18.926797+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:43:18.926797+0000","last_undegraded":"2024-03-28T05:43:18.926797+0000","last_fullsized":"2024-03-28T05:43:18.926797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948538+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:43:18.948538+0000","last_peered":"2024-03-28T05:43:18.948538+0000","last_clean":"2024-03-28T05:43:18.948538+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:43:18.948538+0000","last_undegraded":"2024-03-28T05:43:18.948538+0000","last_fullsized":"2024-03-28T05:43:18.948538+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":116,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:12.087478+0000","last_change":"2024-03-28T05:43:18.959998+0000","last_active":"2024-03-28T05:44:12.087478+0000","last_peered":"2024-03-28T05:44:12.087478+0000","last_clean":"2024-03-28T05:44:12.087478+0000","last_became_active":"2024-03-28T05:43:18.945599+0000","last_became_peered":"2024-03-28T05:43:18.945599+0000","last_unstale":"2024-03-28T05:44:12.087478+0000","last_undegraded":"2024-03-28T05:44:12.087478+0000","last_fullsized":"2024-03-28T05:44:12.087478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:02:08.702587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925695+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:43:18.925695+0000","last_peered":"2024-03-28T05:43:18.925695+0000","last_clean":"2024-03-28T05:43:18.925695+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:43:18.925695+0000","last_undegraded":"2024-03-28T05:43:18.925695+0000","last_fullsized":"2024-03-28T05:43:18.925695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968521+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:43:18.968521+0000","last_peered":"2024-03-28T05:43:18.968521+0000","last_clean":"2024-03-28T05:43:18.968521+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:43:18.968521+0000","last_undegraded":"2024-03-28T05:43:18.968521+0000","last_fullsized":"2024-03-28T05:43:18.968521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.950125+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:43:18.950125+0000","last_peered":"2024-03-28T05:43:18.950125+0000","last_clean":"2024-03-28T05:43:18.950125+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:43:18.950125+0000","last_undegraded":"2024-03-28T05:43:18.950125+0000","last_fullsized":"2024-03-28T05:43:18.950125+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932322+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:43:18.932322+0000","last_peered":"2024-03-28T05:43:18.932322+0000","last_clean":"2024-03-28T05:43:18.932322+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:43:18.932322+0000","last_undegraded":"2024-03-28T05:43:18.932322+0000","last_fullsized":"2024-03-28T05:43:18.932322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930169+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:43:18.930169+0000","last_peered":"2024-03-28T05:43:18.930169+0000","last_clean":"2024-03-28T05:43:18.930169+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:43:18.930169+0000","last_undegraded":"2024-03-28T05:43:18.930169+0000","last_fullsized":"2024-03-28T05:43:18.930169+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942255+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:43:18.942255+0000","last_peered":"2024-03-28T05:43:18.942255+0000","last_clean":"2024-03-28T05:43:18.942255+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:43:18.942255+0000","last_undegraded":"2024-03-28T05:43:18.942255+0000","last_fullsized":"2024-03-28T05:43:18.942255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932257+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:43:18.932257+0000","last_peered":"2024-03-28T05:43:18.932257+0000","last_clean":"2024-03-28T05:43:18.932257+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:43:18.932257+0000","last_undegraded":"2024-03-28T05:43:18.932257+0000","last_fullsized":"2024-03-28T05:43:18.932257+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:16.096794+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:44:16.096794+0000","last_peered":"2024-03-28T05:44:16.096794+0000","last_clean":"2024-03-28T05:44:16.096794+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:44:16.096794+0000","last_undegraded":"2024-03-28T05:44:16.096794+0000","last_fullsized":"2024-03-28T05:44:16.096794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930746+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:43:18.930746+0000","last_peered":"2024-03-28T05:43:18.930746+0000","last_clean":"2024-03-28T05:43:18.930746+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:43:18.930746+0000","last_undegraded":"2024-03-28T05:43:18.930746+0000","last_fullsized":"2024-03-28T05:43:18.930746+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937927+0000","last_change":"2024-03-28T05:43:18.937927+0000","last_active":"2024-03-28T05:43:18.937927+0000","last_peered":"2024-03-28T05:43:18.937927+0000","last_clean":"2024-03-28T05:43:18.937927+0000","last_became_active":"2024-03-28T05:43:18.931224+0000","last_became_peered":"2024-03-28T05:43:18.931224+0000","last_unstale":"2024-03-28T05:43:18.937927+0000","last_undegraded":"2024-03-28T05:43:18.937927+0000","last_fullsized":"2024-03-28T05:43:18.937927+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:57:28.359905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927272+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:43:18.927272+0000","last_peered":"2024-03-28T05:43:18.927272+0000","last_clean":"2024-03-28T05:43:18.927272+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:43:18.927272+0000","last_undegraded":"2024-03-28T05:43:18.927272+0000","last_fullsized":"2024-03-28T05:43:18.927272+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948713+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:43:18.948713+0000","last_peered":"2024-03-28T05:43:18.948713+0000","last_clean":"2024-03-28T05:43:18.948713+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:43:18.948713+0000","last_undegraded":"2024-03-28T05:43:18.948713+0000","last_fullsized":"2024-03-28T05:43:18.948713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930486+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:43:18.930486+0000","last_peered":"2024-03-28T05:43:18.930486+0000","last_clean":"2024-03-28T05:43:18.930486+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:43:18.930486+0000","last_undegraded":"2024-03-28T05:43:18.930486+0000","last_fullsized":"2024-03-28T05:43:18.930486+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'29","reported_seq":217,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.084798+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:44:17.084798+0000","last_peered":"2024-03-28T05:44:17.084798+0000","last_clean":"2024-03-28T05:44:17.084798+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:44:17.084798+0000","last_undegraded":"2024-03-28T05:44:17.084798+0000","last_fullsized":"2024-03-28T05:44:17.084798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65252,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":147,"num_write":30,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926047+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:43:18.926047+0000","last_peered":"2024-03-28T05:43:18.926047+0000","last_clean":"2024-03-28T05:43:18.926047+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:43:18.926047+0000","last_undegraded":"2024-03-28T05:43:18.926047+0000","last_fullsized":"2024-03-28T05:43:18.926047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936573+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:43:18.936573+0000","last_peered":"2024-03-28T05:43:18.936573+0000","last_clean":"2024-03-28T05:43:18.936573+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:43:18.936573+0000","last_undegraded":"2024-03-28T05:43:18.936573+0000","last_fullsized":"2024-03-28T05:43:18.936573+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932699+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:43:18.932699+0000","last_peered":"2024-03-28T05:43:18.932699+0000","last_clean":"2024-03-28T05:43:18.932699+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:43:18.932699+0000","last_undegraded":"2024-03-28T05:43:18.932699+0000","last_fullsized":"2024-03-28T05:43:18.932699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.945955+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:43:18.945955+0000","last_peered":"2024-03-28T05:43:18.945955+0000","last_clean":"2024-03-28T05:43:18.945955+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:43:18.945955+0000","last_undegraded":"2024-03-28T05:43:18.945955+0000","last_fullsized":"2024-03-28T05:43:18.945955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.935508+0000","last_change":"2024-03-28T05:43:18.935508+0000","last_active":"2024-03-28T05:43:18.935508+0000","last_peered":"2024-03-28T05:43:18.935508+0000","last_clean":"2024-03-28T05:43:18.935508+0000","last_became_active":"2024-03-28T05:43:18.934708+0000","last_became_peered":"2024-03-28T05:43:18.934708+0000","last_unstale":"2024-03-28T05:43:18.935508+0000","last_undegraded":"2024-03-28T05:43:18.935508+0000","last_fullsized":"2024-03-28T05:43:18.935508+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:09:07.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:14.007417+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:44:14.007417+0000","last_peered":"2024-03-28T05:44:14.007417+0000","last_clean":"2024-03-28T05:44:14.007417+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:44:14.007417+0000","last_undegraded":"2024-03-28T05:44:14.007417+0000","last_fullsized":"2024-03-28T05:44:14.007417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926296+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:43:18.926296+0000","last_peered":"2024-03-28T05:43:18.926296+0000","last_clean":"2024-03-28T05:43:18.926296+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:43:18.926296+0000","last_undegraded":"2024-03-28T05:43:18.926296+0000","last_fullsized":"2024-03-28T05:43:18.926296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925514+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:43:18.925514+0000","last_peered":"2024-03-28T05:43:18.925514+0000","last_clean":"2024-03-28T05:43:18.925514+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:43:18.925514+0000","last_undegraded":"2024-03-28T05:43:18.925514+0000","last_fullsized":"2024-03-28T05:43:18.925514+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942860+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:43:18.942860+0000","last_peered":"2024-03-28T05:43:18.942860+0000","last_clean":"2024-03-28T05:43:18.942860+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:43:18.942860+0000","last_undegraded":"2024-03-28T05:43:18.942860+0000","last_fullsized":"2024-03-28T05:43:18.942860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957174+0000","last_change":"2024-03-28T05:43:18.956299+0000","last_active":"2024-03-28T05:43:18.957174+0000","last_peered":"2024-03-28T05:43:18.957174+0000","last_clean":"2024-03-28T05:43:18.957174+0000","last_became_active":"2024-03-28T05:43:18.947840+0000","last_became_peered":"2024-03-28T05:43:18.947840+0000","last_unstale":"2024-03-28T05:43:18.957174+0000","last_undegraded":"2024-03-28T05:43:18.957174+0000","last_fullsized":"2024-03-28T05:43:18.957174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:51.876409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930707+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:43:18.930707+0000","last_peered":"2024-03-28T05:43:18.930707+0000","last_clean":"2024-03-28T05:43:18.930707+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:43:18.930707+0000","last_undegraded":"2024-03-28T05:43:18.930707+0000","last_fullsized":"2024-03-28T05:43:18.930707+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931688+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:43:18.931688+0000","last_peered":"2024-03-28T05:43:18.931688+0000","last_clean":"2024-03-28T05:43:18.931688+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:43:18.931688+0000","last_undegraded":"2024-03-28T05:43:18.931688+0000","last_fullsized":"2024-03-28T05:43:18.931688+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968807+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:43:18.968807+0000","last_peered":"2024-03-28T05:43:18.968807+0000","last_clean":"2024-03-28T05:43:18.968807+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:43:18.968807+0000","last_undegraded":"2024-03-28T05:43:18.968807+0000","last_fullsized":"2024-03-28T05:43:18.968807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926601+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:43:18.926601+0000","last_peered":"2024-03-28T05:43:18.926601+0000","last_clean":"2024-03-28T05:43:18.926601+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:43:18.926601+0000","last_undegraded":"2024-03-28T05:43:18.926601+0000","last_fullsized":"2024-03-28T05:43:18.926601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968752+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:43:18.968752+0000","last_peered":"2024-03-28T05:43:18.968752+0000","last_clean":"2024-03-28T05:43:18.968752+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:43:18.968752+0000","last_undegraded":"2024-03-28T05:43:18.968752+0000","last_fullsized":"2024-03-28T05:43:18.968752+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.943500+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:43:18.943500+0000","last_peered":"2024-03-28T05:43:18.943500+0000","last_clean":"2024-03-28T05:43:18.943500+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:43:18.943500+0000","last_undegraded":"2024-03-28T05:43:18.943500+0000","last_fullsized":"2024-03-28T05:43:18.943500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:14.006400+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:44:14.006400+0000","last_peered":"2024-03-28T05:44:14.006400+0000","last_clean":"2024-03-28T05:44:14.006400+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:44:14.006400+0000","last_undegraded":"2024-03-28T05:44:14.006400+0000","last_fullsized":"2024-03-28T05:44:14.006400+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930395+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:43:18.930395+0000","last_peered":"2024-03-28T05:43:18.930395+0000","last_clean":"2024-03-28T05:43:18.930395+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:43:18.930395+0000","last_undegraded":"2024-03-28T05:43:18.930395+0000","last_fullsized":"2024-03-28T05:43:18.930395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923880+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:43:18.923880+0000","last_peered":"2024-03-28T05:43:18.923880+0000","last_clean":"2024-03-28T05:43:18.923880+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:43:18.923880+0000","last_undegraded":"2024-03-28T05:43:18.923880+0000","last_fullsized":"2024-03-28T05:43:18.923880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927223+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:43:18.927223+0000","last_peered":"2024-03-28T05:43:18.927223+0000","last_clean":"2024-03-28T05:43:18.927223+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:43:18.927223+0000","last_undegraded":"2024-03-28T05:43:18.927223+0000","last_fullsized":"2024-03-28T05:43:18.927223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932764+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:43:18.932764+0000","last_peered":"2024-03-28T05:43:18.932764+0000","last_clean":"2024-03-28T05:43:18.932764+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:43:18.932764+0000","last_undegraded":"2024-03-28T05:43:18.932764+0000","last_fullsized":"2024-03-28T05:43:18.932764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926590+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:43:18.926590+0000","last_peered":"2024-03-28T05:43:18.926590+0000","last_clean":"2024-03-28T05:43:18.926590+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:43:18.926590+0000","last_undegraded":"2024-03-28T05:43:18.926590+0000","last_fullsized":"2024-03-28T05:43:18.926590+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.951170+0000","last_change":"2024-03-28T05:43:18.950408+0000","last_active":"2024-03-28T05:43:18.951170+0000","last_peered":"2024-03-28T05:43:18.951170+0000","last_clean":"2024-03-28T05:43:18.951170+0000","last_became_active":"2024-03-28T05:43:18.936590+0000","last_became_peered":"2024-03-28T05:43:18.936590+0000","last_unstale":"2024-03-28T05:43:18.951170+0000","last_undegraded":"2024-03-28T05:43:18.951170+0000","last_fullsized":"2024-03-28T05:43:18.951170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:39:27.277236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932269+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:43:18.932269+0000","last_peered":"2024-03-28T05:43:18.932269+0000","last_clean":"2024-03-28T05:43:18.932269+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:43:18.932269+0000","last_undegraded":"2024-03-28T05:43:18.932269+0000","last_fullsized":"2024-03-28T05:43:18.932269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'8","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931780+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:43:18.931780+0000","last_peered":"2024-03-28T05:43:18.931780+0000","last_clean":"2024-03-28T05:43:18.931780+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:43:18.931780+0000","last_undegraded":"2024-03-28T05:43:18.931780+0000","last_fullsized":"2024-03-28T05:43:18.931780+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931986+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:43:18.931986+0000","last_peered":"2024-03-28T05:43:18.931986+0000","last_clean":"2024-03-28T05:43:18.931986+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:43:18.931986+0000","last_undegraded":"2024-03-28T05:43:18.931986+0000","last_fullsized":"2024-03-28T05:43:18.931986+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923579+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:43:18.923579+0000","last_peered":"2024-03-28T05:43:18.923579+0000","last_clean":"2024-03-28T05:43:18.923579+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:43:18.923579+0000","last_undegraded":"2024-03-28T05:43:18.923579+0000","last_fullsized":"2024-03-28T05:43:18.923579+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927058+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:43:18.927058+0000","last_peered":"2024-03-28T05:43:18.927058+0000","last_clean":"2024-03-28T05:43:18.927058+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:43:18.927058+0000","last_undegraded":"2024-03-28T05:43:18.927058+0000","last_fullsized":"2024-03-28T05:43:18.927058+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929739+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:43:18.929739+0000","last_peered":"2024-03-28T05:43:18.929739+0000","last_clean":"2024-03-28T05:43:18.929739+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:43:18.929739+0000","last_undegraded":"2024-03-28T05:43:18.929739+0000","last_fullsized":"2024-03-28T05:43:18.929739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925275+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:43:18.925275+0000","last_peered":"2024-03-28T05:43:18.925275+0000","last_clean":"2024-03-28T05:43:18.925275+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:43:18.925275+0000","last_undegraded":"2024-03-28T05:43:18.925275+0000","last_fullsized":"2024-03-28T05:43:18.925275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930335+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:43:18.930335+0000","last_peered":"2024-03-28T05:43:18.930335+0000","last_clean":"2024-03-28T05:43:18.930335+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:43:18.930335+0000","last_undegraded":"2024-03-28T05:43:18.930335+0000","last_fullsized":"2024-03-28T05:43:18.930335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930380+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:43:18.930380+0000","last_peered":"2024-03-28T05:43:18.930380+0000","last_clean":"2024-03-28T05:43:18.930380+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:43:18.930380+0000","last_undegraded":"2024-03-28T05:43:18.930380+0000","last_fullsized":"2024-03-28T05:43:18.930380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.934937+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:43:18.934937+0000","last_peered":"2024-03-28T05:43:18.934937+0000","last_clean":"2024-03-28T05:43:18.934937+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:43:18.934937+0000","last_undegraded":"2024-03-28T05:43:18.934937+0000","last_fullsized":"2024-03-28T05:43:18.934937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930659+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:43:18.930659+0000","last_peered":"2024-03-28T05:43:18.930659+0000","last_clean":"2024-03-28T05:43:18.930659+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:43:18.930659+0000","last_undegraded":"2024-03-28T05:43:18.930659+0000","last_fullsized":"2024-03-28T05:43:18.930659+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925733+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:43:18.925733+0000","last_peered":"2024-03-28T05:43:18.925733+0000","last_clean":"2024-03-28T05:43:18.925733+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:43:18.925733+0000","last_undegraded":"2024-03-28T05:43:18.925733+0000","last_fullsized":"2024-03-28T05:43:18.925733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926801+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:43:18.926801+0000","last_peered":"2024-03-28T05:43:18.926801+0000","last_clean":"2024-03-28T05:43:18.926801+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:43:18.926801+0000","last_undegraded":"2024-03-28T05:43:18.926801+0000","last_fullsized":"2024-03-28T05:43:18.926801+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937313+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:43:18.937313+0000","last_peered":"2024-03-28T05:43:18.937313+0000","last_clean":"2024-03-28T05:43:18.937313+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:43:18.937313+0000","last_undegraded":"2024-03-28T05:43:18.937313+0000","last_fullsized":"2024-03-28T05:43:18.937313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927187+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:43:18.927187+0000","last_peered":"2024-03-28T05:43:18.927187+0000","last_clean":"2024-03-28T05:43:18.927187+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:43:18.927187+0000","last_undegraded":"2024-03-28T05:43:18.927187+0000","last_fullsized":"2024-03-28T05:43:18.927187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948343+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:43:18.948343+0000","last_peered":"2024-03-28T05:43:18.948343+0000","last_clean":"2024-03-28T05:43:18.948343+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:43:18.948343+0000","last_undegraded":"2024-03-28T05:43:18.948343+0000","last_fullsized":"2024-03-28T05:43:18.948343+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'1","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957536+0000","last_change":"2024-03-28T05:43:18.957536+0000","last_active":"2024-03-28T05:43:18.957536+0000","last_peered":"2024-03-28T05:43:18.957536+0000","last_clean":"2024-03-28T05:43:18.957536+0000","last_became_active":"2024-03-28T05:43:18.945541+0000","last_became_peered":"2024-03-28T05:43:18.945541+0000","last_unstale":"2024-03-28T05:43:18.957536+0000","last_undegraded":"2024-03-28T05:43:18.957536+0000","last_fullsized":"2024-03-28T05:43:18.957536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:35:23.625743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933054+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:43:18.933054+0000","last_peered":"2024-03-28T05:43:18.933054+0000","last_clean":"2024-03-28T05:43:18.933054+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:43:18.933054+0000","last_undegraded":"2024-03-28T05:43:18.933054+0000","last_fullsized":"2024-03-28T05:43:18.933054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926701+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:43:18.926701+0000","last_peered":"2024-03-28T05:43:18.926701+0000","last_clean":"2024-03-28T05:43:18.926701+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:43:18.926701+0000","last_undegraded":"2024-03-28T05:43:18.926701+0000","last_fullsized":"2024-03-28T05:43:18.926701+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930466+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:43:18.930466+0000","last_peered":"2024-03-28T05:43:18.930466+0000","last_clean":"2024-03-28T05:43:18.930466+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:43:18.930466+0000","last_undegraded":"2024-03-28T05:43:18.930466+0000","last_fullsized":"2024-03-28T05:43:18.930466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937325+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:43:18.937325+0000","last_peered":"2024-03-28T05:43:18.937325+0000","last_clean":"2024-03-28T05:43:18.937325+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:43:18.937325+0000","last_undegraded":"2024-03-28T05:43:18.937325+0000","last_fullsized":"2024-03-28T05:43:18.937325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936012+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:43:18.936012+0000","last_peered":"2024-03-28T05:43:18.936012+0000","last_clean":"2024-03-28T05:43:18.936012+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:43:18.936012+0000","last_undegraded":"2024-03-28T05:43:18.936012+0000","last_fullsized":"2024-03-28T05:43:18.936012+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926394+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:43:18.926394+0000","last_peered":"2024-03-28T05:43:18.926394+0000","last_clean":"2024-03-28T05:43:18.926394+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:43:18.926394+0000","last_undegraded":"2024-03-28T05:43:18.926394+0000","last_fullsized":"2024-03-28T05:43:18.926394+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932638+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:43:18.932638+0000","last_peered":"2024-03-28T05:43:18.932638+0000","last_clean":"2024-03-28T05:43:18.932638+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:43:18.932638+0000","last_undegraded":"2024-03-28T05:43:18.932638+0000","last_fullsized":"2024-03-28T05:43:18.932638+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931721+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:43:18.931721+0000","last_peered":"2024-03-28T05:43:18.931721+0000","last_clean":"2024-03-28T05:43:18.931721+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:43:18.931721+0000","last_undegraded":"2024-03-28T05:43:18.931721+0000","last_fullsized":"2024-03-28T05:43:18.931721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.935114+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:43:18.935114+0000","last_peered":"2024-03-28T05:43:18.935114+0000","last_clean":"2024-03-28T05:43:18.935114+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:43:18.935114+0000","last_undegraded":"2024-03-28T05:43:18.935114+0000","last_fullsized":"2024-03-28T05:43:18.935114+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931456+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:43:18.931456+0000","last_peered":"2024-03-28T05:43:18.931456+0000","last_clean":"2024-03-28T05:43:18.931456+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:43:18.931456+0000","last_undegraded":"2024-03-28T05:43:18.931456+0000","last_fullsized":"2024-03-28T05:43:18.931456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.940562+0000","last_change":"2024-03-28T05:43:18.939398+0000","last_active":"2024-03-28T05:43:18.940562+0000","last_peered":"2024-03-28T05:43:18.940562+0000","last_clean":"2024-03-28T05:43:18.940562+0000","last_became_active":"2024-03-28T05:43:18.936942+0000","last_became_peered":"2024-03-28T05:43:18.936942+0000","last_unstale":"2024-03-28T05:43:18.940562+0000","last_undegraded":"2024-03-28T05:43:18.940562+0000","last_fullsized":"2024-03-28T05:43:18.940562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:02:50.892203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930105+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:43:18.930105+0000","last_peered":"2024-03-28T05:43:18.930105+0000","last_clean":"2024-03-28T05:43:18.930105+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:43:18.930105+0000","last_undegraded":"2024-03-28T05:43:18.930105+0000","last_fullsized":"2024-03-28T05:43:18.930105+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930122+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:43:18.930122+0000","last_peered":"2024-03-28T05:43:18.930122+0000","last_clean":"2024-03-28T05:43:18.930122+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:43:18.930122+0000","last_undegraded":"2024-03-28T05:43:18.930122+0000","last_fullsized":"2024-03-28T05:43:18.930122+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932499+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:43:18.932499+0000","last_peered":"2024-03-28T05:43:18.932499+0000","last_clean":"2024-03-28T05:43:18.932499+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:43:18.932499+0000","last_undegraded":"2024-03-28T05:43:18.932499+0000","last_fullsized":"2024-03-28T05:43:18.932499+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.944603+0000","last_change":"2024-03-28T05:43:18.944603+0000","last_active":"2024-03-28T05:43:18.944603+0000","last_peered":"2024-03-28T05:43:18.944603+0000","last_clean":"2024-03-28T05:43:18.944603+0000","last_became_active":"2024-03-28T05:43:18.943787+0000","last_became_peered":"2024-03-28T05:43:18.943787+0000","last_unstale":"2024-03-28T05:43:18.944603+0000","last_undegraded":"2024-03-28T05:43:18.944603+0000","last_fullsized":"2024-03-28T05:43:18.944603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:13.905446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69644,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":496,"num_read_kb":323,"num_write":158,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1057,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":208932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220193,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":481676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481832,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1708032,"data_stored":1138756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678063,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":481985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939702,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":481744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234045,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36924,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708228,"statfs":{"total":95995035648,"available":95957225472,"internally_reserved":0,"allocated":1617920,"data_stored":1074109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430275,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":546302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":482528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1093632,"data_stored":547030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149785,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":481451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888145,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":483098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1630208,"data_stored":1073402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:44:19.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-28T05:44:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:19 smithi086 ceph-mon[35163]: pgmap v412: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:19 smithi086 ceph-mon[35163]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:19 smithi086 ceph-mon[35163]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-28T05:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:19 smithi159 ceph-mon[36109]: pgmap v412: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:19 smithi159 ceph-mon[36109]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:19 smithi159 ceph-mon[36109]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-28T05:44:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:19 smithi055 ceph-mon[31863]: pgmap v412: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:19 smithi055 ceph-mon[31863]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:19 smithi055 ceph-mon[31863]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-28T05:44:19.734 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:44:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:44:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:44:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:44:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:20.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:44:20.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:44:20.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:44:21.534 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:21 smithi055 ceph-mon[31863]: pgmap v413: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-28T05:44:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 -- 172.21.15.55:0/2737714899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b8109160 msgr2=0x7f65b8115670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 --2- 172.21.15.55:0/2737714899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b8109160 0x7f65b8115670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65b000b0a0 tx=0x7f65b000b3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 -- 172.21.15.55:0/2737714899 shutdown_connections 2024-03-28T05:44:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 --2- 172.21.15.55:0/2737714899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b8109160 0x7f65b8115670 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 --2- 172.21.15.55:0/2737714899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b810e7a0 0x7f65b810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 --2- 172.21.15.55:0/2737714899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b81087a0 0x7f65b8108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.795+0000 7f65bcc00700 1 -- 172.21.15.55:0/2737714899 >> 172.21.15.55:0/2737714899 conn(0x7f65b8075960 msgr2=0x7f65b8077d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.796+0000 7f65bcc00700 1 -- 172.21.15.55:0/2737714899 shutdown_connections 2024-03-28T05:44:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.796+0000 7f65bcc00700 1 -- 172.21.15.55:0/2737714899 wait complete. 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 Processor -- start 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 -- start start 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 0x7f65b819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b8109160 0x7f65b819f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b81189f0 con 0x7f65b810e7a0 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8118870 con 0x7f65b81087a0 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.797+0000 7f65bcc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8118b70 con 0x7f65b8109160 2024-03-28T05:44:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37810/0 (socket says 172.21.15.55:37810) 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 -- 172.21.15.55:0/102651005 learned_addr learned my addr 172.21.15.55:0/102651005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b5e00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 0x7f65b819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 -- 172.21.15.55:0/102651005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b8109160 msgr2=0x7f65b819f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b5400700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b8109160 0x7f65b819f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b8109160 0x7f65b819f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 -- 172.21.15.55:0/102651005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 msgr2=0x7f65b819ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 0x7f65b819ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b6800700 1 -- 172.21.15.55:0/102651005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b81a3e10 con 0x7f65b810e7a0 2024-03-28T05:44:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.798+0000 7f65b5e00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 0x7f65b819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65b6800700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65b000b070 tx=0x7f65b0004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0021070 con 0x7f65b810e7a0 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f65b0003c00 con 0x7f65b810e7a0 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0004890 con 0x7f65b810e7a0 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b81a40a0 con 0x7f65b810e7a0 2024-03-28T05:44:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.799+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b81ab980 con 0x7f65b810e7a0 2024-03-28T05:44:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.800+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b8068e50 con 0x7f65b810e7a0 2024-03-28T05:44:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.802+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f65b0004020 con 0x7f65b810e7a0 2024-03-28T05:44:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.805+0000 7f65aea00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 0x7f659c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.805+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f65b000f020 con 0x7f65b810e7a0 2024-03-28T05:44:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.805+0000 7f65b5e00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 0x7f659c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:21.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.805+0000 7f65b5e00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 0x7f659c0a4dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009c90 tx=0x7f65a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:21.809+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f65b002a020 con 0x7f65b810e7a0 2024-03-28T05:44:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:21 smithi086 ceph-mon[35163]: pgmap v413: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-28T05:44:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:21 smithi159 ceph-mon[36109]: pgmap v413: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-28T05:44:22.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.032+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65b80625d0 con 0x7f659c0a2910 2024-03-28T05:44:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.056+0000 7f65aea00700 1 -- 172.21.15.55:0/102651005 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258974 (secure 0 0 0) 0x7f65b80625d0 con 0x7f659c0a2910 2024-03-28T05:44:22.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.063+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 msgr2=0x7f659c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.063+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 0x7f659c0a4dd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009c90 tx=0x7f65a8009260 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.063+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 msgr2=0x7f65b81a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.063+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f65b000b070 tx=0x7f65b0004da0 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 shutdown_connections 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f659c0a2910 0x7f659c0a4dd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b810e7a0 0x7f65b81a36d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65b81087a0 0x7f65b819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 --2- 172.21.15.55:0/102651005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b8109160 0x7f65b819f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 >> 172.21.15.55:0/102651005 conn(0x7f65b8075960 msgr2=0x7f65b8075ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 shutdown_connections 2024-03-28T05:44:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:22.064+0000 7f65bcc00700 1 -- 172.21.15.55:0/102651005 wait complete. 2024-03-28T05:44:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:44:22.862 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-03-28T05:44:21.855115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660528,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":639,"num_read_kb":439,"num_write":346,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181910,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":693,"ondisk_log_size":693,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388080,"kb_used_data":13944,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553744,"statfs":{"total":1151940427776,"available":1151543033856,"internally_reserved":0,"allocated":14278656,"data_stored":7754541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004863"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840597+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:44:17.840597+0000","last_peered":"2024-03-28T05:44:17.840597+0000","last_clean":"2024-03-28T05:44:17.840597+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:44:17.840597+0000","last_undegraded":"2024-03-28T05:44:17.840597+0000","last_fullsized":"2024-03-28T05:44:17.840597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926923+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:43:18.926923+0000","last_peered":"2024-03-28T05:43:18.926923+0000","last_clean":"2024-03-28T05:43:18.926923+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:43:18.926923+0000","last_undegraded":"2024-03-28T05:43:18.926923+0000","last_fullsized":"2024-03-28T05:43:18.926923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926728+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:43:18.926728+0000","last_peered":"2024-03-28T05:43:18.926728+0000","last_clean":"2024-03-28T05:43:18.926728+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:43:18.926728+0000","last_undegraded":"2024-03-28T05:43:18.926728+0000","last_fullsized":"2024-03-28T05:43:18.926728+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825716+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:44:17.825716+0000","last_peered":"2024-03-28T05:44:17.825716+0000","last_clean":"2024-03-28T05:44:17.825716+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:44:17.825716+0000","last_undegraded":"2024-03-28T05:44:17.825716+0000","last_fullsized":"2024-03-28T05:44:17.825716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813565+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:44:17.813565+0000","last_peered":"2024-03-28T05:44:17.813565+0000","last_clean":"2024-03-28T05:44:17.813565+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:44:17.813565+0000","last_undegraded":"2024-03-28T05:44:17.813565+0000","last_fullsized":"2024-03-28T05:44:17.813565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968643+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:43:18.968643+0000","last_peered":"2024-03-28T05:43:18.968643+0000","last_clean":"2024-03-28T05:43:18.968643+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:43:18.968643+0000","last_undegraded":"2024-03-28T05:43:18.968643+0000","last_fullsized":"2024-03-28T05:43:18.968643+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814160+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:44:17.814160+0000","last_peered":"2024-03-28T05:44:17.814160+0000","last_clean":"2024-03-28T05:44:17.814160+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:44:17.814160+0000","last_undegraded":"2024-03-28T05:44:17.814160+0000","last_fullsized":"2024-03-28T05:44:17.814160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816586+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:44:17.816586+0000","last_peered":"2024-03-28T05:44:17.816586+0000","last_clean":"2024-03-28T05:44:17.816586+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:44:17.816586+0000","last_undegraded":"2024-03-28T05:44:17.816586+0000","last_fullsized":"2024-03-28T05:44:17.816586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.844240+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:44:17.844240+0000","last_peered":"2024-03-28T05:44:17.844240+0000","last_clean":"2024-03-28T05:44:17.844240+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:44:17.844240+0000","last_undegraded":"2024-03-28T05:44:17.844240+0000","last_fullsized":"2024-03-28T05:44:17.844240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.969043+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:43:18.969043+0000","last_peered":"2024-03-28T05:43:18.969043+0000","last_clean":"2024-03-28T05:43:18.969043+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:43:18.969043+0000","last_undegraded":"2024-03-28T05:43:18.969043+0000","last_fullsized":"2024-03-28T05:43:18.969043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841639+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:44:17.841639+0000","last_peered":"2024-03-28T05:44:17.841639+0000","last_clean":"2024-03-28T05:44:17.841639+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:44:17.841639+0000","last_undegraded":"2024-03-28T05:44:17.841639+0000","last_fullsized":"2024-03-28T05:44:17.841639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.820910+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:44:17.820910+0000","last_peered":"2024-03-28T05:44:17.820910+0000","last_clean":"2024-03-28T05:44:17.820910+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:44:17.820910+0000","last_undegraded":"2024-03-28T05:44:17.820910+0000","last_fullsized":"2024-03-28T05:44:17.820910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817703+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:44:17.817703+0000","last_peered":"2024-03-28T05:44:17.817703+0000","last_clean":"2024-03-28T05:44:17.817703+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:44:17.817703+0000","last_undegraded":"2024-03-28T05:44:17.817703+0000","last_fullsized":"2024-03-28T05:44:17.817703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926207+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:43:18.926207+0000","last_peered":"2024-03-28T05:43:18.926207+0000","last_clean":"2024-03-28T05:43:18.926207+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:43:18.926207+0000","last_undegraded":"2024-03-28T05:43:18.926207+0000","last_fullsized":"2024-03-28T05:43:18.926207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.941455+0000","last_change":"2024-03-28T05:43:18.941455+0000","last_active":"2024-03-28T05:43:18.941455+0000","last_peered":"2024-03-28T05:43:18.941455+0000","last_clean":"2024-03-28T05:43:18.941455+0000","last_became_active":"2024-03-28T05:43:18.941092+0000","last_became_peered":"2024-03-28T05:43:18.941092+0000","last_unstale":"2024-03-28T05:43:18.941455+0000","last_undegraded":"2024-03-28T05:43:18.941455+0000","last_fullsized":"2024-03-28T05:43:18.941455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:44:55.741140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840193+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:44:17.840193+0000","last_peered":"2024-03-28T05:44:17.840193+0000","last_clean":"2024-03-28T05:44:17.840193+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:44:17.840193+0000","last_undegraded":"2024-03-28T05:44:17.840193+0000","last_fullsized":"2024-03-28T05:44:17.840193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840910+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:44:17.840910+0000","last_peered":"2024-03-28T05:44:17.840910+0000","last_clean":"2024-03-28T05:44:17.840910+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:44:17.840910+0000","last_undegraded":"2024-03-28T05:44:17.840910+0000","last_fullsized":"2024-03-28T05:44:17.840910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837438+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:44:17.837438+0000","last_peered":"2024-03-28T05:44:17.837438+0000","last_clean":"2024-03-28T05:44:17.837438+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:44:17.837438+0000","last_undegraded":"2024-03-28T05:44:17.837438+0000","last_fullsized":"2024-03-28T05:44:17.837438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828283+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:44:17.828283+0000","last_peered":"2024-03-28T05:44:17.828283+0000","last_clean":"2024-03-28T05:44:17.828283+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:44:17.828283+0000","last_undegraded":"2024-03-28T05:44:17.828283+0000","last_fullsized":"2024-03-28T05:44:17.828283+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933520+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:43:18.933520+0000","last_peered":"2024-03-28T05:43:18.933520+0000","last_clean":"2024-03-28T05:43:18.933520+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:43:18.933520+0000","last_undegraded":"2024-03-28T05:43:18.933520+0000","last_fullsized":"2024-03-28T05:43:18.933520+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.827464+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:44:17.827464+0000","last_peered":"2024-03-28T05:44:17.827464+0000","last_clean":"2024-03-28T05:44:17.827464+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:44:17.827464+0000","last_undegraded":"2024-03-28T05:44:17.827464+0000","last_fullsized":"2024-03-28T05:44:17.827464+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932799+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:43:18.932799+0000","last_peered":"2024-03-28T05:43:18.932799+0000","last_clean":"2024-03-28T05:43:18.932799+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:43:18.932799+0000","last_undegraded":"2024-03-28T05:43:18.932799+0000","last_fullsized":"2024-03-28T05:43:18.932799+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927152+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:43:18.927152+0000","last_peered":"2024-03-28T05:43:18.927152+0000","last_clean":"2024-03-28T05:43:18.927152+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:43:18.927152+0000","last_undegraded":"2024-03-28T05:43:18.927152+0000","last_fullsized":"2024-03-28T05:43:18.927152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926528+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:43:18.926528+0000","last_peered":"2024-03-28T05:43:18.926528+0000","last_clean":"2024-03-28T05:43:18.926528+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:43:18.926528+0000","last_undegraded":"2024-03-28T05:43:18.926528+0000","last_fullsized":"2024-03-28T05:43:18.926528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845473+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:44:17.845473+0000","last_peered":"2024-03-28T05:44:17.845473+0000","last_clean":"2024-03-28T05:44:17.845473+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:44:17.845473+0000","last_undegraded":"2024-03-28T05:44:17.845473+0000","last_fullsized":"2024-03-28T05:44:17.845473+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926797+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:43:18.926797+0000","last_peered":"2024-03-28T05:43:18.926797+0000","last_clean":"2024-03-28T05:43:18.926797+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:43:18.926797+0000","last_undegraded":"2024-03-28T05:43:18.926797+0000","last_fullsized":"2024-03-28T05:43:18.926797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.842087+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:44:17.842087+0000","last_peered":"2024-03-28T05:44:17.842087+0000","last_clean":"2024-03-28T05:44:17.842087+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:44:17.842087+0000","last_undegraded":"2024-03-28T05:44:17.842087+0000","last_fullsized":"2024-03-28T05:44:17.842087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'7","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:18.102987+0000","last_change":"2024-03-28T05:43:18.959998+0000","last_active":"2024-03-28T05:44:18.102987+0000","last_peered":"2024-03-28T05:44:18.102987+0000","last_clean":"2024-03-28T05:44:18.102987+0000","last_became_active":"2024-03-28T05:43:18.945599+0000","last_became_peered":"2024-03-28T05:43:18.945599+0000","last_unstale":"2024-03-28T05:44:18.102987+0000","last_undegraded":"2024-03-28T05:44:18.102987+0000","last_fullsized":"2024-03-28T05:44:18.102987+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:02:08.702587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819251+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:44:17.819251+0000","last_peered":"2024-03-28T05:44:17.819251+0000","last_clean":"2024-03-28T05:44:17.819251+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:44:17.819251+0000","last_undegraded":"2024-03-28T05:44:17.819251+0000","last_fullsized":"2024-03-28T05:44:17.819251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968521+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:43:18.968521+0000","last_peered":"2024-03-28T05:43:18.968521+0000","last_clean":"2024-03-28T05:43:18.968521+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:43:18.968521+0000","last_undegraded":"2024-03-28T05:43:18.968521+0000","last_fullsized":"2024-03-28T05:43:18.968521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821575+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:44:17.821575+0000","last_peered":"2024-03-28T05:44:17.821575+0000","last_clean":"2024-03-28T05:44:17.821575+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:44:17.821575+0000","last_undegraded":"2024-03-28T05:44:17.821575+0000","last_fullsized":"2024-03-28T05:44:17.821575+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932322+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:43:18.932322+0000","last_peered":"2024-03-28T05:43:18.932322+0000","last_clean":"2024-03-28T05:43:18.932322+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:43:18.932322+0000","last_undegraded":"2024-03-28T05:43:18.932322+0000","last_fullsized":"2024-03-28T05:43:18.932322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817304+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:44:17.817304+0000","last_peered":"2024-03-28T05:44:17.817304+0000","last_clean":"2024-03-28T05:44:17.817304+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:44:17.817304+0000","last_undegraded":"2024-03-28T05:44:17.817304+0000","last_fullsized":"2024-03-28T05:44:17.817304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942255+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:43:18.942255+0000","last_peered":"2024-03-28T05:43:18.942255+0000","last_clean":"2024-03-28T05:43:18.942255+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:43:18.942255+0000","last_undegraded":"2024-03-28T05:43:18.942255+0000","last_fullsized":"2024-03-28T05:43:18.942255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824389+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:44:17.824389+0000","last_peered":"2024-03-28T05:44:17.824389+0000","last_clean":"2024-03-28T05:44:17.824389+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:44:17.824389+0000","last_undegraded":"2024-03-28T05:44:17.824389+0000","last_fullsized":"2024-03-28T05:44:17.824389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:16.096794+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:44:16.096794+0000","last_peered":"2024-03-28T05:44:16.096794+0000","last_clean":"2024-03-28T05:44:16.096794+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:44:16.096794+0000","last_undegraded":"2024-03-28T05:44:16.096794+0000","last_fullsized":"2024-03-28T05:44:16.096794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.843595+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:44:17.843595+0000","last_peered":"2024-03-28T05:44:17.843595+0000","last_clean":"2024-03-28T05:44:17.843595+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:44:17.843595+0000","last_undegraded":"2024-03-28T05:44:17.843595+0000","last_fullsized":"2024-03-28T05:44:17.843595+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937927+0000","last_change":"2024-03-28T05:43:18.937927+0000","last_active":"2024-03-28T05:43:18.937927+0000","last_peered":"2024-03-28T05:43:18.937927+0000","last_clean":"2024-03-28T05:43:18.937927+0000","last_became_active":"2024-03-28T05:43:18.931224+0000","last_became_peered":"2024-03-28T05:43:18.931224+0000","last_unstale":"2024-03-28T05:43:18.937927+0000","last_undegraded":"2024-03-28T05:43:18.937927+0000","last_fullsized":"2024-03-28T05:43:18.937927+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:57:28.359905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927272+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:43:18.927272+0000","last_peered":"2024-03-28T05:43:18.927272+0000","last_clean":"2024-03-28T05:43:18.927272+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:43:18.927272+0000","last_undegraded":"2024-03-28T05:43:18.927272+0000","last_fullsized":"2024-03-28T05:43:18.927272+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948713+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:43:18.948713+0000","last_peered":"2024-03-28T05:43:18.948713+0000","last_clean":"2024-03-28T05:43:18.948713+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:43:18.948713+0000","last_undegraded":"2024-03-28T05:43:18.948713+0000","last_fullsized":"2024-03-28T05:43:18.948713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.844821+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:44:17.844821+0000","last_peered":"2024-03-28T05:44:17.844821+0000","last_clean":"2024-03-28T05:44:17.844821+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:44:17.844821+0000","last_undegraded":"2024-03-28T05:44:17.844821+0000","last_fullsized":"2024-03-28T05:44:17.844821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'29","reported_seq":217,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.084798+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:44:17.084798+0000","last_peered":"2024-03-28T05:44:17.084798+0000","last_clean":"2024-03-28T05:44:17.084798+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:44:17.084798+0000","last_undegraded":"2024-03-28T05:44:17.084798+0000","last_fullsized":"2024-03-28T05:44:17.084798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65252,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":147,"num_write":30,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824832+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:44:17.824832+0000","last_peered":"2024-03-28T05:44:17.824832+0000","last_clean":"2024-03-28T05:44:17.824832+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:44:17.824832+0000","last_undegraded":"2024-03-28T05:44:17.824832+0000","last_fullsized":"2024-03-28T05:44:17.824832+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936573+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:43:18.936573+0000","last_peered":"2024-03-28T05:43:18.936573+0000","last_clean":"2024-03-28T05:43:18.936573+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:43:18.936573+0000","last_undegraded":"2024-03-28T05:43:18.936573+0000","last_fullsized":"2024-03-28T05:43:18.936573+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.820749+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:44:17.820749+0000","last_peered":"2024-03-28T05:44:17.820749+0000","last_clean":"2024-03-28T05:44:17.820749+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:44:17.820749+0000","last_undegraded":"2024-03-28T05:44:17.820749+0000","last_fullsized":"2024-03-28T05:44:17.820749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.945955+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:43:18.945955+0000","last_peered":"2024-03-28T05:43:18.945955+0000","last_clean":"2024-03-28T05:43:18.945955+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:43:18.945955+0000","last_undegraded":"2024-03-28T05:43:18.945955+0000","last_fullsized":"2024-03-28T05:43:18.945955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835100+0000","last_change":"2024-03-28T05:43:18.935508+0000","last_active":"2024-03-28T05:44:17.835100+0000","last_peered":"2024-03-28T05:44:17.835100+0000","last_clean":"2024-03-28T05:44:17.835100+0000","last_became_active":"2024-03-28T05:43:18.934708+0000","last_became_peered":"2024-03-28T05:43:18.934708+0000","last_unstale":"2024-03-28T05:44:17.835100+0000","last_undegraded":"2024-03-28T05:44:17.835100+0000","last_fullsized":"2024-03-28T05:44:17.835100+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:09:07.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'5","reported_seq":111,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:19.027042+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:44:19.027042+0000","last_peered":"2024-03-28T05:44:19.027042+0000","last_clean":"2024-03-28T05:44:19.027042+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:44:19.027042+0000","last_undegraded":"2024-03-28T05:44:19.027042+0000","last_fullsized":"2024-03-28T05:44:19.027042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814074+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:44:17.814074+0000","last_peered":"2024-03-28T05:44:17.814074+0000","last_clean":"2024-03-28T05:44:17.814074+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:44:17.814074+0000","last_undegraded":"2024-03-28T05:44:17.814074+0000","last_fullsized":"2024-03-28T05:44:17.814074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925514+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:43:18.925514+0000","last_peered":"2024-03-28T05:43:18.925514+0000","last_clean":"2024-03-28T05:43:18.925514+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:43:18.925514+0000","last_undegraded":"2024-03-28T05:43:18.925514+0000","last_fullsized":"2024-03-28T05:43:18.925514+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841371+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:44:17.841371+0000","last_peered":"2024-03-28T05:44:17.841371+0000","last_clean":"2024-03-28T05:44:17.841371+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:44:17.841371+0000","last_undegraded":"2024-03-28T05:44:17.841371+0000","last_fullsized":"2024-03-28T05:44:17.841371+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957174+0000","last_change":"2024-03-28T05:43:18.956299+0000","last_active":"2024-03-28T05:43:18.957174+0000","last_peered":"2024-03-28T05:43:18.957174+0000","last_clean":"2024-03-28T05:43:18.957174+0000","last_became_active":"2024-03-28T05:43:18.947840+0000","last_became_peered":"2024-03-28T05:43:18.947840+0000","last_unstale":"2024-03-28T05:43:18.957174+0000","last_undegraded":"2024-03-28T05:43:18.957174+0000","last_fullsized":"2024-03-28T05:43:18.957174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:51.876409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818438+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:44:17.818438+0000","last_peered":"2024-03-28T05:44:17.818438+0000","last_clean":"2024-03-28T05:44:17.818438+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:44:17.818438+0000","last_undegraded":"2024-03-28T05:44:17.818438+0000","last_fullsized":"2024-03-28T05:44:17.818438+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931688+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:43:18.931688+0000","last_peered":"2024-03-28T05:43:18.931688+0000","last_clean":"2024-03-28T05:43:18.931688+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:43:18.931688+0000","last_undegraded":"2024-03-28T05:43:18.931688+0000","last_fullsized":"2024-03-28T05:43:18.931688+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'1","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968807+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:43:18.968807+0000","last_peered":"2024-03-28T05:43:18.968807+0000","last_clean":"2024-03-28T05:43:18.968807+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:43:18.968807+0000","last_undegraded":"2024-03-28T05:43:18.968807+0000","last_fullsized":"2024-03-28T05:43:18.968807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926601+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:43:18.926601+0000","last_peered":"2024-03-28T05:43:18.926601+0000","last_clean":"2024-03-28T05:43:18.926601+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:43:18.926601+0000","last_undegraded":"2024-03-28T05:43:18.926601+0000","last_fullsized":"2024-03-28T05:43:18.926601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968752+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:43:18.968752+0000","last_peered":"2024-03-28T05:43:18.968752+0000","last_clean":"2024-03-28T05:43:18.968752+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:43:18.968752+0000","last_undegraded":"2024-03-28T05:43:18.968752+0000","last_fullsized":"2024-03-28T05:43:18.968752+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821039+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:44:17.821039+0000","last_peered":"2024-03-28T05:44:17.821039+0000","last_clean":"2024-03-28T05:44:17.821039+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:44:17.821039+0000","last_undegraded":"2024-03-28T05:44:17.821039+0000","last_fullsized":"2024-03-28T05:44:17.821039+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'5","reported_seq":107,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:19.025798+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:44:19.025798+0000","last_peered":"2024-03-28T05:44:19.025798+0000","last_clean":"2024-03-28T05:44:19.025798+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:44:19.025798+0000","last_undegraded":"2024-03-28T05:44:19.025798+0000","last_fullsized":"2024-03-28T05:44:19.025798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835189+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:44:17.835189+0000","last_peered":"2024-03-28T05:44:17.835189+0000","last_clean":"2024-03-28T05:44:17.835189+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:44:17.835189+0000","last_undegraded":"2024-03-28T05:44:17.835189+0000","last_fullsized":"2024-03-28T05:44:17.835189+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923880+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:43:18.923880+0000","last_peered":"2024-03-28T05:43:18.923880+0000","last_clean":"2024-03-28T05:43:18.923880+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:43:18.923880+0000","last_undegraded":"2024-03-28T05:43:18.923880+0000","last_fullsized":"2024-03-28T05:43:18.923880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927223+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:43:18.927223+0000","last_peered":"2024-03-28T05:43:18.927223+0000","last_clean":"2024-03-28T05:43:18.927223+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:43:18.927223+0000","last_undegraded":"2024-03-28T05:43:18.927223+0000","last_fullsized":"2024-03-28T05:43:18.927223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823111+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:44:17.823111+0000","last_peered":"2024-03-28T05:44:17.823111+0000","last_clean":"2024-03-28T05:44:17.823111+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:44:17.823111+0000","last_undegraded":"2024-03-28T05:44:17.823111+0000","last_fullsized":"2024-03-28T05:44:17.823111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926590+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:43:18.926590+0000","last_peered":"2024-03-28T05:43:18.926590+0000","last_clean":"2024-03-28T05:43:18.926590+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:43:18.926590+0000","last_undegraded":"2024-03-28T05:43:18.926590+0000","last_fullsized":"2024-03-28T05:43:18.926590+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.951170+0000","last_change":"2024-03-28T05:43:18.950408+0000","last_active":"2024-03-28T05:43:18.951170+0000","last_peered":"2024-03-28T05:43:18.951170+0000","last_clean":"2024-03-28T05:43:18.951170+0000","last_became_active":"2024-03-28T05:43:18.936590+0000","last_became_peered":"2024-03-28T05:43:18.936590+0000","last_unstale":"2024-03-28T05:43:18.951170+0000","last_undegraded":"2024-03-28T05:43:18.951170+0000","last_fullsized":"2024-03-28T05:43:18.951170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:39:27.277236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819695+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:44:17.819695+0000","last_peered":"2024-03-28T05:44:17.819695+0000","last_clean":"2024-03-28T05:44:17.819695+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:44:17.819695+0000","last_undegraded":"2024-03-28T05:44:17.819695+0000","last_fullsized":"2024-03-28T05:44:17.819695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'9","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931823+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:43:18.931823+0000","last_peered":"2024-03-28T05:43:18.931823+0000","last_clean":"2024-03-28T05:43:18.931823+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:43:18.931823+0000","last_undegraded":"2024-03-28T05:43:18.931823+0000","last_fullsized":"2024-03-28T05:43:18.931823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817566+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:44:17.817566+0000","last_peered":"2024-03-28T05:44:17.817566+0000","last_clean":"2024-03-28T05:44:17.817566+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:44:17.817566+0000","last_undegraded":"2024-03-28T05:44:17.817566+0000","last_fullsized":"2024-03-28T05:44:17.817566+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923579+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:43:18.923579+0000","last_peered":"2024-03-28T05:43:18.923579+0000","last_clean":"2024-03-28T05:43:18.923579+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:43:18.923579+0000","last_undegraded":"2024-03-28T05:43:18.923579+0000","last_fullsized":"2024-03-28T05:43:18.923579+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927058+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:43:18.927058+0000","last_peered":"2024-03-28T05:43:18.927058+0000","last_clean":"2024-03-28T05:43:18.927058+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:43:18.927058+0000","last_undegraded":"2024-03-28T05:43:18.927058+0000","last_fullsized":"2024-03-28T05:43:18.927058+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929739+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:43:18.929739+0000","last_peered":"2024-03-28T05:43:18.929739+0000","last_clean":"2024-03-28T05:43:18.929739+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:43:18.929739+0000","last_undegraded":"2024-03-28T05:43:18.929739+0000","last_fullsized":"2024-03-28T05:43:18.929739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.790514+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:44:17.790514+0000","last_peered":"2024-03-28T05:44:17.790514+0000","last_clean":"2024-03-28T05:44:17.790514+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:44:17.790514+0000","last_undegraded":"2024-03-28T05:44:17.790514+0000","last_fullsized":"2024-03-28T05:44:17.790514+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930335+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:43:18.930335+0000","last_peered":"2024-03-28T05:43:18.930335+0000","last_clean":"2024-03-28T05:43:18.930335+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:43:18.930335+0000","last_undegraded":"2024-03-28T05:43:18.930335+0000","last_fullsized":"2024-03-28T05:43:18.930335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830542+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:44:17.830542+0000","last_peered":"2024-03-28T05:44:17.830542+0000","last_clean":"2024-03-28T05:44:17.830542+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:44:17.830542+0000","last_undegraded":"2024-03-28T05:44:17.830542+0000","last_fullsized":"2024-03-28T05:44:17.830542+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.934937+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:43:18.934937+0000","last_peered":"2024-03-28T05:43:18.934937+0000","last_clean":"2024-03-28T05:43:18.934937+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:43:18.934937+0000","last_undegraded":"2024-03-28T05:43:18.934937+0000","last_fullsized":"2024-03-28T05:43:18.934937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.829450+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:44:17.829450+0000","last_peered":"2024-03-28T05:44:17.829450+0000","last_clean":"2024-03-28T05:44:17.829450+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:44:17.829450+0000","last_undegraded":"2024-03-28T05:44:17.829450+0000","last_fullsized":"2024-03-28T05:44:17.829450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925733+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:43:18.925733+0000","last_peered":"2024-03-28T05:43:18.925733+0000","last_clean":"2024-03-28T05:43:18.925733+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:43:18.925733+0000","last_undegraded":"2024-03-28T05:43:18.925733+0000","last_fullsized":"2024-03-28T05:43:18.925733+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835888+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:44:17.835888+0000","last_peered":"2024-03-28T05:44:17.835888+0000","last_clean":"2024-03-28T05:44:17.835888+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:44:17.835888+0000","last_undegraded":"2024-03-28T05:44:17.835888+0000","last_fullsized":"2024-03-28T05:44:17.835888+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937313+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:43:18.937313+0000","last_peered":"2024-03-28T05:43:18.937313+0000","last_clean":"2024-03-28T05:43:18.937313+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:43:18.937313+0000","last_undegraded":"2024-03-28T05:43:18.937313+0000","last_fullsized":"2024-03-28T05:43:18.937313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841878+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:44:17.841878+0000","last_peered":"2024-03-28T05:44:17.841878+0000","last_clean":"2024-03-28T05:44:17.841878+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:44:17.841878+0000","last_undegraded":"2024-03-28T05:44:17.841878+0000","last_fullsized":"2024-03-28T05:44:17.841878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948343+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:43:18.948343+0000","last_peered":"2024-03-28T05:43:18.948343+0000","last_clean":"2024-03-28T05:43:18.948343+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:43:18.948343+0000","last_undegraded":"2024-03-28T05:43:18.948343+0000","last_fullsized":"2024-03-28T05:43:18.948343+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825093+0000","last_change":"2024-03-28T05:43:18.957536+0000","last_active":"2024-03-28T05:44:17.825093+0000","last_peered":"2024-03-28T05:44:17.825093+0000","last_clean":"2024-03-28T05:44:17.825093+0000","last_became_active":"2024-03-28T05:43:18.945541+0000","last_became_peered":"2024-03-28T05:43:18.945541+0000","last_unstale":"2024-03-28T05:44:17.825093+0000","last_undegraded":"2024-03-28T05:44:17.825093+0000","last_fullsized":"2024-03-28T05:44:17.825093+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:35:23.625743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933054+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:43:18.933054+0000","last_peered":"2024-03-28T05:43:18.933054+0000","last_clean":"2024-03-28T05:43:18.933054+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:43:18.933054+0000","last_undegraded":"2024-03-28T05:43:18.933054+0000","last_fullsized":"2024-03-28T05:43:18.933054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828683+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:44:17.828683+0000","last_peered":"2024-03-28T05:44:17.828683+0000","last_clean":"2024-03-28T05:44:17.828683+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:44:17.828683+0000","last_undegraded":"2024-03-28T05:44:17.828683+0000","last_fullsized":"2024-03-28T05:44:17.828683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823531+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:44:17.823531+0000","last_peered":"2024-03-28T05:44:17.823531+0000","last_clean":"2024-03-28T05:44:17.823531+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:44:17.823531+0000","last_undegraded":"2024-03-28T05:44:17.823531+0000","last_fullsized":"2024-03-28T05:44:17.823531+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825299+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:44:17.825299+0000","last_peered":"2024-03-28T05:44:17.825299+0000","last_clean":"2024-03-28T05:44:17.825299+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:44:17.825299+0000","last_undegraded":"2024-03-28T05:44:17.825299+0000","last_fullsized":"2024-03-28T05:44:17.825299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825560+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:44:17.825560+0000","last_peered":"2024-03-28T05:44:17.825560+0000","last_clean":"2024-03-28T05:44:17.825560+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:44:17.825560+0000","last_undegraded":"2024-03-28T05:44:17.825560+0000","last_fullsized":"2024-03-28T05:44:17.825560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926394+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:43:18.926394+0000","last_peered":"2024-03-28T05:43:18.926394+0000","last_clean":"2024-03-28T05:43:18.926394+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:43:18.926394+0000","last_undegraded":"2024-03-28T05:43:18.926394+0000","last_fullsized":"2024-03-28T05:43:18.926394+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825925+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:44:17.825925+0000","last_peered":"2024-03-28T05:44:17.825925+0000","last_clean":"2024-03-28T05:44:17.825925+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:44:17.825925+0000","last_undegraded":"2024-03-28T05:44:17.825925+0000","last_fullsized":"2024-03-28T05:44:17.825925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813821+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:44:17.813821+0000","last_peered":"2024-03-28T05:44:17.813821+0000","last_clean":"2024-03-28T05:44:17.813821+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:44:17.813821+0000","last_undegraded":"2024-03-28T05:44:17.813821+0000","last_fullsized":"2024-03-28T05:44:17.813821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.838252+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:44:17.838252+0000","last_peered":"2024-03-28T05:44:17.838252+0000","last_clean":"2024-03-28T05:44:17.838252+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:44:17.838252+0000","last_undegraded":"2024-03-28T05:44:17.838252+0000","last_fullsized":"2024-03-28T05:44:17.838252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821968+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:44:17.821968+0000","last_peered":"2024-03-28T05:44:17.821968+0000","last_clean":"2024-03-28T05:44:17.821968+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:44:17.821968+0000","last_undegraded":"2024-03-28T05:44:17.821968+0000","last_fullsized":"2024-03-28T05:44:17.821968+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.812261+0000","last_change":"2024-03-28T05:43:18.939398+0000","last_active":"2024-03-28T05:44:17.812261+0000","last_peered":"2024-03-28T05:44:17.812261+0000","last_clean":"2024-03-28T05:44:17.812261+0000","last_became_active":"2024-03-28T05:43:18.936942+0000","last_became_peered":"2024-03-28T05:43:18.936942+0000","last_unstale":"2024-03-28T05:44:17.812261+0000","last_undegraded":"2024-03-28T05:44:17.812261+0000","last_fullsized":"2024-03-28T05:44:17.812261+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:02:50.892203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822692+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:44:17.822692+0000","last_peered":"2024-03-28T05:44:17.822692+0000","last_clean":"2024-03-28T05:44:17.822692+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:44:17.822692+0000","last_undegraded":"2024-03-28T05:44:17.822692+0000","last_fullsized":"2024-03-28T05:44:17.822692+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.838477+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:44:17.838477+0000","last_peered":"2024-03-28T05:44:17.838477+0000","last_clean":"2024-03-28T05:44:17.838477+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:44:17.838477+0000","last_undegraded":"2024-03-28T05:44:17.838477+0000","last_fullsized":"2024-03-28T05:44:17.838477+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831807+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:44:17.831807+0000","last_peered":"2024-03-28T05:44:17.831807+0000","last_clean":"2024-03-28T05:44:17.831807+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:44:17.831807+0000","last_undegraded":"2024-03-28T05:44:17.831807+0000","last_fullsized":"2024-03-28T05:44:17.831807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818533+0000","last_change":"2024-03-28T05:43:18.944603+0000","last_active":"2024-03-28T05:44:17.818533+0000","last_peered":"2024-03-28T05:44:17.818533+0000","last_clean":"2024-03-28T05:44:17.818533+0000","last_became_active":"2024-03-28T05:43:18.943787+0000","last_became_peered":"2024-03-28T05:43:18.943787+0000","last_unstale":"2024-03-28T05:44:17.818533+0000","last_undegraded":"2024-03-28T05:44:17.818533+0000","last_fullsized":"2024-03-28T05:44:17.818533+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:13.905446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":415,"ondisk_log_size":415,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69926,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":513,"num_read_kb":330,"num_write":163,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1057,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":210135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220194,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":481676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481832,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1708032,"data_stored":1138756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678064,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":481985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939703,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":481744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234046,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1617920,"data_stored":1074391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430276,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":546551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":482528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":547279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":481451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888146,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":483380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1630208,"data_stored":1073543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:44:22.866 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-28T05:44:22.866 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-28T05:44:22.866 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-28T05:44:22.866 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph health --format=json 2024-03-28T05:44:23.368 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:23.699 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:23 smithi055 ceph-mon[31863]: pgmap v414: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-28T05:44:23.699 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:23 smithi055 ceph-mon[31863]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:23 smithi086 ceph-mon[35163]: pgmap v414: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-28T05:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:23 smithi086 ceph-mon[35163]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:23 smithi159 ceph-mon[36109]: pgmap v414: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-28T05:44:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:23 smithi159 ceph-mon[36109]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:44:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 -- 172.21.15.55:0/3566797954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 msgr2=0x7fdea0111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 --2- 172.21.15.55:0/3566797954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea0111190 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde980099c0 tx=0x7fde98009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 -- 172.21.15.55:0/3566797954 shutdown_connections 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 --2- 172.21.15.55:0/3566797954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea0111190 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 --2- 172.21.15.55:0/3566797954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea01044e0 0x7fdea01048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 --2- 172.21.15.55:0/3566797954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea0104e90 0x7fdea0108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 -- 172.21.15.55:0/3566797954 >> 172.21.15.55:0/3566797954 conn(0x7fdea00ffdb0 msgr2=0x7fdea01021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 -- 172.21.15.55:0/3566797954 shutdown_connections 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.544+0000 7fde9fe00700 1 -- 172.21.15.55:0/3566797954 wait complete. 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.545+0000 7fde9fe00700 1 Processor -- start 2024-03-28T05:44:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.545+0000 7fde9fe00700 1 -- start start 2024-03-28T05:44:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea01044e0 0x7fdea01a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea0104e90 0x7fdea01a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea01144b0 con 0x7fdea01095c0 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0114330 con 0x7fdea01044e0 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9fe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0114630 con 0x7fdea0104e90 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37834/0 (socket says 172.21.15.55:37834) 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 -- 172.21.15.55:0/412129446 learned_addr learned my addr 172.21.15.55:0/412129446 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9ea00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea01044e0 0x7fdea01a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde96000700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea0104e90 0x7fdea01a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 -- 172.21.15.55:0/412129446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea0104e90 msgr2=0x7fdea01a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea0104e90 0x7fdea01a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 -- 172.21.15.55:0/412129446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea01044e0 msgr2=0x7fdea01a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea01044e0 0x7fdea01a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.546+0000 7fde9f400700 1 -- 172.21.15.55:0/412129446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea019aff0 con 0x7fdea01095c0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde9f400700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde98005b40 tx=0x7fde980055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98026070 con 0x7fdea01095c0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fde9800f460 con 0x7fdea01095c0 2024-03-28T05:44:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea019b280 con 0x7fdea01095c0 2024-03-28T05:44:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98009e60 con 0x7fdea01095c0 2024-03-28T05:44:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.547+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea01a75c0 con 0x7fdea01095c0 2024-03-28T05:44:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.549+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea019b5e0 con 0x7fdea01095c0 2024-03-28T05:44:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.552+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fde98029070 con 0x7fdea01095c0 2024-03-28T05:44:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.553+0000 7fde97e00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 0x7fde840a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.554+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fde980cf690 con 0x7fdea01095c0 2024-03-28T05:44:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.554+0000 7fde9ea00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 0x7fde840a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.555+0000 7fde9ea00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 0x7fde840a4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde90005950 tx=0x7fde9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.556+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fde98030020 con 0x7fdea01095c0 2024-03-28T05:44:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:25 smithi086 ceph-mon[35163]: pgmap v415: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:25 smithi055 ceph-mon[31863]: pgmap v415: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:25 smithi159 ceph-mon[36109]: pgmap v415: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.836+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdea0068e80 con 0x7fdea01095c0 2024-03-28T05:44:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.836+0000 7fde97e00700 1 -- 172.21.15.55:0/412129446 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdea0068e80 con 0x7fdea01095c0 2024-03-28T05:44:25.838 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:25.838 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 msgr2=0x7fde840a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 0x7fde840a4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fde90005950 tx=0x7fde9000b410 comp rx=0 tx=0).stop 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 msgr2=0x7fdea019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde98005b40 tx=0x7fde980055f0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 shutdown_connections 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fde840a2910 0x7fde840a4dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea01095c0 0x7fdea019a710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdea01044e0 0x7fdea01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 --2- 172.21.15.55:0/412129446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdea0104e90 0x7fdea01a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 >> 172.21.15.55:0/412129446 conn(0x7fdea00ffdb0 msgr2=0x7fdea01008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 shutdown_connections 2024-03-28T05:44:25.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:25.839+0000 7fde9fe00700 1 -- 172.21.15.55:0/412129446 wait complete. 2024-03-28T05:44:26.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:26 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/412129446' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-28T05:44:26.689 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-28T05:44:26.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:44:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:26 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/412129446' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-28T05:44:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:26 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/412129446' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 -- 172.21.15.55:0/2272210720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 msgr2=0x7fb67410bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 --2- 172.21.15.55:0/2272210720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb67410bb30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009ca0 tx=0x7fb66c02c0f0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 -- 172.21.15.55:0/2272210720 shutdown_connections 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 --2- 172.21.15.55:0/2272210720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb67410bb30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 --2- 172.21.15.55:0/2272210720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741048e0 0x7fb674104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 --2- 172.21.15.55:0/2272210720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741036f0 0x7fb674103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.921+0000 7fb679e00640 1 -- 172.21.15.55:0/2272210720 >> 172.21.15.55:0/2272210720 conn(0x7fb6740fec80 msgr2=0x7fb6741010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:26.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.922+0000 7fb679e00640 1 -- 172.21.15.55:0/2272210720 shutdown_connections 2024-03-28T05:44:26.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.922+0000 7fb679e00640 1 -- 172.21.15.55:0/2272210720 wait complete. 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 Processor -- start 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 -- start start 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741036f0 0x7fb674199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 0x7fb674199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67410f200 con 0x7fb6741052a0 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67410f080 con 0x7fb6741048e0 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67410f380 con 0x7fb6741036f0 2024-03-28T05:44:26.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37840/0 (socket says 172.21.15.55:37840) 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.923+0000 7fb679400640 1 -- 172.21.15.55:0/1341222102 learned_addr learned my addr 172.21.15.55:0/1341222102 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb678a00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741036f0 0x7fb674199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb66be00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 0x7fb674199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 -- 172.21.15.55:0/1341222102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741036f0 msgr2=0x7fb674199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741036f0 0x7fb674199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 -- 172.21.15.55:0/1341222102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 msgr2=0x7fb674199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 0x7fb674199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 -- 172.21.15.55:0/1341222102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6741a14d0 con 0x7fb6741052a0 2024-03-28T05:44:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb66be00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 0x7fb674199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb679400640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb66c032380 tx=0x7fb66c032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c041020 con 0x7fb6741052a0 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb66c003e20 con 0x7fb6741052a0 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.924+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c039040 con 0x7fb6741052a0 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.925+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6741a1760 con 0x7fb6741052a0 2024-03-28T05:44:26.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.925+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6741a1ca0 con 0x7fb6741052a0 2024-03-28T05:44:26.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.926+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67410aa30 con 0x7fb6741052a0 2024-03-28T05:44:26.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.928+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb66c044020 con 0x7fb6741052a0 2024-03-28T05:44:26.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.929+0000 7fb672000640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 0x7fb6580a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:26.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.929+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb66c0f0d40 con 0x7fb6741052a0 2024-03-28T05:44:26.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.929+0000 7fb678a00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 0x7fb6580a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:26.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.930+0000 7fb678a00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 0x7fb6580a4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb664005d00 tx=0x7fb664005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:26.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:26.933+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb66c04b020 con 0x7fb6741052a0 2024-03-28T05:44:27.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.140+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6740622a0 con 0x7fb6741052a0 2024-03-28T05:44:27.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.142+0000 7fb672000640 1 -- 172.21.15.55:0/1341222102 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7fb66c03b2f0 con 0x7fb6741052a0 2024-03-28T05:44:27.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:27.144 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.145+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 msgr2=0x7fb6580a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.145+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 0x7fb6580a4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb664005d00 tx=0x7fb664005c50 comp rx=0 tx=0).stop 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.145+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 msgr2=0x7fb6741a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.145+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb66c032380 tx=0x7fb66c032820 comp rx=0 tx=0).stop 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 shutdown_connections 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6580a2880 0x7fb6580a4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6741052a0 0x7fb6741a0e60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6741048e0 0x7fb674199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 --2- 172.21.15.55:0/1341222102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6741036f0 0x7fb674199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 >> 172.21.15.55:0/1341222102 conn(0x7fb6740fec80 msgr2=0x7fb674107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 shutdown_connections 2024-03-28T05:44:27.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.146+0000 7fb679e00640 1 -- 172.21.15.55:0/1341222102 wait complete. 2024-03-28T05:44:27.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:44:27.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 -- 172.21.15.55:0/2449912570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504107bc0 msgr2=0x7f2504107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 --2- 172.21.15.55:0/2449912570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504107bc0 0x7f2504107fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f802bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 -- 172.21.15.55:0/2449912570 shutdown_connections 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 --2- 172.21.15.55:0/2449912570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504109770 0x7f2504110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 --2- 172.21.15.55:0/2449912570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504108db0 0x7f2504109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 --2- 172.21.15.55:0/2449912570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504107bc0 0x7f2504107fe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.395+0000 7f250b000640 1 -- 172.21.15.55:0/2449912570 >> 172.21.15.55:0/2449912570 conn(0x7f2504076b70 msgr2=0x7f2504078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:27.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.396+0000 7f250b000640 1 -- 172.21.15.55:0/2449912570 shutdown_connections 2024-03-28T05:44:27.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.396+0000 7f250b000640 1 -- 172.21.15.55:0/2449912570 wait complete. 2024-03-28T05:44:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.397+0000 7f250b000640 1 Processor -- start 2024-03-28T05:44:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.397+0000 7f250b000640 1 -- start start 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.397+0000 7f250b000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504107bc0 0x7f250419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.397+0000 7f250b000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504108db0 0x7f250419e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250b000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250b000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504113790 con 0x7f2504109770 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250b000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504113610 con 0x7f2504107bc0 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250b000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504113910 con 0x7f2504108db0 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37854/0 (socket says 172.21.15.55:37854) 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 -- 172.21.15.55:0/1010245170 learned_addr learned my addr 172.21.15.55:0/1010245170 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:27.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f2509c00640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504107bc0 0x7f250419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f2509200640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504108db0 0x7f250419e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 -- 172.21.15.55:0/1010245170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504108db0 msgr2=0x7f250419e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504108db0 0x7f250419e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 -- 172.21.15.55:0/1010245170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504107bc0 msgr2=0x7f250419de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504107bc0 0x7f250419de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.398+0000 7f250a600640 1 -- 172.21.15.55:0/1010245170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25041a5a20 con 0x7f2504109770 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f250a600640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00b970 tx=0x7f24fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc019070 con 0x7f2504109770 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25041a5d10 con 0x7f2504109770 2024-03-28T05:44:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f24fc014440 con 0x7f2504109770 2024-03-28T05:44:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0075d0 con 0x7f2504109770 2024-03-28T05:44:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.399+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25041a6280 con 0x7f2504109770 2024-03-28T05:44:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.400+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250410eee0 con 0x7f2504109770 2024-03-28T05:44:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.403+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f24fc01c070 con 0x7f2504109770 2024-03-28T05:44:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.404+0000 7f2502000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 0x7f24ec0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.404+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24fc0ce510 con 0x7f2504109770 2024-03-28T05:44:27.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.404+0000 7f2509c00640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 0x7f24ec0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.405+0000 7f2509c00640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 0x7f24ec0a4cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24f802c240 tx=0x7f24f8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.408+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f24fc09b5b0 con 0x7f2504109770 2024-03-28T05:44:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.616+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f250402d070 con 0x7f2504109770 2024-03-28T05:44:27.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.616+0000 7f2502000640 1 -- 172.21.15.55:0/1010245170 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24fc09aeb0 con 0x7f2504109770 2024-03-28T05:44:27.617 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:44:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 msgr2=0x7f24ec0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 0x7f24ec0a4cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24f802c240 tx=0x7f24f8000bc0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 msgr2=0x7f25041a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00b970 tx=0x7f24fc00be30 comp rx=0 tx=0).stop 2024-03-28T05:44:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 shutdown_connections 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f24ec0a2800 0x7f24ec0a4cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2504109770 0x7f25041a53b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2504108db0 0x7f250419e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 --2- 172.21.15.55:0/1010245170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2504107bc0 0x7f250419de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 >> 172.21.15.55:0/1010245170 conn(0x7f2504076b70 msgr2=0x7f250410c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 shutdown_connections 2024-03-28T05:44:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.619+0000 7f250b000640 1 -- 172.21.15.55:0/1010245170 wait complete. 2024-03-28T05:44:27.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:44:27.724 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:27 smithi055 ceph-mon[31863]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:27.724 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:27 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1341222102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:27 smithi086 ceph-mon[35163]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:27 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1341222102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:27 smithi159 ceph-mon[36109]: pgmap v416: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:27 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1341222102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 -- 172.21.15.55:0/1157105172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c1037a0 msgr2=0x7fb62c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 --2- 172.21.15.55:0/1157105172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c1037a0 0x7fb62c103bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009900 tx=0x7fb61c02bc40 comp rx=0 tx=0).stop 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 -- 172.21.15.55:0/1157105172 shutdown_connections 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 --2- 172.21.15.55:0/1157105172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c10bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 --2- 172.21.15.55:0/1157105172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c104990 0x7fb62c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 --2- 172.21.15.55:0/1157105172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c1037a0 0x7fb62c103bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 -- 172.21.15.55:0/1157105172 >> 172.21.15.55:0/1157105172 conn(0x7fb62c0fed10 msgr2=0x7fb62c101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:27.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 -- 172.21.15.55:0/1157105172 shutdown_connections 2024-03-28T05:44:27.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.870+0000 7fb631c00640 1 -- 172.21.15.55:0/1157105172 wait complete. 2024-03-28T05:44:27.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.871+0000 7fb631c00640 1 Processor -- start 2024-03-28T05:44:27.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.871+0000 7fb631c00640 1 -- start start 2024-03-28T05:44:27.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.871+0000 7fb631c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c1037a0 0x7fb62c199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.871+0000 7fb631c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 0x7fb62c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.871+0000 7fb631c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c10f370 con 0x7fb62c104990 2024-03-28T05:44:27.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c10f1f0 con 0x7fb62c105350 2024-03-28T05:44:27.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c10f4f0 con 0x7fb62c1037a0 2024-03-28T05:44:27.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb623e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 0x7fb62c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:54648/0 (socket says 172.21.15.55:54648) 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb631200640 1 -- 172.21.15.55:0/1030212657 learned_addr learned my addr 172.21.15.55:0/1030212657 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.872+0000 7fb62be00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c1037a0 0x7fb62c199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 -- 172.21.15.55:0/1030212657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c1037a0 msgr2=0x7fb62c199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c1037a0 0x7fb62c199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 -- 172.21.15.55:0/1030212657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 msgr2=0x7fb62c1a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 -- 172.21.15.55:0/1030212657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c1a16b0 con 0x7fb62c104990 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb631200640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb623e00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 0x7fb62c199fd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb61400b3f0 tx=0x7fb61400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614015020 con 0x7fb62c104990 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb614011ce0 con 0x7fb62c104990 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614010d80 con 0x7fb62c104990 2024-03-28T05:44:27.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c1a19a0 con 0x7fb62c104990 2024-03-28T05:44:27.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.873+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c1a1ef0 con 0x7fb62c104990 2024-03-28T05:44:27.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.875+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c10abe0 con 0x7fb62c104990 2024-03-28T05:44:27.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.877+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb614018020 con 0x7fb62c104990 2024-03-28T05:44:27.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.879+0000 7fb629600640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 0x7fb6100a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:27.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.879+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6140ce220 con 0x7fb62c104990 2024-03-28T05:44:27.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.879+0000 7fb62be00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 0x7fb6100a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:27.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.880+0000 7fb62be00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 0x7fb6100a4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb61c02c250 tx=0x7fb61c02c7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:27.884+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb61401f020 con 0x7fb62c104990 2024-03-28T05:44:28.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.086+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb62c0622a0 con 0x7fb62c104990 2024-03-28T05:44:28.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.087+0000 7fb629600640 1 -- 172.21.15.55:0/1030212657 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb61409b280 con 0x7fb62c104990 2024-03-28T05:44:28.087 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.089+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 msgr2=0x7fb6100a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.089+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 0x7fb6100a4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb61c02c250 tx=0x7fb61c02c7f0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.089+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 msgr2=0x7fb62c199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.089+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 0x7fb62c199fd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb61400b3f0 tx=0x7fb61400b8b0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 shutdown_connections 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6100a2880 0x7fb6100a4d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb62c105350 0x7fb62c1a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb62c104990 0x7fb62c199fd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 --2- 172.21.15.55:0/1030212657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb62c1037a0 0x7fb62c199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 >> 172.21.15.55:0/1030212657 conn(0x7fb62c0fed10 msgr2=0x7fb62c107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 shutdown_connections 2024-03-28T05:44:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.090+0000 7fb631c00640 1 -- 172.21.15.55:0/1030212657 wait complete. 2024-03-28T05:44:28.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:44:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 -- 172.21.15.55:0/905194228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 msgr2=0x7fd8c4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/905194228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4102c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009900 tx=0x7fd8ac02bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 -- 172.21.15.55:0/905194228 shutdown_connections 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/905194228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 0x7fd8c41099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/905194228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4102c10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/905194228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 0x7fd8c41019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 -- 172.21.15.55:0/905194228 >> 172.21.15.55:0/905194228 conn(0x7fd8c40fcb10 msgr2=0x7fd8c40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 -- 172.21.15.55:0/905194228 shutdown_connections 2024-03-28T05:44:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.341+0000 7fd8c9e00640 1 -- 172.21.15.55:0/905194228 wait complete. 2024-03-28T05:44:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.342+0000 7fd8c9e00640 1 Processor -- start 2024-03-28T05:44:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 -- start start 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 0x7fd8c41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 0x7fd8c419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c410d120 con 0x7fd8c4102790 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c410cfa0 con 0x7fd8c41015a0 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8c9e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c410d2a0 con 0x7fd8c4103150 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.343+0000 7fd8bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37890/0 (socket says 172.21.15.55:37890) 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 -- 172.21.15.55:0/3707664324 learned_addr learned my addr 172.21.15.55:0/3707664324 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8c8a00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 0x7fd8c41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8c9400640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 0x7fd8c419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 -- 172.21.15.55:0/3707664324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 msgr2=0x7fd8c419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 0x7fd8c419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 -- 172.21.15.55:0/3707664324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 msgr2=0x7fd8c41977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 0x7fd8c41977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 -- 172.21.15.55:0/3707664324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c419f3e0 con 0x7fd8c4102790 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.344+0000 7fd8bbe00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.345+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac043020 con 0x7fd8c4102790 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.345+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd8ac0054c0 con 0x7fd8c4102790 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.345+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c419f670 con 0x7fd8c4102790 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.345+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac003d70 con 0x7fd8c4102790 2024-03-28T05:44:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.345+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c419fc10 con 0x7fd8c4102790 2024-03-28T05:44:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.346+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c4108940 con 0x7fd8c4102790 2024-03-28T05:44:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.348+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd8ac046020 con 0x7fd8c4102790 2024-03-28T05:44:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.349+0000 7fd8c2000640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 0x7fd8a80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.349+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd8ac0f1090 con 0x7fd8c4102790 2024-03-28T05:44:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.350+0000 7fd8c8a00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 0x7fd8a80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.350+0000 7fd8c8a00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 0x7fd8a80a4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005fd0 tx=0x7fd8b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:28.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.354+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd8ac04d020 con 0x7fd8c4102790 2024-03-28T05:44:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.559+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8c40622a0 con 0x7fd8c4102790 2024-03-28T05:44:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.559+0000 7fd8c2000640 1 -- 172.21.15.55:0/3707664324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8ac0be250 con 0x7fd8c4102790 2024-03-28T05:44:28.561 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:44:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 msgr2=0x7fd8a80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 0x7fd8a80a4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005fd0 tx=0x7fd8b400b410 comp rx=0 tx=0).stop 2024-03-28T05:44:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 msgr2=0x7fd8c4197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac0042f0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 shutdown_connections 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8a80a2880 0x7fd8a80a4d40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c4103150 0x7fd8c419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c4102790 0x7fd8c4197d00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 --2- 172.21.15.55:0/3707664324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8c41015a0 0x7fd8c41977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.562+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 >> 172.21.15.55:0/3707664324 conn(0x7fd8c40fcb10 msgr2=0x7fd8c4105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.563+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 shutdown_connections 2024-03-28T05:44:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.563+0000 7fd8c9e00640 1 -- 172.21.15.55:0/3707664324 wait complete. 2024-03-28T05:44:28.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 -- 172.21.15.55:0/483522388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 msgr2=0x7f3aac102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/483522388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac102d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009900 tx=0x7f3a9402bc50 comp rx=0 tx=0).stop 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 -- 172.21.15.55:0/483522388 shutdown_connections 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/483522388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac103270 0x7f3aac109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/483522388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac102d30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/483522388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac1016c0 0x7f3aac101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 -- 172.21.15.55:0/483522388 >> 172.21.15.55:0/483522388 conn(0x7f3aac0fcc50 msgr2=0x7f3aac0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:28.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 -- 172.21.15.55:0/483522388 shutdown_connections 2024-03-28T05:44:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.803+0000 7f3ab1e00640 1 -- 172.21.15.55:0/483522388 wait complete. 2024-03-28T05:44:28.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.804+0000 7f3ab1e00640 1 Processor -- start 2024-03-28T05:44:28.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 -- start start 2024-03-28T05:44:28.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac103270 0x7f3aac073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac10d1f0 con 0x7f3aac1028b0 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac10d070 con 0x7f3aac1016c0 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3ab1e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac10d370 con 0x7f3aac103270 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3aaaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3aa3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3aaaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:54706/0 (socket says 172.21.15.55:54706) 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.805+0000 7f3aaaa00640 1 -- 172.21.15.55:0/466430546 learned_addr learned my addr 172.21.15.55:0/466430546 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aab400640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac103270 0x7f3aac073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 -- 172.21.15.55:0/466430546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac103270 msgr2=0x7f3aac073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac103270 0x7f3aac073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 -- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 msgr2=0x7f3aac073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 -- 172.21.15.55:0/466430546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac074860 con 0x7f3aac1016c0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3aaaa00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d950 tx=0x7f3a9c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c017070 con 0x7f3aac1016c0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac1a1a50 con 0x7f3aac1016c0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3a9c009c30 con 0x7f3aac1016c0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.806+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00f620 con 0x7f3aac1016c0 2024-03-28T05:44:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.807+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac1a1f70 con 0x7f3aac1016c0 2024-03-28T05:44:28.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.808+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac108b00 con 0x7f3aac1016c0 2024-03-28T05:44:28.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.811+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3a9c01a070 con 0x7f3aac1016c0 2024-03-28T05:44:28.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.812+0000 7f3ab0a00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 0x7f3a900a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:28.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.812+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3a9c0ce560 con 0x7f3aac1016c0 2024-03-28T05:44:28.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.812+0000 7f3aa3e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 0x7f3a900a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:28.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.813+0000 7f3aa3e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 0x7f3a900a4cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009230 tx=0x7f3a94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:28 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1010245170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:28 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1030212657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:28 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1010245170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:28 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1030212657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:28.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:28.824+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f3a9c009de0 con 0x7f3aac1016c0 2024-03-28T05:44:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:28 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1010245170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:28 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1030212657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.071+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aac02d070 con 0x7f3aac1016c0 2024-03-28T05:44:29.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.073+0000 7f3ab0a00640 1 -- 172.21.15.55:0/466430546 <== mon.2 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f3a9c09b5c0 con 0x7f3aac1016c0 2024-03-28T05:44:29.075 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:29.075 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:44:29.075 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 msgr2=0x7f3a900a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 0x7f3a900a4cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009230 tx=0x7f3a94005fd0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 msgr2=0x7f3aac075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00d950 tx=0x7f3a9c00de10 comp rx=0 tx=0).stop 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 shutdown_connections 2024-03-28T05:44:29.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3a900a2800 0x7f3a900a4cc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aac103270 0x7f3aac073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3aac1028b0 0x7f3aac073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 --2- 172.21.15.55:0/466430546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aac1016c0 0x7f3aac075450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 >> 172.21.15.55:0/466430546 conn(0x7f3aac0fcc50 msgr2=0x7f3aac105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.076+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 shutdown_connections 2024-03-28T05:44:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.077+0000 7f3ab1e00640 1 -- 172.21.15.55:0/466430546 wait complete. 2024-03-28T05:44:29.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:44:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 -- 172.21.15.55:0/3542881546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c80772a0 msgr2=0x7f79c8077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 --2- 172.21.15.55:0/3542881546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c80772a0 0x7f79c8077700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b002bc40 comp rx=0 tx=0).stop 2024-03-28T05:44:29.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 -- 172.21.15.55:0/3542881546 shutdown_connections 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 --2- 172.21.15.55:0/3542881546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 0x7f79c80784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 --2- 172.21.15.55:0/3542881546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c80772a0 0x7f79c8077700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 --2- 172.21.15.55:0/3542881546 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c8076060 0x7f79c8076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 -- 172.21.15.55:0/3542881546 >> 172.21.15.55:0/3542881546 conn(0x7f79c80fee50 msgr2=0x7f79c8101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 -- 172.21.15.55:0/3542881546 shutdown_connections 2024-03-28T05:44:29.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.318+0000 7f79cec00640 1 -- 172.21.15.55:0/3542881546 wait complete. 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 Processor -- start 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 -- start start 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c80772a0 0x7f79c819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 0x7f79c81a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c8113820 con 0x7f79c8076060 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81136a0 con 0x7f79c80772a0 2024-03-28T05:44:29.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.319+0000 7f79cec00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c81139a0 con 0x7f79c8077c40 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49242/0 (socket says 172.21.15.55:49242) 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 -- 172.21.15.55:0/1038998600 learned_addr learned my addr 172.21.15.55:0/1038998600 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79bf400640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c80772a0 0x7f79c819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79ccc00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 0x7f79c81a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 -- 172.21.15.55:0/1038998600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 msgr2=0x7f79c81a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 0x7f79c81a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 -- 172.21.15.55:0/1038998600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c80772a0 msgr2=0x7f79c819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c80772a0 0x7f79c819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 -- 172.21.15.55:0/1038998600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c81a5ab0 con 0x7f79c8076060 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.320+0000 7f79c7e00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79b800eab0 tx=0x7f79b800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.321+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800ce40 con 0x7f79c8076060 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.321+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f79b8011920 con 0x7f79c8076060 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.321+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8010a00 con 0x7f79c8076060 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.321+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c81a5da0 con 0x7f79c8076060 2024-03-28T05:44:29.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.321+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c81a6200 con 0x7f79c8076060 2024-03-28T05:44:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.322+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c81103e0 con 0x7f79c8076060 2024-03-28T05:44:29.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.324+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f79b8011ad0 con 0x7f79c8076060 2024-03-28T05:44:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.327+0000 7f79c5600640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 0x7f79ac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.327+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f79b80cf0d0 con 0x7f79c8076060 2024-03-28T05:44:29.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.327+0000 7f79bf400640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 0x7f79ac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.328+0000 7f79bf400640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 0x7f79ac0a4cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b002c7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:29.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.331+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f79b8016030 con 0x7f79c8076060 2024-03-28T05:44:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.537+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c8062340 con 0x7f79c8076060 2024-03-28T05:44:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.542+0000 7f79c5600640 1 -- 172.21.15.55:0/1038998600 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f79b809c130 con 0x7f79c8076060 2024-03-28T05:44:29.544 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:29.544 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:44:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 msgr2=0x7f79ac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 0x7f79ac0a4cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c00 tx=0x7f79b002c7f0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 msgr2=0x7f79c819de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79b800eab0 tx=0x7f79b800ef70 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 shutdown_connections 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f79ac0a2800 0x7f79ac0a4cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79c8077c40 0x7f79c81a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79c80772a0 0x7f79c819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 --2- 172.21.15.55:0/1038998600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c8076060 0x7f79c819de90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 >> 172.21.15.55:0/1038998600 conn(0x7f79c80fee50 msgr2=0x7f79c8100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 shutdown_connections 2024-03-28T05:44:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.545+0000 7f79cec00640 1 -- 172.21.15.55:0/1038998600 wait complete. 2024-03-28T05:44:29.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:44:29.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 -- 172.21.15.55:0/2734585404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63381008f0 msgr2=0x7f6338100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 --2- 172.21.15.55:0/2734585404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63381008f0 0x7f6338100d50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6320009900 tx=0x7f632002bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 -- 172.21.15.55:0/2734585404 shutdown_connections 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 --2- 172.21.15.55:0/2734585404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f6338101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 --2- 172.21.15.55:0/2734585404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63381008f0 0x7f6338100d50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 --2- 172.21.15.55:0/2734585404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63380fff90 0x7f63381003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 -- 172.21.15.55:0/2734585404 >> 172.21.15.55:0/2734585404 conn(0x7f63380fbb50 msgr2=0x7f63380fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 -- 172.21.15.55:0/2734585404 shutdown_connections 2024-03-28T05:44:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.795+0000 7f633f600640 1 -- 172.21.15.55:0/2734585404 wait complete. 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.796+0000 7f633f600640 1 Processor -- start 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.796+0000 7f633f600640 1 -- start start 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 0x7f633819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f63381a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633810f430 con 0x7f63380fff90 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633810f2b0 con 0x7f63381008f0 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633f600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633810f5b0 con 0x7f6338101290 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49260/0 (socket says 172.21.15.55:49260) 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 -- 172.21.15.55:0/1606413248 learned_addr learned my addr 172.21.15.55:0/1606413248 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f6337e00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 0x7f633819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633d600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f63381a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 -- 172.21.15.55:0/1606413248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 msgr2=0x7f63381a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f63381a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 -- 172.21.15.55:0/1606413248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 msgr2=0x7f633819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 0x7f633819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633cc00640 1 -- 172.21.15.55:0/1606413248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63381a1750 con 0x7f63380fff90 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f633d600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f63381a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.797+0000 7f6337e00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 0x7f633819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f633cc00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f632800db80 tx=0x7f632800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328017070 con 0x7f63380fff90 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6328003b70 con 0x7f63380fff90 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63381a1a40 con 0x7f63380fff90 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280104c0 con 0x7f63380fff90 2024-03-28T05:44:29.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.798+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63381a1f60 con 0x7f63380fff90 2024-03-28T05:44:29.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.799+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63380688e0 con 0x7f63380fff90 2024-03-28T05:44:29.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.802+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f6328004020 con 0x7f63380fff90 2024-03-28T05:44:29.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.803+0000 7f6335600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 0x7f63180a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:29.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.803+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f63280cf450 con 0x7f63380fff90 2024-03-28T05:44:29.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.803+0000 7f6337e00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 0x7f63180a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:29.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.804+0000 7f6337e00640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 0x7f63180a4cc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6320006010 tx=0x7f632002c740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:29.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:29.806+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f632809c4b0 con 0x7f63380fff90 2024-03-28T05:44:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:29 smithi086 ceph-mon[35163]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:29 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3707664324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:29 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/466430546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:29 smithi159 ceph-mon[36109]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:29 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3707664324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:29 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/466430546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:29 smithi055 ceph-mon[31863]: pgmap v417: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-28T05:44:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:29 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3707664324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:29 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/466430546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.006+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f633802d200 con 0x7f63380fff90 2024-03-28T05:44:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.007+0000 7f6335600640 1 -- 172.21.15.55:0/1606413248 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f632809bdb0 con 0x7f63380fff90 2024-03-28T05:44:30.008 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 msgr2=0x7f63180a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 0x7f63180a4cc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6320006010 tx=0x7f632002c740 comp rx=0 tx=0).stop 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 msgr2=0x7f6338199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f632800db80 tx=0x7f632800b630 comp rx=0 tx=0).stop 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 shutdown_connections 2024-03-28T05:44:30.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f63180a2800 0x7f63180a4cc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6338101290 0x7f63381a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381008f0 0x7f633819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 --2- 172.21.15.55:0/1606413248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63380fff90 0x7f6338199b30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 >> 172.21.15.55:0/1606413248 conn(0x7f63380fbb50 msgr2=0x7f63380fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 shutdown_connections 2024-03-28T05:44:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.010+0000 7f633f600640 1 -- 172.21.15.55:0/1606413248 wait complete. 2024-03-28T05:44:30.030 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:44:30.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 -- 172.21.15.55:0/985641601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 msgr2=0x7fdec4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 --2- 172.21.15.55:0/985641601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4104e10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009900 tx=0x7fdeac02bc40 comp rx=0 tx=0).stop 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 -- 172.21.15.55:0/985641601 shutdown_connections 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 --2- 172.21.15.55:0/985641601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec4105350 0x7fdec410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 --2- 172.21.15.55:0/985641601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4104e10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 --2- 172.21.15.55:0/985641601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec41037a0 0x7fdec4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 -- 172.21.15.55:0/985641601 >> 172.21.15.55:0/985641601 conn(0x7fdec40fed10 msgr2=0x7fdec4101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 -- 172.21.15.55:0/985641601 shutdown_connections 2024-03-28T05:44:30.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.258+0000 7fdec9600640 1 -- 172.21.15.55:0/985641601 wait complete. 2024-03-28T05:44:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.259+0000 7fdec9600640 1 Processor -- start 2024-03-28T05:44:30.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.259+0000 7fdec9600640 1 -- start start 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.259+0000 7fdec9600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 0x7fdec4199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.259+0000 7fdec9600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 0x7fdec41a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec9600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec410f300 con 0x7fdec4104990 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec9600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec410f180 con 0x7fdec4105350 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec9600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec410f480 con 0x7fdec41037a0 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49286/0 (socket says 172.21.15.55:49286) 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 -- 172.21.15.55:0/1670190583 learned_addr learned my addr 172.21.15.55:0/1670190583 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:30.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec3e00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 0x7fdec4199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 -- 172.21.15.55:0/1670190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 msgr2=0x7fdec4199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 0x7fdec4199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 -- 172.21.15.55:0/1670190583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 msgr2=0x7fdec41a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec8c00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 0x7fdec41a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 0x7fdec41a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdebb400640 1 -- 172.21.15.55:0/1670190583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec41a1590 con 0x7fdec4104990 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec3e00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 0x7fdec4199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.260+0000 7fdec8c00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 0x7fdec41a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdebb400640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000c00 tx=0x7fdeac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:30.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac043020 con 0x7fdec4104990 2024-03-28T05:44:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fdeac0054c0 con 0x7fdec4104990 2024-03-28T05:44:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec41a1820 con 0x7fdec4104990 2024-03-28T05:44:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac003d40 con 0x7fdec4104990 2024-03-28T05:44:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.261+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41a1d70 con 0x7fdec4104990 2024-03-28T05:44:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.262+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec410ab40 con 0x7fdec4104990 2024-03-28T05:44:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.264+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fdeac046020 con 0x7fdec4104990 2024-03-28T05:44:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.266+0000 7fdec1600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 0x7fdea80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.266+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdeac0f0f00 con 0x7fdec4104990 2024-03-28T05:44:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.266+0000 7fdec3e00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 0x7fdea80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.267+0000 7fdec3e00640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 0x7fdea80a4cc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005d00 tx=0x7fdeb4005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.270+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fdeac04d020 con 0x7fdec4104990 2024-03-28T05:44:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.478+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdec40622a0 con 0x7fdec4104990 2024-03-28T05:44:30.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.480+0000 7fdec1600640 1 -- 172.21.15.55:0/1670190583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdeac0be0c0 con 0x7fdec4104990 2024-03-28T05:44:30.481 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.482+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 msgr2=0x7fdea80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.482+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 0x7fdea80a4cc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005d00 tx=0x7fdeb4005ef0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.482+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 msgr2=0x7fdec4199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.482+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdeac000c00 tx=0x7fdeac0042f0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 shutdown_connections 2024-03-28T05:44:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fdea80a2800 0x7fdea80a4cc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdec4105350 0x7fdec41a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4104990 0x7fdec4199eb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 --2- 172.21.15.55:0/1670190583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdec41037a0 0x7fdec4199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 >> 172.21.15.55:0/1670190583 conn(0x7fdec40fed10 msgr2=0x7fdec4107d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 shutdown_connections 2024-03-28T05:44:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.483+0000 7fdec9600640 1 -- 172.21.15.55:0/1670190583 wait complete. 2024-03-28T05:44:30.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 -- 172.21.15.55:0/3440538226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 msgr2=0x7f8bb00784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3440538226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb00784e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009ca0 tx=0x7f8ba802c100 comp rx=0 tx=0).stop 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 -- 172.21.15.55:0/3440538226 shutdown_connections 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3440538226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb00784e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3440538226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 0x7f8bb0077700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3440538226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb0076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.721+0000 7f8bb7800640 1 -- 172.21.15.55:0/3440538226 >> 172.21.15.55:0/3440538226 conn(0x7f8bb00fee50 msgr2=0x7f8bb0101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.722+0000 7f8bb7800640 1 -- 172.21.15.55:0/3440538226 shutdown_connections 2024-03-28T05:44:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.722+0000 7f8bb7800640 1 -- 172.21.15.55:0/3440538226 wait complete. 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 Processor -- start 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 -- start start 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb019def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 0x7f8bb019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb01a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0113820 con 0x7f8bb0077c40 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb01136a0 con 0x7f8bb0076060 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb7800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb01139a0 con 0x7f8bb00772a0 2024-03-28T05:44:30.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb01a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.723+0000 7f8bb4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb019def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb019def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51532/0 (socket says 172.21.15.55:51532) 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb4e00640 1 -- 172.21.15.55:0/3203660766 learned_addr learned my addr 172.21.15.55:0/3203660766 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bafe00640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 0x7f8bb019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 -- 172.21.15.55:0/3203660766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 msgr2=0x7f8bb019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 0x7f8bb019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 -- 172.21.15.55:0/3203660766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 msgr2=0x7f8bb019def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb019def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 -- 172.21.15.55:0/3203660766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb01a5b10 con 0x7f8bb0077c40 2024-03-28T05:44:30.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.724+0000 7f8bb5800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb01a54a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802c640 tx=0x7f8ba8035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.725+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8039040 con 0x7f8bb0077c40 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.725+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ba8034700 con 0x7f8bb0077c40 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.725+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb01a5da0 con 0x7f8bb0077c40 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.725+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004330 con 0x7f8bb0077c40 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.725+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb01a6280 con 0x7f8bb0077c40 2024-03-28T05:44:30.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.726+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb0110250 con 0x7f8bb0077c40 2024-03-28T05:44:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.728+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8ba8046030 con 0x7f8bb0077c40 2024-03-28T05:44:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.729+0000 7f8bad600640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 0x7f8b980a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.729+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8ba80f06d0 con 0x7f8bb0077c40 2024-03-28T05:44:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.729+0000 7f8bb4e00640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 0x7f8b980a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.730+0000 7f8bb4e00640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 0x7f8b980a4d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009c90 tx=0x7f8ba4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.733+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8ba804d060 con 0x7f8bb0077c40 2024-03-28T05:44:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:30 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1038998600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:30 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1606413248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:30 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1038998600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:30 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1606413248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:30 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1038998600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:30 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1606413248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:44:30.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.938+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8bb0062340 con 0x7f8bb0077c40 2024-03-28T05:44:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.939+0000 7f8bad600640 1 -- 172.21.15.55:0/3203660766 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ba80bd7c0 con 0x7f8bb0077c40 2024-03-28T05:44:30.941 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 msgr2=0x7f8b980a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 0x7f8b980a4d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009c90 tx=0x7f8ba4005f90 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 msgr2=0x7f8bb01a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb01a54a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802c640 tx=0x7f8ba8035d60 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 shutdown_connections 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8b980a2880 0x7f8b980a4d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8bb0077c40 0x7f8bb01a54a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bb00772a0 0x7f8bb019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 --2- 172.21.15.55:0/3203660766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bb0076060 0x7f8bb019def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 >> 172.21.15.55:0/3203660766 conn(0x7f8bb00fee50 msgr2=0x7f8bb0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.942+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 shutdown_connections 2024-03-28T05:44:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:30.943+0000 7f8bb7800640 1 -- 172.21.15.55:0/3203660766 wait complete. 2024-03-28T05:44:30.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 -- 172.21.15.55:0/1327119112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01048e0 msgr2=0x7f91d0104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 --2- 172.21.15.55:0/1327119112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01048e0 0x7f91d0104d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009900 tx=0x7f91b802bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 -- 172.21.15.55:0/1327119112 shutdown_connections 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 --2- 172.21.15.55:0/1327119112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01052a0 0x7f91d010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 --2- 172.21.15.55:0/1327119112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01048e0 0x7f91d0104d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 --2- 172.21.15.55:0/1327119112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01036f0 0x7f91d0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.178+0000 7f91cf200640 1 -- 172.21.15.55:0/1327119112 >> 172.21.15.55:0/1327119112 conn(0x7f91d00fec80 msgr2=0x7f91d01010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.179+0000 7f91cf200640 1 -- 172.21.15.55:0/1327119112 shutdown_connections 2024-03-28T05:44:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.179+0000 7f91cf200640 1 -- 172.21.15.55:0/1327119112 wait complete. 2024-03-28T05:44:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.179+0000 7f91cf200640 1 Processor -- start 2024-03-28T05:44:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 -- start start 2024-03-28T05:44:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 0x7f91d0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01048e0 0x7f91d0199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d010f270 con 0x7f91d01052a0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d010f0f0 con 0x7f91d01036f0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cf200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d010f3f0 con 0x7f91d01048e0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91ce800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91cde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 0x7f91d0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.180+0000 7f91c7e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01048e0 0x7f91d0199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49312/0 (socket says 172.21.15.55:49312) 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 -- 172.21.15.55:0/3560298464 learned_addr learned my addr 172.21.15.55:0/3560298464 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91cde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 0x7f91d0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51562/0 (socket says 172.21.15.55:51562) 2024-03-28T05:44:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 -- 172.21.15.55:0/3560298464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01048e0 msgr2=0x7f91d0199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01048e0 0x7f91d0199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 -- 172.21.15.55:0/3560298464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 msgr2=0x7f91d0199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 0x7f91d0199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 -- 172.21.15.55:0/3560298464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d01a1540 con 0x7f91d01052a0 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91ce800640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f91c800eb10 tx=0x7f91c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.181+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8004b20 con 0x7f91d01052a0 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.182+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f91c8004cc0 con 0x7f91d01052a0 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.182+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d01a1830 con 0x7f91d01052a0 2024-03-28T05:44:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.182+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8010690 con 0x7f91d01052a0 2024-03-28T05:44:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.182+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d01a1d00 con 0x7f91d01052a0 2024-03-28T05:44:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.183+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d010aa90 con 0x7f91d01052a0 2024-03-28T05:44:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.185+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f91c8005020 con 0x7f91d01052a0 2024-03-28T05:44:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.186+0000 7f91c6a00640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 0x7f91b40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.186+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f91c80ceff0 con 0x7f91d01052a0 2024-03-28T05:44:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.186+0000 7f91cde00640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 0x7f91b40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.187+0000 7f91cde00640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 0x7f91b40a4cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005fd0 tx=0x7f91c000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:31.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.190+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f91c809c090 con 0x7f91d01052a0 2024-03-28T05:44:31.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.436+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d00622a0 con 0x7f91d01052a0 2024-03-28T05:44:31.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.438+0000 7f91c6a00640 1 -- 172.21.15.55:0/3560298464 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f91c809b990 con 0x7f91d01052a0 2024-03-28T05:44:31.440 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:31.440 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:44:31.441 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 msgr2=0x7f91b40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 0x7f91b40a4cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005fd0 tx=0x7f91c000b390 comp rx=0 tx=0).stop 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 msgr2=0x7f91d01a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f91c800eb10 tx=0x7f91c800c2d0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 shutdown_connections 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91b40a2800 0x7f91b40a4cc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d01052a0 0x7f91d01a0ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91d01048e0 0x7f91d0199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 --2- 172.21.15.55:0/3560298464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d01036f0 0x7f91d0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 >> 172.21.15.55:0/3560298464 conn(0x7f91d00fec80 msgr2=0x7f91d0107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 shutdown_connections 2024-03-28T05:44:31.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.441+0000 7f91cf200640 1 -- 172.21.15.55:0/3560298464 wait complete. 2024-03-28T05:44:31.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.683+0000 7f7412800640 1 -- 172.21.15.55:0/288694381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c1093d0 msgr2=0x7f740c10b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.683+0000 7f7412800640 1 --2- 172.21.15.55:0/288694381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c1093d0 0x7f740c10b860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7404009900 tx=0x7f740402bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 -- 172.21.15.55:0/288694381 shutdown_connections 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 --2- 172.21.15.55:0/288694381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c1093d0 0x7f740c10b860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 --2- 172.21.15.55:0/288694381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 0x7f740c074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 --2- 172.21.15.55:0/288694381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f740c0756e0 0x7f740c073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 -- 172.21.15.55:0/288694381 >> 172.21.15.55:0/288694381 conn(0x7f740c0fca80 msgr2=0x7f740c0feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:31.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 -- 172.21.15.55:0/288694381 shutdown_connections 2024-03-28T05:44:31.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.684+0000 7f7412800640 1 -- 172.21.15.55:0/288694381 wait complete. 2024-03-28T05:44:31.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 Processor -- start 2024-03-28T05:44:31.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 -- start start 2024-03-28T05:44:31.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 0x7f740c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f740c1093d0 0x7f740c1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c10f270 con 0x7f740c0756e0 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c10f0f0 con 0x7f740c1093d0 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7412800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c10f3f0 con 0x7f740c074100 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7410a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7410a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49328/0 (socket says 172.21.15.55:49328) 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.685+0000 7f7410a00640 1 -- 172.21.15.55:0/1061101450 learned_addr learned my addr 172.21.15.55:0/1061101450 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:31.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7411400640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 0x7f740c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 -- 172.21.15.55:0/1061101450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 msgr2=0x7f740c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 0x7f740c1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 -- 172.21.15.55:0/1061101450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f740c1093d0 msgr2=0x7f740c1a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f740c1093d0 0x7f740c1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 -- 172.21.15.55:0/1061101450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c1a1500 con 0x7f740c0756e0 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7410a00640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00eb90 tx=0x7f73fc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc004d20 con 0x7f740c0756e0 2024-03-28T05:44:31.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f73fc00ee90 con 0x7f740c0756e0 2024-03-28T05:44:31.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c1a17f0 con 0x7f740c0756e0 2024-03-28T05:44:31.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.686+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc010670 con 0x7f740c0756e0 2024-03-28T05:44:31.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.687+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c1a1cf0 con 0x7f740c0756e0 2024-03-28T05:44:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.688+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c108100 con 0x7f740c0756e0 2024-03-28T05:44:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.690+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f73fc005020 con 0x7f740c0756e0 2024-03-28T05:44:31.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.691+0000 7f740a000640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 0x7f73f40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:31.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.691+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f73fc0cf290 con 0x7f740c0756e0 2024-03-28T05:44:31.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.691+0000 7f7411400640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 0x7f73f40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:31.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.692+0000 7f7411400640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 0x7f73f40a4cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7400005fd0 tx=0x7f7400005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:31.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.695+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f73fc09c2f0 con 0x7f740c0756e0 2024-03-28T05:44:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:31 smithi086 ceph-mon[35163]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:31 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1670190583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:31 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3203660766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:31 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3560298464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:31 smithi159 ceph-mon[36109]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:31 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1670190583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:31 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3203660766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:31 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3560298464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:31 smithi055 ceph-mon[31863]: pgmap v418: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:44:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:31 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1670190583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:31 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3203660766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:44:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:31 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3560298464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:31.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.898+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f740c062340 con 0x7f740c0756e0 2024-03-28T05:44:31.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.902+0000 7f740a000640 1 -- 172.21.15.55:0/1061101450 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f73fc09bbf0 con 0x7f740c0756e0 2024-03-28T05:44:31.904 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:31.904 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 msgr2=0x7f73f40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 0x7f73f40a4cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7400005fd0 tx=0x7f7400005850 comp rx=0 tx=0).stop 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 msgr2=0x7f740c199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00eb90 tx=0x7f73fc00c6a0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 shutdown_connections 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f73f40a2800 0x7f73f40a4cc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f740c1093d0 0x7f740c1a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f740c0756e0 0x7f740c199e20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 --2- 172.21.15.55:0/1061101450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f740c074100 0x7f740c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.905+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 >> 172.21.15.55:0/1061101450 conn(0x7f740c0fca80 msgr2=0x7f740c1052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.906+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 shutdown_connections 2024-03-28T05:44:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:31.906+0000 7f7412800640 1 -- 172.21.15.55:0/1061101450 wait complete. 2024-03-28T05:44:31.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 -- 172.21.15.55:0/1355578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 msgr2=0x7f2790077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 --2- 172.21.15.55:0/1355578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f2790077700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f277c009900 tx=0x7f277c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 -- 172.21.15.55:0/1355578878 shutdown_connections 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 --2- 172.21.15.55:0/1355578878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 0x7f27900784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 --2- 172.21.15.55:0/1355578878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f2790077700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 --2- 172.21.15.55:0/1355578878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 0x7f2790076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 -- 172.21.15.55:0/1355578878 >> 172.21.15.55:0/1355578878 conn(0x7f27900fee50 msgr2=0x7f2790101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 -- 172.21.15.55:0/1355578878 shutdown_connections 2024-03-28T05:44:32.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.154+0000 7f2797400640 1 -- 172.21.15.55:0/1355578878 wait complete. 2024-03-28T05:44:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.155+0000 7f2797400640 1 Processor -- start 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.155+0000 7f2797400640 1 -- start start 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 0x7f279019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 0x7f27901a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901138a0 con 0x7f27900772a0 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790113720 con 0x7f2790076060 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2797400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790113a20 con 0x7f2790077c40 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f278fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f278fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49346/0 (socket says 172.21.15.55:49346) 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f278fe00640 1 -- 172.21.15.55:0/3350746863 learned_addr learned my addr 172.21.15.55:0/3350746863 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2794a00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 0x7f279019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.156+0000 7f2795400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 0x7f27901a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 -- 172.21.15.55:0/3350746863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 msgr2=0x7f27901a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 0x7f27901a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 -- 172.21.15.55:0/3350746863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 msgr2=0x7f279019df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 0x7f279019df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 -- 172.21.15.55:0/3350746863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27901a5b70 con 0x7f27900772a0 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278fe00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f277c000c00 tx=0x7f277c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c043020 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f277c0054c0 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c003d70 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27901a5e00 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.157+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27901a6390 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.158+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2790110430 con 0x7f27900772a0 2024-03-28T05:44:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.161+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f277c046020 con 0x7f27900772a0 2024-03-28T05:44:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.162+0000 7f278d600640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 0x7f27740a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.163+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f277c0f0e60 con 0x7f27900772a0 2024-03-28T05:44:32.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.163+0000 7f2794a00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 0x7f27740a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.163+0000 7f2794a00640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 0x7f27740a4d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f278000bbe0 tx=0x7f278000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.167+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f277c04d020 con 0x7f27900772a0 2024-03-28T05:44:32.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.406+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f279002d070 con 0x7f27900772a0 2024-03-28T05:44:32.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.408+0000 7f278d600640 1 -- 172.21.15.55:0/3350746863 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f277c0bdfe0 con 0x7f27900772a0 2024-03-28T05:44:32.409 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:32.409 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:44:32.410 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 msgr2=0x7f27740a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 0x7f27740a4d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f278000bbe0 tx=0x7f278000b390 comp rx=0 tx=0).stop 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 msgr2=0x7f279019e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f277c000c00 tx=0x7f277c0042f0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 shutdown_connections 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f27740a2880 0x7f27740a4d40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2790077c40 0x7f27901a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27900772a0 0x7f279019e490 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 --2- 172.21.15.55:0/3350746863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2790076060 0x7f279019df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 >> 172.21.15.55:0/3350746863 conn(0x7f27900fee50 msgr2=0x7f2790100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 shutdown_connections 2024-03-28T05:44:32.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.410+0000 7f2797400640 1 -- 172.21.15.55:0/3350746863 wait complete. 2024-03-28T05:44:32.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-28T05:42:52.123648+0000', 'modified': '2024-03-28T05:42:57.977747+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34535, 'mds_1': 34490, 'mds_2': 34457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6837/1347717104', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6836', 'nonce': 1347717104}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 1347717104}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6839/673238495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 673238495}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 673238495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34433': {'gid': 34433, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6833/3295609155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6832', 'nonce': 3295609155}, {'type': 'v1', 'addr': '172.21.15.86:6833', 'nonce': 3295609155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34457': {'gid': 34457, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.86:6835/833423423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 833423423}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 833423423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34490': {'gid': 34490, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.86:6837/2422548949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 2422548949}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 2422548949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34535': {'gid': 34535, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6839/3285549085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 3285549085}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 3285549085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34535, 'qdb_cluster': [34457, 34490, 34535]} 2024-03-28T05:44:32.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-28T05:44:32.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 -- 172.21.15.55:0/2770715713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220108eb0 msgr2=0x7f4220109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 --2- 172.21.15.55:0/2770715713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220108eb0 0x7f4220109330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4208009900 tx=0x7f420802bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 -- 172.21.15.55:0/2770715713 shutdown_connections 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 --2- 172.21.15.55:0/2770715713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220109870 0x7f4220110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 --2- 172.21.15.55:0/2770715713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220108eb0 0x7f4220109330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 --2- 172.21.15.55:0/2770715713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220107cc0 0x7f42201080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 -- 172.21.15.55:0/2770715713 >> 172.21.15.55:0/2770715713 conn(0x7f4220076c60 msgr2=0x7f42200790a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 -- 172.21.15.55:0/2770715713 shutdown_connections 2024-03-28T05:44:32.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.647+0000 7f4224e00640 1 -- 172.21.15.55:0/2770715713 wait complete. 2024-03-28T05:44:32.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.648+0000 7f4224e00640 1 Processor -- start 2024-03-28T05:44:32.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 -- start start 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220108eb0 0x7f422019e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220109870 0x7f42201a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220113820 con 0x7f4220107cc0 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201136a0 con 0x7f4220109870 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f4224e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201139a0 con 0x7f4220108eb0 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f421de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f421de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49362/0 (socket says 172.21.15.55:49362) 2024-03-28T05:44:32.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.649+0000 7f421de00640 1 -- 172.21.15.55:0/1022530771 learned_addr learned my addr 172.21.15.55:0/1022530771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f4215400640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220108eb0 0x7f422019e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421e800640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220109870 0x7f42201a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 -- 172.21.15.55:0/1022530771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220108eb0 msgr2=0x7f422019e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220108eb0 0x7f422019e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 -- 172.21.15.55:0/1022530771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220109870 msgr2=0x7f42201a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220109870 0x7f42201a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 -- 172.21.15.55:0/1022530771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42201a5ab0 con 0x7f4220107cc0 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f421de00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f421000d770 tx=0x7f421000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f4217400640 1 -- 172.21.15.55:0/1022530771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210017070 con 0x7f4220107cc0 2024-03-28T05:44:32.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f4217400640 1 -- 172.21.15.55:0/1022530771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4210009c30 con 0x7f4220107cc0 2024-03-28T05:44:32.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.650+0000 7f4217400640 1 -- 172.21.15.55:0/1022530771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210003d00 con 0x7f4220107cc0 2024-03-28T05:44:32.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.651+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42201a5da0 con 0x7f4220107cc0 2024-03-28T05:44:32.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.651+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42201a61b0 con 0x7f4220107cc0 2024-03-28T05:44:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f4217400640 1 -- 172.21.15.55:0/1022530771 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f4210003ea0 con 0x7f4220107cc0 2024-03-28T05:44:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 Processor -- start 2024-03-28T05:44:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 -- start start 2024-03-28T05:44:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f5f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f556c90 con 0x55bd4f5f7700 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f4ff980 con 0x55bd4f5f2590 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.654+0000 7f42279f5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f552d30 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49370/0 (socket says 172.21.15.55:49370) 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 -- 172.21.15.55:0/2968027351 learned_addr learned my addr 172.21.15.55:0/2968027351 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f421de00640 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f5f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f421e800640 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 -- 172.21.15.55:0/2968027351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 msgr2=0x55bd4f5f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 -- 172.21.15.55:0/2968027351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 msgr2=0x55bd4f5f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f5f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 -- 172.21.15.55:0/2968027351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd4f517510 con 0x55bd4f5f7700 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4217400640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 0x7f42040a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4215400640 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4208005ab0 tx=0x7f4208005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8ea7da35247761 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.655+0000 7f4217400640 1 -- 172.21.15.55:0/1022530771 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f42100ce7f0 con 0x7f4220107cc0 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.656+0000 7f421e800640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 0x7f42040a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.656+0000 7f420f400640 1 -- 172.21.15.55:0/2968027351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208044020 con 0x55bd4f5f7700 2024-03-28T05:44:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.656+0000 7f420f400640 1 -- 172.21.15.55:0/2968027351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4208005040 con 0x55bd4f5f7700 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.656+0000 7f420f400640 1 -- 172.21.15.55:0/2968027351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208004920 con 0x55bd4f5f7700 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- 172.21.15.55:0/2968027351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 msgr2=0x55bd4f5f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4208005ab0 tx=0x7f4208005e00 comp rx=0 tx=0).stop 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f421e800640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 0x7f42040a4d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55bd4f5f2df0 tx=0x7f4218007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- 172.21.15.55:0/2968027351 shutdown_connections 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f7700 0x55bd4f5f9b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f5f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 --2- 172.21.15.55:0/2968027351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- 172.21.15.55:0/2968027351 >> 172.21.15.55:0/2968027351 conn(0x55bd4f5ed110 msgr2=0x55bd4f5ed510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- 172.21.15.55:0/2968027351 shutdown_connections 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- 172.21.15.55:0/2968027351 wait complete. 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 -- start start 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.657+0000 7f42279f5740 1 Processor -- start 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f603600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f5fa650 con 0x55bd4f5f2590 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f512dd0 con 0x55bd4f5f7700 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f5fa7d0 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f42279f5740 10 client.0 _ll_register_callbacks cb 0x55bd4f26aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49382/0 (socket says 172.21.15.55:49382) 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 -- 172.21.15.55:0/649386273 learned_addr learned my addr 172.21.15.55:0/649386273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f421de00640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 -- 172.21.15.55:0/649386273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 msgr2=0x55bd4f5fc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f421e800640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f603600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 -- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 msgr2=0x55bd4f603600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f603600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.658+0000 7f4215400640 1 -- 172.21.15.55:0/649386273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd4f26b2d0 con 0x55bd4f5f2590 2024-03-28T05:44:32.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f4215400640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4208036040 tx=0x7f42080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadb50a7fdaeb98b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f4203e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208004cf0 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4208040470 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4208005040 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4208004e90 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f42279f5740 10 client.15054 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.659+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bd4f3356b0 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4208005040 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4208053600 con 0x55bd4f5f2590 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 10 client.15054 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:32.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 10 client.15054 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T05:44:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 20 client.15054 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f607760 0x55bd4f60c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 4 client.15054 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:44:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.660+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd4f4f8520 con 0x55bd4f607760 2024-03-28T05:44:32.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.661+0000 7f421de00640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f607760 0x55bd4f60c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.662+0000 7f421de00640 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f607760 0x55bd4f60c830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a62ad3c9f2dadf2 server_cookie=89da571693b008f3 in_seq=0 out_seq=0 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.662+0000 7f4203e00640 10 client.15054 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f4203e00640 1 -- 172.21.15.55:0/649386273 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bd4f4f8520 con 0x55bd4f607760 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f4203e00640 10 client.15054 handle_command_reply: tid=0 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 client.15054 shutdown 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 msgr2=0x55bd4f5fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4208036040 tx=0x7f42080048f0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 shutdown_connections 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f607760 0x55bd4f60c830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f603600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5fc5c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 --2- 172.21.15.55:0/649386273 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f4203e00640 0 client.15054 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 >> 172.21.15.55:0/649386273 conn(0x55bd4f5ed110 msgr2=0x55bd4f5ec310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 shutdown_connections 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.664+0000 7f42279f5740 1 -- 172.21.15.55:0/649386273 wait complete. 2024-03-28T05:44:32.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.665+0000 7f42279f5740 20 client.15054 trim_cache size 0 max 16384 2024-03-28T05:44:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 Processor -- start 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 -- start start 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f6035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f7700 0x55bd4f5e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f607bd0 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f608230 con 0x55bd4f5f2590 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.682+0000 7f42279f5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f608890 con 0x55bd4f5f7700 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49396/0 (socket says 172.21.15.55:49396) 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 -- 172.21.15.55:0/3136877253 learned_addr learned my addr 172.21.15.55:0/3136877253 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f4215400640 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f6035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 -- 172.21.15.55:0/3136877253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f7700 msgr2=0x55bd4f5e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f7700 0x55bd4f5e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 -- 172.21.15.55:0/3136877253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 msgr2=0x55bd4f6035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f6035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 -- 172.21.15.55:0/3136877253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd4f5e7420 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f4215400640 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f6035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.683+0000 7f421de00640 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4210009610 tx=0x7f42100cc180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be36c3a101fa715 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f420ea00640 1 -- 172.21.15.55:0/3136877253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210020040 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f420ea00640 1 -- 172.21.15.55:0/3136877253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f421009b150 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f420ea00640 1 -- 172.21.15.55:0/3136877253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100cc3c0 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 -- 172.21.15.55:0/3136877253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 msgr2=0x55bd4f5f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4210009610 tx=0x7f42100cc180 comp rx=0 tx=0).stop 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 -- 172.21.15.55:0/3136877253 shutdown_connections 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f7700 0x55bd4f5e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f2590 0x55bd4f6035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 --2- 172.21.15.55:0/3136877253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5f3030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 -- 172.21.15.55:0/3136877253 >> 172.21.15.55:0/3136877253 conn(0x55bd4f5ed110 msgr2=0x55bd4f5f0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 -- 172.21.15.55:0/3136877253 shutdown_connections 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.684+0000 7f42279f5740 1 -- 172.21.15.55:0/3136877253 wait complete. 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 -- start start 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 Processor -- start 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f602350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f609550 con 0x55bd4f5f2590 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f608ef0 con 0x55bd4f5f7700 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd4f609bb0 con 0x55bd4f5f1ba0 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.685+0000 7f42279f5740 10 client.0 _ll_register_callbacks cb 0x7f4208005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49406/0 (socket says 172.21.15.55:49406) 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 -- 172.21.15.55:0/1896834813 learned_addr learned my addr 172.21.15.55:0/1896834813 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f421de00640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 -- 172.21.15.55:0/1896834813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 msgr2=0x55bd4f5fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f421e800640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f602350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 -- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 msgr2=0x55bd4f602350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f602350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 -- 172.21.15.55:0/1896834813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd4f602940 con 0x55bd4f5f2590 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4215400640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4208005e40 tx=0x7f42080050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e040b27fee17479 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4203e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.686+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208044040 con 0x55bd4f5f2590 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f420802cbe0 con 0x55bd4f5f2590 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f421009b150 con 0x55bd4f5f2590 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4208053440 con 0x55bd4f5f2590 2024-03-28T05:44:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 10 client.15060 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bd4f663a80 con 0x55bd4f5f2590 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f421009b150 con 0x55bd4f5f2590 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4208003680 con 0x55bd4f5f2590 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 10 client.15060 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 10 client.15060 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 20 client.15060 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f667f30 0x55bd4f663d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 4 client.15060 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.687+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bd4f5641d0 con 0x55bd4f667f30 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.688+0000 7f421de00640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f667f30 0x55bd4f663d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.689+0000 7f421de00640 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f667f30 0x55bd4f663d00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1fd4ed9729219699 server_cookie=3858deac43a36076 in_seq=0 out_seq=0 2024-03-28T05:44:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.689+0000 7f4203e00640 10 client.15060 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f4203e00640 1 -- 172.21.15.55:0/1896834813 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55bd4f5641d0 con 0x55bd4f667f30 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f4203e00640 10 client.15060 handle_command_reply: tid=0 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 client.15060 shutdown 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 msgr2=0x55bd4f5ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4208005e40 tx=0x7f42080050c0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 shutdown_connections 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55bd4f667f30 0x55bd4f663d00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bd4f5f7700 0x55bd4f602350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bd4f5f2590 0x55bd4f5ff330 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 --2- 172.21.15.55:0/1896834813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd4f5f1ba0 0x55bd4f5fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f4203e00640 0 client.15060 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 >> 172.21.15.55:0/1896834813 conn(0x55bd4f5ed110 msgr2=0x55bd4f5ed4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 shutdown_connections 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 1 -- 172.21.15.55:0/1896834813 wait complete. 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.690+0000 7f42279f5740 20 client.15060 trim_cache size 0 max 16384 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 2, 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34457, 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:44:32.697 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 95.219184202999998, 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 132.957802974 2024-03-28T05:44:32.698 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 msgr2=0x7f42040a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 0x7f42040a4d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55bd4f5f2df0 tx=0x7f4218007400 comp rx=0 tx=0).stop 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 msgr2=0x7f422019de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f421000d770 tx=0x7f421000dc30 comp rx=0 tx=0).stop 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 shutdown_connections 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f42040a2880 0x7f42040a4d40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4220109870 0x7f42201a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4220108eb0 0x7f422019e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 --2- 172.21.15.55:0/1022530771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4220107cc0 0x7f422019de90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 >> 172.21.15.55:0/1022530771 conn(0x7f4220076c60 msgr2=0x7f422010c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 shutdown_connections 2024-03-28T05:44:32.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.691+0000 7f4224e00640 1 -- 172.21.15.55:0/1022530771 wait complete. 2024-03-28T05:44:32.708 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:32 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1061101450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.708 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:32 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3350746863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-28T05:44:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1061101450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:32 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3350746863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:32 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1061101450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:32 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3350746863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:44:32.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 -- 172.21.15.55:0/320953075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 msgr2=0x7fb6f4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 --2- 172.21.15.55:0/320953075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4103d00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009ca0 tx=0x7fb6e402c100 comp rx=0 tx=0).stop 2024-03-28T05:44:32.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 -- 172.21.15.55:0/320953075 shutdown_connections 2024-03-28T05:44:32.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 --2- 172.21.15.55:0/320953075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 0x7fb6f410bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 --2- 172.21.15.55:0/320953075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 0x7fb6f4104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.924+0000 7fb6fc600640 1 --2- 172.21.15.55:0/320953075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4103d00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.925+0000 7fb6fc600640 1 -- 172.21.15.55:0/320953075 >> 172.21.15.55:0/320953075 conn(0x7fb6f40fee50 msgr2=0x7fb6f4101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.925+0000 7fb6fc600640 1 -- 172.21.15.55:0/320953075 shutdown_connections 2024-03-28T05:44:32.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.925+0000 7fb6fc600640 1 -- 172.21.15.55:0/320953075 wait complete. 2024-03-28T05:44:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.925+0000 7fb6fc600640 1 Processor -- start 2024-03-28T05:44:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 -- start start 2024-03-28T05:44:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 0x7fb6f419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 0x7fb6f41a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f410f3e0 con 0x7fb6f41038e0 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f410f260 con 0x7fb6f4104ad0 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6fc600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f410f560 con 0x7fb6f4105490 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6f9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6f9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49424/0 (socket says 172.21.15.55:49424) 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6f9c00640 1 -- 172.21.15.55:0/2338198331 learned_addr learned my addr 172.21.15.55:0/2338198331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.926+0000 7fb6f9200640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 0x7fb6f419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6fa600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 0x7fb6f41a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 -- 172.21.15.55:0/2338198331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 msgr2=0x7fb6f41a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 0x7fb6f41a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 -- 172.21.15.55:0/2338198331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 msgr2=0x7fb6f419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 0x7fb6f419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 -- 172.21.15.55:0/2338198331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f41a16e0 con 0x7fb6f41038e0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4000f80 tx=0x7fb6e4035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f2000640 1 -- 172.21.15.55:0/2338198331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4039040 con 0x7fb6f41038e0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f2000640 1 -- 172.21.15.55:0/2338198331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6e4044070 con 0x7fb6f41038e0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6f2000640 1 -- 172.21.15.55:0/2338198331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4004440 con 0x7fb6f41038e0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.927+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f41a1970 con 0x7fb6f41038e0 2024-03-28T05:44:32.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.928+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f41a1eb0 con 0x7fb6f41038e0 2024-03-28T05:44:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6f2000640 1 -- 172.21.15.55:0/2338198331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb6e40045e0 con 0x7fb6f41038e0 2024-03-28T05:44:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 Processor -- start 2024-03-28T05:44:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 -- start start 2024-03-28T05:44:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f5a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ada0 0x560659f5f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659eb6c90 con 0x560659f5ff10 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659e5f980 con 0x560659f5a3b0 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.931+0000 7fb6ff425740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659eb2d30 con 0x560659f5ada0 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49426/0 (socket says 172.21.15.55:49426) 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 -- 172.21.15.55:0/247986588 learned_addr learned my addr 172.21.15.55:0/247986588 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6fa600640 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f5a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ada0 0x560659f5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 -- 172.21.15.55:0/247986588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ada0 msgr2=0x560659f5f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ada0 0x560659f5f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 -- 172.21.15.55:0/247986588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 msgr2=0x560659f5a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f5a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 -- 172.21.15.55:0/247986588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560659e77510 con 0x560659f5ff10 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f2000640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 0x7fb6d80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.932+0000 7fb6f9200640 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009c10 tx=0x7fb6e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f70534952a780 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6f2000640 1 -- 172.21.15.55:0/2338198331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6e40f0ee0 con 0x7fb6f41038e0 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6eaa00640 1 -- 172.21.15.55:0/247986588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0012450 con 0x560659f5ff10 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6fa600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 0x7fb6d80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6eaa00640 1 -- 172.21.15.55:0/247986588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6e0012aa0 con 0x560659f5ff10 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6eaa00640 1 -- 172.21.15.55:0/247986588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000fb10 con 0x560659f5ff10 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 -- 172.21.15.55:0/247986588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 msgr2=0x560659f623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6fa600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 0x7fb6d80a4d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560659f5b600 tx=0x7fb6ec00b340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009c10 tx=0x7fb6e00117b0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 -- 172.21.15.55:0/247986588 shutdown_connections 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f623a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ada0 0x560659f5f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.933+0000 7fb6ff425740 1 --2- 172.21.15.55:0/247986588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.934+0000 7fb6ff425740 1 -- 172.21.15.55:0/247986588 >> 172.21.15.55:0/247986588 conn(0x560659f55920 msgr2=0x560659f55d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.934+0000 7fb6ff425740 1 -- 172.21.15.55:0/247986588 shutdown_connections 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.934+0000 7fb6ff425740 1 -- 172.21.15.55:0/247986588 wait complete. 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.934+0000 7fb6ff425740 1 -- start start 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.934+0000 7fb6ff425740 1 Processor -- start 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f64920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f62ec0 con 0x560659f5ada0 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659e72dd0 con 0x560659f5a3b0 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f63040 con 0x560659f5ff10 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6ff425740 10 client.0 _ll_register_callbacks cb 0x560659bcaac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49432/0 (socket says 172.21.15.55:49432) 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 -- 172.21.15.55:0/2035299855 learned_addr learned my addr 172.21.15.55:0/2035299855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f64920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 -- 172.21.15.55:0/2035299855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 msgr2=0x560659f6bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 -- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 msgr2=0x560659f64920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f64920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.935+0000 7fb6f9200640 1 -- 172.21.15.55:0/2035299855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560659bcb2d0 con 0x560659f5ada0 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6f9200640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000f4f0 tx=0x7fb6e0012e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c334106413e268 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6df400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0028070 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6e0012860 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6e0012aa0 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e0034050 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6ff425740 10 client.15072 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.936+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560659c956b0 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6e0012aa0 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb6e00054f0 con 0x560659f5ada0 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 10 client.15072 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 20 client.15072 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659f700c0 0x560659f751c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 4 client.15072 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:44:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560659e58520 con 0x560659f700c0 2024-03-28T05:44:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.937+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659f700c0 0x560659f751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.938+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659f700c0 0x560659f751c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=424973053f181909 server_cookie=b4fd3348e271f4f1 in_seq=0 out_seq=0 2024-03-28T05:44:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.938+0000 7fb6df400640 10 client.15072 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:44:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.939+0000 7fb6df400640 1 -- 172.21.15.55:0/2035299855 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560659e58520 con 0x560659f700c0 2024-03-28T05:44:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.939+0000 7fb6df400640 10 client.15072 handle_command_reply: tid=0 2024-03-28T05:44:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.939+0000 7fb6ff425740 1 client.15072 shutdown 2024-03-28T05:44:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 msgr2=0x560659f64e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000f4f0 tx=0x7fb6e0012e80 comp rx=0 tx=0).stop 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 shutdown_connections 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659f700c0 0x560659f751c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ada0 0x560659f64e60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 --2- 172.21.15.55:0/2035299855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5a3b0 0x560659f64920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6df400640 0 client.15072 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 >> 172.21.15.55:0/2035299855 conn(0x560659f55920 msgr2=0x560659f4c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 shutdown_connections 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 1 -- 172.21.15.55:0/2035299855 wait complete. 2024-03-28T05:44:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.940+0000 7fb6ff425740 20 client.15072 trim_cache size 0 max 16384 2024-03-28T05:44:32.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 Processor -- start 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 -- start start 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5a3b0 0x560659f62300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f6be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f70560 con 0x560659f5ff10 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f70bc0 con 0x560659f5ada0 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.958+0000 7fb6ff425740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f71220 con 0x560659f5a3b0 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f6be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49438/0 (socket says 172.21.15.55:49438) 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 -- 172.21.15.55:0/3125526910 learned_addr learned my addr 172.21.15.55:0/3125526910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5a3b0 0x560659f62300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 -- 172.21.15.55:0/3125526910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5a3b0 msgr2=0x560659f62300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5a3b0 0x560659f62300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 -- 172.21.15.55:0/3125526910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 msgr2=0x560659f6be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f6be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 -- 172.21.15.55:0/3125526910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560659f5b630 con 0x560659f5ff10 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6f9200640 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f6be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.959+0000 7fb6fa600640 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e570 tx=0x7fb6ec012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb35c37720947adc server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ea000640 1 -- 172.21.15.55:0/3125526910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec01d830 con 0x560659f5ff10 2024-03-28T05:44:32.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ea000640 1 -- 172.21.15.55:0/3125526910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6ec025400 con 0x560659f5ff10 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ea000640 1 -- 172.21.15.55:0/3125526910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec01c610 con 0x560659f5ff10 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 -- 172.21.15.55:0/3125526910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 msgr2=0x560659f63470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e570 tx=0x7fb6ec012040 comp rx=0 tx=0).stop 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 -- 172.21.15.55:0/3125526910 shutdown_connections 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5ff10 0x560659f63470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f6be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 --2- 172.21.15.55:0/3125526910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5a3b0 0x560659f62300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 -- 172.21.15.55:0/3125526910 >> 172.21.15.55:0/3125526910 conn(0x560659f55920 msgr2=0x560659f5b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 -- 172.21.15.55:0/3125526910 shutdown_connections 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.960+0000 7fb6ff425740 1 -- 172.21.15.55:0/3125526910 wait complete. 2024-03-28T05:44:32.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 -- start start 2024-03-28T05:44:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 Processor -- start 2024-03-28T05:44:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f68450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f71ee0 con 0x560659f5a3b0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f71880 con 0x560659f5ada0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560659f72540 con 0x560659f5ff10 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.961+0000 7fb6ff425740 10 client.0 _ll_register_callbacks cb 0x7fb6ec005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49450/0 (socket says 172.21.15.55:49450) 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f68450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 -- 172.21.15.55:0/1771579841 learned_addr learned my addr 172.21.15.55:0/1771579841 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6fa600640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 -- 172.21.15.55:0/1771579841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 msgr2=0x560659f6b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 -- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 msgr2=0x560659f68450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f68450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 -- 172.21.15.55:0/1771579841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560659f6ba60 con 0x560659f5a3b0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6f9c00640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6e402c710 tx=0x7fb6e4009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da037158c802bed8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6df400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.962+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40eee60 con 0x560659f5a3b0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6e40327c0 con 0x560659f5a3b0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6ec025400 con 0x560659f5a3b0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e40bdf40 con 0x560659f5a3b0 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 10 client.15078 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:32.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560659fccc00 con 0x560659f5a3b0 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb6ec025400 con 0x560659f5a3b0 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fb6e403c030 con 0x560659f5a3b0 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 20 client.15078 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659fd1330 0x560659fcce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 4 client.15078 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.963+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560659ec41d0 con 0x560659fd1330 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.964+0000 7fb6f9200640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659fd1330 0x560659fcce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.964+0000 7fb6f9200640 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659fd1330 0x560659fcce70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1b015b63805d02f server_cookie=1de4d5253d382da8 in_seq=0 out_seq=0 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.964+0000 7fb6df400640 10 client.15078 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:44:32.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.964+0000 7fb6df400640 1 -- 172.21.15.55:0/1771579841 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560659ec41d0 con 0x560659fd1330 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6df400640 10 client.15078 handle_command_reply: tid=0 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 client.15078 shutdown 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 msgr2=0x560659f67f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb6e402c710 tx=0x7fb6e4009670 comp rx=0 tx=0).stop 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 shutdown_connections 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x560659fd1330 0x560659fcce70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560659f5ff10 0x560659f6b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560659f5ada0 0x560659f68450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 --2- 172.21.15.55:0/1771579841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560659f5a3b0 0x560659f67f10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 >> 172.21.15.55:0/1771579841 conn(0x560659f55920 msgr2=0x560659f63470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6df400640 0 client.15078 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:44:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 shutdown_connections 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 1 -- 172.21.15.55:0/1771579841 wait complete. 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.965+0000 7fb6ff425740 20 client.15078 trim_cache size 0 max 16384 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 1, 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34490, 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:44:32.973 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 96.509523178999999, 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 121.441462714 2024-03-28T05:44:32.974 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 msgr2=0x7fb6d80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 0x7fb6d80a4d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x560659f5b600 tx=0x7fb6ec00b340 comp rx=0 tx=0).stop 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 msgr2=0x7fb6f4199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4000f80 tx=0x7fb6e4035d60 comp rx=0 tx=0).stop 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 shutdown_connections 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb6d80a2880 0x7fb6d80a4d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6f4105490 0x7fb6f41a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6f4104ad0 0x7fb6f419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 --2- 172.21.15.55:0/2338198331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f41038e0 0x7fb6f4199ac0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 >> 172.21.15.55:0/2338198331 conn(0x7fb6f40fee50 msgr2=0x7fb6f4107f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 shutdown_connections 2024-03-28T05:44:32.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:32.966+0000 7fb6fc600640 1 -- 172.21.15.55:0/2338198331 wait complete. 2024-03-28T05:44:32.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 -- 172.21.15.55:0/951908263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c103260 msgr2=0x7fe83c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 --2- 172.21.15.55:0/951908263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c103260 0x7fe83c109af0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe834009ca0 tx=0x7fe83402c100 comp rx=0 tx=0).stop 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 -- 172.21.15.55:0/951908263 shutdown_connections 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 --2- 172.21.15.55:0/951908263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c103260 0x7fe83c109af0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 --2- 172.21.15.55:0/951908263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 --2- 172.21.15.55:0/951908263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c1016b0 0x7fe83c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.183+0000 7fe841c00640 1 -- 172.21.15.55:0/951908263 >> 172.21.15.55:0/951908263 conn(0x7fe83c0fcc40 msgr2=0x7fe83c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.184+0000 7fe841c00640 1 -- 172.21.15.55:0/951908263 shutdown_connections 2024-03-28T05:44:33.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.184+0000 7fe841c00640 1 -- 172.21.15.55:0/951908263 wait complete. 2024-03-28T05:44:33.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 Processor -- start 2024-03-28T05:44:33.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 -- start start 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 0x7fe83c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10d1c0 con 0x7fe83c1016b0 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10d040 con 0x7fe83c103260 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe841c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10d340 con 0x7fe83c1028a0 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49470/0 (socket says 172.21.15.55:49470) 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.185+0000 7fe83aa00640 1 -- 172.21.15.55:0/1020037922 learned_addr learned my addr 172.21.15.55:0/1020037922 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:33.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83b400640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 0x7fe83c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe832000640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 -- 172.21.15.55:0/1020037922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 msgr2=0x7fe83c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 -- 172.21.15.55:0/1020037922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 msgr2=0x7fe83c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 0x7fe83c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 -- 172.21.15.55:0/1020037922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c19f4b0 con 0x7fe83c1016b0 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83b400640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 0x7fe83c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe832000640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:33.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe83aa00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9c0 tx=0x7fe82c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe833e00640 1 -- 172.21.15.55:0/1020037922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cd80 con 0x7fe83c1016b0 2024-03-28T05:44:33.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe833e00640 1 -- 172.21.15.55:0/1020037922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe82c0035f0 con 0x7fe83c1016b0 2024-03-28T05:44:33.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe833e00640 1 -- 172.21.15.55:0/1020037922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c010690 con 0x7fe83c1016b0 2024-03-28T05:44:33.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c19f7a0 con 0x7fe83c1016b0 2024-03-28T05:44:33.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.186+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c19fca0 con 0x7fe83c1016b0 2024-03-28T05:44:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe833e00640 1 -- 172.21.15.55:0/1020037922 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fe82c0037a0 con 0x7fe83c1016b0 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 Processor -- start 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 -- start start 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c15fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9b7ac90 con 0x555fa9c16590 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9b23980 con 0x555fa9c1b700 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.190+0000 7fe8449f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9b76d30 con 0x555fa9c15ba0 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49472/0 (socket says 172.21.15.55:49472) 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 -- 172.21.15.55:0/3937971617 learned_addr learned my addr 172.21.15.55:0/3937971617 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83b400640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c15fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe832000640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 -- 172.21.15.55:0/3937971617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 msgr2=0x555fa9c15fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c15fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 -- 172.21.15.55:0/3937971617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 msgr2=0x555fa9c1db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 -- 172.21.15.55:0/3937971617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fa9b3b510 con 0x555fa9c16590 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe832000640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe833e00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 0x7fe8200a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.191+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0d2e10 tx=0x7fe82c0d2f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef06a1dd7cf6b6e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.192+0000 7fe83b400640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 0x7fe8200a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.192+0000 7fe833e00640 1 -- 172.21.15.55:0/1020037922 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe82c0ceec0 con 0x7fe83c1016b0 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.192+0000 7fe82be00640 1 -- 172.21.15.55:0/3937971617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c097b00 con 0x555fa9c16590 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.192+0000 7fe82be00640 1 -- 172.21.15.55:0/3937971617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe82c003b30 con 0x555fa9c16590 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.192+0000 7fe82be00640 1 -- 172.21.15.55:0/3937971617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0d2a30 con 0x555fa9c16590 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- 172.21.15.55:0/3937971617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 msgr2=0x555fa9c1b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe83b400640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 0x7fe8200a4d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe83402c640 tx=0x7fe834004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0d2e10 tx=0x7fe82c0d2f00 comp rx=0 tx=0).stop 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- 172.21.15.55:0/3937971617 shutdown_connections 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c1b090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3937971617 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c15fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- 172.21.15.55:0/3937971617 >> 172.21.15.55:0/3937971617 conn(0x555fa9c11110 msgr2=0x555fa9c11510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- 172.21.15.55:0/3937971617 shutdown_connections 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- 172.21.15.55:0/3937971617 wait complete. 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 -- start start 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.193+0000 7fe8449f2740 1 Processor -- start 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c15ba0 0x555fa9c24400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c24940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c1e700 con 0x555fa9c1b700 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9b36dd0 con 0x555fa9c15ba0 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c1e880 con 0x555fa9c16590 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe8449f2740 10 client.0 _ll_register_callbacks cb 0x555fa988eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe83b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe83b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49486/0 (socket says 172.21.15.55:49486) 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe83b400640 1 -- 172.21.15.55:0/3298928543 learned_addr learned my addr 172.21.15.55:0/3298928543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.194+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c15ba0 0x555fa9c24400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe832000640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c24940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 -- 172.21.15.55:0/3298928543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 msgr2=0x555fa9c24940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c24940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 -- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c15ba0 msgr2=0x555fa9c24400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c15ba0 0x555fa9c24400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 -- 172.21.15.55:0/3298928543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fa988f2d0 con 0x555fa9c1b700 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe83b400640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe834009ca0 tx=0x7fe83402c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872742b2287cb3a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe828c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83404f070 con 0x555fa9c1b700 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe83403f640 con 0x555fa9c1b700 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.195+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fa9b1c520 con 0x555fa9c1b700 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe83405b050 con 0x555fa9c1b700 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 10 client.15090 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:33.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555fa99596b0 con 0x555fa9c1b700 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x555fa9b1c520 con 0x555fa9c1b700 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe83404a070 con 0x555fa9c1b700 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 10 client.15090 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 20 client.15090 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c30c60 0x555fa9c2fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 4 client.15090 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.196+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fa9b881d0 con 0x555fa9c30c60 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.197+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c30c60 0x555fa9c2fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.198+0000 7fe83aa00640 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c30c60 0x555fa9c2fc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=860f5b4b9c2a5b61 server_cookie=ed899f7d1668d6ec in_seq=0 out_seq=0 2024-03-28T05:44:33.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.198+0000 7fe828c00640 10 client.15090 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe828c00640 1 -- 172.21.15.55:0/3298928543 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555fa9b881d0 con 0x555fa9c30c60 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe828c00640 10 client.15090 handle_command_reply: tid=0 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 client.15090 shutdown 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 msgr2=0x555fa9c2b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe834009ca0 tx=0x7fe83402c100 comp rx=0 tx=0).stop 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 shutdown_connections 2024-03-28T05:44:33.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c30c60 0x555fa9c2fc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c1b700 0x555fa9c2b980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c24940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe828c00640 0 client.15090 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 --2- 172.21.15.55:0/3298928543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c15ba0 0x555fa9c24400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 >> 172.21.15.55:0/3298928543 conn(0x555fa9c11110 msgr2=0x555fa9c10310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 shutdown_connections 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 1 -- 172.21.15.55:0/3298928543 wait complete. 2024-03-28T05:44:33.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.200+0000 7fe8449f2740 20 client.15090 trim_cache size 0 max 16384 2024-03-28T05:44:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 Processor -- start 2024-03-28T05:44:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 -- start start 2024-03-28T05:44:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c30480 con 0x555fa9c15ba0 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c30ae0 con 0x555fa9c1b700 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.219+0000 7fe8449f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c31140 con 0x555fa9c16590 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49490/0 (socket says 172.21.15.55:49490) 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 -- 172.21.15.55:0/735876656 learned_addr learned my addr 172.21.15.55:0/735876656 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83b400640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe832000640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 -- 172.21.15.55:0/735876656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 msgr2=0x555fa9c2b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c2b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 -- 172.21.15.55:0/735876656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 msgr2=0x555fa9c1f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 -- 172.21.15.55:0/735876656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fa9c0f700 con 0x555fa9c15ba0 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83b400640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.220+0000 7fe83aa00640 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe82c003e70 tx=0x7fe82c009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f5258bc1143817 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe82b400640 1 -- 172.21.15.55:0/735876656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0b3070 con 0x555fa9c15ba0 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe82b400640 1 -- 172.21.15.55:0/735876656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe82c09f9b0 con 0x555fa9c15ba0 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe82b400640 1 -- 172.21.15.55:0/735876656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c09b1c0 con 0x555fa9c15ba0 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 -- 172.21.15.55:0/735876656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 msgr2=0x555fa9c0bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe82c003e70 tx=0x7fe82c009700 comp rx=0 tx=0).stop 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 -- 172.21.15.55:0/735876656 shutdown_connections 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c16590 0x555fa9c2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 --2- 172.21.15.55:0/735876656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c15ba0 0x555fa9c0bfc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 -- 172.21.15.55:0/735876656 >> 172.21.15.55:0/735876656 conn(0x555fa9c11110 msgr2=0x555fa9c2fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 -- 172.21.15.55:0/735876656 shutdown_connections 2024-03-28T05:44:33.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.221+0000 7fe8449f2740 1 -- 172.21.15.55:0/735876656 wait complete. 2024-03-28T05:44:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 -- start start 2024-03-28T05:44:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 Processor -- start 2024-03-28T05:44:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c27b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c2ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c31e00 con 0x555fa9c16590 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c317a0 con 0x555fa9c1b700 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fa9c32460 con 0x555fa9c15ba0 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.222+0000 7fe8449f2740 10 client.0 _ll_register_callbacks cb 0x7fe834037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49494/0 (socket says 172.21.15.55:49494) 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 -- 172.21.15.55:0/4288693014 learned_addr learned my addr 172.21.15.55:0/4288693014 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:33.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe83b400640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c2ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 -- 172.21.15.55:0/4288693014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 msgr2=0x555fa9c27b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c27b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 -- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 msgr2=0x555fa9c2ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c2ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 -- 172.21.15.55:0/4288693014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fa9c2b450 con 0x555fa9c16590 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe832000640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe824005fd0 tx=0x7fe8240127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15c66358d05af15 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe828c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824004220 con 0x555fa9c16590 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.223+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe8240043c0 con 0x555fa9c16590 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe82c09f9b0 con 0x555fa9c16590 2024-03-28T05:44:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe824005020 con 0x555fa9c16590 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 10 client.15096 fetch_fsmap learned FSMap version 23 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555fa9c8c6a0 con 0x555fa9c16590 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe82c09f9b0 con 0x555fa9c16590 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe824019070 con 0x555fa9c16590 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 10 client.15096 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 10 client.15096 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 20 client.15096 populate_metadata read hostname 'smithi055' 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c90e30 0x555fa9c8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 4 client.15096 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.224+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555fa9b82520 con 0x555fa9c90e30 2024-03-28T05:44:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.225+0000 7fe83aa00640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c90e30 0x555fa9c8c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.225+0000 7fe83aa00640 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c90e30 0x555fa9c8c9e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d66aa82691d8ff server_cookie=fa9976bff82466b0 in_seq=0 out_seq=0 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe828c00640 10 client.15096 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe828c00640 1 -- 172.21.15.55:0/4288693014 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555fa9b82520 con 0x555fa9c90e30 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe828c00640 10 client.15096 handle_command_reply: tid=0 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 client.15096 shutdown 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 msgr2=0x555fa9c28130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe824005fd0 tx=0x7fe8240127c0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 shutdown_connections 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fa9c90e30 0x555fa9c8c9e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fa9c1b700 0x555fa9c2ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fa9c16590 0x555fa9c28130 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 --2- 172.21.15.55:0/4288693014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fa9c15ba0 0x555fa9c27b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 >> 172.21.15.55:0/4288693014 conn(0x555fa9c11110 msgr2=0x555fa9c1af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.226+0000 7fe828c00640 0 client.15096 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 shutdown_connections 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe8449f2740 1 -- 172.21.15.55:0/4288693014 wait complete. 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe8449f2740 20 client.15096 trim_cache size 0 max 16384 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:44:33.234 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34535, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 100.16056623199999, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 105.880505773 2024-03-28T05:44:33.235 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:44:33.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 msgr2=0x7fe8200a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 0x7fe8200a4d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe83402c640 tx=0x7fe834004a40 comp rx=0 tx=0).stop 2024-03-28T05:44:33.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 msgr2=0x7fe83c197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:33.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9c0 tx=0x7fe82c00ee80 comp rx=0 tx=0).stop 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 shutdown_connections 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe8200a2880 0x7fe8200a4d40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe83c103260 0x7fe83c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe83c1028a0 0x7fe83c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 --2- 172.21.15.55:0/1020037922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe83c1016b0 0x7fe83c197890 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.227+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 >> 172.21.15.55:0/1020037922 conn(0x7fe83c0fcc40 msgr2=0x7fe83c105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.228+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 shutdown_connections 2024-03-28T05:44:33.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:33.228+0000 7fe841c00640 1 -- 172.21.15.55:0/1020037922 wait complete. 2024-03-28T05:44:33.246 INFO:tasks.cephadm:Setup complete, yielding 2024-03-28T05:44:33.246 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-28T05:44:33.257 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi055.front.sepia.ceph.com 2024-03-28T05:44:33.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph orch status' 2024-03-28T05:44:33.703 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:33 smithi086 ceph-mon[35163]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-28T05:44:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:33 smithi159 ceph-mon[36109]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-28T05:44:33.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:33 smithi055 ceph-mon[31863]: pgmap v419: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-28T05:44:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:35 smithi055 ceph-mon[31863]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-28T05:44:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:35 smithi086 ceph-mon[35163]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-28T05:44:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:35 smithi159 ceph-mon[36109]: pgmap v420: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 -- 172.21.15.55:0/3038332651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888105610 msgr2=0x7fd888105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 --2- 172.21.15.55:0/3038332651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888105610 0x7fd888105a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8740099c0 tx=0x7fd874009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 -- 172.21.15.55:0/3038332651 shutdown_connections 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 --2- 172.21.15.55:0/3038332651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888104410 0x7fd888104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 --2- 172.21.15.55:0/3038332651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 0x7fd88810c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 --2- 172.21.15.55:0/3038332651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888105610 0x7fd888105a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 -- 172.21.15.55:0/3038332651 >> 172.21.15.55:0/3038332651 conn(0x7fd8880ff9b0 msgr2=0x7fd888101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 -- 172.21.15.55:0/3038332651 shutdown_connections 2024-03-28T05:44:35.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.832+0000 7fd88fc00700 1 -- 172.21.15.55:0/3038332651 wait complete. 2024-03-28T05:44:35.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.833+0000 7fd88fc00700 1 Processor -- start 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 -- start start 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888104410 0x7fd88819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 0x7fd8881a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810fee0 con 0x7fd888105610 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810fd60 con 0x7fd888104410 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88fc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888110060 con 0x7fd888105fb0 2024-03-28T05:44:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd887e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd887e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49520/0 (socket says 172.21.15.55:49520) 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd88d200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888104410 0x7fd88819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.834+0000 7fd887e00700 1 -- 172.21.15.55:0/822241223 learned_addr learned my addr 172.21.15.55:0/822241223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd88dc00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 0x7fd8881a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 -- 172.21.15.55:0/822241223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 msgr2=0x7fd8881a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 0x7fd8881a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 -- 172.21.15.55:0/822241223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888104410 msgr2=0x7fd88819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888104410 0x7fd88819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 -- 172.21.15.55:0/822241223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8881a2140 con 0x7fd888105610 2024-03-28T05:44:35.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd887e00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd874005910 tx=0x7fd874003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.835+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874009e60 con 0x7fd888105610 2024-03-28T05:44:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.836+0000 7fd88fc00700 1 -- 172.21.15.55:0/822241223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8881a23d0 con 0x7fd888105610 2024-03-28T05:44:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.836+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd87400f460 con 0x7fd888105610 2024-03-28T05:44:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.836+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874017650 con 0x7fd888105610 2024-03-28T05:44:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.836+0000 7fd88fc00700 1 -- 172.21.15.55:0/822241223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8881a2880 con 0x7fd888105610 2024-03-28T05:44:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.837+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864005330 con 0x7fd888105610 2024-03-28T05:44:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.839+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd87400f610 con 0x7fd888105610 2024-03-28T05:44:35.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.840+0000 7fd885600700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 0x7fd8700a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:35.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.840+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd8740cf980 con 0x7fd888105610 2024-03-28T05:44:35.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.841+0000 7fd88d200700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 0x7fd8700a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:35.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.841+0000 7fd88d200700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 0x7fd8700a4d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009680 tx=0x7fd87c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:35.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:35.845+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd874013070 con 0x7fd888105610 2024-03-28T05:44:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.091+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd864000bc0 con 0x7fd8700a2890 2024-03-28T05:44:36.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.093+0000 7fd885600700 1 -- 172.21.15.55:0/822241223 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd864000bc0 con 0x7fd8700a2890 2024-03-28T05:44:36.095 INFO:teuthology.orchestra.run.smithi055.stdout:Backend: cephadm 2024-03-28T05:44:36.095 INFO:teuthology.orchestra.run.smithi055.stdout:Available: Yes 2024-03-28T05:44:36.095 INFO:teuthology.orchestra.run.smithi055.stdout:Paused: No 2024-03-28T05:44:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.096+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 msgr2=0x7fd8700a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.096+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 0x7fd8700a4d50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009680 tx=0x7fd87c009260 comp rx=0 tx=0).stop 2024-03-28T05:44:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.096+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 msgr2=0x7fd88819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.096+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd874005910 tx=0x7fd874003e60 comp rx=0 tx=0).stop 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 shutdown_connections 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd8700a2890 0x7fd8700a4d50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd888105fb0 0x7fd8881a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd888104410 0x7fd88819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 --2- 172.21.15.55:0/822241223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd888105610 0x7fd88819aac0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 >> 172.21.15.55:0/822241223 conn(0x7fd8880ff9b0 msgr2=0x7fd888108910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 shutdown_connections 2024-03-28T05:44:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:36.097+0000 7fd87aa00700 1 -- 172.21.15.55:0/822241223 wait complete. 2024-03-28T05:44:36.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-28T05:44:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:37 smithi086 ceph-mon[35163]: pgmap v421: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:37 smithi086 ceph-mon[35163]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:37 smithi159 ceph-mon[36109]: pgmap v421: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:37 smithi159 ceph-mon[36109]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:37.841 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:37 smithi055 ceph-mon[31863]: pgmap v421: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:37.841 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:37 smithi055 ceph-mon[31863]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:39.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.497+0000 7f3eab200700 1 -- 172.21.15.55:0/3501149257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 msgr2=0x7f3ea410a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 --2- 172.21.15.55:0/3501149257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea410a620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b0d0 tx=0x7f3e9c00b3e0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 -- 172.21.15.55:0/3501149257 shutdown_connections 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 --2- 172.21.15.55:0/3501149257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea410a620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 --2- 172.21.15.55:0/3501149257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea41025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 --2- 172.21.15.55:0/3501149257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 0x7f3ea4103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 -- 172.21.15.55:0/3501149257 >> 172.21.15.55:0/3501149257 conn(0x7f3ea40fd730 msgr2=0x7f3ea40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 -- 172.21.15.55:0/3501149257 shutdown_connections 2024-03-28T05:44:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.498+0000 7f3eab200700 1 -- 172.21.15.55:0/3501149257 wait complete. 2024-03-28T05:44:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.499+0000 7f3eab200700 1 Processor -- start 2024-03-28T05:44:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 -- start start 2024-03-28T05:44:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 0x7f3ea41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea410dd20 con 0x7f3ea4103d70 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea410dba0 con 0x7f3ea41021d0 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.500+0000 7f3eab200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea410dea0 con 0x7f3ea41033d0 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea3e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:33350/0 (socket says 172.21.15.55:33350) 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33102/0 (socket says 172.21.15.55:33102) 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea3e00700 1 -- 172.21.15.55:0/2264105676 learned_addr learned my addr 172.21.15.55:0/2264105676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea3400700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 0x7f3ea41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 -- 172.21.15.55:0/2264105676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 msgr2=0x7f3ea41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 0x7f3ea41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 -- 172.21.15.55:0/2264105676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 msgr2=0x7f3ea4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.501+0000 7f3ea9200700 1 -- 172.21.15.55:0/2264105676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea419ffc0 con 0x7f3ea4103d70 2024-03-28T05:44:39.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3ea9200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009fd0 tx=0x7f3e9c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c021030 con 0x7f3ea4103d70 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3e9c003a00 con 0x7f3ea4103d70 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0046e0 con 0x7f3ea4103d70 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea41a0250 con 0x7f3ea4103d70 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.502+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea41a0700 con 0x7f3ea4103d70 2024-03-28T05:44:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.504+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4068e50 con 0x7f3ea4103d70 2024-03-28T05:44:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.505+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3e9c024070 con 0x7f3ea4103d70 2024-03-28T05:44:39.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.508+0000 7f3ea0c00700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 0x7f3e880a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:39.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.508+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3e9c00f020 con 0x7f3ea4103d70 2024-03-28T05:44:39.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.508+0000 7f3ea3e00700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 0x7f3e880a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.509+0000 7f3ea3e00700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 0x7f3e880a4d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e94007cf0 tx=0x7f3e94007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.512+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f3e9c09bfa0 con 0x7f3ea4103d70 2024-03-28T05:44:39.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.756+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea40625d0 con 0x7f3e880a2890 2024-03-28T05:44:39.757 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:39 smithi055 ceph-mon[31863]: pgmap v422: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.a smithi055 running (116s) 21s ago 116s 12.2M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 3d1ce2c9b3d9 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.b smithi086 running (112s) 40s ago 112s 24.7M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 9bf966e88f6c 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.c smithi159 running (2m) 41s ago 2m 15.4M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 10e6346e7320 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.d smithi055 running (2m) 21s ago 2m 12.5M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 2a233a2c19e8 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.e smithi086 running (2m) 40s ago 2m 16.7M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 afecc766db39 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.f smithi159 running (2m) 41s ago 2m 12.4M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 c0fd60913477 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.g smithi055 running (2m) 21s ago 2m 12.3M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 7fcfb84c1714 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.h smithi086 running (2m) 40s ago 2m 16.8M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 490a14aa361d 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.i smithi159 running (2m) 41s ago 2m 15.4M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 cc3bbb7fc4de 2024-03-28T05:44:39.787 INFO:teuthology.orchestra.run.smithi055.stdout:mds.j smithi055 running (2m) 21s ago 2m 12.5M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 686e2d0e0ae4 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mds.k smithi086 running (2m) 40s ago 2m 16.9M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 65bbeb2d09f0 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mds.l smithi159 running (2m) 41s ago 2m 12.5M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 44b9a45f9970 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.x smithi055 *:9283,8765 running (12m) 21s ago 12m 514M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 3b0dc23314f1 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.y smithi086 *:8443,8765 running (9m) 40s ago 9m 451M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 34a1e06d02ce 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mgr.z smithi159 *:8443,8765 running (9m) 41s ago 9m 451M - 19.0.0-2145-g3be9a5c9 c664afe56bb0 c7c1e9f9764e 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mon.a smithi055 running (12m) 21s ago 12m 51.2M 2048M 19.0.0-2145-g3be9a5c9 c664afe56bb0 714d91b7a4b4 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mon.b smithi086 running (10m) 40s ago 10m 39.6M 2048M 19.0.0-2145-g3be9a5c9 c664afe56bb0 1fd6574df6a5 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:mon.c smithi159 running (10m) 41s ago 10m 40.2M 2048M 19.0.0-2145-g3be9a5c9 c664afe56bb0 81b684f93473 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 smithi055 running (9m) 21s ago 9m 47.9M 4273M 19.0.0-2145-g3be9a5c9 c664afe56bb0 704dfce0e110 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 smithi086 running (8m) 40s ago 8m 48.4M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 b771557c22de 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 smithi159 running (8m) 41s ago 8m 55.6M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 0c401e939d7d 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 smithi055 running (7m) 21s ago 7m 45.8M 4273M 19.0.0-2145-g3be9a5c9 c664afe56bb0 eaab8df16b22 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 smithi086 running (7m) 40s ago 7m 43.6M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 842e2af633e3 2024-03-28T05:44:39.788 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 smithi159 running (6m) 41s ago 6m 53.2M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 c148c7794636 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.6 smithi055 running (5m) 21s ago 5m 51.3M 4273M 19.0.0-2145-g3be9a5c9 c664afe56bb0 b91057974e98 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.7 smithi086 running (5m) 40s ago 5m 53.8M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 42c419fff3f3 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.8 smithi159 running (4m) 41s ago 4m 52.4M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 2f0012d23612 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.9 smithi055 running (4m) 21s ago 4m 50.3M 4273M 19.0.0-2145-g3be9a5c9 c664afe56bb0 255670d39ba1 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.10 smithi086 running (3m) 40s ago 3m 53.3M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 5e92e93439f8 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stdout:osd.11 smithi159 running (2m) 41s ago 2m 48.3M 4272M 19.0.0-2145-g3be9a5c9 c664afe56bb0 9ac32bf4334f 2024-03-28T05:44:39.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.785+0000 7f3ea0c00700 1 -- 172.21.15.55:0/2264105676 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f3ea40625d0 con 0x7f3e880a2890 2024-03-28T05:44:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 msgr2=0x7f3e880a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 0x7f3e880a4d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e94007cf0 tx=0x7f3e94007480 comp rx=0 tx=0).stop 2024-03-28T05:44:39.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 msgr2=0x7f3ea419f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009fd0 tx=0x7f3e9c004c80 comp rx=0 tx=0).stop 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 shutdown_connections 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3e880a2890 0x7f3e880a4d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ea4103d70 0x7f3ea419f920 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ea41021d0 0x7f3ea4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 --2- 172.21.15.55:0/2264105676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ea41033d0 0x7f3ea41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.789+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 >> 172.21.15.55:0/2264105676 conn(0x7f3ea40fd730 msgr2=0x7f3ea41066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.790+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 shutdown_connections 2024-03-28T05:44:39.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:39.790+0000 7f3eab200700 1 -- 172.21.15.55:0/2264105676 wait complete. 2024-03-28T05:44:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:39 smithi086 ceph-mon[35163]: pgmap v422: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:39 smithi159 ceph-mon[36109]: pgmap v422: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:40.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-28T05:44:41.109 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:41 smithi086 ceph-mon[35163]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:41 smithi086 ceph-mon[35163]: pgmap v423: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:41 smithi159 ceph-mon[36109]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:41.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:41 smithi159 ceph-mon[36109]: pgmap v423: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:41 smithi055 ceph-mon[31863]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:41 smithi055 ceph-mon[31863]: pgmap v423: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 -- 172.21.15.55:0/263787859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 msgr2=0x7f911c1008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 --2- 172.21.15.55:0/263787859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c1008f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f910c009990 tx=0x7f910c009ca0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 -- 172.21.15.55:0/263787859 shutdown_connections 2024-03-28T05:44:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 --2- 172.21.15.55:0/263787859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c1008f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 --2- 172.21.15.55:0/263787859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 0x7f911c10a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 --2- 172.21.15.55:0/263787859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 0x7f911c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 -- 172.21.15.55:0/263787859 >> 172.21.15.55:0/263787859 conn(0x7f911c0fbe30 msgr2=0x7f911c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 -- 172.21.15.55:0/263787859 shutdown_connections 2024-03-28T05:44:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.384+0000 7f9121e00700 1 -- 172.21.15.55:0/263787859 wait complete. 2024-03-28T05:44:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.385+0000 7f9121e00700 1 Processor -- start 2024-03-28T05:44:43.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.385+0000 7f9121e00700 1 -- start start 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 0x7f911c101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 0x7f911c101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c10dcc0 con 0x7f911c1004d0 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c10db40 con 0x7f911c103ef0 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f9121e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c10de40 con 0x7f911c103550 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f911aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f911aa00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33118/0 (socket says 172.21.15.55:33118) 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f911aa00700 1 -- 172.21.15.55:0/3510662833 learned_addr learned my addr 172.21.15.55:0/3510662833 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f911b400700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 0x7f911c101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.386+0000 7f911a000700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 0x7f911c101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 -- 172.21.15.55:0/3510662833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 msgr2=0x7f911c101500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 0x7f911c101500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 -- 172.21.15.55:0/3510662833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 msgr2=0x7f911c101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 0x7f911c101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 -- 172.21.15.55:0/3510662833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c1022f0 con 0x7f911c1004d0 2024-03-28T05:44:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f911aa00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f910c000c00 tx=0x7f910c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c027070 con 0x7f911c1004d0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c1a2490 con 0x7f911c1004d0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f910c004150 con 0x7f911c1004d0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.387+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f460 con 0x7f911c1004d0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.388+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c1a2890 con 0x7f911c1004d0 2024-03-28T05:44:43.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.389+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c068e50 con 0x7f911c1004d0 2024-03-28T05:44:43.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.391+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f910c02a070 con 0x7f911c1004d0 2024-03-28T05:44:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.392+0000 7f9120a00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 0x7f91000a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.392+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f910c0cfa60 con 0x7f911c1004d0 2024-03-28T05:44:43.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.392+0000 7f911a000700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 0x7f91000a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:43.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.393+0000 7f911a000700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 0x7f91000a4d50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9108005fd0 tx=0x7f910800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:43.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.397+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f910c05e740 con 0x7f911c1004d0 2024-03-28T05:44:43.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.637+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f911c0625d0 con 0x7f91000a2890 2024-03-28T05:44:43.638 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:43 smithi055 ceph-mon[31863]: pgmap v424: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:43.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.655+0000 7f9120a00700 1 -- 172.21.15.55:0/3510662833 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f911c0625d0 con 0x7f91000a2890 2024-03-28T05:44:43.656 INFO:teuthology.orchestra.run.smithi055.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-28T05:44:43.657 INFO:teuthology.orchestra.run.smithi055.stdout:mds.all 12/12 44s ago 2m smithi055=a;smithi055=d;smithi055=g;smithi055=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-03-28T05:44:43.657 INFO:teuthology.orchestra.run.smithi055.stdout:mgr 3/3 44s ago 9m smithi055=x;smithi086=y;smithi159=z;count:3 2024-03-28T05:44:43.657 INFO:teuthology.orchestra.run.smithi055.stdout:mon 3/3 44s ago 10m smithi055:172.21.15.55=a;smithi086:172.21.15.86=b;smithi159:172.21.15.159=c;count:3 2024-03-28T05:44:43.657 INFO:teuthology.orchestra.run.smithi055.stdout:osd 12 44s ago - 2024-03-28T05:44:43.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 msgr2=0x7f91000a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 0x7f91000a4d50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9108005fd0 tx=0x7f910800a560 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 msgr2=0x7f911c102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f910c000c00 tx=0x7f910c0057c0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 shutdown_connections 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f91000a2890 0x7f91000a4d50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f911c1004d0 0x7f911c102eb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f911c103ef0 0x7f911c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 --2- 172.21.15.55:0/3510662833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f911c103550 0x7f911c101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:43.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.658+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 >> 172.21.15.55:0/3510662833 conn(0x7f911c0fbe30 msgr2=0x7f911c1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:43.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.659+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 shutdown_connections 2024-03-28T05:44:43.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:43.659+0000 7f9121e00700 1 -- 172.21.15.55:0/3510662833 wait complete. 2024-03-28T05:44:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:43 smithi086 ceph-mon[35163]: pgmap v424: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:43 smithi159 ceph-mon[36109]: pgmap v424: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:44.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-28T05:44:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:44 smithi055 ceph-mon[31863]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:44 smithi086 ceph-mon[35163]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:44 smithi159 ceph-mon[36109]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:44.912 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:45 smithi055 ceph-mon[31863]: pgmap v425: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:45 smithi159 ceph-mon[36109]: pgmap v425: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:45 smithi086 ceph-mon[35163]: pgmap v425: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:47.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 -- 172.21.15.55:0/1590694824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14741021c0 msgr2=0x7f14741025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 --2- 172.21.15.55:0/1590694824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14741021c0 0x7f14741025e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f14640099c0 tx=0x7f1464009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 -- 172.21.15.55:0/1590694824 shutdown_connections 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 --2- 172.21.15.55:0/1590694824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14741021c0 0x7f14741025e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 --2- 172.21.15.55:0/1590694824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1474103d60 0x7f147410a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 --2- 172.21.15.55:0/1590694824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741033c0 0x7f1474103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 -- 172.21.15.55:0/1590694824 >> 172.21.15.55:0/1590694824 conn(0x7f14740fd7a0 msgr2=0x7f14740ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 -- 172.21.15.55:0/1590694824 shutdown_connections 2024-03-28T05:44:47.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.096+0000 7f1479400700 1 -- 172.21.15.55:0/1590694824 wait complete. 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.097+0000 7f1479400700 1 Processor -- start 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.097+0000 7f1479400700 1 -- start start 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741021c0 0x7f147419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 0x7f147419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147410dd00 con 0x7f1474103d60 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147410db80 con 0x7f14741033c0 2024-03-28T05:44:47.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1479400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147410de80 con 0x7f14741021c0 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33138/0 (socket says 172.21.15.55:33138) 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 -- 172.21.15.55:0/1579851559 learned_addr learned my addr 172.21.15.55:0/1579851559 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1471e00700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 0x7f147419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1472800700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741021c0 0x7f147419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 -- 172.21.15.55:0/1579851559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741021c0 msgr2=0x7f147419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741021c0 0x7f147419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 -- 172.21.15.55:0/1579851559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 msgr2=0x7f147419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 0x7f147419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1473200700 1 -- 172.21.15.55:0/1579851559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14741a2270 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.098+0000 7f1471e00700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 0x7f147419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f1473200700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f146c007f10 tx=0x7f146c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c004bb0 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14741a2560 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f146c004d50 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c005990 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.099+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14741a2ad0 con 0x7f1474103d60 2024-03-28T05:44:47.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.100+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1474068e50 con 0x7f1474103d60 2024-03-28T05:44:47.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.102+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f146c01a020 con 0x7f1474103d60 2024-03-28T05:44:47.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.104+0000 7f146b400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 0x7f14580a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:47.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.104+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f146c0ce340 con 0x7f1474103d60 2024-03-28T05:44:47.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.104+0000 7f1472800700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 0x7f14580a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:47.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.105+0000 7f1472800700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 0x7f14580a4d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1464000c00 tx=0x7f1464005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:47.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.109+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f146c010070 con 0x7f1474103d60 2024-03-28T05:44:47.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.342+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f147410a300 con 0x7f14580a2890 2024-03-28T05:44:47.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.346+0000 7f146b400700 1 -- 172.21.15.55:0/1579851559 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f147410a300 con 0x7f14580a2890 2024-03-28T05:44:47.347 INFO:teuthology.orchestra.run.smithi055.stdout:HOST ADDR LABELS STATUS 2024-03-28T05:44:47.347 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055 172.21.15.55 2024-03-28T05:44:47.347 INFO:teuthology.orchestra.run.smithi055.stdout:smithi086 172.21.15.86 2024-03-28T05:44:47.347 INFO:teuthology.orchestra.run.smithi055.stdout:smithi159 172.21.15.159 2024-03-28T05:44:47.348 INFO:teuthology.orchestra.run.smithi055.stdout:3 hosts in cluster 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 msgr2=0x7f14580a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 0x7f14580a4d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1464000c00 tx=0x7f1464005fb0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 msgr2=0x7f14741a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f146c007f10 tx=0x7f146c00d3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 shutdown_connections 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14580a2890 0x7f14580a4d50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1474103d60 0x7f14741a1bd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14741021c0 0x7f147419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 --2- 172.21.15.55:0/1579851559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14741033c0 0x7f147419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:47.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 >> 172.21.15.55:0/1579851559 conn(0x7f14740fd7a0 msgr2=0x7f1474108be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:47.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.349+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 shutdown_connections 2024-03-28T05:44:47.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:47.350+0000 7f1479400700 1 -- 172.21.15.55:0/1579851559 wait complete. 2024-03-28T05:44:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:47 smithi055 ceph-mon[31863]: pgmap v426: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:47 smithi086 ceph-mon[35163]: pgmap v426: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:47 smithi159 ceph-mon[36109]: pgmap v426: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:48.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-28T05:44:48.591 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:48 smithi055 ceph-mon[31863]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:48 smithi086 ceph-mon[35163]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:48 smithi159 ceph-mon[36109]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:49.858 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:49 smithi055 ceph-mon[31863]: pgmap v427: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:49 smithi086 ceph-mon[35163]: pgmap v427: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:49 smithi159 ceph-mon[36109]: pgmap v427: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:50.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1143316899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca0108810 msgr2=0x7f2ca0108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1143316899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca0108810 0x7f2ca0108c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2c900099c0 tx=0x7f2c90009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1143316899 shutdown_connections 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1143316899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca0108810 0x7f2ca0108c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1143316899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca010a3b0 0x7f2ca0110c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1143316899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 0x7f2ca0109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1143316899 >> 172.21.15.55:0/1143316899 conn(0x7f2ca00777e0 msgr2=0x7f2ca0079c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.689+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1143316899 shutdown_connections 2024-03-28T05:44:50.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.690+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1143316899 wait complete. 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 Processor -- start 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 -- start start 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 0x7f2ca019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 0x7f2ca019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:50.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01142f0 con 0x7f2ca010a3b0 2024-03-28T05:44:50.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0114170 con 0x7f2ca0109a10 2024-03-28T05:44:50.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2ca4a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0114470 con 0x7f2ca0108810 2024-03-28T05:44:50.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.691+0000 7f2c9e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44020/0 (socket says 172.21.15.55:44020) 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 -- 172.21.15.55:0/1506123968 learned_addr learned my addr 172.21.15.55:0/1506123968 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c97e00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 0x7f2ca019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9de00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 0x7f2ca019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 -- 172.21.15.55:0/1506123968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 msgr2=0x7f2ca019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 0x7f2ca019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 -- 172.21.15.55:0/1506123968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 msgr2=0x7f2ca019ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 0x7f2ca019ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 -- 172.21.15.55:0/1506123968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca01a6590 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9de00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 0x7f2ca019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.692+0000 7f2c9e800700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c98007f10 tx=0x7f2c9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.693+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98004bb0 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.693+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2c98004d50 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.693+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98005990 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.693+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca01a6880 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.693+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca01a6d70 con 0x7f2ca010a3b0 2024-03-28T05:44:50.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.694+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0068e50 con 0x7f2ca010a3b0 2024-03-28T05:44:50.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.696+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f2c9801a020 con 0x7f2ca010a3b0 2024-03-28T05:44:50.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.699+0000 7f2c96a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 0x7f2c840a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:50.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.699+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2c980cdd20 con 0x7f2ca010a3b0 2024-03-28T05:44:50.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.699+0000 7f2c9de00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 0x7f2c840a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:50.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.700+0000 7f2c9de00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 0x7f2c840a4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000b580 tx=0x7f2c90005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.703+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f2c98010070 con 0x7f2ca010a3b0 2024-03-28T05:44:50.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.943+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ca00625d0 con 0x7f2c840a2910 2024-03-28T05:44:50.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.947+0000 7f2c96a00700 1 -- 172.21.15.55:0/1506123968 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f2ca00625d0 con 0x7f2c840a2910 2024-03-28T05:44:50.948 INFO:teuthology.orchestra.run.smithi055.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-28T05:44:50.949 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102VS4P0KGN 3726G No 4m ago Has a FileSystem, LVM detected 2024-03-28T05:44:50.949 INFO:teuthology.orchestra.run.smithi055.stdout:smithi086 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UL400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-28T05:44:50.949 INFO:teuthology.orchestra.run.smithi055.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-28T05:44:50.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 msgr2=0x7f2c840a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:50.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 0x7f2c840a4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000b580 tx=0x7f2c90005fb0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 msgr2=0x7f2ca01a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:50.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c98007f10 tx=0x7f2c9800d3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 shutdown_connections 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2c840a2910 0x7f2c840a4dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca010a3b0 0x7f2ca01a5ef0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ca0108810 0x7f2ca019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 --2- 172.21.15.55:0/1506123968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ca0109a10 0x7f2ca019ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.950+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 >> 172.21.15.55:0/1506123968 conn(0x7f2ca00777e0 msgr2=0x7f2ca010cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.951+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 shutdown_connections 2024-03-28T05:44:50.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:50.951+0000 7f2ca4a00700 1 -- 172.21.15.55:0/1506123968 wait complete. 2024-03-28T05:44:51.659 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-28T05:44:51.667 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi055.front.sepia.ceph.com 2024-03-28T05:44:51.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-28T05:44:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:51 smithi055 ceph-mon[31863]: pgmap v428: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:51 smithi086 ceph-mon[35163]: pgmap v428: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:51 smithi159 ceph-mon[36109]: pgmap v428: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:44:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:52 smithi055 ceph-mon[31863]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:52 smithi086 ceph-mon[35163]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:52 smithi159 ceph-mon[36109]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-28T05:44:53.724 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:53 smithi055 ceph-mon[31863]: pgmap v429: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:53 smithi086 ceph-mon[35163]: pgmap v429: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:53 smithi159 ceph-mon[36109]: pgmap v429: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 -- 172.21.15.55:0/3952134248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0104410 msgr2=0x7feed0104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 --2- 172.21.15.55:0/3952134248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0104410 0x7feed0104830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feec40099c0 tx=0x7feec4009cd0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 -- 172.21.15.55:0/3952134248 shutdown_connections 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 --2- 172.21.15.55:0/3952134248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0104410 0x7feed0104830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 --2- 172.21.15.55:0/3952134248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105fb0 0x7feed010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 --2- 172.21.15.55:0/3952134248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0105610 0x7feed0105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 -- 172.21.15.55:0/3952134248 >> 172.21.15.55:0/3952134248 conn(0x7feed00ff9b0 msgr2=0x7feed0101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 -- 172.21.15.55:0/3952134248 shutdown_connections 2024-03-28T05:44:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.234+0000 7feed8200700 1 -- 172.21.15.55:0/3952134248 wait complete. 2024-03-28T05:44:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.235+0000 7feed8200700 1 Processor -- start 2024-03-28T05:44:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.235+0000 7feed8200700 1 -- start start 2024-03-28T05:44:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0104410 0x7feed019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105610 0x7feed019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:54.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed010fee0 con 0x7feed0105fb0 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed010fd60 con 0x7feed0105610 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed8200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0110060 con 0x7feed0104410 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed6200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed6200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44042/0 (socket says 172.21.15.55:44042) 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed6200700 1 -- 172.21.15.55:0/3234983994 learned_addr learned my addr 172.21.15.55:0/3234983994 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.236+0000 7feed4e00700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105610 0x7feed019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed5800700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0104410 0x7feed019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 -- 172.21.15.55:0/3234983994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0104410 msgr2=0x7feed019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0104410 0x7feed019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 -- 172.21.15.55:0/3234983994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105610 msgr2=0x7feed019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105610 0x7feed019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 -- 172.21.15.55:0/3234983994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed01a2130 con 0x7feed0105fb0 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed6200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7feec8007f10 tx=0x7feec800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8004bb0 con 0x7feed0105fb0 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed01a2420 con 0x7feed0105fb0 2024-03-28T05:44:54.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7feec8004d50 con 0x7feed0105fb0 2024-03-28T05:44:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.237+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8005990 con 0x7feed0105fb0 2024-03-28T05:44:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.238+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed01a2910 con 0x7feed0105fb0 2024-03-28T05:44:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.239+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed0068e50 con 0x7feed0105fb0 2024-03-28T05:44:54.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.241+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7feec801a020 con 0x7feed0105fb0 2024-03-28T05:44:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.242+0000 7feece000700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 0x7feeb80a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.242+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7feec80ce2c0 con 0x7feed0105fb0 2024-03-28T05:44:54.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.242+0000 7feed5800700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 0x7feeb80a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:54.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.243+0000 7feed5800700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 0x7feeb80a4d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feec40038f0 tx=0x7feec4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:54.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.247+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7feec8010070 con 0x7feed0105fb0 2024-03-28T05:44:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.524+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feed0062da0 con 0x7feed0105fb0 2024-03-28T05:44:54.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.525+0000 7feece000700 1 -- 172.21.15.55:0/3234983994 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2985 (secure 0 0 0) 0x7feec8085070 con 0x7feed0105fb0 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:e23 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:legacy client fscid: 1 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:Filesystem 'cephfs' (1) 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:fs_name cephfs 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 23 2024-03-28T05:44:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-03-28T05:42:52.123648+0000 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-03-28T05:42:57.977747+0000 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:tableserver 0 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:root 0 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:session_timeout 300 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:session_autoclose 300 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:max_file_size 1099511627776 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:max_xattr_size 65536 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:required_client_features {} 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure 0 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:last_failure_osd_epoch 0 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-28T05:44:54.528 INFO:teuthology.orchestra.run.smithi055.stdout:max_mds 3 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:in 0,1,2 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:up {0=34535,1=34490,2=34457} 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:failed 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:damaged 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:stopped 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:data_pools [3] 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:metadata_pool 2 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:inline_data disabled 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:balancer 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:bal_rank_mask -1 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:standby_count_wanted 0 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:qdb_cluster leader: 34535 members: 34457,34490,34535 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b{0:34535} state up:active seq 3 addr [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.k{0:34433} state up:standby-replay seq 1 addr [v2:172.21.15.86:6832/3295609155,v1:172.21.15.86:6833/3295609155] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.h{1:34490} state up:active seq 8 addr [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.i{1:24502} state up:standby-replay seq 1 addr [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.e{2:34457} state up:active seq 11 addr [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c{2:24481} state up:standby-replay seq 1 addr [v2:172.21.15.159:6836/1347717104,v1:172.21.15.159:6837/1347717104] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:Standby daemons: 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.j{-1:14517} state up:standby seq 1 addr [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d{-1:14535} state up:standby seq 1 addr [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.g{-1:14622} state up:standby seq 1 addr [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a{-1:14640} state up:standby seq 1 addr [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.530 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.531 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.f{-1:24463} state up:standby seq 1 addr [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] compat {c=[1],r=[1],i=[fff]}] 2024-03-28T05:44:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.527+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 msgr2=0x7feeb80a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.527+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 0x7feeb80a4d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feec40038f0 tx=0x7feec4000bc0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.527+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 msgr2=0x7feed01a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.527+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7feec8007f10 tx=0x7feec800d3b0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 shutdown_connections 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feeb80a2890 0x7feeb80a4d50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feed0105fb0 0x7feed01a1a90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feed0104410 0x7feed019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 --2- 172.21.15.55:0/3234983994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feed0105610 0x7feed019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 >> 172.21.15.55:0/3234983994 conn(0x7feed00ff9b0 msgr2=0x7feed0108910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 shutdown_connections 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:54.528+0000 7feed8200700 1 -- 172.21.15.55:0/3234983994 wait complete. 2024-03-28T05:44:54.532 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:44:54.829 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:54 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3234983994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-28T05:44:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:54 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3234983994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-28T05:44:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:54 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3234983994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-28T05:44:55.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-28T05:44:55.684 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:44:55.832 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:55 smithi055 ceph-mon[31863]: pgmap v430: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:55 smithi086 ceph-mon[35163]: pgmap v430: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:55 smithi159 ceph-mon[36109]: pgmap v430: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 -- 172.21.15.55:0/4265805960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 msgr2=0x7f4c6c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 --2- 172.21.15.55:0/4265805960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c102e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009990 tx=0x7f4c60009ca0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 -- 172.21.15.55:0/4265805960 shutdown_connections 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 --2- 172.21.15.55:0/4265805960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c102e70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 --2- 172.21.15.55:0/4265805960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 0x7f4c6c106200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 --2- 172.21.15.55:0/4265805960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 0x7f4c6c105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 -- 172.21.15.55:0/4265805960 >> 172.21.15.55:0/4265805960 conn(0x7f4c6c0fc660 msgr2=0x7f4c6c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 -- 172.21.15.55:0/4265805960 shutdown_connections 2024-03-28T05:44:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.675+0000 7f4c73800700 1 -- 172.21.15.55:0/4265805960 wait complete. 2024-03-28T05:44:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 Processor -- start 2024-03-28T05:44:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 -- start start 2024-03-28T05:44:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 0x7f4c6c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 0x7f4c6c1a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c114220 con 0x7f4c6c100a40 2024-03-28T05:44:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1140a0 con 0x7f4c6c105d80 2024-03-28T05:44:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.677+0000 7f4c73800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1143a0 con 0x7f4c6c1033b0 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44060/0 (socket says 172.21.15.55:44060) 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 -- 172.21.15.55:0/3552062257 learned_addr learned my addr 172.21.15.55:0/3552062257 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c6be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 0x7f4c6c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c71800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 0x7f4c6c1a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 -- 172.21.15.55:0/3552062257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 msgr2=0x7f4c6c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 0x7f4c6c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 -- 172.21.15.55:0/3552062257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 msgr2=0x7f4c6c1a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.678+0000 7f4c70e00700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 0x7f4c6c1a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c70e00700 1 -- 172.21.15.55:0/3552062257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c1a6520 con 0x7f4c6c100a40 2024-03-28T05:44:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c70e00700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006010 tx=0x7f4c60003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60027070 con 0x7f4c6c100a40 2024-03-28T05:44:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c1a67b0 con 0x7f4c6c100a40 2024-03-28T05:44:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4c6000bd90 con 0x7f4c6c100a40 2024-03-28T05:44:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60022dc0 con 0x7f4c6c100a40 2024-03-28T05:44:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.679+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c1a6cc0 con 0x7f4c6c100a40 2024-03-28T05:44:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.681+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c068e50 con 0x7f4c6c100a40 2024-03-28T05:44:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.683+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f4c6002a070 con 0x7f4c6c100a40 2024-03-28T05:44:57.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.684+0000 7f4c69600700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 0x7f4c540a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:57.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.684+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4c600cf820 con 0x7f4c6c100a40 2024-03-28T05:44:57.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.685+0000 7f4c6be00700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 0x7f4c540a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.685+0000 7f4c6be00700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 0x7f4c540a4d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c004630 tx=0x7f4c5c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:57.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.689+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f4c60013070 con 0x7f4c6c100a40 2024-03-28T05:44:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:57 smithi055 ceph-mon[31863]: pgmap v431: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:57.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.917+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f4c6c062da0 con 0x7f4c6c100a40 2024-03-28T05:44:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.919+0000 7f4c69600700 1 -- 172.21.15.55:0/3552062257 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) v1 ==== 56+0+5292 (secure 0 0 0) 0x7f4c6009c910 con 0x7f4c6c100a40 2024-03-28T05:44:57.921 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 92 2024-03-28T05:44:57.921 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-03-28T05:32:10.226265+0000 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:modified 2024-03-28T05:43:18.912467+0000 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:crush_version 26 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:full_ratio 0.95 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:backfillfull_ratio 0.9 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:nearfull_ratio 0.85 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:require_min_compat_client luminous 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:min_compat_client luminous 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:require_osd_release squid 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:stretch_mode_enabled false 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-28T05:44:57.922 INFO:teuthology.orchestra.run.smithi055.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 90 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:max_osd 12 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6802/2006201392,v1:172.21.15.55:6803/2006201392] [v2:172.21.15.55:6804/2006201392,v1:172.21.15.55:6805/2006201392] exists,up df00632e-7830-42bc-8e05-74ae3fbbdb94 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.1 up in weight 1 up_from 13 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/2855371338,v1:172.21.15.86:6801/2855371338] [v2:172.21.15.86:6802/2855371338,v1:172.21.15.86:6803/2855371338] exists,up 7cbaa230-33bb-4f8a-aed7-0bdabfeaa815 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/1186747066,v1:172.21.15.159:6801/1186747066] [v2:172.21.15.159:6802/1186747066,v1:172.21.15.159:6803/1186747066] exists,up 65e1186a-cbc9-429b-ba19-135a705d8a7c 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.3 up in weight 1 up_from 26 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6810/680016669,v1:172.21.15.55:6811/680016669] [v2:172.21.15.55:6812/680016669,v1:172.21.15.55:6813/680016669] exists,up d7fdfb8b-c726-4cb0-9d81-c96524ccbd17 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.4 up in weight 1 up_from 34 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/3228408788,v1:172.21.15.86:6809/3228408788] [v2:172.21.15.86:6810/3228408788,v1:172.21.15.86:6811/3228408788] exists,up d81c2c4b-5f5f-4b51-ab13-740a305476a5 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.5 up in weight 1 up_from 40 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/2204866007,v1:172.21.15.159:6809/2204866007] [v2:172.21.15.159:6810/2204866007,v1:172.21.15.159:6811/2204866007] exists,up db884aaf-8559-4c28-a521-57ee113e3107 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.6 up in weight 1 up_from 48 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6818/3781986926,v1:172.21.15.55:6819/3781986926] [v2:172.21.15.55:6820/3781986926,v1:172.21.15.55:6821/3781986926] exists,up f026158b-3c5a-4fc7-866c-86f5adc9d2f0 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.7 up in weight 1 up_from 54 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6816/3390667682,v1:172.21.15.86:6817/3390667682] [v2:172.21.15.86:6818/3390667682,v1:172.21.15.86:6819/3390667682] exists,up 625d939c-a761-46ea-96b0-ad1f45d0889b 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.8 up in weight 1 up_from 63 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/4245320261,v1:172.21.15.159:6817/4245320261] [v2:172.21.15.159:6818/4245320261,v1:172.21.15.159:6819/4245320261] exists,up f3778672-12bc-4c1a-a1a8-d26e981911e0 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.9 up in weight 1 up_from 71 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6826/443330436,v1:172.21.15.55:6827/443330436] [v2:172.21.15.55:6828/443330436,v1:172.21.15.55:6829/443330436] exists,up ffea7a53-4b7a-4d50-a690-3ec6a3dc005c 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.10 up in weight 1 up_from 77 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/3742760056,v1:172.21.15.86:6825/3742760056] [v2:172.21.15.86:6826/3742760056,v1:172.21.15.86:6827/3742760056] exists,up f7d7d35b-4f51-49d7-9fa8-d558f915ff4f 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:osd.11 up in weight 1 up_from 85 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/535297782,v1:172.21.15.159:6825/535297782] [v2:172.21.15.159:6826/535297782,v1:172.21.15.159:6827/535297782] exists,up 238c21e2-0ee8-479f-a68a-22758a71cf10 2024-03-28T05:44:57.923 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 2.5 [8,11] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 2.f [8,11] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 2.16 [2,4] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 2.1b [2,4] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 3.c [3,9] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 3.13 [4,9] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 3.28 [5,6] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 3.2c [4,9] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:pg_upmap_items 3.31 [4,8] 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:6801/2069525720 expires 2024-03-29T05:33:17.649133+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:6800/2069525720 expires 2024-03-29T05:33:17.649133+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/2536988057 expires 2024-03-29T05:32:43.443255+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/1408496281 expires 2024-03-29T05:32:43.443255+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/640673760 expires 2024-03-29T05:33:17.649133+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:6800/860110821 expires 2024-03-29T05:32:43.443255+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:6801/860110821 expires 2024-03-29T05:32:43.443255+0000 2024-03-28T05:44:57.924 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/1851388624 expires 2024-03-29T05:33:17.649133+0000 2024-03-28T05:44:57.925 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/2319770671 expires 2024-03-29T05:32:43.443255+0000 2024-03-28T05:44:57.925 INFO:teuthology.orchestra.run.smithi055.stdout:blocklist 172.21.15.55:0/3421643402 expires 2024-03-29T05:33:17.649133+0000 2024-03-28T05:44:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 msgr2=0x7f4c540a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 0x7f4c540a4d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c004630 tx=0x7f4c5c00b3c0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 msgr2=0x7f4c6c19e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006010 tx=0x7f4c60003b80 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 shutdown_connections 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4c540a2890 0x7f4c540a4d50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c6c100a40 0x7f4c6c19e910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c6c105d80 0x7f4c6c1a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 --2- 172.21.15.55:0/3552062257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c6c1033b0 0x7f4c6c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.922+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 >> 172.21.15.55:0/3552062257 conn(0x7f4c6c0fc660 msgr2=0x7f4c6c103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.923+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 shutdown_connections 2024-03-28T05:44:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:57.923+0000 7f4c73800700 1 -- 172.21.15.55:0/3552062257 wait complete. 2024-03-28T05:44:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:57 smithi086 ceph-mon[35163]: pgmap v431: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:57 smithi159 ceph-mon[36109]: pgmap v431: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:44:58.600 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-28T05:44:58.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 -- 172.21.15.55:0/46948503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 msgr2=0x7fa620104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 --2- 172.21.15.55:0/46948503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620104d60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa608009900 tx=0x7fa60802bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 -- 172.21.15.55:0/46948503 shutdown_connections 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 --2- 172.21.15.55:0/46948503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 0x7fa62010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 --2- 172.21.15.55:0/46948503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620104d60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:58.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 --2- 172.21.15.55:0/46948503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 0x7fa620103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:58.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 -- 172.21.15.55:0/46948503 >> 172.21.15.55:0/46948503 conn(0x7fa6200fec80 msgr2=0x7fa6201010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:58.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 -- 172.21.15.55:0/46948503 shutdown_connections 2024-03-28T05:44:58.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.841+0000 7fa61fe00640 1 -- 172.21.15.55:0/46948503 wait complete. 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.842+0000 7fa61fe00640 1 Processor -- start 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.842+0000 7fa61fe00640 1 -- start start 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 0x7fa620199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 0x7fa6201a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62010f250 con 0x7fa6201048e0 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62010f0d0 con 0x7fa6201036f0 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61fe00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62010f3d0 con 0x7fa6201052a0 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa617e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa617e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44080/0 (socket says 172.21.15.55:44080) 2024-03-28T05:44:58.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa617e00640 1 -- 172.21.15.55:0/2056994859 learned_addr learned my addr 172.21.15.55:0/2056994859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:58.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61ea00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 0x7fa620199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.843+0000 7fa61f400640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 0x7fa6201a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 -- 172.21.15.55:0/2056994859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 msgr2=0x7fa6201a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 0x7fa6201a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 -- 172.21.15.55:0/2056994859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 msgr2=0x7fa620199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 0x7fa620199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 -- 172.21.15.55:0/2056994859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6201a1520 con 0x7fa6201048e0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617e00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa608000c00 tx=0x7fa6080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608043020 con 0x7fa6201048e0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa6080054c0 con 0x7fa6201048e0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6201a17b0 con 0x7fa6201048e0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608003d40 con 0x7fa6201048e0 2024-03-28T05:44:58.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.844+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6201a1d00 con 0x7fa6201048e0 2024-03-28T05:44:58.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.846+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62010aa90 con 0x7fa6201048e0 2024-03-28T05:44:58.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.848+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa608046020 con 0x7fa6201048e0 2024-03-28T05:44:58.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.849+0000 7fa617400640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 0x7fa6040a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:58.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.849+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa6080f0f00 con 0x7fa6201048e0 2024-03-28T05:44:58.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.849+0000 7fa61ea00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 0x7fa6040a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:58.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.850+0000 7fa61ea00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 0x7fa6040a4cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa610005fd0 tx=0x7fa610005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:58.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:58.854+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa60804d020 con 0x7fa6201048e0 2024-03-28T05:44:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:58 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3552062257' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-28T05:44:59.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.058+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6200622a0 con 0x7fa6201048e0 2024-03-28T05:44:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.062+0000 7fa617400640 1 -- 172.21.15.55:0/2056994859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7fa6080be0c0 con 0x7fa6201048e0 2024-03-28T05:44:59.064 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:44:59.064 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:44:59.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 msgr2=0x7fa6040a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 0x7fa6040a4cc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa610005fd0 tx=0x7fa610005850 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 msgr2=0x7fa620199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa608000c00 tx=0x7fa6080042f0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 shutdown_connections 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.065+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa6040a2800 0x7fa6040a4cc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6201052a0 0x7fa6201a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6201048e0 0x7fa620199e40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 --2- 172.21.15.55:0/2056994859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6201036f0 0x7fa620199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 >> 172.21.15.55:0/2056994859 conn(0x7fa6200fec80 msgr2=0x7fa620107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 shutdown_connections 2024-03-28T05:44:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.066+0000 7fa61fe00640 1 -- 172.21.15.55:0/2056994859 wait complete. 2024-03-28T05:44:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:58 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3552062257' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-28T05:44:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:58 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3552062257' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-28T05:44:59.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:44:59.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:44:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 -- 172.21.15.55:0/893617663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 msgr2=0x7f225c101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 --2- 172.21.15.55:0/893617663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c101ad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f224c009ca0 tx=0x7f224c02c0f0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 -- 172.21.15.55:0/893617663 shutdown_connections 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 --2- 172.21.15.55:0/893617663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c103260 0x7f225c109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 --2- 172.21.15.55:0/893617663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c1028a0 0x7f225c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 --2- 172.21.15.55:0/893617663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c101ad0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 -- 172.21.15.55:0/893617663 >> 172.21.15.55:0/893617663 conn(0x7f225c0fcc40 msgr2=0x7f225c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.314+0000 7f2262000640 1 -- 172.21.15.55:0/893617663 shutdown_connections 2024-03-28T05:44:59.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.315+0000 7f2262000640 1 -- 172.21.15.55:0/893617663 wait complete. 2024-03-28T05:44:59.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.315+0000 7f2262000640 1 Processor -- start 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 -- start start 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c1028a0 0x7f225c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c103260 0x7f225c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c10d1e0 con 0x7f225c1016b0 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c10d060 con 0x7f225c103260 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f2262000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c10d360 con 0x7f225c1028a0 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f225b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f225b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59800/0 (socket says 172.21.15.55:59800) 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f225b400640 1 -- 172.21.15.55:0/4087674265 learned_addr learned my addr 172.21.15.55:0/4087674265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.316+0000 7f225be00640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c103260 0x7f225c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225aa00640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c1028a0 0x7f225c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 -- 172.21.15.55:0/4087674265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c1028a0 msgr2=0x7f225c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c1028a0 0x7f225c197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 -- 172.21.15.55:0/4087674265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c103260 msgr2=0x7f225c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c103260 0x7f225c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 -- 172.21.15.55:0/4087674265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c19f560 con 0x7f225c1016b0 2024-03-28T05:44:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f225b400640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f224c032380 tx=0x7f224c032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c041020 con 0x7f225c1016b0 2024-03-28T05:44:59.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f224c003e20 con 0x7f225c1016b0 2024-03-28T05:44:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c039040 con 0x7f225c1016b0 2024-03-28T05:44:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c19f7f0 con 0x7f225c1016b0 2024-03-28T05:44:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.317+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c19fd30 con 0x7f225c1016b0 2024-03-28T05:44:59.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.318+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c108b40 con 0x7f225c1016b0 2024-03-28T05:44:59.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.320+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f224c044020 con 0x7f225c1016b0 2024-03-28T05:44:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.322+0000 7f2253e00640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 0x7f22400a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.322+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f224c0f0d90 con 0x7f225c1016b0 2024-03-28T05:44:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.322+0000 7f225aa00640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 0x7f22400a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.323+0000 7f225aa00640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 0x7f22400a4d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2244005fd0 tx=0x7f2244005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:59.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.326+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f224c04b020 con 0x7f225c1016b0 2024-03-28T05:44:59.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.531+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f225c02d2b0 con 0x7f225c1016b0 2024-03-28T05:44:59.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.531+0000 7f2253e00640 1 -- 172.21.15.55:0/4087674265 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f224c0bdef0 con 0x7f225c1016b0 2024-03-28T05:44:59.532 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:44:59.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 msgr2=0x7f22400a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 0x7f22400a4d40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2244005fd0 tx=0x7f2244005850 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 msgr2=0x7f225c197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f224c032380 tx=0x7f224c032820 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 shutdown_connections 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f22400a2880 0x7f22400a4d40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225c103260 0x7f225c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f225c1028a0 0x7f225c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 --2- 172.21.15.55:0/4087674265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f225c1016b0 0x7f225c197940 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.534+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 >> 172.21.15.55:0/4087674265 conn(0x7f225c0fcc40 msgr2=0x7f225c105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.535+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 shutdown_connections 2024-03-28T05:44:59.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.535+0000 7f2262000640 1 -- 172.21.15.55:0/4087674265 wait complete. 2024-03-28T05:44:59.556 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 -- 172.21.15.55:0/3871741688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3801037a0 msgr2=0x7fd380103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 --2- 172.21.15.55:0/3871741688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3801037a0 0x7fd380103bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd370009900 tx=0x7fd37002bc30 comp rx=0 tx=0).stop 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 -- 172.21.15.55:0/3871741688 shutdown_connections 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 --2- 172.21.15.55:0/3871741688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd380105350 0x7fd38010bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 --2- 172.21.15.55:0/3871741688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380104990 0x7fd380104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 --2- 172.21.15.55:0/3871741688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3801037a0 0x7fd380103bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 -- 172.21.15.55:0/3871741688 >> 172.21.15.55:0/3871741688 conn(0x7fd3800fed10 msgr2=0x7fd380101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:44:59.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 -- 172.21.15.55:0/3871741688 shutdown_connections 2024-03-28T05:44:59.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.785+0000 7fd37f200640 1 -- 172.21.15.55:0/3871741688 wait complete. 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.786+0000 7fd37f200640 1 Processor -- start 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.786+0000 7fd37f200640 1 -- start start 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 0x7fd380199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 0x7fd3801a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38010f2f0 con 0x7fd380104990 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38010f170 con 0x7fd380105350 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37f200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38010f470 con 0x7fd3801037a0 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd377e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd377e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59818/0 (socket says 172.21.15.55:59818) 2024-03-28T05:44:59.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd377e00640 1 -- 172.21.15.55:0/656106229 learned_addr learned my addr 172.21.15.55:0/656106229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:44:59.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37e800640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 0x7fd3801a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.787+0000 7fd37de00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 0x7fd380199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 -- 172.21.15.55:0/656106229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 msgr2=0x7fd380199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 0x7fd380199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 -- 172.21.15.55:0/656106229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 msgr2=0x7fd3801a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 0x7fd3801a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 -- 172.21.15.55:0/656106229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3801a15f0 con 0x7fd380104990 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd37e800640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 0x7fd3801a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd37de00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 0x7fd380199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd377e00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd36800e9f0 tx=0x7fd36800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800cd80 con 0x7fd380104990 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd3680108e0 con 0x7fd380104990 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3801a18e0 con 0x7fd380104990 2024-03-28T05:44:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368018920 con 0x7fd380104990 2024-03-28T05:44:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.788+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3801a1e30 con 0x7fd380104990 2024-03-28T05:44:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.789+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38010ac00 con 0x7fd380104990 2024-03-28T05:44:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.792+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd368010a90 con 0x7fd380104990 2024-03-28T05:44:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.793+0000 7fd376a00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 0x7fd3640a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:44:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.793+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd3680cef10 con 0x7fd380104990 2024-03-28T05:44:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.793+0000 7fd37de00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 0x7fd3640a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:44:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.794+0000 7fd37de00640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 0x7fd3640a4cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd37002c240 tx=0x7fd370005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:44:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:44:59.797+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd36809bf70 con 0x7fd380104990 2024-03-28T05:44:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:59 smithi055 ceph-mon[31863]: pgmap v432: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:44:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:59 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2056994859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:44:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:44:59 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4087674265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.007+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3800622a0 con 0x7fd380104990 2024-03-28T05:45:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.008+0000 7fd376a00640 1 -- 172.21.15.55:0/656106229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd36809b870 con 0x7fd380104990 2024-03-28T05:45:00.009 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:45:00.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 msgr2=0x7fd3640a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 0x7fd3640a4cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd37002c240 tx=0x7fd370005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 msgr2=0x7fd380199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd36800e9f0 tx=0x7fd36800eeb0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 shutdown_connections 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd3640a2800 0x7fd3640a4cc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd380105350 0x7fd3801a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd380104990 0x7fd380199f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.010+0000 7fd37f200640 1 --2- 172.21.15.55:0/656106229 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3801037a0 0x7fd380199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.011+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 >> 172.21.15.55:0/656106229 conn(0x7fd3800fed10 msgr2=0x7fd380107dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.011+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 shutdown_connections 2024-03-28T05:45:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.011+0000 7fd37f200640 1 -- 172.21.15.55:0/656106229 wait complete. 2024-03-28T05:45:00.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:45:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:59 smithi086 ceph-mon[35163]: pgmap v432: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:59 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2056994859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:44:59 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4087674265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:59 smithi159 ceph-mon[36109]: pgmap v432: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:59 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2056994859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:44:59 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4087674265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.257+0000 7fa5cbe00640 1 -- 172.21.15.55:0/657856826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc0756e0 msgr2=0x7fa5cc073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.257+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/657856826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc073b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009930 tx=0x7fa5bc02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 -- 172.21.15.55:0/657856826 shutdown_connections 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/657856826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc10db70 0x7fa5cc10ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/657856826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc074100 0x7fa5cc074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/657856826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc073b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 -- 172.21.15.55:0/657856826 >> 172.21.15.55:0/657856826 conn(0x7fa5cc0fcb10 msgr2=0x7fa5cc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 -- 172.21.15.55:0/657856826 shutdown_connections 2024-03-28T05:45:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.258+0000 7fa5cbe00640 1 -- 172.21.15.55:0/657856826 wait complete. 2024-03-28T05:45:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.259+0000 7fa5cbe00640 1 Processor -- start 2024-03-28T05:45:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.259+0000 7fa5cbe00640 1 -- start start 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 0x7fa5cc19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 0x7fa5cc1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc113710 con 0x7fa5cc0756e0 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc113590 con 0x7fa5cc10db70 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cbe00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc113890 con 0x7fa5cc074100 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5ca000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5ca000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59838/0 (socket says 172.21.15.55:59838) 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5ca000640 1 -- 172.21.15.55:0/1297412294 learned_addr learned my addr 172.21.15.55:0/1297412294 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:00.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.260+0000 7fa5cb400640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 0x7fa5cc1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5caa00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 0x7fa5cc19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 -- 172.21.15.55:0/1297412294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 msgr2=0x7fa5cc19dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 0x7fa5cc19dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 -- 172.21.15.55:0/1297412294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 msgr2=0x7fa5cc1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 0x7fa5cc1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 -- 172.21.15.55:0/1297412294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc1a5a00 con 0x7fa5cc0756e0 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5caa00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 0x7fa5cc19dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5cb400640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 0x7fa5cc1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5ca000640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009d50 tx=0x7fa5b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4003b70 con 0x7fa5cc0756e0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.261+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa5b4003d10 con 0x7fa5cc0756e0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.262+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc1a5cf0 con 0x7fa5cc0756e0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.262+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40108f0 con 0x7fa5cc0756e0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.262+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc1a6230 con 0x7fa5cc0756e0 2024-03-28T05:45:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.263+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc103d40 con 0x7fa5cc0756e0 2024-03-28T05:45:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.266+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa5b4004000 con 0x7fa5cc0756e0 2024-03-28T05:45:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.267+0000 7fa5d0a00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 0x7fa5ac0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.267+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa5b40cf1d0 con 0x7fa5cc0756e0 2024-03-28T05:45:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.268+0000 7fa5caa00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 0x7fa5ac0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.268+0000 7fa5caa00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 0x7fa5ac0a4d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009900 tx=0x7fa5bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:00.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.272+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa5b409c230 con 0x7fa5cc0756e0 2024-03-28T05:45:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.481+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5cc0622a0 con 0x7fa5cc0756e0 2024-03-28T05:45:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.482+0000 7fa5d0a00640 1 -- 172.21.15.55:0/1297412294 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5b409bb30 con 0x7fa5cc0756e0 2024-03-28T05:45:00.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:45:00.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 msgr2=0x7fa5ac0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 0x7fa5ac0a4d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009900 tx=0x7fa5bc005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 msgr2=0x7fa5cc19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009d50 tx=0x7fa5b400c6a0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 shutdown_connections 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa5ac0a2880 0x7fa5ac0a4d40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5cc10db70 0x7fa5cc1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.484+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5cc0756e0 0x7fa5cc19e320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.485+0000 7fa5cbe00640 1 --2- 172.21.15.55:0/1297412294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5cc074100 0x7fa5cc19dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.485+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 >> 172.21.15.55:0/1297412294 conn(0x7fa5cc0fcb10 msgr2=0x7fa5cc100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.485+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 shutdown_connections 2024-03-28T05:45:00.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.485+0000 7fa5cbe00640 1 -- 172.21.15.55:0/1297412294 wait complete. 2024-03-28T05:45:00.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:45:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 -- 172.21.15.55:0/411719046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041048e0 msgr2=0x7f4d04104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 --2- 172.21.15.55:0/411719046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041048e0 0x7f4d04104d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009900 tx=0x7f4cf002bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 -- 172.21.15.55:0/411719046 shutdown_connections 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 --2- 172.21.15.55:0/411719046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041052a0 0x7f4d0410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 --2- 172.21.15.55:0/411719046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041048e0 0x7f4d04104d60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 --2- 172.21.15.55:0/411719046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041036f0 0x7f4d04103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 -- 172.21.15.55:0/411719046 >> 172.21.15.55:0/411719046 conn(0x7f4d040fec80 msgr2=0x7f4d041010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 -- 172.21.15.55:0/411719046 shutdown_connections 2024-03-28T05:45:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.717+0000 7f4d03e00640 1 -- 172.21.15.55:0/411719046 wait complete. 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.718+0000 7f4d03e00640 1 Processor -- start 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 -- start start 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041048e0 0x7f4d04199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041052a0 0x7f4d041a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0410f220 con 0x7f4d041036f0 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0410f0a0 con 0x7f4d041048e0 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d03e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0410f3a0 con 0x7f4d041052a0 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d02a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d02a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59846/0 (socket says 172.21.15.55:59846) 2024-03-28T05:45:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d02a00640 1 -- 172.21.15.55:0/858395275 learned_addr learned my addr 172.21.15.55:0/858395275 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.719+0000 7f4d02000640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041048e0 0x7f4d04199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d03400640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041052a0 0x7f4d041a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 -- 172.21.15.55:0/858395275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041052a0 msgr2=0x7f4d041a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041052a0 0x7f4d041a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 -- 172.21.15.55:0/858395275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041048e0 msgr2=0x7f4d04199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041048e0 0x7f4d04199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 -- 172.21.15.55:0/858395275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d041a1560 con 0x7f4d041036f0 2024-03-28T05:45:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.720+0000 7f4d02a00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400d950 tx=0x7f4cf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.721+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4017070 con 0x7f4d041036f0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.721+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4cf4009c30 con 0x7f4d041036f0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.721+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041a1850 con 0x7f4d041036f0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.721+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400f620 con 0x7f4d041036f0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.721+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d041a1d20 con 0x7f4d041036f0 2024-03-28T05:45:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.722+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0410aae0 con 0x7f4d041036f0 2024-03-28T05:45:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.725+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f4cf401a070 con 0x7f4d041036f0 2024-03-28T05:45:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.726+0000 7f4d08a00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 0x7f4ce80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.726+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4cf40ce4d0 con 0x7f4d041036f0 2024-03-28T05:45:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.727+0000 7f4d02000640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 0x7f4ce80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.727+0000 7f4d02000640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 0x7f4ce80a4cc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009230 tx=0x7f4cf0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:00.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.731+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f4cf4009de0 con 0x7f4d041036f0 2024-03-28T05:45:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:00 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/656106229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:00 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1297412294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:00.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.978+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d040622a0 con 0x7f4d041036f0 2024-03-28T05:45:00.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.980+0000 7f4d08a00640 1 -- 172.21.15.55:0/858395275 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f4cf409b530 con 0x7f4d041036f0 2024-03-28T05:45:00.981 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:00.981 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:45:00.981 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 msgr2=0x7f4ce80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 0x7f4ce80a4cc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009230 tx=0x7f4cf0005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 msgr2=0x7f4d04199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400d950 tx=0x7f4cf400de10 comp rx=0 tx=0).stop 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 shutdown_connections 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4ce80a2800 0x7f4ce80a4cc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d041052a0 0x7f4d041a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d041048e0 0x7f4d04199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 --2- 172.21.15.55:0/858395275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d041036f0 0x7f4d04199940 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 >> 172.21.15.55:0/858395275 conn(0x7f4d040fec80 msgr2=0x7f4d04107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 shutdown_connections 2024-03-28T05:45:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:00.983+0000 7f4d03e00640 1 -- 172.21.15.55:0/858395275 wait complete. 2024-03-28T05:45:01.004 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:00 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/656106229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:00 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1297412294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:00 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/656106229' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:00 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1297412294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:01.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.225+0000 7fbca0c00640 1 -- 172.21.15.55:0/3865538868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1036f0 msgr2=0x7fbc9c103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.225+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3865538868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c103b10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009900 tx=0x7fbc8c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 -- 172.21.15.55:0/3865538868 shutdown_connections 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3865538868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3865538868 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1048e0 0x7fbc9c104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3865538868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c103b10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 -- 172.21.15.55:0/3865538868 >> 172.21.15.55:0/3865538868 conn(0x7fbc9c0fec80 msgr2=0x7fbc9c1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 -- 172.21.15.55:0/3865538868 shutdown_connections 2024-03-28T05:45:01.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.226+0000 7fbca0c00640 1 -- 172.21.15.55:0/3865538868 wait complete. 2024-03-28T05:45:01.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 Processor -- start 2024-03-28T05:45:01.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 -- start start 2024-03-28T05:45:01.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1048e0 0x7fbc9c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c10f1f0 con 0x7fbc9c1052a0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c10f070 con 0x7fbc9c1048e0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbca0c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c10f370 con 0x7fbc9c1036f0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbc9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59874/0 (socket says 172.21.15.55:59874) 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.227+0000 7fbc9be00640 1 -- 172.21.15.55:0/3319468675 learned_addr learned my addr 172.21.15.55:0/3319468675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9aa00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1048e0 0x7fbc9c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9b400640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 -- 172.21.15.55:0/3319468675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1036f0 msgr2=0x7fbc9c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 -- 172.21.15.55:0/3319468675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1048e0 msgr2=0x7fbc9c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1048e0 0x7fbc9c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 -- 172.21.15.55:0/3319468675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c1a1510 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc9be00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400eaa0 tx=0x7fbc9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400cdb0 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fbc94005020 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c1a1800 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.228+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940116d0 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.229+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c1a1d00 con 0x7fbc9c1052a0 2024-03-28T05:45:01.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.230+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c10aa60 con 0x7fbc9c1052a0 2024-03-28T05:45:01.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.232+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fbc940051d0 con 0x7fbc9c1052a0 2024-03-28T05:45:01.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.233+0000 7fbc93e00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 0x7fbc800a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.233+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbc940cec70 con 0x7fbc9c1052a0 2024-03-28T05:45:01.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.233+0000 7fbc9b400640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 0x7fbc800a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.234+0000 7fbc9b400640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 0x7fbc800a4cc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c006010 tx=0x7fbc8c005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:01.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.238+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fbc94016030 con 0x7fbc9c1052a0 2024-03-28T05:45:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.446+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc9c0622a0 con 0x7fbc9c1052a0 2024-03-28T05:45:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.448+0000 7fbc93e00640 1 -- 172.21.15.55:0/3319468675 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7fbc9409bd10 con 0x7fbc9c1052a0 2024-03-28T05:45:01.450 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:01.450 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:01.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 msgr2=0x7fbc800a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 0x7fbc800a4cc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c006010 tx=0x7fbc8c005be0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 msgr2=0x7fbc9c1a0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400eaa0 tx=0x7fbc9400ef60 comp rx=0 tx=0).stop 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 shutdown_connections 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fbc800a2800 0x7fbc800a4cc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc9c1052a0 0x7fbc9c1a0ea0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc9c1048e0 0x7fbc9c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 --2- 172.21.15.55:0/3319468675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc9c1036f0 0x7fbc9c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.451+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 >> 172.21.15.55:0/3319468675 conn(0x7fbc9c0fec80 msgr2=0x7fbc9c107c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.452+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 shutdown_connections 2024-03-28T05:45:01.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.452+0000 7fbca0c00640 1 -- 172.21.15.55:0/3319468675 wait complete. 2024-03-28T05:45:01.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:45:01.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:45:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 -- 172.21.15.55:0/972005033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0109870 msgr2=0x7fa8e0110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 --2- 172.21.15.55:0/972005033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0109870 0x7fa8e0110100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009ca0 tx=0x7fa8d802c100 comp rx=0 tx=0).stop 2024-03-28T05:45:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 -- 172.21.15.55:0/972005033 shutdown_connections 2024-03-28T05:45:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 --2- 172.21.15.55:0/972005033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0109870 0x7fa8e0110100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 --2- 172.21.15.55:0/972005033 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0108eb0 0x7fa8e0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 --2- 172.21.15.55:0/972005033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e01080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 -- 172.21.15.55:0/972005033 >> 172.21.15.55:0/972005033 conn(0x7fa8e0076c60 msgr2=0x7fa8e00790a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:01.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 -- 172.21.15.55:0/972005033 shutdown_connections 2024-03-28T05:45:01.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.704+0000 7fa8e5800640 1 -- 172.21.15.55:0/972005033 wait complete. 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.705+0000 7fa8e5800640 1 Processor -- start 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.705+0000 7fa8e5800640 1 -- start start 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 0x7fa8e019e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0109870 0x7fa8e01a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01137d0 con 0x7fa8e0107cc0 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0113650 con 0x7fa8e0108eb0 2024-03-28T05:45:01.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8e5800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0113950 con 0x7fa8e0109870 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59886/0 (socket says 172.21.15.55:59886) 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 -- 172.21.15.55:0/1243619993 learned_addr learned my addr 172.21.15.55:0/1243619993 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8d7e00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 0x7fa8e019e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 -- 172.21.15.55:0/1243619993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0109870 msgr2=0x7fa8e01a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8df400640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0109870 0x7fa8e01a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0109870 0x7fa8e01a5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 -- 172.21.15.55:0/1243619993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 msgr2=0x7fa8e019e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 0x7fa8e019e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8dea00640 1 -- 172.21.15.55:0/1243619993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e01a5a90 con 0x7fa8e0107cc0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.706+0000 7fa8d7e00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 0x7fa8e019e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8dea00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000e9c0 tx=0x7fa8d000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d000cde0 con 0x7fa8e0107cc0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa8d00108e0 con 0x7fa8e0107cc0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e01a5d80 con 0x7fa8e0107cc0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0018990 con 0x7fa8e0107cc0 2024-03-28T05:45:01.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.707+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01a6240 con 0x7fa8e0107cc0 2024-03-28T05:45:01.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.708+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e010efe0 con 0x7fa8e0107cc0 2024-03-28T05:45:01.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.710+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa8d001f020 con 0x7fa8e0107cc0 2024-03-28T05:45:01.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.712+0000 7fa8d7400640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 0x7fa8c40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.712+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa8d00ced30 con 0x7fa8e0107cc0 2024-03-28T05:45:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.712+0000 7fa8d7e00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 0x7fa8c40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:01.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.713+0000 7fa8d7e00640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 0x7fa8c40a4d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa8e019f380 tx=0x7fa8c800b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:01.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.716+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa8d009bd90 con 0x7fa8e0107cc0 2024-03-28T05:45:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:01 smithi055 ceph-mon[31863]: pgmap v433: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/858395275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3319468675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.920+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8e0061ae0 con 0x7fa8e0107cc0 2024-03-28T05:45:01.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.921+0000 7fa8d7400640 1 -- 172.21.15.55:0/1243619993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8d009b690 con 0x7fa8e0107cc0 2024-03-28T05:45:01.922 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 msgr2=0x7fa8c40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 0x7fa8c40a4d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa8e019f380 tx=0x7fa8c800b5f0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 msgr2=0x7fa8e019de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000e9c0 tx=0x7fa8d000ee80 comp rx=0 tx=0).stop 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 shutdown_connections 2024-03-28T05:45:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa8c40a2880 0x7fa8c40a4d40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8e0109870 0x7fa8e01a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8e0108eb0 0x7fa8e019e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 --2- 172.21.15.55:0/1243619993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0107cc0 0x7fa8e019de70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 >> 172.21.15.55:0/1243619993 conn(0x7fa8e0076c60 msgr2=0x7fa8e010c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 shutdown_connections 2024-03-28T05:45:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:01.924+0000 7fa8e5800640 1 -- 172.21.15.55:0/1243619993 wait complete. 2024-03-28T05:45:01.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:45:01.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:01 smithi159 ceph-mon[36109]: pgmap v433: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:01.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/858395275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:01.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3319468675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:01 smithi086 ceph-mon[35163]: pgmap v433: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/858395275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3319468675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 -- 172.21.15.55:0/11115961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb641038c0 msgr2=0x7feb64103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 --2- 172.21.15.55:0/11115961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb641038c0 0x7feb64103ce0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feb54009900 tx=0x7feb5402bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 -- 172.21.15.55:0/11115961 shutdown_connections 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 --2- 172.21.15.55:0/11115961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb64105470 0x7feb6410bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 --2- 172.21.15.55:0/11115961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64104ab0 0x7feb64104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 --2- 172.21.15.55:0/11115961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb641038c0 0x7feb64103ce0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.170+0000 7feb69a00640 1 -- 172.21.15.55:0/11115961 >> 172.21.15.55:0/11115961 conn(0x7feb640fee50 msgr2=0x7feb64101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.171+0000 7feb69a00640 1 -- 172.21.15.55:0/11115961 shutdown_connections 2024-03-28T05:45:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.171+0000 7feb69a00640 1 -- 172.21.15.55:0/11115961 wait complete. 2024-03-28T05:45:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 Processor -- start 2024-03-28T05:45:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 -- start start 2024-03-28T05:45:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 0x7feb64199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64105470 0x7feb641a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6410f440 con 0x7feb64104ab0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6410f2c0 con 0x7feb64105470 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb69a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6410f5c0 con 0x7feb641038c0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb62000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb62000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59906/0 (socket says 172.21.15.55:59906) 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.172+0000 7feb62000640 1 -- 172.21.15.55:0/1678691794 learned_addr learned my addr 172.21.15.55:0/1678691794 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 0x7feb64199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb63400640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64105470 0x7feb641a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 -- 172.21.15.55:0/1678691794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 msgr2=0x7feb64199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 0x7feb64199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 -- 172.21.15.55:0/1678691794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64105470 msgr2=0x7feb641a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64105470 0x7feb641a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 -- 172.21.15.55:0/1678691794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb641a1700 con 0x7feb64104ab0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 0x7feb64199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb62000640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d950 tx=0x7feb5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50017030 con 0x7feb64104ab0 2024-03-28T05:45:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7feb50004020 con 0x7feb64104ab0 2024-03-28T05:45:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb641a19f0 con 0x7feb64104ab0 2024-03-28T05:45:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.173+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500047a0 con 0x7feb64104ab0 2024-03-28T05:45:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.174+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb641a1f40 con 0x7feb64104ab0 2024-03-28T05:45:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.175+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6410acb0 con 0x7feb64104ab0 2024-03-28T05:45:02.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.178+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7feb500041d0 con 0x7feb64104ab0 2024-03-28T05:45:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.179+0000 7feb5b400640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 0x7feb480a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.179+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7feb500ce630 con 0x7feb64104ab0 2024-03-28T05:45:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.179+0000 7feb62a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 0x7feb480a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.180+0000 7feb62a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 0x7feb480a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb54036040 tx=0x7feb54005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.183+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7feb5009b690 con 0x7feb64104ab0 2024-03-28T05:45:02.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.383+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb640622a0 con 0x7feb64104ab0 2024-03-28T05:45:02.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.384+0000 7feb5b400640 1 -- 172.21.15.55:0/1678691794 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb5009af90 con 0x7feb64104ab0 2024-03-28T05:45:02.385 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 msgr2=0x7feb480a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 0x7feb480a4cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb54036040 tx=0x7feb54005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 msgr2=0x7feb6419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d950 tx=0x7feb5000de10 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 shutdown_connections 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7feb480a2800 0x7feb480a4cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb64105470 0x7feb641a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb64104ab0 0x7feb6419a020 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 --2- 172.21.15.55:0/1678691794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb641038c0 0x7feb64199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 >> 172.21.15.55:0/1678691794 conn(0x7feb640fee50 msgr2=0x7feb64107e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:02.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 shutdown_connections 2024-03-28T05:45:02.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.387+0000 7feb69a00640 1 -- 172.21.15.55:0/1678691794 wait complete. 2024-03-28T05:45:02.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 -- 172.21.15.55:0/460703120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4101670 msgr2=0x7f77f4101af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 --2- 172.21.15.55:0/460703120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4101670 0x7f77f4101af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009ca0 tx=0x7f77e402c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 -- 172.21.15.55:0/460703120 shutdown_connections 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 --2- 172.21.15.55:0/460703120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4102030 0x7f77f41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 --2- 172.21.15.55:0/460703120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4101670 0x7f77f4101af0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 --2- 172.21.15.55:0/460703120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4100480 0x7f77f41008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 -- 172.21.15.55:0/460703120 >> 172.21.15.55:0/460703120 conn(0x7f77f40fba10 msgr2=0x7f77f40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 -- 172.21.15.55:0/460703120 shutdown_connections 2024-03-28T05:45:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.634+0000 7f77f3e00640 1 -- 172.21.15.55:0/460703120 wait complete. 2024-03-28T05:45:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.635+0000 7f77f3e00640 1 Processor -- start 2024-03-28T05:45:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 -- start start 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 0x7f77f4199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 0x7f77f41a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410bfc0 con 0x7f77f4100480 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410be40 con 0x7f77f4101670 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f3e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410c140 con 0x7f77f4102030 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59916/0 (socket says 172.21.15.55:59916) 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.636+0000 7f77f2a00640 1 -- 172.21.15.55:0/3438095279 learned_addr learned my addr 172.21.15.55:0/3438095279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2000640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 0x7f77f4199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f3400640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 0x7f77f41a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 -- 172.21.15.55:0/3438095279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 msgr2=0x7f77f41a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 0x7f77f41a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 -- 172.21.15.55:0/3438095279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 msgr2=0x7f77f4199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 0x7f77f4199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 -- 172.21.15.55:0/3438095279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f41a15e0 con 0x7f77f4100480 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f3400640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 0x7f77f41a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2000640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 0x7f77f4199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:02.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.637+0000 7f77f2a00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00d950 tx=0x7f77dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.638+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc017070 con 0x7f77f4100480 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.638+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f77dc009c30 con 0x7f77f4100480 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.638+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f41a18d0 con 0x7f77f4100480 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.638+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00f620 con 0x7f77f4100480 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.638+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f41a1df0 con 0x7f77f4100480 2024-03-28T05:45:02.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.639+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f41a1ff0 con 0x7f77f4100480 2024-03-28T05:45:02.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.641+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f77dc01a070 con 0x7f77f4100480 2024-03-28T05:45:02.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.642+0000 7f77eb400640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 0x7f77d80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:02.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.642+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f77dc0ce500 con 0x7f77f4100480 2024-03-28T05:45:02.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.643+0000 7f77f2000640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 0x7f77d80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:02.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.643+0000 7f77f2000640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 0x7f77d80a4d40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006010 tx=0x7f77e40324f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:02.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.646+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f77dc009de0 con 0x7f77f4100480 2024-03-28T05:45:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.849+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77f41a21c0 con 0x7f77f4100480 2024-03-28T05:45:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.850+0000 7f77eb400640 1 -- 172.21.15.55:0/3438095279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77dc09b560 con 0x7f77f4100480 2024-03-28T05:45:02.851 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.852+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 msgr2=0x7f77d80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.852+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 0x7f77d80a4d40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006010 tx=0x7f77e40324f0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.852+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 msgr2=0x7f77f4199a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.852+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00d950 tx=0x7f77dc00de10 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 shutdown_connections 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f77d80a2880 0x7f77d80a4d40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77f4102030 0x7f77f41a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f4101670 0x7f77f4199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 --2- 172.21.15.55:0/3438095279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f4100480 0x7f77f4199a10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 >> 172.21.15.55:0/3438095279 conn(0x7f77f40fba10 msgr2=0x7f77f40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 shutdown_connections 2024-03-28T05:45:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:02.853+0000 7f77f3e00640 1 -- 172.21.15.55:0/3438095279 wait complete. 2024-03-28T05:45:02.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:45:02.960 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1243619993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:02.960 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1678691794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1243619993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1678691794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1243619993' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1678691794' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- 172.21.15.55:0/302211461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4108ed0 msgr2=0x7fb8f4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 --2- 172.21.15.55:0/302211461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4108ed0 0x7fb8f4109350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009900 tx=0x7fb8e002bc40 comp rx=0 tx=0).stop 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- 172.21.15.55:0/302211461 shutdown_connections 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 --2- 172.21.15.55:0/302211461 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f4109890 0x7fb8f4110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 --2- 172.21.15.55:0/302211461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4108ed0 0x7fb8f4109350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 --2- 172.21.15.55:0/302211461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4107ce0 0x7fb8f4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- 172.21.15.55:0/302211461 >> 172.21.15.55:0/302211461 conn(0x7fb8f4076cb0 msgr2=0x7fb8f40790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:03.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- 172.21.15.55:0/302211461 shutdown_connections 2024-03-28T05:45:03.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- 172.21.15.55:0/302211461 wait complete. 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 Processor -- start 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.102+0000 7fb8fb600640 1 -- start start 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f4108ed0 0x7fb8f419e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 0x7fb8f41a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4113840 con 0x7fb8f4107ce0 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41136c0 con 0x7fb8f4109890 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8fb600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41139c0 con 0x7fb8f4108ed0 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59934/0 (socket says 172.21.15.55:59934) 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 -- 172.21.15.55:0/3970109027 learned_addr learned my addr 172.21.15.55:0/3970109027 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f9600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 0x7fb8f41a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 -- 172.21.15.55:0/3970109027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f4108ed0 msgr2=0x7fb8f419e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f4108ed0 0x7fb8f419e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 -- 172.21.15.55:0/3970109027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 msgr2=0x7fb8f41a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 0x7fb8f41a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f8c00640 1 -- 172.21.15.55:0/3970109027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f41a5aa0 con 0x7fb8f4107ce0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.103+0000 7fb8f9600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 0x7fb8f41a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8f8c00640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800e9c0 tx=0x7fb8e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800cde0 con 0x7fb8f4107ce0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f41a5d90 con 0x7fb8f4107ce0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb8e80108e0 con 0x7fb8f4107ce0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80188e0 con 0x7fb8f4107ce0 2024-03-28T05:45:03.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.104+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f41a6280 con 0x7fb8f4107ce0 2024-03-28T05:45:03.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.105+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f410f000 con 0x7fb8f4107ce0 2024-03-28T05:45:03.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.107+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb8e801f020 con 0x7fb8f4107ce0 2024-03-28T05:45:03.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.110+0000 7fb8f1600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 0x7fb8dc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.110+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb8e80cedb0 con 0x7fb8f4107ce0 2024-03-28T05:45:03.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.110+0000 7fb8f3e00640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 0x7fb8dc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.110+0000 7fb8f3e00640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 0x7fb8dc0a4cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005c20 tx=0x7fb8e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:03.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.113+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb8e80d3070 con 0x7fb8f4107ce0 2024-03-28T05:45:03.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.358+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f402d320 con 0x7fb8f4107ce0 2024-03-28T05:45:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.361+0000 7fb8f1600640 1 -- 172.21.15.55:0/3970109027 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11382 (secure 0 0 0) 0x7fb8e809be10 con 0x7fb8f4107ce0 2024-03-28T05:45:03.361 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:03.361 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:42:57.977747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34457,34490,34535]},"id":1}]} 2024-03-28T05:45:03.361 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 23 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.362+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 msgr2=0x7fb8dc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.362+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 0x7fb8dc0a4cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0005c20 tx=0x7fb8e0000bc0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.362+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 msgr2=0x7fb8f419de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.362+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800e9c0 tx=0x7fb8e800ee80 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 shutdown_connections 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb8dc0a2800 0x7fb8dc0a4cc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8f4109890 0x7fb8f41a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8f4108ed0 0x7fb8f419e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 --2- 172.21.15.55:0/3970109027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8f4107ce0 0x7fb8f419de80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 >> 172.21.15.55:0/3970109027 conn(0x7fb8f4076cb0 msgr2=0x7fb8f410c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 shutdown_connections 2024-03-28T05:45:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.363+0000 7fb8fb600640 1 -- 172.21.15.55:0/3970109027 wait complete. 2024-03-28T05:45:03.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 -- 172.21.15.55:0/3725468336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c1096b0 msgr2=0x7f287c10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 --2- 172.21.15.55:0/3725468336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c1096b0 0x7f287c10ff40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2874009be0 tx=0x7f287402bef0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 -- 172.21.15.55:0/3725468336 shutdown_connections 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 --2- 172.21.15.55:0/3725468336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c1096b0 0x7f287c10ff40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 --2- 172.21.15.55:0/3725468336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 0x7f287c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 --2- 172.21.15.55:0/3725468336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c107b00 0x7f287c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 -- 172.21.15.55:0/3725468336 >> 172.21.15.55:0/3725468336 conn(0x7f287c076ab0 msgr2=0x7f287c078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 -- 172.21.15.55:0/3725468336 shutdown_connections 2024-03-28T05:45:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 -- 172.21.15.55:0/3725468336 wait complete. 2024-03-28T05:45:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.601+0000 7f287b200640 1 Processor -- start 2024-03-28T05:45:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 -- start start 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 0x7f287c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c1096b0 0x7f287c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c113660 con 0x7f287c107b00 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1134e0 con 0x7f287c108cf0 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f287b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1137e0 con 0x7f287c1096b0 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f2879e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f2879e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59962/0 (socket says 172.21.15.55:59962) 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f2879e00640 1 -- 172.21.15.55:0/1802734497 learned_addr learned my addr 172.21.15.55:0/1802734497 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.602+0000 7f2871400640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 0x7f287c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f287a800640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c1096b0 0x7f287c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 -- 172.21.15.55:0/1802734497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c1096b0 msgr2=0x7f287c1a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c1096b0 0x7f287c1a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 -- 172.21.15.55:0/1802734497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 msgr2=0x7f287c19e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 0x7f287c19e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 -- 172.21.15.55:0/1802734497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c1a58b0 con 0x7f287c107b00 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2879e00640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f286c00d770 tx=0x7f286c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.603+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c017070 con 0x7f287c107b00 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.604+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c1a5ba0 con 0x7f287c107b00 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.604+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f286c009cd0 con 0x7f287c107b00 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.604+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c003c60 con 0x7f287c107b00 2024-03-28T05:45:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.604+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1a6140 con 0x7f287c107b00 2024-03-28T05:45:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.605+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c10ee20 con 0x7f287c107b00 2024-03-28T05:45:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.608+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f286c009820 con 0x7f287c107b00 2024-03-28T05:45:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.609+0000 7f2873400640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 0x7f28600a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.609+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f286c0ce410 con 0x7f287c107b00 2024-03-28T05:45:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.609+0000 7f2871400640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 0x7f28600a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.609+0000 7f2871400640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 0x7f28600a4cc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f287c19f170 tx=0x7f2864009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.614+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f286c09b470 con 0x7f287c107b00 2024-03-28T05:45:03.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.819+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c0622a0 con 0x7f287c107b00 2024-03-28T05:45:03.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.823+0000 7f2873400640 1 -- 172.21.15.55:0/1802734497 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f286c09ad70 con 0x7f287c107b00 2024-03-28T05:45:03.824 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:03.824 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.825+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 msgr2=0x7f28600a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 0x7f28600a4cc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f287c19f170 tx=0x7f2864009260 comp rx=0 tx=0).stop 2024-03-28T05:45:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 msgr2=0x7f287c19dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f286c00d770 tx=0x7f286c00db70 comp rx=0 tx=0).stop 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 shutdown_connections 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f28600a2800 0x7f28600a4cc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f287c1096b0 0x7f287c1a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f287c108cf0 0x7f287c19e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 --2- 172.21.15.55:0/1802734497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f287c107b00 0x7f287c19dc70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 >> 172.21.15.55:0/1802734497 conn(0x7f287c076ab0 msgr2=0x7f287c10bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 shutdown_connections 2024-03-28T05:45:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:03.826+0000 7f287b200640 1 -- 172.21.15.55:0/1802734497 wait complete. 2024-03-28T05:45:03.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-28T05:42:52.123648+0000', 'modified': '2024-03-28T05:42:57.977747+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34535, 'mds_1': 34490, 'mds_2': 34457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6837/1347717104', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6836', 'nonce': 1347717104}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 1347717104}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6839/673238495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 673238495}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 673238495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34433': {'gid': 34433, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6833/3295609155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6832', 'nonce': 3295609155}, {'type': 'v1', 'addr': '172.21.15.86:6833', 'nonce': 3295609155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34457': {'gid': 34457, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.86:6835/833423423', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 833423423}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 833423423}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34490': {'gid': 34490, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.86:6837/2422548949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 2422548949}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 2422548949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_34535': {'gid': 34535, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6839/3285549085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 3285549085}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 3285549085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34535, 'qdb_cluster': [34457, 34490, 34535]} 2024-03-28T05:45:03.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-28T05:45:03.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-28T05:45:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:03 smithi086 ceph-mon[35163]: pgmap v434: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3438095279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3970109027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:04.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 -- 172.21.15.55:0/2442089512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 msgr2=0x7f5ed0102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 --2- 172.21.15.55:0/2442089512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed0102220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009ca0 tx=0x7f5ec002c100 comp rx=0 tx=0).stop 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 -- 172.21.15.55:0/2442089512 shutdown_connections 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 --2- 172.21.15.55:0/2442089512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 0x7f5ed0105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 --2- 172.21.15.55:0/2442089512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed0104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 --2- 172.21.15.55:0/2442089512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed0102220 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 -- 172.21.15.55:0/2442089512 >> 172.21.15.55:0/2442089512 conn(0x7f5ed00fba10 msgr2=0x7f5ed00fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.069+0000 7f5ecf200640 1 -- 172.21.15.55:0/2442089512 shutdown_connections 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.070+0000 7f5ecf200640 1 -- 172.21.15.55:0/2442089512 wait complete. 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.070+0000 7f5ecf200640 1 Processor -- start 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 -- start start 2024-03-28T05:45:04.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 0x7f5ed01a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0113680 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0113500 con 0x7f5ed0102760 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecf200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0113800 con 0x7f5ed0105110 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59982/0 (socket says 172.21.15.55:59982) 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecde00640 1 -- 172.21.15.55:0/418409465 learned_addr learned my addr 172.21.15.55:0/418409465 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ecd400640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.071+0000 7f5ece800640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 0x7f5ed01a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 -- 172.21.15.55:0/418409465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 msgr2=0x7f5ed01a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 0x7f5ed01a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 -- 172.21.15.55:0/418409465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 msgr2=0x7f5ed019e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed019e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 -- 172.21.15.55:0/418409465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed01a5950 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecd400640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecde00640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0032380 tx=0x7f5ec0035ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ec6a00640 1 -- 172.21.15.55:0/418409465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0039040 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ec6a00640 1 -- 172.21.15.55:0/418409465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ec0044070 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ec6a00640 1 -- 172.21.15.55:0/418409465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0004530 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.072+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed01a5be0 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.073+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01a6120 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.077 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:03 smithi159 ceph-mon[36109]: pgmap v434: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:04.077 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3438095279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:04.077 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3970109027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 Processor -- start 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ec6a00640 1 -- 172.21.15.55:0/418409465 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f5ec00327c0 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 -- start start 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd280dc90 con 0x55fbd28a9770 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd27b6980 con 0x55fbd28ae8e0 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.076+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd2809d30 con 0x55fbd28a8d80 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59994/0 (socket says 172.21.15.55:59994) 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 -- 172.21.15.55:0/1046834712 learned_addr learned my addr 172.21.15.55:0/1046834712 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecd400640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ece800640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 -- 172.21.15.55:0/1046834712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 msgr2=0x55fbd28a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 -- 172.21.15.55:0/1046834712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 msgr2=0x55fbd28b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecde00640 1 -- 172.21.15.55:0/1046834712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbd27ce510 con 0x55fbd28a9770 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.077+0000 7f5ecd400640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00f9320 tx=0x7f5ec00f9410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9c4e156b25ef84 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ec6a00640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 0x7f5eb40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ebf400640 1 -- 172.21.15.55:0/1046834712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00b9ea0 con 0x55fbd28a9770 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ec6a00640 1 -- 172.21.15.55:0/418409465 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5ec00f12f0 con 0x7f5ed00ffdf0 2024-03-28T05:45:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ebf400640 1 -- 172.21.15.55:0/1046834712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ec00fe030 con 0x55fbd28a9770 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ebf400640 1 -- 172.21.15.55:0/1046834712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00bd0e0 con 0x55fbd28a9770 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.078+0000 7f5ece800640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 0x7f5eb40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1046834712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 msgr2=0x55fbd28ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ece800640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 0x7f5eb40a4d40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8005fd0 tx=0x7f5ec8005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00f9320 tx=0x7f5ec00f9410 comp rx=0 tx=0).stop 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1046834712 shutdown_connections 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ae270 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1046834712 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1046834712 >> 172.21.15.55:0/1046834712 conn(0x55fbd28a42f0 msgr2=0x55fbd28a46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1046834712 shutdown_connections 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.079+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1046834712 wait complete. 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.080+0000 7f5ed7e80740 1 -- start start 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.080+0000 7f5ed7e80740 1 Processor -- start 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.080+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a8d80 0x55fbd28b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.080+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a9770 0x55fbd28b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.080+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28b1650 con 0x55fbd28ae8e0 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd27c9dd0 con 0x55fbd28a8d80 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28b17d0 con 0x55fbd28a9770 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ed7e80740 10 client.0 _ll_register_callbacks cb 0x55fbd2521ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60010/0 (socket says 172.21.15.55:60010) 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 -- 172.21.15.55:0/3294339298 learned_addr learned my addr 172.21.15.55:0/3294339298 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ecde00640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a8d80 0x55fbd28b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ecd400640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a9770 0x55fbd28b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 -- 172.21.15.55:0/3294339298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a9770 msgr2=0x55fbd28b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a9770 0x55fbd28b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 -- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a8d80 msgr2=0x55fbd28b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a8d80 0x55fbd28b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.081+0000 7f5ece800640 1 -- 172.21.15.55:0/3294339298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbd25222d0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5ece800640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8011b20 tx=0x7f5ec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4c7055f597ddef server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5eb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec801e420 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ec00fe030 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5ec801e5c0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ec801e7c0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5ed7e80740 10 client.15216 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fbd25ec6b0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.082+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5ec00fe030 con 0x55fbd28ae8e0 2024-03-28T05:45:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5ec801c850 con 0x55fbd28ae8e0 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 10 client.15216 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 10 client.15216 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 20 client.15216 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd28bf7d0 0x55fbd28be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 4 client.15216 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbd27af520 con 0x55fbd28bf7d0 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.083+0000 7f5ecde00640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd28bf7d0 0x55fbd28be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.084+0000 7f5ecde00640 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd28bf7d0 0x55fbd28be880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acd66e7130827e24 server_cookie=e18b5531fee2eff1 in_seq=0 out_seq=0 2024-03-28T05:45:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.084+0000 7f5eb3e00640 10 client.15216 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5eb3e00640 1 -- 172.21.15.55:0/3294339298 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55fbd27af520 con 0x55fbd28bf7d0 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5eb3e00640 10 client.15216 handle_command_reply: tid=0 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 client.15216 shutdown 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 msgr2=0x55fbd28ba4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8011b20 tx=0x7f5ec80046c0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 shutdown_connections 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd28bf7d0 0x55fbd28be880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28ba4e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a9770 0x55fbd28b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/3294339298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a8d80 0x55fbd28b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5eb3e00640 0 client.15216 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 >> 172.21.15.55:0/3294339298 conn(0x55fbd28a42f0 msgr2=0x55fbd28a34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 shutdown_connections 2024-03-28T05:45:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.085+0000 7f5ed7e80740 1 -- 172.21.15.55:0/3294339298 wait complete. 2024-03-28T05:45:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.086+0000 7f5ed7e80740 20 client.15216 trim_cache size 0 max 16384 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 Processor -- start 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 -- start start 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28beff0 con 0x55fbd28a9770 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28bf650 con 0x55fbd28ae8e0 2024-03-28T05:45:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.104+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28bfcb0 con 0x55fbd28a8d80 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60026/0 (socket says 172.21.15.55:60026) 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 -- 172.21.15.55:0/2901185447 learned_addr learned my addr 172.21.15.55:0/2901185447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecde00640 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ece800640 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 -- 172.21.15.55:0/2901185447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 msgr2=0x55fbd28b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 -- 172.21.15.55:0/2901185447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 msgr2=0x55fbd28be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 -- 172.21.15.55:0/2901185447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbd28a5060 con 0x55fbd28a9770 2024-03-28T05:45:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.105+0000 7f5ecd400640 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800bc50 tx=0x7f5eb80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bec28ec4b5d28f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ebea00640 1 -- 172.21.15.55:0/2901185447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800be00 con 0x55fbd28a9770 2024-03-28T05:45:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ebea00640 1 -- 172.21.15.55:0/2901185447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5eb80035f0 con 0x55fbd28a9770 2024-03-28T05:45:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ebea00640 1 -- 172.21.15.55:0/2901185447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800f650 con 0x55fbd28a9770 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ed7e80740 1 -- 172.21.15.55:0/2901185447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 msgr2=0x55fbd28ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800bc50 tx=0x7f5eb80127c0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ed7e80740 1 -- 172.21.15.55:0/2901185447 shutdown_connections 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.106+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28ae8e0 0x55fbd28be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/2901185447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 -- 172.21.15.55:0/2901185447 >> 172.21.15.55:0/2901185447 conn(0x55fbd28a42f0 msgr2=0x55fbd28b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 -- 172.21.15.55:0/2901185447 shutdown_connections 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 -- 172.21.15.55:0/2901185447 wait complete. 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 -- start start 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.107+0000 7f5ed7e80740 1 Processor -- start 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28c0970 con 0x55fbd28ae8e0 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28c0310 con 0x55fbd28a9770 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbd28c0fd0 con 0x55fbd28a8d80 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ed7e80740 10 client.0 _ll_register_callbacks cb 0x7f5ec800c8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60032/0 (socket says 172.21.15.55:60032) 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 -- 172.21.15.55:0/1920590331 learned_addr learned my addr 172.21.15.55:0/1920590331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ecd400640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 -- 172.21.15.55:0/1920590331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 msgr2=0x55fbd28b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 -- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a9770 msgr2=0x55fbd28ba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ece800640 1 -- 172.21.15.55:0/1920590331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fbd28b7300 con 0x55fbd28ae8e0 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.108+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5ece800640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8010fd0 tx=0x7f5ec801e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef58a96f8f1b32 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5eb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec801ed70 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5ec8004020 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5eb80035f0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ec800e790 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5ed7e80740 10 client.15222 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fbd291b680 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.109+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5eb80035f0 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5ec803a070 con 0x55fbd28ae8e0 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 10 client.15222 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 10 client.15222 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T05:45:04.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 20 client.15222 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd291fdc0 0x55fbd291b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 4 client.15222 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fbd281b1d0 con 0x55fbd291fdc0 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.110+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd291fdc0 0x55fbd291b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.111+0000 7f5ecde00640 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd291fdc0 0x55fbd291b970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c3613fb73dc29d9 server_cookie=287512a51a627f7e in_seq=0 out_seq=0 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.111+0000 7f5eb3e00640 10 client.15222 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5eb3e00640 1 -- 172.21.15.55:0/1920590331 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55fbd281b1d0 con 0x55fbd291fdc0 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5eb3e00640 10 client.15222 handle_command_reply: tid=0 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 client.15222 shutdown 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 msgr2=0x55fbd28b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8010fd0 tx=0x7f5ec801e6d0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 shutdown_connections 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55fbd291fdc0 0x55fbd291b970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fbd28ae8e0 0x55fbd28b6ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbd28a9770 0x55fbd28ba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 --2- 172.21.15.55:0/1920590331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fbd28a8d80 0x55fbd28b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5eb3e00640 0 client.15222 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 >> 172.21.15.55:0/1920590331 conn(0x55fbd28a42f0 msgr2=0x55fbd28be880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 shutdown_connections 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 1 -- 172.21.15.55:0/1920590331 wait complete. 2024-03-28T05:45:04.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.112+0000 7f5ed7e80740 20 client.15222 trim_cache size 0 max 16384 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 2, 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34457, 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 126.64020815799999, 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:45:04.120 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:45:04.121 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 164.378831924 2024-03-28T05:45:04.121 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 msgr2=0x7f5eb40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 0x7f5eb40a4d40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8005fd0 tx=0x7f5ec8005ec0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 msgr2=0x7f5ed019dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0032380 tx=0x7f5ec0035ce0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 shutdown_connections 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5eb40a2880 0x7f5eb40a4d40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ed0105110 0x7f5ed01a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed0102760 0x7f5ed019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 --2- 172.21.15.55:0/418409465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ed00ffdf0 0x7f5ed019dd40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 >> 172.21.15.55:0/418409465 conn(0x7f5ed00fba10 msgr2=0x7f5ed01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 shutdown_connections 2024-03-28T05:45:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.113+0000 7f5ecf200640 1 -- 172.21.15.55:0/418409465 wait complete. 2024-03-28T05:45:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:03 smithi055 ceph-mon[31863]: pgmap v434: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3438095279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3970109027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:04.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 -- 172.21.15.55:0/3065239008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 msgr2=0x7fe9c8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 --2- 172.21.15.55:0/3065239008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c8104bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009900 tx=0x7fe9b402bc40 comp rx=0 tx=0).stop 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 -- 172.21.15.55:0/3065239008 shutdown_connections 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 --2- 172.21.15.55:0/3065239008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c8105130 0x7fe9c81055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 --2- 172.21.15.55:0/3065239008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c8104bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 --2- 172.21.15.55:0/3065239008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c80ffe10 0x7fe9c8102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 -- 172.21.15.55:0/3065239008 >> 172.21.15.55:0/3065239008 conn(0x7fe9c80fba10 msgr2=0x7fe9c80fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 -- 172.21.15.55:0/3065239008 shutdown_connections 2024-03-28T05:45:04.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.335+0000 7fe9cf000640 1 -- 172.21.15.55:0/3065239008 wait complete. 2024-03-28T05:45:04.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.336+0000 7fe9cf000640 1 Processor -- start 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 -- start start 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80ffe10 0x7fe9c819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c8105130 0x7fe9c81a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81136a0 con 0x7fe9c8102780 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8113520 con 0x7fe9c8105130 2024-03-28T05:45:04.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cf000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8113820 con 0x7fe9c80ffe10 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60054/0 (socket says 172.21.15.55:60054) 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cd200640 1 -- 172.21.15.55:0/4199161142 learned_addr learned my addr 172.21.15.55:0/4199161142 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9ce600640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c8105130 0x7fe9c81a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.337+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80ffe10 0x7fe9c819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 -- 172.21.15.55:0/4199161142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80ffe10 msgr2=0x7fe9c819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80ffe10 0x7fe9c819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 -- 172.21.15.55:0/4199161142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c8105130 msgr2=0x7fe9c81a52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c8105130 0x7fe9c81a52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 -- 172.21.15.55:0/4199161142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c81a5940 con 0x7fe9c8102780 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cd200640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4006010 tx=0x7fe9b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9c6000640 1 -- 172.21.15.55:0/4199161142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4043020 con 0x7fe9c8102780 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9c6000640 1 -- 172.21.15.55:0/4199161142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9b4004aa0 con 0x7fe9c8102780 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c81a5bd0 con 0x7fe9c8102780 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9c6000640 1 -- 172.21.15.55:0/4199161142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4003c60 con 0x7fe9c8102780 2024-03-28T05:45:04.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.338+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c81a6120 con 0x7fe9c8102780 2024-03-28T05:45:04.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 Processor -- start 2024-03-28T05:45:04.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9c6000640 1 -- 172.21.15.55:0/4199161142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fe9b4046020 con 0x7fe9c8102780 2024-03-28T05:45:04.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 -- start start 2024-03-28T05:45:04.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5df770 0x564a4d5e4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 0x564a4d5e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d543c90 con 0x564a4d5ded80 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d4ec980 con 0x564a4d5e48e0 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.342+0000 7fe9d326c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d53fd30 con 0x564a4d5df770 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60064/0 (socket says 172.21.15.55:60064) 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 -- 172.21.15.55:0/3836252694 learned_addr learned my addr 172.21.15.55:0/3836252694 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9cd200640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 0x564a4d5e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5df770 0x564a4d5e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 -- 172.21.15.55:0/3836252694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5df770 msgr2=0x564a4d5e4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5df770 0x564a4d5e4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 -- 172.21.15.55:0/3836252694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 msgr2=0x564a4d5e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 0x564a4d5e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 -- 172.21.15.55:0/3836252694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a4d504510 con 0x564a4d5ded80 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9cd200640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 0x564a4d5e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.343+0000 7fe9ce600640 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0007dd0 tx=0x7fe9c000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db83bf59e2922c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9bea00640 1 -- 172.21.15.55:0/3836252694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0014070 con 0x564a4d5ded80 2024-03-28T05:45:04.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9c6000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 0x7fe9ac0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9bea00640 1 -- 172.21.15.55:0/3836252694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9c0004d20 con 0x564a4d5ded80 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9bea00640 1 -- 172.21.15.55:0/3836252694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00107b0 con 0x564a4d5ded80 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9c6000640 1 -- 172.21.15.55:0/4199161142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe9b40f0fa0 con 0x7fe9c8102780 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 0x7fe9ac0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9d326c740 1 -- 172.21.15.55:0/3836252694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 msgr2=0x564a4d5df1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.344+0000 7fe9d326c740 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0007dd0 tx=0x7fe9c000e720 comp rx=0 tx=0).stop 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 -- 172.21.15.55:0/3836252694 shutdown_connections 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5e48e0 0x564a4d5e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5df770 0x564a4d5e4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 --2- 172.21.15.55:0/3836252694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5ded80 0x564a4d5df1a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 -- 172.21.15.55:0/3836252694 >> 172.21.15.55:0/3836252694 conn(0x564a4d5da2f0 msgr2=0x564a4d5da6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 -- 172.21.15.55:0/3836252694 shutdown_connections 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 0x7fe9ac0a4cc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8005d00 tx=0x7fe9b8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 -- 172.21.15.55:0/3836252694 wait complete. 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 -- start start 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.345+0000 7fe9d326c740 1 Processor -- start 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5e9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5e7890 con 0x564a4d5e48e0 2024-03-28T05:45:04.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d4ffdd0 con 0x564a4d5df770 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5e7a10 con 0x564a4d5ded80 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9d326c740 10 client.0 _ll_register_callbacks cb 0x564a4d257ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60076/0 (socket says 172.21.15.55:60076) 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9ce600640 1 -- 172.21.15.55:0/1726942670 learned_addr learned my addr 172.21.15.55:0/1726942670 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.346+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 -- 172.21.15.55:0/1726942670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 msgr2=0x564a4d5e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 -- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 msgr2=0x564a4d5e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5e9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 -- 172.21.15.55:0/1726942670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a4d2582d0 con 0x564a4d5e48e0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0007da0 tx=0x7fe9c0005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5913b5ead5cb38e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9b3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0027060 con 0x564a4d5e48e0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe9c0010530 con 0x564a4d5e48e0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.347+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9c0004d20 con 0x564a4d5e48e0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c0014070 con 0x564a4d5e48e0 2024-03-28T05:45:04.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 10 client.15234 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564a4d3226b0 con 0x564a4d5e48e0 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9c0004d20 con 0x564a4d5e48e0 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe9c002c070 con 0x564a4d5e48e0 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 10 client.15234 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 20 client.15234 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d5f49f0 0x564a4d5f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 4 client.15234 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.348+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a4d4e5520 con 0x564a4d5f49f0 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.349+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d5f49f0 0x564a4d5f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.350+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d5f49f0 0x564a4d5f9a30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58783aed18e9b0da server_cookie=4aeeba97527e881b in_seq=0 out_seq=0 2024-03-28T05:45:04.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.350+0000 7fe9b3400640 10 client.15234 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9b3400640 1 -- 172.21.15.55:0/1726942670 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564a4d4e5520 con 0x564a4d5f49f0 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9b3400640 10 client.15234 handle_command_reply: tid=0 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 client.15234 shutdown 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 msgr2=0x564a4d5f0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0007da0 tx=0x7fe9c0005700 comp rx=0 tx=0).stop 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 shutdown_connections 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5f0870 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d5f49f0 0x564a4d5f9a30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1726942670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 >> 172.21.15.55:0/1726942670 conn(0x564a4d5da2f0 msgr2=0x564a4d5d94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9b3400640 0 client.15234 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 shutdown_connections 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 1 -- 172.21.15.55:0/1726942670 wait complete. 2024-03-28T05:45:04.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.352+0000 7fe9d326c740 20 client.15234 trim_cache size 0 max 16384 2024-03-28T05:45:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 Processor -- start 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 -- start start 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5ded80 0x564a4d5e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5e48e0 0x564a4d5e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f4dd0 con 0x564a4d5df770 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f5430 con 0x564a4d5ded80 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9d326c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f5a90 con 0x564a4d5e48e0 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60082/0 (socket says 172.21.15.55:60082) 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.371+0000 7fe9cd200640 1 -- 172.21.15.55:0/1717287559 learned_addr learned my addr 172.21.15.55:0/1717287559 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5ded80 0x564a4d5e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5e48e0 0x564a4d5e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 -- 172.21.15.55:0/1717287559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5e48e0 msgr2=0x564a4d5e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5e48e0 0x564a4d5e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 -- 172.21.15.55:0/1717287559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5ded80 msgr2=0x564a4d5e8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5ded80 0x564a4d5e8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 -- 172.21.15.55:0/1717287559 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a4d5db060 con 0x564a4d5df770 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40ba280 tx=0x7fe9b40bd7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7599bdebaada942 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9be000640 1 -- 172.21.15.55:0/1717287559 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40035f0 con 0x564a4d5df770 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9be000640 1 -- 172.21.15.55:0/1717287559 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9b40be040 con 0x564a4d5df770 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.372+0000 7fe9be000640 1 -- 172.21.15.55:0/1717287559 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40b9f20 con 0x564a4d5df770 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 -- 172.21.15.55:0/1717287559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 msgr2=0x564a4d5f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40ba280 tx=0x7fe9b40bd7d0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 -- 172.21.15.55:0/1717287559 shutdown_connections 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5e48e0 0x564a4d5e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5df770 0x564a4d5f0790 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1717287559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5ded80 0x564a4d5e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 -- 172.21.15.55:0/1717287559 >> 172.21.15.55:0/1717287559 conn(0x564a4d5da2f0 msgr2=0x564a4d5e0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 -- 172.21.15.55:0/1717287559 shutdown_connections 2024-03-28T05:45:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.373+0000 7fe9d326c740 1 -- 172.21.15.55:0/1717287559 wait complete. 2024-03-28T05:45:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 -- start start 2024-03-28T05:45:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 Processor -- start 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f6750 con 0x564a4d5e48e0 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f60f0 con 0x564a4d5df770 2024-03-28T05:45:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a4d5f6db0 con 0x564a4d5ded80 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9d326c740 10 client.0 _ll_register_callbacks cb 0x7fe9c0007c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.374+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60098/0 (socket says 172.21.15.55:60098) 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 -- 172.21.15.55:0/1639955761 learned_addr learned my addr 172.21.15.55:0/1639955761 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 -- 172.21.15.55:0/1639955761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 msgr2=0x564a4d5ec740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5ec740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 -- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 msgr2=0x564a4d5ecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5ecc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 -- 172.21.15.55:0/1639955761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a4d5f0290 con 0x564a4d5e48e0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9cd200640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9ce600640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00228c0 tx=0x7fe9c0005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23610820613560d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.375+0000 7fe9b3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0032070 con 0x564a4d5e48e0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe9c0007320 con 0x564a4d5e48e0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9b40be040 con 0x564a4d5e48e0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c003e050 con 0x564a4d5e48e0 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 10 client.15240 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564a4d651410 con 0x564a4d5e48e0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe9b40be040 con 0x564a4d5e48e0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe9c002c030 con 0x564a4d5e48e0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 10 client.15240 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 10 client.15240 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 20 client.15240 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d6559f0 0x564a4d651690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 4 client.15240 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.376+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564a4d5511d0 con 0x564a4d6559f0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.377+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d6559f0 0x564a4d651690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.378+0000 7fe9cdc00640 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d6559f0 0x564a4d651690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=934a8261b445814 server_cookie=2371c0c87488fb1d in_seq=0 out_seq=0 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.378+0000 7fe9b3400640 10 client.15240 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:04.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.378+0000 7fe9b3400640 1 -- 172.21.15.55:0/1639955761 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564a4d5511d0 con 0x564a4d6559f0 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.378+0000 7fe9b3400640 10 client.15240 handle_command_reply: tid=0 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.378+0000 7fe9d326c740 1 client.15240 shutdown 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 msgr2=0x564a4d5efca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00228c0 tx=0x7fe9c0005300 comp rx=0 tx=0).stop 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 shutdown_connections 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564a4d5e48e0 0x564a4d5efca0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a4d5df770 0x564a4d5ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x564a4d6559f0 0x564a4d651690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 --2- 172.21.15.55:0/1639955761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564a4d5ded80 0x564a4d5ec740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 >> 172.21.15.55:0/1639955761 conn(0x564a4d5da2f0 msgr2=0x564a4d5e7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9b3400640 0 client.15240 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:04.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 shutdown_connections 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 1 -- 172.21.15.55:0/1639955761 wait complete. 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.379+0000 7fe9d326c740 20 client.15240 trim_cache size 0 max 16384 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 1, 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34490, 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:45:04.386 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 127.922198323, 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 152.85415118500001 2024-03-28T05:45:04.387 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 msgr2=0x7fe9ac0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 0x7fe9ac0a4cc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8005d00 tx=0x7fe9b8005c50 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 msgr2=0x7fe9c819e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4006010 tx=0x7fe9b40042f0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 shutdown_connections 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe9ac0a2800 0x7fe9ac0a4cc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9c8105130 0x7fe9c81a52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9c8102780 0x7fe9c819e270 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 --2- 172.21.15.55:0/4199161142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9c80ffe10 0x7fe9c819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 >> 172.21.15.55:0/4199161142 conn(0x7fe9c80fba10 msgr2=0x7fe9c8100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 shutdown_connections 2024-03-28T05:45:04.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.380+0000 7fe9cf000640 1 -- 172.21.15.55:0/4199161142 wait complete. 2024-03-28T05:45:04.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 -- 172.21.15.55:0/2038875501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 msgr2=0x7f657c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 --2- 172.21.15.55:0/2038875501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c073b30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f656c009900 tx=0x7f656c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 -- 172.21.15.55:0/2038875501 shutdown_connections 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 --2- 172.21.15.55:0/2038875501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 0x7f657c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 --2- 172.21.15.55:0/2038875501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 0x7f657c074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 --2- 172.21.15.55:0/2038875501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c073b30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 -- 172.21.15.55:0/2038875501 >> 172.21.15.55:0/2038875501 conn(0x7f657c0fcb10 msgr2=0x7f657c0fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.615+0000 7f657b200640 1 -- 172.21.15.55:0/2038875501 shutdown_connections 2024-03-28T05:45:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.616+0000 7f657b200640 1 -- 172.21.15.55:0/2038875501 wait complete. 2024-03-28T05:45:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.616+0000 7f657b200640 1 Processor -- start 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 -- start start 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 0x7f657c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 0x7f657c1a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c10f2e0 con 0x7f657c0756e0 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c10f160 con 0x7f657c074100 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f657b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c10f460 con 0x7f657c109440 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f6571400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f6571400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60116/0 (socket says 172.21.15.55:60116) 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f6571400640 1 -- 172.21.15.55:0/1105062795 learned_addr learned my addr 172.21.15.55:0/1105062795 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.617+0000 7f6579e00640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 0x7f657c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f657a800640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 0x7f657c1a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 -- 172.21.15.55:0/1105062795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 msgr2=0x7f657c1a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 0x7f657c1a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 -- 172.21.15.55:0/1105062795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 msgr2=0x7f657c1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 0x7f657c1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 -- 172.21.15.55:0/1105062795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c1a15c0 con 0x7f657c0756e0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6571400640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f656400e9f0 tx=0x7f656400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6573400640 1 -- 172.21.15.55:0/1105062795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656400cd80 con 0x7f657c0756e0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6573400640 1 -- 172.21.15.55:0/1105062795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f65640108e0 con 0x7f657c0756e0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c1a18b0 con 0x7f657c0756e0 2024-03-28T05:45:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f6573400640 1 -- 172.21.15.55:0/1105062795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564018920 con 0x7f657c0756e0 2024-03-28T05:45:04.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.618+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c1a1e00 con 0x7f657c0756e0 2024-03-28T05:45:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 Processor -- start 2024-03-28T05:45:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f6573400640 1 -- 172.21.15.55:0/1105062795 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f6564010a90 con 0x7f657c0756e0 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 -- start start 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c6b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c70270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556bcfc90 con 0x565556c708e0 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556b78980 con 0x565556c6b770 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.622+0000 7f65837e8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556bcbd30 con 0x565556c6ad80 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60118/0 (socket says 172.21.15.55:60118) 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 -- 172.21.15.55:0/3450122060 learned_addr learned my addr 172.21.15.55:0/3450122060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6579e00640 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c70270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f657a800640 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c6b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 -- 172.21.15.55:0/3450122060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 msgr2=0x565556c6b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c6b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 -- 172.21.15.55:0/3450122060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 msgr2=0x565556c70270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c70270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6571400640 1 -- 172.21.15.55:0/3450122060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565556b90510 con 0x565556c708e0 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.623+0000 7f6573400640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 0x7f65600a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f6571400640 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65640d2ef0 tx=0x7f65640d5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66f6d814142bada server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f6573400640 1 -- 172.21.15.55:0/1105062795 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f65640cee00 con 0x7f657c0756e0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f657a800640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 0x7f65600a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f656b000640 1 -- 172.21.15.55:0/3450122060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564097a40 con 0x565556c708e0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f656b000640 1 -- 172.21.15.55:0/3450122060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f656406ce50 con 0x565556c708e0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.624+0000 7f656b000640 1 -- 172.21.15.55:0/3450122060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656409b100 con 0x565556c708e0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- 172.21.15.55:0/3450122060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 msgr2=0x565556c72d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f65640d2ef0 tx=0x7f65640d5810 comp rx=0 tx=0).stop 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f657a800640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 0x7f65600a4cc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x565556c6bfd0 tx=0x7f6574009580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- 172.21.15.55:0/3450122060 shutdown_connections 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c72d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c70270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 --2- 172.21.15.55:0/3450122060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c6b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- 172.21.15.55:0/3450122060 >> 172.21.15.55:0/3450122060 conn(0x565556c662f0 msgr2=0x565556c666f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- 172.21.15.55:0/3450122060 shutdown_connections 2024-03-28T05:45:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- 172.21.15.55:0/3450122060 wait complete. 2024-03-28T05:45:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.625+0000 7f65837e8740 1 -- start start 2024-03-28T05:45:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 Processor -- start 2024-03-28T05:45:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c75790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c708e0 0x565556c7c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c73890 con 0x565556c6ad80 2024-03-28T05:45:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556b8bdd0 con 0x565556c6b770 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c73a10 con 0x565556c708e0 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f65837e8740 10 client.0 _ll_register_callbacks cb 0x5655568e3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f6579e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f6579e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60130/0 (socket says 172.21.15.55:60130) 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.626+0000 7f6579e00640 1 -- 172.21.15.55:0/2678515806 learned_addr learned my addr 172.21.15.55:0/2678515806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6571400640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c75790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f657a800640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c708e0 0x565556c7c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 -- 172.21.15.55:0/2678515806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c708e0 msgr2=0x565556c7c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c708e0 0x565556c7c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 -- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 msgr2=0x565556c75790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c75790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 -- 172.21.15.55:0/2678515806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5655568e42d0 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6571400640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c75790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f6579e00640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ab596d4a4c3c86 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f655f400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c005250 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f656c0053f0 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.627+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f656406ce50 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f656c0055f0 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 10 client.15252 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5655569ae6b0 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f656406ce50 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f656c0038b0 con 0x565556c6ad80 2024-03-28T05:45:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 10 client.15252 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 10 client.15252 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 20 client.15252 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556c81ab0 0x565556c80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 4 client.15252 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.628+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565556b71520 con 0x565556c81ab0 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.629+0000 7f6571400640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556c81ab0 0x565556c80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.630+0000 7f6571400640 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556c81ab0 0x565556c80b60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c0bda69ec5bee4 server_cookie=fc6b924682f630ef in_seq=0 out_seq=0 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.630+0000 7f655f400640 10 client.15252 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.632+0000 7f655f400640 1 -- 172.21.15.55:0/2678515806 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x565556b71520 con 0x565556c81ab0 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.632+0000 7f655f400640 10 client.15252 handle_command_reply: tid=0 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.632+0000 7f65837e8740 1 client.15252 shutdown 2024-03-28T05:45:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 msgr2=0x565556c75250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c004270 comp rx=0 tx=0).stop 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 shutdown_connections 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556c81ab0 0x565556c80b60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c708e0 0x565556c7c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556c75790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 --2- 172.21.15.55:0/2678515806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c6ad80 0x565556c75250 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f655f400640 0 client.15252 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 >> 172.21.15.55:0/2678515806 conn(0x565556c662f0 msgr2=0x565556c654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 shutdown_connections 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 1 -- 172.21.15.55:0/2678515806 wait complete. 2024-03-28T05:45:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.633+0000 7f65837e8740 20 client.15252 trim_cache size 0 max 16384 2024-03-28T05:45:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.651+0000 7f65837e8740 1 Processor -- start 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 -- start start 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6ad80 0x565556c80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6b770 0x565556c7c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c812d0 con 0x565556c708e0 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c81930 con 0x565556c6ad80 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f65837e8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c81f90 con 0x565556c6b770 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f657a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f657a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60142/0 (socket says 172.21.15.55:60142) 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f657a800640 1 -- 172.21.15.55:0/3333488483 learned_addr learned my addr 172.21.15.55:0/3333488483 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.652+0000 7f6579e00640 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6ad80 0x565556c80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 -- 172.21.15.55:0/3333488483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6b770 msgr2=0x565556c7c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f6571400640 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6b770 0x565556c7c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6b770 0x565556c7c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 -- 172.21.15.55:0/3333488483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6ad80 msgr2=0x565556c80b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6ad80 0x565556c80b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 -- 172.21.15.55:0/3333488483 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565556c58170 con 0x565556c708e0 2024-03-28T05:45:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.653+0000 7f657a800640 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6574012770 tx=0x7f6574014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868df8f80b733540 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f656a600640 1 -- 172.21.15.55:0/3333488483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657401e820 con 0x565556c708e0 2024-03-28T05:45:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f656a600640 1 -- 172.21.15.55:0/3333488483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f657401ee70 con 0x565556c708e0 2024-03-28T05:45:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f656a600640 1 -- 172.21.15.55:0/3333488483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657401c410 con 0x565556c708e0 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 -- 172.21.15.55:0/3333488483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 msgr2=0x565556c666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6574012770 tx=0x7f6574014000 comp rx=0 tx=0).stop 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 -- 172.21.15.55:0/3333488483 shutdown_connections 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556c666d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6b770 0x565556c7c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 --2- 172.21.15.55:0/3333488483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6ad80 0x565556c80b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 -- 172.21.15.55:0/3333488483 >> 172.21.15.55:0/3333488483 conn(0x565556c662f0 msgr2=0x565556c73db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 -- 172.21.15.55:0/3333488483 shutdown_connections 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.654+0000 7f65837e8740 1 -- 172.21.15.55:0/3333488483 wait complete. 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.655+0000 7f65837e8740 1 -- start start 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.655+0000 7f65837e8740 1 Processor -- start 2024-03-28T05:45:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.655+0000 7f65837e8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c7a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556ce1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c82c50 con 0x565556c708e0 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c825f0 con 0x565556c6b770 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x565556c832b0 con 0x565556c6ad80 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f65837e8740 10 client.0 _ll_register_callbacks cb 0x7f656c005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60148/0 (socket says 172.21.15.55:60148) 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 -- 172.21.15.55:0/3644313278 learned_addr learned my addr 172.21.15.55:0/3644313278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f6579e00640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c7a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 -- 172.21.15.55:0/3644313278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 msgr2=0x565556c7a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c7a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 -- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 msgr2=0x565556ce1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556ce1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f657a800640 1 -- 172.21.15.55:0/3644313278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565556ce4150 con 0x565556c708e0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.656+0000 7f6579e00640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c7a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f657a800640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f657401f930 tx=0x7f657401f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4bf29337175ed4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f655f400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574036020 con 0x565556c708e0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6574004a40 con 0x565556c708e0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f657401ee70 con 0x565556c708e0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6574004c80 con 0x565556c708e0 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f65837e8740 10 client.15258 fetch_fsmap learned FSMap version 23 2024-03-28T05:45:04.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.657+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x565556ce5450 con 0x565556c708e0 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f657401ee70 con 0x565556c708e0 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 23) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6574020ce0 con 0x565556c708e0 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 10 client.15258 fetch_fsmap finished waiting for FSMap version 23 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 10 client.15258 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 20 client.15258 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556ce9880 0x565556ce5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 4 client.15258 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.658+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565556bdd1d0 con 0x565556ce9880 2024-03-28T05:45:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.659+0000 7f6579e00640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556ce9880 0x565556ce5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:04.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.659+0000 7f6579e00640 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556ce9880 0x565556ce5790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b566b22dfcfa7e0 server_cookie=d088f6c75de2d290 in_seq=0 out_seq=0 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.659+0000 7f655f400640 10 client.15258 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f655f400640 1 -- 172.21.15.55:0/3644313278 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x565556bdd1d0 con 0x565556ce9880 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f655f400640 10 client.15258 handle_command_reply: tid=0 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 client.15258 shutdown 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 msgr2=0x565556ce3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f657401f930 tx=0x7f657401f420 comp rx=0 tx=0).stop 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 shutdown_connections 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x565556ce9880 0x565556ce5790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565556c708e0 0x565556ce3920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565556c6b770 0x565556ce1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f655f400640 0 client.15258 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 --2- 172.21.15.55:0/3644313278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x565556c6ad80 0x565556c7a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 >> 172.21.15.55:0/3644313278 conn(0x565556c662f0 msgr2=0x565556c80b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 shutdown_connections 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 1 -- 172.21.15.55:0/3644313278 wait complete. 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.660+0000 7f65837e8740 20 client.15258 trim_cache size 0 max 16384 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "5f86a62c-ecc4-11ee-95d0-87774f69a715", 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 34535, 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-03-28T05:45:04.665 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 131.59336203399999, 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 23, 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 92, 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 137.31330212699999 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:04.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 msgr2=0x7f65600a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 0x7f65600a4cc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x565556c6bfd0 tx=0x7f6574009580 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 msgr2=0x7f657c199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f656400e9f0 tx=0x7f656400eeb0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 shutdown_connections 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f65600a2800 0x7f65600a4cc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f657c109440 0x7f657c1a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f657c0756e0 0x7f657c199ee0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 --2- 172.21.15.55:0/1105062795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f657c074100 0x7f657c1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 >> 172.21.15.55:0/1105062795 conn(0x7f657c0fcb10 msgr2=0x7f657c105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 shutdown_connections 2024-03-28T05:45:04.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:04.661+0000 7f657b200640 1 -- 172.21.15.55:0/1105062795 wait complete. 2024-03-28T05:45:04.680 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-28T05:45:04.704 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-28T05:45:04.704 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-28T05:45:04.704 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-03-28T05:45:04.704 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T05:45:04.704 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:04.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:04.705 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-03-28T05:45:04.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:04.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-03-28T05:45:04.868 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-03-28T05:45:04.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T05:45:04.872 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-28T05:45:04.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph fs ls 2024-03-28T05:45:04.950 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:04 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1802734497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:04 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1802734497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:04 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1802734497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:05.339 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T05:45:05.739 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:05 smithi055 ceph-mon[31863]: pgmap v435: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:05 smithi086 ceph-mon[35163]: pgmap v435: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:05 smithi159 ceph-mon[36109]: pgmap v435: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.450+0000 7fcebf200700 1 -- 172.21.15.55:0/3105731293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb806aff0 msgr2=0x7fceb810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.450+0000 7fcebf200700 1 --2- 172.21.15.55:0/3105731293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb806aff0 0x7fceb810e730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009990 tx=0x7fcea0009ca0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 -- 172.21.15.55:0/3105731293 shutdown_connections 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 --2- 172.21.15.55:0/3105731293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb810ec70 0x7fceb8111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 --2- 172.21.15.55:0/3105731293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806a6d0 0x7fceb806aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 --2- 172.21.15.55:0/3105731293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb806aff0 0x7fceb810e730 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 -- 172.21.15.55:0/3105731293 >> 172.21.15.55:0/3105731293 conn(0x7fceb80770e0 msgr2=0x7fceb80774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:07.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 -- 172.21.15.55:0/3105731293 shutdown_connections 2024-03-28T05:45:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.451+0000 7fcebf200700 1 -- 172.21.15.55:0/3105731293 wait complete. 2024-03-28T05:45:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.452+0000 7fcebf200700 1 Processor -- start 2024-03-28T05:45:07.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.452+0000 7fcebf200700 1 -- start start 2024-03-28T05:45:07.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb806a6d0 0x7fceb81a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:07.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806aff0 0x7fceb81a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:07.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8114680 con 0x7fceb810ec70 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8114500 con 0x7fceb806aff0 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebf200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8114800 con 0x7fceb806a6d0 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebd200700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60176/0 (socket says 172.21.15.55:60176) 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fcebd200700 1 -- 172.21.15.55:0/67959648 learned_addr learned my addr 172.21.15.55:0/67959648 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.453+0000 7fceb7e00700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb806a6d0 0x7fceb81a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:07.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fceaf400700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806aff0 0x7fceb81a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:07.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 -- 172.21.15.55:0/67959648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb806a6d0 msgr2=0x7fceb81a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:07.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb806a6d0 0x7fceb81a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 -- 172.21.15.55:0/67959648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806aff0 msgr2=0x7fceb81a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:07.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806aff0 0x7fceb81a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 -- 172.21.15.55:0/67959648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb819b180 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebd200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b480 tx=0x7fceb000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0015020 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fceb0011ce0 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.454+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb819b470 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.455+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0010e60 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.455+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb81a76e0 con 0x7fceb810ec70 2024-03-28T05:45:07.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.456+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb8068e50 con 0x7fceb810ec70 2024-03-28T05:45:07.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.458+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fceb0018020 con 0x7fceb810ec70 2024-03-28T05:45:07.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.459+0000 7fceb5600700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 0x7fce9c0a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:07.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.460+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fceb00ce2c0 con 0x7fceb810ec70 2024-03-28T05:45:07.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.460+0000 7fceb7e00700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 0x7fce9c0a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:07.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.460+0000 7fceb7e00700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 0x7fce9c0a4dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fceb81007c0 tx=0x7fcea80094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:07.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.464+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fceb001f020 con 0x7fceb810ec70 2024-03-28T05:45:07.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.746+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fceb819bf00 con 0x7fceb810ec70 2024-03-28T05:45:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.747+0000 7fceb5600700 1 -- 172.21.15.55:0/67959648 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fceb0085070 con 0x7fceb810ec70 2024-03-28T05:45:07.747 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 msgr2=0x7fce9c0a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 0x7fce9c0a4dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fceb81007c0 tx=0x7fcea80094f0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 msgr2=0x7fceb819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b480 tx=0x7fceb000b840 comp rx=0 tx=0).stop 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 shutdown_connections 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fce9c0a2910 0x7fce9c0a4dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fceb810ec70 0x7fceb819aa20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceb806a6d0 0x7fceb81a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 --2- 172.21.15.55:0/67959648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb806aff0 0x7fceb81a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.750+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 >> 172.21.15.55:0/67959648 conn(0x7fceb80770e0 msgr2=0x7fceb8110360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.751+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 shutdown_connections 2024-03-28T05:45:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:07.751+0000 7fcebf200700 1 -- 172.21.15.55:0/67959648 wait complete. 2024-03-28T05:45:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:07 smithi086 ceph-mon[35163]: pgmap v436: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:07 smithi159 ceph-mon[36109]: pgmap v436: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:07 smithi055 ceph-mon[31863]: pgmap v436: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:08.791 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T05:45:08.791 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T05:45:08.792 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-03-28T05:45:08.792 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-28T05:45:08.792 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:08.792 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T05:45:08.792 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T05:45:08.793 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T05:45:08.793 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-28T05:45:08.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:08.794 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-03-28T05:45:08.851 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T05:45:08.851 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-03-28T05:45:08.852 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41286sec preferred_lft 41286sec 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-03-28T05:45:08.853 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-28T05:45:08.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-28T05:45:08.854 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-03-28T05:45:08.944 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:08 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/67959648' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-28T05:45:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:08 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/67959648' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-28T05:45:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:08 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/67959648' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-28T05:45:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:09.346 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T05:45:09.425 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-03-28T05:45:09.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:09.429 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-03-28T05:45:09.490 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-03-28T05:45:09.490 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T05:45:09.490 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-28T05:45:09.490 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-28T05:45:09.490 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T05:45:09.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-28T05:45:09.492 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-03-28T05:45:09.826 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:09 smithi055 ceph-mon[31863]: pgmap v437: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:45:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:09 smithi086 ceph-mon[35163]: pgmap v437: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:45:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:09 smithi159 ceph-mon[36109]: pgmap v437: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:45:10.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:10.263 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-03-28T05:45:10.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:10.308 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-03-28T05:45:10.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:10.402 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-03-28T05:45:10.402 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-03-28T05:45:10.402 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:10.402 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-28T05:45:10.402 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-03-28T05:45:10.543 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-28T05:45:10.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-28T05:45:10.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-28T05:45:10.545 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-03-28T05:45:10.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:10.824 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-03-28T05:45:10.824 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-03-28T05:45:10.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-03-28T05:45:10.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-03-28T05:45:10.825 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-03-28T05:45:10.977 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-03-28T05:45:10.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T05:45:10.978 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:11.023 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-28T05:45:11.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T05:45:11.024 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:11.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-03-28T05:45:11.224 DEBUG:teuthology.orchestra.run.smithi055:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/proc 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/sys 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/dev 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/security 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/shm 2024-03-28T05:45:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/pts 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/run 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/cgroup 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/pstore 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/bpf 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/ 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/selinux 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/hugepages 2024-03-28T05:45:11.282 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/mqueue 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/debug 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/tracing 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/fuse/connections 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/config 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-sysctl.service 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/nfs/rpc_pipefs 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/1000 2024-03-28T05:45:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/ceph 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/191c4717bdb6b05b34be7fa9cd3ec077b0715ad9a72569601a120a22f4b4b083/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/83dade654a6a0d35c9fb543933457d22bc99369babb325b9f7f696e132ea4091/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/0 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8943e1f80b31b9639e3643cc536fc46e7ac9c30ac83e0ef10996bee7a8a1c6f0/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d79bd924b4adde94102fca600f5dfb90be4f26b851dbe3f054e9bf7f8b5a072b/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d5cf4a4c9ac0515dc7b6257ed0292ab4321cdc92da1525b91ed0a3154bb19d11/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/1dffe62224430b48b02adee0e774ad267e016d2ed0128c871adc89968364c2e6/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8df7f3c34c4430e4bc09ad21d73675b1ec8861b6c5f11d214ec6c627645ebd93/merged 2024-03-28T05:45:11.284 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/b69e9dd0d3871a0876e21834295b922ce4a1040aaed71c9f6a160e11117cf727/merged 2024-03-28T05:45:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/94ca6c112f04667213969845917b116359396bc8c7d894fa1d6516bd3004a1c5/merged 2024-03-28T05:45:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/e9be1ae7ced51b22ef78a70e7407e1b11b74632816ff4bdde6c8d08c6a21e574/merged 2024-03-28T05:45:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns 2024-03-28T05:45:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:11.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:11.286 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-03-28T05:45:11.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-28T05:45:11.337 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/e7fce19b-124f-4268-836a-e7c30d9424d8 --client_fs=cephfs) 2024-03-28T05:45:11.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-03-28T05:45:11.418 DEBUG:teuthology.orchestra.run.smithi055:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T05:45:11.464 INFO:teuthology.orchestra.run.smithi055.stdout:/proc 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/sys 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/dev 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/security 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/shm 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/pts 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/run 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/cgroup 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/pstore 2024-03-28T05:45:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/bpf 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/ 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/selinux 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/hugepages 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/mqueue 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/debug 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/tracing 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/fuse/connections 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/config 2024-03-28T05:45:11.466 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-sysctl.service 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/nfs/rpc_pipefs 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/1000 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/ceph 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/191c4717bdb6b05b34be7fa9cd3ec077b0715ad9a72569601a120a22f4b4b083/merged 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/83dade654a6a0d35c9fb543933457d22bc99369babb325b9f7f696e132ea4091/merged 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/0 2024-03-28T05:45:11.467 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8943e1f80b31b9639e3643cc536fc46e7ac9c30ac83e0ef10996bee7a8a1c6f0/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d79bd924b4adde94102fca600f5dfb90be4f26b851dbe3f054e9bf7f8b5a072b/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d5cf4a4c9ac0515dc7b6257ed0292ab4321cdc92da1525b91ed0a3154bb19d11/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/1dffe62224430b48b02adee0e774ad267e016d2ed0128c871adc89968364c2e6/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8df7f3c34c4430e4bc09ad21d73675b1ec8861b6c5f11d214ec6c627645ebd93/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/b69e9dd0d3871a0876e21834295b922ce4a1040aaed71c9f6a160e11117cf727/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/94ca6c112f04667213969845917b116359396bc8c7d894fa1d6516bd3004a1c5/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/e9be1ae7ced51b22ef78a70e7407e1b11b74632816ff4bdde6c8d08c6a21e574/merged 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns 2024-03-28T05:45:11.468 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:11.469 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:11.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:11.470 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-03-28T05:45:11.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-03-28T05:45:11.555+0000 7f97eb3ff480 -1 init, newargv = 0x56100c866230 newargc=15 2024-03-28T05:45:11.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[82143]: starting ceph client 2024-03-28T05:45:11.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[82143]: starting fuse 2024-03-28T05:45:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:11 smithi086 ceph-mon[35163]: pgmap v438: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-03-28T05:45:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:11 smithi159 ceph-mon[36109]: pgmap v438: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-03-28T05:45:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:11 smithi055 ceph-mon[31863]: pgmap v438: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-03-28T05:45:12.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-03-28T05:45:12.770 DEBUG:teuthology.orchestra.run.smithi055:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T05:45:12.828 INFO:teuthology.orchestra.run.smithi055.stdout:/proc 2024-03-28T05:45:12.828 INFO:teuthology.orchestra.run.smithi055.stdout:/sys 2024-03-28T05:45:12.828 INFO:teuthology.orchestra.run.smithi055.stdout:/dev 2024-03-28T05:45:12.828 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/security 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/shm 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/pts 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/run 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/cgroup 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/pstore 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/bpf 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/ 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/selinux 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/hugepages 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/dev/mqueue 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/debug 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/tracing 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/fs/fuse/connections 2024-03-28T05:45:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:/sys/kernel/config 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-sysctl.service 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/nfs/rpc_pipefs 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/1000 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/ceph 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/191c4717bdb6b05b34be7fa9cd3ec077b0715ad9a72569601a120a22f4b4b083/merged 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/83dade654a6a0d35c9fb543933457d22bc99369babb325b9f7f696e132ea4091/merged 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/run/user/0 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8943e1f80b31b9639e3643cc536fc46e7ac9c30ac83e0ef10996bee7a8a1c6f0/merged 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d79bd924b4adde94102fca600f5dfb90be4f26b851dbe3f054e9bf7f8b5a072b/merged 2024-03-28T05:45:12.830 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/d5cf4a4c9ac0515dc7b6257ed0292ab4321cdc92da1525b91ed0a3154bb19d11/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/1dffe62224430b48b02adee0e774ad267e016d2ed0128c871adc89968364c2e6/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/8df7f3c34c4430e4bc09ad21d73675b1ec8861b6c5f11d214ec6c627645ebd93/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/b69e9dd0d3871a0876e21834295b922ce4a1040aaed71c9f6a160e11117cf727/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/94ca6c112f04667213969845917b116359396bc8c7d894fa1d6516bd3004a1c5/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/var/lib/containers/storage/overlay/e9be1ae7ced51b22ef78a70e7407e1b11b74632816ff4bdde6c8d08c6a21e574/merged 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T05:45:12.831 INFO:teuthology.orchestra.run.smithi055.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:12.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:12.832 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-03-28T05:45:12.887 INFO:teuthology.orchestra.run.smithi055.stdout:118 2024-03-28T05:45:12.887 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [118] 2024-03-28T05:45:12.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo stdin-killer -- python3 -c ' 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> 2024-03-28T05:45:12.888 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-03-28T05:45:12.889 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-03-28T05:45:13.075 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.82143.asok 2024-03-28T05:45:13.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T05:45:13.093 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82143.asok 2024-03-28T05:45:13.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:13.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82143.asok status 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "3be9a5c9bc793e11e2800a8c0c696e8b46742033", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev)", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "82143", 2024-03-28T05:45:13.337 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/volumes/qa/sv_0/e7fce19b-124f-4268-836a-e7c30d9424d8" 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 15270, 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 15270 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1775161137 2024-03-28T05:45:13.338 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1775161137 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.15270 192.168.0.1:0/1775161137", 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1775161137", 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 5, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 23, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 92, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-03-28T05:45:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:13.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:13.353 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-03-28T05:45:13.353 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-03-28T05:45:13.411 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:13.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:13.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:13.521 INFO:teuthology.run_tasks:Running task exec... 2024-03-28T05:45:13.530 INFO:teuthology.task.exec:Executing custom commands... 2024-03-28T05:45:13.531 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi055.front.sepia.ceph.com 2024-03-28T05:45:13.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-03-28T05:45:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 -- 172.21.15.55:0/630328529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89701054b0 msgr2=0x7f897010bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 --2- 172.21.15.55:0/630328529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89701054b0 0x7f897010bd40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8968009ca0 tx=0x7f896802c100 comp rx=0 tx=0).stop 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 -- 172.21.15.55:0/630328529 shutdown_connections 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 --2- 172.21.15.55:0/630328529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89701054b0 0x7f897010bd40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 --2- 172.21.15.55:0/630328529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 0x7f8970104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 --2- 172.21.15.55:0/630328529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8970103900 0x7f8970103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 -- 172.21.15.55:0/630328529 >> 172.21.15.55:0/630328529 conn(0x7f89700fee90 msgr2=0x7f89701012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 -- 172.21.15.55:0/630328529 shutdown_connections 2024-03-28T05:45:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.755+0000 7f8974a00640 1 -- 172.21.15.55:0/630328529 wait complete. 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.756+0000 7f8974a00640 1 Processor -- start 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 -- start start 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 0x7f8970199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89701054b0 0x7f89701a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897010f410 con 0x7f8970103900 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897010f290 con 0x7f8970104af0 2024-03-28T05:45:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f8974a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897010f590 con 0x7f89701054b0 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f896de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f896de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55640/0 (socket says 172.21.15.55:55640) 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.757+0000 7f896de00640 1 -- 172.21.15.55:0/1476852688 learned_addr learned my addr 172.21.15.55:0/1476852688 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 -- 172.21.15.55:0/1476852688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89701054b0 msgr2=0x7f89701a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896e800640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89701054b0 0x7f89701a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89701054b0 0x7f89701a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 -- 172.21.15.55:0/1476852688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 msgr2=0x7f8970199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f8967e00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 0x7f8970199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 0x7f8970199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 -- 172.21.15.55:0/1476852688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89701a15e0 con 0x7f8970103900 2024-03-28T05:45:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.758+0000 7f896de00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f896000c970 tx=0x7f896000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.759+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960007c10 con 0x7f8970103900 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.759+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8960007db0 con 0x7f8970103900 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.759+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000f870 con 0x7f8970103900 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.759+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89701a18d0 con 0x7f8970103900 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.759+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89701a1dd0 con 0x7f8970103900 2024-03-28T05:45:13.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.761+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897010ac20 con 0x7f8970103900 2024-03-28T05:45:13.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.763+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f896000fa10 con 0x7f8970103900 2024-03-28T05:45:13.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.764+0000 7f8966a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 0x7f89540a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:13.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.764+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f89600cee70 con 0x7f8970103900 2024-03-28T05:45:13.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.764+0000 7f8967e00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 0x7f89540a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:13.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.765+0000 7f8967e00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 0x7f89540a4de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8958005fd0 tx=0x7f8958009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:13.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:13.769+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f896009bf60 con 0x7f8970103900 2024-03-28T05:45:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:13 smithi055 ceph-mon[31863]: pgmap v439: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:14.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.018+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7f897002d070 con 0x7f8970103900 2024-03-28T05:45:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:13 smithi086 ceph-mon[35163]: pgmap v439: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:13 smithi159 ceph-mon[36109]: pgmap v439: 97 pgs: 97 active+clean; 645 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-28T05:45:14.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.774+0000 7f8966a00640 1 -- 172.21.15.55:0/1476852688 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) v1 ==== 117+0+0 (secure 0 0 0) 0x7f896009b860 con 0x7f8970103900 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 msgr2=0x7f89540a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 0x7f89540a4de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8958005fd0 tx=0x7f8958009470 comp rx=0 tx=0).stop 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 msgr2=0x7f89701999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f896000c970 tx=0x7f896000ce30 comp rx=0 tx=0).stop 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 shutdown_connections 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f89540a2920 0x7f89540a4de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89701054b0 0x7f89701a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8970104af0 0x7f8970199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 --2- 172.21.15.55:0/1476852688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8970103900 0x7f89701999c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 >> 172.21.15.55:0/1476852688 conn(0x7f89700fee90 msgr2=0x7f8970107df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 shutdown_connections 2024-03-28T05:45:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:14.778+0000 7f8974a00640 1 -- 172.21.15.55:0/1476852688 wait complete. 2024-03-28T05:45:14.798 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-28T05:45:14.808 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-28T05:45:14.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.044+0000 7f6420800640 1 -- 172.21.15.55:0/3275289465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 msgr2=0x7f64181097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.044+0000 7f6420800640 1 --2- 172.21.15.55:0/3275289465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181097e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6414009ca0 tx=0x7f641402c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 -- 172.21.15.55:0/3275289465 shutdown_connections 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 --2- 172.21.15.55:0/3275289465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181097e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 --2- 172.21.15.55:0/3275289465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418104ac0 0x7f6418106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 --2- 172.21.15.55:0/3275289465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418102190 0x7f6418104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 -- 172.21.15.55:0/3275289465 >> 172.21.15.55:0/3275289465 conn(0x7f64180fbb20 msgr2=0x7f64180fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:15.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 -- 172.21.15.55:0/3275289465 shutdown_connections 2024-03-28T05:45:15.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.045+0000 7f6420800640 1 -- 172.21.15.55:0/3275289465 wait complete. 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 Processor -- start 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 -- start start 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 0x7f6418199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 0x7f641819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641810d200 con 0x7f64181073f0 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641810d080 con 0x7f6418104ac0 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.046+0000 7f6420800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641810d380 con 0x7f6418102190 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55658/0 (socket says 172.21.15.55:55658) 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 -- 172.21.15.55:0/368646623 learned_addr learned my addr 172.21.15.55:0/368646623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641d400640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 0x7f641819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641de00640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 0x7f6418199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 -- 172.21.15.55:0/368646623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 msgr2=0x7f6418199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 0x7f6418199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 -- 172.21.15.55:0/368646623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 msgr2=0x7f641819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 0x7f641819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641e800640 1 -- 172.21.15.55:0/368646623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64181a1710 con 0x7f64181073f0 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641de00640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 0x7f6418199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.047+0000 7f641d400640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 0x7f641819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f641e800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f641402c700 tx=0x7f64140328a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414041020 con 0x7f64181073f0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6414003e20 con 0x7f64181073f0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414039040 con 0x7f64181073f0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64181a19a0 con 0x7f64181073f0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.048+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64181a1e40 con 0x7f64181073f0 2024-03-28T05:45:15.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.049+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6418108ee0 con 0x7f64181073f0 2024-03-28T05:45:15.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.051+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f6414044020 con 0x7f64181073f0 2024-03-28T05:45:15.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.053+0000 7f6412a00640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 0x7f64000a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.053+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f64140f1130 con 0x7f64181073f0 2024-03-28T05:45:15.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.053+0000 7f641de00640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 0x7f64000a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.054+0000 7f641de00640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 0x7f64000a4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f640c009b50 tx=0x7f640c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.055+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f641404b020 con 0x7f64181073f0 2024-03-28T05:45:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:14 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-28T05:45:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:14 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-28T05:45:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:14 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-28T05:45:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.259+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641802d240 con 0x7f64181073f0 2024-03-28T05:45:15.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.263+0000 7f6412a00640 1 -- 172.21.15.55:0/368646623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f64140be190 con 0x7f64181073f0 2024-03-28T05:45:15.264 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:15.265 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.265+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 msgr2=0x7f64000a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.265+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 0x7f64000a4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f640c009b50 tx=0x7f640c005f90 comp rx=0 tx=0).stop 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.265+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 msgr2=0x7f64181a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.265+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f641402c700 tx=0x7f64140328a0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 shutdown_connections 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f64000a2880 0x7f64000a4d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64181073f0 0x7f64181a10a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6418104ac0 0x7f641819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 --2- 172.21.15.55:0/368646623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6418102190 0x7f6418199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 >> 172.21.15.55:0/368646623 conn(0x7f64180fbb20 msgr2=0x7f64181018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 shutdown_connections 2024-03-28T05:45:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.266+0000 7f6420800640 1 -- 172.21.15.55:0/368646623 wait complete. 2024-03-28T05:45:15.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:45:15.288 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:45:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 -- 172.21.15.55:0/790195062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc102140 msgr2=0x7f00fc104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 --2- 172.21.15.55:0/790195062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc102140 0x7f00fc104530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009900 tx=0x7f00ec02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 -- 172.21.15.55:0/790195062 shutdown_connections 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 --2- 172.21.15.55:0/790195062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc1073a0 0x7f00fc1097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 --2- 172.21.15.55:0/790195062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 0x7f00fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 --2- 172.21.15.55:0/790195062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc102140 0x7f00fc104530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 -- 172.21.15.55:0/790195062 >> 172.21.15.55:0/790195062 conn(0x7f00fc0fbb50 msgr2=0x7f00fc0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 -- 172.21.15.55:0/790195062 shutdown_connections 2024-03-28T05:45:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.503+0000 7f0101e00640 1 -- 172.21.15.55:0/790195062 wait complete. 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.504+0000 7f0101e00640 1 Processor -- start 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.504+0000 7f0101e00640 1 -- start start 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc102140 0x7f00fc199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 0x7f00fc19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc10d260 con 0x7f00fc1073a0 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc10d0e0 con 0x7f00fc104a70 2024-03-28T05:45:15.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f0101e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc10d3e0 con 0x7f00fc102140 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f00fb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f00fb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55680/0 (socket says 172.21.15.55:55680) 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f00fb400640 1 -- 172.21.15.55:0/4025146 learned_addr learned my addr 172.21.15.55:0/4025146 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f00fa000640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 0x7f00fc19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.505+0000 7f00faa00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc102140 0x7f00fc199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 -- 172.21.15.55:0/4025146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc102140 msgr2=0x7f00fc199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc102140 0x7f00fc199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 -- 172.21.15.55:0/4025146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 msgr2=0x7f00fc19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 0x7f00fc19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 -- 172.21.15.55:0/4025146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc1a1780 con 0x7f00fc1073a0 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f00fb400640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f00f400d750 tx=0x7f00f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4017070 con 0x7f00fc1073a0 2024-03-28T05:45:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f00f40054d0 con 0x7f00fc1073a0 2024-03-28T05:45:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4004c60 con 0x7f00fc1073a0 2024-03-28T05:45:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.506+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc1a1a70 con 0x7f00fc1073a0 2024-03-28T05:45:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.507+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc1a2010 con 0x7f00fc1073a0 2024-03-28T05:45:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.508+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc108ef0 con 0x7f00fc1073a0 2024-03-28T05:45:15.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.510+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f00f4004e00 con 0x7f00fc1073a0 2024-03-28T05:45:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.511+0000 7f0100a00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 0x7f00dc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.511+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f00f40ce2f0 con 0x7f00fc1073a0 2024-03-28T05:45:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.512+0000 7f00faa00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 0x7f00dc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.512+0000 7f00faa00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 0x7f00dc0a4d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec02c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.516+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f00f409ad00 con 0x7f00fc1073a0 2024-03-28T05:45:15.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.727+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00fc062340 con 0x7f00fc1073a0 2024-03-28T05:45:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.728+0000 7f0100a00640 1 -- 172.21.15.55:0/4025146 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00f409eda0 con 0x7f00fc1073a0 2024-03-28T05:45:15.729 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.730+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 msgr2=0x7f00dc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.730+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 0x7f00dc0a4d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000c00 tx=0x7f00ec02c7e0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 msgr2=0x7f00fc1a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f00f400d750 tx=0x7f00f400dc10 comp rx=0 tx=0).stop 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 shutdown_connections 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f00dc0a2880 0x7f00dc0a4d40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00fc1073a0 0x7f00fc1a1110 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00fc104a70 0x7f00fc19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 --2- 172.21.15.55:0/4025146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00fc102140 0x7f00fc199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 >> 172.21.15.55:0/4025146 conn(0x7f00fc0fbb50 msgr2=0x7f00fc101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 shutdown_connections 2024-03-28T05:45:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.731+0000 7f0101e00640 1 -- 172.21.15.55:0/4025146 wait complete. 2024-03-28T05:45:15.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:45:15.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 -- 172.21.15.55:0/3440289263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc1015a0 msgr2=0x7f1fdc1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3440289263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc1019c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009900 tx=0x7f1fd002bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:15.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 -- 172.21.15.55:0/3440289263 shutdown_connections 2024-03-28T05:45:15.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3440289263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc103150 0x7f1fdc1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3440289263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc102790 0x7f1fdc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3440289263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc1019c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 -- 172.21.15.55:0/3440289263 >> 172.21.15.55:0/3440289263 conn(0x7f1fdc0fcb10 msgr2=0x7f1fdc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:15.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 -- 172.21.15.55:0/3440289263 shutdown_connections 2024-03-28T05:45:15.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.972+0000 7f1fe2800640 1 -- 172.21.15.55:0/3440289263 wait complete. 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 Processor -- start 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 -- start start 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc103150 0x7f1fdc073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc10d0b0 con 0x7f1fdc102790 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc10cf30 con 0x7f1fdc1015a0 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.973+0000 7f1fe2800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc10d230 con 0x7f1fdc103150 2024-03-28T05:45:15.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55712/0 (socket says 172.21.15.55:55712) 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 -- 172.21.15.55:0/3605944111 learned_addr learned my addr 172.21.15.55:0/3605944111 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe1400640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 -- 172.21.15.55:0/3605944111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc103150 msgr2=0x7f1fdc073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc103150 0x7f1fdc073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 -- 172.21.15.55:0/3605944111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc1015a0 msgr2=0x7f1fdc075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 -- 172.21.15.55:0/3605944111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc074860 con 0x7f1fdc102790 2024-03-28T05:45:15.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.974+0000 7f1fe0a00640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d950 tx=0x7f1fc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.975+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8017070 con 0x7f1fdc102790 2024-03-28T05:45:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.975+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f1fc8009c30 con 0x7f1fdc102790 2024-03-28T05:45:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.975+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800f620 con 0x7f1fdc102790 2024-03-28T05:45:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.975+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc1a1930 con 0x7f1fdc102790 2024-03-28T05:45:15.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.975+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc1a1e80 con 0x7f1fdc102790 2024-03-28T05:45:15.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.976+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc108990 con 0x7f1fdc102790 2024-03-28T05:45:15.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.979+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f1fc80109a0 con 0x7f1fdc102790 2024-03-28T05:45:15.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.980+0000 7f1fda000640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 0x7f1fc40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:15.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.981+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1fc80ce6e0 con 0x7f1fdc102790 2024-03-28T05:45:15.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.981+0000 7f1fe1400640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 0x7f1fc40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:15.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.982+0000 7f1fe1400640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 0x7f1fc40a4cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0005ab0 tx=0x7f1fd0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:15.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:15.983+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f1fc8009de0 con 0x7f1fdc102790 2024-03-28T05:45:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:15 smithi086 ceph-mon[35163]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-28T05:45:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:15 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-28T05:45:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:15 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:45:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:15 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/368646623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:15 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4025146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:15 smithi159 ceph-mon[36109]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-28T05:45:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:15 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-28T05:45:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:15 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:45:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:15 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/368646623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:15 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4025146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:15 smithi055 ceph-mon[31863]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-28T05:45:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:15 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1476852688' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-28T05:45:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:15 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:45:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:15 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/368646623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:15 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4025146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:16.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.186+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fdc02d200 con 0x7f1fdc102790 2024-03-28T05:45:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.187+0000 7f1fda000640 1 -- 172.21.15.55:0/3605944111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fc809b740 con 0x7f1fdc102790 2024-03-28T05:45:16.188 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:45:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.189+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 msgr2=0x7f1fc40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.189+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 0x7f1fc40a4cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0005ab0 tx=0x7f1fd0005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 msgr2=0x7f1fdc073a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d950 tx=0x7f1fc800de10 comp rx=0 tx=0).stop 2024-03-28T05:45:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 shutdown_connections 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f1fc40a2800 0x7f1fc40a4cc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fdc103150 0x7f1fdc073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc102790 0x7f1fdc073a90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 --2- 172.21.15.55:0/3605944111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fdc1015a0 0x7f1fdc075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 >> 172.21.15.55:0/3605944111 conn(0x7f1fdc0fcb10 msgr2=0x7f1fdc105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 shutdown_connections 2024-03-28T05:45:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.190+0000 7f1fe2800640 1 -- 172.21.15.55:0/3605944111 wait complete. 2024-03-28T05:45:16.211 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:45:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 -- 172.21.15.55:0/2335556711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8103130 msgr2=0x7f4fd81099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 --2- 172.21.15.55:0/2335556711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8103130 0x7f4fd81099c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009ca0 tx=0x7f4fd002c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 -- 172.21.15.55:0/2335556711 shutdown_connections 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 --2- 172.21.15.55:0/2335556711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8103130 0x7f4fd81099c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 --2- 172.21.15.55:0/2335556711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8102770 0x7f4fd8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 --2- 172.21.15.55:0/2335556711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 0x7f4fd81019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 -- 172.21.15.55:0/2335556711 >> 172.21.15.55:0/2335556711 conn(0x7f4fd80fcb10 msgr2=0x7f4fd80fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 -- 172.21.15.55:0/2335556711 shutdown_connections 2024-03-28T05:45:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.447+0000 7f4fdda00640 1 -- 172.21.15.55:0/2335556711 wait complete. 2024-03-28T05:45:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.448+0000 7f4fdda00640 1 Processor -- start 2024-03-28T05:45:16.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.448+0000 7f4fdda00640 1 -- start start 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 0x7f4fd8197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8103130 0x7f4fd819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810d0b0 con 0x7f4fd8102770 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810cf30 con 0x7f4fd8103130 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdda00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810d230 con 0x7f4fd8101580 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fd7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fd7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55728/0 (socket says 172.21.15.55:55728) 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fd7400640 1 -- 172.21.15.55:0/3835077827 learned_addr learned my addr 172.21.15.55:0/3835077827 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fdd000640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8103130 0x7f4fd819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.449+0000 7f4fd7e00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 0x7f4fd8197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 -- 172.21.15.55:0/3835077827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 msgr2=0x7f4fd8197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 0x7f4fd8197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 -- 172.21.15.55:0/3835077827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8103130 msgr2=0x7f4fd819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8103130 0x7f4fd819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 -- 172.21.15.55:0/3835077827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd819f370 con 0x7f4fd8102770 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd7400640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400d950 tx=0x7f4fc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4017070 con 0x7f4fd8102770 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f4fc4009c30 con 0x7f4fd8102770 2024-03-28T05:45:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd819f660 con 0x7f4fd8102770 2024-03-28T05:45:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f620 con 0x7f4fd8102770 2024-03-28T05:45:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.450+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd819fbb0 con 0x7f4fd8102770 2024-03-28T05:45:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.452+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd81088c0 con 0x7f4fd8102770 2024-03-28T05:45:16.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.454+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f4fc40109a0 con 0x7f4fd8102770 2024-03-28T05:45:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.456+0000 7f4fd4c00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 0x7f4fbc0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.456+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4fc40ce7a0 con 0x7f4fd8102770 2024-03-28T05:45:16.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.456+0000 7f4fd7e00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 0x7f4fbc0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.457+0000 7f4fd7e00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 0x7f4fbc0a4cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8005fd0 tx=0x7f4fc8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:16.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.460+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f4fc4009de0 con 0x7f4fd8102770 2024-03-28T05:45:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.663+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4fd80622a0 con 0x7f4fd8102770 2024-03-28T05:45:16.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.664+0000 7f4fd4c00640 1 -- 172.21.15.55:0/3835077827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fc409b800 con 0x7f4fd8102770 2024-03-28T05:45:16.665 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:45:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.666+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 msgr2=0x7f4fbc0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.666+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 0x7f4fbc0a4cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8005fd0 tx=0x7f4fc8005850 comp rx=0 tx=0).stop 2024-03-28T05:45:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.666+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 msgr2=0x7f4fd8197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.666+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400d950 tx=0x7f4fc400de10 comp rx=0 tx=0).stop 2024-03-28T05:45:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 shutdown_connections 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f4fbc0a2800 0x7f4fbc0a4cc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fd8103130 0x7f4fd819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd8102770 0x7f4fd8197c90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 --2- 172.21.15.55:0/3835077827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4fd8101580 0x7f4fd8197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 >> 172.21.15.55:0/3835077827 conn(0x7f4fd80fcb10 msgr2=0x7f4fd8105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 shutdown_connections 2024-03-28T05:45:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.667+0000 7f4fdda00640 1 -- 172.21.15.55:0/3835077827 wait complete. 2024-03-28T05:45:16.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 -- 172.21.15.55:0/1854822741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 msgr2=0x7f7d60106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 --2- 172.21.15.55:0/1854822741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60106c90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009900 tx=0x7f7d4802bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 -- 172.21.15.55:0/1854822741 shutdown_connections 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 --2- 172.21.15.55:0/1854822741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d601071d0 0x7f7d60109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 --2- 172.21.15.55:0/1854822741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60106c90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 --2- 172.21.15.55:0/1854822741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d60101f70 0x7f7d60104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 -- 172.21.15.55:0/1854822741 >> 172.21.15.55:0/1854822741 conn(0x7f7d600fb980 msgr2=0x7f7d600fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 -- 172.21.15.55:0/1854822741 shutdown_connections 2024-03-28T05:45:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.916+0000 7f7d66200640 1 -- 172.21.15.55:0/1854822741 wait complete. 2024-03-28T05:45:16.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.917+0000 7f7d66200640 1 Processor -- start 2024-03-28T05:45:16.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.917+0000 7f7d66200640 1 -- start start 2024-03-28T05:45:16.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d60101f70 0x7f7d60199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d601071d0 0x7f7d601a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6010d040 con 0x7f7d601048a0 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6010cec0 con 0x7f7d60101f70 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d66200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6010d1c0 con 0x7f7d601071d0 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d57e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d57e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55758/0 (socket says 172.21.15.55:55758) 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d57e00640 1 -- 172.21.15.55:0/1156940522 learned_addr learned my addr 172.21.15.55:0/1156940522 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d64e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d60101f70 0x7f7d60199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d65800640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d601071d0 0x7f7d601a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.918+0000 7f7d57e00640 1 -- 172.21.15.55:0/1156940522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d601071d0 msgr2=0x7f7d601a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d57e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d601071d0 0x7f7d601a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d57e00640 1 -- 172.21.15.55:0/1156940522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d60101f70 msgr2=0x7f7d60199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d57e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d60101f70 0x7f7d60199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d57e00640 1 -- 172.21.15.55:0/1156940522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d601a1550 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d57e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005ab0 tx=0x7f7d480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48043020 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7d480054c0 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48003d10 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d601a17e0 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.919+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d601a1ce0 con 0x7f7d601048a0 2024-03-28T05:45:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.920+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d60108d20 con 0x7f7d601048a0 2024-03-28T05:45:16.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.922+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f7d48046020 con 0x7f7d601048a0 2024-03-28T05:45:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.925+0000 7f7d5e000640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 0x7f7d440a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.925+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7d480f1200 con 0x7f7d601048a0 2024-03-28T05:45:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.925+0000 7f7d64e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 0x7f7d440a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.926+0000 7f7d64e00640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 0x7f7d440a4cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005fd0 tx=0x7f7d50009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:16.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:16.927+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f7d4804d020 con 0x7f7d601048a0 2024-03-28T05:45:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:16 smithi086 ceph-mon[35163]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:16 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3605944111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:16 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3835077827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:16 smithi159 ceph-mon[36109]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:16 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3605944111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:16 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3835077827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:16 smithi055 ceph-mon[31863]: pgmap v441: 97 pgs: 97 active+clean; 647 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:16 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3605944111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:16 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3835077827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:17.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.131+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d6002d2c0 con 0x7f7d601048a0 2024-03-28T05:45:17.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.135+0000 7f7d5e000640 1 -- 172.21.15.55:0/1156940522 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f7d480be260 con 0x7f7d601048a0 2024-03-28T05:45:17.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:17.137 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 msgr2=0x7f7d440a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 0x7f7d440a4cc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005fd0 tx=0x7f7d50009680 comp rx=0 tx=0).stop 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 msgr2=0x7f7d60199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005ab0 tx=0x7f7d480042f0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 shutdown_connections 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7d440a2800 0x7f7d440a4cc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d601071d0 0x7f7d601a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d601048a0 0x7f7d60199e70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 --2- 172.21.15.55:0/1156940522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d60101f70 0x7f7d60199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 >> 172.21.15.55:0/1156940522 conn(0x7f7d600fb980 msgr2=0x7f7d60101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:17.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 shutdown_connections 2024-03-28T05:45:17.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.138+0000 7f7d66200640 1 -- 172.21.15.55:0/1156940522 wait complete. 2024-03-28T05:45:17.159 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:45:17.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 -- 172.21.15.55:0/741987323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c103130 msgr2=0x7f402c1099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 --2- 172.21.15.55:0/741987323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c103130 0x7f402c1099c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4024009ca0 tx=0x7f402402c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 -- 172.21.15.55:0/741987323 shutdown_connections 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 --2- 172.21.15.55:0/741987323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c103130 0x7f402c1099c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 --2- 172.21.15.55:0/741987323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c102770 0x7f402c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.385+0000 7f4032e00640 1 --2- 172.21.15.55:0/741987323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 0x7f402c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.386+0000 7f4032e00640 1 -- 172.21.15.55:0/741987323 >> 172.21.15.55:0/741987323 conn(0x7f402c0fcb10 msgr2=0x7f402c0fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:17.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.386+0000 7f4032e00640 1 -- 172.21.15.55:0/741987323 shutdown_connections 2024-03-28T05:45:17.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.386+0000 7f4032e00640 1 -- 172.21.15.55:0/741987323 wait complete. 2024-03-28T05:45:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 Processor -- start 2024-03-28T05:45:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 -- start start 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 0x7f402c075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 0x7f402c073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c10d0c0 con 0x7f402c102770 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c10cf40 con 0x7f402c103130 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.387+0000 7f4032e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c10d240 con 0x7f402c101580 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55784/0 (socket says 172.21.15.55:55784) 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 -- 172.21.15.55:0/4232277811 learned_addr learned my addr 172.21.15.55:0/4232277811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4032400640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 0x7f402c073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031a00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 0x7f402c075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 -- 172.21.15.55:0/4232277811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 msgr2=0x7f402c075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 0x7f402c075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 -- 172.21.15.55:0/4232277811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 msgr2=0x7f402c073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 0x7f402c073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 -- 172.21.15.55:0/4232277811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c074860 con 0x7f402c102770 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4032400640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 0x7f402c073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.388+0000 7f4031000640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f401800ea60 tx=0x7f401800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.389+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401800cde0 con 0x7f402c102770 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.389+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f40180035f0 con 0x7f402c102770 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.389+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018010690 con 0x7f402c102770 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.389+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c1a1810 con 0x7f402c102770 2024-03-28T05:45:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.389+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c1a1d10 con 0x7f402c102770 2024-03-28T05:45:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.390+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c1088f0 con 0x7f402c102770 2024-03-28T05:45:17.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.393+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f40180037a0 con 0x7f402c102770 2024-03-28T05:45:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.395+0000 7f402a000640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 0x7f40140a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.395+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f40180cee40 con 0x7f402c102770 2024-03-28T05:45:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.396+0000 7f4031a00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 0x7f40140a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.396+0000 7f4031a00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 0x7f40140a4d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4020005fd0 tx=0x7f4020005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:17.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.400+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f401809bee0 con 0x7f402c102770 2024-03-28T05:45:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.600+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f402c02d320 con 0x7f402c102770 2024-03-28T05:45:17.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.601+0000 7f402a000640 1 -- 172.21.15.55:0/4232277811 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f401809b7e0 con 0x7f402c102770 2024-03-28T05:45:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:45:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 msgr2=0x7f40140a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 0x7f40140a4d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4020005fd0 tx=0x7f4020005850 comp rx=0 tx=0).stop 2024-03-28T05:45:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 msgr2=0x7f402c073a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f401800ea60 tx=0x7f401800ef20 comp rx=0 tx=0).stop 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 shutdown_connections 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f40140a2880 0x7f40140a4d40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402c103130 0x7f402c073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f402c102770 0x7f402c073a90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 --2- 172.21.15.55:0/4232277811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f402c101580 0x7f402c075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.603+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 >> 172.21.15.55:0/4232277811 conn(0x7f402c0fcb10 msgr2=0x7f402c105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.604+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 shutdown_connections 2024-03-28T05:45:17.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.604+0000 7f4032e00640 1 -- 172.21.15.55:0/4232277811 wait complete. 2024-03-28T05:45:17.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:45:17.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 -- 172.21.15.55:0/1044362065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 msgr2=0x7f5c5410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 --2- 172.21.15.55:0/1044362065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c5410bc00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009ca0 tx=0x7f5c4c02c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 -- 172.21.15.55:0/1044362065 shutdown_connections 2024-03-28T05:45:17.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 --2- 172.21.15.55:0/1044362065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c5410bc00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 --2- 172.21.15.55:0/1044362065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541049b0 0x7f5c54104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 --2- 172.21.15.55:0/1044362065 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541037c0 0x7f5c54103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 -- 172.21.15.55:0/1044362065 >> 172.21.15.55:0/1044362065 conn(0x7f5c540fed50 msgr2=0x7f5c54101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:17.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 -- 172.21.15.55:0/1044362065 shutdown_connections 2024-03-28T05:45:17.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.851+0000 7f5c53200640 1 -- 172.21.15.55:0/1044362065 wait complete. 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.852+0000 7f5c53200640 1 Processor -- start 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.852+0000 7f5c53200640 1 -- start start 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541037c0 0x7f5c54199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 0x7f5c54199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5410f2f0 con 0x7f5c54105370 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5410f170 con 0x7f5c541037c0 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c53200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5410f470 con 0x7f5c541049b0 2024-03-28T05:45:17.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55804/0 (socket says 172.21.15.55:55804) 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 -- 172.21.15.55:0/2290177605 learned_addr learned my addr 172.21.15.55:0/2290177605 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c51e00640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541037c0 0x7f5c54199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c51400640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 0x7f5c54199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 -- 172.21.15.55:0/2290177605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 msgr2=0x7f5c54199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 0x7f5c54199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 -- 172.21.15.55:0/2290177605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541037c0 msgr2=0x7f5c54199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:17.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541037c0 0x7f5c54199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c52800640 1 -- 172.21.15.55:0/2290177605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c541a1560 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.853+0000 7f5c51400640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 0x7f5c54199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c52800640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c032380 tx=0x7f5c4c032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c041020 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c541a17f0 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5c4c003e20 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c039040 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.854+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c541a1d30 con 0x7f5c54105370 2024-03-28T05:45:17.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.855+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5410aae0 con 0x7f5c54105370 2024-03-28T05:45:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.857+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f5c4c044020 con 0x7f5c54105370 2024-03-28T05:45:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.859+0000 7f5c4aa00640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 0x7f5c380a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.859+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5c4c0f1070 con 0x7f5c54105370 2024-03-28T05:45:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.859+0000 7f5c51e00640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 0x7f5c380a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:17.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.860+0000 7f5c51e00640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 0x7f5c380a4cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c44005fd0 tx=0x7f5c44005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:17.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:17.861+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f5c4c04b020 con 0x7f5c54105370 2024-03-28T05:45:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:17 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1156940522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:17 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4232277811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.065+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c5402d070 con 0x7f5c54105370 2024-03-28T05:45:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.066+0000 7f5c4aa00640 1 -- 172.21.15.55:0/2290177605 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c4c0333a0 con 0x7f5c54105370 2024-03-28T05:45:18.068 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:45:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:17 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1156940522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:17 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4232277811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 msgr2=0x7f5c380a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 0x7f5c380a4cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c44005fd0 tx=0x7f5c44005850 comp rx=0 tx=0).stop 2024-03-28T05:45:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 msgr2=0x7f5c541a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c032380 tx=0x7f5c4c032820 comp rx=0 tx=0).stop 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 shutdown_connections 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f5c380a2800 0x7f5c380a4cc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c54105370 0x7f5c541a0ef0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c541049b0 0x7f5c54199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 --2- 172.21.15.55:0/2290177605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c541037c0 0x7f5c54199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 >> 172.21.15.55:0/2290177605 conn(0x7f5c540fed50 msgr2=0x7f5c54107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 shutdown_connections 2024-03-28T05:45:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.069+0000 7f5c53200640 1 -- 172.21.15.55:0/2290177605 wait complete. 2024-03-28T05:45:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:17 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1156940522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:17 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4232277811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:18.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:45:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 -- 172.21.15.55:0/2652117292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 msgr2=0x7fa0e0074500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 --2- 172.21.15.55:0/2652117292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0074500 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009900 tx=0x7fa0cc02bcd0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 -- 172.21.15.55:0/2652117292 shutdown_connections 2024-03-28T05:45:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 --2- 172.21.15.55:0/2652117292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e010b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 --2- 172.21.15.55:0/2652117292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0074500 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 --2- 172.21.15.55:0/2652117292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 0x7fa0e0073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 -- 172.21.15.55:0/2652117292 >> 172.21.15.55:0/2652117292 conn(0x7fa0e00fcb10 msgr2=0x7fa0e00fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 -- 172.21.15.55:0/2652117292 shutdown_connections 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.314+0000 7fa0e5400640 1 -- 172.21.15.55:0/2652117292 wait complete. 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 Processor -- start 2024-03-28T05:45:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 -- start start 2024-03-28T05:45:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 0x7fa0e0199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e01a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e010f2e0 con 0x7fa0e00740a0 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e010f160 con 0x7fa0e0109410 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.315+0000 7fa0e5400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e010f460 con 0x7fa0e0075680 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55824/0 (socket says 172.21.15.55:55824) 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 -- 172.21.15.55:0/4028328097 learned_addr learned my addr 172.21.15.55:0/4028328097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0e4a00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e01a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0df400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 0x7fa0e0199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 -- 172.21.15.55:0/4028328097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 msgr2=0x7fa0e0199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 0x7fa0e0199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 -- 172.21.15.55:0/4028328097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 msgr2=0x7fa0e01a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e01a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 -- 172.21.15.55:0/4028328097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e01a15a0 con 0x7fa0e00740a0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0e4a00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e01a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.316+0000 7fa0dfe00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000d950 tx=0x7fa0d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.317+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0017070 con 0x7fa0e00740a0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.317+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa0d0009c30 con 0x7fa0e00740a0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.317+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e01a1890 con 0x7fa0e00740a0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.317+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000f620 con 0x7fa0e00740a0 2024-03-28T05:45:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.317+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01a1de0 con 0x7fa0e00740a0 2024-03-28T05:45:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.318+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e01081d0 con 0x7fa0e00740a0 2024-03-28T05:45:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.320+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa0d00109a0 con 0x7fa0e00740a0 2024-03-28T05:45:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.321+0000 7fa0dcc00640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 0x7fa0c40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.322+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa0d00ce7a0 con 0x7fa0e00740a0 2024-03-28T05:45:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.322+0000 7fa0df400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 0x7fa0c40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.323+0000 7fa0df400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 0x7fa0c40a4cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0096c0 tx=0x7fa0cc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:18.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.326+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa0d0009de0 con 0x7fa0e00740a0 2024-03-28T05:45:18.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.533+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0e00622a0 con 0x7fa0e00740a0 2024-03-28T05:45:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.534+0000 7fa0dcc00640 1 -- 172.21.15.55:0/4028328097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0d009b800 con 0x7fa0e00740a0 2024-03-28T05:45:18.535 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 msgr2=0x7fa0c40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 0x7fa0c40a4cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0096c0 tx=0x7fa0cc005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 msgr2=0x7fa0e0199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000d950 tx=0x7fa0d000de10 comp rx=0 tx=0).stop 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 shutdown_connections 2024-03-28T05:45:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0c40a2800 0x7fa0c40a4cc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0e0109410 0x7fa0e01a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0e0075680 0x7fa0e0199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 --2- 172.21.15.55:0/4028328097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa0e00740a0 0x7fa0e0199980 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 >> 172.21.15.55:0/4028328097 conn(0x7fa0e00fcb10 msgr2=0x7fa0e01053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 shutdown_connections 2024-03-28T05:45:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.537+0000 7fa0e5400640 1 -- 172.21.15.55:0/4028328097 wait complete. 2024-03-28T05:45:18.555 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-28T05:45:18.556 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:45:18.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 -- 172.21.15.55:0/4263909428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f4107b00 msgr2=0x7f58f4107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 --2- 172.21.15.55:0/4263909428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f4107b00 0x7f58f4107f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009900 tx=0x7f58e802bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 -- 172.21.15.55:0/4263909428 shutdown_connections 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 --2- 172.21.15.55:0/4263909428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f41096b0 0x7f58f410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 --2- 172.21.15.55:0/4263909428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 0x7f58f4109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 --2- 172.21.15.55:0/4263909428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f4107b00 0x7f58f4107f20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 -- 172.21.15.55:0/4263909428 >> 172.21.15.55:0/4263909428 conn(0x7f58f4076ab0 msgr2=0x7f58f4078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 -- 172.21.15.55:0/4263909428 shutdown_connections 2024-03-28T05:45:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.773+0000 7f58fa400640 1 -- 172.21.15.55:0/4263909428 wait complete. 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 Processor -- start 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 -- start start 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f4107b00 0x7f58f419dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 0x7f58f419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4113680 con 0x7f58f41096b0 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4113500 con 0x7f58f4108cf0 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.775+0000 7f58fa400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4113800 con 0x7f58f4107b00 2024-03-28T05:45:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55840/0 (socket says 172.21.15.55:55840) 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 -- 172.21.15.55:0/2334563762 learned_addr learned my addr 172.21.15.55:0/2334563762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f3e00640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 0x7f58f419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9000640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f4107b00 0x7f58f419dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 -- 172.21.15.55:0/2334563762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f4107b00 msgr2=0x7f58f419dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f4107b00 0x7f58f419dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 -- 172.21.15.55:0/2334563762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 msgr2=0x7f58f419e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 0x7f58f419e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.776+0000 7f58f9a00640 1 -- 172.21.15.55:0/2334563762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f41a5950 con 0x7f58f41096b0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.777+0000 7f58f9a00640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00eb10 tx=0x7f58ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.777+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec004b20 con 0x7f58f41096b0 2024-03-28T05:45:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.777+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f41a5c40 con 0x7f58f41096b0 2024-03-28T05:45:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.777+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f41a61b0 con 0x7f58f41096b0 2024-03-28T05:45:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.779+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f410ee20 con 0x7f58f41096b0 2024-03-28T05:45:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.782+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f58ec0218f0 con 0x7f58f41096b0 2024-03-28T05:45:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.782+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec010830 con 0x7f58f41096b0 2024-03-28T05:45:18.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.785+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f58ec021440 con 0x7f58f41096b0 2024-03-28T05:45:18.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.786+0000 7f58f1600640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 0x7f58dc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:18.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.787+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f58ec0cf6d0 con 0x7f58f41096b0 2024-03-28T05:45:18.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.787+0000 7f58f9000640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 0x7f58dc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:18.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.788+0000 7f58f9000640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 0x7f58dc0a4d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58e802c240 tx=0x7f58e8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:18.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:18.789+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f58ec09c730 con 0x7f58f41096b0 2024-03-28T05:45:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:18 smithi055 ceph-mon[31863]: pgmap v442: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:18 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2290177605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:18 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4028328097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:19.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.036+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f402d070 con 0x7f58f41096b0 2024-03-28T05:45:19.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.038+0000 7f58f1600640 1 -- 172.21.15.55:0/2334563762 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f58ec09c030 con 0x7f58f41096b0 2024-03-28T05:45:19.039 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:19.039 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:45:14.020698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34535,34457,34490]},"id":1}]} 2024-03-28T05:45:19.039 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.040+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 msgr2=0x7f58dc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.040+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 0x7f58dc0a4d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58e802c240 tx=0x7f58e8005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.040+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 msgr2=0x7f58f41a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.040+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00eb10 tx=0x7f58ec00c2d0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 shutdown_connections 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58dc0a2880 0x7f58dc0a4d40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58f41096b0 0x7f58f41a52b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58f4108cf0 0x7f58f419e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 --2- 172.21.15.55:0/2334563762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58f4107b00 0x7f58f419dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 >> 172.21.15.55:0/2334563762 conn(0x7f58f4076ab0 msgr2=0x7f58f410bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 shutdown_connections 2024-03-28T05:45:19.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.041+0000 7f58fa400640 1 -- 172.21.15.55:0/2334563762 wait complete. 2024-03-28T05:45:19.061 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-28T05:45:19.061 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-28T05:45:19.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T05:45:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:18 smithi086 ceph-mon[35163]: pgmap v442: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:18 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2290177605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:18 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4028328097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:18 smithi159 ceph-mon[36109]: pgmap v442: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:18 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2290177605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:18 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4028328097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 -- 172.21.15.55:0/186477069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1048e0 msgr2=0x7f8abc104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/186477069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1048e0 0x7f8abc104d60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009900 tx=0x7f8aa802bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 -- 172.21.15.55:0/186477069 shutdown_connections 2024-03-28T05:45:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/186477069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 0x7f8abc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/186477069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1048e0 0x7f8abc104d60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/186477069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1036f0 0x7f8abc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 -- 172.21.15.55:0/186477069 >> 172.21.15.55:0/186477069 conn(0x7f8abc0fec80 msgr2=0x7f8abc1010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 -- 172.21.15.55:0/186477069 shutdown_connections 2024-03-28T05:45:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.288+0000 7f8ac2a00640 1 -- 172.21.15.55:0/186477069 wait complete. 2024-03-28T05:45:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.289+0000 7f8ac2a00640 1 Processor -- start 2024-03-28T05:45:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 -- start start 2024-03-28T05:45:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 0x7f8abc199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 0x7f8abc1a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc10f250 con 0x7f8abc1036f0 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc10f0d0 con 0x7f8abc1052a0 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac2a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc10f3d0 con 0x7f8abc1048e0 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60682/0 (socket says 172.21.15.55:60682) 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.290+0000 7f8ac1600640 1 -- 172.21.15.55:0/7049220 learned_addr learned my addr 172.21.15.55:0/7049220 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac0c00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 0x7f8abc199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac2000640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 0x7f8abc1a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 -- 172.21.15.55:0/7049220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 msgr2=0x7f8abc199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 0x7f8abc199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 -- 172.21.15.55:0/7049220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 msgr2=0x7f8abc1a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 0x7f8abc1a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 -- 172.21.15.55:0/7049220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc1a1570 con 0x7f8abc1036f0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac0c00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 0x7f8abc199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.291+0000 7f8ac1600640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c970 tx=0x7f8ab000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.292+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0004220 con 0x7f8abc1036f0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.292+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8ab00043c0 con 0x7f8abc1036f0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.292+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000f450 con 0x7f8abc1036f0 2024-03-28T05:45:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.292+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc1a1860 con 0x7f8abc1036f0 2024-03-28T05:45:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.292+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc1a1d60 con 0x7f8abc1036f0 2024-03-28T05:45:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.293+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc10aab0 con 0x7f8abc1036f0 2024-03-28T05:45:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.296+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8ab00079b0 con 0x7f8abc1036f0 2024-03-28T05:45:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.297+0000 7f8aba000640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 0x7f8aa40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.298+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8ab00cebb0 con 0x7f8abc1036f0 2024-03-28T05:45:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.298+0000 7f8ac0c00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 0x7f8aa40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.299+0000 7f8ac0c00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 0x7f8aa40a4d40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8abc19ae60 tx=0x7f8aa8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.299+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f8ab0014030 con 0x7f8abc1036f0 2024-03-28T05:45:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.500+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8abc061ae0 con 0x7f8aa40a2880 2024-03-28T05:45:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.508+0000 7f8aba000640 1 -- 172.21.15.55:0/7049220 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258936 (secure 0 0 0) 0x7f8abc061ae0 con 0x7f8aa40a2880 2024-03-28T05:45:19.511 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:19.515 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 msgr2=0x7f8aa40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 0x7f8aa40a4d40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8abc19ae60 tx=0x7f8aa8005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 msgr2=0x7f8abc199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000c970 tx=0x7f8ab000ce30 comp rx=0 tx=0).stop 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 shutdown_connections 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f8aa40a2880 0x7f8aa40a4d40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc1052a0 0x7f8abc1a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8abc1048e0 0x7f8abc199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 --2- 172.21.15.55:0/7049220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8abc1036f0 0x7f8abc199950 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 >> 172.21.15.55:0/7049220 conn(0x7f8abc0fec80 msgr2=0x7f8abc107c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:19.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 shutdown_connections 2024-03-28T05:45:19.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.515+0000 7f8ac2a00640 1 -- 172.21.15.55:0/7049220 wait complete. 2024-03-28T05:45:19.539 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-03-28T05:45:17.878498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666570,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":987,"num_read_kb":617,"num_write":361,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181910,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388064,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553760,"statfs":{"total":1151940427776,"available":1151543050240,"internally_reserved":0,"allocated":14286848,"data_stored":7763682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005399"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840728+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:44:17.840728+0000","last_peered":"2024-03-28T05:44:17.840728+0000","last_clean":"2024-03-28T05:44:17.840728+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:44:17.840728+0000","last_undegraded":"2024-03-28T05:44:17.840728+0000","last_fullsized":"2024-03-28T05:44:17.840728+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837683+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:44:17.837683+0000","last_peered":"2024-03-28T05:44:17.837683+0000","last_clean":"2024-03-28T05:44:17.837683+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:44:17.837683+0000","last_undegraded":"2024-03-28T05:44:17.837683+0000","last_fullsized":"2024-03-28T05:44:17.837683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841249+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:44:17.841249+0000","last_peered":"2024-03-28T05:44:17.841249+0000","last_clean":"2024-03-28T05:44:17.841249+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:44:17.841249+0000","last_undegraded":"2024-03-28T05:44:17.841249+0000","last_fullsized":"2024-03-28T05:44:17.841249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825822+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:44:17.825822+0000","last_peered":"2024-03-28T05:44:17.825822+0000","last_clean":"2024-03-28T05:44:17.825822+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:44:17.825822+0000","last_undegraded":"2024-03-28T05:44:17.825822+0000","last_fullsized":"2024-03-28T05:44:17.825822+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813565+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:44:17.813565+0000","last_peered":"2024-03-28T05:44:17.813565+0000","last_clean":"2024-03-28T05:44:17.813565+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:44:17.813565+0000","last_undegraded":"2024-03-28T05:44:17.813565+0000","last_fullsized":"2024-03-28T05:44:17.813565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822178+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:44:17.822178+0000","last_peered":"2024-03-28T05:44:17.822178+0000","last_clean":"2024-03-28T05:44:17.822178+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:44:17.822178+0000","last_undegraded":"2024-03-28T05:44:17.822178+0000","last_fullsized":"2024-03-28T05:44:17.822178+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814160+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:44:17.814160+0000","last_peered":"2024-03-28T05:44:17.814160+0000","last_clean":"2024-03-28T05:44:17.814160+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:44:17.814160+0000","last_undegraded":"2024-03-28T05:44:17.814160+0000","last_fullsized":"2024-03-28T05:44:17.814160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816586+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:44:17.816586+0000","last_peered":"2024-03-28T05:44:17.816586+0000","last_clean":"2024-03-28T05:44:17.816586+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:44:17.816586+0000","last_undegraded":"2024-03-28T05:44:17.816586+0000","last_fullsized":"2024-03-28T05:44:17.816586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.844240+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:44:17.844240+0000","last_peered":"2024-03-28T05:44:17.844240+0000","last_clean":"2024-03-28T05:44:17.844240+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:44:17.844240+0000","last_undegraded":"2024-03-28T05:44:17.844240+0000","last_fullsized":"2024-03-28T05:44:17.844240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831855+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:44:17.831855+0000","last_peered":"2024-03-28T05:44:17.831855+0000","last_clean":"2024-03-28T05:44:17.831855+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:44:17.831855+0000","last_undegraded":"2024-03-28T05:44:17.831855+0000","last_fullsized":"2024-03-28T05:44:17.831855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841639+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:44:17.841639+0000","last_peered":"2024-03-28T05:44:17.841639+0000","last_clean":"2024-03-28T05:44:17.841639+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:44:17.841639+0000","last_undegraded":"2024-03-28T05:44:17.841639+0000","last_fullsized":"2024-03-28T05:44:17.841639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.820910+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:44:17.820910+0000","last_peered":"2024-03-28T05:44:17.820910+0000","last_clean":"2024-03-28T05:44:17.820910+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:44:17.820910+0000","last_undegraded":"2024-03-28T05:44:17.820910+0000","last_fullsized":"2024-03-28T05:44:17.820910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817703+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:44:17.817703+0000","last_peered":"2024-03-28T05:44:17.817703+0000","last_clean":"2024-03-28T05:44:17.817703+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:44:17.817703+0000","last_undegraded":"2024-03-28T05:44:17.817703+0000","last_fullsized":"2024-03-28T05:44:17.817703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837405+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:44:17.837405+0000","last_peered":"2024-03-28T05:44:17.837405+0000","last_clean":"2024-03-28T05:44:17.837405+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:44:17.837405+0000","last_undegraded":"2024-03-28T05:44:17.837405+0000","last_fullsized":"2024-03-28T05:44:17.837405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824671+0000","last_change":"2024-03-28T05:43:18.941455+0000","last_active":"2024-03-28T05:44:17.824671+0000","last_peered":"2024-03-28T05:44:17.824671+0000","last_clean":"2024-03-28T05:44:17.824671+0000","last_became_active":"2024-03-28T05:43:18.941092+0000","last_became_peered":"2024-03-28T05:43:18.941092+0000","last_unstale":"2024-03-28T05:44:17.824671+0000","last_undegraded":"2024-03-28T05:44:17.824671+0000","last_fullsized":"2024-03-28T05:44:17.824671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:44:55.741140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840505+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:44:17.840505+0000","last_peered":"2024-03-28T05:44:17.840505+0000","last_clean":"2024-03-28T05:44:17.840505+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:44:17.840505+0000","last_undegraded":"2024-03-28T05:44:17.840505+0000","last_fullsized":"2024-03-28T05:44:17.840505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841046+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:44:17.841046+0000","last_peered":"2024-03-28T05:44:17.841046+0000","last_clean":"2024-03-28T05:44:17.841046+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:44:17.841046+0000","last_undegraded":"2024-03-28T05:44:17.841046+0000","last_fullsized":"2024-03-28T05:44:17.841046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837612+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:44:17.837612+0000","last_peered":"2024-03-28T05:44:17.837612+0000","last_clean":"2024-03-28T05:44:17.837612+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:44:17.837612+0000","last_undegraded":"2024-03-28T05:44:17.837612+0000","last_fullsized":"2024-03-28T05:44:17.837612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828447+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:44:17.828447+0000","last_peered":"2024-03-28T05:44:17.828447+0000","last_clean":"2024-03-28T05:44:17.828447+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:44:17.828447+0000","last_undegraded":"2024-03-28T05:44:17.828447+0000","last_fullsized":"2024-03-28T05:44:17.828447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933574+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:43:18.933574+0000","last_peered":"2024-03-28T05:43:18.933574+0000","last_clean":"2024-03-28T05:43:18.933574+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:43:18.933574+0000","last_undegraded":"2024-03-28T05:43:18.933574+0000","last_fullsized":"2024-03-28T05:43:18.933574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828208+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:44:17.828208+0000","last_peered":"2024-03-28T05:44:17.828208+0000","last_clean":"2024-03-28T05:44:17.828208+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:44:17.828208+0000","last_undegraded":"2024-03-28T05:44:17.828208+0000","last_fullsized":"2024-03-28T05:44:17.828208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932847+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:43:18.932847+0000","last_peered":"2024-03-28T05:43:18.932847+0000","last_clean":"2024-03-28T05:43:18.932847+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:43:18.932847+0000","last_undegraded":"2024-03-28T05:43:18.932847+0000","last_fullsized":"2024-03-28T05:43:18.932847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841168+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:44:17.841168+0000","last_peered":"2024-03-28T05:44:17.841168+0000","last_clean":"2024-03-28T05:44:17.841168+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:44:17.841168+0000","last_undegraded":"2024-03-28T05:44:17.841168+0000","last_fullsized":"2024-03-28T05:44:17.841168+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926528+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:43:18.926528+0000","last_peered":"2024-03-28T05:43:18.926528+0000","last_clean":"2024-03-28T05:43:18.926528+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:43:18.926528+0000","last_undegraded":"2024-03-28T05:43:18.926528+0000","last_fullsized":"2024-03-28T05:43:18.926528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845473+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:44:17.845473+0000","last_peered":"2024-03-28T05:44:17.845473+0000","last_clean":"2024-03-28T05:44:17.845473+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:44:17.845473+0000","last_undegraded":"2024-03-28T05:44:17.845473+0000","last_fullsized":"2024-03-28T05:44:17.845473+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926797+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:43:18.926797+0000","last_peered":"2024-03-28T05:43:18.926797+0000","last_clean":"2024-03-28T05:43:18.926797+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:43:18.926797+0000","last_undegraded":"2024-03-28T05:43:18.926797+0000","last_fullsized":"2024-03-28T05:43:18.926797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.842087+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:44:17.842087+0000","last_peered":"2024-03-28T05:44:17.842087+0000","last_clean":"2024-03-28T05:44:17.842087+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:44:17.842087+0000","last_undegraded":"2024-03-28T05:44:17.842087+0000","last_fullsized":"2024-03-28T05:44:17.842087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":180,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:12.267877+0000","last_change":"2024-03-28T05:43:18.959998+0000","last_active":"2024-03-28T05:45:12.267877+0000","last_peered":"2024-03-28T05:45:12.267877+0000","last_clean":"2024-03-28T05:45:12.267877+0000","last_became_active":"2024-03-28T05:43:18.945599+0000","last_became_peered":"2024-03-28T05:43:18.945599+0000","last_unstale":"2024-03-28T05:45:12.267877+0000","last_undegraded":"2024-03-28T05:45:12.267877+0000","last_fullsized":"2024-03-28T05:45:12.267877+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:02:08.702587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819251+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:44:17.819251+0000","last_peered":"2024-03-28T05:44:17.819251+0000","last_clean":"2024-03-28T05:44:17.819251+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:44:17.819251+0000","last_undegraded":"2024-03-28T05:44:17.819251+0000","last_fullsized":"2024-03-28T05:44:17.819251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968521+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:43:18.968521+0000","last_peered":"2024-03-28T05:43:18.968521+0000","last_clean":"2024-03-28T05:43:18.968521+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:43:18.968521+0000","last_undegraded":"2024-03-28T05:43:18.968521+0000","last_fullsized":"2024-03-28T05:43:18.968521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821575+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:44:17.821575+0000","last_peered":"2024-03-28T05:44:17.821575+0000","last_clean":"2024-03-28T05:44:17.821575+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:44:17.821575+0000","last_undegraded":"2024-03-28T05:44:17.821575+0000","last_fullsized":"2024-03-28T05:44:17.821575+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932322+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:43:18.932322+0000","last_peered":"2024-03-28T05:43:18.932322+0000","last_clean":"2024-03-28T05:43:18.932322+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:43:18.932322+0000","last_undegraded":"2024-03-28T05:43:18.932322+0000","last_fullsized":"2024-03-28T05:43:18.932322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817431+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:44:17.817431+0000","last_peered":"2024-03-28T05:44:17.817431+0000","last_clean":"2024-03-28T05:44:17.817431+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:44:17.817431+0000","last_undegraded":"2024-03-28T05:44:17.817431+0000","last_fullsized":"2024-03-28T05:44:17.817431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942255+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:43:18.942255+0000","last_peered":"2024-03-28T05:43:18.942255+0000","last_clean":"2024-03-28T05:43:18.942255+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:43:18.942255+0000","last_undegraded":"2024-03-28T05:43:18.942255+0000","last_fullsized":"2024-03-28T05:43:18.942255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824389+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:44:17.824389+0000","last_peered":"2024-03-28T05:44:17.824389+0000","last_clean":"2024-03-28T05:44:17.824389+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:44:17.824389+0000","last_undegraded":"2024-03-28T05:44:17.824389+0000","last_fullsized":"2024-03-28T05:44:17.824389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":165,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.281125+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:45:17.281125+0000","last_peered":"2024-03-28T05:45:17.281125+0000","last_clean":"2024-03-28T05:45:17.281125+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:45:17.281125+0000","last_undegraded":"2024-03-28T05:45:17.281125+0000","last_fullsized":"2024-03-28T05:45:17.281125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.843595+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:44:17.843595+0000","last_peered":"2024-03-28T05:44:17.843595+0000","last_clean":"2024-03-28T05:44:17.843595+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:44:17.843595+0000","last_undegraded":"2024-03-28T05:44:17.843595+0000","last_fullsized":"2024-03-28T05:44:17.843595+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937927+0000","last_change":"2024-03-28T05:43:18.937927+0000","last_active":"2024-03-28T05:43:18.937927+0000","last_peered":"2024-03-28T05:43:18.937927+0000","last_clean":"2024-03-28T05:43:18.937927+0000","last_became_active":"2024-03-28T05:43:18.931224+0000","last_became_peered":"2024-03-28T05:43:18.931224+0000","last_unstale":"2024-03-28T05:43:18.937927+0000","last_undegraded":"2024-03-28T05:43:18.937927+0000","last_fullsized":"2024-03-28T05:43:18.937927+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:57:28.359905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.834091+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:44:17.834091+0000","last_peered":"2024-03-28T05:44:17.834091+0000","last_clean":"2024-03-28T05:44:17.834091+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:44:17.834091+0000","last_undegraded":"2024-03-28T05:44:17.834091+0000","last_fullsized":"2024-03-28T05:44:17.834091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948713+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:43:18.948713+0000","last_peered":"2024-03-28T05:43:18.948713+0000","last_clean":"2024-03-28T05:43:18.948713+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:43:18.948713+0000","last_undegraded":"2024-03-28T05:43:18.948713+0000","last_fullsized":"2024-03-28T05:43:18.948713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845705+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:44:17.845705+0000","last_peered":"2024-03-28T05:44:17.845705+0000","last_clean":"2024-03-28T05:44:17.845705+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:44:17.845705+0000","last_undegraded":"2024-03-28T05:44:17.845705+0000","last_fullsized":"2024-03-28T05:44:17.845705+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":346,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.229794+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:45:17.229794+0000","last_peered":"2024-03-28T05:45:17.229794+0000","last_clean":"2024-03-28T05:45:17.229794+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:45:17.229794+0000","last_undegraded":"2024-03-28T05:45:17.229794+0000","last_fullsized":"2024-03-28T05:45:17.229794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70308,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":209,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824832+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:44:17.824832+0000","last_peered":"2024-03-28T05:44:17.824832+0000","last_clean":"2024-03-28T05:44:17.824832+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:44:17.824832+0000","last_undegraded":"2024-03-28T05:44:17.824832+0000","last_fullsized":"2024-03-28T05:44:17.824832+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936763+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:43:18.936763+0000","last_peered":"2024-03-28T05:43:18.936763+0000","last_clean":"2024-03-28T05:43:18.936763+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:43:18.936763+0000","last_undegraded":"2024-03-28T05:43:18.936763+0000","last_fullsized":"2024-03-28T05:43:18.936763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821574+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:44:17.821574+0000","last_peered":"2024-03-28T05:44:17.821574+0000","last_clean":"2024-03-28T05:44:17.821574+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:44:17.821574+0000","last_undegraded":"2024-03-28T05:44:17.821574+0000","last_fullsized":"2024-03-28T05:44:17.821574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.946185+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:43:18.946185+0000","last_peered":"2024-03-28T05:43:18.946185+0000","last_clean":"2024-03-28T05:43:18.946185+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:43:18.946185+0000","last_undegraded":"2024-03-28T05:43:18.946185+0000","last_fullsized":"2024-03-28T05:43:18.946185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835326+0000","last_change":"2024-03-28T05:43:18.935508+0000","last_active":"2024-03-28T05:44:17.835326+0000","last_peered":"2024-03-28T05:44:17.835326+0000","last_clean":"2024-03-28T05:44:17.835326+0000","last_became_active":"2024-03-28T05:43:18.934708+0000","last_became_peered":"2024-03-28T05:43:18.934708+0000","last_unstale":"2024-03-28T05:44:17.835326+0000","last_undegraded":"2024-03-28T05:44:17.835326+0000","last_fullsized":"2024-03-28T05:44:17.835326+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:09:07.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:14.192191+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:45:14.192191+0000","last_peered":"2024-03-28T05:45:14.192191+0000","last_clean":"2024-03-28T05:45:14.192191+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:45:14.192191+0000","last_undegraded":"2024-03-28T05:45:14.192191+0000","last_fullsized":"2024-03-28T05:45:14.192191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814193+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:44:17.814193+0000","last_peered":"2024-03-28T05:44:17.814193+0000","last_clean":"2024-03-28T05:44:17.814193+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:44:17.814193+0000","last_undegraded":"2024-03-28T05:44:17.814193+0000","last_fullsized":"2024-03-28T05:44:17.814193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925706+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:43:18.925706+0000","last_peered":"2024-03-28T05:43:18.925706+0000","last_clean":"2024-03-28T05:43:18.925706+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:43:18.925706+0000","last_undegraded":"2024-03-28T05:43:18.925706+0000","last_fullsized":"2024-03-28T05:43:18.925706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841479+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:44:17.841479+0000","last_peered":"2024-03-28T05:44:17.841479+0000","last_clean":"2024-03-28T05:44:17.841479+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:44:17.841479+0000","last_undegraded":"2024-03-28T05:44:17.841479+0000","last_fullsized":"2024-03-28T05:44:17.841479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957174+0000","last_change":"2024-03-28T05:43:18.956299+0000","last_active":"2024-03-28T05:43:18.957174+0000","last_peered":"2024-03-28T05:43:18.957174+0000","last_clean":"2024-03-28T05:43:18.957174+0000","last_became_active":"2024-03-28T05:43:18.947840+0000","last_became_peered":"2024-03-28T05:43:18.947840+0000","last_unstale":"2024-03-28T05:43:18.957174+0000","last_undegraded":"2024-03-28T05:43:18.957174+0000","last_fullsized":"2024-03-28T05:43:18.957174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:51.876409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818601+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:44:17.818601+0000","last_peered":"2024-03-28T05:44:17.818601+0000","last_clean":"2024-03-28T05:44:17.818601+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:44:17.818601+0000","last_undegraded":"2024-03-28T05:44:17.818601+0000","last_fullsized":"2024-03-28T05:44:17.818601+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931748+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:43:18.931748+0000","last_peered":"2024-03-28T05:43:18.931748+0000","last_clean":"2024-03-28T05:43:18.931748+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:43:18.931748+0000","last_undegraded":"2024-03-28T05:43:18.931748+0000","last_fullsized":"2024-03-28T05:43:18.931748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813647+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:44:17.813647+0000","last_peered":"2024-03-28T05:44:17.813647+0000","last_clean":"2024-03-28T05:44:17.813647+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:44:17.813647+0000","last_undegraded":"2024-03-28T05:44:17.813647+0000","last_fullsized":"2024-03-28T05:44:17.813647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926663+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:43:18.926663+0000","last_peered":"2024-03-28T05:43:18.926663+0000","last_clean":"2024-03-28T05:43:18.926663+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:43:18.926663+0000","last_undegraded":"2024-03-28T05:43:18.926663+0000","last_fullsized":"2024-03-28T05:43:18.926663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832121+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:44:17.832121+0000","last_peered":"2024-03-28T05:44:17.832121+0000","last_clean":"2024-03-28T05:44:17.832121+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:44:17.832121+0000","last_undegraded":"2024-03-28T05:44:17.832121+0000","last_fullsized":"2024-03-28T05:44:17.832121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822580+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:44:17.822580+0000","last_peered":"2024-03-28T05:44:17.822580+0000","last_clean":"2024-03-28T05:44:17.822580+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:44:17.822580+0000","last_undegraded":"2024-03-28T05:44:17.822580+0000","last_fullsized":"2024-03-28T05:44:17.822580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:13.187980+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:45:13.187980+0000","last_peered":"2024-03-28T05:45:13.187980+0000","last_clean":"2024-03-28T05:45:13.187980+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:45:13.187980+0000","last_undegraded":"2024-03-28T05:45:13.187980+0000","last_fullsized":"2024-03-28T05:45:13.187980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":137,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835274+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:44:17.835274+0000","last_peered":"2024-03-28T05:44:17.835274+0000","last_clean":"2024-03-28T05:44:17.835274+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:44:17.835274+0000","last_undegraded":"2024-03-28T05:44:17.835274+0000","last_fullsized":"2024-03-28T05:44:17.835274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923968+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:43:18.923968+0000","last_peered":"2024-03-28T05:43:18.923968+0000","last_clean":"2024-03-28T05:43:18.923968+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:43:18.923968+0000","last_undegraded":"2024-03-28T05:43:18.923968+0000","last_fullsized":"2024-03-28T05:43:18.923968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927223+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:43:18.927223+0000","last_peered":"2024-03-28T05:43:18.927223+0000","last_clean":"2024-03-28T05:43:18.927223+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:43:18.927223+0000","last_undegraded":"2024-03-28T05:43:18.927223+0000","last_fullsized":"2024-03-28T05:43:18.927223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823604+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:44:17.823604+0000","last_peered":"2024-03-28T05:44:17.823604+0000","last_clean":"2024-03-28T05:44:17.823604+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:44:17.823604+0000","last_undegraded":"2024-03-28T05:44:17.823604+0000","last_fullsized":"2024-03-28T05:44:17.823604+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926670+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:43:18.926670+0000","last_peered":"2024-03-28T05:43:18.926670+0000","last_clean":"2024-03-28T05:43:18.926670+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:43:18.926670+0000","last_undegraded":"2024-03-28T05:43:18.926670+0000","last_fullsized":"2024-03-28T05:43:18.926670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.951170+0000","last_change":"2024-03-28T05:43:18.950408+0000","last_active":"2024-03-28T05:43:18.951170+0000","last_peered":"2024-03-28T05:43:18.951170+0000","last_clean":"2024-03-28T05:43:18.951170+0000","last_became_active":"2024-03-28T05:43:18.936590+0000","last_became_peered":"2024-03-28T05:43:18.936590+0000","last_unstale":"2024-03-28T05:43:18.951170+0000","last_undegraded":"2024-03-28T05:43:18.951170+0000","last_fullsized":"2024-03-28T05:43:18.951170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:39:27.277236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819921+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:44:17.819921+0000","last_peered":"2024-03-28T05:44:17.819921+0000","last_clean":"2024-03-28T05:44:17.819921+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:44:17.819921+0000","last_undegraded":"2024-03-28T05:44:17.819921+0000","last_fullsized":"2024-03-28T05:44:17.819921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'10","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:03.534063+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:45:03.534063+0000","last_peered":"2024-03-28T05:45:03.534063+0000","last_clean":"2024-03-28T05:45:03.534063+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:45:03.534063+0000","last_undegraded":"2024-03-28T05:45:03.534063+0000","last_fullsized":"2024-03-28T05:45:03.534063+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817681+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:44:17.817681+0000","last_peered":"2024-03-28T05:44:17.817681+0000","last_clean":"2024-03-28T05:44:17.817681+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:44:17.817681+0000","last_undegraded":"2024-03-28T05:44:17.817681+0000","last_fullsized":"2024-03-28T05:44:17.817681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923640+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:43:18.923640+0000","last_peered":"2024-03-28T05:43:18.923640+0000","last_clean":"2024-03-28T05:43:18.923640+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:43:18.923640+0000","last_undegraded":"2024-03-28T05:43:18.923640+0000","last_fullsized":"2024-03-28T05:43:18.923640+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831225+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:44:17.831225+0000","last_peered":"2024-03-28T05:44:17.831225+0000","last_clean":"2024-03-28T05:44:17.831225+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:44:17.831225+0000","last_undegraded":"2024-03-28T05:44:17.831225+0000","last_fullsized":"2024-03-28T05:44:17.831225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929809+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:43:18.929809+0000","last_peered":"2024-03-28T05:43:18.929809+0000","last_clean":"2024-03-28T05:43:18.929809+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:43:18.929809+0000","last_undegraded":"2024-03-28T05:43:18.929809+0000","last_fullsized":"2024-03-28T05:43:18.929809+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.811377+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:44:17.811377+0000","last_peered":"2024-03-28T05:44:17.811377+0000","last_clean":"2024-03-28T05:44:17.811377+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:44:17.811377+0000","last_undegraded":"2024-03-28T05:44:17.811377+0000","last_fullsized":"2024-03-28T05:44:17.811377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930385+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:43:18.930385+0000","last_peered":"2024-03-28T05:43:18.930385+0000","last_clean":"2024-03-28T05:43:18.930385+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:43:18.930385+0000","last_undegraded":"2024-03-28T05:43:18.930385+0000","last_fullsized":"2024-03-28T05:43:18.930385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830699+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:44:17.830699+0000","last_peered":"2024-03-28T05:44:17.830699+0000","last_clean":"2024-03-28T05:44:17.830699+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:44:17.830699+0000","last_undegraded":"2024-03-28T05:44:17.830699+0000","last_fullsized":"2024-03-28T05:44:17.830699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:05.436491+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:45:05.436491+0000","last_peered":"2024-03-28T05:45:05.436491+0000","last_clean":"2024-03-28T05:45:05.436491+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:45:05.436491+0000","last_undegraded":"2024-03-28T05:45:05.436491+0000","last_fullsized":"2024-03-28T05:45:05.436491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830528+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:44:17.830528+0000","last_peered":"2024-03-28T05:44:17.830528+0000","last_clean":"2024-03-28T05:44:17.830528+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:44:17.830528+0000","last_undegraded":"2024-03-28T05:44:17.830528+0000","last_fullsized":"2024-03-28T05:44:17.830528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926416+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:43:18.926416+0000","last_peered":"2024-03-28T05:43:18.926416+0000","last_clean":"2024-03-28T05:43:18.926416+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:43:18.926416+0000","last_undegraded":"2024-03-28T05:43:18.926416+0000","last_fullsized":"2024-03-28T05:43:18.926416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835992+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:44:17.835992+0000","last_peered":"2024-03-28T05:44:17.835992+0000","last_clean":"2024-03-28T05:44:17.835992+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:44:17.835992+0000","last_undegraded":"2024-03-28T05:44:17.835992+0000","last_fullsized":"2024-03-28T05:44:17.835992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937454+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:43:18.937454+0000","last_peered":"2024-03-28T05:43:18.937454+0000","last_clean":"2024-03-28T05:43:18.937454+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:43:18.937454+0000","last_undegraded":"2024-03-28T05:43:18.937454+0000","last_fullsized":"2024-03-28T05:43:18.937454+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841989+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:44:17.841989+0000","last_peered":"2024-03-28T05:44:17.841989+0000","last_clean":"2024-03-28T05:44:17.841989+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:44:17.841989+0000","last_undegraded":"2024-03-28T05:44:17.841989+0000","last_fullsized":"2024-03-28T05:44:17.841989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948434+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:43:18.948434+0000","last_peered":"2024-03-28T05:43:18.948434+0000","last_clean":"2024-03-28T05:43:18.948434+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:43:18.948434+0000","last_undegraded":"2024-03-28T05:43:18.948434+0000","last_fullsized":"2024-03-28T05:43:18.948434+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825244+0000","last_change":"2024-03-28T05:43:18.957536+0000","last_active":"2024-03-28T05:44:17.825244+0000","last_peered":"2024-03-28T05:44:17.825244+0000","last_clean":"2024-03-28T05:44:17.825244+0000","last_became_active":"2024-03-28T05:43:18.945541+0000","last_became_peered":"2024-03-28T05:43:18.945541+0000","last_unstale":"2024-03-28T05:44:17.825244+0000","last_undegraded":"2024-03-28T05:44:17.825244+0000","last_fullsized":"2024-03-28T05:44:17.825244+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:35:23.625743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933109+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:43:18.933109+0000","last_peered":"2024-03-28T05:43:18.933109+0000","last_clean":"2024-03-28T05:43:18.933109+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:43:18.933109+0000","last_undegraded":"2024-03-28T05:43:18.933109+0000","last_fullsized":"2024-03-28T05:43:18.933109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828825+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:44:17.828825+0000","last_peered":"2024-03-28T05:44:17.828825+0000","last_clean":"2024-03-28T05:44:17.828825+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:44:17.828825+0000","last_undegraded":"2024-03-28T05:44:17.828825+0000","last_fullsized":"2024-03-28T05:44:17.828825+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823662+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:44:17.823662+0000","last_peered":"2024-03-28T05:44:17.823662+0000","last_clean":"2024-03-28T05:44:17.823662+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:44:17.823662+0000","last_undegraded":"2024-03-28T05:44:17.823662+0000","last_fullsized":"2024-03-28T05:44:17.823662+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825447+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:44:17.825447+0000","last_peered":"2024-03-28T05:44:17.825447+0000","last_clean":"2024-03-28T05:44:17.825447+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:44:17.825447+0000","last_undegraded":"2024-03-28T05:44:17.825447+0000","last_fullsized":"2024-03-28T05:44:17.825447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825872+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:44:17.825872+0000","last_peered":"2024-03-28T05:44:17.825872+0000","last_clean":"2024-03-28T05:44:17.825872+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:44:17.825872+0000","last_undegraded":"2024-03-28T05:44:17.825872+0000","last_fullsized":"2024-03-28T05:44:17.825872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831731+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:44:17.831731+0000","last_peered":"2024-03-28T05:44:17.831731+0000","last_clean":"2024-03-28T05:44:17.831731+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:44:17.831731+0000","last_undegraded":"2024-03-28T05:44:17.831731+0000","last_fullsized":"2024-03-28T05:44:17.831731+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.826103+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:44:17.826103+0000","last_peered":"2024-03-28T05:44:17.826103+0000","last_clean":"2024-03-28T05:44:17.826103+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:44:17.826103+0000","last_undegraded":"2024-03-28T05:44:17.826103+0000","last_fullsized":"2024-03-28T05:44:17.826103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816002+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:44:17.816002+0000","last_peered":"2024-03-28T05:44:17.816002+0000","last_clean":"2024-03-28T05:44:17.816002+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:44:17.816002+0000","last_undegraded":"2024-03-28T05:44:17.816002+0000","last_fullsized":"2024-03-28T05:44:17.816002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.838346+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:44:17.838346+0000","last_peered":"2024-03-28T05:44:17.838346+0000","last_clean":"2024-03-28T05:44:17.838346+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:44:17.838346+0000","last_undegraded":"2024-03-28T05:44:17.838346+0000","last_fullsized":"2024-03-28T05:44:17.838346+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822135+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:44:17.822135+0000","last_peered":"2024-03-28T05:44:17.822135+0000","last_clean":"2024-03-28T05:44:17.822135+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:44:17.822135+0000","last_undegraded":"2024-03-28T05:44:17.822135+0000","last_fullsized":"2024-03-28T05:44:17.822135+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.812261+0000","last_change":"2024-03-28T05:43:18.939398+0000","last_active":"2024-03-28T05:44:17.812261+0000","last_peered":"2024-03-28T05:44:17.812261+0000","last_clean":"2024-03-28T05:44:17.812261+0000","last_became_active":"2024-03-28T05:43:18.936942+0000","last_became_peered":"2024-03-28T05:43:18.936942+0000","last_unstale":"2024-03-28T05:44:17.812261+0000","last_undegraded":"2024-03-28T05:44:17.812261+0000","last_fullsized":"2024-03-28T05:44:17.812261+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:02:50.892203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824626+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:44:17.824626+0000","last_peered":"2024-03-28T05:44:17.824626+0000","last_clean":"2024-03-28T05:44:17.824626+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:44:17.824626+0000","last_undegraded":"2024-03-28T05:44:17.824626+0000","last_fullsized":"2024-03-28T05:44:17.824626+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.839006+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:44:17.839006+0000","last_peered":"2024-03-28T05:44:17.839006+0000","last_clean":"2024-03-28T05:44:17.839006+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:44:17.839006+0000","last_undegraded":"2024-03-28T05:44:17.839006+0000","last_fullsized":"2024-03-28T05:44:17.839006+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832264+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:44:17.832264+0000","last_peered":"2024-03-28T05:44:17.832264+0000","last_clean":"2024-03-28T05:44:17.832264+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:44:17.832264+0000","last_undegraded":"2024-03-28T05:44:17.832264+0000","last_fullsized":"2024-03-28T05:44:17.832264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818676+0000","last_change":"2024-03-28T05:43:18.944603+0000","last_active":"2024-03-28T05:44:17.818676+0000","last_peered":"2024-03-28T05:44:17.818676+0000","last_clean":"2024-03-28T05:44:17.818676+0000","last_became_active":"2024-03-28T05:43:18.943787+0000","last_became_peered":"2024-03-28T05:43:18.943787+0000","last_unstale":"2024-03-28T05:44:17.818676+0000","last_undegraded":"2024-03-28T05:44:17.818676+0000","last_fullsized":"2024-03-28T05:44:17.818676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:13.905446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75968,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":861,"num_read_kb":508,"num_write":178,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1057,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":219276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":481676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481844,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1716224,"data_stored":1144446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":481985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939714,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":481744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234057,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1617920,"data_stored":1075377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430287,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":547044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":482528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":547772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":481451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":484366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1630208,"data_stored":1074036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:45:19.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T05:45:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 -- 172.21.15.55:0/903952548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01036f0 msgr2=0x7fc7e0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 --2- 172.21.15.55:0/903952548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01036f0 0x7fc7e0103b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d002bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 -- 172.21.15.55:0/903952548 shutdown_connections 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 --2- 172.21.15.55:0/903952548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01052a0 0x7fc7e010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 --2- 172.21.15.55:0/903952548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01048e0 0x7fc7e0104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 --2- 172.21.15.55:0/903952548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01036f0 0x7fc7e0103b10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 -- 172.21.15.55:0/903952548 >> 172.21.15.55:0/903952548 conn(0x7fc7e00fec80 msgr2=0x7fc7e01010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 -- 172.21.15.55:0/903952548 shutdown_connections 2024-03-28T05:45:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.807+0000 7fc7df200640 1 -- 172.21.15.55:0/903952548 wait complete. 2024-03-28T05:45:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 Processor -- start 2024-03-28T05:45:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 -- start start 2024-03-28T05:45:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 0x7fc7e01998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 0x7fc7e0199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e010f270 con 0x7fc7e01052a0 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e010f0f0 con 0x7fc7e01036f0 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.808+0000 7fc7df200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e010f3f0 con 0x7fc7e01048e0 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60700/0 (socket says 172.21.15.55:60700) 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 -- 172.21.15.55:0/3226668552 learned_addr learned my addr 172.21.15.55:0/3226668552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 -- 172.21.15.55:0/3226668552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 msgr2=0x7fc7e0199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7dd400640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 0x7fc7e0199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7dde00640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 0x7fc7e01998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 0x7fc7e0199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 -- 172.21.15.55:0/3226668552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 msgr2=0x7fc7e01998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 0x7fc7e01998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 -- 172.21.15.55:0/3226668552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e01a1500 con 0x7fc7e01052a0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7dde00640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 0x7fc7e01998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7dd400640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 0x7fc7e0199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.809+0000 7fc7de800640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800eaa0 tx=0x7fc7d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.810+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800cdb0 con 0x7fc7e01052a0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.810+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc7d8005020 con 0x7fc7e01052a0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.810+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e01a17f0 con 0x7fc7e01052a0 2024-03-28T05:45:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.810+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80116d0 con 0x7fc7e01052a0 2024-03-28T05:45:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.810+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e01a1d40 con 0x7fc7e01052a0 2024-03-28T05:45:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.811+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e010aa10 con 0x7fc7e01052a0 2024-03-28T05:45:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.813+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc7d80051d0 con 0x7fc7e01052a0 2024-03-28T05:45:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.814+0000 7fc7d6a00640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 0x7fc7c40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.815+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc7d80ced00 con 0x7fc7e01052a0 2024-03-28T05:45:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.815+0000 7fc7dde00640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 0x7fc7c40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.815+0000 7fc7dde00640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 0x7fc7c40a4cc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0036040 tx=0x7fc7d0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:19.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:19.819+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc7d8016030 con 0x7fc7e01052a0 2024-03-28T05:45:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.023+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e0061ae0 con 0x7fc7c40a2800 2024-03-28T05:45:20.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.032+0000 7fc7d6a00640 1 -- 172.21.15.55:0/3226668552 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258924 (secure 0 0 0) 0x7fc7e0061ae0 con 0x7fc7c40a2800 2024-03-28T05:45:20.038 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:20.039 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 msgr2=0x7fc7c40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 0x7fc7c40a4cc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0036040 tx=0x7fc7d0005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 msgr2=0x7fc7e01a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800eaa0 tx=0x7fc7d800ef60 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 shutdown_connections 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.038+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc7c40a2800 0x7fc7c40a4cc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7e01052a0 0x7fc7e01a0e90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7e01048e0 0x7fc7e0199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 --2- 172.21.15.55:0/3226668552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e01036f0 0x7fc7e01998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 >> 172.21.15.55:0/3226668552 conn(0x7fc7e00fec80 msgr2=0x7fc7e0107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 shutdown_connections 2024-03-28T05:45:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.039+0000 7fc7df200640 1 -- 172.21.15.55:0/3226668552 wait complete. 2024-03-28T05:45:20.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:19 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2334563762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:20.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:19 smithi055 ceph-mon[31863]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:20.061 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-03-28T05:45:19.879009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666570,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":992,"num_read_kb":617,"num_write":361,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181910,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388064,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553760,"statfs":{"total":1151940427776,"available":1151543050240,"internally_reserved":0,"allocated":14286848,"data_stored":7763682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":33,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004939"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840728+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:44:17.840728+0000","last_peered":"2024-03-28T05:44:17.840728+0000","last_clean":"2024-03-28T05:44:17.840728+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:44:17.840728+0000","last_undegraded":"2024-03-28T05:44:17.840728+0000","last_fullsized":"2024-03-28T05:44:17.840728+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837683+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:44:17.837683+0000","last_peered":"2024-03-28T05:44:17.837683+0000","last_clean":"2024-03-28T05:44:17.837683+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:44:17.837683+0000","last_undegraded":"2024-03-28T05:44:17.837683+0000","last_fullsized":"2024-03-28T05:44:17.837683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841249+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:44:17.841249+0000","last_peered":"2024-03-28T05:44:17.841249+0000","last_clean":"2024-03-28T05:44:17.841249+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:44:17.841249+0000","last_undegraded":"2024-03-28T05:44:17.841249+0000","last_fullsized":"2024-03-28T05:44:17.841249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825822+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:44:17.825822+0000","last_peered":"2024-03-28T05:44:17.825822+0000","last_clean":"2024-03-28T05:44:17.825822+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:44:17.825822+0000","last_undegraded":"2024-03-28T05:44:17.825822+0000","last_fullsized":"2024-03-28T05:44:17.825822+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813565+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:44:17.813565+0000","last_peered":"2024-03-28T05:44:17.813565+0000","last_clean":"2024-03-28T05:44:17.813565+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:44:17.813565+0000","last_undegraded":"2024-03-28T05:44:17.813565+0000","last_fullsized":"2024-03-28T05:44:17.813565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822178+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:44:17.822178+0000","last_peered":"2024-03-28T05:44:17.822178+0000","last_clean":"2024-03-28T05:44:17.822178+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:44:17.822178+0000","last_undegraded":"2024-03-28T05:44:17.822178+0000","last_fullsized":"2024-03-28T05:44:17.822178+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814160+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:44:17.814160+0000","last_peered":"2024-03-28T05:44:17.814160+0000","last_clean":"2024-03-28T05:44:17.814160+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:44:17.814160+0000","last_undegraded":"2024-03-28T05:44:17.814160+0000","last_fullsized":"2024-03-28T05:44:17.814160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816586+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:44:17.816586+0000","last_peered":"2024-03-28T05:44:17.816586+0000","last_clean":"2024-03-28T05:44:17.816586+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:44:17.816586+0000","last_undegraded":"2024-03-28T05:44:17.816586+0000","last_fullsized":"2024-03-28T05:44:17.816586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.844240+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:44:17.844240+0000","last_peered":"2024-03-28T05:44:17.844240+0000","last_clean":"2024-03-28T05:44:17.844240+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:44:17.844240+0000","last_undegraded":"2024-03-28T05:44:17.844240+0000","last_fullsized":"2024-03-28T05:44:17.844240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831855+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:44:17.831855+0000","last_peered":"2024-03-28T05:44:17.831855+0000","last_clean":"2024-03-28T05:44:17.831855+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:44:17.831855+0000","last_undegraded":"2024-03-28T05:44:17.831855+0000","last_fullsized":"2024-03-28T05:44:17.831855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841747+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:44:17.841747+0000","last_peered":"2024-03-28T05:44:17.841747+0000","last_clean":"2024-03-28T05:44:17.841747+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:44:17.841747+0000","last_undegraded":"2024-03-28T05:44:17.841747+0000","last_fullsized":"2024-03-28T05:44:17.841747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.820910+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:44:17.820910+0000","last_peered":"2024-03-28T05:44:17.820910+0000","last_clean":"2024-03-28T05:44:17.820910+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:44:17.820910+0000","last_undegraded":"2024-03-28T05:44:17.820910+0000","last_fullsized":"2024-03-28T05:44:17.820910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817703+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:44:17.817703+0000","last_peered":"2024-03-28T05:44:17.817703+0000","last_clean":"2024-03-28T05:44:17.817703+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:44:17.817703+0000","last_undegraded":"2024-03-28T05:44:17.817703+0000","last_fullsized":"2024-03-28T05:44:17.817703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837405+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:44:17.837405+0000","last_peered":"2024-03-28T05:44:17.837405+0000","last_clean":"2024-03-28T05:44:17.837405+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:44:17.837405+0000","last_undegraded":"2024-03-28T05:44:17.837405+0000","last_fullsized":"2024-03-28T05:44:17.837405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824671+0000","last_change":"2024-03-28T05:43:18.941455+0000","last_active":"2024-03-28T05:44:17.824671+0000","last_peered":"2024-03-28T05:44:17.824671+0000","last_clean":"2024-03-28T05:44:17.824671+0000","last_became_active":"2024-03-28T05:43:18.941092+0000","last_became_peered":"2024-03-28T05:43:18.941092+0000","last_unstale":"2024-03-28T05:44:17.824671+0000","last_undegraded":"2024-03-28T05:44:17.824671+0000","last_fullsized":"2024-03-28T05:44:17.824671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:44:55.741140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840505+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:44:17.840505+0000","last_peered":"2024-03-28T05:44:17.840505+0000","last_clean":"2024-03-28T05:44:17.840505+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:44:17.840505+0000","last_undegraded":"2024-03-28T05:44:17.840505+0000","last_fullsized":"2024-03-28T05:44:17.840505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841046+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:44:17.841046+0000","last_peered":"2024-03-28T05:44:17.841046+0000","last_clean":"2024-03-28T05:44:17.841046+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:44:17.841046+0000","last_undegraded":"2024-03-28T05:44:17.841046+0000","last_fullsized":"2024-03-28T05:44:17.841046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837612+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:44:17.837612+0000","last_peered":"2024-03-28T05:44:17.837612+0000","last_clean":"2024-03-28T05:44:17.837612+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:44:17.837612+0000","last_undegraded":"2024-03-28T05:44:17.837612+0000","last_fullsized":"2024-03-28T05:44:17.837612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828447+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:44:17.828447+0000","last_peered":"2024-03-28T05:44:17.828447+0000","last_clean":"2024-03-28T05:44:17.828447+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:44:17.828447+0000","last_undegraded":"2024-03-28T05:44:17.828447+0000","last_fullsized":"2024-03-28T05:44:17.828447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933574+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:43:18.933574+0000","last_peered":"2024-03-28T05:43:18.933574+0000","last_clean":"2024-03-28T05:43:18.933574+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:43:18.933574+0000","last_undegraded":"2024-03-28T05:43:18.933574+0000","last_fullsized":"2024-03-28T05:43:18.933574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828208+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:44:17.828208+0000","last_peered":"2024-03-28T05:44:17.828208+0000","last_clean":"2024-03-28T05:44:17.828208+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:44:17.828208+0000","last_undegraded":"2024-03-28T05:44:17.828208+0000","last_fullsized":"2024-03-28T05:44:17.828208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932847+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:43:18.932847+0000","last_peered":"2024-03-28T05:43:18.932847+0000","last_clean":"2024-03-28T05:43:18.932847+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:43:18.932847+0000","last_undegraded":"2024-03-28T05:43:18.932847+0000","last_fullsized":"2024-03-28T05:43:18.932847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841168+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:44:17.841168+0000","last_peered":"2024-03-28T05:44:17.841168+0000","last_clean":"2024-03-28T05:44:17.841168+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:44:17.841168+0000","last_undegraded":"2024-03-28T05:44:17.841168+0000","last_fullsized":"2024-03-28T05:44:17.841168+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926528+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:43:18.926528+0000","last_peered":"2024-03-28T05:43:18.926528+0000","last_clean":"2024-03-28T05:43:18.926528+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:43:18.926528+0000","last_undegraded":"2024-03-28T05:43:18.926528+0000","last_fullsized":"2024-03-28T05:43:18.926528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845473+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:44:17.845473+0000","last_peered":"2024-03-28T05:44:17.845473+0000","last_clean":"2024-03-28T05:44:17.845473+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:44:17.845473+0000","last_undegraded":"2024-03-28T05:44:17.845473+0000","last_fullsized":"2024-03-28T05:44:17.845473+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926797+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:43:18.926797+0000","last_peered":"2024-03-28T05:43:18.926797+0000","last_clean":"2024-03-28T05:43:18.926797+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:43:18.926797+0000","last_undegraded":"2024-03-28T05:43:18.926797+0000","last_fullsized":"2024-03-28T05:43:18.926797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.842087+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:44:17.842087+0000","last_peered":"2024-03-28T05:44:17.842087+0000","last_clean":"2024-03-28T05:44:17.842087+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:44:17.842087+0000","last_undegraded":"2024-03-28T05:44:17.842087+0000","last_fullsized":"2024-03-28T05:44:17.842087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":185,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.282367+0000","last_change":"2024-03-28T05:43:18.959998+0000","last_active":"2024-03-28T05:45:17.282367+0000","last_peered":"2024-03-28T05:45:17.282367+0000","last_clean":"2024-03-28T05:45:17.282367+0000","last_became_active":"2024-03-28T05:43:18.945599+0000","last_became_peered":"2024-03-28T05:43:18.945599+0000","last_unstale":"2024-03-28T05:45:17.282367+0000","last_undegraded":"2024-03-28T05:45:17.282367+0000","last_fullsized":"2024-03-28T05:45:17.282367+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:02:08.702587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819251+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:44:17.819251+0000","last_peered":"2024-03-28T05:44:17.819251+0000","last_clean":"2024-03-28T05:44:17.819251+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:44:17.819251+0000","last_undegraded":"2024-03-28T05:44:17.819251+0000","last_fullsized":"2024-03-28T05:44:17.819251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968521+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:43:18.968521+0000","last_peered":"2024-03-28T05:43:18.968521+0000","last_clean":"2024-03-28T05:43:18.968521+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:43:18.968521+0000","last_undegraded":"2024-03-28T05:43:18.968521+0000","last_fullsized":"2024-03-28T05:43:18.968521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821575+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:44:17.821575+0000","last_peered":"2024-03-28T05:44:17.821575+0000","last_clean":"2024-03-28T05:44:17.821575+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:44:17.821575+0000","last_undegraded":"2024-03-28T05:44:17.821575+0000","last_fullsized":"2024-03-28T05:44:17.821575+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932322+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:43:18.932322+0000","last_peered":"2024-03-28T05:43:18.932322+0000","last_clean":"2024-03-28T05:43:18.932322+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:43:18.932322+0000","last_undegraded":"2024-03-28T05:43:18.932322+0000","last_fullsized":"2024-03-28T05:43:18.932322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817431+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:44:17.817431+0000","last_peered":"2024-03-28T05:44:17.817431+0000","last_clean":"2024-03-28T05:44:17.817431+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:44:17.817431+0000","last_undegraded":"2024-03-28T05:44:17.817431+0000","last_fullsized":"2024-03-28T05:44:17.817431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942469+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:43:18.942469+0000","last_peered":"2024-03-28T05:43:18.942469+0000","last_clean":"2024-03-28T05:43:18.942469+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:43:18.942469+0000","last_undegraded":"2024-03-28T05:43:18.942469+0000","last_fullsized":"2024-03-28T05:43:18.942469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824769+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:44:17.824769+0000","last_peered":"2024-03-28T05:44:17.824769+0000","last_clean":"2024-03-28T05:44:17.824769+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:44:17.824769+0000","last_undegraded":"2024-03-28T05:44:17.824769+0000","last_fullsized":"2024-03-28T05:44:17.824769+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":165,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.281125+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:45:17.281125+0000","last_peered":"2024-03-28T05:45:17.281125+0000","last_clean":"2024-03-28T05:45:17.281125+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:45:17.281125+0000","last_undegraded":"2024-03-28T05:45:17.281125+0000","last_fullsized":"2024-03-28T05:45:17.281125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.843595+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:44:17.843595+0000","last_peered":"2024-03-28T05:44:17.843595+0000","last_clean":"2024-03-28T05:44:17.843595+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:44:17.843595+0000","last_undegraded":"2024-03-28T05:44:17.843595+0000","last_fullsized":"2024-03-28T05:44:17.843595+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.939098+0000","last_change":"2024-03-28T05:43:18.937927+0000","last_active":"2024-03-28T05:43:18.939098+0000","last_peered":"2024-03-28T05:43:18.939098+0000","last_clean":"2024-03-28T05:43:18.939098+0000","last_became_active":"2024-03-28T05:43:18.931224+0000","last_became_peered":"2024-03-28T05:43:18.931224+0000","last_unstale":"2024-03-28T05:43:18.939098+0000","last_undegraded":"2024-03-28T05:43:18.939098+0000","last_fullsized":"2024-03-28T05:43:18.939098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:57:28.359905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.834091+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:44:17.834091+0000","last_peered":"2024-03-28T05:44:17.834091+0000","last_clean":"2024-03-28T05:44:17.834091+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:44:17.834091+0000","last_undegraded":"2024-03-28T05:44:17.834091+0000","last_fullsized":"2024-03-28T05:44:17.834091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948798+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:43:18.948798+0000","last_peered":"2024-03-28T05:43:18.948798+0000","last_clean":"2024-03-28T05:43:18.948798+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:43:18.948798+0000","last_undegraded":"2024-03-28T05:43:18.948798+0000","last_fullsized":"2024-03-28T05:43:18.948798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845705+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:44:17.845705+0000","last_peered":"2024-03-28T05:44:17.845705+0000","last_clean":"2024-03-28T05:44:17.845705+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:44:17.845705+0000","last_undegraded":"2024-03-28T05:44:17.845705+0000","last_fullsized":"2024-03-28T05:44:17.845705+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":346,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.229794+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:45:17.229794+0000","last_peered":"2024-03-28T05:45:17.229794+0000","last_clean":"2024-03-28T05:45:17.229794+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:45:17.229794+0000","last_undegraded":"2024-03-28T05:45:17.229794+0000","last_fullsized":"2024-03-28T05:45:17.229794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70308,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":209,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825453+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:44:17.825453+0000","last_peered":"2024-03-28T05:44:17.825453+0000","last_clean":"2024-03-28T05:44:17.825453+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:44:17.825453+0000","last_undegraded":"2024-03-28T05:44:17.825453+0000","last_fullsized":"2024-03-28T05:44:17.825453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936763+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:43:18.936763+0000","last_peered":"2024-03-28T05:43:18.936763+0000","last_clean":"2024-03-28T05:43:18.936763+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:43:18.936763+0000","last_undegraded":"2024-03-28T05:43:18.936763+0000","last_fullsized":"2024-03-28T05:43:18.936763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821574+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:44:17.821574+0000","last_peered":"2024-03-28T05:44:17.821574+0000","last_clean":"2024-03-28T05:44:17.821574+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:44:17.821574+0000","last_undegraded":"2024-03-28T05:44:17.821574+0000","last_fullsized":"2024-03-28T05:44:17.821574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.946185+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:43:18.946185+0000","last_peered":"2024-03-28T05:43:18.946185+0000","last_clean":"2024-03-28T05:43:18.946185+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:43:18.946185+0000","last_undegraded":"2024-03-28T05:43:18.946185+0000","last_fullsized":"2024-03-28T05:43:18.946185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835326+0000","last_change":"2024-03-28T05:43:18.935508+0000","last_active":"2024-03-28T05:44:17.835326+0000","last_peered":"2024-03-28T05:44:17.835326+0000","last_clean":"2024-03-28T05:44:17.835326+0000","last_became_active":"2024-03-28T05:43:18.934708+0000","last_became_peered":"2024-03-28T05:43:18.934708+0000","last_unstale":"2024-03-28T05:44:17.835326+0000","last_undegraded":"2024-03-28T05:44:17.835326+0000","last_fullsized":"2024-03-28T05:44:17.835326+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:09:07.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:14.192191+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:45:14.192191+0000","last_peered":"2024-03-28T05:45:14.192191+0000","last_clean":"2024-03-28T05:45:14.192191+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:45:14.192191+0000","last_undegraded":"2024-03-28T05:45:14.192191+0000","last_fullsized":"2024-03-28T05:45:14.192191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814193+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:44:17.814193+0000","last_peered":"2024-03-28T05:44:17.814193+0000","last_clean":"2024-03-28T05:44:17.814193+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:44:17.814193+0000","last_undegraded":"2024-03-28T05:44:17.814193+0000","last_fullsized":"2024-03-28T05:44:17.814193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925706+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:43:18.925706+0000","last_peered":"2024-03-28T05:43:18.925706+0000","last_clean":"2024-03-28T05:43:18.925706+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:43:18.925706+0000","last_undegraded":"2024-03-28T05:43:18.925706+0000","last_fullsized":"2024-03-28T05:43:18.925706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841479+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:44:17.841479+0000","last_peered":"2024-03-28T05:44:17.841479+0000","last_clean":"2024-03-28T05:44:17.841479+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:44:17.841479+0000","last_undegraded":"2024-03-28T05:44:17.841479+0000","last_fullsized":"2024-03-28T05:44:17.841479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957174+0000","last_change":"2024-03-28T05:43:18.956299+0000","last_active":"2024-03-28T05:43:18.957174+0000","last_peered":"2024-03-28T05:43:18.957174+0000","last_clean":"2024-03-28T05:43:18.957174+0000","last_became_active":"2024-03-28T05:43:18.947840+0000","last_became_peered":"2024-03-28T05:43:18.947840+0000","last_unstale":"2024-03-28T05:43:18.957174+0000","last_undegraded":"2024-03-28T05:43:18.957174+0000","last_fullsized":"2024-03-28T05:43:18.957174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:51.876409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818601+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:44:17.818601+0000","last_peered":"2024-03-28T05:44:17.818601+0000","last_clean":"2024-03-28T05:44:17.818601+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:44:17.818601+0000","last_undegraded":"2024-03-28T05:44:17.818601+0000","last_fullsized":"2024-03-28T05:44:17.818601+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931748+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:43:18.931748+0000","last_peered":"2024-03-28T05:43:18.931748+0000","last_clean":"2024-03-28T05:43:18.931748+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:43:18.931748+0000","last_undegraded":"2024-03-28T05:43:18.931748+0000","last_fullsized":"2024-03-28T05:43:18.931748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813647+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:44:17.813647+0000","last_peered":"2024-03-28T05:44:17.813647+0000","last_clean":"2024-03-28T05:44:17.813647+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:44:17.813647+0000","last_undegraded":"2024-03-28T05:44:17.813647+0000","last_fullsized":"2024-03-28T05:44:17.813647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926663+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:43:18.926663+0000","last_peered":"2024-03-28T05:43:18.926663+0000","last_clean":"2024-03-28T05:43:18.926663+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:43:18.926663+0000","last_undegraded":"2024-03-28T05:43:18.926663+0000","last_fullsized":"2024-03-28T05:43:18.926663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832121+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:44:17.832121+0000","last_peered":"2024-03-28T05:44:17.832121+0000","last_clean":"2024-03-28T05:44:17.832121+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:44:17.832121+0000","last_undegraded":"2024-03-28T05:44:17.832121+0000","last_fullsized":"2024-03-28T05:44:17.832121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822580+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:44:17.822580+0000","last_peered":"2024-03-28T05:44:17.822580+0000","last_clean":"2024-03-28T05:44:17.822580+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:44:17.822580+0000","last_undegraded":"2024-03-28T05:44:17.822580+0000","last_fullsized":"2024-03-28T05:44:17.822580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:13.187980+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:45:13.187980+0000","last_peered":"2024-03-28T05:45:13.187980+0000","last_clean":"2024-03-28T05:45:13.187980+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:45:13.187980+0000","last_undegraded":"2024-03-28T05:45:13.187980+0000","last_fullsized":"2024-03-28T05:45:13.187980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":137,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835274+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:44:17.835274+0000","last_peered":"2024-03-28T05:44:17.835274+0000","last_clean":"2024-03-28T05:44:17.835274+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:44:17.835274+0000","last_undegraded":"2024-03-28T05:44:17.835274+0000","last_fullsized":"2024-03-28T05:44:17.835274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923968+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:43:18.923968+0000","last_peered":"2024-03-28T05:43:18.923968+0000","last_clean":"2024-03-28T05:43:18.923968+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:43:18.923968+0000","last_undegraded":"2024-03-28T05:43:18.923968+0000","last_fullsized":"2024-03-28T05:43:18.923968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927223+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:43:18.927223+0000","last_peered":"2024-03-28T05:43:18.927223+0000","last_clean":"2024-03-28T05:43:18.927223+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:43:18.927223+0000","last_undegraded":"2024-03-28T05:43:18.927223+0000","last_fullsized":"2024-03-28T05:43:18.927223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823604+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:44:17.823604+0000","last_peered":"2024-03-28T05:44:17.823604+0000","last_clean":"2024-03-28T05:44:17.823604+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:44:17.823604+0000","last_undegraded":"2024-03-28T05:44:17.823604+0000","last_fullsized":"2024-03-28T05:44:17.823604+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926670+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:43:18.926670+0000","last_peered":"2024-03-28T05:43:18.926670+0000","last_clean":"2024-03-28T05:43:18.926670+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:43:18.926670+0000","last_undegraded":"2024-03-28T05:43:18.926670+0000","last_fullsized":"2024-03-28T05:43:18.926670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.951170+0000","last_change":"2024-03-28T05:43:18.950408+0000","last_active":"2024-03-28T05:43:18.951170+0000","last_peered":"2024-03-28T05:43:18.951170+0000","last_clean":"2024-03-28T05:43:18.951170+0000","last_became_active":"2024-03-28T05:43:18.936590+0000","last_became_peered":"2024-03-28T05:43:18.936590+0000","last_unstale":"2024-03-28T05:43:18.951170+0000","last_undegraded":"2024-03-28T05:43:18.951170+0000","last_fullsized":"2024-03-28T05:43:18.951170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:39:27.277236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819921+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:44:17.819921+0000","last_peered":"2024-03-28T05:44:17.819921+0000","last_clean":"2024-03-28T05:44:17.819921+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:44:17.819921+0000","last_undegraded":"2024-03-28T05:44:17.819921+0000","last_fullsized":"2024-03-28T05:44:17.819921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'10","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:03.534063+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:45:03.534063+0000","last_peered":"2024-03-28T05:45:03.534063+0000","last_clean":"2024-03-28T05:45:03.534063+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:45:03.534063+0000","last_undegraded":"2024-03-28T05:45:03.534063+0000","last_fullsized":"2024-03-28T05:45:03.534063+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817681+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:44:17.817681+0000","last_peered":"2024-03-28T05:44:17.817681+0000","last_clean":"2024-03-28T05:44:17.817681+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:44:17.817681+0000","last_undegraded":"2024-03-28T05:44:17.817681+0000","last_fullsized":"2024-03-28T05:44:17.817681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923640+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:43:18.923640+0000","last_peered":"2024-03-28T05:43:18.923640+0000","last_clean":"2024-03-28T05:43:18.923640+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:43:18.923640+0000","last_undegraded":"2024-03-28T05:43:18.923640+0000","last_fullsized":"2024-03-28T05:43:18.923640+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831225+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:44:17.831225+0000","last_peered":"2024-03-28T05:44:17.831225+0000","last_clean":"2024-03-28T05:44:17.831225+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:44:17.831225+0000","last_undegraded":"2024-03-28T05:44:17.831225+0000","last_fullsized":"2024-03-28T05:44:17.831225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929809+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:43:18.929809+0000","last_peered":"2024-03-28T05:43:18.929809+0000","last_clean":"2024-03-28T05:43:18.929809+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:43:18.929809+0000","last_undegraded":"2024-03-28T05:43:18.929809+0000","last_fullsized":"2024-03-28T05:43:18.929809+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.811377+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:44:17.811377+0000","last_peered":"2024-03-28T05:44:17.811377+0000","last_clean":"2024-03-28T05:44:17.811377+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:44:17.811377+0000","last_undegraded":"2024-03-28T05:44:17.811377+0000","last_fullsized":"2024-03-28T05:44:17.811377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930385+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:43:18.930385+0000","last_peered":"2024-03-28T05:43:18.930385+0000","last_clean":"2024-03-28T05:43:18.930385+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:43:18.930385+0000","last_undegraded":"2024-03-28T05:43:18.930385+0000","last_fullsized":"2024-03-28T05:43:18.930385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830699+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:44:17.830699+0000","last_peered":"2024-03-28T05:44:17.830699+0000","last_clean":"2024-03-28T05:44:17.830699+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:44:17.830699+0000","last_undegraded":"2024-03-28T05:44:17.830699+0000","last_fullsized":"2024-03-28T05:44:17.830699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:05.436491+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:45:05.436491+0000","last_peered":"2024-03-28T05:45:05.436491+0000","last_clean":"2024-03-28T05:45:05.436491+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:45:05.436491+0000","last_undegraded":"2024-03-28T05:45:05.436491+0000","last_fullsized":"2024-03-28T05:45:05.436491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830528+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:44:17.830528+0000","last_peered":"2024-03-28T05:44:17.830528+0000","last_clean":"2024-03-28T05:44:17.830528+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:44:17.830528+0000","last_undegraded":"2024-03-28T05:44:17.830528+0000","last_fullsized":"2024-03-28T05:44:17.830528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926416+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:43:18.926416+0000","last_peered":"2024-03-28T05:43:18.926416+0000","last_clean":"2024-03-28T05:43:18.926416+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:43:18.926416+0000","last_undegraded":"2024-03-28T05:43:18.926416+0000","last_fullsized":"2024-03-28T05:43:18.926416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835992+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:44:17.835992+0000","last_peered":"2024-03-28T05:44:17.835992+0000","last_clean":"2024-03-28T05:44:17.835992+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:44:17.835992+0000","last_undegraded":"2024-03-28T05:44:17.835992+0000","last_fullsized":"2024-03-28T05:44:17.835992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937454+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:43:18.937454+0000","last_peered":"2024-03-28T05:43:18.937454+0000","last_clean":"2024-03-28T05:43:18.937454+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:43:18.937454+0000","last_undegraded":"2024-03-28T05:43:18.937454+0000","last_fullsized":"2024-03-28T05:43:18.937454+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841989+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:44:17.841989+0000","last_peered":"2024-03-28T05:44:17.841989+0000","last_clean":"2024-03-28T05:44:17.841989+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:44:17.841989+0000","last_undegraded":"2024-03-28T05:44:17.841989+0000","last_fullsized":"2024-03-28T05:44:17.841989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948434+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:43:18.948434+0000","last_peered":"2024-03-28T05:43:18.948434+0000","last_clean":"2024-03-28T05:43:18.948434+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:43:18.948434+0000","last_undegraded":"2024-03-28T05:43:18.948434+0000","last_fullsized":"2024-03-28T05:43:18.948434+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825244+0000","last_change":"2024-03-28T05:43:18.957536+0000","last_active":"2024-03-28T05:44:17.825244+0000","last_peered":"2024-03-28T05:44:17.825244+0000","last_clean":"2024-03-28T05:44:17.825244+0000","last_became_active":"2024-03-28T05:43:18.945541+0000","last_became_peered":"2024-03-28T05:43:18.945541+0000","last_unstale":"2024-03-28T05:44:17.825244+0000","last_undegraded":"2024-03-28T05:44:17.825244+0000","last_fullsized":"2024-03-28T05:44:17.825244+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:35:23.625743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933109+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:43:18.933109+0000","last_peered":"2024-03-28T05:43:18.933109+0000","last_clean":"2024-03-28T05:43:18.933109+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:43:18.933109+0000","last_undegraded":"2024-03-28T05:43:18.933109+0000","last_fullsized":"2024-03-28T05:43:18.933109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828825+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:44:17.828825+0000","last_peered":"2024-03-28T05:44:17.828825+0000","last_clean":"2024-03-28T05:44:17.828825+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:44:17.828825+0000","last_undegraded":"2024-03-28T05:44:17.828825+0000","last_fullsized":"2024-03-28T05:44:17.828825+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823662+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:44:17.823662+0000","last_peered":"2024-03-28T05:44:17.823662+0000","last_clean":"2024-03-28T05:44:17.823662+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:44:17.823662+0000","last_undegraded":"2024-03-28T05:44:17.823662+0000","last_fullsized":"2024-03-28T05:44:17.823662+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825447+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:44:17.825447+0000","last_peered":"2024-03-28T05:44:17.825447+0000","last_clean":"2024-03-28T05:44:17.825447+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:44:17.825447+0000","last_undegraded":"2024-03-28T05:44:17.825447+0000","last_fullsized":"2024-03-28T05:44:17.825447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825872+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:44:17.825872+0000","last_peered":"2024-03-28T05:44:17.825872+0000","last_clean":"2024-03-28T05:44:17.825872+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:44:17.825872+0000","last_undegraded":"2024-03-28T05:44:17.825872+0000","last_fullsized":"2024-03-28T05:44:17.825872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831731+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:44:17.831731+0000","last_peered":"2024-03-28T05:44:17.831731+0000","last_clean":"2024-03-28T05:44:17.831731+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:44:17.831731+0000","last_undegraded":"2024-03-28T05:44:17.831731+0000","last_fullsized":"2024-03-28T05:44:17.831731+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.826103+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:44:17.826103+0000","last_peered":"2024-03-28T05:44:17.826103+0000","last_clean":"2024-03-28T05:44:17.826103+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:44:17.826103+0000","last_undegraded":"2024-03-28T05:44:17.826103+0000","last_fullsized":"2024-03-28T05:44:17.826103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816002+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:44:17.816002+0000","last_peered":"2024-03-28T05:44:17.816002+0000","last_clean":"2024-03-28T05:44:17.816002+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:44:17.816002+0000","last_undegraded":"2024-03-28T05:44:17.816002+0000","last_fullsized":"2024-03-28T05:44:17.816002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.838346+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:44:17.838346+0000","last_peered":"2024-03-28T05:44:17.838346+0000","last_clean":"2024-03-28T05:44:17.838346+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:44:17.838346+0000","last_undegraded":"2024-03-28T05:44:17.838346+0000","last_fullsized":"2024-03-28T05:44:17.838346+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822135+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:44:17.822135+0000","last_peered":"2024-03-28T05:44:17.822135+0000","last_clean":"2024-03-28T05:44:17.822135+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:44:17.822135+0000","last_undegraded":"2024-03-28T05:44:17.822135+0000","last_fullsized":"2024-03-28T05:44:17.822135+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.812261+0000","last_change":"2024-03-28T05:43:18.939398+0000","last_active":"2024-03-28T05:44:17.812261+0000","last_peered":"2024-03-28T05:44:17.812261+0000","last_clean":"2024-03-28T05:44:17.812261+0000","last_became_active":"2024-03-28T05:43:18.936942+0000","last_became_peered":"2024-03-28T05:43:18.936942+0000","last_unstale":"2024-03-28T05:44:17.812261+0000","last_undegraded":"2024-03-28T05:44:17.812261+0000","last_fullsized":"2024-03-28T05:44:17.812261+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:02:50.892203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824626+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:44:17.824626+0000","last_peered":"2024-03-28T05:44:17.824626+0000","last_clean":"2024-03-28T05:44:17.824626+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:44:17.824626+0000","last_undegraded":"2024-03-28T05:44:17.824626+0000","last_fullsized":"2024-03-28T05:44:17.824626+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.839006+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:44:17.839006+0000","last_peered":"2024-03-28T05:44:17.839006+0000","last_clean":"2024-03-28T05:44:17.839006+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:44:17.839006+0000","last_undegraded":"2024-03-28T05:44:17.839006+0000","last_fullsized":"2024-03-28T05:44:17.839006+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832264+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:44:17.832264+0000","last_peered":"2024-03-28T05:44:17.832264+0000","last_clean":"2024-03-28T05:44:17.832264+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:44:17.832264+0000","last_undegraded":"2024-03-28T05:44:17.832264+0000","last_fullsized":"2024-03-28T05:44:17.832264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818676+0000","last_change":"2024-03-28T05:43:18.944603+0000","last_active":"2024-03-28T05:44:17.818676+0000","last_peered":"2024-03-28T05:44:17.818676+0000","last_clean":"2024-03-28T05:44:17.818676+0000","last_became_active":"2024-03-28T05:43:18.943787+0000","last_became_peered":"2024-03-28T05:43:18.943787+0000","last_unstale":"2024-03-28T05:44:17.818676+0000","last_undegraded":"2024-03-28T05:44:17.818676+0000","last_fullsized":"2024-03-28T05:44:17.818676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:13.905446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75968,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":866,"num_read_kb":508,"num_write":178,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1057,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":219276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220206,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":481676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481844,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1716224,"data_stored":1144446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":481985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939715,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":481744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234058,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1617920,"data_stored":1075377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430287,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":547044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":482528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":547772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":481451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":484366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691928,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1630208,"data_stored":1074036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:45:20.065 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-28T05:45:20.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T05:45:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:19 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2334563762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:19 smithi086 ceph-mon[35163]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:19 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2334563762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:19 smithi159 ceph-mon[36109]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:20.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 -- 172.21.15.55:0/892844335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081026f0 msgr2=0x7fc908102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 --2- 172.21.15.55:0/892844335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081026f0 0x7fc908102b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009900 tx=0x7fc8f402bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:20.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 -- 172.21.15.55:0/892844335 shutdown_connections 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 --2- 172.21.15.55:0/892844335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9081030b0 0x7fc908109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 --2- 172.21.15.55:0/892844335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081026f0 0x7fc908102b70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 --2- 172.21.15.55:0/892844335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc908101500 0x7fc908101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 -- 172.21.15.55:0/892844335 >> 172.21.15.55:0/892844335 conn(0x7fc9080fca70 msgr2=0x7fc9080feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 -- 172.21.15.55:0/892844335 shutdown_connections 2024-03-28T05:45:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.320+0000 7fc90e400640 1 -- 172.21.15.55:0/892844335 wait complete. 2024-03-28T05:45:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.321+0000 7fc90e400640 1 Processor -- start 2024-03-28T05:45:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.321+0000 7fc90e400640 1 -- start start 2024-03-28T05:45:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc908101500 0x7fc908197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90810d090 con 0x7fc9081030b0 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90810cf10 con 0x7fc9081026f0 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90e400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90810d210 con 0x7fc908101500 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc907e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60712/0 (socket says 172.21.15.55:60712) 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90da00640 1 -- 172.21.15.55:0/1802191195 learned_addr learned my addr 172.21.15.55:0/1802191195 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc907e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51668/0 (socket says 172.21.15.55:51668) 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.322+0000 7fc90d000640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc908101500 0x7fc908197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 -- 172.21.15.55:0/1802191195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc908101500 msgr2=0x7fc908197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc908101500 0x7fc908197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 -- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 msgr2=0x7fc90819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 -- 172.21.15.55:0/1802191195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90819f340 con 0x7fc9081026f0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc90da00640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.323+0000 7fc907e00640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8f402c170 tx=0x7fc8f40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.324+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4043020 con 0x7fc9081026f0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.324+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90819f5d0 con 0x7fc9081026f0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.324+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc8f40044c0 con 0x7fc9081026f0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.324+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4003c30 con 0x7fc9081026f0 2024-03-28T05:45:20.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.324+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90819fb40 con 0x7fc9081026f0 2024-03-28T05:45:20.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.325+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9081088c0 con 0x7fc9081026f0 2024-03-28T05:45:20.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.328+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc8f4046020 con 0x7fc9081026f0 2024-03-28T05:45:20.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.329+0000 7fc905600640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 0x7fc8f00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.329+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8f40f1320 con 0x7fc9081026f0 2024-03-28T05:45:20.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.330+0000 7fc90d000640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 0x7fc8f00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.331+0000 7fc90d000640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 0x7fc8f00a4cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0095f0 tx=0x7fc8fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:20.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.337+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc8f404d020 con 0x7fc9081026f0 2024-03-28T05:45:20.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.551+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 --> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc908061ae0 con 0x7fc8f00a2800 2024-03-28T05:45:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.561+0000 7fc905600640 1 -- 172.21.15.55:0/1802191195 <== mgr.14152 v2:172.21.15.55:6800/3012677107 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258924 (secure 0 0 0) 0x7fc908061ae0 con 0x7fc8f00a2800 2024-03-28T05:45:20.566 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-03-28T05:45:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 msgr2=0x7fc8f00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 0x7fc8f00a4cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0095f0 tx=0x7fc8fc005f90 comp rx=0 tx=0).stop 2024-03-28T05:45:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 msgr2=0x7fc908197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8f402c170 tx=0x7fc8f40040c0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 shutdown_connections 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8f00a2800 0x7fc8f00a4cc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9081030b0 0x7fc90819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9081026f0 0x7fc908197c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 --2- 172.21.15.55:0/1802191195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc908101500 0x7fc908197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.566+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 >> 172.21.15.55:0/1802191195 conn(0x7fc9080fca70 msgr2=0x7fc908105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.567+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 shutdown_connections 2024-03-28T05:45:20.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.567+0000 7fc90e400640 1 -- 172.21.15.55:0/1802191195 wait complete. 2024-03-28T05:45:20.585 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-03-28T05:45:19.879009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666570,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":992,"num_read_kb":617,"num_write":361,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181910,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388064,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553760,"statfs":{"total":1151940427776,"available":1151543050240,"internally_reserved":0,"allocated":14286848,"data_stored":7763682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":33,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004939"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840728+0000","last_change":"2024-03-28T05:42:52.713819+0000","last_active":"2024-03-28T05:44:17.840728+0000","last_peered":"2024-03-28T05:44:17.840728+0000","last_clean":"2024-03-28T05:44:17.840728+0000","last_became_active":"2024-03-28T05:42:52.713012+0000","last_became_peered":"2024-03-28T05:42:52.713012+0000","last_unstale":"2024-03-28T05:44:17.840728+0000","last_undegraded":"2024-03-28T05:44:17.840728+0000","last_fullsized":"2024-03-28T05:44:17.840728+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:44:45.932481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837683+0000","last_change":"2024-03-28T05:42:52.720450+0000","last_active":"2024-03-28T05:44:17.837683+0000","last_peered":"2024-03-28T05:44:17.837683+0000","last_clean":"2024-03-28T05:44:17.837683+0000","last_became_active":"2024-03-28T05:42:52.719396+0000","last_became_peered":"2024-03-28T05:42:52.719396+0000","last_unstale":"2024-03-28T05:44:17.837683+0000","last_undegraded":"2024-03-28T05:44:17.837683+0000","last_fullsized":"2024-03-28T05:44:17.837683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:50:42.206763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841249+0000","last_change":"2024-03-28T05:42:52.725407+0000","last_active":"2024-03-28T05:44:17.841249+0000","last_peered":"2024-03-28T05:44:17.841249+0000","last_clean":"2024-03-28T05:44:17.841249+0000","last_became_active":"2024-03-28T05:42:52.718509+0000","last_became_peered":"2024-03-28T05:42:52.718509+0000","last_unstale":"2024-03-28T05:44:17.841249+0000","last_undegraded":"2024-03-28T05:44:17.841249+0000","last_fullsized":"2024-03-28T05:44:17.841249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:19:50.440824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825822+0000","last_change":"2024-03-28T05:42:52.718963+0000","last_active":"2024-03-28T05:44:17.825822+0000","last_peered":"2024-03-28T05:44:17.825822+0000","last_clean":"2024-03-28T05:44:17.825822+0000","last_became_active":"2024-03-28T05:42:52.718270+0000","last_became_peered":"2024-03-28T05:42:52.718270+0000","last_unstale":"2024-03-28T05:44:17.825822+0000","last_undegraded":"2024-03-28T05:44:17.825822+0000","last_fullsized":"2024-03-28T05:44:17.825822+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:48:03.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813565+0000","last_change":"2024-03-28T05:42:52.721786+0000","last_active":"2024-03-28T05:44:17.813565+0000","last_peered":"2024-03-28T05:44:17.813565+0000","last_clean":"2024-03-28T05:44:17.813565+0000","last_became_active":"2024-03-28T05:42:52.720870+0000","last_became_peered":"2024-03-28T05:42:52.720870+0000","last_unstale":"2024-03-28T05:44:17.813565+0000","last_undegraded":"2024-03-28T05:44:17.813565+0000","last_fullsized":"2024-03-28T05:44:17.813565+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:30:14.919955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822178+0000","last_change":"2024-03-28T05:42:52.699561+0000","last_active":"2024-03-28T05:44:17.822178+0000","last_peered":"2024-03-28T05:44:17.822178+0000","last_clean":"2024-03-28T05:44:17.822178+0000","last_became_active":"2024-03-28T05:42:52.699162+0000","last_became_peered":"2024-03-28T05:42:52.699162+0000","last_unstale":"2024-03-28T05:44:17.822178+0000","last_undegraded":"2024-03-28T05:44:17.822178+0000","last_fullsized":"2024-03-28T05:44:17.822178+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:59.506157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814160+0000","last_change":"2024-03-28T05:42:52.708365+0000","last_active":"2024-03-28T05:44:17.814160+0000","last_peered":"2024-03-28T05:44:17.814160+0000","last_clean":"2024-03-28T05:44:17.814160+0000","last_became_active":"2024-03-28T05:42:52.707981+0000","last_became_peered":"2024-03-28T05:42:52.707981+0000","last_unstale":"2024-03-28T05:44:17.814160+0000","last_undegraded":"2024-03-28T05:44:17.814160+0000","last_fullsized":"2024-03-28T05:44:17.814160+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:05:24.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816586+0000","last_change":"2024-03-28T05:42:52.715508+0000","last_active":"2024-03-28T05:44:17.816586+0000","last_peered":"2024-03-28T05:44:17.816586+0000","last_clean":"2024-03-28T05:44:17.816586+0000","last_became_active":"2024-03-28T05:42:52.715117+0000","last_became_peered":"2024-03-28T05:42:52.715117+0000","last_unstale":"2024-03-28T05:44:17.816586+0000","last_undegraded":"2024-03-28T05:44:17.816586+0000","last_fullsized":"2024-03-28T05:44:17.816586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:03:40.090273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.844240+0000","last_change":"2024-03-28T05:42:52.719744+0000","last_active":"2024-03-28T05:44:17.844240+0000","last_peered":"2024-03-28T05:44:17.844240+0000","last_clean":"2024-03-28T05:44:17.844240+0000","last_became_active":"2024-03-28T05:42:52.719450+0000","last_became_peered":"2024-03-28T05:42:52.719450+0000","last_unstale":"2024-03-28T05:44:17.844240+0000","last_undegraded":"2024-03-28T05:44:17.844240+0000","last_fullsized":"2024-03-28T05:44:17.844240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:27:48.960551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831855+0000","last_change":"2024-03-28T05:42:52.700561+0000","last_active":"2024-03-28T05:44:17.831855+0000","last_peered":"2024-03-28T05:44:17.831855+0000","last_clean":"2024-03-28T05:44:17.831855+0000","last_became_active":"2024-03-28T05:42:52.698865+0000","last_became_peered":"2024-03-28T05:42:52.698865+0000","last_unstale":"2024-03-28T05:44:17.831855+0000","last_undegraded":"2024-03-28T05:44:17.831855+0000","last_fullsized":"2024-03-28T05:44:17.831855+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:42:28.385224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841747+0000","last_change":"2024-03-28T05:42:52.721771+0000","last_active":"2024-03-28T05:44:17.841747+0000","last_peered":"2024-03-28T05:44:17.841747+0000","last_clean":"2024-03-28T05:44:17.841747+0000","last_became_active":"2024-03-28T05:42:52.719719+0000","last_became_peered":"2024-03-28T05:42:52.719719+0000","last_unstale":"2024-03-28T05:44:17.841747+0000","last_undegraded":"2024-03-28T05:44:17.841747+0000","last_fullsized":"2024-03-28T05:44:17.841747+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:48:23.553580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.820910+0000","last_change":"2024-03-28T05:42:52.718663+0000","last_active":"2024-03-28T05:44:17.820910+0000","last_peered":"2024-03-28T05:44:17.820910+0000","last_clean":"2024-03-28T05:44:17.820910+0000","last_became_active":"2024-03-28T05:42:52.717828+0000","last_became_peered":"2024-03-28T05:42:52.717828+0000","last_unstale":"2024-03-28T05:44:17.820910+0000","last_undegraded":"2024-03-28T05:44:17.820910+0000","last_fullsized":"2024-03-28T05:44:17.820910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:28:53.118351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817703+0000","last_change":"2024-03-28T05:42:52.718251+0000","last_active":"2024-03-28T05:44:17.817703+0000","last_peered":"2024-03-28T05:44:17.817703+0000","last_clean":"2024-03-28T05:44:17.817703+0000","last_became_active":"2024-03-28T05:42:52.717812+0000","last_became_peered":"2024-03-28T05:42:52.717812+0000","last_unstale":"2024-03-28T05:44:17.817703+0000","last_undegraded":"2024-03-28T05:44:17.817703+0000","last_fullsized":"2024-03-28T05:44:17.817703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:16.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837405+0000","last_change":"2024-03-28T05:42:52.725208+0000","last_active":"2024-03-28T05:44:17.837405+0000","last_peered":"2024-03-28T05:44:17.837405+0000","last_clean":"2024-03-28T05:44:17.837405+0000","last_became_active":"2024-03-28T05:42:52.723772+0000","last_became_peered":"2024-03-28T05:42:52.723772+0000","last_unstale":"2024-03-28T05:44:17.837405+0000","last_undegraded":"2024-03-28T05:44:17.837405+0000","last_fullsized":"2024-03-28T05:44:17.837405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:23.132951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824671+0000","last_change":"2024-03-28T05:43:18.941455+0000","last_active":"2024-03-28T05:44:17.824671+0000","last_peered":"2024-03-28T05:44:17.824671+0000","last_clean":"2024-03-28T05:44:17.824671+0000","last_became_active":"2024-03-28T05:43:18.941092+0000","last_became_peered":"2024-03-28T05:43:18.941092+0000","last_unstale":"2024-03-28T05:44:17.824671+0000","last_undegraded":"2024-03-28T05:44:17.824671+0000","last_fullsized":"2024-03-28T05:44:17.824671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:44:55.741140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.840505+0000","last_change":"2024-03-28T05:42:52.711669+0000","last_active":"2024-03-28T05:44:17.840505+0000","last_peered":"2024-03-28T05:44:17.840505+0000","last_clean":"2024-03-28T05:44:17.840505+0000","last_became_active":"2024-03-28T05:42:52.711460+0000","last_became_peered":"2024-03-28T05:42:52.711460+0000","last_unstale":"2024-03-28T05:44:17.840505+0000","last_undegraded":"2024-03-28T05:44:17.840505+0000","last_fullsized":"2024-03-28T05:44:17.840505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:53.222156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841046+0000","last_change":"2024-03-28T05:42:52.714155+0000","last_active":"2024-03-28T05:44:17.841046+0000","last_peered":"2024-03-28T05:44:17.841046+0000","last_clean":"2024-03-28T05:44:17.841046+0000","last_became_active":"2024-03-28T05:42:52.713461+0000","last_became_peered":"2024-03-28T05:42:52.713461+0000","last_unstale":"2024-03-28T05:44:17.841046+0000","last_undegraded":"2024-03-28T05:44:17.841046+0000","last_fullsized":"2024-03-28T05:44:17.841046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:56.819828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.837612+0000","last_change":"2024-03-28T05:42:52.696548+0000","last_active":"2024-03-28T05:44:17.837612+0000","last_peered":"2024-03-28T05:44:17.837612+0000","last_clean":"2024-03-28T05:44:17.837612+0000","last_became_active":"2024-03-28T05:42:52.696151+0000","last_became_peered":"2024-03-28T05:42:52.696151+0000","last_unstale":"2024-03-28T05:44:17.837612+0000","last_undegraded":"2024-03-28T05:44:17.837612+0000","last_fullsized":"2024-03-28T05:44:17.837612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:20.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828447+0000","last_change":"2024-03-28T05:42:52.715316+0000","last_active":"2024-03-28T05:44:17.828447+0000","last_peered":"2024-03-28T05:44:17.828447+0000","last_clean":"2024-03-28T05:44:17.828447+0000","last_became_active":"2024-03-28T05:42:52.710003+0000","last_became_peered":"2024-03-28T05:42:52.710003+0000","last_unstale":"2024-03-28T05:44:17.828447+0000","last_undegraded":"2024-03-28T05:44:17.828447+0000","last_fullsized":"2024-03-28T05:44:17.828447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:49:55.565039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933574+0000","last_change":"2024-03-28T05:42:51.677375+0000","last_active":"2024-03-28T05:43:18.933574+0000","last_peered":"2024-03-28T05:43:18.933574+0000","last_clean":"2024-03-28T05:43:18.933574+0000","last_became_active":"2024-03-28T05:42:51.677042+0000","last_became_peered":"2024-03-28T05:42:51.677042+0000","last_unstale":"2024-03-28T05:43:18.933574+0000","last_undegraded":"2024-03-28T05:43:18.933574+0000","last_fullsized":"2024-03-28T05:43:18.933574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:16:57.888690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828208+0000","last_change":"2024-03-28T05:42:52.720999+0000","last_active":"2024-03-28T05:44:17.828208+0000","last_peered":"2024-03-28T05:44:17.828208+0000","last_clean":"2024-03-28T05:44:17.828208+0000","last_became_active":"2024-03-28T05:42:52.720639+0000","last_became_peered":"2024-03-28T05:42:52.720639+0000","last_unstale":"2024-03-28T05:44:17.828208+0000","last_undegraded":"2024-03-28T05:44:17.828208+0000","last_fullsized":"2024-03-28T05:44:17.828208+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:31:08.863241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932847+0000","last_change":"2024-03-28T05:42:51.679157+0000","last_active":"2024-03-28T05:43:18.932847+0000","last_peered":"2024-03-28T05:43:18.932847+0000","last_clean":"2024-03-28T05:43:18.932847+0000","last_became_active":"2024-03-28T05:42:51.678480+0000","last_became_peered":"2024-03-28T05:42:51.678480+0000","last_unstale":"2024-03-28T05:43:18.932847+0000","last_undegraded":"2024-03-28T05:43:18.932847+0000","last_fullsized":"2024-03-28T05:43:18.932847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:44:26.515979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841168+0000","last_change":"2024-03-28T05:42:52.713910+0000","last_active":"2024-03-28T05:44:17.841168+0000","last_peered":"2024-03-28T05:44:17.841168+0000","last_clean":"2024-03-28T05:44:17.841168+0000","last_became_active":"2024-03-28T05:42:52.713530+0000","last_became_peered":"2024-03-28T05:42:52.713530+0000","last_unstale":"2024-03-28T05:44:17.841168+0000","last_undegraded":"2024-03-28T05:44:17.841168+0000","last_fullsized":"2024-03-28T05:44:17.841168+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:59:40.642830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926528+0000","last_change":"2024-03-28T05:42:51.686441+0000","last_active":"2024-03-28T05:43:18.926528+0000","last_peered":"2024-03-28T05:43:18.926528+0000","last_clean":"2024-03-28T05:43:18.926528+0000","last_became_active":"2024-03-28T05:42:51.686106+0000","last_became_peered":"2024-03-28T05:42:51.686106+0000","last_unstale":"2024-03-28T05:43:18.926528+0000","last_undegraded":"2024-03-28T05:43:18.926528+0000","last_fullsized":"2024-03-28T05:43:18.926528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:05.949098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845473+0000","last_change":"2024-03-28T05:42:52.714825+0000","last_active":"2024-03-28T05:44:17.845473+0000","last_peered":"2024-03-28T05:44:17.845473+0000","last_clean":"2024-03-28T05:44:17.845473+0000","last_became_active":"2024-03-28T05:42:52.714513+0000","last_became_peered":"2024-03-28T05:42:52.714513+0000","last_unstale":"2024-03-28T05:44:17.845473+0000","last_undegraded":"2024-03-28T05:44:17.845473+0000","last_fullsized":"2024-03-28T05:44:17.845473+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:12:41.766130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926797+0000","last_change":"2024-03-28T05:42:51.686426+0000","last_active":"2024-03-28T05:43:18.926797+0000","last_peered":"2024-03-28T05:43:18.926797+0000","last_clean":"2024-03-28T05:43:18.926797+0000","last_became_active":"2024-03-28T05:42:51.685991+0000","last_became_peered":"2024-03-28T05:42:51.685991+0000","last_unstale":"2024-03-28T05:43:18.926797+0000","last_undegraded":"2024-03-28T05:43:18.926797+0000","last_fullsized":"2024-03-28T05:43:18.926797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:26.230214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.842087+0000","last_change":"2024-03-28T05:42:52.721987+0000","last_active":"2024-03-28T05:44:17.842087+0000","last_peered":"2024-03-28T05:44:17.842087+0000","last_clean":"2024-03-28T05:44:17.842087+0000","last_became_active":"2024-03-28T05:42:52.721586+0000","last_became_peered":"2024-03-28T05:42:52.721586+0000","last_unstale":"2024-03-28T05:44:17.842087+0000","last_undegraded":"2024-03-28T05:44:17.842087+0000","last_fullsized":"2024-03-28T05:44:17.842087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:49:53.135583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'8","reported_seq":185,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.282367+0000","last_change":"2024-03-28T05:43:18.959998+0000","last_active":"2024-03-28T05:45:17.282367+0000","last_peered":"2024-03-28T05:45:17.282367+0000","last_clean":"2024-03-28T05:45:17.282367+0000","last_became_active":"2024-03-28T05:43:18.945599+0000","last_became_peered":"2024-03-28T05:43:18.945599+0000","last_unstale":"2024-03-28T05:45:17.282367+0000","last_undegraded":"2024-03-28T05:45:17.282367+0000","last_fullsized":"2024-03-28T05:45:17.282367+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:02:08.702587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819251+0000","last_change":"2024-03-28T05:42:52.718451+0000","last_active":"2024-03-28T05:44:17.819251+0000","last_peered":"2024-03-28T05:44:17.819251+0000","last_clean":"2024-03-28T05:44:17.819251+0000","last_became_active":"2024-03-28T05:42:52.717938+0000","last_became_peered":"2024-03-28T05:42:52.717938+0000","last_unstale":"2024-03-28T05:44:17.819251+0000","last_undegraded":"2024-03-28T05:44:17.819251+0000","last_fullsized":"2024-03-28T05:44:17.819251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:03:27.582939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.968521+0000","last_change":"2024-03-28T05:42:51.688659+0000","last_active":"2024-03-28T05:43:18.968521+0000","last_peered":"2024-03-28T05:43:18.968521+0000","last_clean":"2024-03-28T05:43:18.968521+0000","last_became_active":"2024-03-28T05:42:51.688309+0000","last_became_peered":"2024-03-28T05:42:51.688309+0000","last_unstale":"2024-03-28T05:43:18.968521+0000","last_undegraded":"2024-03-28T05:43:18.968521+0000","last_fullsized":"2024-03-28T05:43:18.968521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:52:32.369605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821575+0000","last_change":"2024-03-28T05:42:52.726052+0000","last_active":"2024-03-28T05:44:17.821575+0000","last_peered":"2024-03-28T05:44:17.821575+0000","last_clean":"2024-03-28T05:44:17.821575+0000","last_became_active":"2024-03-28T05:42:52.725571+0000","last_became_peered":"2024-03-28T05:42:52.725571+0000","last_unstale":"2024-03-28T05:44:17.821575+0000","last_undegraded":"2024-03-28T05:44:17.821575+0000","last_fullsized":"2024-03-28T05:44:17.821575+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:38.792371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.932322+0000","last_change":"2024-03-28T05:42:51.679168+0000","last_active":"2024-03-28T05:43:18.932322+0000","last_peered":"2024-03-28T05:43:18.932322+0000","last_clean":"2024-03-28T05:43:18.932322+0000","last_became_active":"2024-03-28T05:42:51.678878+0000","last_became_peered":"2024-03-28T05:42:51.678878+0000","last_unstale":"2024-03-28T05:43:18.932322+0000","last_undegraded":"2024-03-28T05:43:18.932322+0000","last_fullsized":"2024-03-28T05:43:18.932322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:53:14.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817431+0000","last_change":"2024-03-28T05:42:52.717433+0000","last_active":"2024-03-28T05:44:17.817431+0000","last_peered":"2024-03-28T05:44:17.817431+0000","last_clean":"2024-03-28T05:44:17.817431+0000","last_became_active":"2024-03-28T05:42:52.717030+0000","last_became_peered":"2024-03-28T05:42:52.717030+0000","last_unstale":"2024-03-28T05:44:17.817431+0000","last_undegraded":"2024-03-28T05:44:17.817431+0000","last_fullsized":"2024-03-28T05:44:17.817431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:24:56.277824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.942469+0000","last_change":"2024-03-28T05:42:51.685970+0000","last_active":"2024-03-28T05:43:18.942469+0000","last_peered":"2024-03-28T05:43:18.942469+0000","last_clean":"2024-03-28T05:43:18.942469+0000","last_became_active":"2024-03-28T05:42:51.685330+0000","last_became_peered":"2024-03-28T05:42:51.685330+0000","last_unstale":"2024-03-28T05:43:18.942469+0000","last_undegraded":"2024-03-28T05:43:18.942469+0000","last_fullsized":"2024-03-28T05:43:18.942469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:22:30.815796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824769+0000","last_change":"2024-03-28T05:42:52.701076+0000","last_active":"2024-03-28T05:44:17.824769+0000","last_peered":"2024-03-28T05:44:17.824769+0000","last_clean":"2024-03-28T05:44:17.824769+0000","last_became_active":"2024-03-28T05:42:52.700676+0000","last_became_peered":"2024-03-28T05:42:52.700676+0000","last_unstale":"2024-03-28T05:44:17.824769+0000","last_undegraded":"2024-03-28T05:44:17.824769+0000","last_fullsized":"2024-03-28T05:44:17.824769+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:56:33.253109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'5","reported_seq":165,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.281125+0000","last_change":"2024-03-28T05:42:51.684272+0000","last_active":"2024-03-28T05:45:17.281125+0000","last_peered":"2024-03-28T05:45:17.281125+0000","last_clean":"2024-03-28T05:45:17.281125+0000","last_became_active":"2024-03-28T05:42:51.683837+0000","last_became_peered":"2024-03-28T05:42:51.683837+0000","last_unstale":"2024-03-28T05:45:17.281125+0000","last_undegraded":"2024-03-28T05:45:17.281125+0000","last_fullsized":"2024-03-28T05:45:17.281125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:25:22.276388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.843595+0000","last_change":"2024-03-28T05:42:52.706490+0000","last_active":"2024-03-28T05:44:17.843595+0000","last_peered":"2024-03-28T05:44:17.843595+0000","last_clean":"2024-03-28T05:44:17.843595+0000","last_became_active":"2024-03-28T05:42:52.703105+0000","last_became_peered":"2024-03-28T05:42:52.703105+0000","last_unstale":"2024-03-28T05:44:17.843595+0000","last_undegraded":"2024-03-28T05:44:17.843595+0000","last_fullsized":"2024-03-28T05:44:17.843595+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:08:04.050866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.939098+0000","last_change":"2024-03-28T05:43:18.937927+0000","last_active":"2024-03-28T05:43:18.939098+0000","last_peered":"2024-03-28T05:43:18.939098+0000","last_clean":"2024-03-28T05:43:18.939098+0000","last_became_active":"2024-03-28T05:43:18.931224+0000","last_became_peered":"2024-03-28T05:43:18.931224+0000","last_unstale":"2024-03-28T05:43:18.939098+0000","last_undegraded":"2024-03-28T05:43:18.939098+0000","last_fullsized":"2024-03-28T05:43:18.939098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:57:28.359905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.834091+0000","last_change":"2024-03-28T05:42:52.721371+0000","last_active":"2024-03-28T05:44:17.834091+0000","last_peered":"2024-03-28T05:44:17.834091+0000","last_clean":"2024-03-28T05:44:17.834091+0000","last_became_active":"2024-03-28T05:42:52.720649+0000","last_became_peered":"2024-03-28T05:42:52.720649+0000","last_unstale":"2024-03-28T05:44:17.834091+0000","last_undegraded":"2024-03-28T05:44:17.834091+0000","last_fullsized":"2024-03-28T05:44:17.834091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:37:31.361681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948798+0000","last_change":"2024-03-28T05:42:51.671204+0000","last_active":"2024-03-28T05:43:18.948798+0000","last_peered":"2024-03-28T05:43:18.948798+0000","last_clean":"2024-03-28T05:43:18.948798+0000","last_became_active":"2024-03-28T05:42:51.670064+0000","last_became_peered":"2024-03-28T05:42:51.670064+0000","last_unstale":"2024-03-28T05:43:18.948798+0000","last_undegraded":"2024-03-28T05:43:18.948798+0000","last_fullsized":"2024-03-28T05:43:18.948798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:01:58.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.845705+0000","last_change":"2024-03-28T05:42:52.708863+0000","last_active":"2024-03-28T05:44:17.845705+0000","last_peered":"2024-03-28T05:44:17.845705+0000","last_clean":"2024-03-28T05:44:17.845705+0000","last_became_active":"2024-03-28T05:42:52.708433+0000","last_became_peered":"2024-03-28T05:42:52.708433+0000","last_unstale":"2024-03-28T05:44:17.845705+0000","last_undegraded":"2024-03-28T05:44:17.845705+0000","last_fullsized":"2024-03-28T05:44:17.845705+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:11:49.775066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":346,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:17.229794+0000","last_change":"2024-03-28T05:42:51.687168+0000","last_active":"2024-03-28T05:45:17.229794+0000","last_peered":"2024-03-28T05:45:17.229794+0000","last_clean":"2024-03-28T05:45:17.229794+0000","last_became_active":"2024-03-28T05:42:51.685698+0000","last_became_peered":"2024-03-28T05:42:51.685698+0000","last_unstale":"2024-03-28T05:45:17.229794+0000","last_undegraded":"2024-03-28T05:45:17.229794+0000","last_fullsized":"2024-03-28T05:45:17.229794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:34.043436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70308,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":209,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825453+0000","last_change":"2024-03-28T05:42:52.717386+0000","last_active":"2024-03-28T05:44:17.825453+0000","last_peered":"2024-03-28T05:44:17.825453+0000","last_clean":"2024-03-28T05:44:17.825453+0000","last_became_active":"2024-03-28T05:42:52.716944+0000","last_became_peered":"2024-03-28T05:42:52.716944+0000","last_unstale":"2024-03-28T05:44:17.825453+0000","last_undegraded":"2024-03-28T05:44:17.825453+0000","last_fullsized":"2024-03-28T05:44:17.825453+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:45:32.533055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.936763+0000","last_change":"2024-03-28T05:42:51.677894+0000","last_active":"2024-03-28T05:43:18.936763+0000","last_peered":"2024-03-28T05:43:18.936763+0000","last_clean":"2024-03-28T05:43:18.936763+0000","last_became_active":"2024-03-28T05:42:51.676746+0000","last_became_peered":"2024-03-28T05:42:51.676746+0000","last_unstale":"2024-03-28T05:43:18.936763+0000","last_undegraded":"2024-03-28T05:43:18.936763+0000","last_fullsized":"2024-03-28T05:43:18.936763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:55:09.654421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.821574+0000","last_change":"2024-03-28T05:42:52.710168+0000","last_active":"2024-03-28T05:44:17.821574+0000","last_peered":"2024-03-28T05:44:17.821574+0000","last_clean":"2024-03-28T05:44:17.821574+0000","last_became_active":"2024-03-28T05:42:52.709084+0000","last_became_peered":"2024-03-28T05:42:52.709084+0000","last_unstale":"2024-03-28T05:44:17.821574+0000","last_undegraded":"2024-03-28T05:44:17.821574+0000","last_fullsized":"2024-03-28T05:44:17.821574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:42:07.072795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.946185+0000","last_change":"2024-03-28T05:42:51.679921+0000","last_active":"2024-03-28T05:43:18.946185+0000","last_peered":"2024-03-28T05:43:18.946185+0000","last_clean":"2024-03-28T05:43:18.946185+0000","last_became_active":"2024-03-28T05:42:51.679543+0000","last_became_peered":"2024-03-28T05:42:51.679543+0000","last_unstale":"2024-03-28T05:43:18.946185+0000","last_undegraded":"2024-03-28T05:43:18.946185+0000","last_fullsized":"2024-03-28T05:43:18.946185+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:48:40.706520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835326+0000","last_change":"2024-03-28T05:43:18.935508+0000","last_active":"2024-03-28T05:44:17.835326+0000","last_peered":"2024-03-28T05:44:17.835326+0000","last_clean":"2024-03-28T05:44:17.835326+0000","last_became_active":"2024-03-28T05:43:18.934708+0000","last_became_peered":"2024-03-28T05:43:18.934708+0000","last_unstale":"2024-03-28T05:44:17.835326+0000","last_undegraded":"2024-03-28T05:44:17.835326+0000","last_fullsized":"2024-03-28T05:44:17.835326+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:09:07.265862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":169,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:14.192191+0000","last_change":"2024-03-28T05:42:51.682860+0000","last_active":"2024-03-28T05:45:14.192191+0000","last_peered":"2024-03-28T05:45:14.192191+0000","last_clean":"2024-03-28T05:45:14.192191+0000","last_became_active":"2024-03-28T05:42:51.682054+0000","last_became_peered":"2024-03-28T05:42:51.682054+0000","last_unstale":"2024-03-28T05:45:14.192191+0000","last_undegraded":"2024-03-28T05:45:14.192191+0000","last_fullsized":"2024-03-28T05:45:14.192191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:03:17.595019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.814193+0000","last_change":"2024-03-28T05:42:52.708480+0000","last_active":"2024-03-28T05:44:17.814193+0000","last_peered":"2024-03-28T05:44:17.814193+0000","last_clean":"2024-03-28T05:44:17.814193+0000","last_became_active":"2024-03-28T05:42:52.708091+0000","last_became_peered":"2024-03-28T05:42:52.708091+0000","last_unstale":"2024-03-28T05:44:17.814193+0000","last_undegraded":"2024-03-28T05:44:17.814193+0000","last_fullsized":"2024-03-28T05:44:17.814193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:51:46.199799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.925706+0000","last_change":"2024-03-28T05:42:51.688131+0000","last_active":"2024-03-28T05:43:18.925706+0000","last_peered":"2024-03-28T05:43:18.925706+0000","last_clean":"2024-03-28T05:43:18.925706+0000","last_became_active":"2024-03-28T05:42:51.687790+0000","last_became_peered":"2024-03-28T05:42:51.687790+0000","last_unstale":"2024-03-28T05:43:18.925706+0000","last_undegraded":"2024-03-28T05:43:18.925706+0000","last_fullsized":"2024-03-28T05:43:18.925706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T11:32:42.962734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841479+0000","last_change":"2024-03-28T05:42:52.719776+0000","last_active":"2024-03-28T05:44:17.841479+0000","last_peered":"2024-03-28T05:44:17.841479+0000","last_clean":"2024-03-28T05:44:17.841479+0000","last_became_active":"2024-03-28T05:42:52.719344+0000","last_became_peered":"2024-03-28T05:42:52.719344+0000","last_unstale":"2024-03-28T05:44:17.841479+0000","last_undegraded":"2024-03-28T05:44:17.841479+0000","last_fullsized":"2024-03-28T05:44:17.841479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:27:53.172927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.957174+0000","last_change":"2024-03-28T05:43:18.956299+0000","last_active":"2024-03-28T05:43:18.957174+0000","last_peered":"2024-03-28T05:43:18.957174+0000","last_clean":"2024-03-28T05:43:18.957174+0000","last_became_active":"2024-03-28T05:43:18.947840+0000","last_became_peered":"2024-03-28T05:43:18.947840+0000","last_unstale":"2024-03-28T05:43:18.957174+0000","last_undegraded":"2024-03-28T05:43:18.957174+0000","last_fullsized":"2024-03-28T05:43:18.957174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:51.876409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818601+0000","last_change":"2024-03-28T05:42:52.713212+0000","last_active":"2024-03-28T05:44:17.818601+0000","last_peered":"2024-03-28T05:44:17.818601+0000","last_clean":"2024-03-28T05:44:17.818601+0000","last_became_active":"2024-03-28T05:42:52.712747+0000","last_became_peered":"2024-03-28T05:42:52.712747+0000","last_unstale":"2024-03-28T05:44:17.818601+0000","last_undegraded":"2024-03-28T05:44:17.818601+0000","last_fullsized":"2024-03-28T05:44:17.818601+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:25:57.527080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.931748+0000","last_change":"2024-03-28T05:42:51.667860+0000","last_active":"2024-03-28T05:43:18.931748+0000","last_peered":"2024-03-28T05:43:18.931748+0000","last_clean":"2024-03-28T05:43:18.931748+0000","last_became_active":"2024-03-28T05:42:51.667467+0000","last_became_peered":"2024-03-28T05:42:51.667467+0000","last_unstale":"2024-03-28T05:43:18.931748+0000","last_undegraded":"2024-03-28T05:43:18.931748+0000","last_fullsized":"2024-03-28T05:43:18.931748+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:59:02.281259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.813647+0000","last_change":"2024-03-28T05:42:52.712447+0000","last_active":"2024-03-28T05:44:17.813647+0000","last_peered":"2024-03-28T05:44:17.813647+0000","last_clean":"2024-03-28T05:44:17.813647+0000","last_became_active":"2024-03-28T05:42:52.711395+0000","last_became_peered":"2024-03-28T05:42:52.711395+0000","last_unstale":"2024-03-28T05:44:17.813647+0000","last_undegraded":"2024-03-28T05:44:17.813647+0000","last_fullsized":"2024-03-28T05:44:17.813647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:47:04.649283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926663+0000","last_change":"2024-03-28T05:42:51.686542+0000","last_active":"2024-03-28T05:43:18.926663+0000","last_peered":"2024-03-28T05:43:18.926663+0000","last_clean":"2024-03-28T05:43:18.926663+0000","last_became_active":"2024-03-28T05:42:51.683341+0000","last_became_peered":"2024-03-28T05:42:51.683341+0000","last_unstale":"2024-03-28T05:43:18.926663+0000","last_undegraded":"2024-03-28T05:43:18.926663+0000","last_fullsized":"2024-03-28T05:43:18.926663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:44:19.526967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832121+0000","last_change":"2024-03-28T05:42:52.712347+0000","last_active":"2024-03-28T05:44:17.832121+0000","last_peered":"2024-03-28T05:44:17.832121+0000","last_clean":"2024-03-28T05:44:17.832121+0000","last_became_active":"2024-03-28T05:42:52.710961+0000","last_became_peered":"2024-03-28T05:42:52.710961+0000","last_unstale":"2024-03-28T05:44:17.832121+0000","last_undegraded":"2024-03-28T05:44:17.832121+0000","last_fullsized":"2024-03-28T05:44:17.832121+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:25:41.961465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822580+0000","last_change":"2024-03-28T05:42:52.717264+0000","last_active":"2024-03-28T05:44:17.822580+0000","last_peered":"2024-03-28T05:44:17.822580+0000","last_clean":"2024-03-28T05:44:17.822580+0000","last_became_active":"2024-03-28T05:42:52.716903+0000","last_became_peered":"2024-03-28T05:42:52.716903+0000","last_unstale":"2024-03-28T05:44:17.822580+0000","last_undegraded":"2024-03-28T05:44:17.822580+0000","last_fullsized":"2024-03-28T05:44:17.822580+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:36:48.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:13.187980+0000","last_change":"2024-03-28T05:42:51.686016+0000","last_active":"2024-03-28T05:45:13.187980+0000","last_peered":"2024-03-28T05:45:13.187980+0000","last_clean":"2024-03-28T05:45:13.187980+0000","last_became_active":"2024-03-28T05:42:51.683471+0000","last_became_peered":"2024-03-28T05:42:51.683471+0000","last_unstale":"2024-03-28T05:45:13.187980+0000","last_undegraded":"2024-03-28T05:45:13.187980+0000","last_fullsized":"2024-03-28T05:45:13.187980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:24:54.746670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":137,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835274+0000","last_change":"2024-03-28T05:42:52.725226+0000","last_active":"2024-03-28T05:44:17.835274+0000","last_peered":"2024-03-28T05:44:17.835274+0000","last_clean":"2024-03-28T05:44:17.835274+0000","last_became_active":"2024-03-28T05:42:52.723340+0000","last_became_peered":"2024-03-28T05:42:52.723340+0000","last_unstale":"2024-03-28T05:44:17.835274+0000","last_undegraded":"2024-03-28T05:44:17.835274+0000","last_fullsized":"2024-03-28T05:44:17.835274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:13:07.182478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923968+0000","last_change":"2024-03-28T05:42:51.680515+0000","last_active":"2024-03-28T05:43:18.923968+0000","last_peered":"2024-03-28T05:43:18.923968+0000","last_clean":"2024-03-28T05:43:18.923968+0000","last_became_active":"2024-03-28T05:42:51.680076+0000","last_became_peered":"2024-03-28T05:42:51.680076+0000","last_unstale":"2024-03-28T05:43:18.923968+0000","last_undegraded":"2024-03-28T05:43:18.923968+0000","last_fullsized":"2024-03-28T05:43:18.923968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:37:04.712674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":348,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.927223+0000","last_change":"2024-03-28T05:41:15.755405+0000","last_active":"2024-03-28T05:43:18.927223+0000","last_peered":"2024-03-28T05:43:18.927223+0000","last_clean":"2024-03-28T05:43:18.927223+0000","last_became_active":"2024-03-28T05:41:15.754131+0000","last_became_peered":"2024-03-28T05:41:15.754131+0000","last_unstale":"2024-03-28T05:43:18.927223+0000","last_undegraded":"2024-03-28T05:43:18.927223+0000","last_fullsized":"2024-03-28T05:43:18.927223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:36:36.444722+0000","last_clean_scrub_stamp":"2024-03-28T05:36:36.444722+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:07:33.743793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823604+0000","last_change":"2024-03-28T05:42:52.710716+0000","last_active":"2024-03-28T05:44:17.823604+0000","last_peered":"2024-03-28T05:44:17.823604+0000","last_clean":"2024-03-28T05:44:17.823604+0000","last_became_active":"2024-03-28T05:42:52.710269+0000","last_became_peered":"2024-03-28T05:42:52.710269+0000","last_unstale":"2024-03-28T05:44:17.823604+0000","last_undegraded":"2024-03-28T05:44:17.823604+0000","last_fullsized":"2024-03-28T05:44:17.823604+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:43:14.049422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926670+0000","last_change":"2024-03-28T05:42:51.679086+0000","last_active":"2024-03-28T05:43:18.926670+0000","last_peered":"2024-03-28T05:43:18.926670+0000","last_clean":"2024-03-28T05:43:18.926670+0000","last_became_active":"2024-03-28T05:42:51.678438+0000","last_became_peered":"2024-03-28T05:42:51.678438+0000","last_unstale":"2024-03-28T05:43:18.926670+0000","last_undegraded":"2024-03-28T05:43:18.926670+0000","last_fullsized":"2024-03-28T05:43:18.926670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:06:13.423963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.951170+0000","last_change":"2024-03-28T05:43:18.950408+0000","last_active":"2024-03-28T05:43:18.951170+0000","last_peered":"2024-03-28T05:43:18.951170+0000","last_clean":"2024-03-28T05:43:18.951170+0000","last_became_active":"2024-03-28T05:43:18.936590+0000","last_became_peered":"2024-03-28T05:43:18.936590+0000","last_unstale":"2024-03-28T05:43:18.951170+0000","last_undegraded":"2024-03-28T05:43:18.951170+0000","last_fullsized":"2024-03-28T05:43:18.951170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:39:27.277236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.819921+0000","last_change":"2024-03-28T05:42:52.709065+0000","last_active":"2024-03-28T05:44:17.819921+0000","last_peered":"2024-03-28T05:44:17.819921+0000","last_clean":"2024-03-28T05:44:17.819921+0000","last_became_active":"2024-03-28T05:42:52.708650+0000","last_became_peered":"2024-03-28T05:42:52.708650+0000","last_unstale":"2024-03-28T05:44:17.819921+0000","last_undegraded":"2024-03-28T05:44:17.819921+0000","last_fullsized":"2024-03-28T05:44:17.819921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:53:16.407241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'10","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:03.534063+0000","last_change":"2024-03-28T05:42:51.680016+0000","last_active":"2024-03-28T05:45:03.534063+0000","last_peered":"2024-03-28T05:45:03.534063+0000","last_clean":"2024-03-28T05:45:03.534063+0000","last_became_active":"2024-03-28T05:42:51.679533+0000","last_became_peered":"2024-03-28T05:42:51.679533+0000","last_unstale":"2024-03-28T05:45:03.534063+0000","last_undegraded":"2024-03-28T05:45:03.534063+0000","last_fullsized":"2024-03-28T05:45:03.534063+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:51:32.039038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.817681+0000","last_change":"2024-03-28T05:42:52.715090+0000","last_active":"2024-03-28T05:44:17.817681+0000","last_peered":"2024-03-28T05:44:17.817681+0000","last_clean":"2024-03-28T05:44:17.817681+0000","last_became_active":"2024-03-28T05:42:52.714552+0000","last_became_peered":"2024-03-28T05:42:52.714552+0000","last_unstale":"2024-03-28T05:44:17.817681+0000","last_undegraded":"2024-03-28T05:44:17.817681+0000","last_fullsized":"2024-03-28T05:44:17.817681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:54:28.971239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.923640+0000","last_change":"2024-03-28T05:42:51.687446+0000","last_active":"2024-03-28T05:43:18.923640+0000","last_peered":"2024-03-28T05:43:18.923640+0000","last_clean":"2024-03-28T05:43:18.923640+0000","last_became_active":"2024-03-28T05:42:51.686779+0000","last_became_peered":"2024-03-28T05:42:51.686779+0000","last_unstale":"2024-03-28T05:43:18.923640+0000","last_undegraded":"2024-03-28T05:43:18.923640+0000","last_fullsized":"2024-03-28T05:43:18.923640+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:08:42.631028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831225+0000","last_change":"2024-03-28T05:42:52.709899+0000","last_active":"2024-03-28T05:44:17.831225+0000","last_peered":"2024-03-28T05:44:17.831225+0000","last_clean":"2024-03-28T05:44:17.831225+0000","last_became_active":"2024-03-28T05:42:52.709472+0000","last_became_peered":"2024-03-28T05:42:52.709472+0000","last_unstale":"2024-03-28T05:44:17.831225+0000","last_undegraded":"2024-03-28T05:44:17.831225+0000","last_fullsized":"2024-03-28T05:44:17.831225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:01:33.653161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.929809+0000","last_change":"2024-03-28T05:42:51.686136+0000","last_active":"2024-03-28T05:43:18.929809+0000","last_peered":"2024-03-28T05:43:18.929809+0000","last_clean":"2024-03-28T05:43:18.929809+0000","last_became_active":"2024-03-28T05:42:51.685816+0000","last_became_peered":"2024-03-28T05:42:51.685816+0000","last_unstale":"2024-03-28T05:43:18.929809+0000","last_undegraded":"2024-03-28T05:43:18.929809+0000","last_fullsized":"2024-03-28T05:43:18.929809+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:54:18.024315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.811377+0000","last_change":"2024-03-28T05:42:52.717667+0000","last_active":"2024-03-28T05:44:17.811377+0000","last_peered":"2024-03-28T05:44:17.811377+0000","last_clean":"2024-03-28T05:44:17.811377+0000","last_became_active":"2024-03-28T05:42:52.717177+0000","last_became_peered":"2024-03-28T05:42:52.717177+0000","last_unstale":"2024-03-28T05:44:17.811377+0000","last_undegraded":"2024-03-28T05:44:17.811377+0000","last_fullsized":"2024-03-28T05:44:17.811377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:38:18.430168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.930385+0000","last_change":"2024-03-28T05:42:51.683622+0000","last_active":"2024-03-28T05:43:18.930385+0000","last_peered":"2024-03-28T05:43:18.930385+0000","last_clean":"2024-03-28T05:43:18.930385+0000","last_became_active":"2024-03-28T05:42:51.681322+0000","last_became_peered":"2024-03-28T05:42:51.681322+0000","last_unstale":"2024-03-28T05:43:18.930385+0000","last_undegraded":"2024-03-28T05:43:18.930385+0000","last_fullsized":"2024-03-28T05:43:18.930385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:02:51.054597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830699+0000","last_change":"2024-03-28T05:42:52.712543+0000","last_active":"2024-03-28T05:44:17.830699+0000","last_peered":"2024-03-28T05:44:17.830699+0000","last_clean":"2024-03-28T05:44:17.830699+0000","last_became_active":"2024-03-28T05:42:52.712199+0000","last_became_peered":"2024-03-28T05:42:52.712199+0000","last_unstale":"2024-03-28T05:44:17.830699+0000","last_undegraded":"2024-03-28T05:44:17.830699+0000","last_fullsized":"2024-03-28T05:44:17.830699+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T10:15:16.853932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:45:05.436491+0000","last_change":"2024-03-28T05:42:51.684100+0000","last_active":"2024-03-28T05:45:05.436491+0000","last_peered":"2024-03-28T05:45:05.436491+0000","last_clean":"2024-03-28T05:45:05.436491+0000","last_became_active":"2024-03-28T05:42:51.683730+0000","last_became_peered":"2024-03-28T05:42:51.683730+0000","last_unstale":"2024-03-28T05:45:05.436491+0000","last_undegraded":"2024-03-28T05:45:05.436491+0000","last_fullsized":"2024-03-28T05:45:05.436491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:26.046059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.830528+0000","last_change":"2024-03-28T05:42:52.720638+0000","last_active":"2024-03-28T05:44:17.830528+0000","last_peered":"2024-03-28T05:44:17.830528+0000","last_clean":"2024-03-28T05:44:17.830528+0000","last_became_active":"2024-03-28T05:42:52.720118+0000","last_became_peered":"2024-03-28T05:42:52.720118+0000","last_unstale":"2024-03-28T05:44:17.830528+0000","last_undegraded":"2024-03-28T05:44:17.830528+0000","last_fullsized":"2024-03-28T05:44:17.830528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:55:46.554613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.926416+0000","last_change":"2024-03-28T05:42:51.682950+0000","last_active":"2024-03-28T05:43:18.926416+0000","last_peered":"2024-03-28T05:43:18.926416+0000","last_clean":"2024-03-28T05:43:18.926416+0000","last_became_active":"2024-03-28T05:42:51.681360+0000","last_became_peered":"2024-03-28T05:42:51.681360+0000","last_unstale":"2024-03-28T05:43:18.926416+0000","last_undegraded":"2024-03-28T05:43:18.926416+0000","last_fullsized":"2024-03-28T05:43:18.926416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:33:45.930886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.835992+0000","last_change":"2024-03-28T05:42:52.713682+0000","last_active":"2024-03-28T05:44:17.835992+0000","last_peered":"2024-03-28T05:44:17.835992+0000","last_clean":"2024-03-28T05:44:17.835992+0000","last_became_active":"2024-03-28T05:42:52.713110+0000","last_became_peered":"2024-03-28T05:42:52.713110+0000","last_unstale":"2024-03-28T05:44:17.835992+0000","last_undegraded":"2024-03-28T05:44:17.835992+0000","last_fullsized":"2024-03-28T05:44:17.835992+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:45:29.109070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.937454+0000","last_change":"2024-03-28T05:42:51.679700+0000","last_active":"2024-03-28T05:43:18.937454+0000","last_peered":"2024-03-28T05:43:18.937454+0000","last_clean":"2024-03-28T05:43:18.937454+0000","last_became_active":"2024-03-28T05:42:51.679012+0000","last_became_peered":"2024-03-28T05:42:51.679012+0000","last_unstale":"2024-03-28T05:43:18.937454+0000","last_undegraded":"2024-03-28T05:43:18.937454+0000","last_fullsized":"2024-03-28T05:43:18.937454+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:22:44.581231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.841989+0000","last_change":"2024-03-28T05:42:52.715245+0000","last_active":"2024-03-28T05:44:17.841989+0000","last_peered":"2024-03-28T05:44:17.841989+0000","last_clean":"2024-03-28T05:44:17.841989+0000","last_became_active":"2024-03-28T05:42:52.714838+0000","last_became_peered":"2024-03-28T05:42:52.714838+0000","last_unstale":"2024-03-28T05:44:17.841989+0000","last_undegraded":"2024-03-28T05:44:17.841989+0000","last_fullsized":"2024-03-28T05:44:17.841989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:09:44.983866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.948434+0000","last_change":"2024-03-28T05:42:51.675582+0000","last_active":"2024-03-28T05:43:18.948434+0000","last_peered":"2024-03-28T05:43:18.948434+0000","last_clean":"2024-03-28T05:43:18.948434+0000","last_became_active":"2024-03-28T05:42:51.674257+0000","last_became_peered":"2024-03-28T05:42:51.674257+0000","last_unstale":"2024-03-28T05:43:18.948434+0000","last_undegraded":"2024-03-28T05:43:18.948434+0000","last_fullsized":"2024-03-28T05:43:18.948434+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:13:50.046966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825244+0000","last_change":"2024-03-28T05:43:18.957536+0000","last_active":"2024-03-28T05:44:17.825244+0000","last_peered":"2024-03-28T05:44:17.825244+0000","last_clean":"2024-03-28T05:44:17.825244+0000","last_became_active":"2024-03-28T05:43:18.945541+0000","last_became_peered":"2024-03-28T05:43:18.945541+0000","last_unstale":"2024-03-28T05:44:17.825244+0000","last_undegraded":"2024-03-28T05:44:17.825244+0000","last_fullsized":"2024-03-28T05:44:17.825244+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:35:23.625743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:43:18.933109+0000","last_change":"2024-03-28T05:42:51.677239+0000","last_active":"2024-03-28T05:43:18.933109+0000","last_peered":"2024-03-28T05:43:18.933109+0000","last_clean":"2024-03-28T05:43:18.933109+0000","last_became_active":"2024-03-28T05:42:51.676794+0000","last_became_peered":"2024-03-28T05:42:51.676794+0000","last_unstale":"2024-03-28T05:43:18.933109+0000","last_undegraded":"2024-03-28T05:43:18.933109+0000","last_fullsized":"2024-03-28T05:43:18.933109+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:50.627060+0000","last_clean_scrub_stamp":"2024-03-28T05:42:50.627060+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:53:16.714790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.828825+0000","last_change":"2024-03-28T05:42:52.720848+0000","last_active":"2024-03-28T05:44:17.828825+0000","last_peered":"2024-03-28T05:44:17.828825+0000","last_clean":"2024-03-28T05:44:17.828825+0000","last_became_active":"2024-03-28T05:42:52.720481+0000","last_became_peered":"2024-03-28T05:42:52.720481+0000","last_unstale":"2024-03-28T05:44:17.828825+0000","last_undegraded":"2024-03-28T05:44:17.828825+0000","last_fullsized":"2024-03-28T05:44:17.828825+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:48:02.668793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.823662+0000","last_change":"2024-03-28T05:42:52.707758+0000","last_active":"2024-03-28T05:44:17.823662+0000","last_peered":"2024-03-28T05:44:17.823662+0000","last_clean":"2024-03-28T05:44:17.823662+0000","last_became_active":"2024-03-28T05:42:52.707383+0000","last_became_peered":"2024-03-28T05:42:52.707383+0000","last_unstale":"2024-03-28T05:44:17.823662+0000","last_undegraded":"2024-03-28T05:44:17.823662+0000","last_fullsized":"2024-03-28T05:44:17.823662+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:59:18.231048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825447+0000","last_change":"2024-03-28T05:42:52.711882+0000","last_active":"2024-03-28T05:44:17.825447+0000","last_peered":"2024-03-28T05:44:17.825447+0000","last_clean":"2024-03-28T05:44:17.825447+0000","last_became_active":"2024-03-28T05:42:52.711554+0000","last_became_peered":"2024-03-28T05:42:52.711554+0000","last_unstale":"2024-03-28T05:44:17.825447+0000","last_undegraded":"2024-03-28T05:44:17.825447+0000","last_fullsized":"2024-03-28T05:44:17.825447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:30:20.217198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.825872+0000","last_change":"2024-03-28T05:42:52.712266+0000","last_active":"2024-03-28T05:44:17.825872+0000","last_peered":"2024-03-28T05:44:17.825872+0000","last_clean":"2024-03-28T05:44:17.825872+0000","last_became_active":"2024-03-28T05:42:52.709421+0000","last_became_peered":"2024-03-28T05:42:52.709421+0000","last_unstale":"2024-03-28T05:44:17.825872+0000","last_undegraded":"2024-03-28T05:44:17.825872+0000","last_fullsized":"2024-03-28T05:44:17.825872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:36:52.118906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.831731+0000","last_change":"2024-03-28T05:42:52.725519+0000","last_active":"2024-03-28T05:44:17.831731+0000","last_peered":"2024-03-28T05:44:17.831731+0000","last_clean":"2024-03-28T05:44:17.831731+0000","last_became_active":"2024-03-28T05:42:52.723353+0000","last_became_peered":"2024-03-28T05:42:52.723353+0000","last_unstale":"2024-03-28T05:44:17.831731+0000","last_undegraded":"2024-03-28T05:44:17.831731+0000","last_fullsized":"2024-03-28T05:44:17.831731+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:47:06.446123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.826103+0000","last_change":"2024-03-28T05:42:52.714037+0000","last_active":"2024-03-28T05:44:17.826103+0000","last_peered":"2024-03-28T05:44:17.826103+0000","last_clean":"2024-03-28T05:44:17.826103+0000","last_became_active":"2024-03-28T05:42:52.710589+0000","last_became_peered":"2024-03-28T05:42:52.710589+0000","last_unstale":"2024-03-28T05:44:17.826103+0000","last_undegraded":"2024-03-28T05:44:17.826103+0000","last_fullsized":"2024-03-28T05:44:17.826103+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:40.167689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.816002+0000","last_change":"2024-03-28T05:42:52.722299+0000","last_active":"2024-03-28T05:44:17.816002+0000","last_peered":"2024-03-28T05:44:17.816002+0000","last_clean":"2024-03-28T05:44:17.816002+0000","last_became_active":"2024-03-28T05:42:52.719680+0000","last_became_peered":"2024-03-28T05:42:52.719680+0000","last_unstale":"2024-03-28T05:44:17.816002+0000","last_undegraded":"2024-03-28T05:44:17.816002+0000","last_fullsized":"2024-03-28T05:44:17.816002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:03:59.229824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.838346+0000","last_change":"2024-03-28T05:42:52.701994+0000","last_active":"2024-03-28T05:44:17.838346+0000","last_peered":"2024-03-28T05:44:17.838346+0000","last_clean":"2024-03-28T05:44:17.838346+0000","last_became_active":"2024-03-28T05:42:52.701552+0000","last_became_peered":"2024-03-28T05:42:52.701552+0000","last_unstale":"2024-03-28T05:44:17.838346+0000","last_undegraded":"2024-03-28T05:44:17.838346+0000","last_fullsized":"2024-03-28T05:44:17.838346+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:40:38.319972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.822135+0000","last_change":"2024-03-28T05:42:52.722597+0000","last_active":"2024-03-28T05:44:17.822135+0000","last_peered":"2024-03-28T05:44:17.822135+0000","last_clean":"2024-03-28T05:44:17.822135+0000","last_became_active":"2024-03-28T05:42:52.717036+0000","last_became_peered":"2024-03-28T05:42:52.717036+0000","last_unstale":"2024-03-28T05:44:17.822135+0000","last_undegraded":"2024-03-28T05:44:17.822135+0000","last_fullsized":"2024-03-28T05:44:17.822135+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:14:07.747690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.812261+0000","last_change":"2024-03-28T05:43:18.939398+0000","last_active":"2024-03-28T05:44:17.812261+0000","last_peered":"2024-03-28T05:44:17.812261+0000","last_clean":"2024-03-28T05:44:17.812261+0000","last_became_active":"2024-03-28T05:43:18.936942+0000","last_became_peered":"2024-03-28T05:43:18.936942+0000","last_unstale":"2024-03-28T05:44:17.812261+0000","last_undegraded":"2024-03-28T05:44:17.812261+0000","last_fullsized":"2024-03-28T05:44:17.812261+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:02:50.892203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.824626+0000","last_change":"2024-03-28T05:42:52.709226+0000","last_active":"2024-03-28T05:44:17.824626+0000","last_peered":"2024-03-28T05:44:17.824626+0000","last_clean":"2024-03-28T05:44:17.824626+0000","last_became_active":"2024-03-28T05:42:52.708774+0000","last_became_peered":"2024-03-28T05:42:52.708774+0000","last_unstale":"2024-03-28T05:44:17.824626+0000","last_undegraded":"2024-03-28T05:44:17.824626+0000","last_fullsized":"2024-03-28T05:44:17.824626+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:25.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.839006+0000","last_change":"2024-03-28T05:42:52.709392+0000","last_active":"2024-03-28T05:44:17.839006+0000","last_peered":"2024-03-28T05:44:17.839006+0000","last_clean":"2024-03-28T05:44:17.839006+0000","last_became_active":"2024-03-28T05:42:52.708971+0000","last_became_peered":"2024-03-28T05:42:52.708971+0000","last_unstale":"2024-03-28T05:44:17.839006+0000","last_undegraded":"2024-03-28T05:44:17.839006+0000","last_fullsized":"2024-03-28T05:44:17.839006+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T08:47:03.601147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.832264+0000","last_change":"2024-03-28T05:42:52.715860+0000","last_active":"2024-03-28T05:44:17.832264+0000","last_peered":"2024-03-28T05:44:17.832264+0000","last_clean":"2024-03-28T05:44:17.832264+0000","last_became_active":"2024-03-28T05:42:52.712485+0000","last_became_peered":"2024-03-28T05:42:52.712485+0000","last_unstale":"2024-03-28T05:44:17.832264+0000","last_undegraded":"2024-03-28T05:44:17.832264+0000","last_fullsized":"2024-03-28T05:44:17.832264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:12.352035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-28T05:44:17.818676+0000","last_change":"2024-03-28T05:43:18.944603+0000","last_active":"2024-03-28T05:44:17.818676+0000","last_peered":"2024-03-28T05:44:17.818676+0000","last_clean":"2024-03-28T05:44:17.818676+0000","last_became_active":"2024-03-28T05:43:18.943787+0000","last_became_peered":"2024-03-28T05:43:18.943787+0000","last_unstale":"2024-03-28T05:44:17.818676+0000","last_undegraded":"2024-03-28T05:44:17.818676+0000","last_fullsized":"2024-03-28T05:44:17.818676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T05:42:51.640509+0000","last_clean_scrub_stamp":"2024-03-28T05:42:51.640509+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:44:13.905446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75968,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":866,"num_read_kb":508,"num_write":178,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1057,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":219276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":85,"seq":365072220206,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":481676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":77,"seq":330712481844,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32852,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712300,"statfs":{"total":95995035648,"available":95961395200,"internally_reserved":0,"allocated":1716224,"data_stored":1144446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":71,"seq":304942678076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":481985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":63,"seq":270582939715,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":481744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234058,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1617920,"data_stored":1075377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430287,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1011712,"data_stored":481257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":547044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":482528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":547772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":481451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":484366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691928,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1630208,"data_stored":1074036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":66722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T05:45:20.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 -- 172.21.15.55:0/1643586101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 msgr2=0x7fc89c074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 --2- 172.21.15.55:0/1643586101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c074580 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc888009930 tx=0x7fc88802bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 -- 172.21.15.55:0/1643586101 shutdown_connections 2024-03-28T05:45:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 --2- 172.21.15.55:0/1643586101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c10dae0 0x7fc89c10fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 --2- 172.21.15.55:0/1643586101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c074580 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 --2- 172.21.15.55:0/1643586101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c0756e0 0x7fc89c073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 -- 172.21.15.55:0/1643586101 >> 172.21.15.55:0/1643586101 conn(0x7fc89c0fca80 msgr2=0x7fc89c0feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 -- 172.21.15.55:0/1643586101 shutdown_connections 2024-03-28T05:45:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.842+0000 7fc8a2600640 1 -- 172.21.15.55:0/1643586101 wait complete. 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 Processor -- start 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 -- start start 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c0756e0 0x7fc89c19e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 0x7fc89c1a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c113630 con 0x7fc89c074100 2024-03-28T05:45:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c1134b0 con 0x7fc89c0756e0 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.843+0000 7fc8a2600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c1137b0 con 0x7fc89c10dae0 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc89be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c0756e0 0x7fc89c19e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60734/0 (socket says 172.21.15.55:60734) 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 -- 172.21.15.55:0/288981422 learned_addr learned my addr 172.21.15.55:0/288981422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1c00640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 0x7fc89c1a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 -- 172.21.15.55:0/288981422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 msgr2=0x7fc89c1a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 0x7fc89c1a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 -- 172.21.15.55:0/288981422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c0756e0 msgr2=0x7fc89c19e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c0756e0 0x7fc89c19e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1200640 1 -- 172.21.15.55:0/288981422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c1a59d0 con 0x7fc89c074100 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.844+0000 7fc8a1c00640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 0x7fc89c1a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc8a1200640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e9f0 tx=0x7fc89000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89000cd80 con 0x7fc89c074100 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc8900054d0 con 0x7fc89c074100 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c1a5cc0 con 0x7fc89c074100 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890010490 con 0x7fc89c074100 2024-03-28T05:45:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.845+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c1a61c0 con 0x7fc89c074100 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.846+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c103ba0 con 0x7fc89c074100 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.848+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc890005020 con 0x7fc89c074100 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.849+0000 7fc899600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 0x7fc8840a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.850+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8900ceeb0 con 0x7fc89c074100 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.850+0000 7fc89be00640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 0x7fc8840a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.851+0000 7fc89be00640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 0x7fc8840a4d40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc888009900 tx=0x7fc888005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:20.854+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc89009bf10 con 0x7fc89c074100 2024-03-28T05:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: pgmap v443: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: from='client.35141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:21.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.057+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc89c062340 con 0x7fc89c074100 2024-03-28T05:45:21.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.060+0000 7fc899600640 1 -- 172.21.15.55:0/288981422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7fc89009b810 con 0x7fc89c074100 2024-03-28T05:45:21.061 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:21.062 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 msgr2=0x7fc8840a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 0x7fc8840a4d40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc888009900 tx=0x7fc888005fd0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 msgr2=0x7fc89c19de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e9f0 tx=0x7fc89000edf0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 shutdown_connections 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc8840a2880 0x7fc8840a4d40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc89c10dae0 0x7fc89c1a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc89c0756e0 0x7fc89c19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 --2- 172.21.15.55:0/288981422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc89c074100 0x7fc89c19de10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 >> 172.21.15.55:0/288981422 conn(0x7fc89c0fca80 msgr2=0x7fc89c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 shutdown_connections 2024-03-28T05:45:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.063+0000 7fc8a2600640 1 -- 172.21.15.55:0/288981422 wait complete. 2024-03-28T05:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: pgmap v443: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: from='client.35141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:45:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: pgmap v443: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: from='client.35141 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-28T05:45:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:21.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T05:45:21.084 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T05:45:21.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 -- 172.21.15.55:0/367745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 msgr2=0x7fcce8105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 --2- 172.21.15.55:0/367745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce8105590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009ca0 tx=0x7fcce002c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 -- 172.21.15.55:0/367745556 shutdown_connections 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 --2- 172.21.15.55:0/367745556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce8105590 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 --2- 172.21.15.55:0/367745556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce8102760 0x7fcce8104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 --2- 172.21.15.55:0/367745556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce80ffdf0 0x7fcce8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 -- 172.21.15.55:0/367745556 >> 172.21.15.55:0/367745556 conn(0x7fcce80fba50 msgr2=0x7fcce80fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 -- 172.21.15.55:0/367745556 shutdown_connections 2024-03-28T05:45:21.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.298+0000 7fccee600640 1 -- 172.21.15.55:0/367745556 wait complete. 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.299+0000 7fccee600640 1 Processor -- start 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.299+0000 7fccee600640 1 -- start start 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.299+0000 7fccee600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce80ffdf0 0x7fcce819dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccee600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce8102760 0x7fcce819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccee600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccee600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81136a0 con 0x7fcce8105110 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccee600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8113520 con 0x7fcce8102760 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccee600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8113820 con 0x7fcce80ffdf0 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60752/0 (socket says 172.21.15.55:60752) 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 -- 172.21.15.55:0/2277096463 learned_addr learned my addr 172.21.15.55:0/2277096463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fcced200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce80ffdf0 0x7fcce819dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fcce7e00640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce8102760 0x7fcce819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 -- 172.21.15.55:0/2277096463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce80ffdf0 msgr2=0x7fcce819dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce80ffdf0 0x7fcce819dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 -- 172.21.15.55:0/2277096463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce8102760 msgr2=0x7fcce819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce8102760 0x7fcce819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.300+0000 7fccedc00640 1 -- 172.21.15.55:0/2277096463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce81a5930 con 0x7fcce8105110 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fccedc00640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcce002c700 tx=0x7fcce00328a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0041020 con 0x7fcce8105110 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce81a5bc0 con 0x7fcce8105110 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fcce0003e20 con 0x7fcce8105110 2024-03-28T05:45:21.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0039040 con 0x7fcce8105110 2024-03-28T05:45:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.301+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce81a6100 con 0x7fcce8105110 2024-03-28T05:45:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.303+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce80fd540 con 0x7fcce8105110 2024-03-28T05:45:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.304+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fcce0044020 con 0x7fcce8105110 2024-03-28T05:45:21.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.306+0000 7fcce5600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 0x7fccd00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.306+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcce00f0cc0 con 0x7fcce8105110 2024-03-28T05:45:21.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.306+0000 7fcced200640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 0x7fccd00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.307+0000 7fcced200640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 0x7fccd00a4cc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcce819f1f0 tx=0x7fccdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:21.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.310+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fcce00f7080 con 0x7fcce8105110 2024-03-28T05:45:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.536+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcce80622a0 con 0x7fcce8105110 2024-03-28T05:45:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.537+0000 7fcce5600640 1 -- 172.21.15.55:0/2277096463 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcce004b020 con 0x7fcce8105110 2024-03-28T05:45:21.538 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T05:45:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 msgr2=0x7fccd00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 0x7fccd00a4cc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcce819f1f0 tx=0x7fccdc005f90 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 msgr2=0x7fcce81a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcce002c700 tx=0x7fcce00328a0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 shutdown_connections 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fccd00a2800 0x7fccd00a4cc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcce8105110 0x7fcce81a5290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcce8102760 0x7fcce819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 --2- 172.21.15.55:0/2277096463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcce80ffdf0 0x7fcce819dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 >> 172.21.15.55:0/2277096463 conn(0x7fcce80fba50 msgr2=0x7fcce8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 shutdown_connections 2024-03-28T05:45:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.540+0000 7fccee600640 1 -- 172.21.15.55:0/2277096463 wait complete. 2024-03-28T05:45:21.560 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 -- 172.21.15.55:0/3312863769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac1038e0 msgr2=0x7f15ac103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 --2- 172.21.15.55:0/3312863769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac1038e0 0x7f15ac103d00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009860 tx=0x7f15a002bb70 comp rx=0 tx=0).stop 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 -- 172.21.15.55:0/3312863769 shutdown_connections 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 --2- 172.21.15.55:0/3312863769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac105490 0x7f15ac10bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 --2- 172.21.15.55:0/3312863769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac104ad0 0x7f15ac104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 --2- 172.21.15.55:0/3312863769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac1038e0 0x7f15ac103d00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 -- 172.21.15.55:0/3312863769 >> 172.21.15.55:0/3312863769 conn(0x7f15ac0fee50 msgr2=0x7f15ac101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 -- 172.21.15.55:0/3312863769 shutdown_connections 2024-03-28T05:45:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.767+0000 7f15b4800640 1 -- 172.21.15.55:0/3312863769 wait complete. 2024-03-28T05:45:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.768+0000 7f15b4800640 1 Processor -- start 2024-03-28T05:45:21.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.768+0000 7f15b4800640 1 -- start start 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 0x7f15ac199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac105490 0x7f15ac1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac10f3e0 con 0x7f15ac104ad0 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac10f260 con 0x7f15ac1038e0 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b4800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac10f560 con 0x7f15ac105490 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b1e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 0x7f15ac199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60772/0 (socket says 172.21.15.55:60772) 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b1400640 1 -- 172.21.15.55:0/637117956 learned_addr learned my addr 172.21.15.55:0/637117956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.769+0000 7f15b2800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac105490 0x7f15ac1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 -- 172.21.15.55:0/637117956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac105490 msgr2=0x7f15ac1a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac105490 0x7f15ac1a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 -- 172.21.15.55:0/637117956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 msgr2=0x7f15ac199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 0x7f15ac199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 -- 172.21.15.55:0/637117956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac1a17b0 con 0x7f15ac104ad0 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1e00640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 0x7f15ac199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b1400640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f159c00e9f0 tx=0x7f159c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00cd80 con 0x7f15ac104ad0 2024-03-28T05:45:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f159c0108e0 con 0x7f15ac104ad0 2024-03-28T05:45:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c018920 con 0x7f15ac104ad0 2024-03-28T05:45:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.770+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac1a1aa0 con 0x7f15ac104ad0 2024-03-28T05:45:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.771+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac1a2040 con 0x7f15ac104ad0 2024-03-28T05:45:21.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.772+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac10ad20 con 0x7f15ac104ad0 2024-03-28T05:45:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.777+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f159c010a90 con 0x7f15ac104ad0 2024-03-28T05:45:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.778+0000 7f15a6a00640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 0x7f15940a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.778+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f159c0cf140 con 0x7f15ac104ad0 2024-03-28T05:45:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.778+0000 7f15b1e00640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 0x7f15940a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.779+0000 7f15b1e00640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 0x7f15940a4d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009830 tx=0x7f15a0034980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.780+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f159c09bb90 con 0x7f15ac104ad0 2024-03-28T05:45:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:21 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/288981422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:21 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2277096463' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:21.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.990+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15ac02d270 con 0x7f15ac104ad0 2024-03-28T05:45:21.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.990+0000 7f15a6a00640 1 -- 172.21.15.55:0/637117956 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f159c09fc30 con 0x7f15ac104ad0 2024-03-28T05:45:21.991 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 msgr2=0x7f15940a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 0x7f15940a4d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009830 tx=0x7f15a0034980 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 msgr2=0x7f15ac19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f159c00e9f0 tx=0x7f159c00eeb0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 shutdown_connections 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f15940a2880 0x7f15940a4d40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15ac105490 0x7f15ac1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac104ad0 0x7f15ac19a0d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 --2- 172.21.15.55:0/637117956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15ac1038e0 0x7f15ac199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.993+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 >> 172.21.15.55:0/637117956 conn(0x7f15ac0fee50 msgr2=0x7f15ac107ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.994+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 shutdown_connections 2024-03-28T05:45:21.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:21.994+0000 7f15b4800640 1 -- 172.21.15.55:0/637117956 wait complete. 2024-03-28T05:45:22.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T05:45:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:21 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/288981422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:21 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2277096463' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:21 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/288981422' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:21 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2277096463' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 -- 172.21.15.55:0/1243042903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110104930 msgr2=0x7fb110106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 --2- 172.21.15.55:0/1243042903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110104930 0x7fb110106d20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009900 tx=0x7fb0fc02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 -- 172.21.15.55:0/1243042903 shutdown_connections 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 --2- 172.21.15.55:0/1243042903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110107260 0x7fb1101096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 --2- 172.21.15.55:0/1243042903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110104930 0x7fb110106d20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 --2- 172.21.15.55:0/1243042903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110102000 0x7fb1101043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.216+0000 7fb116200640 1 -- 172.21.15.55:0/1243042903 >> 172.21.15.55:0/1243042903 conn(0x7fb1100fba10 msgr2=0x7fb1100fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.217+0000 7fb116200640 1 -- 172.21.15.55:0/1243042903 shutdown_connections 2024-03-28T05:45:22.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.217+0000 7fb116200640 1 -- 172.21.15.55:0/1243042903 wait complete. 2024-03-28T05:45:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 Processor -- start 2024-03-28T05:45:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 -- start start 2024-03-28T05:45:22.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110104930 0x7fb110199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11010d110 con 0x7fb110107260 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11010cf90 con 0x7fb110102000 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb116200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11010d290 con 0x7fb110104930 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.218+0000 7fb115800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb114e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60780/0 (socket says 172.21.15.55:60780) 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 -- 172.21.15.55:0/2054601693 learned_addr learned my addr 172.21.15.55:0/2054601693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb114e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51724/0 (socket says 172.21.15.55:51724) 2024-03-28T05:45:22.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb10fe00640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110104930 0x7fb110199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 -- 172.21.15.55:0/2054601693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110104930 msgr2=0x7fb110199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110104930 0x7fb110199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 -- 172.21.15.55:0/2054601693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 msgr2=0x7fb1101999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 -- 172.21.15.55:0/2054601693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1101a15f0 con 0x7fb110107260 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb114e00640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.219+0000 7fb115800640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb10800eb10 tx=0x7fb10800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.220+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108004b20 con 0x7fb110107260 2024-03-28T05:45:22.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.220+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb108004cc0 con 0x7fb110107260 2024-03-28T05:45:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.220+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108010690 con 0x7fb110107260 2024-03-28T05:45:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.220+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1101a18e0 con 0x7fb110107260 2024-03-28T05:45:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.220+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1101a1db0 con 0x7fb110107260 2024-03-28T05:45:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.221+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb110108db0 con 0x7fb110107260 2024-03-28T05:45:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.223+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb108005000 con 0x7fb110107260 2024-03-28T05:45:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.224+0000 7fb10d600640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 0x7fb0f80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.225+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb1080cf150 con 0x7fb110107260 2024-03-28T05:45:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.225+0000 7fb114e00640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 0x7fb0f80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.225+0000 7fb114e00640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 0x7fb0f80a4d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb104005d00 tx=0x7fb10400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.228+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb108053740 con 0x7fb110107260 2024-03-28T05:45:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.442+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb11002d2c0 con 0x7fb110107260 2024-03-28T05:45:22.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.443+0000 7fb10d600640 1 -- 172.21.15.55:0/2054601693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb10809c1b0 con 0x7fb110107260 2024-03-28T05:45:22.445 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T05:45:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 msgr2=0x7fb0f80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 0x7fb0f80a4d40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb104005d00 tx=0x7fb10400b410 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 msgr2=0x7fb1101a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb10800eb10 tx=0x7fb10800c2d0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 shutdown_connections 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb0f80a2880 0x7fb0f80a4d40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb110107260 0x7fb1101a0f80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb110104930 0x7fb110199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 --2- 172.21.15.55:0/2054601693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb110102000 0x7fb1101999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 >> 172.21.15.55:0/2054601693 conn(0x7fb1100fba10 msgr2=0x7fb1101017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 shutdown_connections 2024-03-28T05:45:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.446+0000 7fb116200640 1 -- 172.21.15.55:0/2054601693 wait complete. 2024-03-28T05:45:22.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 -- 172.21.15.55:0/1015189835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 msgr2=0x7ff03c101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 --2- 172.21.15.55:0/1015189835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c101ae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009900 tx=0x7ff02c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 -- 172.21.15.55:0/1015189835 shutdown_connections 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 --2- 172.21.15.55:0/1015189835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 0x7ff03c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 --2- 172.21.15.55:0/1015189835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff03c1028b0 0x7ff03c102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 --2- 172.21.15.55:0/1015189835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c101ae0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 -- 172.21.15.55:0/1015189835 >> 172.21.15.55:0/1015189835 conn(0x7ff03c0fcc50 msgr2=0x7ff03c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 -- 172.21.15.55:0/1015189835 shutdown_connections 2024-03-28T05:45:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.654+0000 7ff042a00640 1 -- 172.21.15.55:0/1015189835 wait complete. 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.655+0000 7ff042a00640 1 Processor -- start 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.655+0000 7ff042a00640 1 -- start start 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff03c1028b0 0x7ff03c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 0x7ff03c1a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c10d230 con 0x7ff03c1016c0 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c10d0b0 con 0x7ff03c103270 2024-03-28T05:45:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff042a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c10d3b0 con 0x7ff03c1028b0 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff03be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff03be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60788/0 (socket says 172.21.15.55:60788) 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff03be00640 1 -- 172.21.15.55:0/3979473984 learned_addr learned my addr 172.21.15.55:0/3979473984 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff040a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 0x7ff03c1a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff03be00640 1 -- 172.21.15.55:0/3979473984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff03c1028b0 msgr2=0x7ff03c19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.656+0000 7ff03be00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff03c1028b0 0x7ff03c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff03be00640 1 -- 172.21.15.55:0/3979473984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 msgr2=0x7ff03c1a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff03be00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 0x7ff03c1a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff03be00640 1 -- 172.21.15.55:0/3979473984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c1a1790 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff03be00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c043020 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7ff02c0044c0 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c1a1a20 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.657+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c003c60 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.658+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c1a1fc0 con 0x7ff03c1016c0 2024-03-28T05:45:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.659+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c1a2190 con 0x7ff03c1016c0 2024-03-28T05:45:22.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.661+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7ff02c046020 con 0x7ff03c1016c0 2024-03-28T05:45:22.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.663+0000 7ff038c00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 0x7ff0200a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:22.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.664+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff02c0f0fa0 con 0x7ff03c1016c0 2024-03-28T05:45:22.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.664+0000 7ff03b400640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 0x7ff0200a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:22.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.665+0000 7ff03b400640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 0x7ff0200a4d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff028005fd0 tx=0x7ff028005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.666+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7ff02c04d020 con 0x7ff03c1016c0 2024-03-28T05:45:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.926+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff03c1a2360 con 0x7ff03c1016c0 2024-03-28T05:45:22.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.927+0000 7ff038c00640 1 -- 172.21.15.55:0/3979473984 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11382 (secure 0 0 0) 0x7ff02c0be0e0 con 0x7ff03c1016c0 2024-03-28T05:45:22.928 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:22.928 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:45:14.020698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34535,34457,34490]},"id":1}]} 2024-03-28T05:45:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-03-28T05:45:22.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 msgr2=0x7ff0200a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 0x7ff0200a4d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff028005fd0 tx=0x7ff028005850 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 msgr2=0x7ff03c199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c0040c0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 shutdown_connections 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7ff0200a2880 0x7ff0200a4d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff03c103270 0x7ff03c1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff03c1028b0 0x7ff03c19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 --2- 172.21.15.55:0/3979473984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c1016c0 0x7ff03c199b70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.930+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 >> 172.21.15.55:0/3979473984 conn(0x7ff03c0fcc50 msgr2=0x7ff03c0738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.931+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 shutdown_connections 2024-03-28T05:45:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:22.931+0000 7ff042a00640 1 -- 172.21.15.55:0/3979473984 wait complete. 2024-03-28T05:45:22.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T05:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: pgmap v444: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/637117956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2054601693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: pgmap v444: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/637117956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2054601693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: pgmap v444: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/637117956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2054601693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.163+0000 7f0f43e00640 1 -- 172.21.15.55:0/3177934900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f44101500 msgr2=0x7f0f44101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.163+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3177934900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f44101500 0x7f0f44101920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009900 tx=0x7f0f3402bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 -- 172.21.15.55:0/3177934900 shutdown_connections 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3177934900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f441030b0 0x7f0f44109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3177934900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441026f0 0x7f0f44102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3177934900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f44101500 0x7f0f44101920 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 -- 172.21.15.55:0/3177934900 >> 172.21.15.55:0/3177934900 conn(0x7f0f440fca70 msgr2=0x7f0f440feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 -- 172.21.15.55:0/3177934900 shutdown_connections 2024-03-28T05:45:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.164+0000 7f0f43e00640 1 -- 172.21.15.55:0/3177934900 wait complete. 2024-03-28T05:45:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.165+0000 7f0f43e00640 1 Processor -- start 2024-03-28T05:45:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 -- start start 2024-03-28T05:45:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f44101500 0x7f0f44075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 0x7f0f44073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4410d090 con 0x7f0f441026f0 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4410cf10 con 0x7f0f441030b0 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f43e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4410d210 con 0x7f0f44101500 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.166+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60816/0 (socket says 172.21.15.55:60816) 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 -- 172.21.15.55:0/3212010120 learned_addr learned my addr 172.21.15.55:0/3212010120 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f43400640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 0x7f0f44073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f42a00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f44101500 0x7f0f44075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 -- 172.21.15.55:0/3212010120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f44101500 msgr2=0x7f0f44075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f44101500 0x7f0f44075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 -- 172.21.15.55:0/3212010120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 msgr2=0x7f0f44073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 0x7f0f44073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 -- 172.21.15.55:0/3212010120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44074860 con 0x7f0f441026f0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f43400640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 0x7f0f44073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.167+0000 7f0f3be00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.168+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00cd80 con 0x7f0f441026f0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.168+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0f2c0108e0 con 0x7f0f441026f0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.168+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c018920 con 0x7f0f441026f0 2024-03-28T05:45:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.168+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f441a1890 con 0x7f0f441026f0 2024-03-28T05:45:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.168+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f441a1e30 con 0x7f0f441026f0 2024-03-28T05:45:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.169+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f44108910 con 0x7f0f441026f0 2024-03-28T05:45:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.171+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f0f2c010a90 con 0x7f0f441026f0 2024-03-28T05:45:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.174+0000 7f0f3b400640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 0x7f0f280a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.174+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0f2c0cf180 con 0x7f0f441026f0 2024-03-28T05:45:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.174+0000 7f0f42a00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 0x7f0f280a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.175+0000 7f0f42a00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 0x7f0f280a4d40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f3402c240 tx=0x7f0f3402c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.176+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f0f2c09bb90 con 0x7f0f441026f0 2024-03-28T05:45:23.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.392+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f4402d2c0 con 0x7f0f441026f0 2024-03-28T05:45:23.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.395+0000 7f0f3b400640 1 -- 172.21.15.55:0/3212010120 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22650 (secure 0 0 0) 0x7f0f2c09fc30 con 0x7f0f441026f0 2024-03-28T05:45:23.396 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:23.396 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:43:18.912467+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 msgr2=0x7f0f280a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 0x7f0f280a4d40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0f3402c240 tx=0x7f0f3402c7e0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 msgr2=0x7f0f44073a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 shutdown_connections 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.397+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f0f280a2880 0x7f0f280a4d40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f441030b0 0x7f0f44073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f441026f0 0x7f0f44073a90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 --2- 172.21.15.55:0/3212010120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f44101500 0x7f0f44075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 >> 172.21.15.55:0/3212010120 conn(0x7f0f440fca70 msgr2=0x7f0f44105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 shutdown_connections 2024-03-28T05:45:23.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.398+0000 7f0f43e00640 1 -- 172.21.15.55:0/3212010120 wait complete. 2024-03-28T05:45:23.417 DEBUG:tasks.fwd_scrub:Yielding 2024-03-28T05:45:23.418 INFO:teuthology.run_tasks:Running task workunit... 2024-03-28T05:45:23.430 INFO:tasks.workunit:Pulling workunits from ref 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:45:23.430 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-28T05:45:23.430 INFO:tasks.workunit:timeout=3h 2024-03-28T05:45:23.430 INFO:tasks.workunit:cleanup=True 2024-03-28T05:45:23.431 DEBUG:teuthology.orchestra.run.smithi055:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:23.431 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-28T05:45:23.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-28T05:45:23.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:23.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 76h/118d Inode: 1 Links: 2 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-03-28 05:42:59.861338509 +0000 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-03-28 05:42:59.861338509 +0000 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-03-28 05:45:13.511899736 +0000 2024-03-28T05:45:23.474 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2024-03-28T05:45:23.474 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-28T05:45:23.475 DEBUG:teuthology.orchestra.run.smithi055:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-28T05:45:23.602 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-28T05:45:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 -- 172.21.15.55:0/2328048005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c4104b10 msgr2=0x7f69c4106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 --2- 172.21.15.55:0/2328048005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c4104b10 0x7f69c4106f00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009900 tx=0x7f69b402bc50 comp rx=0 tx=0).stop 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 -- 172.21.15.55:0/2328048005 shutdown_connections 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 --2- 172.21.15.55:0/2328048005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 0x7f69c4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 --2- 172.21.15.55:0/2328048005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c4104b10 0x7f69c4106f00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 --2- 172.21.15.55:0/2328048005 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c41021e0 0x7f69c41045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.640+0000 7f69cc800640 1 -- 172.21.15.55:0/2328048005 >> 172.21.15.55:0/2328048005 conn(0x7f69c40fbb50 msgr2=0x7f69c40fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.641+0000 7f69cc800640 1 -- 172.21.15.55:0/2328048005 shutdown_connections 2024-03-28T05:45:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.641+0000 7f69cc800640 1 -- 172.21.15.55:0/2328048005 wait complete. 2024-03-28T05:45:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 Processor -- start 2024-03-28T05:45:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 -- start start 2024-03-28T05:45:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c4104b10 0x7f69c4100190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 0x7f69c41006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c410d210 con 0x7f69c41021e0 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c410d090 con 0x7f69c4107440 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69cc800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c410d390 con 0x7f69c4104b10 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60832/0 (socket says 172.21.15.55:60832) 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.642+0000 7f69c9e00640 1 -- 172.21.15.55:0/419303401 learned_addr learned my addr 172.21.15.55:0/419303401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69ca800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 0x7f69c41006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9400640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c4104b10 0x7f69c4100190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9e00640 1 -- 172.21.15.55:0/419303401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c4104b10 msgr2=0x7f69c4100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9e00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c4104b10 0x7f69c4100190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9e00640 1 -- 172.21.15.55:0/419303401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 msgr2=0x7f69c41006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9e00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 0x7f69c41006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.643+0000 7f69c9e00640 1 -- 172.21.15.55:0/419303401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4100f60 con 0x7f69c41021e0 2024-03-28T05:45:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69c9e00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69b800d950 tx=0x7f69b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69bea00640 1 -- 172.21.15.55:0/419303401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8017030 con 0x7f69c41021e0 2024-03-28T05:45:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69bea00640 1 -- 172.21.15.55:0/419303401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69b8004020 con 0x7f69c41021e0 2024-03-28T05:45:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69bea00640 1 -- 172.21.15.55:0/419303401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b80047a0 con 0x7f69c41021e0 2024-03-28T05:45:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c41a1a60 con 0x7f69c41021e0 2024-03-28T05:45:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.644+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c41a1f30 con 0x7f69c41021e0 2024-03-28T05:45:23.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69bea00640 1 -- 172.21.15.55:0/419303401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f69b80041d0 con 0x7f69c41021e0 2024-03-28T05:45:23.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 Processor -- start 2024-03-28T05:45:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 -- start start 2024-03-28T05:45:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0992a90 0x5647d0997590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d099a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d08f7eb0 con 0x5647d0992a90 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d08a0a60 con 0x5647d09920a0 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.648+0000 7f69cf637740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d08f3f50 con 0x5647d0997c00 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51784/0 (socket says 172.21.15.55:51784) 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 -- 172.21.15.55:0/837716147 learned_addr learned my addr 172.21.15.55:0/837716147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69c9e00640 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0992a90 0x5647d0997590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69c9400640 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d099a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 -- 172.21.15.55:0/837716147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 msgr2=0x5647d099a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d099a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 -- 172.21.15.55:0/837716147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0992a90 msgr2=0x5647d0997590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0992a90 0x5647d0997590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69ca800640 1 -- 172.21.15.55:0/837716147 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d06d47e0 con 0x5647d09920a0 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.649+0000 7f69bea00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 0x7f69ac0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69ca800640 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009f50 tx=0x7f69c00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d1253e1c842c1d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69bea00640 1 -- 172.21.15.55:0/419303401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f69b80ce4c0 con 0x7f69c41021e0 2024-03-28T05:45:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69c9e00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 0x7f69ac0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69b3000640 1 -- 172.21.15.55:0/837716147 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0004d20 con 0x5647d09920a0 2024-03-28T05:45:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69b3000640 1 -- 172.21.15.55:0/837716147 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69c0004050 con 0x5647d09920a0 2024-03-28T05:45:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.650+0000 7f69b3000640 1 -- 172.21.15.55:0/837716147 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0005280 con 0x5647d09920a0 2024-03-28T05:45:23.652 INFO:tasks.workunit.client.0.smithi055.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-28T05:45:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 -- 172.21.15.55:0/837716147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 msgr2=0x5647d09924c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009f50 tx=0x7f69c00118d0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69c9e00640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 0x7f69ac0a4d40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69b8097280 tx=0x7f69b80d1f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 -- 172.21.15.55:0/837716147 shutdown_connections 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d099a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0992a90 0x5647d0997590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 --2- 172.21.15.55:0/837716147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09924c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 -- 172.21.15.55:0/837716147 >> 172.21.15.55:0/837716147 conn(0x5647d098d610 msgr2=0x5647d098da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 -- 172.21.15.55:0/837716147 shutdown_connections 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.651+0000 7f69cf637740 1 -- 172.21.15.55:0/837716147 wait complete. 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 -- start start 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 Processor -- start 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 0x5647d099c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d09a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.652+0000 7f69cf637740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d099abb0 con 0x5647d09920a0 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69cf637740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d08b3eb0 con 0x5647d0992a90 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69cf637740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647d099ad30 con 0x5647d0997c00 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69cf637740 10 client.0 _ll_register_callbacks cb 0x5647d08a8150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 0x5647d099c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69c9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69c9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51800/0 (socket says 172.21.15.55:51800) 2024-03-28T05:45:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69c9400640 1 -- 172.21.15.55:0/3020030949 learned_addr learned my addr 172.21.15.55:0/3020030949 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d09a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 -- 172.21.15.55:0/3020030949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 msgr2=0x5647d09a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d09a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 -- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 msgr2=0x5647d099c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69ca800640 1 -- 172.21.15.55:0/3020030949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647d0734f70 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.653+0000 7f69c9400640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69ca800640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 0x5647d099c220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f69c001b040 tx=0x7f69c00096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bebc9e3bab08f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69a7400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c002c060 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f69c0005040 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69c0004050 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69c0005240 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69cf637740 10 client.15396 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.654+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5647d05cc170 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69c0004050 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f69c0031070 con 0x5647d09920a0 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 10 client.15396 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 20 client.15396 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d09a7da0 0x5647d09aa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 4 client.15396 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.655+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647d09053f0 con 0x5647d09a7da0 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.656+0000 7f69c9400640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d09a7da0 0x5647d09aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.656+0000 7f69c9400640 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d09a7da0 0x5647d09aa190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d8eeec9cf86ef3 server_cookie=219f159aa00af3f2 in_seq=0 out_seq=0 2024-03-28T05:45:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.656+0000 7f69a7400640 10 client.15396 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69a7400640 1 -- 172.21.15.55:0/3020030949 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5647d09053f0 con 0x5647d09a7da0 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69a7400640 10 client.15396 handle_command_reply: tid=0 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 client.15396 shutdown 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 msgr2=0x5647d099c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 0x5647d099c220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f69c001b040 tx=0x7f69c00096c0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 shutdown_connections 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d09a7da0 0x5647d09aa190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0997c00 0x5647d09a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d099c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 --2- 172.21.15.55:0/3020030949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d09920a0 0x5647d099c220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 >> 172.21.15.55:0/3020030949 conn(0x5647d098d610 msgr2=0x5647d098c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69a7400640 0 client.15396 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 shutdown_connections 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.658+0000 7f69cf637740 1 -- 172.21.15.55:0/3020030949 wait complete. 2024-03-28T05:45:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.659+0000 7f69cf637740 20 client.15396 trim_cache size 0 max 16384 2024-03-28T05:45:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.677+0000 7f69cf637740 1 Processor -- start 2024-03-28T05:45:23.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.677+0000 7f69cf637740 1 -- start start 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 0x5647d098bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d098c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41ad130 con 0x5647d0997c00 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41aac30 con 0x5647d0992a90 2024-03-28T05:45:23.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69cf637740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a8cb0 con 0x5647d09920a0 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69c9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69c9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51802/0 (socket says 172.21.15.55:51802) 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69c9400640 1 -- 172.21.15.55:0/580484895 learned_addr learned my addr 172.21.15.55:0/580484895 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69ca800640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d098c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.678+0000 7f69ca800640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 0x5647d098bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 -- 172.21.15.55:0/580484895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 msgr2=0x5647d098bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 0x5647d098bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 -- 172.21.15.55:0/580484895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 msgr2=0x5647d098c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d098c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 -- 172.21.15.55:0/580484895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647d0988c20 con 0x5647d0992a90 2024-03-28T05:45:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69ca800640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 0x5647d098bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:23.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.679+0000 7f69c9400640 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009230 tx=0x7f69b402c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7327068dc1a44d69 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.680+0000 7f69b2600640 1 -- 172.21.15.55:0/580484895 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4050070 con 0x5647d0992a90 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.680+0000 7f69b2600640 1 -- 172.21.15.55:0/580484895 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69b402cc90 con 0x5647d0992a90 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.680+0000 7f69b2600640 1 -- 172.21.15.55:0/580484895 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40046c0 con 0x5647d0992a90 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 -- 172.21.15.55:0/580484895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 msgr2=0x5647d09a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009230 tx=0x7f69b402c800 comp rx=0 tx=0).stop 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 -- 172.21.15.55:0/580484895 shutdown_connections 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d098c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d0992a90 0x5647d09a3730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 --2- 172.21.15.55:0/580484895 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d09920a0 0x5647d098bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 -- 172.21.15.55:0/580484895 >> 172.21.15.55:0/580484895 conn(0x5647d098d610 msgr2=0x5647d0991100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 -- 172.21.15.55:0/580484895 shutdown_connections 2024-03-28T05:45:23.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.681+0000 7f69cf637740 1 -- 172.21.15.55:0/580484895 wait complete. 2024-03-28T05:45:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 -- start start 2024-03-28T05:45:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 Processor -- start 2024-03-28T05:45:23.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0992a90 0x5647d09a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.682+0000 7f69cf637740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a92b0 con 0x5647d0997c00 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69cf637740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41aa5d0 con 0x5647d09920a0 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69cf637740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a9910 con 0x5647d0992a90 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69cf637740 10 client.0 _ll_register_callbacks cb 0x7f69b80d1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69ca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60866/0 (socket says 172.21.15.55:60866) 2024-03-28T05:45:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.683+0000 7f69ca800640 1 -- 172.21.15.55:0/2872900241 learned_addr learned my addr 172.21.15.55:0/2872900241 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 -- 172.21.15.55:0/2872900241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0992a90 msgr2=0x5647d09a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0992a90 0x5647d09a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 -- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 msgr2=0x5647d09a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09a31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 -- 172.21.15.55:0/2872900241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647d09a1ff0 con 0x5647d0997c00 2024-03-28T05:45:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69ca800640 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f69c0027870 tx=0x7f69c0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baee12d5dc9ba7a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:23.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.684+0000 7f69a7400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0037040 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f69c0004820 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69b402cc90 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69c002c040 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69cf637740 10 client.15402 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.685+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5647d0a0c950 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f69b402cc90 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f69c003d070 con 0x5647d0997c00 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 10 client.15402 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:23.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 20 client.15402 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d0a0d1a0 0x5647d0a0f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 4 client.15402 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.686+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5647d08ff740 con 0x5647d0a0d1a0 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.687+0000 7f69c9400640 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d0a0d1a0 0x5647d0a0f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:23.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.689+0000 7f69c9400640 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d0a0d1a0 0x5647d0a0f5c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ccba8b1ea332ed3 server_cookie=de8340ad7c0fc19 in_seq=0 out_seq=0 2024-03-28T05:45:23.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.690+0000 7f69a7400640 10 client.15402 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:23.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.690+0000 7f69a7400640 1 -- 172.21.15.55:0/2872900241 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5647d08ff740 con 0x5647d0a0d1a0 2024-03-28T05:45:23.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.690+0000 7f69a7400640 10 client.15402 handle_command_reply: tid=0 2024-03-28T05:45:23.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.690+0000 7f69cf637740 1 client.15402 shutdown 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 msgr2=0x5647d09a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f69c0027870 tx=0x7f69c0014040 comp rx=0 tx=0).stop 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 shutdown_connections 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5647d0a0d1a0 0x5647d0a0f5c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5647d0997c00 0x5647d09a17c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647d0992a90 0x5647d09a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 --2- 172.21.15.55:0/2872900241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5647d09920a0 0x5647d09a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 >> 172.21.15.55:0/2872900241 conn(0x5647d098d610 msgr2=0x5647d0993530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.691+0000 7f69a7400640 0 client.15402 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.692+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 shutdown_connections 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.692+0000 7f69cf637740 1 -- 172.21.15.55:0/2872900241 wait complete. 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.692+0000 7f69cf637740 20 client.15402 trim_cache size 0 max 16384 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "d2ca7704-f7d4-4b7a-a13b-7fabdf4ad386", 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-03-28T05:45:23.693 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:23.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 msgr2=0x7f69ac0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 0x7f69ac0a4d40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69b8097280 tx=0x7f69b80d1f00 comp rx=0 tx=0).stop 2024-03-28T05:45:23.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 msgr2=0x7f69c4101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69b800d950 tx=0x7f69b800de10 comp rx=0 tx=0).stop 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 shutdown_connections 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f69ac0a2880 0x7f69ac0a4d40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c4107440 0x7f69c41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69c4104b10 0x7f69c4100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 --2- 172.21.15.55:0/419303401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69c41021e0 0x7f69c4101b50 secure :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69b800d950 tx=0x7f69b800de10 comp rx=0 tx=0).stop 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 >> 172.21.15.55:0/419303401 conn(0x7f69c40fbb50 msgr2=0x7f69c4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.693+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 shutdown_connections 2024-03-28T05:45:23.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:23.694+0000 7f69cc800640 1 -- 172.21.15.55:0/419303401 wait complete. 2024-03-28T05:45:23.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:45:23.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.015+0000 7f66cde00640 1 -- 172.21.15.55:0/3873050598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8102770 msgr2=0x7f66c8104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.015+0000 7f66cde00640 1 --2- 172.21.15.55:0/3873050598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8102770 0x7f66c8104be0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009900 tx=0x7f66b002bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 -- 172.21.15.55:0/3873050598 shutdown_connections 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 --2- 172.21.15.55:0/3873050598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8105120 0x7f66c81055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 --2- 172.21.15.55:0/3873050598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8102770 0x7f66c8104be0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 --2- 172.21.15.55:0/3873050598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 0x7f66c8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 -- 172.21.15.55:0/3873050598 >> 172.21.15.55:0/3873050598 conn(0x7f66c80fba20 msgr2=0x7f66c80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 -- 172.21.15.55:0/3873050598 shutdown_connections 2024-03-28T05:45:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.016+0000 7f66cde00640 1 -- 172.21.15.55:0/3873050598 wait complete. 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 Processor -- start 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 -- start start 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 0x7f66c819ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8102770 0x7f66c819e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81136e0 con 0x7f66c8105120 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8113560 con 0x7f66c8102770 2024-03-28T05:45:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.017+0000 7f66cde00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8113860 con 0x7f66c80ffe00 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60898/0 (socket says 172.21.15.55:60898) 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 -- 172.21.15.55:0/2055216650 learned_addr learned my addr 172.21.15.55:0/2055216650 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66bfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8102770 0x7f66c819e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cca00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 0x7f66c819ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 -- 172.21.15.55:0/2055216650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 msgr2=0x7f66c819ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 0x7f66c819ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 -- 172.21.15.55:0/2055216650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8102770 msgr2=0x7f66c819e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8102770 0x7f66c819e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 -- 172.21.15.55:0/2055216650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c81a59d0 con 0x7f66c8105120 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.018+0000 7f66cd400640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e970 tx=0x7f66c000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.019+0000 7f66c6000640 1 -- 172.21.15.55:0/2055216650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000ccc0 con 0x7f66c8105120 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.019+0000 7f66c6000640 1 -- 172.21.15.55:0/2055216650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66c000ce60 con 0x7f66c8105120 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.019+0000 7f66c6000640 1 -- 172.21.15.55:0/2055216650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0010430 con 0x7f66c8105120 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.019+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c81a5cc0 con 0x7f66c8105120 2024-03-28T05:45:24.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.019+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c81a6190 con 0x7f66c8105120 2024-03-28T05:45:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.022+0000 7f66c6000640 1 -- 172.21.15.55:0/2055216650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f66c0004ff0 con 0x7f66c8105120 2024-03-28T05:45:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.022+0000 7f66d2078740 1 Processor -- start 2024-03-28T05:45:24.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 -- start start 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b566544470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 0x55b56654c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5664a9250 con 0x55b566544a40 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b566451a30 con 0x55b566549bb0 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66d2078740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5664a52f0 con 0x55b566544050 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66cca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66cca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60906/0 (socket says 172.21.15.55:60906) 2024-03-28T05:45:24.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.023+0000 7f66cca00640 1 -- 172.21.15.55:0/1777012674 learned_addr learned my addr 172.21.15.55:0/1777012674 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66bfe00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 0x55b56654c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66bfe00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b566544470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 -- 172.21.15.55:0/1777012674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 msgr2=0x55b566544470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b566544470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 -- 172.21.15.55:0/1777012674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 msgr2=0x55b56654c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 0x55b56654c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 -- 172.21.15.55:0/1777012674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56643c690 con 0x55b566544a40 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66bfe00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 0x55b56654c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:24.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.024+0000 7f66cca00640 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f66b8010400 tx=0x7f66b80108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa38fa837cad041 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66c6000640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 0x7f66ac0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66bdc00640 1 -- 172.21.15.55:0/1777012674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8003b70 con 0x55b566544a40 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66bdc00640 1 -- 172.21.15.55:0/1777012674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66b8003d10 con 0x55b566544a40 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66bdc00640 1 -- 172.21.15.55:0/1777012674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8011a70 con 0x55b566544a40 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66c6000640 1 -- 172.21.15.55:0/2055216650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f66c00ceea0 con 0x7f66c8105120 2024-03-28T05:45:24.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.025+0000 7f66bfe00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 0x7f66ac0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- 172.21.15.55:0/1777012674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 msgr2=0x55b566549540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f66b8010400 tx=0x7f66b80108c0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- 172.21.15.55:0/1777012674 shutdown_connections 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566549bb0 0x55b56654c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544a40 0x55b566549540 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 --2- 172.21.15.55:0/1777012674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b566544470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- 172.21.15.55:0/1777012674 >> 172.21.15.55:0/1777012674 conn(0x55b56650c200 msgr2=0x55b56653f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66bfe00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 0x7f66ac0a4d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f66b0000c00 tx=0x7f66b002c610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- 172.21.15.55:0/1777012674 shutdown_connections 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- 172.21.15.55:0/1777012674 wait complete. 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.026+0000 7f66d2078740 1 -- start start 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 Processor -- start 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 0x55b56654e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544a40 0x55b56654e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b5665555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56654cb60 con 0x55b566549bb0 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b566464e80 con 0x55b566544050 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56654cce0 con 0x55b566544a40 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66d2078740 10 client.0 _ll_register_callbacks cb 0x55b566477130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66cca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 0x55b56654e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66cd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b5665555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66cca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 0x55b56654e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:51856/0 (socket says 172.21.15.55:51856) 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66cca00640 1 -- 172.21.15.55:0/3850846836 learned_addr learned my addr 172.21.15.55:0/3850846836 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:24.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.027+0000 7f66bfe00640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544a40 0x55b56654e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 -- 172.21.15.55:0/3850846836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544a40 msgr2=0x55b56654e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544a40 0x55b56654e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 -- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 msgr2=0x55b56654e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 0x55b56654e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 -- 172.21.15.55:0/3850846836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5662877d0 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66cd400640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b5665555a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e940 tx=0x7f66c009b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ebe9fa4cede1a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66b6000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.028+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00b3020 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f66c009baa0 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66b8003d10 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c00cce60 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 10 client.15414 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b5661bd3f0 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66b8003d10 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f66c00a3be0 con 0x55b566549bb0 2024-03-28T05:45:24.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 10 client.15414 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 20 client.15414 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.029+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b566559e10 0x55b56655c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.030+0000 7f66d2078740 4 client.15414 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.030+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5664b6790 con 0x55b566559e10 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.030+0000 7f66cca00640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b566559e10 0x55b56655c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.031+0000 7f66cca00640 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b566559e10 0x55b56655c2b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7d56721d79b1ae server_cookie=db86738341fd202e in_seq=0 out_seq=0 2024-03-28T05:45:24.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.031+0000 7f66b6000640 10 client.15414 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:24.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.032+0000 7f66b6000640 1 -- 172.21.15.55:0/3850846836 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b5664b6790 con 0x55b566559e10 2024-03-28T05:45:24.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.032+0000 7f66b6000640 10 client.15414 handle_command_reply: tid=0 2024-03-28T05:45:24.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 client.15414 shutdown 2024-03-28T05:45:24.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 msgr2=0x55b5665555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b5665555a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e940 tx=0x7f66c009b1a0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 shutdown_connections 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b566559e10 0x55b56655c2b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b5665555a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544a40 0x55b56654e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 --2- 172.21.15.55:0/3850846836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544050 0x55b56654e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66b6000640 0 client.15414 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 >> 172.21.15.55:0/3850846836 conn(0x55b56650c200 msgr2=0x55b56653ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 shutdown_connections 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 1 -- 172.21.15.55:0/3850846836 wait complete. 2024-03-28T05:45:24.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.033+0000 7f66d2078740 20 client.15414 trim_cache size 0 max 16384 2024-03-28T05:45:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.051+0000 7f66d2078740 1 Processor -- start 2024-03-28T05:45:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.051+0000 7f66d2078740 1 -- start start 2024-03-28T05:45:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566555560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566549bb0 0x55b5665452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81b12f0 con 0x55b566544050 2024-03-28T05:45:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81aedf0 con 0x55b566544a40 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66d2078740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81ace70 con 0x55b566549bb0 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60918/0 (socket says 172.21.15.55:60918) 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 -- 172.21.15.55:0/3567034265 learned_addr learned my addr 172.21.15.55:0/3567034265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66bfe00640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566555560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cd400640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566549bb0 0x55b5665452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 -- 172.21.15.55:0/3567034265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566549bb0 msgr2=0x55b5665452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566549bb0 0x55b5665452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 -- 172.21.15.55:0/3567034265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 msgr2=0x55b566555560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.052+0000 7f66cca00640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566555560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66cca00640 1 -- 172.21.15.55:0/3567034265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56617d0f0 con 0x55b566544050 2024-03-28T05:45:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66bfe00640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566555560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66cca00640 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66b8005cc0 tx=0x7f66b8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b7b4d6c8a4a314 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66bd200640 1 -- 172.21.15.55:0/3567034265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8004af0 con 0x55b566544050 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66bd200640 1 -- 172.21.15.55:0/3567034265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66b802b030 con 0x55b566544050 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.053+0000 7f66bd200640 1 -- 172.21.15.55:0/3567034265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8005440 con 0x55b566544050 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 -- 172.21.15.55:0/3567034265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 msgr2=0x55b566549020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66b8005cc0 tx=0x7f66b8009280 comp rx=0 tx=0).stop 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 -- 172.21.15.55:0/3567034265 shutdown_connections 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566549bb0 0x55b5665452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566555560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 --2- 172.21.15.55:0/3567034265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566544050 0x55b566549020 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 -- 172.21.15.55:0/3567034265 >> 172.21.15.55:0/3567034265 conn(0x55b56650c200 msgr2=0x55b56653ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 -- 172.21.15.55:0/3567034265 shutdown_connections 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.054+0000 7f66d2078740 1 -- 172.21.15.55:0/3567034265 wait complete. 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 -- start start 2024-03-28T05:45:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 Processor -- start 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b5665530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566553620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81ad470 con 0x55b566549bb0 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81ae790 con 0x55b566544a40 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81adad0 con 0x55b566544050 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.055+0000 7f66d2078740 10 client.0 _ll_register_callbacks cb 0x7f66c0097420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60924/0 (socket says 172.21.15.55:60924) 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 -- 172.21.15.55:0/3906772196 learned_addr learned my addr 172.21.15.55:0/3906772196 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66bfe00640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566553620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cca00640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b5665530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 -- 172.21.15.55:0/3906772196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 msgr2=0x55b5665530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b5665530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 -- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 msgr2=0x55b566553620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566553620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.056+0000 7f66cd400640 1 -- 172.21.15.55:0/3906772196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b566554c20 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66cd400640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c00981c0 tx=0x7f66c0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3900fafdfd15f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66b6000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00b3040 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f66c009ae90 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66b802b030 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c0097ae0 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66d2078740 10 client.15420 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.057+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b5665b5bd0 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f66b802b030 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f66c0081020 con 0x55b566549bb0 2024-03-28T05:45:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 10 client.15420 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 20 client.15420 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b5665b6570 0x55b5665b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 4 client.15420 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:45:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b5664b0ae0 con 0x55b5665b6570 2024-03-28T05:45:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.058+0000 7f66cca00640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b5665b6570 0x55b5665b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.059+0000 7f66cca00640 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b5665b6570 0x55b5665b8990 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=806169737520a378 server_cookie=570afe03492a9765 in_seq=0 out_seq=0 2024-03-28T05:45:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.059+0000 7f66b6000640 10 client.15420 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66b6000640 1 -- 172.21.15.55:0/3906772196 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b5664b0ae0 con 0x55b5665b6570 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66b6000640 10 client.15420 handle_command_reply: tid=0 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 client.15420 shutdown 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 msgr2=0x55b566554630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c00981c0 tx=0x7f66c0009310 comp rx=0 tx=0).stop 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 shutdown_connections 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b5665b6570 0x55b5665b8990 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b566549bb0 0x55b566554630 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b566544a40 0x55b566553620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 --2- 172.21.15.55:0/3906772196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b566544050 0x55b5665530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 >> 172.21.15.55:0/3906772196 conn(0x55b56650c200 msgr2=0x55b566542c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66b6000640 0 client.15420 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 shutdown_connections 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 1 -- 172.21.15.55:0/3906772196 wait complete. 2024-03-28T05:45:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.060+0000 7f66d2078740 20 client.15420 trim_cache size 0 max 16384 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "d2ca7704-f7d4-4b7a-a13b-7fabdf4ad386": { 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "d2ca7704-f7d4-4b7a-a13b-7fabdf4ad386", 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,force" 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:45:24.064 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 msgr2=0x7f66ac0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 0x7f66ac0a4d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f66b0000c00 tx=0x7f66b002c610 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 msgr2=0x7f66c81a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e970 tx=0x7f66c000ed70 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 shutdown_connections 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f66ac0a2880 0x7f66ac0a4d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66c8105120 0x7f66c81a5360 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c8102770 0x7f66c819e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 --2- 172.21.15.55:0/2055216650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66c80ffe00 0x7f66c819ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.061+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 >> 172.21.15.55:0/2055216650 conn(0x7f66c80fba20 msgr2=0x7f66c8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.062+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 shutdown_connections 2024-03-28T05:45:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:24.062+0000 7f66cde00640 1 -- 172.21.15.55:0/2055216650 wait complete. 2024-03-28T05:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:23 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3979473984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:23 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3212010120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:23 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3979473984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:23 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3212010120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.078 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:23 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3979473984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.078 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.078 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:24.078 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:23 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3212010120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T05:45:24.080 INFO:tasks.cephfs.filesystem:scrub status for tag:d2ca7704-f7d4-4b7a-a13b-7fabdf4ad386 - {'path': '/', 'tag': 'd2ca7704-f7d4-4b7a-a13b-7fabdf4ad386', 'options': 'recursive,force'} 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: scrub queued for path: / 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: scrub summary: active paths [/] 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: pgmap v445: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:45:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: scrub queued for path: / 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: scrub summary: active paths [/] 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: pgmap v445: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:45:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: scrub queued for path: / 2024-03-28T05:45:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: scrub summary: active paths [/] 2024-03-28T05:45:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: pgmap v445: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:45:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:45:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:45:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:45:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:26 smithi086 ceph-mon[35163]: pgmap v446: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:26 smithi159 ceph-mon[36109]: pgmap v446: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:26 smithi055 ceph-mon[31863]: pgmap v446: 97 pgs: 97 active+clean; 651 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:27 smithi086 ceph-mon[35163]: scrub summary: idle 2024-03-28T05:45:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:27 smithi159 ceph-mon[36109]: scrub summary: idle 2024-03-28T05:45:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:27 smithi055 ceph-mon[31863]: scrub summary: idle 2024-03-28T05:45:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:28 smithi086 ceph-mon[35163]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-28T05:45:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:28 smithi159 ceph-mon[36109]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-28T05:45:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:28 smithi055 ceph-mon[31863]: pgmap v447: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-28T05:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:30 smithi086 ceph-mon[35163]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-28T05:45:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:30 smithi159 ceph-mon[36109]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-28T05:45:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:30 smithi055 ceph-mon[31863]: pgmap v448: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-28T05:45:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:32 smithi086 ceph-mon[35163]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:45:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:32 smithi159 ceph-mon[36109]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:45:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:32 smithi055 ceph-mon[31863]: pgmap v449: 97 pgs: 97 active+clean; 656 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-28T05:45:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:34 smithi086 ceph-mon[35163]: pgmap v450: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:34 smithi159 ceph-mon[36109]: pgmap v450: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:34 smithi055 ceph-mon[31863]: pgmap v450: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:36 smithi086 ceph-mon[35163]: pgmap v451: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-28T05:45:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:36 smithi159 ceph-mon[36109]: pgmap v451: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-28T05:45:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:36 smithi055 ceph-mon[31863]: pgmap v451: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-28T05:45:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:38 smithi086 ceph-mon[35163]: pgmap v452: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:38 smithi159 ceph-mon[36109]: pgmap v452: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:38 smithi055 ceph-mon[31863]: pgmap v452: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:45:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:41 smithi086 ceph-mon[35163]: pgmap v453: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-28T05:45:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:41 smithi159 ceph-mon[36109]: pgmap v453: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-28T05:45:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:41 smithi055 ceph-mon[31863]: pgmap v453: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-28T05:45:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:43 smithi086 ceph-mon[35163]: pgmap v454: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:43 smithi159 ceph-mon[36109]: pgmap v454: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:43 smithi055 ceph-mon[31863]: pgmap v454: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-28T05:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:45 smithi086 ceph-mon[35163]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-28T05:45:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:45 smithi159 ceph-mon[36109]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-28T05:45:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:45 smithi055 ceph-mon[31863]: pgmap v455: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-28T05:45:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:47 smithi086 ceph-mon[35163]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-03-28T05:45:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:47 smithi159 ceph-mon[36109]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-03-28T05:45:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:47 smithi055 ceph-mon[31863]: pgmap v456: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-03-28T05:45:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:49 smithi086 ceph-mon[35163]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:45:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:49 smithi159 ceph-mon[36109]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:45:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:49 smithi055 ceph-mon[31863]: pgmap v457: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:45:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:51 smithi086 ceph-mon[35163]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:51 smithi159 ceph-mon[36109]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:51 smithi055 ceph-mon[31863]: pgmap v458: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:45:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:53 smithi086 ceph-mon[35163]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:53 smithi159 ceph-mon[36109]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:53 smithi055 ceph-mon[31863]: pgmap v459: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:54.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:45:54.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:45:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.324+0000 7f8091600640 1 -- 172.21.15.55:0/3196542515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c0756e0 msgr2=0x7f808c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.324+0000 7f8091600640 1 --2- 172.21.15.55:0/3196542515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c0756e0 0x7f808c073b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f807c009900 tx=0x7f807c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 -- 172.21.15.55:0/3196542515 shutdown_connections 2024-03-28T05:45:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 --2- 172.21.15.55:0/3196542515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c109570 0x7f808c10ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 --2- 172.21.15.55:0/3196542515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c074100 0x7f808c074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 --2- 172.21.15.55:0/3196542515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c0756e0 0x7f808c073b30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 -- 172.21.15.55:0/3196542515 >> 172.21.15.55:0/3196542515 conn(0x7f808c0fcc40 msgr2=0x7f808c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 -- 172.21.15.55:0/3196542515 shutdown_connections 2024-03-28T05:45:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.325+0000 7f8091600640 1 -- 172.21.15.55:0/3196542515 wait complete. 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 Processor -- start 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 -- start start 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c0756e0 0x7f808c104f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 0x7f808c101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c10f410 con 0x7f808c074100 2024-03-28T05:45:54.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c10f290 con 0x7f808c0756e0 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.326+0000 7f8091600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c10f590 con 0x7f808c109570 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46190/0 (socket says 172.21.15.55:46190) 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 -- 172.21.15.55:0/271995741 learned_addr learned my addr 172.21.15.55:0/271995741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808a000640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c0756e0 0x7f808c104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808b400640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 0x7f808c101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 -- 172.21.15.55:0/271995741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 msgr2=0x7f808c101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 0x7f808c101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 -- 172.21.15.55:0/271995741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c0756e0 msgr2=0x7f808c104f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c0756e0 0x7f808c104f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808aa00640 1 -- 172.21.15.55:0/271995741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c101e00 con 0x7f808c074100 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.327+0000 7f808b400640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 0x7f808c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:54.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f808aa00640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f807c000c00 tx=0x7f807c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f8083400640 1 -- 172.21.15.55:0/271995741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c043020 con 0x7f808c074100 2024-03-28T05:45:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f8083400640 1 -- 172.21.15.55:0/271995741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f807c0054c0 con 0x7f808c074100 2024-03-28T05:45:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c1a5f50 con 0x7f808c074100 2024-03-28T05:45:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f8083400640 1 -- 172.21.15.55:0/271995741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c003d70 con 0x7f808c074100 2024-03-28T05:45:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.328+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1a6300 con 0x7f808c074100 2024-03-28T05:45:54.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.332+0000 7f8083400640 1 -- 172.21.15.55:0/271995741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f807c046020 con 0x7f808c074100 2024-03-28T05:45:54.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.332+0000 7f8094220740 1 Processor -- start 2024-03-28T05:45:54.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.332+0000 7f8094220740 1 -- start start 2024-03-28T05:45:54.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799493f250 con 0x5579949df9e0 2024-03-28T05:45:54.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579948e7a30 con 0x5579949d9e80 2024-03-28T05:45:54.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8094220740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799493b2f0 con 0x5579949da870 2024-03-28T05:45:54.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46200/0 (socket says 172.21.15.55:46200) 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f808a000640 1 -- 172.21.15.55:0/2703151680 learned_addr learned my addr 172.21.15.55:0/2703151680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f808b400640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949da2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f808aa00640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.333+0000 7f8083400640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 0x7f80700a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 -- 172.21.15.55:0/2703151680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 msgr2=0x5579949df370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949df370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 -- 172.21.15.55:0/2703151680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 msgr2=0x5579949da2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949da2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 -- 172.21.15.55:0/2703151680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579948d2690 con 0x5579949df9e0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808aa00640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f8083400640 1 -- 172.21.15.55:0/271995741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f807c0f1050 con 0x7f808c074100 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808b400640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 0x7f80700a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f808a000640 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f807800bc90 tx=0x7f807800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce3b218ddf6b2b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f8077400640 1 -- 172.21.15.55:0/2703151680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078015070 con 0x5579949df9e0 2024-03-28T05:45:54.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f8077400640 1 -- 172.21.15.55:0/2703151680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f807801a910 con 0x5579949df9e0 2024-03-28T05:45:54.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.334+0000 7f8077400640 1 -- 172.21.15.55:0/2703151680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078011840 con 0x5579949df9e0 2024-03-28T05:45:54.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 -- 172.21.15.55:0/2703151680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 msgr2=0x5579949e1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f808b400640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 0x7f80700a4d40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5579949db0d0 tx=0x7f8084004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f807800bc90 tx=0x7f807800f730 comp rx=0 tx=0).stop 2024-03-28T05:45:54.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 -- 172.21.15.55:0/2703151680 shutdown_connections 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949df9e0 0x5579949e1e70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 --2- 172.21.15.55:0/2703151680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949da2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 -- 172.21.15.55:0/2703151680 >> 172.21.15.55:0/2703151680 conn(0x5579949a2200 msgr2=0x5579949d57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.335+0000 7f8094220740 1 -- 172.21.15.55:0/2703151680 shutdown_connections 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.336+0000 7f8094220740 1 -- 172.21.15.55:0/2703151680 wait complete. 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.336+0000 7f8094220740 1 -- start start 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.336+0000 7f8094220740 1 Processor -- start 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.336+0000 7f8094220740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949e2990 con 0x5579949da870 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579948fae80 con 0x5579949d9e80 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579949e2b10 con 0x5579949df9e0 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f8094220740 10 client.0 _ll_register_callbacks cb 0x55799490d130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:54.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46212/0 (socket says 172.21.15.55:46212) 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 -- 172.21.15.55:0/4011833441 learned_addr learned my addr 172.21.15.55:0/4011833441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808aa00640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808b400640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 -- 172.21.15.55:0/4011833441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 msgr2=0x5579949eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 -- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 msgr2=0x5579949e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949e3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808a000640 1 -- 172.21.15.55:0/4011833441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55799471d7d0 con 0x5579949da870 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808aa00640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.337+0000 7f808b400640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f808a000640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f807801a690 tx=0x7f807801a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e494a108a161a28f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f806be00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078028060 con 0x5579949da870 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f807801acd0 con 0x5579949da870 2024-03-28T05:45:54.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f807801a910 con 0x5579949da870 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8078015070 con 0x5579949da870 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f8094220740 10 client.15432 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.338+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5579946533f0 con 0x5579949da870 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f807801a910 con 0x5579949da870 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f807802d070 con 0x5579949da870 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 10 client.15432 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 20 client.15432 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5579949ef990 0x5579949f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 4 client.15432 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55799494c790 con 0x5579949ef990 2024-03-28T05:45:54.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.339+0000 7f808aa00640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5579949ef990 0x5579949f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.340+0000 7f808aa00640 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5579949ef990 0x5579949f1da0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b75c7791520ee92 server_cookie=d2b0aa68ce4865f5 in_seq=0 out_seq=0 2024-03-28T05:45:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.341+0000 7f806be00640 10 client.15432 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f806be00640 1 -- 172.21.15.55:0/4011833441 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55799494c790 con 0x5579949ef990 2024-03-28T05:45:54.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f806be00640 10 client.15432 handle_command_reply: tid=0 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 client.15432 shutdown 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 msgr2=0x5579949e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f807801a690 tx=0x7f807801a6c0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 shutdown_connections 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5579949ef990 0x5579949f1da0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949e4370 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 --2- 172.21.15.55:0/4011833441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 >> 172.21.15.55:0/4011833441 conn(0x5579949a2200 msgr2=0x5579949d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f806be00640 0 client.15432 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 shutdown_connections 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 1 -- 172.21.15.55:0/4011833441 wait complete. 2024-03-28T05:45:54.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.343+0000 7f8094220740 20 client.15432 trim_cache size 0 max 16384 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 Processor -- start 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 -- start start 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1b14f0 con 0x5579949da870 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1aeff0 con 0x5579949d9e80 2024-03-28T05:45:54.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.361+0000 7f8094220740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1ad070 con 0x5579949df9e0 2024-03-28T05:45:54.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46214/0 (socket says 172.21.15.55:46214) 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 -- 172.21.15.55:0/3677243541 learned_addr learned my addr 172.21.15.55:0/3677243541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808aa00640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808b400640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 -- 172.21.15.55:0/3677243541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 msgr2=0x5579949db310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949db310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 -- 172.21.15.55:0/3677243541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 msgr2=0x5579949d9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949d9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 -- 172.21.15.55:0/3677243541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579946130f0 con 0x5579949da870 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808b400640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.362+0000 7f808a000640 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8078004af0 tx=0x7f807800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d429d780bf0f7d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.363+0000 7f8076a00640 1 -- 172.21.15.55:0/3677243541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078033070 con 0x5579949da870 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.363+0000 7f8076a00640 1 -- 172.21.15.55:0/3677243541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8078011440 con 0x5579949da870 2024-03-28T05:45:54.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.363+0000 7f8076a00640 1 -- 172.21.15.55:0/3677243541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078028040 con 0x5579949da870 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.363+0000 7f8094220740 1 -- 172.21.15.55:0/3677243541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 msgr2=0x5579949eb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.363+0000 7f8094220740 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8078004af0 tx=0x7f807800b930 comp rx=0 tx=0).stop 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 -- 172.21.15.55:0/3677243541 shutdown_connections 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949df9e0 0x5579949db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949da870 0x5579949eb370 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 --2- 172.21.15.55:0/3677243541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949d9e80 0x5579949d9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 -- 172.21.15.55:0/3677243541 >> 172.21.15.55:0/3677243541 conn(0x5579949a2200 msgr2=0x5579949d8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 -- 172.21.15.55:0/3677243541 shutdown_connections 2024-03-28T05:45:54.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 -- 172.21.15.55:0/3677243541 wait complete. 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 -- start start 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.364+0000 7f8094220740 1 Processor -- start 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 0x5579949ea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1ad670 con 0x5579949d9e80 2024-03-28T05:45:54.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1ae990 con 0x5579949df9e0 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1adcd0 con 0x5579949da870 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f8094220740 10 client.0 _ll_register_callbacks cb 0x7f80840095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46216/0 (socket says 172.21.15.55:46216) 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808aa00640 1 -- 172.21.15.55:0/2786730748 learned_addr learned my addr 172.21.15.55:0/2786730748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808b400640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 0x5579949ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808a000640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.365+0000 7f808aa00640 1 -- 172.21.15.55:0/2786730748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 msgr2=0x5579949e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808aa00640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949e91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808aa00640 1 -- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 msgr2=0x5579949ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808aa00640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 0x5579949ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808aa00640 1 -- 172.21.15.55:0/2786730748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579949ea770 con 0x5579949d9e80 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808b400640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 0x5579949ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:54.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f808aa00640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f807c0eeb10 tx=0x7f807c0f3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695819c808aa801d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f806be00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0bd430 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f807c0eec20 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8078011440 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f807c004c50 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f8094220740 10 client.15438 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.366+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557994a4b3f0 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8078011440 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f807c0ba140 con 0x5579949d9e80 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 10 client.15438 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 20 client.15438 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x557994a4bd50 0x557994a4e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 4 client.15438 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:45:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.367+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557994946ae0 con 0x557994a4bd50 2024-03-28T05:45:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.368+0000 7f808a000640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x557994a4bd50 0x557994a4e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.368+0000 7f808a000640 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x557994a4bd50 0x557994a4e170 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54bd3000ce41c0cf server_cookie=7e173424526589a2 in_seq=0 out_seq=0 2024-03-28T05:45:54.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.368+0000 7f806be00640 10 client.15438 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f806be00640 1 -- 172.21.15.55:0/2786730748 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557994946ae0 con 0x557994a4bd50 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f806be00640 10 client.15438 handle_command_reply: tid=0 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 client.15438 shutdown 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 msgr2=0x5579949e8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f807c0eeb10 tx=0x7f807c0f3040 comp rx=0 tx=0).stop 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 shutdown_connections 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x557994a4bd50 0x557994a4e170 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579949df9e0 0x5579949ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5579949da870 0x5579949e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 --2- 172.21.15.55:0/2786730748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5579949d9e80 0x5579949e8c80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f806be00640 0 client.15438 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 >> 172.21.15.55:0/2786730748 conn(0x5579949a2200 msgr2=0x5579949db310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 shutdown_connections 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.369+0000 7f8094220740 1 -- 172.21.15.55:0/2786730748 wait complete. 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8094220740 20 client.15438 trim_cache size 0 max 16384 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-03-28T05:45:54.373 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 msgr2=0x7f80700a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 0x7f80700a4d40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5579949db0d0 tx=0x7f8084004a40 comp rx=0 tx=0).stop 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 msgr2=0x7f808c1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f807c000c00 tx=0x7f807c0042f0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 shutdown_connections 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80700a2880 0x7f80700a4d40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f808c109570 0x7f808c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f808c0756e0 0x7f808c104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 --2- 172.21.15.55:0/271995741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f808c074100 0x7f808c1049d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.370+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 >> 172.21.15.55:0/271995741 conn(0x7f808c0fcc40 msgr2=0x7f808c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.371+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 shutdown_connections 2024-03-28T05:45:54.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.371+0000 7f8091600640 1 -- 172.21.15.55:0/271995741 wait complete. 2024-03-28T05:45:54.390 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-28T05:45:54.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.618+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2251508237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 msgr2=0x7fd7cc101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.618+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2251508237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc101900 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009900 tx=0x7fd7c002bc50 comp rx=0 tx=0).stop 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2251508237 shutdown_connections 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2251508237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 0x7fd7cc109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2251508237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2251508237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc101900 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2251508237 >> 172.21.15.55:0/2251508237 conn(0x7fd7cc0fca30 msgr2=0x7fd7cc0fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2251508237 shutdown_connections 2024-03-28T05:45:54.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.619+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2251508237 wait complete. 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 Processor -- start 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 -- start start 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 0x7fd7cc073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc10d0b0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc10cf30 con 0x7fd7cc103090 2024-03-28T05:45:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.620+0000 7fd7d2a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc10d230 con 0x7fd7cc1026d0 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46232/0 (socket says 172.21.15.55:46232) 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 -- 172.21.15.55:0/2715883328 learned_addr learned my addr 172.21.15.55:0/2715883328 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d0c00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d2000640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 0x7fd7cc073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 -- 172.21.15.55:0/2715883328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 msgr2=0x7fd7cc073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 -- 172.21.15.55:0/2715883328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 msgr2=0x7fd7cc073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 0x7fd7cc073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 -- 172.21.15.55:0/2715883328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc074860 con 0x7fd7cc1014e0 2024-03-28T05:45:54.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d0c00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.621+0000 7fd7d1600640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0005ab0 tx=0x7fd7c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.622+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0043020 con 0x7fd7cc1014e0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.622+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd7c00054c0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.622+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0003de0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.622+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc1a1870 con 0x7fd7cc1014e0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.622+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc1a1dc0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.623+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc108800 con 0x7fd7cc1014e0 2024-03-28T05:45:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.625+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd7c0046020 con 0x7fd7cc1014e0 2024-03-28T05:45:54.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.627+0000 7fd7ca000640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 0x7fd7b40a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:54.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.627+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd7c00f0fe0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.627+0000 7fd7d0c00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 0x7fd7b40a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:54.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.628+0000 7fd7d0c00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 0x7fd7b40a4cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0751c0 tx=0x7fd7b8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:54.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.632+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fd7c004d020 con 0x7fd7cc1014e0 2024-03-28T05:45:54.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.880+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7cc02d070 con 0x7fd7cc1014e0 2024-03-28T05:45:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.881+0000 7fd7ca000640 1 -- 172.21.15.55:0/2715883328 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11382 (secure 0 0 0) 0x7fd7c00be1a0 con 0x7fd7cc1014e0 2024-03-28T05:45:54.881 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:45:54.882 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:45:14.020698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34535,34457,34490]},"id":1}]} 2024-03-28T05:45:54.882 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-03-28T05:45:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 msgr2=0x7fd7b40a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 0x7fd7b40a4cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0751c0 tx=0x7fd7b8008040 comp rx=0 tx=0).stop 2024-03-28T05:45:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 msgr2=0x7fd7cc075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0005ab0 tx=0x7fd7c00042f0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 shutdown_connections 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd7b40a2800 0x7fd7b40a4cc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7cc103090 0x7fd7cc073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7cc1026d0 0x7fd7cc073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 --2- 172.21.15.55:0/2715883328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7cc1014e0 0x7fd7cc075450 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 >> 172.21.15.55:0/2715883328 conn(0x7fd7cc0fca30 msgr2=0x7fd7cc1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 shutdown_connections 2024-03-28T05:45:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:54.884+0000 7fd7d2a00640 1 -- 172.21.15.55:0/2715883328 wait complete. 2024-03-28T05:45:54.905 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:45:54.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-28T05:45:55.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 -- 172.21.15.55:0/3500308971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 msgr2=0x7f58a4073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 --2- 172.21.15.55:0/3500308971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a4073b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5894009cd0 tx=0x7f589402c0e0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 -- 172.21.15.55:0/3500308971 shutdown_connections 2024-03-28T05:45:55.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 --2- 172.21.15.55:0/3500308971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a410db70 0x7f58a410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 --2- 172.21.15.55:0/3500308971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a4074100 0x7f58a4074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 --2- 172.21.15.55:0/3500308971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a4073b30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 -- 172.21.15.55:0/3500308971 >> 172.21.15.55:0/3500308971 conn(0x7f58a40fcb10 msgr2=0x7f58a40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 -- 172.21.15.55:0/3500308971 shutdown_connections 2024-03-28T05:45:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.125+0000 7f58a9200640 1 -- 172.21.15.55:0/3500308971 wait complete. 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.126+0000 7f58a9200640 1 Processor -- start 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.126+0000 7f58a9200640 1 -- start start 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a4074100 0x7f58a419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a410db70 0x7f58a41a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41136a0 con 0x7f58a40756e0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4113520 con 0x7f58a410db70 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a9200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4113820 con 0x7f58a4074100 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46252/0 (socket says 172.21.15.55:46252) 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a2a00640 1 -- 172.21.15.55:0/1080101969 learned_addr learned my addr 172.21.15.55:0/1080101969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a3e00640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a410db70 0x7f58a41a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.127+0000 7f58a3400640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a4074100 0x7f58a419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 -- 172.21.15.55:0/1080101969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a4074100 msgr2=0x7f58a419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a4074100 0x7f58a419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 -- 172.21.15.55:0/1080101969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a410db70 msgr2=0x7f58a41a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a410db70 0x7f58a41a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 -- 172.21.15.55:0/1080101969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a41a59b0 con 0x7f58a40756e0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f588c00d950 tx=0x7f588c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f589be00640 1 -- 172.21.15.55:0/1080101969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c017070 con 0x7f58a40756e0 2024-03-28T05:45:55.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a41a5ca0 con 0x7f58a40756e0 2024-03-28T05:45:55.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f589be00640 1 -- 172.21.15.55:0/1080101969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f588c009c30 con 0x7f58a40756e0 2024-03-28T05:45:55.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f589be00640 1 -- 172.21.15.55:0/1080101969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00f620 con 0x7f58a40756e0 2024-03-28T05:45:55.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.128+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a41a61c0 con 0x7f58a40756e0 2024-03-28T05:45:55.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.131+0000 7f58ad5b9740 1 Processor -- start 2024-03-28T05:45:55.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 -- start start 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f589be00640 1 -- 172.21.15.55:0/1080101969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f588c0109a0 con 0x7f58a40756e0 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 0x556a946dae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a946372c0 con 0x556a946d29f0 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a945dfc90 con 0x556a946d4580 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a94633360 con 0x556a946d3bc0 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46266/0 (socket says 172.21.15.55:46266) 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.132+0000 7f58a3e00640 1 -- 172.21.15.55:0/8621498 learned_addr learned my addr 172.21.15.55:0/8621498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3400640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a2a00640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 0x556a946dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 -- 172.21.15.55:0/8621498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 msgr2=0x556a946d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 -- 172.21.15.55:0/8621498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 msgr2=0x556a946dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 0x556a946dae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 -- 172.21.15.55:0/8621498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a94604080 con 0x556a946d29f0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3400640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a2a00640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 0x556a946dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.133+0000 7f58a3e00640 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f589c00cbe0 tx=0x7f589c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952fe831a3acd761 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f5898c00640 1 -- 172.21.15.55:0/8621498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c005220 con 0x556a946d29f0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f5898c00640 1 -- 172.21.15.55:0/8621498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f589c004c50 con 0x556a946d29f0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f5898c00640 1 -- 172.21.15.55:0/8621498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c0107b0 con 0x556a946d29f0 2024-03-28T05:45:55.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f589be00640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 0x7f58880a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f589be00640 1 -- 172.21.15.55:0/1080101969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f588c0ce830 con 0x7f58a40756e0 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f58ad5b9740 1 -- 172.21.15.55:0/8621498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 msgr2=0x556a946d2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f589c00cbe0 tx=0x7f589c00e720 comp rx=0 tx=0).stop 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.134+0000 7f58a3400640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 0x7f58880a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 -- 172.21.15.55:0/8621498 shutdown_connections 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d4580 0x556a946dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/8621498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946d2e10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 -- 172.21.15.55:0/8621498 >> 172.21.15.55:0/8621498 conn(0x556a946cdde0 msgr2=0x556a946ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 -- 172.21.15.55:0/8621498 shutdown_connections 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 -- 172.21.15.55:0/8621498 wait complete. 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58a3400640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 0x7f58880a4cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f589402c620 tx=0x7f589402e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.135+0000 7f58ad5b9740 1 -- start start 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 Processor -- start 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946e4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a946db590 con 0x556a946d3bc0 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a945f30d0 con 0x556a946d29f0 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a946db710 con 0x556a946d4580 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58ad5b9740 10 client.0 _ll_register_callbacks cb 0x556a945f7e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46276/0 (socket says 172.21.15.55:46276) 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.136+0000 7f58a2a00640 1 -- 172.21.15.55:0/1301976532 learned_addr learned my addr 172.21.15.55:0/1301976532 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a3400640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a3e00640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 -- 172.21.15.55:0/1301976532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 msgr2=0x556a946e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 -- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 msgr2=0x556a946dcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946dcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 -- 172.21.15.55:0/1301976532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9434b3f0 con 0x556a946d3bc0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a3400640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946dcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f588c09ae90 tx=0x7f588c0992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720ec6b687fa28a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f5891600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c020050 con 0x556a946d3bc0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f588c09a5e0 con 0x556a946d3bc0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.137+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f589c004c50 con 0x556a946d3bc0 2024-03-28T05:45:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f588c0973a0 con 0x556a946d3bc0 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 10 client.15456 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556a944157d0 con 0x556a946d3bc0 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f589c004c50 con 0x556a946d3bc0 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f588c010460 con 0x556a946d3bc0 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 10 client.15456 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 10 client.15456 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 20 client.15456 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a946e8560 0x556a946eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 4 client.15456 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.138+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a94644800 con 0x556a946e8560 2024-03-28T05:45:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.139+0000 7f58a3400640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a946e8560 0x556a946eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.140+0000 7f58a3400640 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a946e8560 0x556a946eaa00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2395aa2fdf8f3d5 server_cookie=4fc563d5112632fe in_seq=0 out_seq=0 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.140+0000 7f5891600640 10 client.15456 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f5891600640 1 -- 172.21.15.55:0/1301976532 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556a94644800 con 0x556a946e8560 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f5891600640 10 client.15456 handle_command_reply: tid=0 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 client.15456 shutdown 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 msgr2=0x556a946dd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f588c09ae90 tx=0x7f588c0992d0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 shutdown_connections 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a946e8560 0x556a946eaa00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d3bc0 0x556a946dd110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1301976532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946dcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f5891600640 0 client.15456 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 >> 172.21.15.55:0/1301976532 conn(0x556a946cdde0 msgr2=0x556a946cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 shutdown_connections 2024-03-28T05:45:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.142+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1301976532 wait complete. 2024-03-28T05:45:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.143+0000 7f58ad5b9740 20 client.15456 trim_cache size 0 max 16384 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.156+0000 7f58ad5b9740 1 Processor -- start 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.156+0000 7f58ad5b9740 1 -- start start 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.156+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d3bc0 0x556a946e4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41b13e0 con 0x556a946d29f0 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41aeee0 con 0x556a946d3bc0 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41acf60 con 0x556a946d4580 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46282/0 (socket says 172.21.15.55:46282) 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 -- 172.21.15.55:0/947086136 learned_addr learned my addr 172.21.15.55:0/947086136 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 -- 172.21.15.55:0/947086136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 msgr2=0x556a946ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 -- 172.21.15.55:0/947086136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d3bc0 msgr2=0x556a946e4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d3bc0 0x556a946e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 -- 172.21.15.55:0/947086136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a946d3640 con 0x556a946d29f0 2024-03-28T05:45:55.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.157+0000 7f58a3400640 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f589402e010 tx=0x7f589403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c539ed5927368185 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.158+0000 7f5893e00640 1 -- 172.21.15.55:0/947086136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894039040 con 0x556a946d29f0 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.158+0000 7f5893e00640 1 -- 172.21.15.55:0/947086136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5894058070 con 0x556a946d29f0 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.158+0000 7f5893e00640 1 -- 172.21.15.55:0/947086136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589404d940 con 0x556a946d29f0 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.158+0000 7f58ad5b9740 1 -- 172.21.15.55:0/947086136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 msgr2=0x556a946ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.158+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f589402e010 tx=0x7f589403f000 comp rx=0 tx=0).stop 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 -- 172.21.15.55:0/947086136 shutdown_connections 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d4580 0x556a946ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d3bc0 0x556a946e4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/947086136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d29f0 0x556a946ccfe0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 -- 172.21.15.55:0/947086136 >> 172.21.15.55:0/947086136 conn(0x556a946cdde0 msgr2=0x556a946cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 -- 172.21.15.55:0/947086136 shutdown_connections 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 -- 172.21.15.55:0/947086136 wait complete. 2024-03-28T05:45:55.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 -- start start 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.159+0000 7f58ad5b9740 1 Processor -- start 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946e2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41ad560 con 0x556a946d4580 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41ae880 con 0x556a946d29f0 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41adbc0 con 0x556a946d3bc0 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58ad5b9740 10 client.0 _ll_register_callbacks cb 0x7f588c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46296/0 (socket says 172.21.15.55:46296) 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58a3e00640 1 -- 172.21.15.55:0/1346623687 learned_addr learned my addr 172.21.15.55:0/1346623687 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58a3400640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.160+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946e2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 -- 172.21.15.55:0/1346623687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 msgr2=0x556a946e2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946e2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 -- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 msgr2=0x556a946e3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946e3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 -- 172.21.15.55:0/1346623687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a946e2e00 con 0x556a946d4580 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a2a00640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58a3e00640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f589c018000 tx=0x7f589c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7713036da6420a2f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f5891600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c029060 con 0x556a946d4580 2024-03-28T05:45:55.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f589c005d20 con 0x556a946d4580 2024-03-28T05:45:55.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5894058070 con 0x556a946d4580 2024-03-28T05:45:55.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589c0035f0 con 0x556a946d4580 2024-03-28T05:45:55.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58ad5b9740 10 client.15462 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.161+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556a94744bd0 con 0x556a946d4580 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5894058070 con 0x556a946d4580 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f589c02e070 con 0x556a946d4580 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 10 client.15462 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 10 client.15462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 20 client.15462 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a947452a0 0x556a947476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 4 client.15462 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.162+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556a9463eb50 con 0x556a947452a0 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.163+0000 7f58a3400640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a947452a0 0x556a947476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.164+0000 7f58a3400640 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a947452a0 0x556a947476c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dccdd1d425e1d7e8 server_cookie=385d980c2fdd163b in_seq=0 out_seq=0 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.164+0000 7f5891600640 10 client.15462 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:55.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f5891600640 1 -- 172.21.15.55:0/1346623687 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556a9463eb50 con 0x556a947452a0 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f5891600640 10 client.15462 handle_command_reply: tid=0 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 client.15462 shutdown 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 msgr2=0x556a946e28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f589c018000 tx=0x7f589c005780 comp rx=0 tx=0).stop 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 shutdown_connections 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x556a947452a0 0x556a947476c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a946d4580 0x556a946e28c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a946d3bc0 0x556a946e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 --2- 172.21.15.55:0/1346623687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a946d29f0 0x556a946e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 >> 172.21.15.55:0/1346623687 conn(0x556a946cdde0 msgr2=0x556a946cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f5891600640 0 client.15462 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 shutdown_connections 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 1 -- 172.21.15.55:0/1346623687 wait complete. 2024-03-28T05:45:55.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.165+0000 7f58ad5b9740 20 client.15462 trim_cache size 0 max 16384 2024-03-28T05:45:55.168 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:45:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 msgr2=0x7f58880a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 0x7f58880a4cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f589402c620 tx=0x7f589402e040 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 msgr2=0x7f58a419e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f588c00d950 tx=0x7f588c00de10 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 shutdown_connections 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f58880a2800 0x7f58880a4cc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58a410db70 0x7f58a41a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58a40756e0 0x7f58a419e330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 --2- 172.21.15.55:0/1080101969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a4074100 0x7f58a419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 >> 172.21.15.55:0/1080101969 conn(0x7f58a40fcb10 msgr2=0x7f58a4100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 shutdown_connections 2024-03-28T05:45:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.166+0000 7f58a9200640 1 -- 172.21.15.55:0/1080101969 wait complete. 2024-03-28T05:45:55.182 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:55 smithi055 ceph-mon[31863]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:55.182 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:55 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2715883328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:55.185 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:45:55.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-28T05:45:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:55 smithi086 ceph-mon[35163]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:55 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2715883328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:55 smithi159 ceph-mon[36109]: pgmap v460: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:45:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:55 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2715883328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 -- 172.21.15.55:0/388843926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480ffdf0 msgr2=0x7f0848102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 --2- 172.21.15.55:0/388843926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480ffdf0 0x7f0848102220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0838009ca0 tx=0x7f083802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 -- 172.21.15.55:0/388843926 shutdown_connections 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 --2- 172.21.15.55:0/388843926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848105110 0x7f0848105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 --2- 172.21.15.55:0/388843926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0848102760 0x7f0848104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 --2- 172.21.15.55:0/388843926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08480ffdf0 0x7f0848102220 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 -- 172.21.15.55:0/388843926 >> 172.21.15.55:0/388843926 conn(0x7f08480fba10 msgr2=0x7f08480fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 -- 172.21.15.55:0/388843926 shutdown_connections 2024-03-28T05:45:55.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.415+0000 7f0847200640 1 -- 172.21.15.55:0/388843926 wait complete. 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 Processor -- start 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 -- start start 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 0x7f084819de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848102760 0x7f084819e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481136a0 con 0x7f0848105110 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0848113520 con 0x7f0848102760 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.416+0000 7f0847200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0848113820 con 0x7f08480ffdf0 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46308/0 (socket says 172.21.15.55:46308) 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 -- 172.21.15.55:0/1025640379 learned_addr learned my addr 172.21.15.55:0/1025640379 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f083d400640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848102760 0x7f084819e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0845e00640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 0x7f084819de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 -- 172.21.15.55:0/1025640379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 msgr2=0x7f084819de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 0x7f084819de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 -- 172.21.15.55:0/1025640379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848102760 msgr2=0x7f084819e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848102760 0x7f084819e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 -- 172.21.15.55:0/1025640379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08481a5a10 con 0x7f0848105110 2024-03-28T05:45:55.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0845e00640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 0x7f084819de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.417+0000 7f0846800640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f084000e9b0 tx=0x7f084000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.418+0000 7f083f400640 1 -- 172.21.15.55:0/1025640379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000cd80 con 0x7f0848105110 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.418+0000 7f083f400640 1 -- 172.21.15.55:0/1025640379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f08400035f0 con 0x7f0848105110 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.418+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08481a5d00 con 0x7f0848105110 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.418+0000 7f083f400640 1 -- 172.21.15.55:0/1025640379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840010690 con 0x7f0848105110 2024-03-28T05:45:55.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.418+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08481a61a0 con 0x7f0848105110 2024-03-28T05:45:55.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.421+0000 7f083f400640 1 -- 172.21.15.55:0/1025640379 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f08400037a0 con 0x7f0848105110 2024-03-28T05:45:55.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.421+0000 7f084f7d7740 1 Processor -- start 2024-03-28T05:45:55.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.421+0000 7f084f7d7740 1 -- start start 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29fbc0 0x556a1c2a0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c2a0580 0x556a1c2a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c2032c0 con 0x556a1c29e9f0 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c1abc90 con 0x556a1c2a0580 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f084f7d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c1ff360 con 0x556a1c29fbc0 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f083d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f083d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46324/0 (socket says 172.21.15.55:46324) 2024-03-28T05:45:55.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f083d400640 1 -- 172.21.15.55:0/827269238 learned_addr learned my addr 172.21.15.55:0/827269238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.422+0000 7f0845e00640 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29fbc0 0x556a1c2a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c2a0580 0x556a1c2a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 -- 172.21.15.55:0/827269238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29fbc0 msgr2=0x556a1c2a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29fbc0 0x556a1c2a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 -- 172.21.15.55:0/827269238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c2a0580 msgr2=0x556a1c2a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c2a0580 0x556a1c2a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 -- 172.21.15.55:0/827269238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a1c1d0080 con 0x556a1c29e9f0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083f400640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 0x7f082c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083f400640 1 -- 172.21.15.55:0/1025640379 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f08400cef00 con 0x7f0848105110 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f083d400640 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0830009fc0 tx=0x7f08300097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbf20aebaf9c446 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f0845e00640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 0x7f082c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f0837000640 1 -- 172.21.15.55:0/827269238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830011470 con 0x556a1c29e9f0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f0837000640 1 -- 172.21.15.55:0/827269238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0830011ac0 con 0x556a1c29e9f0 2024-03-28T05:45:55.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.423+0000 7f0837000640 1 -- 172.21.15.55:0/827269238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083000f820 con 0x556a1c29e9f0 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 -- 172.21.15.55:0/827269238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 msgr2=0x556a1c29ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f0845e00640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 0x7f082c0a4cc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f083802c630 tx=0x7f0838005c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0830009fc0 tx=0x7f08300097a0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 -- 172.21.15.55:0/827269238 shutdown_connections 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c2a0580 0x556a1c2a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29fbc0 0x556a1c2a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 --2- 172.21.15.55:0/827269238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c29ee10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 -- 172.21.15.55:0/827269238 >> 172.21.15.55:0/827269238 conn(0x556a1c299de0 msgr2=0x556a1c29a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 -- 172.21.15.55:0/827269238 shutdown_connections 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.424+0000 7f084f7d7740 1 -- 172.21.15.55:0/827269238 wait complete. 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 -- start start 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 Processor -- start 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c2a7590 con 0x556a1c29e9f0 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c1bf0d0 con 0x556a1c29fbc0 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.425+0000 7f084f7d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a1c2a7710 con 0x556a1c2a0580 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f084f7d7740 10 client.0 _ll_register_callbacks cb 0x556a1c1c3e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46326/0 (socket says 172.21.15.55:46326) 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 -- 172.21.15.55:0/2884077023 learned_addr learned my addr 172.21.15.55:0/2884077023 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f083d400640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0846800640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 -- 172.21.15.55:0/2884077023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 msgr2=0x556a1c2b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 -- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 msgr2=0x556a1c2a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f0845e00640 1 -- 172.21.15.55:0/2884077023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a1bf173f0 con 0x556a1c29e9f0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.426+0000 7f083d400640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f0845e00640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f083802c700 tx=0x7f083802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95acd209b37239f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f082b400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083804f070 con 0x556a1c29e9f0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f083803f640 con 0x556a1c29e9f0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0830011ac0 con 0x556a1c29e9f0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083805b050 con 0x556a1c29e9f0 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f084f7d7740 10 client.15474 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.427+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556a1bfe17d0 con 0x556a1c29e9f0 2024-03-28T05:45:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0830011ac0 con 0x556a1c29e9f0 2024-03-28T05:45:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f083804a070 con 0x556a1c29e9f0 2024-03-28T05:45:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 10 client.15474 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 10 client.15474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 20 client.15474 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c2b46f0 0x556a1c2b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 4 client.15474 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.428+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a1c210800 con 0x556a1c2b46f0 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.429+0000 7f083d400640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c2b46f0 0x556a1c2b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.430+0000 7f083d400640 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c2b46f0 0x556a1c2b6b90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0f3c7038551a7ec server_cookie=7e31234b1f45a003 in_seq=0 out_seq=0 2024-03-28T05:45:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.430+0000 7f082b400640 10 client.15474 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f082b400640 1 -- 172.21.15.55:0/2884077023 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556a1c210800 con 0x556a1c2b46f0 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f082b400640 10 client.15474 handle_command_reply: tid=0 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 client.15474 shutdown 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 msgr2=0x556a1c2a8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f083802c700 tx=0x7f083802c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 shutdown_connections 2024-03-28T05:45:55.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c2b46f0 0x556a1c2b6b90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 --2- 172.21.15.55:0/2884077023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2a8c60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f082b400640 0 client.15474 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 >> 172.21.15.55:0/2884077023 conn(0x556a1c299de0 msgr2=0x556a1c299160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 shutdown_connections 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.432+0000 7f084f7d7740 1 -- 172.21.15.55:0/2884077023 wait complete. 2024-03-28T05:45:55.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.433+0000 7f084f7d7740 20 client.15474 trim_cache size 0 max 16384 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 Processor -- start 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 -- start start 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29e9f0 0x556a1c2a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481b12d0 con 0x556a1c2a0580 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481aedd0 con 0x556a1c29fbc0 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f084f7d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481ace50 con 0x556a1c29e9f0 2024-03-28T05:45:55.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f0846800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f0846800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46340/0 (socket says 172.21.15.55:46340) 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f0846800640 1 -- 172.21.15.55:0/283346280 learned_addr learned my addr 172.21.15.55:0/283346280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.447+0000 7f083d400640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0845e00640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29e9f0 0x556a1c2a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 -- 172.21.15.55:0/283346280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29e9f0 msgr2=0x556a1c2a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29e9f0 0x556a1c2a2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 -- 172.21.15.55:0/283346280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 msgr2=0x556a1c2b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 -- 172.21.15.55:0/283346280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a1c29a850 con 0x556a1c2a0580 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f083d400640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0846800640 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0840009250 tx=0x7f084009b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac860aba76c359 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0836600640 1 -- 172.21.15.55:0/283346280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400b3020 con 0x556a1c2a0580 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0836600640 1 -- 172.21.15.55:0/283346280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f084009f9b0 con 0x556a1c2a0580 2024-03-28T05:45:55.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.448+0000 7f0836600640 1 -- 172.21.15.55:0/283346280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400a3b70 con 0x556a1c2a0580 2024-03-28T05:45:55.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- 172.21.15.55:0/283346280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 msgr2=0x556a1c2a3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0840009250 tx=0x7f084009b760 comp rx=0 tx=0).stop 2024-03-28T05:45:55.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- 172.21.15.55:0/283346280 shutdown_connections 2024-03-28T05:45:55.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c2a0580 0x556a1c2a3100 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 --2- 172.21.15.55:0/283346280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c29e9f0 0x556a1c2a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- 172.21.15.55:0/283346280 >> 172.21.15.55:0/283346280 conn(0x556a1c299de0 msgr2=0x556a1c29d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- 172.21.15.55:0/283346280 shutdown_connections 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- 172.21.15.55:0/283346280 wait complete. 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.449+0000 7f084f7d7740 1 -- start start 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 Processor -- start 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481ad450 con 0x556a1c29e9f0 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481ae770 con 0x556a1c29fbc0 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08481adab0 con 0x556a1c2a0580 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f084f7d7740 10 client.0 _ll_register_callbacks cb 0x7f0838037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f0845e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f0845e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46344/0 (socket says 172.21.15.55:46344) 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.450+0000 7f0845e00640 1 -- 172.21.15.55:0/1366037717 learned_addr learned my addr 172.21.15.55:0/1366037717 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f083d400640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0846800640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 -- 172.21.15.55:0/1366037717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 msgr2=0x556a1c2ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 -- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 msgr2=0x556a1c2affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 -- 172.21.15.55:0/1366037717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a1c2accf0 con 0x556a1c29e9f0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f083d400640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f0845e00640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f08380043b0 tx=0x7f08380048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa6b682d5bf660 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f082b400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838064060 con 0x556a1c29e9f0 2024-03-28T05:45:55.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0838054440 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.451+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f084009f9b0 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083804f040 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 10 client.15480 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556a1c310cd0 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f084009f9b0 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0838069070 con 0x556a1c29e9f0 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 10 client.15480 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 10 client.15480 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 20 client.15480 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c311600 0x556a1c313a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 4 client.15480 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:45:55.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.452+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556a1c20ab50 con 0x556a1c311600 2024-03-28T05:45:55.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.453+0000 7f083d400640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c311600 0x556a1c313a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.454+0000 7f083d400640 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c311600 0x556a1c313a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a13ca28c22b7530c server_cookie=977b443cdd8f578f in_seq=0 out_seq=0 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.454+0000 7f082b400640 10 client.15480 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.454+0000 7f082b400640 1 -- 172.21.15.55:0/1366037717 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556a1c20ab50 con 0x556a1c311600 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.454+0000 7f082b400640 10 client.15480 handle_command_reply: tid=0 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.454+0000 7f084f7d7740 1 client.15480 shutdown 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 msgr2=0x556a1c2afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f08380043b0 tx=0x7f08380048d0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 shutdown_connections 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x556a1c311600 0x556a1c313a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556a1c2a0580 0x556a1c2ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556a1c29fbc0 0x556a1c2affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 --2- 172.21.15.55:0/1366037717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556a1c29e9f0 0x556a1c2afa90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f082b400640 0 client.15480 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 >> 172.21.15.55:0/1366037717 conn(0x556a1c299de0 msgr2=0x556a1c2988d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 shutdown_connections 2024-03-28T05:45:55.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 1 -- 172.21.15.55:0/1366037717 wait complete. 2024-03-28T05:45:55.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.455+0000 7f084f7d7740 20 client.15480 trim_cache size 0 max 16384 2024-03-28T05:45:55.458 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:45:55.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 msgr2=0x7f082c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 0x7f082c0a4cc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f083802c630 tx=0x7f0838005c30 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 msgr2=0x7f08481a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f084000e9b0 tx=0x7f084000ee70 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 shutdown_connections 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f082c0a2800 0x7f082c0a4cc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0848105110 0x7f08481a53a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0848102760 0x7f084819e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 --2- 172.21.15.55:0/1025640379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08480ffdf0 0x7f084819de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 >> 172.21.15.55:0/1025640379 conn(0x7f08480fba10 msgr2=0x7f0848103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 shutdown_connections 2024-03-28T05:45:55.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.456+0000 7f0847200640 1 -- 172.21.15.55:0/1025640379 wait complete. 2024-03-28T05:45:55.473 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:45:55.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.688+0000 7f150ea00640 1 -- 172.21.15.55:0/3959079360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 msgr2=0x7f1508107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.688+0000 7f150ea00640 1 --2- 172.21.15.55:0/3959079360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f1508107fe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009900 tx=0x7f14fc02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 -- 172.21.15.55:0/3959079360 shutdown_connections 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 --2- 172.21.15.55:0/3959079360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 0x7f1508110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 --2- 172.21.15.55:0/3959079360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 0x7f1508109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 --2- 172.21.15.55:0/3959079360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f1508107fe0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 -- 172.21.15.55:0/3959079360 >> 172.21.15.55:0/3959079360 conn(0x7f1508076b70 msgr2=0x7f1508078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 -- 172.21.15.55:0/3959079360 shutdown_connections 2024-03-28T05:45:55.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.689+0000 7f150ea00640 1 -- 172.21.15.55:0/3959079360 wait complete. 2024-03-28T05:45:55.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.690+0000 7f150ea00640 1 Processor -- start 2024-03-28T05:45:55.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.690+0000 7f150ea00640 1 -- start start 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.690+0000 7f150ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 0x7f150819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150ea00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 0x7f15081a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150ea00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508113740 con 0x7f1508107bc0 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081135c0 con 0x7f1508108db0 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150ea00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081138c0 con 0x7f1508109770 2024-03-28T05:45:55.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46368/0 (socket says 172.21.15.55:46368) 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 -- 172.21.15.55:0/2403611221 learned_addr learned my addr 172.21.15.55:0/2403611221 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150cc00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 0x7f150819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150e000640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 0x7f15081a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 -- 172.21.15.55:0/2403611221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 msgr2=0x7f15081a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 0x7f15081a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 -- 172.21.15.55:0/2403611221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 msgr2=0x7f150819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 0x7f150819e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.691+0000 7f150d600640 1 -- 172.21.15.55:0/2403611221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15081a5a00 con 0x7f1508107bc0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f150d600640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000c00 tx=0x7f14fc005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f1506000640 1 -- 172.21.15.55:0/2403611221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc043020 con 0x7f1508107bc0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f1506000640 1 -- 172.21.15.55:0/2403611221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14fc0043d0 con 0x7f1508107bc0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15081a5c90 con 0x7f1508107bc0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f1506000640 1 -- 172.21.15.55:0/2403611221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc003bb0 con 0x7f1508107bc0 2024-03-28T05:45:55.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.692+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15081a6180 con 0x7f1508107bc0 2024-03-28T05:45:55.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 Processor -- start 2024-03-28T05:45:55.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 -- start start 2024-03-28T05:45:55.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1506000640 1 -- 172.21.15.55:0/2403611221 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f14fc046020 con 0x7f1508107bc0 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae894e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae896040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae7f92c0 con 0x55b3ae896580 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae7a1c90 con 0x55b3ae8949f0 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.696+0000 7f1512c6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae7f5360 con 0x55b3ae895bc0 2024-03-28T05:45:55.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46372/0 (socket says 172.21.15.55:46372) 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 -- 172.21.15.55:0/3375515491 learned_addr learned my addr 172.21.15.55:0/3375515491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150e000640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae894e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150d600640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae896040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 -- 172.21.15.55:0/3375515491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 msgr2=0x55b3ae896040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae896040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 -- 172.21.15.55:0/3375515491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 msgr2=0x55b3ae894e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae894e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 -- 172.21.15.55:0/3375515491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3ae7c6080 con 0x55b3ae896580 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150e000640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae894e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:55.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.697+0000 7f150cc00640 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009c90 tx=0x7f14f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7500f978d1f2c83d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f14fa600640 1 -- 172.21.15.55:0/3375515491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f401e070 con 0x55b3ae896580 2024-03-28T05:45:55.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f14fa600640 1 -- 172.21.15.55:0/3375515491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14f4019ae0 con 0x55b3ae896580 2024-03-28T05:45:55.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f14fa600640 1 -- 172.21.15.55:0/3375515491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400ea40 con 0x55b3ae896580 2024-03-28T05:45:55.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f1506000640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 0x7f14f00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f1506000640 1 -- 172.21.15.55:0/2403611221 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f14fc0f0bd0 con 0x7f1508107bc0 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.698+0000 7f150e000640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 0x7f14f00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 -- 172.21.15.55:0/3375515491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 msgr2=0x55b3ae89ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009c90 tx=0x7f14f4011810 comp rx=0 tx=0).stop 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 -- 172.21.15.55:0/3375515491 shutdown_connections 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae89ce10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae896040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 --2- 172.21.15.55:0/3375515491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae894e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 -- 172.21.15.55:0/3375515491 >> 172.21.15.55:0/3375515491 conn(0x55b3ae88fde0 msgr2=0x55b3ae8901e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 -- 172.21.15.55:0/3375515491 shutdown_connections 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f1512c6f740 1 -- 172.21.15.55:0/3375515491 wait complete. 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.699+0000 7f150e000640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 0x7f14f00a4d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b3ae895ac0 tx=0x7f1500009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 -- start start 2024-03-28T05:45:55.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 Processor -- start 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae895bc0 0x55b3ae89f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae89d590 con 0x55b3ae8949f0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae7b50d0 con 0x55b3ae895bc0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3ae89d710 con 0x55b3ae896580 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f1512c6f740 10 client.0 _ll_register_callbacks cb 0x55b3ae7b9e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.700+0000 7f150d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46376/0 (socket says 172.21.15.55:46376) 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 -- 172.21.15.55:0/607001121 learned_addr learned my addr 172.21.15.55:0/607001121 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150cc00640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae895bc0 0x55b3ae89f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150e000640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 -- 172.21.15.55:0/607001121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 msgr2=0x55b3ae8a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 -- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae895bc0 msgr2=0x55b3ae89f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae895bc0 0x55b3ae89f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 -- 172.21.15.55:0/607001121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3ae50d3f0 con 0x55b3ae8949f0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150e000640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f150d600640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0bd500 tx=0x7f14fc009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa6356b6162229f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f14eea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0bced0 con 0x55b3ae8949f0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f14fc005500 con 0x55b3ae8949f0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.701+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14f4019ae0 con 0x55b3ae8949f0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14fc0bdc70 con 0x55b3ae8949f0 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 10 client.15492 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b3ae5d77d0 con 0x55b3ae8949f0 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14f4019ae0 con 0x55b3ae8949f0 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f14fc0c5880 con 0x55b3ae8949f0 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 10 client.15492 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 20 client.15492 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae8aa680 0x55b3ae8acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 4 client.15492 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.702+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3ae806800 con 0x55b3ae8aa680 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.703+0000 7f150cc00640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae8aa680 0x55b3ae8acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.703+0000 7f150cc00640 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae8aa680 0x55b3ae8acad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b98e0fd3590ab6 server_cookie=7fdcbf9aebdd7f34 in_seq=0 out_seq=0 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.703+0000 7f14eea00640 10 client.15492 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.704+0000 7f14eea00640 1 -- 172.21.15.55:0/607001121 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b3ae806800 con 0x55b3ae8aa680 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.704+0000 7f14eea00640 10 client.15492 handle_command_reply: tid=0 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.704+0000 7f1512c6f740 1 client.15492 shutdown 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.704+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 msgr2=0x55b3ae89ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.704+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0bd500 tx=0x7f14fc009620 comp rx=0 tx=0).stop 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 shutdown_connections 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae8aa680 0x55b3ae8acad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae895bc0 0x55b3ae89f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 --2- 172.21.15.55:0/607001121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae8949f0 0x55b3ae89ec40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 >> 172.21.15.55:0/607001121 conn(0x55b3ae88fde0 msgr2=0x55b3ae88f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f14eea00640 0 client.15492 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 shutdown_connections 2024-03-28T05:45:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 1 -- 172.21.15.55:0/607001121 wait complete. 2024-03-28T05:45:55.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.705+0000 7f1512c6f740 20 client.15492 trim_cache size 0 max 16384 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 Processor -- start 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 -- start start 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae89eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081b12b0 con 0x55b3ae896580 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081aedb0 con 0x55b3ae8949f0 2024-03-28T05:45:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f1512c6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081ace30 con 0x55b3ae895bc0 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f150e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f150d600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae89eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f150e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46386/0 (socket says 172.21.15.55:46386) 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.719+0000 7f150e000640 1 -- 172.21.15.55:0/1554028061 learned_addr learned my addr 172.21.15.55:0/1554028061 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150cc00640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 -- 172.21.15.55:0/1554028061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 msgr2=0x55b3ae8a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 -- 172.21.15.55:0/1554028061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 msgr2=0x55b3ae898df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 -- 172.21.15.55:0/1554028061 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3ae890850 con 0x55b3ae8949f0 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150cc00640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150e000640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f150d600640 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae89eec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b9ef0 tx=0x7f14fc005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8339c61f7f17b5c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.720+0000 7f14f9c00640 1 -- 172.21.15.55:0/1554028061 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0bced0 con 0x55b3ae8949f0 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f14f9c00640 1 -- 172.21.15.55:0/1554028061 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14fc0f5040 con 0x55b3ae8949f0 2024-03-28T05:45:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f14f9c00640 1 -- 172.21.15.55:0/1554028061 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc005500 con 0x55b3ae8949f0 2024-03-28T05:45:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 -- 172.21.15.55:0/1554028061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 msgr2=0x55b3ae89eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae89eec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0b9ef0 tx=0x7f14fc005c90 comp rx=0 tx=0).stop 2024-03-28T05:45:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 -- 172.21.15.55:0/1554028061 shutdown_connections 2024-03-28T05:45:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae896580 0x55b3ae898df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 --2- 172.21.15.55:0/1554028061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae89eec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 -- 172.21.15.55:0/1554028061 >> 172.21.15.55:0/1554028061 conn(0x55b3ae88fde0 msgr2=0x55b3ae8938d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 -- 172.21.15.55:0/1554028061 shutdown_connections 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.721+0000 7f1512c6f740 1 -- 172.21.15.55:0/1554028061 wait complete. 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 -- start start 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 Processor -- start 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae8a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081ad430 con 0x55b3ae895bc0 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081ae750 con 0x55b3ae8949f0 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081ada90 con 0x55b3ae896580 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.722+0000 7f1512c6f740 10 client.0 _ll_register_callbacks cb 0x7f14fc004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46400/0 (socket says 172.21.15.55:46400) 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 -- 172.21.15.55:0/999034707 learned_addr learned my addr 172.21.15.55:0/999034707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150d600640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae8a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150e000640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 -- 172.21.15.55:0/999034707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 msgr2=0x55b3ae8a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 -- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 msgr2=0x55b3ae8a3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae8a3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 -- 172.21.15.55:0/999034707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3ae8a5a00 con 0x55b3ae895bc0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f150cc00640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f14f401c040 tx=0x7f14f4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f63d8b9eac59eae server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f14eea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f401e040 con 0x55b3ae895bc0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f14f40195f0 con 0x55b3ae895bc0 2024-03-28T05:45:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.723+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14fc0f5040 con 0x55b3ae895bc0 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f40098c0 con 0x55b3ae895bc0 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 10 client.15498 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b3ae906590 con 0x55b3ae895bc0 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f14fc0f5040 con 0x55b3ae895bc0 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f14f40035f0 con 0x55b3ae895bc0 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 10 client.15498 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 20 client.15498 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae906d00 0x55b3ae909120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 4 client.15498 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:45:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.724+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b3ae800b50 con 0x55b3ae906d00 2024-03-28T05:45:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.725+0000 7f150d600640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae906d00 0x55b3ae909120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f150d600640 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae906d00 0x55b3ae909120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33451a122e517717 server_cookie=204fcdbfad5b1c4c in_seq=0 out_seq=0 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f14eea00640 10 client.15498 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f14eea00640 1 -- 172.21.15.55:0/999034707 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b3ae800b50 con 0x55b3ae906d00 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f14eea00640 10 client.15498 handle_command_reply: tid=0 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f1512c6f740 1 client.15498 shutdown 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 msgr2=0x55b3ae8a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.726+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f14f401c040 tx=0x7f14f4009850 comp rx=0 tx=0).stop 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 shutdown_connections 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55b3ae906d00 0x55b3ae909120 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b3ae896580 0x55b3ae8a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b3ae895bc0 0x55b3ae8a4400 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 --2- 172.21.15.55:0/999034707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b3ae8949f0 0x55b3ae8a3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f14eea00640 0 client.15498 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 >> 172.21.15.55:0/999034707 conn(0x55b3ae88fde0 msgr2=0x55b3ae8938d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 shutdown_connections 2024-03-28T05:45:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 1 -- 172.21.15.55:0/999034707 wait complete. 2024-03-28T05:45:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.727+0000 7f1512c6f740 20 client.15498 trim_cache size 0 max 16384 2024-03-28T05:45:55.730 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:45:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 msgr2=0x7f14f00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 0x7f14f00a4d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b3ae895ac0 tx=0x7f1500009500 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 msgr2=0x7f150819de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000c00 tx=0x7f14fc005e60 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 shutdown_connections 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f14f00a2880 0x7f14f00a4d40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1508109770 0x7f15081a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1508108db0 0x7f150819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 --2- 172.21.15.55:0/2403611221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1508107bc0 0x7f150819de30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 >> 172.21.15.55:0/2403611221 conn(0x7f1508076b70 msgr2=0x7f150810c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 shutdown_connections 2024-03-28T05:45:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:55.728+0000 7f150ea00640 1 -- 172.21.15.55:0/2403611221 wait complete. 2024-03-28T05:45:56.745 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-28T05:45:56.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:45:56.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 -- 172.21.15.55:0/610588702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c0756e0 msgr2=0x7fda7c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 --2- 172.21.15.55:0/610588702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c0756e0 0x7fda7c073b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009900 tx=0x7fda6c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 -- 172.21.15.55:0/610588702 shutdown_connections 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 --2- 172.21.15.55:0/610588702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c109440 0x7fda7c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 --2- 172.21.15.55:0/610588702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c074100 0x7fda7c074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 --2- 172.21.15.55:0/610588702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c0756e0 0x7fda7c073b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.983+0000 7fda81200640 1 -- 172.21.15.55:0/610588702 >> 172.21.15.55:0/610588702 conn(0x7fda7c0fcb10 msgr2=0x7fda7c0fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.984+0000 7fda81200640 1 -- 172.21.15.55:0/610588702 shutdown_connections 2024-03-28T05:45:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.984+0000 7fda81200640 1 -- 172.21.15.55:0/610588702 wait complete. 2024-03-28T05:45:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 Processor -- start 2024-03-28T05:45:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 -- start start 2024-03-28T05:45:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c074100 0x7fda7c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 0x7fda7c1a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c10f290 con 0x7fda7c0756e0 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c10f110 con 0x7fda7c109440 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda81200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c10f410 con 0x7fda7c074100 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda7aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda7aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46424/0 (socket says 172.21.15.55:46424) 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.985+0000 7fda7aa00640 1 -- 172.21.15.55:0/2941462470 learned_addr learned my addr 172.21.15.55:0/2941462470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7be00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 0x7fda7c1a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7b400640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c074100 0x7fda7c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 -- 172.21.15.55:0/2941462470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c074100 msgr2=0x7fda7c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c074100 0x7fda7c199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 -- 172.21.15.55:0/2941462470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 msgr2=0x7fda7c1a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 0x7fda7c1a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 -- 172.21.15.55:0/2941462470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c1a15b0 con 0x7fda7c0756e0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7be00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 0x7fda7c1a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fda6800ea60 tx=0x7fda6800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda73e00640 1 -- 172.21.15.55:0/2941462470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6800cde0 con 0x7fda7c0756e0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda73e00640 1 -- 172.21.15.55:0/2941462470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda680035f0 con 0x7fda7c0756e0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c1a18a0 con 0x7fda7c0756e0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.986+0000 7fda73e00640 1 -- 172.21.15.55:0/2941462470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68010690 con 0x7fda7c0756e0 2024-03-28T05:45:56.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.987+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c1a1df0 con 0x7fda7c0756e0 2024-03-28T05:45:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 Processor -- start 2024-03-28T05:45:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 -- start start 2024-03-28T05:45:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda73e00640 1 -- 172.21.15.55:0/2941462470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fda680037a0 con 0x7fda7c0756e0 2024-03-28T05:45:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5da77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5daa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5d07eb0 con 0x5558d5da22b0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5cb0a60 con 0x5558d5da7e10 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.990+0000 7fda855a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5d03f50 con 0x5558d5da2ca0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46434/0 (socket says 172.21.15.55:46434) 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 -- 172.21.15.55:0/1399652433 learned_addr learned my addr 172.21.15.55:0/1399652433 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7aa00640 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5daa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7b400640 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5da77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 -- 172.21.15.55:0/1399652433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 msgr2=0x5558d5da77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5da77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 -- 172.21.15.55:0/1399652433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 msgr2=0x5558d5daa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5daa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.991+0000 7fda7be00640 1 -- 172.21.15.55:0/1399652433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d5ae47e0 con 0x5558d5da22b0 2024-03-28T05:45:56.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda7be00640 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fda74009f90 tx=0x7fda7400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fb66db82516671 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda73e00640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 0x7fda600a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda70c00640 1 -- 172.21.15.55:0/1399652433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74003b70 con 0x5558d5da22b0 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda70c00640 1 -- 172.21.15.55:0/1399652433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda74003d10 con 0x5558d5da22b0 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda70c00640 1 -- 172.21.15.55:0/1399652433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740119c0 con 0x5558d5da22b0 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda73e00640 1 -- 172.21.15.55:0/2941462470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fda680ceea0 con 0x7fda7c0756e0 2024-03-28T05:45:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.992+0000 7fda7b400640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 0x7fda600a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 -- 172.21.15.55:0/1399652433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 msgr2=0x5558d5da26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fda74009f90 tx=0x7fda7400f7f0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda7b400640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 0x7fda600a4cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02c170 tx=0x7fda6c005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 -- 172.21.15.55:0/1399652433 shutdown_connections 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5daa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5da77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 --2- 172.21.15.55:0/1399652433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5da26d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 -- 172.21.15.55:0/1399652433 >> 172.21.15.55:0/1399652433 conn(0x5558d5d9d820 msgr2=0x5558d5d9dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 -- 172.21.15.55:0/1399652433 shutdown_connections 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.993+0000 7fda855a7740 1 -- 172.21.15.55:0/1399652433 wait complete. 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 -- start start 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 Processor -- start 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5dac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5db3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5daadc0 con 0x5558d5da22b0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5cc3eb0 con 0x5558d5da7e10 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.994+0000 7fda855a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d5daaf40 con 0x5558d5da2ca0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda855a7740 10 client.0 _ll_register_callbacks cb 0x5558d5cb8150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46440/0 (socket says 172.21.15.55:46440) 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 -- 172.21.15.55:0/2285771340 learned_addr learned my addr 172.21.15.55:0/2285771340 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7be00640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5db3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5dac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 -- 172.21.15.55:0/2285771340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 msgr2=0x5558d5dac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5dac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 -- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 msgr2=0x5558d5db3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5db3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7b400640 1 -- 172.21.15.55:0/2285771340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d5b44f70 con 0x5558d5da22b0 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.995+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5dac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:56.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda7b400640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02c840 tx=0x7fda6c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9162535f571858c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda65600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c04f020 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda74003d10 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fda6c0046c0 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda6c0048c0 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda855a7740 10 client.15510 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.996+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5558d59dc170 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda74003d10 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fda6c003c80 con 0x5558d5da22b0 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 10 client.15510 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 20 client.15510 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5db8300 0x5558d5dba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 4 client.15510 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558d5d153f0 con 0x5558d5db8300 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.997+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5db8300 0x5558d5dba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.998+0000 7fda7aa00640 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5db8300 0x5558d5dba780 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a6141c584c5c25c server_cookie=1ee8763663b0709c in_seq=0 out_seq=0 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.998+0000 7fda65600640 10 client.15510 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda65600640 1 -- 172.21.15.55:0/2285771340 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5558d5d153f0 con 0x5558d5db8300 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda65600640 10 client.15510 handle_command_reply: tid=0 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda855a7740 1 client.15510 shutdown 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 msgr2=0x5558d5dac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02c840 tx=0x7fda6c02bc30 comp rx=0 tx=0).stop 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 shutdown_connections 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:56.999+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5db8300 0x5558d5dba780 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da7e10 0x5558d5db3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5dac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 --2- 172.21.15.55:0/2285771340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da22b0 0x5558d5dac4a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda65600640 0 client.15510 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 >> 172.21.15.55:0/2285771340 conn(0x5558d5d9d820 msgr2=0x5558d5d9ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 shutdown_connections 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 1 -- 172.21.15.55:0/2285771340 wait complete. 2024-03-28T05:45:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.000+0000 7fda855a7740 20 client.15510 trim_cache size 0 max 16384 2024-03-28T05:45:57.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.017+0000 7fda855a7740 1 Processor -- start 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 -- start start 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da22b0 0x5558d5d9c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5db39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1acf20 con 0x5558d5da7e10 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1aaa20 con 0x5558d5da22b0 2024-03-28T05:45:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda855a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1a8aa0 con 0x5558d5da2ca0 2024-03-28T05:45:57.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46442/0 (socket says 172.21.15.55:46442) 2024-03-28T05:45:57.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda7be00640 1 -- 172.21.15.55:0/1198418026 learned_addr learned my addr 172.21.15.55:0/1198418026 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda7b400640 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da22b0 0x5558d5d9c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.018+0000 7fda7aa00640 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5db39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 -- 172.21.15.55:0/1198418026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 msgr2=0x5558d5db39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5db39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 -- 172.21.15.55:0/1198418026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da22b0 msgr2=0x5558d5d9c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da22b0 0x5558d5d9c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 -- 172.21.15.55:0/1198418026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d5da7170 con 0x5558d5da7e10 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda7be00640 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fda74019000 tx=0x7fda74005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e455d037ee7d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda67e00640 1 -- 172.21.15.55:0/1198418026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74003970 con 0x5558d5da7e10 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda67e00640 1 -- 172.21.15.55:0/1198418026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda74011500 con 0x5558d5da7e10 2024-03-28T05:45:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.019+0000 7fda67e00640 1 -- 172.21.15.55:0/1198418026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74005280 con 0x5558d5da7e10 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 -- 172.21.15.55:0/1198418026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 msgr2=0x5558d5dbf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fda74019000 tx=0x7fda74005e50 comp rx=0 tx=0).stop 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 -- 172.21.15.55:0/1198418026 shutdown_connections 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5dbf040 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da2ca0 0x5558d5db39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 --2- 172.21.15.55:0/1198418026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da22b0 0x5558d5d9c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 -- 172.21.15.55:0/1198418026 >> 172.21.15.55:0/1198418026 conn(0x5558d5d9d820 msgr2=0x5558d5d9c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 -- 172.21.15.55:0/1198418026 shutdown_connections 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.020+0000 7fda855a7740 1 -- 172.21.15.55:0/1198418026 wait complete. 2024-03-28T05:45:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 -- start start 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 Processor -- start 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 0x5558d5db2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da2ca0 0x5558d5db2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1a90a0 con 0x5558d5da7e10 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1aa3c0 con 0x5558d5da2ca0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1a9700 con 0x5558d5da22b0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.021+0000 7fda855a7740 10 client.0 _ll_register_callbacks cb 0x7fda68005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46446/0 (socket says 172.21.15.55:46446) 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 -- 172.21.15.55:0/175215769 learned_addr learned my addr 172.21.15.55:0/175215769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7aa00640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da2ca0 0x5558d5db2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7b400640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 0x5558d5db2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 -- 172.21.15.55:0/175215769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 msgr2=0x5558d5db2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 0x5558d5db2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 -- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da2ca0 msgr2=0x5558d5db2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da2ca0 0x5558d5db2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7be00640 1 -- 172.21.15.55:0/175215769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d5e14150 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.022+0000 7fda7b400640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 0x5558d5db2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda7be00640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda7400f830 tx=0x7fda74009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22668df86c4b9845 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda65600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74034020 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fda74003b70 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda74011500 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda74003d70 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda855a7740 10 client.15516 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5558d5e152a0 con 0x5558d5da7e10 2024-03-28T05:45:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.023+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda74011500 con 0x5558d5da7e10 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fda74026510 con 0x5558d5da7e10 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 10 client.15516 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 20 client.15516 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5e159e0 0x5558d5e17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 4 client.15516 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-28T05:45:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5558d5d0f740 con 0x5558d5e159e0 2024-03-28T05:45:57.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.024+0000 7fda7b400640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5e159e0 0x5558d5e17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.025+0000 7fda7b400640 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5e159e0 0x5558d5e17e00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5fe90565f74c460 server_cookie=1b24db5d34e89f06 in_seq=0 out_seq=0 2024-03-28T05:45:57.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.025+0000 7fda65600640 10 client.15516 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.028+0000 7fda65600640 1 -- 172.21.15.55:0/175215769 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5558d5d0f740 con 0x5558d5e159e0 2024-03-28T05:45:57.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.028+0000 7fda65600640 10 client.15516 handle_command_reply: tid=0 2024-03-28T05:45:57.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.028+0000 7fda855a7740 1 client.15516 shutdown 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 msgr2=0x5558d5e13c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fda7400f830 tx=0x7fda74009a20 comp rx=0 tx=0).stop 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 shutdown_connections 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5558d5e159e0 0x5558d5e17e00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5558d5da7e10 0x5558d5e13c10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda65600640 0 client.15516 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558d5da2ca0 0x5558d5db2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 --2- 172.21.15.55:0/175215769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5558d5da22b0 0x5558d5db2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 >> 172.21.15.55:0/175215769 conn(0x5558d5d9d820 msgr2=0x5558d5d9ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 shutdown_connections 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 1 -- 172.21.15.55:0/175215769 wait complete. 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.029+0000 7fda855a7740 20 client.15516 trim_cache size 0 max 16384 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "6b28f60e-4a29-4dee-858a-412e722c51db", 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-03-28T05:45:57.030 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 msgr2=0x7fda600a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 0x7fda600a4cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02c170 tx=0x7fda6c005be0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 msgr2=0x7fda7c199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fda6800ea60 tx=0x7fda6800ef20 comp rx=0 tx=0).stop 2024-03-28T05:45:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 shutdown_connections 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda600a2800 0x7fda600a4cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda7c109440 0x7fda7c1a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda7c0756e0 0x7fda7c199ed0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 --2- 172.21.15.55:0/2941462470 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda7c074100 0x7fda7c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 >> 172.21.15.55:0/2941462470 conn(0x7fda7c0fcb10 msgr2=0x7fda7c105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 shutdown_connections 2024-03-28T05:45:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.030+0000 7fda81200640 1 -- 172.21.15.55:0/2941462470 wait complete. 2024-03-28T05:45:57.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:45:57.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:45:57.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:57 smithi055 ceph-mon[31863]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 -- 172.21.15.55:0/596711420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 msgr2=0x7f6b7410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 --2- 172.21.15.55:0/596711420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b7410bc00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009ca0 tx=0x7f6b7002c0f0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 -- 172.21.15.55:0/596711420 shutdown_connections 2024-03-28T05:45:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 --2- 172.21.15.55:0/596711420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b7410bc00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 --2- 172.21.15.55:0/596711420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 --2- 172.21.15.55:0/596711420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 0x7f6b74103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 -- 172.21.15.55:0/596711420 >> 172.21.15.55:0/596711420 conn(0x7f6b740fed50 msgr2=0x7f6b74101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 -- 172.21.15.55:0/596711420 shutdown_connections 2024-03-28T05:45:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.263+0000 7f6b7b200640 1 -- 172.21.15.55:0/596711420 wait complete. 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.264+0000 7f6b7b200640 1 Processor -- start 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.264+0000 7f6b7b200640 1 -- start start 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 0x7f6b74199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7410f2d0 con 0x7f6b74105370 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7410f150 con 0x7f6b741049b0 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7410f450 con 0x7f6b741037c0 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46474/0 (socket says 172.21.15.55:46474) 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 -- 172.21.15.55:0/2599534485 learned_addr learned my addr 172.21.15.55:0/2599534485 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b79400640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b79e00640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 0x7f6b74199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 -- 172.21.15.55:0/2599534485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 msgr2=0x7f6b74199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 0x7f6b74199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 -- 172.21.15.55:0/2599534485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 msgr2=0x7f6b74199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b7a800640 1 -- 172.21.15.55:0/2599534485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b741a1560 con 0x7f6b74105370 2024-03-28T05:45:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.265+0000 7f6b79400640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:57.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b7a800640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6b70032380 tx=0x7f6b70032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b6ea00640 1 -- 172.21.15.55:0/2599534485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70041020 con 0x7f6b74105370 2024-03-28T05:45:57.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b6ea00640 1 -- 172.21.15.55:0/2599534485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b70003e20 con 0x7f6b74105370 2024-03-28T05:45:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b741a17f0 con 0x7f6b74105370 2024-03-28T05:45:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b6ea00640 1 -- 172.21.15.55:0/2599534485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70039040 con 0x7f6b74105370 2024-03-28T05:45:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.266+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b741a1ce0 con 0x7f6b74105370 2024-03-28T05:45:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b6ea00640 1 -- 172.21.15.55:0/2599534485 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f6b70044020 con 0x7f6b74105370 2024-03-28T05:45:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 Processor -- start 2024-03-28T05:45:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 -- start start 2024-03-28T05:45:57.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a469738540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46973b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a469698250 con 0x55a469733050 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a469640a30 con 0x55a469733a40 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.270+0000 7f6b7f575740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4696942f0 con 0x55a469738bb0 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46482/0 (socket says 172.21.15.55:46482) 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a469738540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 -- 172.21.15.55:0/1971583784 learned_addr learned my addr 172.21.15.55:0/1971583784 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 -- 172.21.15.55:0/1971583784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 msgr2=0x55a46973b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46973b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 -- 172.21.15.55:0/1971583784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 msgr2=0x55a469738540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a469738540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b79400640 1 -- 172.21.15.55:0/1971583784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a46962b690 con 0x55a469733050 2024-03-28T05:45:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.271+0000 7f6b6ea00640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 0x7f6b5c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b6ea00640 1 -- 172.21.15.55:0/2599534485 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6b700f0cc0 con 0x7f6b74105370 2024-03-28T05:45:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b79400640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 0x7f6b5c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b79400640 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009d90 tx=0x7f6b640137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821ea3dd4add784 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b63000640 1 -- 172.21.15.55:0/1971583784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400f640 con 0x55a469733050 2024-03-28T05:45:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b63000640 1 -- 172.21.15.55:0/1971583784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b64017040 con 0x55a469733050 2024-03-28T05:45:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.272+0000 7f6b63000640 1 -- 172.21.15.55:0/1971583784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011cf0 con 0x55a469733050 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 -- 172.21.15.55:0/1971583784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 msgr2=0x55a469733470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009d90 tx=0x7f6b640137d0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b79400640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 0x7f6b5c0a4cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b64020000 tx=0x7f6b64021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 -- 172.21.15.55:0/1971583784 shutdown_connections 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46973b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a469738540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 --2- 172.21.15.55:0/1971583784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a469733470 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 -- 172.21.15.55:0/1971583784 >> 172.21.15.55:0/1971583784 conn(0x55a4696fb200 msgr2=0x55a46972e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.273+0000 7f6b7f575740 1 -- 172.21.15.55:0/1971583784 shutdown_connections 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.274+0000 7f6b7f575740 1 -- 172.21.15.55:0/1971583784 wait complete. 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.274+0000 7f6b7f575740 1 -- start start 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.274+0000 7f6b7f575740 1 Processor -- start 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469733a40 0x55a46973d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469738bb0 0x55a469744630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46973bb60 con 0x55a469733050 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a469653e80 con 0x55a469738bb0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46973bce0 con 0x55a469733a40 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7f575740 10 client.0 _ll_register_callbacks cb 0x55a469666130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46494/0 (socket says 172.21.15.55:46494) 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 -- 172.21.15.55:0/165370912 learned_addr learned my addr 172.21.15.55:0/165370912 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b7a800640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469738bb0 0x55a469744630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79400640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469733a40 0x55a46973d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 -- 172.21.15.55:0/165370912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469733a40 msgr2=0x55a46973d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469733a40 0x55a46973d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 -- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469738bb0 msgr2=0x55a469744630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469738bb0 0x55a469744630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.275+0000 7f6b79e00640 1 -- 172.21.15.55:0/165370912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4694767d0 con 0x55a469733050 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b79e00640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800bec0 tx=0x7f6b68012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c68014a8ed24ae server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b57400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6801f060 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6b680108a0 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b64017040 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b68010aa0 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b7f575740 10 client.15528 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.276+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a4693ac3f0 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b64017040 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6b68024070 con 0x55a469733050 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 10 client.15528 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 20 client.15528 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a469748f30 0x55a46974b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 4 client.15528 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.277+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4696a5790 con 0x55a469748f30 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.278+0000 7f6b79400640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a469748f30 0x55a46974b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.279+0000 7f6b79400640 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a469748f30 0x55a46974b3b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e9d11e3b9bd61b server_cookie=ea55b286972430e2 in_seq=0 out_seq=0 2024-03-28T05:45:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.279+0000 7f6b57400640 10 client.15528 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.280+0000 7f6b57400640 1 -- 172.21.15.55:0/165370912 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a4696a5790 con 0x55a469748f30 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.280+0000 7f6b57400640 10 client.15528 handle_command_reply: tid=0 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 client.15528 shutdown 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 msgr2=0x55a46973d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800bec0 tx=0x7f6b68012820 comp rx=0 tx=0).stop 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 shutdown_connections 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a469748f30 0x55a46974b3b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469738bb0 0x55a469744630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469733a40 0x55a46973d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b57400640 0 client.15528 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 --2- 172.21.15.55:0/165370912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46973d0b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 >> 172.21.15.55:0/165370912 conn(0x55a4696fb200 msgr2=0x55a46972dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 shutdown_connections 2024-03-28T05:45:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 1 -- 172.21.15.55:0/165370912 wait complete. 2024-03-28T05:45:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.281+0000 7f6b7f575740 20 client.15528 trim_cache size 0 max 16384 2024-03-28T05:45:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.301+0000 7f6b7f575740 1 Processor -- start 2024-03-28T05:45:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 -- start start 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46974fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741acf80 con 0x55a469733050 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741aaa80 con 0x55a469733a40 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b7f575740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741a8b00 con 0x55a469738bb0 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46508/0 (socket says 172.21.15.55:46508) 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b79e00640 1 -- 172.21.15.55:0/3146965230 learned_addr learned my addr 172.21.15.55:0/3146965230 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.302+0000 7f6b79400640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b7a800640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46974fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 -- 172.21.15.55:0/3146965230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 msgr2=0x55a46974fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46974fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 -- 172.21.15.55:0/3146965230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 msgr2=0x55a4697445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 -- 172.21.15.55:0/3146965230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a46936c0f0 con 0x55a469733050 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b7a800640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46974fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:45:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b79e00640 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6b6801ae20 tx=0x7f6b68005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c9f3946238b93 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b62600640 1 -- 172.21.15.55:0/3146965230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6802a070 con 0x55a469733050 2024-03-28T05:45:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b62600640 1 -- 172.21.15.55:0/3146965230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b68010e40 con 0x55a469733050 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.303+0000 7f6b62600640 1 -- 172.21.15.55:0/3146965230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6801a8c0 con 0x55a469733050 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 -- 172.21.15.55:0/3146965230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 msgr2=0x55a46972d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6b6801ae20 tx=0x7f6b68005870 comp rx=0 tx=0).stop 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 -- 172.21.15.55:0/3146965230 shutdown_connections 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a46974fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 --2- 172.21.15.55:0/3146965230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a46972d330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 -- 172.21.15.55:0/3146965230 >> 172.21.15.55:0/3146965230 conn(0x55a4696fb200 msgr2=0x55a469732490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 -- 172.21.15.55:0/3146965230 shutdown_connections 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.304+0000 7f6b7f575740 1 -- 172.21.15.55:0/3146965230 wait complete. 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 -- start start 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 Processor -- start 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a4697434e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741a9100 con 0x55a469733050 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741aa420 con 0x55a469733a40 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741a9760 con 0x55a469738bb0 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.305+0000 7f6b7f575740 10 client.0 _ll_register_callbacks cb 0x7f6b6800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46510/0 (socket says 172.21.15.55:46510) 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 -- 172.21.15.55:0/513373805 learned_addr learned my addr 172.21.15.55:0/513373805 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79400640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b7a800640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a4697434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 -- 172.21.15.55:0/513373805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 msgr2=0x55a4697434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a4697434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 -- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 msgr2=0x55a4697425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:45:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 -- 172.21.15.55:0/513373805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a469743ad0 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79400640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b79e00640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b68025450 tx=0x7f6b680108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1035b6902c27dd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.306+0000 7f6b57400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6802a030 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6b68010c40 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b68010e40 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b6801f070 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b7f575740 10 client.15534 fetch_fsmap learned FSMap version 24 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a4697a4a50 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.307+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6b68010e40 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f6b68024040 con 0x55a469733050 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 10 client.15534 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:45:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:45:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 20 client.15534 populate_metadata read hostname 'smithi055' 2024-03-28T05:45:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a4697a5340 0x55a4697a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:45:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 4 client.15534 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:45:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a46969fae0 con 0x55a4697a5340 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.308+0000 7f6b79400640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a4697a5340 0x55a4697a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.309+0000 7f6b79400640 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a4697a5340 0x55a4697a7760 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44d35b068cadf093 server_cookie=89bef18786cc8081 in_seq=0 out_seq=0 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.309+0000 7f6b57400640 10 client.15534 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b57400640 1 -- 172.21.15.55:0/513373805 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a46969fae0 con 0x55a4697a5340 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b57400640 10 client.15534 handle_command_reply: tid=0 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 client.15534 shutdown 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 msgr2=0x55a4697420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6b68025450 tx=0x7f6b680108d0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 shutdown_connections 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a4697a5340 0x55a4697a7760 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a469738bb0 0x55a4697434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a469733a40 0x55a4697425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b57400640 0 client.15534 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 --2- 172.21.15.55:0/513373805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a469733050 0x55a4697420a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 >> 172.21.15.55:0/513373805 conn(0x55a4696fb200 msgr2=0x55a4697342d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 shutdown_connections 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 1 -- 172.21.15.55:0/513373805 wait complete. 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.310+0000 7f6b7f575740 20 client.15534 trim_cache size 0 max 16384 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-28T05:45:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: "6b28f60e-4a29-4dee-858a-412e722c51db": { 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "6b28f60e-4a29-4dee-858a-412e722c51db", 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,force" 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:45:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 msgr2=0x7f6b5c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 0x7f6b5c0a4cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6b64020000 tx=0x7f6b64021000 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 msgr2=0x7f6b741a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6b70032380 tx=0x7f6b70032820 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 shutdown_connections 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f6b5c0a2800 0x7f6b5c0a4cc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b74105370 0x7f6b741a0ef0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b741049b0 0x7f6b74199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 --2- 172.21.15.55:0/2599534485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6b741037c0 0x7f6b74199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 >> 172.21.15.55:0/2599534485 conn(0x7f6b740fed50 msgr2=0x7f6b74107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 shutdown_connections 2024-03-28T05:45:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:45:57.311+0000 7f6b7b200640 1 -- 172.21.15.55:0/2599534485 wait complete. 2024-03-28T05:45:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:57 smithi159 ceph-mon[36109]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:57.331 INFO:tasks.cephfs.filesystem:scrub status for tag:6b28f60e-4a29-4dee-858a-412e722c51db - {'path': '/', 'tag': '6b28f60e-4a29-4dee-858a-412e722c51db', 'options': 'recursive,force'} 2024-03-28T05:45:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:57 smithi086 ceph-mon[35163]: pgmap v461: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:45:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:58 smithi055 ceph-mon[31863]: scrub queued for path: / 2024-03-28T05:45:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:58 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:58 smithi055 ceph-mon[31863]: scrub summary: active paths [/] 2024-03-28T05:45:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:58 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:58 smithi055 ceph-mon[31863]: scrub summary: idle 2024-03-28T05:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:58 smithi086 ceph-mon[35163]: scrub queued for path: / 2024-03-28T05:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:58 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:58 smithi086 ceph-mon[35163]: scrub summary: active paths [/] 2024-03-28T05:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:58 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:58 smithi086 ceph-mon[35163]: scrub summary: idle 2024-03-28T05:45:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:58 smithi159 ceph-mon[36109]: scrub queued for path: / 2024-03-28T05:45:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:58 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:58 smithi159 ceph-mon[36109]: scrub summary: active paths [/] 2024-03-28T05:45:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:58 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:45:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:58 smithi159 ceph-mon[36109]: scrub summary: idle 2024-03-28T05:45:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:45:59 smithi055 ceph-mon[31863]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:45:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:45:59 smithi086 ceph-mon[35163]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:45:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:45:59 smithi159 ceph-mon[36109]: pgmap v462: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:46:01.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:01 smithi159 ceph-mon[36109]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:01 smithi055 ceph-mon[31863]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:01 smithi086 ceph-mon[35163]: pgmap v463: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:03 smithi055 ceph-mon[31863]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:03 smithi086 ceph-mon[35163]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:03 smithi159 ceph-mon[36109]: pgmap v464: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:05 smithi055 ceph-mon[31863]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:05 smithi086 ceph-mon[35163]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:05 smithi159 ceph-mon[36109]: pgmap v465: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:07 smithi055 ceph-mon[31863]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:07 smithi086 ceph-mon[35163]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:07 smithi159 ceph-mon[36109]: pgmap v466: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:09 smithi055 ceph-mon[31863]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:09 smithi086 ceph-mon[35163]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:09 smithi159 ceph-mon[36109]: pgmap v467: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:11 smithi086 ceph-mon[35163]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-28T05:46:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:11 smithi159 ceph-mon[36109]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-28T05:46:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:11 smithi055 ceph-mon[31863]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-03-28T05:46:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:13 smithi086 ceph-mon[35163]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:13 smithi159 ceph-mon[36109]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:13 smithi055 ceph-mon[31863]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:15.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:15 smithi055 ceph-mon[31863]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:15 smithi086 ceph-mon[35163]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:15 smithi159 ceph-mon[36109]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:17 smithi086 ceph-mon[35163]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:17 smithi159 ceph-mon[36109]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:17 smithi055 ceph-mon[31863]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:19 smithi086 ceph-mon[35163]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:19 smithi159 ceph-mon[36109]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:19 smithi055 ceph-mon[31863]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:21 smithi086 ceph-mon[35163]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:21 smithi159 ceph-mon[36109]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:21 smithi055 ceph-mon[31863]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:23 smithi086 ceph-mon[35163]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:23 smithi159 ceph-mon[36109]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:23 smithi055 ceph-mon[31863]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:25 smithi086 ceph-mon[35163]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:46:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:25 smithi159 ceph-mon[36109]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:46:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:25 smithi055 ceph-mon[31863]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:46:27.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:46:27.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:46:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:27 smithi086 ceph-mon[35163]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:46:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:46:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:46:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:27 smithi159 ceph-mon[36109]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:46:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:46:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 -- 172.21.15.55:0/859545259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee200740a0 msgr2=0x7fee20074500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 --2- 172.21.15.55:0/859545259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee200740a0 0x7fee20074500 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009900 tx=0x7fee0c02bcd0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 -- 172.21.15.55:0/859545259 shutdown_connections 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 --2- 172.21.15.55:0/859545259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee20109430 0x7fee2010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 --2- 172.21.15.55:0/859545259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee200740a0 0x7fee20074500 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 --2- 172.21.15.55:0/859545259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20075680 0x7fee20073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 -- 172.21.15.55:0/859545259 >> 172.21.15.55:0/859545259 conn(0x7fee200fcb10 msgr2=0x7fee200fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 -- 172.21.15.55:0/859545259 shutdown_connections 2024-03-28T05:46:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.608+0000 7fee27000640 1 -- 172.21.15.55:0/859545259 wait complete. 2024-03-28T05:46:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 Processor -- start 2024-03-28T05:46:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 -- start start 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee20075680 0x7fee20104e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20109430 0x7fee20101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2010f300 con 0x7fee20075680 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2010f180 con 0x7fee200740a0 2024-03-28T05:46:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.610+0000 7fee27000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2010f480 con 0x7fee20109430 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.611+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.611+0000 7fee25200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee20075680 0x7fee20104e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.611+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40670/0 (socket says 172.21.15.55:40670) 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.611+0000 7fee25c00640 1 -- 172.21.15.55:0/1314910603 learned_addr learned my addr 172.21.15.55:0/1314910603 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.611+0000 7fee26600640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20109430 0x7fee20101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.612+0000 7fee25c00640 1 -- 172.21.15.55:0/1314910603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20109430 msgr2=0x7fee20101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.612+0000 7fee25c00640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20109430 0x7fee20101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.612+0000 7fee25c00640 1 -- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee20075680 msgr2=0x7fee20104e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.612+0000 7fee25c00640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee20075680 0x7fee20104e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.612+0000 7fee25c00640 1 -- 172.21.15.55:0/1314910603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20101d50 con 0x7fee200740a0 2024-03-28T05:46:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee25c00640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee1400d950 tx=0x7fee1400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee1e000640 1 -- 172.21.15.55:0/1314910603 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14017070 con 0x7fee200740a0 2024-03-28T05:46:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee1e000640 1 -- 172.21.15.55:0/1314910603 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee14009c30 con 0x7fee200740a0 2024-03-28T05:46:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee1e000640 1 -- 172.21.15.55:0/1314910603 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400f620 con 0x7fee200740a0 2024-03-28T05:46:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee201a5e50 con 0x7fee200740a0 2024-03-28T05:46:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.613+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee201a6200 con 0x7fee200740a0 2024-03-28T05:46:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.618+0000 7fee2b252740 1 Processor -- start 2024-03-28T05:46:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.618+0000 7fee2b252740 1 -- start start 2024-03-28T05:46:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.619+0000 7fee1e000640 1 -- 172.21.15.55:0/1314910603 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fee140109a0 con 0x7fee200740a0 2024-03-28T05:46:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.619+0000 7fee2b252740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb7499470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.619+0000 7fee2b252740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.619+0000 7fee2b252740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb74a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee2b252740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb73fe250 con 0x555fb749ebb0 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee2b252740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb73a6a30 con 0x555fb7499a40 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee2b252740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb73fa2f0 con 0x555fb7499050 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee26600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb7499470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40672/0 (socket says 172.21.15.55:40672) 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee25c00640 1 -- 172.21.15.55:0/995985944 learned_addr learned my addr 172.21.15.55:0/995985944 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.620+0000 7fee1e000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 0x7fee080a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee1e000640 1 -- 172.21.15.55:0/1314910603 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee140ce5c0 con 0x7fee200740a0 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25c00640 1 -- 172.21.15.55:0/995985944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 msgr2=0x555fb7499470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25c00640 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb7499470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25c00640 1 -- 172.21.15.55:0/995985944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 msgr2=0x555fb74a1040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25200640 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb74a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25c00640 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb74a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25c00640 1 -- 172.21.15.55:0/995985944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fb7391690 con 0x555fb7499a40 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.621+0000 7fee25200640 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb74a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.622+0000 7fee26600640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 0x7fee080a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.622+0000 7fee25c00640 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee1409ad10 tx=0x7fee1400bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83932f64d9ce730e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.622+0000 7fee12a00640 1 -- 172.21.15.55:0/995985944 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14020070 con 0x555fb7499a40 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.622+0000 7fee12a00640 1 -- 172.21.15.55:0/995985944 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee1409b010 con 0x555fb7499a40 2024-03-28T05:46:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.622+0000 7fee12a00640 1 -- 172.21.15.55:0/995985944 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14095b80 con 0x555fb7499a40 2024-03-28T05:46:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:27 smithi055 ceph-mon[31863]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:46:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:46:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee26600640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 0x7fee080a4cc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x555fb749a2a0 tx=0x7fee18004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 -- 172.21.15.55:0/995985944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 msgr2=0x555fb749e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee1409ad10 tx=0x7fee1400bf60 comp rx=0 tx=0).stop 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 -- 172.21.15.55:0/995985944 shutdown_connections 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb74a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb749e540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 --2- 172.21.15.55:0/995985944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb7499470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 -- 172.21.15.55:0/995985944 >> 172.21.15.55:0/995985944 conn(0x555fb7461200 msgr2=0x555fb74949c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 -- 172.21.15.55:0/995985944 shutdown_connections 2024-03-28T05:46:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.624+0000 7fee2b252740 1 -- 172.21.15.55:0/995985944 wait complete. 2024-03-28T05:46:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.625+0000 7fee2b252740 1 -- start start 2024-03-28T05:46:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.625+0000 7fee2b252740 1 Processor -- start 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb74a1b00 con 0x555fb7499a40 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb73b9e80 con 0x555fb7499050 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fb74a1c80 con 0x555fb749ebb0 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee2b252740 10 client.0 _ll_register_callbacks cb 0x555fb73cc130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40680/0 (socket says 172.21.15.55:40680) 2024-03-28T05:46:27.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.626+0000 7fee25c00640 1 -- 172.21.15.55:0/3402070199 learned_addr learned my addr 172.21.15.55:0/3402070199 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25200640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 -- 172.21.15.55:0/3402070199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 msgr2=0x555fb74aa5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74aa5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 -- 172.21.15.55:0/3402070199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 msgr2=0x555fb74a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 -- 172.21.15.55:0/3402070199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fb71dc7d0 con 0x555fb7499050 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25200640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee25c00640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee140a31d0 tx=0x7fee140978b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9ad767acfd3b7a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.627+0000 7fee07400640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14020070 con 0x555fb7499050 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee1409b010 con 0x555fb7499050 2024-03-28T05:46:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee14095d90 con 0x555fb7499050 2024-03-28T05:46:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1409f0b0 con 0x555fb7499050 2024-03-28T05:46:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee2b252740 10 client.35315 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.628+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555fb71123f0 con 0x555fb7499050 2024-03-28T05:46:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.629+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee1409b010 con 0x555fb7499050 2024-03-28T05:46:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.629+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fee14096f60 con 0x555fb7499050 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 10 client.35315 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 10 client.35315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 20 client.35315 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb74aea10 0x555fb74b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 4 client.35315 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fb740b790 con 0x555fb74aea10 2024-03-28T05:46:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.630+0000 7fee25200640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb74aea10 0x555fb74b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.631+0000 7fee25200640 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb74aea10 0x555fb74b0e00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc2eee82e9de131 server_cookie=bf9600f5a3dcfad2 in_seq=0 out_seq=0 2024-03-28T05:46:27.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.631+0000 7fee07400640 10 client.35315 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.633+0000 7fee07400640 1 -- 172.21.15.55:0/3402070199 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555fb740b790 con 0x555fb74aea10 2024-03-28T05:46:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.633+0000 7fee07400640 10 client.35315 handle_command_reply: tid=0 2024-03-28T05:46:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.633+0000 7fee2b252740 1 client.35315 shutdown 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.633+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 msgr2=0x555fb74a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.633+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee140a31d0 tx=0x7fee140978b0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 shutdown_connections 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb74aea10 0x555fb74b0e00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee07400640 0 client.35315 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 --2- 172.21.15.55:0/3402070199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a3030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 >> 172.21.15.55:0/3402070199 conn(0x555fb7461200 msgr2=0x555fb7493bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 shutdown_connections 2024-03-28T05:46:27.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 1 -- 172.21.15.55:0/3402070199 wait complete. 2024-03-28T05:46:27.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.634+0000 7fee2b252740 20 client.35315 trim_cache size 0 max 16384 2024-03-28T05:46:27.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 Processor -- start 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 -- start start 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb74aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb749abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201b13f0 con 0x555fb749ebb0 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.668+0000 7fee2b252740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201aeef0 con 0x555fb7499a40 2024-03-28T05:46:27.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee2b252740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201acf70 con 0x555fb7499050 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee26600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb749abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:41720/0 (socket says 172.21.15.55:41720) 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 -- 172.21.15.55:0/1242748457 learned_addr learned my addr 172.21.15.55:0/1242748457 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25200640 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb74aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 -- 172.21.15.55:0/1242748457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 msgr2=0x555fb74aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb74aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.669+0000 7fee25c00640 1 -- 172.21.15.55:0/1242748457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 msgr2=0x555fb749abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee25c00640 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb749abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee25c00640 1 -- 172.21.15.55:0/1242748457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fb70d20f0 con 0x555fb7499050 2024-03-28T05:46:27.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee26600640 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb749abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:27.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee25c00640 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee1409f270 tx=0x7fee14097920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b2b68ca116be06 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee12000640 1 -- 172.21.15.55:0/1242748457 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14020050 con 0x555fb7499050 2024-03-28T05:46:27.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee12000640 1 -- 172.21.15.55:0/1242748457 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee140cc140 con 0x555fb7499050 2024-03-28T05:46:27.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.671+0000 7fee12000640 1 -- 172.21.15.55:0/1242748457 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140653b0 con 0x555fb7499050 2024-03-28T05:46:27.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.672+0000 7fee2b252740 1 -- 172.21.15.55:0/1242748457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 msgr2=0x555fb74a34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.672+0000 7fee2b252740 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee1409f270 tx=0x7fee14097920 comp rx=0 tx=0).stop 2024-03-28T05:46:27.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 -- 172.21.15.55:0/1242748457 shutdown_connections 2024-03-28T05:46:27.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb749ebb0 0x555fb749abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499a40 0x555fb74aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 --2- 172.21.15.55:0/1242748457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb7499050 0x555fb74a34d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 -- 172.21.15.55:0/1242748457 >> 172.21.15.55:0/1242748457 conn(0x555fb7461200 msgr2=0x555fb749a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 -- 172.21.15.55:0/1242748457 shutdown_connections 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.673+0000 7fee2b252740 1 -- 172.21.15.55:0/1242748457 wait complete. 2024-03-28T05:46:27.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.674+0000 7fee2b252740 1 -- start start 2024-03-28T05:46:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.674+0000 7fee2b252740 1 Processor -- start 2024-03-28T05:46:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201ad570 con 0x555fb7499a40 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201ae890 con 0x555fb7499050 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee201adbd0 con 0x555fb749ebb0 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee2b252740 10 client.0 _ll_register_callbacks cb 0x7fee1400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee25200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee25200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39482/0 (socket says 172.21.15.55:39482) 2024-03-28T05:46:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee25200640 1 -- 172.21.15.55:0/4181594884 learned_addr learned my addr 172.21.15.55:0/4181594884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.675+0000 7fee25c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee26600640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 -- 172.21.15.55:0/4181594884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 msgr2=0x555fb74a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 -- 172.21.15.55:0/4181594884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 msgr2=0x555fb74a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 -- 172.21.15.55:0/4181594884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fb74a97c0 con 0x555fb7499050 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee25c00640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a5d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee14061000 tx=0x7fee1409a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94babb9c8c29d06 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.676+0000 7fee07400640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14020070 con 0x555fb7499050 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee140cc140 con 0x555fb7499050 2024-03-28T05:46:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee14096f70 con 0x555fb7499050 2024-03-28T05:46:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1407e050 con 0x555fb7499050 2024-03-28T05:46:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee2b252740 10 client.35318 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.677+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555fb74a97c0 con 0x555fb7499050 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.678+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fee140cc140 con 0x555fb7499050 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.678+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fee14099ed0 con 0x555fb7499050 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 10 client.35318 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 10 client.35318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 20 client.35318 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb751b480 0x555fb751d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 4 client.35318 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555fb7405ae0 con 0x555fb751b480 2024-03-28T05:46:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.679+0000 7fee25200640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb751b480 0x555fb751d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.680+0000 7fee25200640 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb751b480 0x555fb751d870 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae48a0c38b7be22 server_cookie=b24837ccfd70cc52 in_seq=0 out_seq=0 2024-03-28T05:46:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.680+0000 7fee07400640 10 client.35318 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee07400640 1 -- 172.21.15.55:0/4181594884 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555fb7405ae0 con 0x555fb751b480 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee07400640 10 client.35318 handle_command_reply: tid=0 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 client.35318 shutdown 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 msgr2=0x555fb74a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a5d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee14061000 tx=0x7fee1409a8c0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 shutdown_connections 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x555fb751b480 0x555fb751d870 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555fb749ebb0 0x555fb74a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555fb7499a40 0x555fb74a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee07400640 0 client.35318 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 --2- 172.21.15.55:0/4181594884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555fb7499050 0x555fb74a5d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 >> 172.21.15.55:0/4181594884 conn(0x555fb7461200 msgr2=0x555fb7493bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 shutdown_connections 2024-03-28T05:46:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 1 -- 172.21.15.55:0/4181594884 wait complete. 2024-03-28T05:46:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.681+0000 7fee2b252740 20 client.35318 trim_cache size 0 max 16384 2024-03-28T05:46:27.683 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:46:27.683 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-03-28T05:46:27.684 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-03-28T05:46:27.684 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:46:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 msgr2=0x7fee080a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 0x7fee080a4cc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x555fb749a2a0 tx=0x7fee18004a40 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 msgr2=0x7fee20104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee1400d950 tx=0x7fee1400de10 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 shutdown_connections 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fee080a2800 0x7fee080a4cc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee20109430 0x7fee20101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee20075680 0x7fee20104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.682+0000 7fee27000640 1 --2- 172.21.15.55:0/1314910603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee200740a0 0x7fee20104920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.683+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 >> 172.21.15.55:0/1314910603 conn(0x7fee200fcb10 msgr2=0x7fee201053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.684+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 shutdown_connections 2024-03-28T05:46:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.684+0000 7fee27000640 1 -- 172.21.15.55:0/1314910603 wait complete. 2024-03-28T05:46:27.703 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-28T05:46:27.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 -- 172.21.15.55:0/3690970765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc100930 msgr2=0x7f44fc100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 --2- 172.21.15.55:0/3690970765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc100930 0x7f44fc100d90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e802bcd0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 -- 172.21.15.55:0/3690970765 shutdown_connections 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 --2- 172.21.15.55:0/3690970765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc1012d0 0x7f44fc101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 --2- 172.21.15.55:0/3690970765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc100930 0x7f44fc100d90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 --2- 172.21.15.55:0/3690970765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc0fffd0 0x7f44fc1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 -- 172.21.15.55:0/3690970765 >> 172.21.15.55:0/3690970765 conn(0x7f44fc0fbb50 msgr2=0x7f44fc0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 -- 172.21.15.55:0/3690970765 shutdown_connections 2024-03-28T05:46:27.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.884+0000 7f4503c00640 1 -- 172.21.15.55:0/3690970765 wait complete. 2024-03-28T05:46:27.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.885+0000 7f4503c00640 1 Processor -- start 2024-03-28T05:46:27.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.885+0000 7f4503c00640 1 -- start start 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc0fffd0 0x7f44fc199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 0x7f44fc199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f440 con 0x7f44fc1012d0 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f2c0 con 0x7f44fc100930 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4503c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f5c0 con 0x7f44fc0fffd0 2024-03-28T05:46:27.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4501c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4501c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39494/0 (socket says 172.21.15.55:39494) 2024-03-28T05:46:27.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f4501c00640 1 -- 172.21.15.55:0/22737817 learned_addr learned my addr 172.21.15.55:0/22737817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:27.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.886+0000 7f44fbe00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 0x7f44fc199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501200640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc0fffd0 0x7f44fc199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 -- 172.21.15.55:0/22737817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc0fffd0 msgr2=0x7f44fc199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc0fffd0 0x7f44fc199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 -- 172.21.15.55:0/22737817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 msgr2=0x7f44fc199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 0x7f44fc199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 -- 172.21.15.55:0/22737817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc1a16d0 con 0x7f44fc1012d0 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f44fbe00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 0x7f44fc199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.887+0000 7f4501c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cce0 tx=0x7f44f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.888+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f450 con 0x7f44fc1012d0 2024-03-28T05:46:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.888+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f44f400faa0 con 0x7f44fc1012d0 2024-03-28T05:46:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.888+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4018b70 con 0x7f44fc1012d0 2024-03-28T05:46:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.888+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc1a19c0 con 0x7f44fc1012d0 2024-03-28T05:46:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.888+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc1a1e90 con 0x7f44fc1012d0 2024-03-28T05:46:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.890+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc10aec0 con 0x7f44fc1012d0 2024-03-28T05:46:27.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.891+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f44f400fc50 con 0x7f44fc1012d0 2024-03-28T05:46:27.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.896+0000 7f44f9600640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 0x7f44e40a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.896+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f44f40ceca0 con 0x7f44fc1012d0 2024-03-28T05:46:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.896+0000 7f4501200640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 0x7f44e40a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.897+0000 7f4501200640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 0x7f44e40a4d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f44f0005d00 tx=0x7f44f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:27.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:27.904+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f44f4014030 con 0x7f44fc1012d0 2024-03-28T05:46:28.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.161+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44fc02d070 con 0x7f44fc1012d0 2024-03-28T05:46:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.162+0000 7f44f9600640 1 -- 172.21.15.55:0/22737817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f44f409bd00 con 0x7f44fc1012d0 2024-03-28T05:46:28.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:46:28.163 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:45:14.020698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34535,34457,34490]},"id":1}]} 2024-03-28T05:46:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2024-03-28T05:46:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 msgr2=0x7f44e40a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 0x7f44e40a4d40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f44f0005d00 tx=0x7f44f000b410 comp rx=0 tx=0).stop 2024-03-28T05:46:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 msgr2=0x7f44fc1a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cce0 tx=0x7f44f400a620 comp rx=0 tx=0).stop 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 shutdown_connections 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f44e40a2880 0x7f44e40a4d40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc1012d0 0x7f44fc1a1060 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f44fc100930 0x7f44fc199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 --2- 172.21.15.55:0/22737817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44fc0fffd0 0x7f44fc199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.165+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 >> 172.21.15.55:0/22737817 conn(0x7f44fc0fbb50 msgr2=0x7f44fc0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.166+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 shutdown_connections 2024-03-28T05:46:28.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.166+0000 7f4503c00640 1 -- 172.21.15.55:0/22737817 wait complete. 2024-03-28T05:46:28.189 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:46:28.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-28T05:46:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 -- 172.21.15.55:0/846945092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b981010f0 msgr2=0x7f2b98101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/846945092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b981010f0 0x7f2b98101570 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009ca0 tx=0x7f2b9002c100 comp rx=0 tx=0).stop 2024-03-28T05:46:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 -- 172.21.15.55:0/846945092 shutdown_connections 2024-03-28T05:46:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/846945092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b981010f0 0x7f2b98101570 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/846945092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b98100750 0x7f2b98100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/846945092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b980ffdf0 0x7f2b98100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 -- 172.21.15.55:0/846945092 >> 172.21.15.55:0/846945092 conn(0x7f2b980fba10 msgr2=0x7f2b980fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 -- 172.21.15.55:0/846945092 shutdown_connections 2024-03-28T05:46:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.405+0000 7f2b9ca00640 1 -- 172.21.15.55:0/846945092 wait complete. 2024-03-28T05:46:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.406+0000 7f2b9ca00640 1 Processor -- start 2024-03-28T05:46:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.406+0000 7f2b9ca00640 1 -- start start 2024-03-28T05:46:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b98100750 0x7f2b98199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 0x7f2b981a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9810f280 con 0x7f2b980ffdf0 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9810f100 con 0x7f2b98100750 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b9ca00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9810f400 con 0x7f2b981010f0 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39508/0 (socket says 172.21.15.55:39508) 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b97400640 1 -- 172.21.15.55:0/2934658251 learned_addr learned my addr 172.21.15.55:0/2934658251 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.407+0000 7f2b96a00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b98100750 0x7f2b98199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 0x7f2b981a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 -- 172.21.15.55:0/2934658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 msgr2=0x7f2b981a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 0x7f2b981a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 -- 172.21.15.55:0/2934658251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b98100750 msgr2=0x7f2b98199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b98100750 0x7f2b98199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 -- 172.21.15.55:0/2934658251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b981a14c0 con 0x7f2b980ffdf0 2024-03-28T05:46:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 0x7f2b981a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:46:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b97400640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e9f0 tx=0x7f2b8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b8fe00640 1 -- 172.21.15.55:0/2934658251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800ccc0 con 0x7f2b980ffdf0 2024-03-28T05:46:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b8fe00640 1 -- 172.21.15.55:0/2934658251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b880108e0 con 0x7f2b980ffdf0 2024-03-28T05:46:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.408+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b981a17b0 con 0x7f2b980ffdf0 2024-03-28T05:46:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.409+0000 7f2b8fe00640 1 -- 172.21.15.55:0/2934658251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880187c0 con 0x7f2b980ffdf0 2024-03-28T05:46:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.409+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b981a1d00 con 0x7f2b980ffdf0 2024-03-28T05:46:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 Processor -- start 2024-03-28T05:46:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 -- start start 2024-03-28T05:46:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d88e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830ced2c0 con 0x55f830d89bc0 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830c95c90 con 0x55f830d8a580 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.413+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830ce9360 con 0x55f830d889f0 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b8fe00640 1 -- 172.21.15.55:0/2934658251 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f2b88010a90 con 0x7f2b980ffdf0 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b97e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d88e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b96a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b96a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40744/0 (socket says 172.21.15.55:40744) 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b96a00640 1 -- 172.21.15.55:0/3429407755 learned_addr learned my addr 172.21.15.55:0/3429407755 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.414+0000 7f2b97400640 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 -- 172.21.15.55:0/3429407755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 msgr2=0x55f830d88e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d88e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 -- 172.21.15.55:0/3429407755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 msgr2=0x55f830d8a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d8a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 -- 172.21.15.55:0/3429407755 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f830cba080 con 0x55f830d8a580 2024-03-28T05:46:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.415+0000 7f2b96a00640 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400aca0 tx=0x7f2b8400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb7270b39eda3fd server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.416+0000 7f2b83e00640 1 -- 172.21.15.55:0/3429407755 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8401d070 con 0x55f830d8a580 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.416+0000 7f2b83e00640 1 -- 172.21.15.55:0/3429407755 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b84018af0 con 0x55f830d8a580 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.416+0000 7f2b83e00640 1 -- 172.21.15.55:0/3429407755 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84010b80 con 0x55f830d8a580 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.416+0000 7f2b8fe00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 0x7f2b7c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.416+0000 7f2b8fe00640 1 -- 172.21.15.55:0/2934658251 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2b880cef30 con 0x7f2b980ffdf0 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 0x7f2b7c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- 172.21.15.55:0/3429407755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 msgr2=0x55f830d90e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400aca0 tx=0x7f2b8400f790 comp rx=0 tx=0).stop 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- 172.21.15.55:0/3429407755 shutdown_connections 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d90e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d8a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/3429407755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d88e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- 172.21.15.55:0/3429407755 >> 172.21.15.55:0/3429407755 conn(0x55f830d83de0 msgr2=0x55f830d841e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- 172.21.15.55:0/3429407755 shutdown_connections 2024-03-28T05:46:28.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- 172.21.15.55:0/3429407755 wait complete. 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.417+0000 7f2ba0d78740 1 -- start start 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 Processor -- start 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 0x7f2b7c0a4cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b90004af0 tx=0x7f2b90005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d89bc0 0x55f830d93150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d8a580 0x55f830d9a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830d91590 con 0x55f830d8a580 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830ca90d0 con 0x55f830d889f0 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.418+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f830d91710 con 0x55f830d89bc0 2024-03-28T05:46:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2ba0d78740 10 client.0 _ll_register_callbacks cb 0x55f830cade80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2b97400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2b97400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40748/0 (socket says 172.21.15.55:40748) 2024-03-28T05:46:28.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2b97400640 1 -- 172.21.15.55:0/2836483898 learned_addr learned my addr 172.21.15.55:0/2836483898 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d8a580 0x55f830d9a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.419+0000 7f2b96a00640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d89bc0 0x55f830d93150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 -- 172.21.15.55:0/2836483898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d89bc0 msgr2=0x55f830d93150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d89bc0 0x55f830d93150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 -- 172.21.15.55:0/2836483898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d8a580 msgr2=0x55f830d9a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d8a580 0x55f830d9a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 -- 172.21.15.55:0/2836483898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f830a013f0 con 0x55f830d889f0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b97400640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b880a3b00 tx=0x7f2b8809b2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad93f126e1416a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b80c00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880862b0 con 0x55f830d889f0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2b88010430 con 0x55f830d889f0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.420+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b84018af0 con 0x55f830d889f0 2024-03-28T05:46:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8809f9e0 con 0x55f830d889f0 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 10 client.35336 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f830acb7d0 con 0x55f830d889f0 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b84018af0 con 0x55f830d889f0 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2b88097770 con 0x55f830d889f0 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 10 client.35336 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 10 client.35336 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 20 client.35336 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.421+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830d9e600 0x55f830da0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.422+0000 7f2ba0d78740 4 client.35336 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.422+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f830cfa800 con 0x55f830d9e600 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.422+0000 7f2b96a00640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830d9e600 0x55f830da0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.423+0000 7f2b96a00640 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830d9e600 0x55f830da0a60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35cbe91665389e7c server_cookie=55d5fac2cf2da403 in_seq=0 out_seq=0 2024-03-28T05:46:28.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.423+0000 7f2b80c00640 10 client.35336 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:46:28.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2b80c00640 1 -- 172.21.15.55:0/2836483898 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f830cfa800 con 0x55f830d9e600 2024-03-28T05:46:28.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2b80c00640 10 client.35336 handle_command_reply: tid=0 2024-03-28T05:46:28.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 client.35336 shutdown 2024-03-28T05:46:28.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 msgr2=0x55f830d92c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b880a3b00 tx=0x7f2b8809b2b0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 shutdown_connections 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830d9e600 0x55f830da0a60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d8a580 0x55f830d9a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d89bc0 0x55f830d93150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2b80c00640 0 client.35336 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2836483898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d889f0 0x55f830d92c10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 >> 172.21.15.55:0/2836483898 conn(0x55f830d83de0 msgr2=0x55f830d83160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 shutdown_connections 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2836483898 wait complete. 2024-03-28T05:46:28.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.425+0000 7f2ba0d78740 20 client.35336 trim_cache size 0 max 16384 2024-03-28T05:46:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 Processor -- start 2024-03-28T05:46:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 -- start start 2024-03-28T05:46:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d89bc0 0x55f830d9a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d8a580 0x55f830d8d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981acec0 con 0x55f830d889f0 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981aa9c0 con 0x55f830d89bc0 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.451+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981a8a40 con 0x55f830d8a580 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39522/0 (socket says 172.21.15.55:39522) 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 -- 172.21.15.55:0/2872592717 learned_addr learned my addr 172.21.15.55:0/2872592717 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b96a00640 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d89bc0 0x55f830d9a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97e00640 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d8a580 0x55f830d8d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 -- 172.21.15.55:0/2872592717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d8a580 msgr2=0x55f830d8d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d8a580 0x55f830d8d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 -- 172.21.15.55:0/2872592717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d89bc0 msgr2=0x55f830d9a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d89bc0 0x55f830d9a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.452+0000 7f2b97400640 1 -- 172.21.15.55:0/2872592717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f830d84850 con 0x55f830d889f0 2024-03-28T05:46:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.453+0000 7f2b97400640 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b88098260 tx=0x7f2b88097bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d020432eadf12b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.453+0000 7f2b83400640 1 -- 172.21.15.55:0/2872592717 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880860b0 con 0x55f830d889f0 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.453+0000 7f2b83400640 1 -- 172.21.15.55:0/2872592717 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b88086250 con 0x55f830d889f0 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.453+0000 7f2b83400640 1 -- 172.21.15.55:0/2872592717 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880d2280 con 0x55f830d889f0 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2872592717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 msgr2=0x55f830d8cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b88098260 tx=0x7f2b88097bf0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2872592717 shutdown_connections 2024-03-28T05:46:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d8a580 0x55f830d8d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d89bc0 0x55f830d9a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/2872592717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d889f0 0x55f830d8cdf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2872592717 >> 172.21.15.55:0/2872592717 conn(0x55f830d83de0 msgr2=0x55f830d878d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2872592717 shutdown_connections 2024-03-28T05:46:28.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.454+0000 7f2ba0d78740 1 -- 172.21.15.55:0/2872592717 wait complete. 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.455+0000 7f2ba0d78740 1 -- start start 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.455+0000 7f2ba0d78740 1 Processor -- start 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d98180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981a9040 con 0x55f830d89bc0 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981aa360 con 0x55f830d8a580 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981a96a0 con 0x55f830d889f0 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2ba0d78740 10 client.0 _ll_register_callbacks cb 0x7f2b880d24a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2b96a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2b97e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2b97400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d98180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2b97e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40762/0 (socket says 172.21.15.55:40762) 2024-03-28T05:46:28.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.456+0000 7f2b97e00640 1 -- 172.21.15.55:0/4145199574 learned_addr learned my addr 172.21.15.55:0/4145199574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97400640 1 -- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 msgr2=0x55f830d996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97400640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97400640 1 -- 172.21.15.55:0/4145199574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 msgr2=0x55f830d986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97400640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97400640 1 -- 172.21.15.55:0/4145199574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f830d99cc0 con 0x55f830d889f0 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b97e00640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.457+0000 7f2b96a00640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.458+0000 7f2b97400640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d98180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b8809b540 tx=0x7f2b88097c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db08f195e4390886 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.458+0000 7f2b80c00640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-03-28T05:46:28.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.458+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880a4030 con 0x55f830d889f0 2024-03-28T05:46:28.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.458+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b88086250 con 0x55f830d889f0 2024-03-28T05:46:28.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.458+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2b88010430 con 0x55f830d889f0 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.459+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b88010630 con 0x55f830d889f0 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.459+0000 7f2ba0d78740 10 client.25090 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.459+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f830e02f40 con 0x55f830d889f0 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.459+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f2b88086250 con 0x55f830d889f0 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2b880a0a90 con 0x55f830d889f0 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 10 client.25090 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 10 client.25090 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:46:28.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 20 client.25090 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830e03600 0x55f830e059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 4 client.25090 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:46:28.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.460+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f830cf4b50 con 0x55f830e03600 2024-03-28T05:46:28.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.461+0000 7f2b96a00640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830e03600 0x55f830e059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.461+0000 7f2b96a00640 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830e03600 0x55f830e059f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f0307396393dac4 server_cookie=2a8c94e5bcd529c8 in_seq=0 out_seq=0 2024-03-28T05:46:28.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.461+0000 7f2b80c00640 10 client.25090 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:46:28.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2b80c00640 1 -- 172.21.15.55:0/4145199574 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f830cf4b50 con 0x55f830e03600 2024-03-28T05:46:28.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2b80c00640 10 client.25090 handle_command_reply: tid=0 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 client.25090 shutdown 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 msgr2=0x55f830d98180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d98180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b8809b540 tx=0x7f2b88097c60 comp rx=0 tx=0).stop 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 shutdown_connections 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x55f830e03600 0x55f830e059f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f830d8a580 0x55f830d996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f830d89bc0 0x55f830d986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 --2- 172.21.15.55:0/4145199574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f830d889f0 0x55f830d98180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 >> 172.21.15.55:0/4145199574 conn(0x55f830d83de0 msgr2=0x55f830d828d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2b80c00640 0 client.25090 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.462+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 shutdown_connections 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2ba0d78740 1 -- 172.21.15.55:0/4145199574 wait complete. 2024-03-28T05:46:28.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2ba0d78740 20 client.25090 trim_cache size 0 max 16384 2024-03-28T05:46:28.465 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:46:28.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 msgr2=0x7f2b7c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 0x7f2b7c0a4cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b90004af0 tx=0x7f2b90005da0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 msgr2=0x7f2b981998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.463+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e9f0 tx=0x7f2b8800edf0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 shutdown_connections 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f2b7c0a2800 0x7f2b7c0a4cc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b981010f0 0x7f2b981a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b98100750 0x7f2b98199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 --2- 172.21.15.55:0/2934658251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b980ffdf0 0x7f2b981998a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 >> 172.21.15.55:0/2934658251 conn(0x7f2b980fba10 msgr2=0x7f2b980fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 shutdown_connections 2024-03-28T05:46:28.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.464+0000 7f2b9ca00640 1 -- 172.21.15.55:0/2934658251 wait complete. 2024-03-28T05:46:28.484 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:28 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/22737817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:46:28.487 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:46:28.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-28T05:46:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:28 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/22737817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:46:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:28 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/22737817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:46:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1973226996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 msgr2=0x7f3cc4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1973226996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4102c10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009900 tx=0x7f3cb002bc30 comp rx=0 tx=0).stop 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1973226996 shutdown_connections 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1973226996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc41099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1973226996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4102c10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1973226996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 0x7f3cc41019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1973226996 >> 172.21.15.55:0/1973226996 conn(0x7f3cc40fcb10 msgr2=0x7f3cc40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1973226996 shutdown_connections 2024-03-28T05:46:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.667+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1973226996 wait complete. 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.668+0000 7f3ccaa00640 1 Processor -- start 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.668+0000 7f3ccaa00640 1 -- start start 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 0x7f3cc4075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc4073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc410d120 con 0x7f3cc4102790 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc410cfa0 con 0x7f3cc4103150 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc410d2a0 con 0x7f3cc41015a0 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39538/0 (socket says 172.21.15.55:39538) 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3cc8c00640 1 -- 172.21.15.55:0/1069539274 learned_addr learned my addr 172.21.15.55:0/1069539274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3cca000640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc4073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.669+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 0x7f3cc4075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 -- 172.21.15.55:0/1069539274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 msgr2=0x7f3cc4075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 0x7f3cc4075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 -- 172.21.15.55:0/1069539274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 msgr2=0x7f3cc4073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc4073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 -- 172.21.15.55:0/1069539274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4074860 con 0x7f3cc4102790 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cca000640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc4073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.670+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.671+0000 7f3cc2000640 1 -- 172.21.15.55:0/1069539274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0043020 con 0x7f3cc4102790 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.671+0000 7f3cc2000640 1 -- 172.21.15.55:0/1069539274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cb0004aa0 con 0x7f3cc4102790 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.671+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc41a18e0 con 0x7f3cc4102790 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.671+0000 7f3cc2000640 1 -- 172.21.15.55:0/1069539274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0003d00 con 0x7f3cc4102790 2024-03-28T05:46:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.671+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc41a1e30 con 0x7f3cc4102790 2024-03-28T05:46:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 Processor -- start 2024-03-28T05:46:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 -- start start 2024-03-28T05:46:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12374bc0 0x55ea12375040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea1237be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea122d82c0 con 0x55ea12375580 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea12280c90 con 0x55ea123739f0 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.675+0000 7f3cced64740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea122d4360 con 0x55ea12374bc0 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:40774/0 (socket says 172.21.15.55:40774) 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 -- 172.21.15.55:0/2197240418 learned_addr learned my addr 172.21.15.55:0/2197240418 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cc2000640 1 -- 172.21.15.55:0/1069539274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3cb0046020 con 0x7f3cc4102790 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cc9600640 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12374bc0 0x55ea12375040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 -- 172.21.15.55:0/2197240418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12374bc0 msgr2=0x55ea12375040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12374bc0 0x55ea12375040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 -- 172.21.15.55:0/2197240418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 msgr2=0x55ea1237be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea1237be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.676+0000 7f3cca000640 1 -- 172.21.15.55:0/2197240418 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea122a5080 con 0x55ea123739f0 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.677+0000 7f3cca000640 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0117e0 tx=0x7f3cbc011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac298165016eae3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.677+0000 7f3cb6600640 1 -- 172.21.15.55:0/2197240418 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc011310 con 0x55ea123739f0 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.677+0000 7f3cb6600640 1 -- 172.21.15.55:0/2197240418 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cbc003e20 con 0x55ea123739f0 2024-03-28T05:46:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.677+0000 7f3cb6600640 1 -- 172.21.15.55:0/2197240418 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc004510 con 0x55ea123739f0 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 -- 172.21.15.55:0/2197240418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 msgr2=0x55ea12373e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0117e0 tx=0x7f3cbc011ca0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 -- 172.21.15.55:0/2197240418 shutdown_connections 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea1237be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12374bc0 0x55ea12375040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 --2- 172.21.15.55:0/2197240418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12373e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 -- 172.21.15.55:0/2197240418 >> 172.21.15.55:0/2197240418 conn(0x55ea1236ede0 msgr2=0x55ea1236f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 -- 172.21.15.55:0/2197240418 shutdown_connections 2024-03-28T05:46:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cced64740 1 -- 172.21.15.55:0/2197240418 wait complete. 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.678+0000 7f3cc2000640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 0x7f3cac0a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 -- start start 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cc2000640 1 -- 172.21.15.55:0/1069539274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3cb00f0c60 con 0x7f3cc4102790 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 0x7f3cac0a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 Processor -- start 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea1237dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea1237e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1237c590 con 0x55ea12375580 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea122940d0 con 0x55ea12374bc0 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea1237c710 con 0x55ea123739f0 2024-03-28T05:46:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.679+0000 7f3cced64740 10 client.0 _ll_register_callbacks cb 0x55ea12298e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39552/0 (socket says 172.21.15.55:39552) 2024-03-28T05:46:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 -- 172.21.15.55:0/1537648812 learned_addr learned my addr 172.21.15.55:0/1537648812 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea1237e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 -- 172.21.15.55:0/1537648812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 msgr2=0x55ea1237dd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea1237dd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 -- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 msgr2=0x55ea1237e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea1237e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.680+0000 7f3cca000640 1 -- 172.21.15.55:0/1537648812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea11fec3f0 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3cca000640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc011530 tx=0x7f3cbc011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601988c7d8614afc server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 0x7f3cac0a4bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55ea1236fd50 tx=0x7f3cb800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc02a060 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3cbc004a40 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.681+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cbc003e20 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cbc004c40 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 10 client.15582 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ea120b67d0 con 0x55ea12375580 2024-03-28T05:46:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cbc003e20 con 0x55ea12375580 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3cbc018020 con 0x55ea12375580 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 10 client.15582 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 10 client.15582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 20 client.15582 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea12389480 0x55ea1238b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 4 client.15582 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.682+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea122e5800 con 0x55ea12389480 2024-03-28T05:46:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.683+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea12389480 0x55ea1238b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.683+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea12389480 0x55ea1238b8c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20c05eb0681013c4 server_cookie=e5e982a0735ba1dd in_seq=0 out_seq=0 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.683+0000 7f3caaa00640 10 client.15582 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.685+0000 7f3caaa00640 1 -- 172.21.15.55:0/1537648812 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ea122e5800 con 0x55ea12389480 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.685+0000 7f3caaa00640 10 client.15582 handle_command_reply: tid=0 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.685+0000 7f3cced64740 1 client.15582 shutdown 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.685+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 msgr2=0x55ea123852b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.685+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc011530 tx=0x7f3cbc011560 comp rx=0 tx=0).stop 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 shutdown_connections 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea123852b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea1237e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea12389480 0x55ea1238b8c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 --2- 172.21.15.55:0/1537648812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea1237dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 >> 172.21.15.55:0/1537648812 conn(0x55ea1236ede0 msgr2=0x55ea1236e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3caaa00640 0 client.15582 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:46:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 shutdown_connections 2024-03-28T05:46:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 1 -- 172.21.15.55:0/1537648812 wait complete. 2024-03-28T05:46:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.686+0000 7f3cced64740 20 client.15582 trim_cache size 0 max 16384 2024-03-28T05:46:28.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 Processor -- start 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 -- start start 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12372b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12375580 0x55ea12377c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40108c0 con 0x55ea12374bc0 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400e3c0 con 0x55ea123739f0 2024-03-28T05:46:28.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.700+0000 7f3cced64740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400c440 con 0x55ea12375580 2024-03-28T05:46:28.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39566/0 (socket says 172.21.15.55:39566) 2024-03-28T05:46:28.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 -- 172.21.15.55:0/935434362 learned_addr learned my addr 172.21.15.55:0/935434362 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc9600640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12372b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cca000640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12375580 0x55ea12377c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 -- 172.21.15.55:0/935434362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12375580 msgr2=0x55ea12377c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12375580 0x55ea12377c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 -- 172.21.15.55:0/935434362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 msgr2=0x55ea12372b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12372b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 -- 172.21.15.55:0/935434362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea1236a8b0 con 0x55ea12374bc0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc9600640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12372b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.701+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00b92a0 tx=0x7f3cb0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a8759ff8e63869 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.702+0000 7f3cb5c00640 1 -- 172.21.15.55:0/935434362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00bcf20 con 0x55ea12374bc0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.702+0000 7f3cb5c00640 1 -- 172.21.15.55:0/935434362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cb00bdcc0 con 0x55ea12374bc0 2024-03-28T05:46:28.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.702+0000 7f3cb5c00640 1 -- 172.21.15.55:0/935434362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00044e0 con 0x55ea12374bc0 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- 172.21.15.55:0/935434362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 msgr2=0x55ea12385270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00b92a0 tx=0x7f3cb0009260 comp rx=0 tx=0).stop 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- 172.21.15.55:0/935434362 shutdown_connections 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea12375580 0x55ea12377c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12374bc0 0x55ea12385270 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 --2- 172.21.15.55:0/935434362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea123739f0 0x55ea12372b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- 172.21.15.55:0/935434362 >> 172.21.15.55:0/935434362 conn(0x55ea1236ede0 msgr2=0x55ea1236e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- 172.21.15.55:0/935434362 shutdown_connections 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- 172.21.15.55:0/935434362 wait complete. 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 -- start start 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.703+0000 7f3cced64740 1 Processor -- start 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea12381870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea12384890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400ca40 con 0x55ea12375580 2024-03-28T05:46:28.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400dd60 con 0x55ea12374bc0 2024-03-28T05:46:28.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400d0a0 con 0x55ea123739f0 2024-03-28T05:46:28.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.704+0000 7f3cced64740 10 client.0 _ll_register_callbacks cb 0x7f3cbc0116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cca000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea12384890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea12381870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:41858/0 (socket says 172.21.15.55:41858) 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 -- 172.21.15.55:0/1435477195 learned_addr learned my addr 172.21.15.55:0/1435477195 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 -- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 msgr2=0x55ea12381870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea12381870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 -- 172.21.15.55:0/1435477195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 msgr2=0x55ea12384890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea12384890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc9600640 1 -- 172.21.15.55:0/1435477195 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea12384e80 con 0x55ea123739f0 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea12381870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.705+0000 7f3cca000640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea12384890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.706+0000 7f3cc9600640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80058c0 tx=0x7f3cb80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823e89f9a6b0dfc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.706+0000 7f3caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.706+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8012650 con 0x55ea123739f0 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.706+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3cb80127f0 con 0x55ea123739f0 2024-03-28T05:46:28.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.706+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cb00bdcc0 con 0x55ea123739f0 2024-03-28T05:46:28.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.707+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cb80129f0 con 0x55ea123739f0 2024-03-28T05:46:28.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.707+0000 7f3cced64740 10 client.25096 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.707+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ea123e5800 con 0x55ea123739f0 2024-03-28T05:46:28.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.707+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3cb00bdcc0 con 0x55ea123739f0 2024-03-28T05:46:28.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3cb801fb60 con 0x55ea123739f0 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 10 client.25096 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 10 client.25096 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 20 client.25096 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea123e6190 0x55ea123e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 4 client.25096 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ea122dfb50 con 0x55ea123e6190 2024-03-28T05:46:28.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.708+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea123e6190 0x55ea123e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.709+0000 7f3cc8c00640 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea123e6190 0x55ea123e85b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47b140c46d8015 server_cookie=591a53013a1724ee in_seq=0 out_seq=0 2024-03-28T05:46:28.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.709+0000 7f3caaa00640 10 client.25096 ms_handle_connect on v2:172.21.15.86:6836/2422548949 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.710+0000 7f3caaa00640 1 -- 172.21.15.55:0/1435477195 <== mds.1 v2:172.21.15.86:6836/2422548949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ea122dfb50 con 0x55ea123e6190 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.710+0000 7f3caaa00640 10 client.25096 handle_command_reply: tid=0 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 client.25096 shutdown 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 msgr2=0x55ea12381330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80058c0 tx=0x7f3cb80046c0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 shutdown_connections 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ea12375580 0x55ea12384890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ea12374bc0 0x55ea12381870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x55ea123e6190 0x55ea123e85b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 --2- 172.21.15.55:0/1435477195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ea123739f0 0x55ea12381330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 >> 172.21.15.55:0/1435477195 conn(0x55ea1236ede0 msgr2=0x55ea1237cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3caaa00640 0 client.25096 ms_handle_reset on v2:172.21.15.86:6836/2422548949 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 shutdown_connections 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 1 -- 172.21.15.55:0/1435477195 wait complete. 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.711+0000 7f3cced64740 20 client.25096 trim_cache size 0 max 16384 2024-03-28T05:46:28.713 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 msgr2=0x7f3cac0a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 0x7f3cac0a4bd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55ea1236fd50 tx=0x7f3cb800a2d0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 msgr2=0x7f3cc4073a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb00042f0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 shutdown_connections 2024-03-28T05:46:28.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3cac0a2710 0x7f3cac0a4bd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc4103150 0x7f3cc4073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3cc4102790 0x7f3cc4073a90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 --2- 172.21.15.55:0/1069539274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cc41015a0 0x7f3cc4075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.712+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 >> 172.21.15.55:0/1069539274 conn(0x7f3cc40fcb10 msgr2=0x7f3cc4105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.713+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 shutdown_connections 2024-03-28T05:46:28.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.713+0000 7f3ccaa00640 1 -- 172.21.15.55:0/1069539274 wait complete. 2024-03-28T05:46:28.734 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:46:28.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 -- 172.21.15.55:0/3731825446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088103150 msgr2=0x7fe0881099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 --2- 172.21.15.55:0/3731825446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088103150 0x7fe0881099e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe080009ca0 tx=0x7fe08002c100 comp rx=0 tx=0).stop 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 -- 172.21.15.55:0/3731825446 shutdown_connections 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 --2- 172.21.15.55:0/3731825446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088103150 0x7fe0881099e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 --2- 172.21.15.55:0/3731825446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088102790 0x7fe088102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 --2- 172.21.15.55:0/3731825446 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe0881019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 -- 172.21.15.55:0/3731825446 >> 172.21.15.55:0/3731825446 conn(0x7fe0880fcb10 msgr2=0x7fe0880fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 -- 172.21.15.55:0/3731825446 shutdown_connections 2024-03-28T05:46:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.921+0000 7fe087200640 1 -- 172.21.15.55:0/3731825446 wait complete. 2024-03-28T05:46:28.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.922+0000 7fe087200640 1 Processor -- start 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 -- start start 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe088197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088103150 0x7fe08819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08810d0b0 con 0x7fe088102790 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08810cf30 con 0x7fe088103150 2024-03-28T05:46:28.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe087200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08810d230 con 0x7fe0881015a0 2024-03-28T05:46:28.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.923+0000 7fe085400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33274/0 (socket says 172.21.15.55:33274) 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 -- 172.21.15.55:0/1026566516 learned_addr learned my addr 172.21.15.55:0/1026566516 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085e00640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe088197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe086800640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088103150 0x7fe08819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 -- 172.21.15.55:0/1026566516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 msgr2=0x7fe088197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe088197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 -- 172.21.15.55:0/1026566516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088103150 msgr2=0x7fe08819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088103150 0x7fe08819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085400640 1 -- 172.21.15.55:0/1026566516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08819f340 con 0x7fe088102790 2024-03-28T05:46:28.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.924+0000 7fe085e00640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe088197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.925+0000 7fe085400640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e9f0 tx=0x7fe07400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.925+0000 7fe07ea00640 1 -- 172.21.15.55:0/1026566516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07400cd80 con 0x7fe088102790 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.925+0000 7fe07ea00640 1 -- 172.21.15.55:0/1026566516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe0740108e0 con 0x7fe088102790 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.925+0000 7fe07ea00640 1 -- 172.21.15.55:0/1026566516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074018920 con 0x7fe088102790 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.925+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08819f630 con 0x7fe088102790 2024-03-28T05:46:28.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.926+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08819fb30 con 0x7fe088102790 2024-03-28T05:46:28.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 Processor -- start 2024-03-28T05:46:28.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 -- start start 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2dce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc2392c0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc1e1c90 con 0x560dcc2d6580 2024-03-28T05:46:28.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.929+0000 7fe08f833740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc235360 con 0x560dcc2d49f0 2024-03-28T05:46:28.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33290/0 (socket says 172.21.15.55:33290) 2024-03-28T05:46:28.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 -- 172.21.15.55:0/753288310 learned_addr learned my addr 172.21.15.55:0/753288310 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 -- 172.21.15.55:0/753288310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 msgr2=0x560dcc2d4e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T05:46:28.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2d4e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 -- 172.21.15.55:0/753288310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 msgr2=0x560dcc2dce10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2dce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.930+0000 7fe085e00640 1 -- 172.21.15.55:0/753288310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dcc206080 con 0x560dcc2d5bc0 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.931+0000 7fe085e00640 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe078010450 tx=0x7fe078010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5337debda522b73c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.931+0000 7fe07ea00640 1 -- 172.21.15.55:0/1026566516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fe074010a90 con 0x7fe088102790 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.931+0000 7fe073000640 1 -- 172.21.15.55:0/753288310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078005220 con 0x560dcc2d5bc0 2024-03-28T05:46:28.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.932+0000 7fe073000640 1 -- 172.21.15.55:0/753288310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe078004c50 con 0x560dcc2d5bc0 2024-03-28T05:46:28.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.932+0000 7fe073000640 1 -- 172.21.15.55:0/753288310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078011aa0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe07ea00640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 0x7fe06c0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 -- 172.21.15.55:0/753288310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 msgr2=0x560dcc2d6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe078010450 tx=0x7fe078010910 comp rx=0 tx=0).stop 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe07ea00640 1 -- 172.21.15.55:0/1026566516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe0740ceda0 con 0x7fe088102790 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe086800640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 0x7fe06c0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 -- 172.21.15.55:0/753288310 shutdown_connections 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2dce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d5bc0 0x560dcc2d6040 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 --2- 172.21.15.55:0/753288310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.933+0000 7fe08f833740 1 -- 172.21.15.55:0/753288310 >> 172.21.15.55:0/753288310 conn(0x560dcc2cfde0 msgr2=0x560dcc2d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.934+0000 7fe08f833740 1 -- 172.21.15.55:0/753288310 shutdown_connections 2024-03-28T05:46:28.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.934+0000 7fe08f833740 1 -- 172.21.15.55:0/753288310 wait complete. 2024-03-28T05:46:28.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.934+0000 7fe08f833740 1 -- start start 2024-03-28T05:46:28.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.935+0000 7fe086800640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 0x7fe06c0a4d40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe080006010 tx=0x7fe080005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.935+0000 7fe08f833740 1 Processor -- start 2024-03-28T05:46:28.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.935+0000 7fe08f833740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d49f0 0x560dcc2e3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.935+0000 7fe08f833740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe08f833740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe08f833740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc2e19f0 con 0x560dcc2d6580 2024-03-28T05:46:28.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe08f833740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc1f50d0 con 0x560dcc2d49f0 2024-03-28T05:46:28.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe08f833740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dcc2e1b70 con 0x560dcc2d5bc0 2024-03-28T05:46:28.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe08f833740 10 client.0 _ll_register_callbacks cb 0x560dcc1f9e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe085400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe085400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:48560/0 (socket says 172.21.15.55:48560) 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe085400640 1 -- 172.21.15.55:0/3446340948 learned_addr learned my addr 172.21.15.55:0/3446340948 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.936+0000 7fe085e00640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d49f0 0x560dcc2e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 -- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d49f0 msgr2=0x560dcc2e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d49f0 0x560dcc2e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 -- 172.21.15.55:0/3446340948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 msgr2=0x560dcc2ea5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe086800640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2ea5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 -- 172.21.15.55:0/3446340948 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dcbf4d3f0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe086800640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2ea5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe085400640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe07409b6d0 tx=0x7fe074010de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e350c3f20af0e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.937+0000 7fe067400640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.938+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07409f890 con 0x560dcc2d5bc0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.938+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe078004c50 con 0x560dcc2d5bc0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.938+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe074010430 con 0x560dcc2d5bc0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.938+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0740a3ee0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.939+0000 7fe08f833740 10 client.25105 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.939+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560dcc0177d0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.939+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe078004c50 con 0x560dcc2d5bc0 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe074018ac0 con 0x560dcc2d5bc0 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 10 client.25105 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 10 client.25105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 20 client.25105 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc2eeb10 0x560dcc2f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 4 client.25105 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dcc246800 con 0x560dcc2eeb10 2024-03-28T05:46:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.940+0000 7fe085e00640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc2eeb10 0x560dcc2f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.941+0000 7fe085e00640 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc2eeb10 0x560dcc2f0f00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=570faf9ab16673b5 server_cookie=31d4ba0442aec937 in_seq=0 out_seq=0 2024-03-28T05:46:28.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.941+0000 7fe067400640 10 client.25105 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:28.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.942+0000 7fe067400640 1 -- 172.21.15.55:0/3446340948 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560dcc246800 con 0x560dcc2eeb10 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.942+0000 7fe067400640 10 client.25105 handle_command_reply: tid=0 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.942+0000 7fe08f833740 1 client.25105 shutdown 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 msgr2=0x560dcc2e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe07409b6d0 tx=0x7fe074010de0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 shutdown_connections 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc2eeb10 0x560dcc2f0f00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2ea5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e3580 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 --2- 172.21.15.55:0/3446340948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d49f0 0x560dcc2e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 >> 172.21.15.55:0/3446340948 conn(0x560dcc2cfde0 msgr2=0x560dcc2cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe067400640 0 client.25105 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 shutdown_connections 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 1 -- 172.21.15.55:0/3446340948 wait complete. 2024-03-28T05:46:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.943+0000 7fe08f833740 20 client.25105 trim_cache size 0 max 16384 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 Processor -- start 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 -- start start 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a8ad0 con 0x560dcc2d49f0 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a65d0 con 0x560dcc2d6580 2024-03-28T05:46:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.963+0000 7fe08f833740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a4650 con 0x560dcc2d5bc0 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33310/0 (socket says 172.21.15.55:33310) 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 -- 172.21.15.55:0/778749897 learned_addr learned my addr 172.21.15.55:0/778749897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe086800640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 -- 172.21.15.55:0/778749897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 msgr2=0x560dcc2ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085400640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 -- 172.21.15.55:0/778749897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 msgr2=0x560dcc2ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085e00640 1 -- 172.21.15.55:0/778749897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dcc2f1270 con 0x560dcc2d49f0 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe085400640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:46:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.964+0000 7fe086800640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:46:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.965+0000 7fe085e00640 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b620 tx=0x7fe0780055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8afc959f719a8b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.965+0000 7fe072600640 1 -- 172.21.15.55:0/778749897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078004040 con 0x560dcc2d49f0 2024-03-28T05:46:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.965+0000 7fe072600640 1 -- 172.21.15.55:0/778749897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe07802b860 con 0x560dcc2d49f0 2024-03-28T05:46:28.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.965+0000 7fe072600640 1 -- 172.21.15.55:0/778749897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078003950 con 0x560dcc2d49f0 2024-03-28T05:46:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- 172.21.15.55:0/778749897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 msgr2=0x560dcc2d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b620 tx=0x7fe0780055f0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- 172.21.15.55:0/778749897 shutdown_connections 2024-03-28T05:46:28.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d6580 0x560dcc2ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d5bc0 0x560dcc2ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 --2- 172.21.15.55:0/778749897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d49f0 0x560dcc2d3040 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- 172.21.15.55:0/778749897 >> 172.21.15.55:0/778749897 conn(0x560dcc2cfde0 msgr2=0x560dcc2d9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- 172.21.15.55:0/778749897 shutdown_connections 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- 172.21.15.55:0/778749897 wait complete. 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.966+0000 7fe08f833740 1 -- start start 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 Processor -- start 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2e7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a4c50 con 0x560dcc2d6580 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a5f70 con 0x560dcc2d5bc0 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881a52b0 con 0x560dcc2d49f0 2024-03-28T05:46:28.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.967+0000 7fe08f833740 10 client.0 _ll_register_callbacks cb 0x7fe07400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe085e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe085400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe085e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:48574/0 (socket says 172.21.15.55:48574) 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe085400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:33792/0 (socket says 172.21.15.55:33792) 2024-03-28T05:46:28.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe085e00640 1 -- 172.21.15.55:0/67830514 learned_addr learned my addr 172.21.15.55:0/67830514 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:28.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 -- 172.21.15.55:0/67830514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 msgr2=0x560dcc2ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 -- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 msgr2=0x560dcc2e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.968+0000 7fe086800640 1 -- 172.21.15.55:0/67830514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dcc2e77a0 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe086800640 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2e7260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe080009bf0 tx=0x7fe08002c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b3535a57802a1a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe067400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080050020 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe080004450 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe07802b860 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe080046030 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe08f833740 10 client.15603 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.969+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560dcc34b2c0 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fe07802b860 con 0x560dcc2d6580 2024-03-28T05:46:28.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe080034440 con 0x560dcc2d6580 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 10 client.15603 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 20 client.15603 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc34bc70 0x560dcc34e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 4 client.15603 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.970+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560dcc240b50 con 0x560dcc34bc70 2024-03-28T05:46:28.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.971+0000 7fe085e00640 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc34bc70 0x560dcc34e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.971+0000 7fe067400640 10 client.15603 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.971+0000 7fe085e00640 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc34bc70 0x560dcc34e090 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69eb3a2c7cc54b41 server_cookie=a9a42fd80df624e in_seq=0 out_seq=0 2024-03-28T05:46:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe067400640 1 -- 172.21.15.55:0/67830514 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560dcc240b50 con 0x560dcc34bc70 2024-03-28T05:46:28.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe067400640 10 client.15603 handle_command_reply: tid=0 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 client.15603 shutdown 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 msgr2=0x560dcc2e7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2e7260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe080009bf0 tx=0x7fe08002c100 comp rx=0 tx=0).stop 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 shutdown_connections 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x560dcc34bc70 0x560dcc34e090 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560dcc2d6580 0x560dcc2e7260 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560dcc2d5bc0 0x560dcc2e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 --2- 172.21.15.55:0/67830514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x560dcc2d49f0 0x560dcc2ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 >> 172.21.15.55:0/67830514 conn(0x560dcc2cfde0 msgr2=0x560dcc2d8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe067400640 0 client.15603 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 shutdown_connections 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 1 -- 172.21.15.55:0/67830514 wait complete. 2024-03-28T05:46:28.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.972+0000 7fe08f833740 20 client.15603 trim_cache size 0 max 16384 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 msgr2=0x7fe06c0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 0x7fe06c0a4d40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe080006010 tx=0x7fe080005ef0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 msgr2=0x7fe088197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e9f0 tx=0x7fe07400eeb0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 shutdown_connections 2024-03-28T05:46:28.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fe06c0a2880 0x7fe06c0a4d40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe088103150 0x7fe08819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe088102790 0x7fe088197c60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 --2- 172.21.15.55:0/1026566516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0881015a0 0x7fe088197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.973+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 >> 172.21.15.55:0/1026566516 conn(0x7fe0880fcb10 msgr2=0x7fe088105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.974+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 shutdown_connections 2024-03-28T05:46:28.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:28.974+0000 7fe087200640 1 -- 172.21.15.55:0/1026566516 wait complete. 2024-03-28T05:46:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:29 smithi086 ceph-mon[35163]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:29 smithi159 ceph-mon[36109]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:29 smithi055 ceph-mon[31863]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:29.993 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-28T05:46:29.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T05:46:29.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 -- 172.21.15.55:0/2630560391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70075660 msgr2=0x7f7a70073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 --2- 172.21.15.55:0/2630560391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70075660 0x7f7a70073ab0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009900 tx=0x7f7a6402bcd0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 -- 172.21.15.55:0/2630560391 shutdown_connections 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 --2- 172.21.15.55:0/2630560391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 0x7f7a7010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 --2- 172.21.15.55:0/2630560391 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70074080 0x7f7a700744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 --2- 172.21.15.55:0/2630560391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70075660 0x7f7a70073ab0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 -- 172.21.15.55:0/2630560391 >> 172.21.15.55:0/2630560391 conn(0x7f7a700fcb10 msgr2=0x7f7a700fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 -- 172.21.15.55:0/2630560391 shutdown_connections 2024-03-28T05:46:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.210+0000 7f7a77200640 1 -- 172.21.15.55:0/2630560391 wait complete. 2024-03-28T05:46:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 Processor -- start 2024-03-28T05:46:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 -- start start 2024-03-28T05:46:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70075660 0x7f7a70199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 0x7f7a701a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7010f320 con 0x7f7a70074080 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7010f1a0 con 0x7f7a70109450 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.212+0000 7f7a77200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7010f4a0 con 0x7f7a70075660 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33348/0 (socket says 172.21.15.55:33348) 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 -- 172.21.15.55:0/3185553721 learned_addr learned my addr 172.21.15.55:0/3185553721 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a76800640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 0x7f7a701a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75400640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70075660 0x7f7a70199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 -- 172.21.15.55:0/3185553721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70075660 msgr2=0x7f7a70199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70075660 0x7f7a70199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 -- 172.21.15.55:0/3185553721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 msgr2=0x7f7a701a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 0x7f7a701a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.213+0000 7f7a75e00640 1 -- 172.21.15.55:0/3185553721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a701a15e0 con 0x7f7a70074080 2024-03-28T05:46:30.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000c00 tx=0x7f7a6402dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a6aa00640 1 -- 172.21.15.55:0/3185553721 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64043020 con 0x7f7a70074080 2024-03-28T05:46:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a6aa00640 1 -- 172.21.15.55:0/3185553721 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a6402de30 con 0x7f7a70074080 2024-03-28T05:46:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a6aa00640 1 -- 172.21.15.55:0/3185553721 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64003c40 con 0x7f7a70074080 2024-03-28T05:46:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a701a1870 con 0x7f7a70074080 2024-03-28T05:46:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.214+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a701a1d70 con 0x7f7a70074080 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.218+0000 7f7a7b5fd740 1 Processor -- start 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 -- start start 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 0x5622be7bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 0x5622be7c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be724eb0 con 0x5622be7bfca0 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be6cda60 con 0x5622be7bf2b0 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be720f50 con 0x5622be7c4e10 2024-03-28T05:46:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.219+0000 7f7a6aa00640 1 -- 172.21.15.55:0/3185553721 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f7a64046020 con 0x7f7a70074080 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a76800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 0x5622be7bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a76800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 0x5622be7bf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:33810/0 (socket says 172.21.15.55:33810) 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a76800640 1 -- 172.21.15.55:0/3879188914 learned_addr learned my addr 172.21.15.55:0/3879188914 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75400640 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 0x5622be7c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 -- 172.21.15.55:0/3879188914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 msgr2=0x5622be7c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 -- 172.21.15.55:0/3879188914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 msgr2=0x5622be7bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 0x5622be7bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.220+0000 7f7a75e00640 1 -- 172.21.15.55:0/3879188914 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622be5017e0 con 0x5622be7bfca0 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.221+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 0x5622be7c47a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ee830 tx=0x7f7a640f4e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9b5457df1341c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.221+0000 7f7a6aa00640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 0x7f7a580a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.221+0000 7f7a5f000640 1 -- 172.21.15.55:0/3879188914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64100070 con 0x5622be7bfca0 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.221+0000 7f7a6aa00640 1 -- 172.21.15.55:0/3185553721 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7a640f0dd0 con 0x7f7a70074080 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.222+0000 7f7a5f000640 1 -- 172.21.15.55:0/3879188914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a640035f0 con 0x5622be7bfca0 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.222+0000 7f7a5f000640 1 -- 172.21.15.55:0/3879188914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640b9af0 con 0x5622be7bfca0 2024-03-28T05:46:30.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.222+0000 7f7a76800640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 0x7f7a580a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3879188914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 msgr2=0x5622be7c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a76800640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 0x7f7a580a4d40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5622be7c0500 tx=0x7f7a6c0097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 0x5622be7c47a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ee830 tx=0x7f7a640f4e00 comp rx=0 tx=0).stop 2024-03-28T05:46:30.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3879188914 shutdown_connections 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bfca0 0x5622be7c47a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3879188914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bf2b0 0x5622be7bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3879188914 >> 172.21.15.55:0/3879188914 conn(0x5622be7ba820 msgr2=0x5622be7bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3879188914 shutdown_connections 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.223+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3879188914 wait complete. 2024-03-28T05:46:30.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.224+0000 7f7a7b5fd740 1 -- start start 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.224+0000 7f7a7b5fd740 1 Processor -- start 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be7c7b80 con 0x5622be7bf2b0 2024-03-28T05:46:30.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be6e0eb0 con 0x5622be7bfca0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622be7c7d00 con 0x5622be7c4e10 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a7b5fd740 10 client.0 _ll_register_callbacks cb 0x5622be6d5150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33368/0 (socket says 172.21.15.55:33368) 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a75e00640 1 -- 172.21.15.55:0/3971889098 learned_addr learned my addr 172.21.15.55:0/3971889098 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.225+0000 7f7a75400640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 -- 172.21.15.55:0/3971889098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 msgr2=0x5622be7d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 -- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 msgr2=0x5622be7c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 -- 172.21.15.55:0/3971889098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622be561f70 con 0x5622be7bf2b0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402c2b0 tx=0x7f7a64009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a32a7e0010faa server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.226+0000 7f7a53400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64100040 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7a640bbb50 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622be7323f0 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a640bd1b0 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a7b5fd740 10 client.15615 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5622be3f9170 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x5622be7323f0 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.227+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7a640bdab0 con 0x5622be7bf2b0 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 10 client.15615 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 20 client.15615 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:30.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be7d4c10 0x5622be7d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 4 client.15615 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:30.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622be72c740 con 0x5622be7d4c10 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.228+0000 7f7a75400640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be7d4c10 0x5622be7d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.229+0000 7f7a75400640 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be7d4c10 0x5622be7d7020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b50ba0a74894edd1 server_cookie=4d5a5a6718622cb7 in_seq=0 out_seq=0 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.229+0000 7f7a53400640 10 client.15615 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.231+0000 7f7a53400640 1 -- 172.21.15.55:0/3971889098 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5622be72c740 con 0x5622be7d4c10 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.231+0000 7f7a53400640 10 client.15615 handle_command_reply: tid=0 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.231+0000 7f7a7b5fd740 1 client.15615 shutdown 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.231+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 msgr2=0x5622be7c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.231+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a6402c2b0 tx=0x7f7a64009260 comp rx=0 tx=0).stop 2024-03-28T05:46:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 shutdown_connections 2024-03-28T05:46:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be7d4c10 0x5622be7d7020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3971889098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7c9150 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 >> 172.21.15.55:0/3971889098 conn(0x5622be7ba820 msgr2=0x5622be7b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a53400640 0 client.15615 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 shutdown_connections 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3971889098 wait complete. 2024-03-28T05:46:30.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.232+0000 7f7a7b5fd740 20 client.15615 trim_cache size 0 max 16384 2024-03-28T05:46:30.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.265+0000 7f7a7b5fd740 1 Processor -- start 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 -- start start 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7bf2b0 0x5622be7be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701ad010 con 0x5622be7c4e10 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701aab10 con 0x5622be7bfca0 2024-03-28T05:46:30.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a8b90 con 0x5622be7bf2b0 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a76800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a76800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33372/0 (socket says 172.21.15.55:33372) 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.266+0000 7f7a76800640 1 -- 172.21.15.55:0/2899991859 learned_addr learned my addr 172.21.15.55:0/2899991859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a75e00640 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7bf2b0 0x5622be7be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a75400640 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 -- 172.21.15.55:0/2899991859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7bf2b0 msgr2=0x5622be7be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7bf2b0 0x5622be7be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 -- 172.21.15.55:0/2899991859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 msgr2=0x5622be7d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 -- 172.21.15.55:0/2899991859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622be7d76a0 con 0x5622be7c4e10 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.267+0000 7f7a76800640 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bb0 tx=0x7f7a6c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774aef81d43a8430 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.268+0000 7f7a5e600640 1 -- 172.21.15.55:0/2899991859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c010ea0 con 0x5622be7c4e10 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.268+0000 7f7a5e600640 1 -- 172.21.15.55:0/2899991859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a6c01d8c0 con 0x5622be7c4e10 2024-03-28T05:46:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.268+0000 7f7a5e600640 1 -- 172.21.15.55:0/2899991859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c01eaa0 con 0x5622be7c4e10 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.268+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/2899991859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 msgr2=0x5622be7db920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.268+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bb0 tx=0x7f7a6c014040 comp rx=0 tx=0).stop 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/2899991859 shutdown_connections 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7c4e10 0x5622be7db920 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/2899991859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7bf2b0 0x5622be7be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/2899991859 >> 172.21.15.55:0/2899991859 conn(0x5622be7ba820 msgr2=0x5622be7bda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/2899991859 shutdown_connections 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/2899991859 wait complete. 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 -- start start 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.269+0000 7f7a7b5fd740 1 Processor -- start 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a9190 con 0x5622be7bf2b0 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701aa4b0 con 0x5622be7bfca0 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701a97f0 con 0x5622be7c4e10 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a7b5fd740 10 client.0 _ll_register_callbacks cb 0x7f7a6c009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a75400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a75400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.55:33834/0 (socket says 172.21.15.55:33834) 2024-03-28T05:46:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.270+0000 7f7a75400640 1 -- 172.21.15.55:0/3063632714 learned_addr learned my addr 172.21.15.55:0/3063632714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a76800640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 -- 172.21.15.55:0/3063632714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 msgr2=0x5622be7cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 -- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 msgr2=0x5622be7cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 -- 172.21.15.55:0/3063632714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622be8304f0 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a75e00640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7ced10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7a640b9cb0 tx=0x7f7a640c6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3671b80bee0f9c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a53400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.271+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64100070 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7a640c5b60 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a6c01d8c0 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a640bd390 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 10 client.15621 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5622be8304f0 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f7a6c01d8c0 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7a640beb80 con 0x5622be7bf2b0 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 10 client.15621 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:30.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 20 client.15621 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be831cd0 0x5622be8340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 4 client.15621 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.272+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5622be6aaa40 con 0x5622be831cd0 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.273+0000 7f7a75400640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be831cd0 0x5622be8340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.274+0000 7f7a75400640 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be831cd0 0x5622be8340f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c590ce19b555fb03 server_cookie=39d203d4aeabd92e in_seq=0 out_seq=0 2024-03-28T05:46:30.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.274+0000 7f7a53400640 10 client.15621 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.276+0000 7f7a53400640 1 -- 172.21.15.55:0/3063632714 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5622be6aaa40 con 0x5622be831cd0 2024-03-28T05:46:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.276+0000 7f7a53400640 10 client.15621 handle_command_reply: tid=0 2024-03-28T05:46:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.276+0000 7f7a7b5fd740 1 client.15621 shutdown 2024-03-28T05:46:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.276+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 msgr2=0x5622be7ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.276+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7ced10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7a640b9cb0 tx=0x7f7a640c6040 comp rx=0 tx=0).stop 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 shutdown_connections 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x5622be831cd0 0x5622be8340f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5622be7c4e10 0x5622be7cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622be7bfca0 0x5622be7cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 --2- 172.21.15.55:0/3063632714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5622be7bf2b0 0x5622be7ced10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 >> 172.21.15.55:0/3063632714 conn(0x5622be7ba820 msgr2=0x5622be7be310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a53400640 0 client.15621 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 shutdown_connections 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 1 -- 172.21.15.55:0/3063632714 wait complete. 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.277+0000 7f7a7b5fd740 20 client.15621 trim_cache size 0 max 16384 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "8b6a074d-358e-44dd-ab55-e334a1aa29b1", 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-03-28T05:46:30.279 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 msgr2=0x7f7a580a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 0x7f7a580a4d40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5622be7c0500 tx=0x7f7a6c0097e0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 msgr2=0x7f7a701999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000c00 tx=0x7f7a6402dc40 comp rx=0 tx=0).stop 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 shutdown_connections 2024-03-28T05:46:30.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f7a580a2880 0x7f7a580a4d40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a70109450 0x7f7a701a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a70075660 0x7f7a70199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 --2- 172.21.15.55:0/3185553721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a70074080 0x7f7a701999c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 >> 172.21.15.55:0/3185553721 conn(0x7f7a700fcb10 msgr2=0x7f7a701053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.278+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 shutdown_connections 2024-03-28T05:46:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.279+0000 7f7a77200640 1 -- 172.21.15.55:0/3185553721 wait complete. 2024-03-28T05:46:30.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:46:30.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:46:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 -- 172.21.15.55:0/355855863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0074080 msgr2=0x7f3fd00744e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 --2- 172.21.15.55:0/355855863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0074080 0x7f3fd00744e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009900 tx=0x7f3fbc02bcd0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 -- 172.21.15.55:0/355855863 shutdown_connections 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 --2- 172.21.15.55:0/355855863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0109450 0x7f3fd010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 --2- 172.21.15.55:0/355855863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0074080 0x7f3fd00744e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 --2- 172.21.15.55:0/355855863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0075660 0x7f3fd0073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 -- 172.21.15.55:0/355855863 >> 172.21.15.55:0/355855863 conn(0x7f3fd00fcb10 msgr2=0x7f3fd00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.506+0000 7f3fd6000640 1 -- 172.21.15.55:0/355855863 shutdown_connections 2024-03-28T05:46:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.507+0000 7f3fd6000640 1 -- 172.21.15.55:0/355855863 wait complete. 2024-03-28T05:46:30.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.508+0000 7f3fd6000640 1 Processor -- start 2024-03-28T05:46:30.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.508+0000 7f3fd6000640 1 -- start start 2024-03-28T05:46:30.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.508+0000 7f3fd6000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0074080 0x7f3fd0199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.508+0000 7f3fd6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0075660 0x7f3fd0199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd6000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd010f2d0 con 0x7f3fd0109450 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd6000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd010f150 con 0x7f3fd0075660 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd6000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd010f450 con 0x7f3fd0074080 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33398/0 (socket says 172.21.15.55:33398) 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 -- 172.21.15.55:0/561569739 learned_addr learned my addr 172.21.15.55:0/561569739 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0075660 0x7f3fd0199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0074080 0x7f3fd0199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 -- 172.21.15.55:0/561569739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0074080 msgr2=0x7f3fd0199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0074080 0x7f3fd0199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 -- 172.21.15.55:0/561569739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0075660 msgr2=0x7f3fd0199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0075660 0x7f3fd0199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.509+0000 7f3fd5600640 1 -- 172.21.15.55:0/561569739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd01a15b0 con 0x7f3fd0109450 2024-03-28T05:46:30.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fd5600640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800eaa0 tx=0x7f3fc800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fcd600640 1 -- 172.21.15.55:0/561569739 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800cdb0 con 0x7f3fd0109450 2024-03-28T05:46:30.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fcd600640 1 -- 172.21.15.55:0/561569739 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc8005020 con 0x7f3fd0109450 2024-03-28T05:46:30.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fcd600640 1 -- 172.21.15.55:0/561569739 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80116d0 con 0x7f3fd0109450 2024-03-28T05:46:30.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd01a18a0 con 0x7f3fd0109450 2024-03-28T05:46:30.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.510+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd01a1d70 con 0x7f3fd0109450 2024-03-28T05:46:30.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.514+0000 7f3fda3c8740 1 Processor -- start 2024-03-28T05:46:30.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.516+0000 7f3fcd600640 1 -- 172.21.15.55:0/561569739 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3fc80051d0 con 0x7f3fd0109450 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.516+0000 7f3fda3c8740 1 -- start start 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.516+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d740c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.516+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.516+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d7463c0 0x55911d748850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d69d250 con 0x55911d741250 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d645a30 con 0x55911d7463c0 2024-03-28T05:46:30.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d6992f0 con 0x55911d740860 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33400/0 (socket says 172.21.15.55:33400) 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fd4c00640 1 -- 172.21.15.55:0/1701246825 learned_addr learned my addr 172.21.15.55:0/1701246825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d7463c0 0x55911d748850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.517+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d740c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 -- 172.21.15.55:0/1701246825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 msgr2=0x55911d740c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d740c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 -- 172.21.15.55:0/1701246825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d7463c0 msgr2=0x55911d748850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d7463c0 0x55911d748850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 -- 172.21.15.55:0/1701246825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55911d630690 con 0x55911d741250 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fcd600640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 0x7f3fb80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fcd600640 1 -- 172.21.15.55:0/561569739 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3fc80ceb70 con 0x7f3fd0109450 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 0x7f3fb80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.518+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400bcf0 tx=0x7f3fc400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5c69d812e27aee server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.519+0000 7f3fc1c00640 1 -- 172.21.15.55:0/1701246825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4015070 con 0x55911d741250 2024-03-28T05:46:30.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.519+0000 7f3fc1c00640 1 -- 172.21.15.55:0/1701246825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc401a910 con 0x55911d741250 2024-03-28T05:46:30.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.519+0000 7f3fc1c00640 1 -- 172.21.15.55:0/1701246825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40118e0 con 0x55911d741250 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 -- 172.21.15.55:0/1701246825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 msgr2=0x55911d745d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400bcf0 tx=0x7f3fc400f730 comp rx=0 tx=0).stop 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 0x7f3fb80a4d40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009230 tx=0x7f3fbc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 -- 172.21.15.55:0/1701246825 shutdown_connections 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d7463c0 0x55911d748850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d745d50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/1701246825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d740c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 -- 172.21.15.55:0/1701246825 >> 172.21.15.55:0/1701246825 conn(0x55911d700200 msgr2=0x55911d7339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.520+0000 7f3fda3c8740 1 -- 172.21.15.55:0/1701246825 shutdown_connections 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.521+0000 7f3fda3c8740 1 -- 172.21.15.55:0/1701246825 wait complete. 2024-03-28T05:46:30.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.521+0000 7f3fda3c8740 1 -- start start 2024-03-28T05:46:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.521+0000 7f3fda3c8740 1 Processor -- start 2024-03-28T05:46:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d74ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 0x55911d751de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d749370 con 0x55911d7463c0 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d658e80 con 0x55911d741250 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55911d7494f0 con 0x55911d740860 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.522+0000 7f3fda3c8740 10 client.0 _ll_register_callbacks cb 0x55911d66b130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fcfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d74ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.55:48680/0 (socket says 172.21.15.55:48680) 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 -- 172.21.15.55:0/2250917314 learned_addr learned my addr 172.21.15.55:0/2250917314 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd5600640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 0x55911d751de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 -- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 msgr2=0x55911d74ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d74ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.523+0000 7f3fd4c00640 1 -- 172.21.15.55:0/2250917314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 msgr2=0x55911d751de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.524+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 0x55911d751de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.524+0000 7f3fd4c00640 1 -- 172.21.15.55:0/2250917314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55911d47b7d0 con 0x55911d740860 2024-03-28T05:46:30.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.524+0000 7f3fd5600640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 0x55911d751de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T05:46:30.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.524+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4006010 tx=0x7f3fc400ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee004c24f310b7f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.524+0000 7f3fb6000640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-03-28T05:46:30.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4015050 con 0x55911d740860 2024-03-28T05:46:30.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fc401a910 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3fc401aac0 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc401acc0 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fda3c8740 10 client.25132 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.525+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55911d3b13f0 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.526+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc401a910 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.526+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3fc402c030 con 0x55911d740860 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.526+0000 7f3fda3c8740 10 client.25132 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.526+0000 7f3fda3c8740 10 client.25132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.526+0000 7f3fda3c8740 20 client.25132 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.527+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7562d0 0x55911d7586c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.527+0000 7f3fda3c8740 4 client.25132 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:46:30.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.527+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55911d6aa790 con 0x55911d7562d0 2024-03-28T05:46:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.527+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7562d0 0x55911d7586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.528+0000 7f3fb6000640 10 client.25132 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.528+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7562d0 0x55911d7586c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2dd8ac2f235529 server_cookie=8743839825dd283a in_seq=0 out_seq=0 2024-03-28T05:46:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.529+0000 7f3fb6000640 1 -- 172.21.15.55:0/2250917314 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55911d6aa790 con 0x55911d7562d0 2024-03-28T05:46:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.529+0000 7f3fb6000640 10 client.25132 handle_command_reply: tid=0 2024-03-28T05:46:30.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.529+0000 7f3fda3c8740 1 client.25132 shutdown 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 msgr2=0x55911d74a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4006010 tx=0x7f3fc400ba30 comp rx=0 tx=0).stop 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 shutdown_connections 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7562d0 0x55911d7586c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d7463c0 0x55911d751de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fb6000640 0 client.25132 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d74ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/2250917314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d740860 0x55911d74a860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 >> 172.21.15.55:0/2250917314 conn(0x55911d700200 msgr2=0x55911d732bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 shutdown_connections 2024-03-28T05:46:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 1 -- 172.21.15.55:0/2250917314 wait complete. 2024-03-28T05:46:30.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.530+0000 7f3fda3c8740 20 client.25132 trim_cache size 0 max 16384 2024-03-28T05:46:30.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.563+0000 7f3fda3c8740 1 Processor -- start 2024-03-28T05:46:30.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 -- start start 2024-03-28T05:46:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d751d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d75cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a8bd0 con 0x55911d740860 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a66d0 con 0x55911d741250 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a4770 con 0x55911d7463c0 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fd4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33418/0 (socket says 172.21.15.55:33418) 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fd4c00640 1 -- 172.21.15.55:0/26914017 learned_addr learned my addr 172.21.15.55:0/26914017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.564+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d751d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd5600640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d75cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 -- 172.21.15.55:0/26914017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 msgr2=0x55911d75cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d75cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 -- 172.21.15.55:0/26914017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 msgr2=0x55911d751d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d751d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 -- 172.21.15.55:0/26914017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55911d3710f0 con 0x55911d740860 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd5600640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d75cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400b4e0 tx=0x7f3fc400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43381a6b23f596e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.565+0000 7f3fc1200640 1 -- 172.21.15.55:0/26914017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4015070 con 0x55911d740860 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.566+0000 7f3fc1200640 1 -- 172.21.15.55:0/26914017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc402f8a0 con 0x55911d740860 2024-03-28T05:46:30.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.566+0000 7f3fc1200640 1 -- 172.21.15.55:0/26914017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc401ae60 con 0x55911d740860 2024-03-28T05:46:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.566+0000 7f3fda3c8740 1 -- 172.21.15.55:0/26914017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 msgr2=0x55911d7376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.566+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400b4e0 tx=0x7f3fc400f730 comp rx=0 tx=0).stop 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 -- 172.21.15.55:0/26914017 shutdown_connections 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d75cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d741250 0x55911d751d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/26914017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d740860 0x55911d7376d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 -- 172.21.15.55:0/26914017 >> 172.21.15.55:0/26914017 conn(0x55911d700200 msgr2=0x55911d732bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 -- 172.21.15.55:0/26914017 shutdown_connections 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 -- 172.21.15.55:0/26914017 wait complete. 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.567+0000 7f3fda3c8740 1 -- start start 2024-03-28T05:46:30.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 Processor -- start 2024-03-28T05:46:30.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 0x55911d74ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d7afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a4d70 con 0x55911d741250 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a6070 con 0x55911d740860 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01a53b0 con 0x55911d7463c0 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.568+0000 7f3fda3c8740 10 client.0 _ll_register_callbacks cb 0x7f3fbc0095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33434/0 (socket says 172.21.15.55:33434) 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 -- 172.21.15.55:0/4098200021 learned_addr learned my addr 172.21.15.55:0/4098200021 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 0x55911d74ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fd5600640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d7afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 -- 172.21.15.55:0/4098200021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 msgr2=0x55911d7afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d7afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 -- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 msgr2=0x55911d74ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 0x55911d74ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fcfe00640 1 -- 172.21.15.55:0/4098200021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55911d7b0070 con 0x55911d741250 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.569+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 0x55911d74ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fcfe00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009900 tx=0x7f3fbc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519a9633b1c4c57 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fb6000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0542d0 con 0x55911d741250 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3fbc003bd0 con 0x55911d741250 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fc402f8a0 con 0x55911d741250 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fbc063050 con 0x55911d741250 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fda3c8740 10 client.15639 fetch_fsmap learned FSMap version 24 2024-03-28T05:46:30.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.570+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55911d7b1390 con 0x55911d741250 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3fc402f8a0 con 0x55911d741250 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f3fbc04e040 con 0x55911d741250 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 10 client.15639 fetch_fsmap finished waiting for FSMap version 24 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 20 client.15639 populate_metadata read hostname 'smithi055' 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7b1d70 0x55911d7b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 4 client.15639 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:46:30.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.571+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55911d6a4ae0 con 0x55911d7b1d70 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.572+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7b1d70 0x55911d7b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fd4c00640 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7b1d70 0x55911d7b4190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd139c37d09f3309 server_cookie=cf0444ac86638433 in_seq=0 out_seq=0 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fb6000640 10 client.15639 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fb6000640 1 -- 172.21.15.55:0/4098200021 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55911d6a4ae0 con 0x55911d7b1d70 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fb6000640 10 client.15639 handle_command_reply: tid=0 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 client.15639 shutdown 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 msgr2=0x55911d74f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009900 tx=0x7f3fbc005fd0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 shutdown_connections 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55911d7b1d70 0x55911d7b4190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55911d7463c0 0x55911d7afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55911d741250 0x55911d74f210 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 --2- 172.21.15.55:0/4098200021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55911d740860 0x55911d74ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.573+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 >> 172.21.15.55:0/4098200021 conn(0x55911d700200 msgr2=0x55911d741b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.574+0000 7f3fb6000640 0 client.15639 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.574+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 shutdown_connections 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.574+0000 7f3fda3c8740 1 -- 172.21.15.55:0/4098200021 wait complete. 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.574+0000 7f3fda3c8740 20 client.15639 trim_cache size 0 max 16384 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:46:30.577 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: "8b6a074d-358e-44dd-ab55-e334a1aa29b1": { 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "8b6a074d-358e-44dd-ab55-e334a1aa29b1", 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,force" 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T05:46:30.578 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.575+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 msgr2=0x7f3fb80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.575+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 0x7f3fb80a4d40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009230 tx=0x7f3fbc009260 comp rx=0 tx=0).stop 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.575+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 msgr2=0x7f3fd01a0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.575+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800eaa0 tx=0x7f3fc800ef60 comp rx=0 tx=0).stop 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 shutdown_connections 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3fb80a2880 0x7f3fb80a4d40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd0109450 0x7f3fd01a0f40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fd0075660 0x7f3fd0199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 --2- 172.21.15.55:0/561569739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fd0074080 0x7f3fd0199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:46:30.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 >> 172.21.15.55:0/561569739 conn(0x7f3fd00fcb10 msgr2=0x7f3fd01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:46:30.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 shutdown_connections 2024-03-28T05:46:30.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:46:30.576+0000 7f3fd6000640 1 -- 172.21.15.55:0/561569739 wait complete. 2024-03-28T05:46:30.600 INFO:tasks.cephfs.filesystem:scrub status for tag:8b6a074d-358e-44dd-ab55-e334a1aa29b1 - {'path': '/', 'tag': '8b6a074d-358e-44dd-ab55-e334a1aa29b1', 'options': 'recursive,force'} 2024-03-28T05:46:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:31 smithi086 ceph-mon[35163]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:31 smithi086 ceph-mon[35163]: scrub queued for path: / 2024-03-28T05:46:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:31 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:31 smithi086 ceph-mon[35163]: scrub summary: active paths [/] 2024-03-28T05:46:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:31 smithi086 ceph-mon[35163]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:31 smithi159 ceph-mon[36109]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:31 smithi159 ceph-mon[36109]: scrub queued for path: / 2024-03-28T05:46:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:31 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:31 smithi159 ceph-mon[36109]: scrub summary: active paths [/] 2024-03-28T05:46:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:31 smithi159 ceph-mon[36109]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:31 smithi055 ceph-mon[31863]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:46:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:31 smithi055 ceph-mon[31863]: scrub queued for path: / 2024-03-28T05:46:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:31 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:31 smithi055 ceph-mon[31863]: scrub summary: active paths [/] 2024-03-28T05:46:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:31 smithi055 ceph-mon[31863]: scrub summary: idle+waiting paths [/] 2024-03-28T05:46:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:33 smithi086 ceph-mon[35163]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:33 smithi086 ceph-mon[35163]: scrub summary: idle 2024-03-28T05:46:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:33 smithi159 ceph-mon[36109]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:33 smithi159 ceph-mon[36109]: scrub summary: idle 2024-03-28T05:46:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:33 smithi055 ceph-mon[31863]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:33 smithi055 ceph-mon[31863]: scrub summary: idle 2024-03-28T05:46:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:35 smithi086 ceph-mon[35163]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:35 smithi159 ceph-mon[36109]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:35 smithi055 ceph-mon[31863]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:37 smithi086 ceph-mon[35163]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:37 smithi159 ceph-mon[36109]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:37 smithi055 ceph-mon[31863]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:39 smithi086 ceph-mon[35163]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:39 smithi159 ceph-mon[36109]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:39 smithi055 ceph-mon[31863]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:41 smithi086 ceph-mon[35163]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:41 smithi159 ceph-mon[36109]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:41 smithi055 ceph-mon[31863]: pgmap v483: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-03-28T05:46:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:43 smithi086 ceph-mon[35163]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:43 smithi159 ceph-mon[36109]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:43 smithi055 ceph-mon[31863]: pgmap v484: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:46:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:45 smithi086 ceph-mon[35163]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:45 smithi159 ceph-mon[36109]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:45 smithi055 ceph-mon[31863]: pgmap v485: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-28T05:46:47.015 INFO:tasks.workunit.client.0.smithi055.stderr:Updating files: 59% (7298/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 98% (12059/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-28T05:46:47.347 INFO:tasks.workunit.client.0.smithi055.stderr:Note: switching to '3be9a5c9bc793e11e2800a8c0c696e8b46742033'. 2024-03-28T05:46:47.347 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:state without impacting any branches by switching back to a branch. 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: git switch -c 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:Or undo this operation with: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: git switch - 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr: 2024-03-28T05:46:47.348 INFO:tasks.workunit.client.0.smithi055.stderr:HEAD is now at 3be9a5c9bc7 dummy commit #1 2024-03-28T05:46:47.357 DEBUG:teuthology.orchestra.run.smithi055:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-28T05:46:47.419 INFO:tasks.workunit.client.0.smithi055.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-28T05:46:47.427 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-28T05:46:47.427 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-28T05:46:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:47 smithi086 ceph-mon[35163]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:47 smithi159 ceph-mon[36109]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:47 smithi055 ceph-mon[31863]: pgmap v486: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:46:48.433 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-28T05:46:48.574 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-28T05:46:48.669 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-28T05:46:48.675 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-28T05:46:48.676 INFO:tasks.workunit.client.0.smithi055.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-28T05:46:48.762 INFO:tasks.workunit.client.0.smithi055.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-28T05:46:48.773 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T05:46:48.773 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-28T05:46:48.824 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-03-28T05:46:48.825 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-03-28T05:46:48.825 DEBUG:teuthology.orchestra.run.smithi055:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-03-28T05:46:48.977 INFO:tasks.workunit.client.0.smithi055.stderr:+ dbench 1 2024-03-28T05:46:48.991 INFO:tasks.workunit.client.0.smithi055.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-03-28T05:46:48.991 INFO:tasks.workunit.client.0.smithi055.stdout: 2024-03-28T05:46:48.991 INFO:tasks.workunit.client.0.smithi055.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-03-28T05:46:49.003 INFO:tasks.workunit.client.0.smithi055.stdout:0 of 1 processes prepared for launch 0 sec 2024-03-28T05:46:49.103 INFO:tasks.workunit.client.0.smithi055.stdout:1 of 1 processes prepared for launch 0 sec 2024-03-28T05:46:49.103 INFO:tasks.workunit.client.0.smithi055.stdout:releasing clients 2024-03-28T05:46:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:49 smithi086 ceph-mon[35163]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:49 smithi159 ceph-mon[36109]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:49 smithi055 ceph-mon[31863]: pgmap v487: 97 pgs: 97 active+clean; 661 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:46:50.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 265 9.92 MB/sec warmup 1 sec latency 31.732 ms 2024-03-28T05:46:51.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 501 8.73 MB/sec warmup 2 sec latency 32.711 ms 2024-03-28T05:46:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:51 smithi086 ceph-mon[35163]: pgmap v488: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 42 KiB/s wr, 5 op/s 2024-03-28T05:46:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:51 smithi159 ceph-mon[36109]: pgmap v488: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 42 KiB/s wr, 5 op/s 2024-03-28T05:46:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:51 smithi055 ceph-mon[31863]: pgmap v488: 97 pgs: 97 active+clean; 1.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 42 KiB/s wr, 5 op/s 2024-03-28T05:46:52.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 736 7.10 MB/sec warmup 3 sec latency 49.920 ms 2024-03-28T05:46:53.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 873 5.41 MB/sec warmup 4 sec latency 45.554 ms 2024-03-28T05:46:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:53 smithi086 ceph-mon[35163]: pgmap v489: 97 pgs: 97 active+clean; 6.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 488 KiB/s wr, 7 op/s 2024-03-28T05:46:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:53 smithi159 ceph-mon[36109]: pgmap v489: 97 pgs: 97 active+clean; 6.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 488 KiB/s wr, 7 op/s 2024-03-28T05:46:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:53 smithi055 ceph-mon[31863]: pgmap v489: 97 pgs: 97 active+clean; 6.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 488 KiB/s wr, 7 op/s 2024-03-28T05:46:54.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 977 4.38 MB/sec warmup 5 sec latency 74.953 ms 2024-03-28T05:46:55.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1136 3.83 MB/sec warmup 6 sec latency 49.411 ms 2024-03-28T05:46:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:55 smithi086 ceph-mon[35163]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-03-28T05:46:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:55 smithi159 ceph-mon[36109]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-03-28T05:46:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:55 smithi055 ceph-mon[31863]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 18 op/s 2024-03-28T05:46:56.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1278 3.31 MB/sec warmup 7 sec latency 45.449 ms 2024-03-28T05:46:57.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1449 3.25 MB/sec warmup 8 sec latency 83.102 ms 2024-03-28T05:46:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:57 smithi086 ceph-mon[35163]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-03-28T05:46:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:57 smithi159 ceph-mon[36109]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-03-28T05:46:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:57 smithi055 ceph-mon[31863]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-03-28T05:46:58.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1536 2.90 MB/sec warmup 9 sec latency 43.169 ms 2024-03-28T05:46:59.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1558 2.61 MB/sec warmup 10 sec latency 812.240 ms 2024-03-28T05:46:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:59 smithi086 ceph-mon[35163]: pgmap v492: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-03-28T05:46:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:46:59 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:46:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:59 smithi159 ceph-mon[36109]: pgmap v492: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-03-28T05:46:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:46:59 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:46:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:59 smithi055 ceph-mon[31863]: pgmap v492: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 1.8 MiB/s wr, 27 op/s 2024-03-28T05:46:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:46:59 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:00.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1558 2.37 MB/sec warmup 11 sec latency 1812.339 ms 2024-03-28T05:47:00.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-28T05:47:00.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-28T05:47:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 -- 172.21.15.55:0/3123995100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 msgr2=0x7f36e0077700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 --2- 172.21.15.55:0/3123995100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e0077700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009900 tx=0x7f36d002bc30 comp rx=0 tx=0).stop 2024-03-28T05:47:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 -- 172.21.15.55:0/3123995100 shutdown_connections 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 --2- 172.21.15.55:0/3123995100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 0x7f36e00784e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 --2- 172.21.15.55:0/3123995100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e0077700 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 --2- 172.21.15.55:0/3123995100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 0x7f36e0076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 -- 172.21.15.55:0/3123995100 >> 172.21.15.55:0/3123995100 conn(0x7f36e00fee50 msgr2=0x7f36e0101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 -- 172.21.15.55:0/3123995100 shutdown_connections 2024-03-28T05:47:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.851+0000 7f36e8200640 1 -- 172.21.15.55:0/3123995100 wait complete. 2024-03-28T05:47:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.852+0000 7f36e8200640 1 Processor -- start 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.852+0000 7f36e8200640 1 -- start start 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 0x7f36e019df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 0x7f36e01a5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0113860 con 0x7f36e00772a0 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01136e0 con 0x7f36e0077c40 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e8200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01139e0 con 0x7f36e0076060 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38316/0 (socket says 172.21.15.55:38316) 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 -- 172.21.15.55:0/2978093095 learned_addr learned my addr 172.21.15.55:0/2978093095 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e6200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 0x7f36e01a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e5800640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 0x7f36e019df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 -- 172.21.15.55:0/2978093095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 msgr2=0x7f36e019df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 0x7f36e019df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 -- 172.21.15.55:0/2978093095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 msgr2=0x7f36e01a5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 0x7f36e01a5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.853+0000 7f36e4e00640 1 -- 172.21.15.55:0/2978093095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e01a5b90 con 0x7f36e00772a0 2024-03-28T05:47:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36d0000c00 tx=0x7f36d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36de000640 1 -- 172.21.15.55:0/2978093095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0043020 con 0x7f36e00772a0 2024-03-28T05:47:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e01a5e20 con 0x7f36e00772a0 2024-03-28T05:47:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36de000640 1 -- 172.21.15.55:0/2978093095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36d00054c0 con 0x7f36e00772a0 2024-03-28T05:47:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36de000640 1 -- 172.21.15.55:0/2978093095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0003d70 con 0x7f36e00772a0 2024-03-28T05:47:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.854+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e01a62e0 con 0x7f36e00772a0 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.857+0000 7f36de000640 1 -- 172.21.15.55:0/2978093095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f36d0046020 con 0x7f36e00772a0 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 Processor -- start 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 -- start start 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c69e0 0x55a0d78c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d7826250 con 0x55a0d78c0e80 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d77cea30 con 0x55a0d78c1870 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36eafa2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d78222f0 con 0x55a0d78c69e0 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36e6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36e6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38318/0 (socket says 172.21.15.55:38318) 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.858+0000 7f36e6200640 1 -- 172.21.15.55:0/103200866 learned_addr learned my addr 172.21.15.55:0/103200866 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e5800640 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e4e00640 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c69e0 0x55a0d78c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 -- 172.21.15.55:0/103200866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c69e0 msgr2=0x55a0d78c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c69e0 0x55a0d78c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 -- 172.21.15.55:0/103200866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 msgr2=0x55a0d78c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 -- 172.21.15.55:0/103200866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0d77b9690 con 0x55a0d78c0e80 2024-03-28T05:47:00.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36de000640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 0x7f36c80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e6200640 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f36d8010370 tx=0x7f36d8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799fe57a7aa7c9e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36de000640 1 -- 172.21.15.55:0/2978093095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36d00f0f20 con 0x7f36e00772a0 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.859+0000 7f36e5800640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 0x7f36c80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36cea00640 1 -- 172.21.15.55:0/103200866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8016070 con 0x55a0d78c0e80 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36cea00640 1 -- 172.21.15.55:0/103200866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36d8004d20 con 0x55a0d78c0e80 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36cea00640 1 -- 172.21.15.55:0/103200866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8005350 con 0x55a0d78c0e80 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36eafa2740 1 -- 172.21.15.55:0/103200866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 msgr2=0x55a0d78c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36e5800640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 0x7f36c80a4cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55a0d78c1c70 tx=0x7f36d400c630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.860+0000 7f36eafa2740 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f36d8010370 tx=0x7f36d8010830 comp rx=0 tx=0).stop 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 -- 172.21.15.55:0/103200866 shutdown_connections 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c69e0 0x55a0d78c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 --2- 172.21.15.55:0/103200866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78c12a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 -- 172.21.15.55:0/103200866 >> 172.21.15.55:0/103200866 conn(0x55a0d7889200 msgr2=0x55a0d78bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 -- 172.21.15.55:0/103200866 shutdown_connections 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 -- 172.21.15.55:0/103200866 wait complete. 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 -- start start 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.861+0000 7f36eafa2740 1 Processor -- start 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c1870 0x55a0d78cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d78c9990 con 0x55a0d78c0e80 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d77e1e80 con 0x55a0d78c69e0 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0d78c9b10 con 0x55a0d78c1870 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36eafa2740 10 client.0 _ll_register_callbacks cb 0x55a0d77f4130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36e5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36e5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38330/0 (socket says 172.21.15.55:38330) 2024-03-28T05:47:00.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36e5800640 1 -- 172.21.15.55:0/2203880738 learned_addr learned my addr 172.21.15.55:0/2203880738 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36e6200640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.862+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c1870 0x55a0d78cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 -- 172.21.15.55:0/2203880738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c1870 msgr2=0x55a0d78cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c1870 0x55a0d78cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 -- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 msgr2=0x55a0d78d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78d23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 -- 172.21.15.55:0/2203880738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0d76047d0 con 0x55a0d78c0e80 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36e5800640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36d4011a90 tx=0x7f36d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc3fcc2f10196bf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36c3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d400edd0 con 0x55a0d78c0e80 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36d401e420 con 0x55a0d78c0e80 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.863+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36d8004d20 con 0x55a0d78c0e80 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36d401e620 con 0x55a0d78c0e80 2024-03-28T05:47:00.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 10 client.15651 fetch_fsmap learned FSMap version 25 2024-03-28T05:47:00.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55a0d753a3f0 con 0x55a0d78c0e80 2024-03-28T05:47:00.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36d8004d20 con 0x55a0d78c0e80 2024-03-28T05:47:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f36d4026770 con 0x55a0d78c0e80 2024-03-28T05:47:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 10 client.15651 fetch_fsmap finished waiting for FSMap version 25 2024-03-28T05:47:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:47:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 20 client.15651 populate_metadata read hostname 'smithi055' 2024-03-28T05:47:00.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d78d6d10 0x55a0d78d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 4 client.15651 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.864+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0d7833790 con 0x55a0d78d6d10 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.865+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d78d6d10 0x55a0d78d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.866+0000 7f36e4e00640 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d78d6d10 0x55a0d78d9190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eec690efa1943aca server_cookie=6789f18b847be746 in_seq=0 out_seq=0 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.866+0000 7f36c3400640 10 client.15651 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.867+0000 7f36c3400640 1 -- 172.21.15.55:0/2203880738 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a0d7833790 con 0x55a0d78d6d10 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.867+0000 7f36c3400640 10 client.15651 handle_command_reply: tid=0 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.867+0000 7f36eafa2740 1 client.15651 shutdown 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 msgr2=0x55a0d78caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36d4011a90 tx=0x7f36d40046c0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 shutdown_connections 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d78d6d10 0x55a0d78d9190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c1870 0x55a0d78cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 --2- 172.21.15.55:0/2203880738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c0e80 0x55a0d78caee0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36c3400640 0 client.15651 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:47:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 >> 172.21.15.55:0/2203880738 conn(0x55a0d7889200 msgr2=0x55a0d78bba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 shutdown_connections 2024-03-28T05:47:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 1 -- 172.21.15.55:0/2203880738 wait complete. 2024-03-28T05:47:00.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.868+0000 7f36eafa2740 20 client.15651 trim_cache size 0 max 16384 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 Processor -- start 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 -- start start 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78bfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78bff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01b15d0 con 0x55a0d78c1870 2024-03-28T05:47:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01af0d0 con 0x55a0d78c69e0 2024-03-28T05:47:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.886+0000 7f36eafa2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01ad150 con 0x55a0d78c0e80 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38334/0 (socket says 172.21.15.55:38334) 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 -- 172.21.15.55:0/1250448980 learned_addr learned my addr 172.21.15.55:0/1250448980 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e5800640 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78bfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e6200640 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 -- 172.21.15.55:0/1250448980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 msgr2=0x55a0d78bfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78bfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 -- 172.21.15.55:0/1250448980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 msgr2=0x55a0d78bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78bff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 -- 172.21.15.55:0/1250448980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0d74fa0f0 con 0x55a0d78c1870 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.887+0000 7f36e4e00640 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ba250 tx=0x7f36d00a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8981a8bd18d594a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36ce000640 1 -- 172.21.15.55:0/1250448980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00bd1e0 con 0x55a0d78c1870 2024-03-28T05:47:00.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36ce000640 1 -- 172.21.15.55:0/1250448980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36d0004c50 con 0x55a0d78c1870 2024-03-28T05:47:00.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36ce000640 1 -- 172.21.15.55:0/1250448980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00044e0 con 0x55a0d78c1870 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 -- 172.21.15.55:0/1250448980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 msgr2=0x55a0d78d23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ba250 tx=0x7f36d00a8040 comp rx=0 tx=0).stop 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 -- 172.21.15.55:0/1250448980 shutdown_connections 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c69e0 0x55a0d78bff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c1870 0x55a0d78d23b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 --2- 172.21.15.55:0/1250448980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78bfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.888+0000 7f36eafa2740 1 -- 172.21.15.55:0/1250448980 >> 172.21.15.55:0/1250448980 conn(0x55a0d7889200 msgr2=0x55a0d78bba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 -- 172.21.15.55:0/1250448980 shutdown_connections 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 -- 172.21.15.55:0/1250448980 wait complete. 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 -- start start 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 Processor -- start 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.889+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36eafa2740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36eafa2740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01ad750 con 0x55a0d78c69e0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36eafa2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01aea70 con 0x55a0d78c1870 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36eafa2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01addb0 con 0x55a0d78c0e80 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36eafa2740 10 client.0 _ll_register_callbacks cb 0x7f36d400c8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38344/0 (socket says 172.21.15.55:38344) 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 -- 172.21.15.55:0/3957546410 learned_addr learned my addr 172.21.15.55:0/3957546410 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e4e00640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e5800640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 -- 172.21.15.55:0/3957546410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 msgr2=0x55a0d78d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 -- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 msgr2=0x55a0d78d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e6200640 1 -- 172.21.15.55:0/3957546410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0d78d1be0 con 0x55a0d78c69e0 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.890+0000 7f36e5800640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:47:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36e6200640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f36d8010370 tx=0x7f36d8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96408358f1dee864 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36c3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8016040 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36d80052b0 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36d0004c50 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36d80054b0 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36eafa2740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55a0d7932c90 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.891+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f36d0004c50 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f36d800f040 con 0x55a0d78c69e0 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 20 client.15657 populate_metadata read hostname 'smithi055' 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d7933330 0x55a0d7935750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 4 client.15657 mds_command: new command op to 34535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-28T05:47:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 --> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a0d782dae0 con 0x55a0d7933330 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.892+0000 7f36e5800640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d7933330 0x55a0d7935750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36e5800640 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d7933330 0x55a0d7935750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db0170648af15baf server_cookie=6cf7318dfdd1b510 in_seq=0 out_seq=0 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36c3400640 10 client.15657 ms_handle_connect on v2:172.21.15.86:6838/3285549085 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36c3400640 1 -- 172.21.15.55:0/3957546410 <== mds.0 v2:172.21.15.86:6838/3285549085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a0d782dae0 con 0x55a0d7933330 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36c3400640 10 client.15657 handle_command_reply: tid=0 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36eafa2740 1 client.15657 shutdown 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 msgr2=0x55a0d78d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.893+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f36d8010370 tx=0x7f36d8003ba0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 shutdown_connections 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] conn(0x55a0d7933330 0x55a0d7935750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a0d78c69e0 0x55a0d78d15f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a0d78c1870 0x55a0d78d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 --2- 172.21.15.55:0/3957546410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a0d78c0e80 0x55a0d78d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 >> 172.21.15.55:0/3957546410 conn(0x55a0d7889200 msgr2=0x55a0d78bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36c3400640 0 client.15657 ms_handle_reset on v2:172.21.15.86:6838/3285549085 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 shutdown_connections 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 1 -- 172.21.15.55:0/3957546410 wait complete. 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36eafa2740 20 client.15657 trim_cache size 0 max 16384 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-03-28T05:47:00.897 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 msgr2=0x7f36c80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 0x7f36c80a4cc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55a0d78c1c70 tx=0x7f36d400c630 comp rx=0 tx=0).stop 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 msgr2=0x7f36e019e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.894+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36d0000c00 tx=0x7f36d00042f0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 shutdown_connections 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f36c80a2800 0x7f36c80a4cc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e0077c40 0x7f36e01a5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e00772a0 0x7f36e019e4b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 --2- 172.21.15.55:0/2978093095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e0076060 0x7f36e019df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 >> 172.21.15.55:0/2978093095 conn(0x7f36e00fee50 msgr2=0x7f36e0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 shutdown_connections 2024-03-28T05:47:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:00.895+0000 7f36e8200640 1 -- 172.21.15.55:0/2978093095 wait complete. 2024-03-28T05:47:00.911 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-28T05:47:00.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T05:47:01.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1558 2.17 MB/sec warmup 12 sec latency 2812.473 ms 2024-03-28T05:47:01.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 -- 172.21.15.55:0/1455591798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3141038e0 msgr2=0x7fb314103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 --2- 172.21.15.55:0/1455591798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3141038e0 0x7fb314103d00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb304009900 tx=0x7fb30402bc30 comp rx=0 tx=0).stop 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 -- 172.21.15.55:0/1455591798 shutdown_connections 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 --2- 172.21.15.55:0/1455591798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb31410bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 --2- 172.21.15.55:0/1455591798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb314104ad0 0x7fb314104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 --2- 172.21.15.55:0/1455591798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3141038e0 0x7fb314103d00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 -- 172.21.15.55:0/1455591798 >> 172.21.15.55:0/1455591798 conn(0x7fb3140fee50 msgr2=0x7fb314101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 -- 172.21.15.55:0/1455591798 shutdown_connections 2024-03-28T05:47:01.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.129+0000 7fb318e00640 1 -- 172.21.15.55:0/1455591798 wait complete. 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.130+0000 7fb318e00640 1 Processor -- start 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.130+0000 7fb318e00640 1 -- start start 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3141038e0 0x7fb314199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb3141a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31410f430 con 0x7fb314104ad0 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31410f2b0 con 0x7fb314105490 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb318e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31410f5b0 con 0x7fb3141038e0 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb309400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb309400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38370/0 (socket says 172.21.15.55:38370) 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb309400640 1 -- 172.21.15.55:0/1624855720 learned_addr learned my addr 172.21.15.55:0/1624855720 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb311e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3141038e0 0x7fb314199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.131+0000 7fb312800640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb3141a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 -- 172.21.15.55:0/1624855720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3141038e0 msgr2=0x7fb314199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3141038e0 0x7fb314199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 -- 172.21.15.55:0/1624855720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 msgr2=0x7fb3141a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb3141a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 -- 172.21.15.55:0/1624855720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3141a1750 con 0x7fb314104ad0 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb312800640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb3141a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:47:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb309400640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d950 tx=0x7fb2fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc017070 con 0x7fb314104ad0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb2fc009c30 con 0x7fb314104ad0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00f620 con 0x7fb314104ad0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.132+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3141a1a40 con 0x7fb314104ad0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.133+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3141a1f40 con 0x7fb314104ad0 2024-03-28T05:47:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.134+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31410acd0 con 0x7fb314104ad0 2024-03-28T05:47:01.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.136+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb2fc0109a0 con 0x7fb314104ad0 2024-03-28T05:47:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.137+0000 7fb30b400640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 0x7fb2f80a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.137+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb2fc0ce710 con 0x7fb314104ad0 2024-03-28T05:47:01.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.137+0000 7fb311e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 0x7fb2f80a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.138+0000 7fb311e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 0x7fb2f80a4d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb30402c240 tx=0x7fb304005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.142+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb2fc009de0 con 0x7fb314104ad0 2024-03-28T05:47:01.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.388+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31402d070 con 0x7fb314104ad0 2024-03-28T05:47:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.390+0000 7fb30b400640 1 -- 172.21.15.55:0/1624855720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11383 (secure 0 0 0) 0x7fb2fc09b770 con 0x7fb314104ad0 2024-03-28T05:47:01.391 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T05:47:01.391 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/204524138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":204524138},{"type":"v1","addr":"172.21.15.55:6835","nonce":204524138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1204847109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":1204847109},{"type":"v1","addr":"172.21.15.55:6837","nonce":1204847109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/849759534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":849759534},{"type":"v1","addr":"172.21.15.55:6839","nonce":849759534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6841/3684039614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6840","nonce":3684039614},{"type":"v1","addr":"172.21.15.55:6841","nonce":3684039614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3865980537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3865980537},{"type":"v1","addr":"172.21.15.159:6833","nonce":3865980537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/721766197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":721766197},{"type":"v1","addr":"172.21.15.159:6835","nonce":721766197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-28T05:42:52.123648+0000","modified":"2024-03-28T05:46:57.357355+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34535,"mds_1":34490,"mds_2":34457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6837/1347717104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":1347717104},{"type":"v1","addr":"172.21.15.159:6837","nonce":1347717104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6839/673238495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":673238495},{"type":"v1","addr":"172.21.15.159:6839","nonce":673238495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34433":{"gid":34433,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6833/3295609155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3295609155},{"type":"v1","addr":"172.21.15.86:6833","nonce":3295609155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34457":{"gid":34457,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.86:6835/833423423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":833423423},{"type":"v1","addr":"172.21.15.86:6835","nonce":833423423}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34490":{"gid":34490,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.86:6837/2422548949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2422548949},{"type":"v1","addr":"172.21.15.86:6837","nonce":2422548949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34535":{"gid":34535,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6839/3285549085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":3285549085},{"type":"v1","addr":"172.21.15.86:6839","nonce":3285549085}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34535,"qdb_cluster":[34490,34535,34457]},"id":1}]} 2024-03-28T05:47:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-03-28T05:47:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 msgr2=0x7fb2f80a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 0x7fb2f80a4d40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb30402c240 tx=0x7fb304005fd0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 msgr2=0x7fb31419a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00d950 tx=0x7fb2fc00de10 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 shutdown_connections 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb2f80a2880 0x7fb2f80a4d40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb314105490 0x7fb3141a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb314104ad0 0x7fb31419a070 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 --2- 172.21.15.55:0/1624855720 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3141038e0 0x7fb314199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.393+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 >> 172.21.15.55:0/1624855720 conn(0x7fb3140fee50 msgr2=0x7fb314107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.394+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 shutdown_connections 2024-03-28T05:47:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.394+0000 7fb318e00640 1 -- 172.21.15.55:0/1624855720 wait complete. 2024-03-28T05:47:01.413 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:47:01.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-28T05:47:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-mon[35163]: pgmap v493: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 1.9 MiB/s wr, 30 op/s 2024-03-28T05:47:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:01 smithi159 ceph-mon[36109]: pgmap v493: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 1.9 MiB/s wr, 30 op/s 2024-03-28T05:47:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:01 smithi055 ceph-mon[31863]: pgmap v493: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 1.9 MiB/s wr, 30 op/s 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 -- 172.21.15.55:0/2638675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd968105370 msgr2=0x7fd96810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2638675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd968105370 0x7fd96810bc00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd960009900 tx=0x7fd96002bc50 comp rx=0 tx=0).stop 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 -- 172.21.15.55:0/2638675271 shutdown_connections 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2638675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd968105370 0x7fd96810bc00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2638675271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9681049b0 0x7fd968104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2638675271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 0x7fd968103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.638+0000 7fd96ee00640 1 -- 172.21.15.55:0/2638675271 >> 172.21.15.55:0/2638675271 conn(0x7fd9680fed50 msgr2=0x7fd968101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.639+0000 7fd96ee00640 1 -- 172.21.15.55:0/2638675271 shutdown_connections 2024-03-28T05:47:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.639+0000 7fd96ee00640 1 -- 172.21.15.55:0/2638675271 wait complete. 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 Processor -- start 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 -- start start 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 0x7fd968199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd968105370 0x7fd9681a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810f2f0 con 0x7fd9681049b0 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810f170 con 0x7fd968105370 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.640+0000 7fd96ee00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810f470 con 0x7fd9681037c0 2024-03-28T05:47:01.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38390/0 (socket says 172.21.15.55:38390) 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 -- 172.21.15.55:0/2148263343 learned_addr learned my addr 172.21.15.55:0/2148263343 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96e400640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd968105370 0x7fd9681a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96da00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 0x7fd968199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 -- 172.21.15.55:0/2148263343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 msgr2=0x7fd968199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 0x7fd968199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 -- 172.21.15.55:0/2148263343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd968105370 msgr2=0x7fd9681a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd968105370 0x7fd9681a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.641+0000 7fd96d000640 1 -- 172.21.15.55:0/2148263343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9681a1560 con 0x7fd9681049b0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd96d000640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd95400e9f0 tx=0x7fd95400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd966000640 1 -- 172.21.15.55:0/2148263343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400cd80 con 0x7fd9681049b0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd966000640 1 -- 172.21.15.55:0/2148263343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd9540108e0 con 0x7fd9681049b0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd966000640 1 -- 172.21.15.55:0/2148263343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954018920 con 0x7fd9681049b0 2024-03-28T05:47:01.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9681a1850 con 0x7fd9681049b0 2024-03-28T05:47:01.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.642+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9681a1da0 con 0x7fd9681049b0 2024-03-28T05:47:01.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.646+0000 7fd973233740 1 Processor -- start 2024-03-28T05:47:01.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 -- start start 2024-03-28T05:47:01.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b40d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b413e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b3702c0 con 0x561b5b40b9f0 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b318c90 con 0x561b5b40cbc0 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.647+0000 7fd973233740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b36c360 con 0x561b5b40d580 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38400/0 (socket says 172.21.15.55:38400) 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 -- 172.21.15.55:0/3811330282 learned_addr learned my addr 172.21.15.55:0/3811330282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd966000640 1 -- 172.21.15.55:0/2148263343 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fd954010a90 con 0x7fd9681049b0 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96da00640 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b40d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 -- 172.21.15.55:0/3811330282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 msgr2=0x561b5b413e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b413e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 -- 172.21.15.55:0/3811330282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 msgr2=0x561b5b40d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b40d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 -- 172.21.15.55:0/3811330282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5b33d080 con 0x561b5b40b9f0 2024-03-28T05:47:01.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96da00640 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b40d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:47:01.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.648+0000 7fd96e400640 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd960009900 tx=0x7fd960005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3da6a6fa19d8e96 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.649+0000 7fd95aa00640 1 -- 172.21.15.55:0/3811330282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960045020 con 0x561b5b40b9f0 2024-03-28T05:47:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.649+0000 7fd95aa00640 1 -- 172.21.15.55:0/3811330282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd96002ca40 con 0x561b5b40b9f0 2024-03-28T05:47:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.649+0000 7fd95aa00640 1 -- 172.21.15.55:0/3811330282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600046c0 con 0x561b5b40b9f0 2024-03-28T05:47:01.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd966000640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 0x7fd9500a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 -- 172.21.15.55:0/3811330282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 msgr2=0x561b5b40be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd960009900 tx=0x7fd960005d50 comp rx=0 tx=0).stop 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd966000640 1 -- 172.21.15.55:0/2148263343 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd9540cee00 con 0x7fd9681049b0 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd96da00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 0x7fd9500a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 -- 172.21.15.55:0/3811330282 shutdown_connections 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b413e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b40d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 --2- 172.21.15.55:0/3811330282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b40be10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 -- 172.21.15.55:0/3811330282 >> 172.21.15.55:0/3811330282 conn(0x561b5b406de0 msgr2=0x561b5b4071e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.650+0000 7fd973233740 1 -- 172.21.15.55:0/3811330282 shutdown_connections 2024-03-28T05:47:01.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.651+0000 7fd973233740 1 -- 172.21.15.55:0/3811330282 wait complete. 2024-03-28T05:47:01.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.651+0000 7fd96da00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 0x7fd9500a4cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005f40 tx=0x7fd95c005e10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.651+0000 7fd973233740 1 -- start start 2024-03-28T05:47:01.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.651+0000 7fd973233740 1 Processor -- start 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b4161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b414530 con 0x561b5b40b9f0 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b32c0d0 con 0x561b5b40cbc0 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5b4146b0 con 0x561b5b40d580 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd973233740 10 client.0 _ll_register_callbacks cb 0x561b5b330e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:47:01.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd96da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd96da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38410/0 (socket says 172.21.15.55:38410) 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd96da00640 1 -- 172.21.15.55:0/1358523281 learned_addr learned my addr 172.21.15.55:0/1358523281 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd96d000640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b4161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.652+0000 7fd96e400640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 -- 172.21.15.55:0/1358523281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 msgr2=0x561b5b41d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 -- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 msgr2=0x561b5b4161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b4161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 -- 172.21.15.55:0/1358523281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b5b0843f0 con 0x561b5b40b9f0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96d000640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b4161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd96da00640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd95c012780 tx=0x7fd95c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18748401b13b8951 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd94f400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:47:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.653+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00ead0 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd95c00ec70 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd96002ca40 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c01f420 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd973233740 10 client.15675 fetch_fsmap learned FSMap version 25 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561b5b14e7d0 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.654+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd96002ca40 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x561b5b40b9f0 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 10 client.15675 fetch_fsmap finished waiting for FSMap version 25 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 10 client.15675 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 20 client.15675 populate_metadata read hostname 'smithi055' 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b421750 0x561b5b423bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 4 client.15675 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:47:01.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b5b37d800 con 0x561b5b421750 2024-03-28T05:47:01.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.655+0000 7fd96d000640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b421750 0x561b5b423bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.656+0000 7fd96d000640 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b421750 0x561b5b423bf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e4e4d183416e7db server_cookie=4621137f328aee3e in_seq=0 out_seq=0 2024-03-28T05:47:01.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.656+0000 7fd94f400640 10 client.15675 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd94f400640 1 -- 172.21.15.55:0/1358523281 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561b5b37d800 con 0x561b5b421750 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd94f400640 10 client.15675 handle_command_reply: tid=0 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 client.15675 shutdown 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 msgr2=0x561b5b415c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd95c012780 tx=0x7fd95c004a40 comp rx=0 tx=0).stop 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 shutdown_connections 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b421750 0x561b5b423bf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40cbc0 0x561b5b4161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 --2- 172.21.15.55:0/1358523281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b415c60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd94f400640 0 client.15675 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 >> 172.21.15.55:0/1358523281 conn(0x561b5b406de0 msgr2=0x561b5b406160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 shutdown_connections 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 1 -- 172.21.15.55:0/1358523281 wait complete. 2024-03-28T05:47:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.657+0000 7fd973233740 20 client.15675 trim_cache size 0 max 16384 2024-03-28T05:47:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 Processor -- start 2024-03-28T05:47:01.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 -- start start 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40cbc0 0x561b5b41d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40d580 0x561b5b40a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681acea0 con 0x561b5b40b9f0 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681aa9a0 con 0x561b5b40d580 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.673+0000 7fd973233740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681a8a20 con 0x561b5b40cbc0 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38426/0 (socket says 172.21.15.55:38426) 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 -- 172.21.15.55:0/1534301623 learned_addr learned my addr 172.21.15.55:0/1534301623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96e400640 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40d580 0x561b5b40a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 -- 172.21.15.55:0/1534301623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40cbc0 msgr2=0x561b5b41d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40cbc0 0x561b5b41d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 -- 172.21.15.55:0/1534301623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40d580 msgr2=0x561b5b40a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40d580 0x561b5b40a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.674+0000 7fd96da00640 1 -- 172.21.15.55:0/1534301623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5b4028b0 con 0x561b5b40b9f0 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.675+0000 7fd96da00640 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005d70 tx=0x7fd95c032a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6db0f0ff40b59f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.675+0000 7fd95a000640 1 -- 172.21.15.55:0/1534301623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c03f020 con 0x561b5b40b9f0 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.675+0000 7fd95a000640 1 -- 172.21.15.55:0/1534301623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd95c032d30 con 0x561b5b40b9f0 2024-03-28T05:47:01.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.675+0000 7fd95a000640 1 -- 172.21.15.55:0/1534301623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c037040 con 0x561b5b40b9f0 2024-03-28T05:47:01.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- 172.21.15.55:0/1534301623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 msgr2=0x561b5b416100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005d70 tx=0x7fd95c032a30 comp rx=0 tx=0).stop 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- 172.21.15.55:0/1534301623 shutdown_connections 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40d580 0x561b5b40a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40cbc0 0x561b5b41d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 --2- 172.21.15.55:0/1534301623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40b9f0 0x561b5b416100 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- 172.21.15.55:0/1534301623 >> 172.21.15.55:0/1534301623 conn(0x561b5b406de0 msgr2=0x561b5b40a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- 172.21.15.55:0/1534301623 shutdown_connections 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- 172.21.15.55:0/1534301623 wait complete. 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 -- start start 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.676+0000 7fd973233740 1 Processor -- start 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40b9f0 0x561b5b419330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681a9020 con 0x561b5b40cbc0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681aa340 con 0x561b5b40b9f0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9681a9680 con 0x561b5b40d580 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd973233740 10 client.0 _ll_register_callbacks cb 0x7fd95c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd96d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd96d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38438/0 (socket says 172.21.15.55:38438) 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd96d000640 1 -- 172.21.15.55:0/3511617194 learned_addr learned my addr 172.21.15.55:0/3511617194 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd96da00640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40b9f0 0x561b5b419330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.677+0000 7fd96e400640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 -- 172.21.15.55:0/3511617194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 msgr2=0x561b5b41c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 -- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40b9f0 msgr2=0x561b5b419330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40b9f0 0x561b5b419330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 -- 172.21.15.55:0/3511617194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b5b41ce30 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd96d000640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd954097c00 tx=0x7fd95400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5295b2ae79b64d40 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd94f400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b3020 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd9540860b0 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd95c032d30 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.678+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95409f8f0 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561b5b47db10 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fd95c032d30 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fd95409abf0 con 0x561b5b40cbc0 2024-03-28T05:47:01.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 10 client.15681 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 20 client.15681 populate_metadata read hostname 'smithi055' 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b47e4a0 0x561b5b4808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 4 client.15681 mds_command: new command op to 34457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.679+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 --> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561b5b377b50 con 0x561b5b47e4a0 2024-03-28T05:47:01.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.680+0000 7fd96da00640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b47e4a0 0x561b5b4808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.680+0000 7fd96da00640 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b47e4a0 0x561b5b4808c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=508a3b4a044d5a9a server_cookie=f158a4f0200a4712 in_seq=0 out_seq=0 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.680+0000 7fd94f400640 10 client.15681 ms_handle_connect on v2:172.21.15.86:6834/833423423 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd94f400640 1 -- 172.21.15.55:0/3511617194 <== mds.2 v2:172.21.15.86:6834/833423423 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561b5b377b50 con 0x561b5b47e4a0 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd94f400640 10 client.15681 handle_command_reply: tid=0 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 client.15681 shutdown 2024-03-28T05:47:01.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 msgr2=0x561b5b419870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd954097c00 tx=0x7fd95400e940 comp rx=0 tx=0).stop 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 shutdown_connections 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:6834/833423423,v1:172.21.15.86:6835/833423423] conn(0x561b5b47e4a0 0x561b5b4808c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561b5b40d580 0x561b5b41c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561b5b40cbc0 0x561b5b419870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 --2- 172.21.15.55:0/3511617194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561b5b40b9f0 0x561b5b419330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd94f400640 0 client.15681 ms_handle_reset on v2:172.21.15.86:6834/833423423 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 >> 172.21.15.55:0/3511617194 conn(0x561b5b406de0 msgr2=0x561b5b40a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 shutdown_connections 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.681+0000 7fd973233740 1 -- 172.21.15.55:0/3511617194 wait complete. 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd973233740 20 client.15681 trim_cache size 0 max 16384 2024-03-28T05:47:01.685 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-03-28T05:47:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 msgr2=0x7fd9500a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 0x7fd9500a4cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005f40 tx=0x7fd95c005e10 comp rx=0 tx=0).stop 2024-03-28T05:47:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 msgr2=0x7fd968199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd95400e9f0 tx=0x7fd95400eeb0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 shutdown_connections 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fd9500a2800 0x7fd9500a4cc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd968105370 0x7fd9681a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9681049b0 0x7fd968199e80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 --2- 172.21.15.55:0/2148263343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9681037c0 0x7fd968199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.682+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 >> 172.21.15.55:0/2148263343 conn(0x7fd9680fed50 msgr2=0x7fd968107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.683+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 shutdown_connections 2024-03-28T05:47:01.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.683+0000 7fd96ee00640 1 -- 172.21.15.55:0/2148263343 wait complete. 2024-03-28T05:47:01.701 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-28T05:47:01.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.922+0000 7f5337800640 1 -- 172.21.15.55:0/3025912963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5330077c40 msgr2=0x7f53300784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 --2- 172.21.15.55:0/3025912963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5330077c40 0x7f53300784e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5328009900 tx=0x7f532802bc30 comp rx=0 tx=0).stop 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 -- 172.21.15.55:0/3025912963 shutdown_connections 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 --2- 172.21.15.55:0/3025912963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5330077c40 0x7f53300784e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 --2- 172.21.15.55:0/3025912963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53300772a0 0x7f5330077700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 --2- 172.21.15.55:0/3025912963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330076060 0x7f5330076480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 -- 172.21.15.55:0/3025912963 >> 172.21.15.55:0/3025912963 conn(0x7f53300fee50 msgr2=0x7f5330101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 -- 172.21.15.55:0/3025912963 shutdown_connections 2024-03-28T05:47:01.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.923+0000 7f5337800640 1 -- 172.21.15.55:0/3025912963 wait complete. 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 Processor -- start 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 -- start start 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5330076060 0x7f533019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300772a0 0x7f533019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330077c40 0x7f53301a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330113860 con 0x7f53300772a0 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301136e0 con 0x7f5330077c40 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.924+0000 7f5337800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301139e0 con 0x7f5330076060 2024-03-28T05:47:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300772a0 0x7f533019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300772a0 0x7f533019e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38448/0 (socket says 172.21.15.55:38448) 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 -- 172.21.15.55:0/64605140 learned_addr learned my addr 172.21.15.55:0/64605140 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f5334e00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5330076060 0x7f533019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f5335800640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330077c40 0x7f53301a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 -- 172.21.15.55:0/64605140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5330076060 msgr2=0x7f533019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5330076060 0x7f533019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 -- 172.21.15.55:0/64605140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330077c40 msgr2=0x7f53301a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330077c40 0x7f53301a5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 -- 172.21.15.55:0/64605140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53301a5a90 con 0x7f53300772a0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f5334e00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5330076060 0x7f533019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f5335800640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5330077c40 0x7f53301a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.925+0000 7f532fe00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53300772a0 0x7f533019e400 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f531800e9f0 tx=0x7f531800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.926+0000 7f532d600640 1 -- 172.21.15.55:0/64605140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531800cd80 con 0x7f53300772a0 2024-03-28T05:47:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.926+0000 7f532d600640 1 -- 172.21.15.55:0/64605140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f53180108e0 con 0x7f53300772a0 2024-03-28T05:47:01.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.926+0000 7f532d600640 1 -- 172.21.15.55:0/64605140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318018920 con 0x7f53300772a0 2024-03-28T05:47:01.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.926+0000 7f5337800640 1 -- 172.21.15.55:0/64605140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53301a5d80 con 0x7f53300772a0 2024-03-28T05:47:01.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.926+0000 7f5337800640 1 -- 172.21.15.55:0/64605140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53301a6250 con 0x7f53300772a0 2024-03-28T05:47:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.929+0000 7f533a5e1740 1 Processor -- start 2024-03-28T05:47:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.929+0000 7f532d600640 1 -- 172.21.15.55:0/64605140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f5318010a90 con 0x7f53300772a0 2024-03-28T05:47:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.929+0000 7f533a5e1740 1 -- start start 2024-03-28T05:47:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 0x562e5ad88e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad893a0 0x562e5ad8fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5acec2c0 con 0x562e5ad87810 2024-03-28T05:47:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ac94c90 con 0x562e5ad889e0 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f533a5e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ace8360 con 0x562e5ad893a0 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38460/0 (socket says 172.21.15.55:38460) 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 -- 172.21.15.55:0/1386219344 learned_addr learned my addr 172.21.15.55:0/1386219344 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5334e00640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 0x562e5ad88e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f532fe00640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad893a0 0x562e5ad8fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 -- 172.21.15.55:0/1386219344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad893a0 msgr2=0x562e5ad8fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad893a0 0x562e5ad8fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 -- 172.21.15.55:0/1386219344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 msgr2=0x562e5ad88e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 0x562e5ad88e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5335800640 1 -- 172.21.15.55:0/1386219344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e5acb9080 con 0x562e5ad87810 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.930+0000 7f5334e00640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 0x562e5ad88e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T05:47:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f532d600640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f53140a2880 0x7f53140a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f5335800640 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f532802c6a0 tx=0x7f5328005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9324bb465478ac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f532d600640 1 -- 172.21.15.55:0/64605140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53180cee30 con 0x7f53300772a0 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f5334e00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f53140a2880 0x7f53140a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f5326000640 1 -- 172.21.15.55:0/1386219344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328043020 con 0x562e5ad87810 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f5326000640 1 -- 172.21.15.55:0/1386219344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5328004040 con 0x562e5ad87810 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.931+0000 7f5326000640 1 -- 172.21.15.55:0/1386219344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280046c0 con 0x562e5ad87810 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 -- 172.21.15.55:0/1386219344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 msgr2=0x562e5ad87c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f5334e00640 1 --2- 172.21.15.55:0/64605140 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f53140a2880 0x7f53140a4d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5320005fd0 tx=0x7f5320009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f532802c6a0 tx=0x7f5328005d50 comp rx=0 tx=0).stop 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 -- 172.21.15.55:0/1386219344 shutdown_connections 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad893a0 0x562e5ad8fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad889e0 0x562e5ad88e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 --2- 172.21.15.55:0/1386219344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad87810 0x562e5ad87c30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 -- 172.21.15.55:0/1386219344 >> 172.21.15.55:0/1386219344 conn(0x562e5ad82c00 msgr2=0x562e5ad83000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T05:47:01.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 -- 172.21.15.55:0/1386219344 shutdown_connections 2024-03-28T05:47:01.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.932+0000 7f533a5e1740 1 -- 172.21.15.55:0/1386219344 wait complete. 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 -- start start 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 Processor -- start 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad87810 0x562e5ad91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad889e0 0x562e5ad91fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad893a0 0x562e5ad98fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ad90350 con 0x562e5ad889e0 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5aca80d0 con 0x562e5ad893a0 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ad904d0 con 0x562e5ad87810 2024-03-28T05:47:01.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.933+0000 7f533a5e1740 10 client.0 _ll_register_callbacks cb 0x562e5acace80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad889e0 0x562e5ad91fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad889e0 0x562e5ad91fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38472/0 (socket says 172.21.15.55:38472) 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 -- 172.21.15.55:0/1025709264 learned_addr learned my addr 172.21.15.55:0/1025709264 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f5335800640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad893a0 0x562e5ad98fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad87810 0x562e5ad91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad87810 msgr2=0x562e5ad91a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x562e5ad87810 0x562e5ad91a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad893a0 msgr2=0x562e5ad98fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad893a0 0x562e5ad98fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 -- 172.21.15.55:0/1025709264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e5aa003f0 con 0x562e5ad889e0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f5335800640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562e5ad893a0 0x562e5ad98fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f532fe00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e5ad889e0 0x562e5ad91fa0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5318097c30 tx=0x7f531809b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dbe975120bb229 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T05:47:01.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.934+0000 7f531ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f531ea00640 1 -- 172.21.15.55:0/1025709264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531809b7d0 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f531ea00640 1 -- 172.21.15.55:0/1025709264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53180860b0 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 1 -- 172.21.15.55:0/1025709264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5328004040 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f531ea00640 1 -- 172.21.15.55:0/1025709264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f531809f920 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 10 client.15693 fetch_fsmap learned FSMap version 25 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 1 -- 172.21.15.55:0/1025709264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x562e5aaca7d0 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f531ea00640 1 -- 172.21.15.55:0/1025709264 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f5328004040 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f531ea00640 1 -- 172.21.15.55:0/1025709264 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f531809cb90 con 0x562e5ad889e0 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 10 client.15693 fetch_fsmap finished waiting for FSMap version 25 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 10 client.15693 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 20 client.15693 populate_metadata read hostname 'smithi055' 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.935+0000 7f533a5e1740 4 client.15693 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T05:47:01.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.936+0000 7f533a5e1740 1 -- 172.21.15.55:0/1025709264 --> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e5acf9800 con 0x562e5ad9d500 2024-03-28T05:47:01.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.942+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk reading from fd=12 : -104 Unknown error -104 2024-03-28T05:47:01.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.942+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:47:01.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.942+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-03-28T05:47:01.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:01.942+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T05:47:02.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 2.01 MB/sec warmup 13 sec latency 3247.721 ms 2024-03-28T05:47:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.143+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.143+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.143+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T05:47:02.293 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd9f8800700 time 2024-03-28T05:47:01.881964+0000 2024-03-28T05:47:02.293 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:02.293 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.293 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fda041c64a1] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.294 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.295 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.295 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.295 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.295 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: clone() 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:01.883+0000 7fd9f8800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd9f8800700 time 2024-03-28T05:47:01.881964+0000 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fda041c64a1] 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.297 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: clone() 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: *** Caught signal (Aborted) ** 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: in thread 7fd9f8800700 thread_name:ms_dispatch 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fda02f4dd20] 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: gsignal() 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: abort() 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fda041c64fb] 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.298 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.299 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 19: clone() 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:01.886+0000 7fd9f8800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: in thread 7fd9f8800700 thread_name:ms_dispatch 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fda02f4dd20] 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: gsignal() 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: abort() 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fda041c64fb] 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.300 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.301 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 19: clone() 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: -1> 2024-03-28T05:47:01.883+0000 7fd9f8800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd9f8800700 time 2024-03-28T05:47:01.881964+0000 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fda041c64a1] 2024-03-28T05:47:02.302 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.303 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.303 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.304 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: clone() 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 0> 2024-03-28T05:47:01.886+0000 7fd9f8800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: in thread 7fd9f8800700 thread_name:ms_dispatch 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fda02f4dd20] 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: gsignal() 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: abort() 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fda041c64fb] 2024-03-28T05:47:02.305 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.306 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 19: clone() 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: -1> 2024-03-28T05:47:01.883+0000 7fd9f8800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd9f8800700 time 2024-03-28T05:47:01.881964+0000 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fda041c64a1] 2024-03-28T05:47:02.307 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: clone() 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 0> 2024-03-28T05:47:01.886+0000 7fd9f8800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: in thread 7fd9f8800700 thread_name:ms_dispatch 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fda02f4dd20] 2024-03-28T05:47:02.309 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2: gsignal() 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 3: abort() 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fda041c64fb] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fda041c6667] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d5b9291223] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d5b910b5d6] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d5b910bda1] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d5b914009c] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d5b915e233] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5b9160197] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5b905f11b] 2024-03-28T05:47:02.310 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5b905f6bc] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d5b90491ff] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fda04458488] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 16: (DispatchQueue::entry()+0x51f) [0x7fda0445560f] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fda04528e81] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fda02f431ca] 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 19: clone() 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[64993]: 2024-03-28T05:47:02.311 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:01 smithi086 podman[67415]: 2024-03-28 05:47:01.995965175 +0000 UTC m=+0.035311309 container died 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:47:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.544+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.544+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:02.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:02.544+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T05:47:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1624855720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:47:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1624855720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:47:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1624855720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-28T05:47:03.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.87 MB/sec warmup 14 sec latency 1240.068 ms 2024-03-28T05:47:03.295 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:02 smithi086 podman[67415]: 2024-03-28 05:47:02.882667178 +0000 UTC m=+0.922013355 container remove 490a14aa361dcd44a7ae8d0c9d989fdcc3f7165b8b0c594c6b3f01c70c5b0f07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-28T05:47:03.296 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:02 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:47:03.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:03.346+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:03.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:03.346+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:03.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:03.346+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T05:47:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:03 smithi055 ceph-mon[31863]: pgmap v494: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 MiB/s wr, 32 op/s 2024-03-28T05:47:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:03 smithi086 ceph-mon[35163]: pgmap v494: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 MiB/s wr, 32 op/s 2024-03-28T05:47:03.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:47:03.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 2min 40.111s CPU time. 2024-03-28T05:47:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:03 smithi159 ceph-mon[36109]: pgmap v494: 97 pgs: 97 active+clean; 22 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.8 MiB/s wr, 32 op/s 2024-03-28T05:47:04.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.74 MB/sec warmup 15 sec latency 2240.181 ms 2024-03-28T05:47:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:04 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:04.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:04 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:04 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:04.948+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:04.948+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:04.948+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-28T05:47:05.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.63 MB/sec warmup 16 sec latency 3240.342 ms 2024-03-28T05:47:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:05 smithi055 ceph-mon[31863]: pgmap v495: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.4 MiB/s wr, 35 op/s 2024-03-28T05:47:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:05 smithi086 ceph-mon[35163]: pgmap v495: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.4 MiB/s wr, 35 op/s 2024-03-28T05:47:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:05 smithi159 ceph-mon[36109]: pgmap v495: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.4 MiB/s wr, 35 op/s 2024-03-28T05:47:06.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.54 MB/sec warmup 17 sec latency 4240.458 ms 2024-03-28T05:47:07.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.45 MB/sec warmup 18 sec latency 5240.612 ms 2024-03-28T05:47:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:07 smithi055 ceph-mon[31863]: pgmap v496: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 795 KiB/s wr, 26 op/s 2024-03-28T05:47:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:07 smithi086 ceph-mon[35163]: pgmap v496: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 795 KiB/s wr, 26 op/s 2024-03-28T05:47:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:07 smithi159 ceph-mon[36109]: pgmap v496: 97 pgs: 97 active+clean; 22 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 795 KiB/s wr, 26 op/s 2024-03-28T05:47:08.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.38 MB/sec warmup 19 sec latency 6240.744 ms 2024-03-28T05:47:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:08.152+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:08.152+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:08.152+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-03-28T05:47:09.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.31 MB/sec warmup 20 sec latency 7240.901 ms 2024-03-28T05:47:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:09 smithi086 ceph-mon[35163]: pgmap v497: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 123 KiB/s wr, 25 op/s 2024-03-28T05:47:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:09 smithi159 ceph-mon[36109]: pgmap v497: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 123 KiB/s wr, 25 op/s 2024-03-28T05:47:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:09 smithi055 ceph-mon[31863]: pgmap v497: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 123 KiB/s wr, 25 op/s 2024-03-28T05:47:10.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.25 MB/sec warmup 21 sec latency 8241.049 ms 2024-03-28T05:47:11.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.19 MB/sec warmup 22 sec latency 9241.175 ms 2024-03-28T05:47:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:11 smithi086 ceph-mon[35163]: pgmap v498: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-03-28T05:47:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:11 smithi159 ceph-mon[36109]: pgmap v498: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-03-28T05:47:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:11 smithi055 ceph-mon[31863]: pgmap v498: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-03-28T05:47:12.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.14 MB/sec warmup 23 sec latency 10241.339 ms 2024-03-28T05:47:13.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.09 MB/sec warmup 24 sec latency 11241.469 ms 2024-03-28T05:47:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:13 smithi086 ceph-mon[35163]: pgmap v499: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-03-28T05:47:13.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:13 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:47:13.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:13 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:13.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:13 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 2min 40.111s CPU time. 2024-03-28T05:47:13.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:13 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:47:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:13 smithi159 ceph-mon[36109]: pgmap v499: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-03-28T05:47:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:13 smithi055 ceph-mon[31863]: pgmap v499: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-03-28T05:47:14.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.05 MB/sec warmup 25 sec latency 12241.627 ms 2024-03-28T05:47:14.210 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:13 smithi086 podman[67518]: 2024-03-28 05:47:13.860825148 +0000 UTC m=+0.039785061 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:47:14.210 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 podman[67518]: 2024-03-28 05:47:14.008330649 +0000 UTC m=+0.187290555 container create 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-28T05:47:14.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:14.558+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:14.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:14.559+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-28T05:47:14.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:14.559+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:47:14.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:14.559+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:47:14.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:14.559+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: daemon mds.h restarted 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: osdmap e93: 12 total, 12 up, 12 in 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:boot 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 podman[67518]: 2024-03-28 05:47:14.295096428 +0000 UTC m=+0.474056375 container init 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 podman[67518]: 2024-03-28 05:47:14.303664238 +0000 UTC m=+0.482624159 container start 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-mds[67538]: -- 172.21.15.86:0/2808660665 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56156d52da40 con 0x56156d501000 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: starting mds.h at 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 bash[67518]: 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc 2024-03-28T05:47:14.568 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:14 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: daemon mds.h restarted 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: osdmap e93: 12 total, 12 up, 12 in 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:boot 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:14 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: daemon mds.h restarted 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: osdmap e93: 12 total, 12 up, 12 in 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:boot 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:14 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:15.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 1.01 MB/sec warmup 26 sec latency 13241.761 ms 2024-03-28T05:47:15.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:15 smithi055 ceph-mon[31863]: pgmap v500: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-03-28T05:47:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:15 smithi086 ceph-mon[35163]: pgmap v500: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-03-28T05:47:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:15 smithi159 ceph-mon[36109]: pgmap v500: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-03-28T05:47:16.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.97 MB/sec warmup 27 sec latency 14241.950 ms 2024-03-28T05:47:16.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:16 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:resolve 2024-03-28T05:47:16.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:16 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:16 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:resolve 2024-03-28T05:47:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:16 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:16 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:resolve 2024-03-28T05:47:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:16 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:17.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.93 MB/sec warmup 28 sec latency 15242.111 ms 2024-03-28T05:47:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:17 smithi086 ceph-mon[35163]: pgmap v502: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-03-28T05:47:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:17 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:17 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:reconnect 2024-03-28T05:47:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:17 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-mon[36109]: pgmap v502: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-03-28T05:47:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:reconnect 2024-03-28T05:47:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:17 smithi055 ceph-mon[31863]: pgmap v502: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-03-28T05:47:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:17 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:17 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:reconnect 2024-03-28T05:47:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:17 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:18.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.90 MB/sec warmup 29 sec latency 16242.201 ms 2024-03-28T05:47:18.321 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd0cce00700 time 2024-03-28T05:47:17.959777+0000 2024-03-28T05:47:18.321 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd0d87dd4a1] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.322 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: clone() 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: *** Caught signal (Aborted) ** 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: in thread 7fd0cce00700 thread_name:ms_dispatch 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:17.960+0000 7fd0cce00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd0cce00700 time 2024-03-28T05:47:17.959777+0000 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:18.323 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd0d87dd4a1] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.324 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: clone() 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd0d7564d20] 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: gsignal() 2024-03-28T05:47:18.325 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: abort() 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd0d87dd4fb] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.326 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 19: clone() 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:17.964+0000 7fd0cce00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: in thread 7fd0cce00700 thread_name:ms_dispatch 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd0d7564d20] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: gsignal() 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: abort() 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd0d87dd4fb] 2024-03-28T05:47:18.327 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 19: clone() 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: -1> 2024-03-28T05:47:17.960+0000 7fd0cce00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd0cce00700 time 2024-03-28T05:47:17.959777+0000 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd0d87dd4a1] 2024-03-28T05:47:18.329 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.330 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: clone() 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 0> 2024-03-28T05:47:17.964+0000 7fd0cce00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: in thread 7fd0cce00700 thread_name:ms_dispatch 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd0d7564d20] 2024-03-28T05:47:18.331 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: gsignal() 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: abort() 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd0d87dd4fb] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.332 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 19: clone() 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: -1> 2024-03-28T05:47:17.960+0000 7fd0cce00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd0cce00700 time 2024-03-28T05:47:17.959777+0000 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd0d87dd4a1] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.333 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: clone() 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 0> 2024-03-28T05:47:17.964+0000 7fd0cce00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: in thread 7fd0cce00700 thread_name:ms_dispatch 2024-03-28T05:47:18.334 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd0d7564d20] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2: gsignal() 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 3: abort() 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd0d87dd4fb] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd0d87dd667] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5646032fc223] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5646031765d6] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564603176da1] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5646031ab09c] 2024-03-28T05:47:18.335 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5646031c9233] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5646031cb197] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5646030ca11b] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5646030ca6bc] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5646030b41ff] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd0d8a6f488] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 16: (DispatchQueue::entry()+0x51f) [0x7fd0d8a6c60f] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd0d8b3fe81] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd0d755a1ca] 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 19: clone() 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[66978]: 2024-03-28T05:47:18.336 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 podman[69064]: 2024-03-28 05:47:18.09682762 +0000 UTC m=+0.036550420 container died cc3bbb7fc4dece217674af95588f490ad1bfc1cd567ebc8e5879f2ab482c92c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-28T05:47:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:rejoin 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:active 2024-03-28T05:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:rejoin 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:active 2024-03-28T05:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:rejoin 2024-03-28T05:47:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:47:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/673238495,v1:172.21.15.159:6839/673238495] up:active 2024-03-28T05:47:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:19.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.87 MB/sec warmup 30 sec latency 17242.310 ms 2024-03-28T05:47:19.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 podman[69064]: 2024-03-28 05:47:18.959180071 +0000 UTC m=+0.898902886 container remove cc3bbb7fc4dece217674af95588f490ad1bfc1cd567ebc8e5879f2ab482c92c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-28T05:47:19.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:18 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:47:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:19 smithi086 ceph-mon[35163]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-28T05:47:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:19 smithi159 ceph-mon[36109]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-28T05:47:19.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:47:19.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 2.553s CPU time. 2024-03-28T05:47:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:19 smithi055 ceph-mon[31863]: pgmap v503: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-28T05:47:20.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.84 MB/sec warmup 31 sec latency 18242.489 ms 2024-03-28T05:47:21.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.82 MB/sec warmup 32 sec latency 19242.618 ms 2024-03-28T05:47:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:21 smithi086 ceph-mon[35163]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-03-28T05:47:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:21 smithi159 ceph-mon[36109]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-03-28T05:47:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:21 smithi055 ceph-mon[31863]: pgmap v504: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-03-28T05:47:22.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.79 MB/sec warmup 33 sec latency 20242.783 ms 2024-03-28T05:47:23.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.77 MB/sec warmup 34 sec latency 21242.984 ms 2024-03-28T05:47:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:23 smithi086 ceph-mon[35163]: pgmap v505: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-03-28T05:47:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:23 smithi159 ceph-mon[36109]: pgmap v505: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-03-28T05:47:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:23 smithi055 ceph-mon[31863]: pgmap v505: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-03-28T05:47:24.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.75 MB/sec warmup 35 sec latency 22243.139 ms 2024-03-28T05:47:25.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.73 MB/sec warmup 36 sec latency 23243.239 ms 2024-03-28T05:47:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:25 smithi086 ceph-mon[35163]: pgmap v506: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.3 KiB/s wr, 14 op/s 2024-03-28T05:47:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:25 smithi159 ceph-mon[36109]: pgmap v506: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.3 KiB/s wr, 14 op/s 2024-03-28T05:47:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:25 smithi055 ceph-mon[31863]: pgmap v506: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.3 KiB/s wr, 14 op/s 2024-03-28T05:47:26.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.71 MB/sec warmup 37 sec latency 24243.383 ms 2024-03-28T05:47:27.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.69 MB/sec warmup 38 sec latency 25243.508 ms 2024-03-28T05:47:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:27.372+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:27.373+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-28T05:47:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:27.373+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:47:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:27.373+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:47:27.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:27.373+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:47:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:27 smithi086 ceph-mon[35163]: pgmap v507: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-03-28T05:47:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:47:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:27 smithi159 ceph-mon[36109]: pgmap v507: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-03-28T05:47:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:47:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:27 smithi055 ceph-mon[31863]: pgmap v507: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-03-28T05:47:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:47:28.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.67 MB/sec warmup 39 sec latency 26243.632 ms 2024-03-28T05:47:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:47:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:47:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:47:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:47:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:47:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:47:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:47:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:47:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:47:29.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.65 MB/sec warmup 40 sec latency 27243.786 ms 2024-03-28T05:47:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:29 smithi086 ceph-mon[35163]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-28T05:47:29.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:29 smithi159 ceph-mon[36109]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-28T05:47:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:29 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:47:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:29 smithi159 systemd[1]: Stopped Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:29 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 2.553s CPU time. 2024-03-28T05:47:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:29 smithi159 systemd[1]: Starting Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:47:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:29 smithi055 ceph-mon[31863]: pgmap v508: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-03-28T05:47:30.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.64 MB/sec warmup 41 sec latency 28243.966 ms 2024-03-28T05:47:30.232 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:29 smithi159 podman[69300]: 2024-03-28 05:47:29.871259565 +0000 UTC m=+0.035138615 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:47:30.232 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 podman[69300]: 2024-03-28 05:47:30.001945964 +0000 UTC m=+0.165825048 container create 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 podman[69300]: 2024-03-28 05:47:30.232757116 +0000 UTC m=+0.396636204 container init 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 podman[69300]: 2024-03-28 05:47:30.244508041 +0000 UTC m=+0.408387145 container start 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mds[69318]: -- 172.21.15.159:0/2206102097 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558d28b93a40 con 0x558d28b67000 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: starting mds.i at 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 bash[69300]: 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd 2024-03-28T05:47:30.521 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:30 smithi159 systemd[1]: Started Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: daemon mds.i restarted 2024-03-28T05:47:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: osdmap e94: 12 total, 12 up, 12 in 2024-03-28T05:47:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:boot 2024-03-28T05:47:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:47:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:47:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:30 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: daemon mds.i restarted 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: osdmap e94: 12 total, 12 up, 12 in 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:boot 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:30 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: daemon mds.i restarted 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: osdmap e94: 12 total, 12 up, 12 in 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:boot 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:47:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:30 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:31.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.62 MB/sec warmup 42 sec latency 29244.102 ms 2024-03-28T05:47:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:31 smithi086 ceph-mon[35163]: pgmap v509: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-28T05:47:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:31 smithi159 ceph-mon[36109]: pgmap v509: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-28T05:47:31.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:31 smithi055 ceph-mon[31863]: pgmap v509: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-03-28T05:47:32.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.61 MB/sec warmup 43 sec latency 30244.240 ms 2024-03-28T05:47:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:32 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:resolve 2024-03-28T05:47:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:32 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:32 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:resolve 2024-03-28T05:47:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:32 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:32 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:resolve 2024-03-28T05:47:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:32 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:33.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.59 MB/sec warmup 44 sec latency 31244.372 ms 2024-03-28T05:47:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:33 smithi159 ceph-mon[36109]: pgmap v511: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 7 op/s 2024-03-28T05:47:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:33 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299993 2024-03-28T05:47:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:33 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:reconnect 2024-03-28T05:47:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:33 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:33 smithi055 ceph-mon[31863]: pgmap v511: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 7 op/s 2024-03-28T05:47:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:33 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299993 2024-03-28T05:47:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:33 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:reconnect 2024-03-28T05:47:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:33 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:33 smithi086 ceph-mon[35163]: pgmap v511: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 7 op/s 2024-03-28T05:47:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:33 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299993 2024-03-28T05:47:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:33 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:reconnect 2024-03-28T05:47:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:33 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:34.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.58 MB/sec warmup 45 sec latency 32244.519 ms 2024-03-28T05:47:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:34 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:rejoin 2024-03-28T05:47:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:34 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:34 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:47:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:rejoin 2024-03-28T05:47:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f46ff200700 time 2024-03-28T05:47:34.621260+0000 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f470aa2f4a1] 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: clone() 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:34 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:rejoin 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:34 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:34 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:34.622+0000 7f46ff200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f46ff200700 time 2024-03-28T05:47:34.621260+0000 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f470aa2f4a1] 2024-03-28T05:47:35.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: clone() 2024-03-28T05:47:35.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: *** Caught signal (Aborted) ** 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: in thread 7f46ff200700 thread_name:ms_dispatch 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47097b6d20] 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: gsignal() 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: abort() 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f470aa2f4fb] 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 19: clone() 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:34.625+0000 7f46ff200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: in thread 7f46ff200700 thread_name:ms_dispatch 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47097b6d20] 2024-03-28T05:47:35.073 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: gsignal() 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: abort() 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f470aa2f4fb] 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 19: clone() 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: -1> 2024-03-28T05:47:34.622+0000 7f46ff200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f46ff200700 time 2024-03-28T05:47:34.621260+0000 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f470aa2f4a1] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: clone() 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 0> 2024-03-28T05:47:34.625+0000 7f46ff200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: in thread 7f46ff200700 thread_name:ms_dispatch 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47097b6d20] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: gsignal() 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: abort() 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f470aa2f4fb] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 19: clone() 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: -1> 2024-03-28T05:47:34.622+0000 7f46ff200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f46ff200700 time 2024-03-28T05:47:34.621260+0000 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f470aa2f4a1] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: clone() 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 0> 2024-03-28T05:47:34.625+0000 7f46ff200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: in thread 7f46ff200700 thread_name:ms_dispatch 2024-03-28T05:47:35.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47097b6d20] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2: gsignal() 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 3: abort() 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f470aa2f4fb] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f470aa2f667] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56156c487223] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56156c3015d6] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56156c301da1] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56156c33609c] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56156c354233] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56156c356197] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56156c25511b] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56156c2556bc] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56156c23f1ff] 2024-03-28T05:47:35.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f470acc1488] 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 16: (DispatchQueue::entry()+0x51f) [0x7f470acbe60f] 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f470ad91e81] 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f47097ac1ca] 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 19: clone() 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67534]: 2024-03-28T05:47:35.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:34 smithi086 podman[67708]: 2024-03-28 05:47:34.713982118 +0000 UTC m=+0.031880726 container died 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True) 2024-03-28T05:47:35.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.57 MB/sec warmup 46 sec latency 33244.676 ms 2024-03-28T05:47:35.538 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:35 smithi086 podman[67708]: 2024-03-28 05:47:35.539865117 +0000 UTC m=+0.857763732 container remove 41298aaa1cc67fdb6478d0fc9d5e28858b863112db3074b6f882b27b0799d9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:35 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: pgmap v512: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:active 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: pgmap v512: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:active 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: pgmap v512: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2438181589,v1:172.21.15.86:6837/2438181589] up:active 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:36.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.56 MB/sec warmup 47 sec latency 34244.842 ms 2024-03-28T05:47:36.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:35 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:47:36.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:35 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.293s CPU time. 2024-03-28T05:47:37.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.54 MB/sec warmup 48 sec latency 35244.995 ms 2024-03-28T05:47:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:37 smithi086 ceph-mon[35163]: pgmap v513: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:47:37.817 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:47:37 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:47:37.655+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:47:37.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:37 smithi055 ceph-mon[31863]: pgmap v513: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:47:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:37 smithi159 ceph-mon[36109]: pgmap v513: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:47:38.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.53 MB/sec warmup 49 sec latency 36245.139 ms 2024-03-28T05:47:39.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.52 MB/sec warmup 50 sec latency 37245.273 ms 2024-03-28T05:47:39.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:39 smithi055 ceph-mon[31863]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-03-28T05:47:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:39 smithi086 ceph-mon[35163]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-03-28T05:47:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:39 smithi159 ceph-mon[36109]: pgmap v514: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-03-28T05:47:40.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.51 MB/sec warmup 51 sec latency 38245.389 ms 2024-03-28T05:47:41.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.50 MB/sec warmup 52 sec latency 39245.545 ms 2024-03-28T05:47:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:41 smithi055 ceph-mon[31863]: pgmap v515: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-03-28T05:47:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:41 smithi086 ceph-mon[35163]: pgmap v515: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-03-28T05:47:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:41 smithi159 ceph-mon[36109]: pgmap v515: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-03-28T05:47:42.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.49 MB/sec warmup 53 sec latency 40245.683 ms 2024-03-28T05:47:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:42.389+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:42.389+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:47:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:42.390+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:47:43.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.48 MB/sec warmup 54 sec latency 41245.845 ms 2024-03-28T05:47:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:43 smithi086 ceph-mon[35163]: pgmap v516: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-28T05:47:44.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:43 smithi159 ceph-mon[36109]: pgmap v516: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-28T05:47:44.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.48 MB/sec warmup 55 sec latency 42245.948 ms 2024-03-28T05:47:44.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:43 smithi055 ceph-mon[31863]: pgmap v516: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-28T05:47:45.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.47 MB/sec warmup 56 sec latency 43246.039 ms 2024-03-28T05:47:45.924 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:45 smithi055 ceph-mon[31863]: pgmap v517: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-03-28T05:47:46.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:45 smithi086 ceph-mon[35163]: pgmap v517: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-03-28T05:47:46.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:45 smithi159 ceph-mon[36109]: pgmap v517: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-03-28T05:47:46.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.46 MB/sec warmup 57 sec latency 44246.197 ms 2024-03-28T05:47:46.432 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:47:46.432 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:46.432 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.293s CPU time. 2024-03-28T05:47:46.432 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:47:46.760 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 podman[67813]: 2024-03-28 05:47:46.340124703 +0000 UTC m=+0.033356960 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:47:46.760 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 podman[67813]: 2024-03-28 05:47:46.44950735 +0000 UTC m=+0.142739622 container create 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:47:46.760 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 podman[67813]: 2024-03-28 05:47:46.761103183 +0000 UTC m=+0.454335463 container init 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:47:47.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 podman[67813]: 2024-03-28 05:47:46.772717339 +0000 UTC m=+0.465949603 container start 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:47:47.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 ceph-mds[67830]: -- 172.21.15.86:0/3293032080 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5648b7347a40 con 0x5648b731b000 2024-03-28T05:47:47.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: starting mds.h at 2024-03-28T05:47:47.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 bash[67813]: 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a 2024-03-28T05:47:47.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:47:46 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:47:47.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.45 MB/sec warmup 58 sec latency 45246.352 ms 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: pgmap v518: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: daemon mds.h restarted 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: osdmap e95: 12 total, 12 up, 12 in 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:boot 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:47 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: pgmap v518: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: daemon mds.h restarted 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: osdmap e95: 12 total, 12 up, 12 in 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:boot 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:47 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:48.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.44 MB/sec warmup 59 sec latency 46246.509 ms 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: pgmap v518: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: daemon mds.h restarted 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: osdmap e95: 12 total, 12 up, 12 in 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:boot 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:47:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:47 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:49.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.44 MB/sec warmup 60 sec latency 47246.664 ms 2024-03-28T05:47:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:49 smithi086 ceph-mon[35163]: pgmap v520: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:47:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:49 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:resolve 2024-03-28T05:47:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:49 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:50.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:49 smithi159 ceph-mon[36109]: pgmap v520: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:47:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:49 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:resolve 2024-03-28T05:47:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:49 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:50.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.43 MB/sec warmup 61 sec latency 48246.832 ms 2024-03-28T05:47:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:49 smithi055 ceph-mon[31863]: pgmap v520: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:47:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:49 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:resolve 2024-03-28T05:47:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:49 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:50 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:50 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:reconnect 2024-03-28T05:47:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:50 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:51.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:50 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:51.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:50 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:reconnect 2024-03-28T05:47:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:50 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:51.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.42 MB/sec warmup 62 sec latency 49246.989 ms 2024-03-28T05:47:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:50 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:47:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:50 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:reconnect 2024-03-28T05:47:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:50 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:51 smithi086 ceph-mon[35163]: pgmap v521: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:47:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:51 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:rejoin 2024-03-28T05:47:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:51 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:51 smithi086 ceph-mon[35163]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:52.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-mon[36109]: pgmap v521: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:47:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:rejoin 2024-03-28T05:47:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-mon[36109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f622b800700 time 2024-03-28T05:47:51.722863+0000 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f623700b4a1] 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.070 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.071 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: clone() 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:51.726+0000 7f622b800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f622b800700 time 2024-03-28T05:47:51.722863+0000 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.072 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f623700b4a1] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.073 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: clone() 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: *** Caught signal (Aborted) ** 2024-03-28T05:47:52.074 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: in thread 7f622b800700 thread_name:ms_dispatch 2024-03-28T05:47:52.075 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.075 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6235d92d20] 2024-03-28T05:47:52.075 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: gsignal() 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: abort() 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f623700b4fb] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.076 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 19: clone() 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:51.733+0000 7f622b800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:52.077 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: in thread 7f622b800700 thread_name:ms_dispatch 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6235d92d20] 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: gsignal() 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: abort() 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f623700b4fb] 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.078 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.079 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 19: clone() 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: -1> 2024-03-28T05:47:51.726+0000 7f622b800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f622b800700 time 2024-03-28T05:47:51.722863+0000 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f623700b4a1] 2024-03-28T05:47:52.080 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.081 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.081 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.082 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: clone() 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 0> 2024-03-28T05:47:51.733+0000 7f622b800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: in thread 7f622b800700 thread_name:ms_dispatch 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6235d92d20] 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: gsignal() 2024-03-28T05:47:52.083 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: abort() 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f623700b4fb] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.084 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 19: clone() 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: -1> 2024-03-28T05:47:51.726+0000 7f622b800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f622b800700 time 2024-03-28T05:47:51.722863+0000 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.085 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f623700b4a1] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.086 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: clone() 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 0> 2024-03-28T05:47:51.733+0000 7f622b800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: in thread 7f622b800700 thread_name:ms_dispatch 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.087 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6235d92d20] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2: gsignal() 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 3: abort() 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f623700b4fb] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f623700b667] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558d27ba2223] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558d27a1c5d6] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558d27a1cda1] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558d27a5109c] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558d27a6f233] 2024-03-28T05:47:52.088 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558d27a71197] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558d2797011b] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558d279706bc] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558d2795a1ff] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f623729d488] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 16: (DispatchQueue::entry()+0x51f) [0x7f623729a60f] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f623736de81] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6235d881ca] 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 19: clone() 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:47:52.089 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69314]: 2024-03-28T05:47:52.090 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:51 smithi159 podman[69353]: 2024-03-28 05:47:51.859994333 +0000 UTC m=+0.035622577 container died 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:47:52.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.42 MB/sec warmup 63 sec latency 50247.129 ms 2024-03-28T05:47:52.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:51 smithi055 ceph-mon[31863]: pgmap v521: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:47:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:51 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:rejoin 2024-03-28T05:47:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:51 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:51 smithi055 ceph-mon[31863]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:47:53.044 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:52 smithi159 podman[69353]: 2024-03-28 05:47:52.598948238 +0000 UTC m=+0.774576526 container remove 405888562de1ed3e3041a86e1e541ea54bb62cbf08b5507e9d27f77995b4febd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:47:53.044 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:52 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:47:53.044 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:52 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:53.044 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:52 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:47:53.044 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:52 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:active 2024-03-28T05:47:53.045 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:53.045 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:53.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:47:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:active 2024-03-28T05:47:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:53.067 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:47:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:47:52.656+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:47:53.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.41 MB/sec warmup 64 sec latency 51247.275 ms 2024-03-28T05:47:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:52 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:47:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:52 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:47:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:52 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/3145512970,v1:172.21.15.159:6839/3145512970] up:active 2024-03-28T05:47:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:47:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:47:53.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:53 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:47:53.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:47:53 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.596s CPU time. 2024-03-28T05:47:54.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:53 smithi086 ceph-mon[35163]: pgmap v522: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:47:54.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:53 smithi159 ceph-mon[36109]: pgmap v522: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:47:54.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.40 MB/sec warmup 65 sec latency 52247.409 ms 2024-03-28T05:47:54.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:53 smithi055 ceph-mon[31863]: pgmap v522: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:47:55.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.40 MB/sec warmup 66 sec latency 53247.572 ms 2024-03-28T05:47:56.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:55 smithi086 ceph-mon[35163]: pgmap v523: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-03-28T05:47:56.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:55 smithi159 ceph-mon[36109]: pgmap v523: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-03-28T05:47:56.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.39 MB/sec warmup 67 sec latency 54247.734 ms 2024-03-28T05:47:56.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:55 smithi055 ceph-mon[31863]: pgmap v523: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-03-28T05:47:57.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.38 MB/sec warmup 68 sec latency 55247.904 ms 2024-03-28T05:47:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:57.404+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:47:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:57.406+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-28T05:47:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:57.406+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:47:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:57.406+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:47:57.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:47:57.406+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:47:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:57 smithi086 ceph-mon[35163]: pgmap v524: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-03-28T05:47:58.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:57 smithi159 ceph-mon[36109]: pgmap v524: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-03-28T05:47:58.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.38 MB/sec warmup 69 sec latency 56248.046 ms 2024-03-28T05:47:58.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:57 smithi055 ceph-mon[31863]: pgmap v524: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-03-28T05:47:59.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.37 MB/sec warmup 70 sec latency 57248.172 ms 2024-03-28T05:48:00.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:47:59 smithi086 ceph-mon[35163]: pgmap v525: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:00.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:47:59 smithi159 ceph-mon[36109]: pgmap v525: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:00.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.37 MB/sec warmup 71 sec latency 58248.315 ms 2024-03-28T05:48:00.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:47:59 smithi055 ceph-mon[31863]: pgmap v525: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:01.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.36 MB/sec warmup 72 sec latency 59248.448 ms 2024-03-28T05:48:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:01 smithi086 ceph-mon[35163]: pgmap v526: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:02.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:01 smithi159 ceph-mon[36109]: pgmap v526: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:02.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.36 MB/sec warmup 73 sec latency 60248.609 ms 2024-03-28T05:48:02.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:01 smithi055 ceph-mon[31863]: pgmap v526: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:03.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.35 MB/sec warmup 74 sec latency 61248.743 ms 2024-03-28T05:48:03.705 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:48:03.705 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 systemd[1]: Stopped Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:03.705 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.596s CPU time. 2024-03-28T05:48:03.705 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 systemd[1]: Starting Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:48:04.026 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:03 smithi159 ceph-mon[36109]: pgmap v527: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:04.027 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 podman[69456]: 2024-03-28 05:48:03.612895864 +0000 UTC m=+0.033523791 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:48:04.027 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:03 smithi159 podman[69456]: 2024-03-28 05:48:03.750804598 +0000 UTC m=+0.171432616 container create 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:48:04.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:03 smithi086 ceph-mon[35163]: pgmap v527: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:04.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.35 MB/sec warmup 75 sec latency 62248.883 ms 2024-03-28T05:48:04.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:03 smithi055 ceph-mon[31863]: pgmap v527: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 podman[69456]: 2024-03-28 05:48:04.028174075 +0000 UTC m=+0.448802047 container init 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 podman[69456]: 2024-03-28 05:48:04.038845644 +0000 UTC m=+0.459473609 container start 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mds[69475]: -- 172.21.15.159:0/1630088775 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f18e79da40 con 0x55f18e770c00 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: starting mds.i at 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 bash[69456]: 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b 2024-03-28T05:48:04.319 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:04 smithi159 systemd[1]: Started Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: daemon mds.i restarted 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: osdmap e96: 12 total, 12 up, 12 in 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:boot 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:04 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: daemon mds.i restarted 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: osdmap e96: 12 total, 12 up, 12 in 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:boot 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:04 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:05.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.34 MB/sec warmup 76 sec latency 63249.043 ms 2024-03-28T05:48:05.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: daemon mds.i restarted 2024-03-28T05:48:05.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: osdmap e96: 12 total, 12 up, 12 in 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:boot 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:04 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:06.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:05 smithi086 ceph-mon[35163]: pgmap v528: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:06.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:05 smithi159 ceph-mon[36109]: pgmap v528: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:06.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.34 MB/sec warmup 77 sec latency 64249.142 ms 2024-03-28T05:48:06.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:05 smithi055 ceph-mon[31863]: pgmap v528: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-03-28T05:48:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:06 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:resolve 2024-03-28T05:48:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:06 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:07.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:06 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:resolve 2024-03-28T05:48:07.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:06 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:07.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.34 MB/sec warmup 78 sec latency 65249.263 ms 2024-03-28T05:48:07.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:06 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:resolve 2024-03-28T05:48:07.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:06 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:08.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-mon[35163]: pgmap v530: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:48:08.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:08.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:reconnect 2024-03-28T05:48:08.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:08.064 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f7666e00700 time 2024-03-28T05:48:07.980851+0000 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f76726614a1] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: clone() 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:07.982+0000 7f7666e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f7666e00700 time 2024-03-28T05:48:07.980851+0000 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f76726614a1] 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.067 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: clone() 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: *** Caught signal (Aborted) ** 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: in thread 7f7666e00700 thread_name:ms_dispatch 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f76713e8d20] 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: gsignal() 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: abort() 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f76726614fb] 2024-03-28T05:48:08.069 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.070 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 19: clone() 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:07.984+0000 7f7666e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: in thread 7f7666e00700 thread_name:ms_dispatch 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f76713e8d20] 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: gsignal() 2024-03-28T05:48:08.071 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: abort() 2024-03-28T05:48:08.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f76726614fb] 2024-03-28T05:48:08.072 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:07 smithi159 ceph-mon[36109]: pgmap v530: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:48:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:07 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:07 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:reconnect 2024-03-28T05:48:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:07 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.074 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 19: clone() 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:08.075 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: -1> 2024-03-28T05:48:07.982+0000 7f7666e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f7666e00700 time 2024-03-28T05:48:07.980851+0000 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f76726614a1] 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.076 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.077 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: clone() 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 0> 2024-03-28T05:48:07.984+0000 7f7666e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: in thread 7f7666e00700 thread_name:ms_dispatch 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f76713e8d20] 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: gsignal() 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: abort() 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f76726614fb] 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.078 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.079 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 19: clone() 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: -1> 2024-03-28T05:48:07.982+0000 7f7666e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f7666e00700 time 2024-03-28T05:48:07.980851+0000 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.080 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f76726614a1] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.081 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: clone() 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 0> 2024-03-28T05:48:07.984+0000 7f7666e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: in thread 7f7666e00700 thread_name:ms_dispatch 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:08.082 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f76713e8d20] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2: gsignal() 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 3: abort() 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f76726614fb] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f7672661667] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5648b53fd223] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5648b52775d6] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5648b5277da1] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5648b52ac09c] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5648b52ca233] 2024-03-28T05:48:08.083 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5648b52cc197] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5648b51cb11b] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5648b51cb6bc] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5648b51b51ff] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f76728f3488] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 16: (DispatchQueue::entry()+0x51f) [0x7f76728f060f] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f76729c3e81] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f76713de1ca] 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 19: clone() 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67826]: 2024-03-28T05:48:08.084 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 podman[67866]: 2024-03-28 05:48:08.065187973 +0000 UTC m=+0.031980661 container died 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240319) 2024-03-28T05:48:08.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.33 MB/sec warmup 79 sec latency 66249.419 ms 2024-03-28T05:48:08.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:07 smithi055 ceph-mon[31863]: pgmap v530: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:48:08.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:07 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:08.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:07 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:reconnect 2024-03-28T05:48:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:07 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:rejoin 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:active 2024-03-28T05:48:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:08 smithi086 ceph-mon[35163]: pgmap v531: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:48:09.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 podman[67866]: 2024-03-28 05:48:08.965224596 +0000 UTC m=+0.932017321 container remove 1c67363e7aaceefcd2ab3e21bc4d658853290291fd4bf4828c126d120c59364a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240319, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-28T05:48:09.068 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:08 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:rejoin 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:active 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:08 smithi159 ceph-mon[36109]: pgmap v531: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:48:09.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.33 MB/sec warmup 80 sec latency 67249.574 ms 2024-03-28T05:48:09.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:rejoin 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2686345738,v1:172.21.15.86:6837/2686345738] up:active 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:08 smithi055 ceph-mon[31863]: pgmap v531: 97 pgs: 97 active+clean; 22 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-28T05:48:09.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:09 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:48:09.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:09 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.362s CPU time. 2024-03-28T05:48:10.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.32 MB/sec warmup 81 sec latency 68249.748 ms 2024-03-28T05:48:11.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.32 MB/sec warmup 82 sec latency 69249.931 ms 2024-03-28T05:48:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:11 smithi086 ceph-mon[35163]: pgmap v532: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:48:11.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:11 smithi159 ceph-mon[36109]: pgmap v532: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:48:11.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:11 smithi055 ceph-mon[31863]: pgmap v532: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:48:12.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.32 MB/sec warmup 83 sec latency 70250.087 ms 2024-03-28T05:48:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:12.407+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:48:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:12.407+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:48:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:12.407+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:48:13.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.31 MB/sec warmup 84 sec latency 71250.234 ms 2024-03-28T05:48:13.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:13 smithi086 ceph-mon[35163]: pgmap v533: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:48:13.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:13 smithi159 ceph-mon[36109]: pgmap v533: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:48:13.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:13 smithi055 ceph-mon[31863]: pgmap v533: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:48:14.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.31 MB/sec warmup 85 sec latency 72250.352 ms 2024-03-28T05:48:15.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.30 MB/sec warmup 86 sec latency 73250.543 ms 2024-03-28T05:48:15.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:15 smithi086 ceph-mon[35163]: pgmap v534: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:15.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:15 smithi159 ceph-mon[36109]: pgmap v534: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:15.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:15 smithi055 ceph-mon[31863]: pgmap v534: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:16.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.30 MB/sec warmup 87 sec latency 74250.701 ms 2024-03-28T05:48:17.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.30 MB/sec warmup 88 sec latency 75250.874 ms 2024-03-28T05:48:17.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:17 smithi086 ceph-mon[35163]: pgmap v535: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:17.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:17 smithi159 ceph-mon[36109]: pgmap v535: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:17.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:17 smithi055 ceph-mon[31863]: pgmap v535: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:18.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.29 MB/sec warmup 89 sec latency 76250.964 ms 2024-03-28T05:48:19.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.29 MB/sec warmup 90 sec latency 77251.063 ms 2024-03-28T05:48:19.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:19 smithi086 ceph-mon[35163]: pgmap v536: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:19.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:19 smithi159 ceph-mon[36109]: pgmap v536: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:19.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:19 smithi055 ceph-mon[31863]: pgmap v536: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:19.999 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:19 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:48:20.000 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:19 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:20.000 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:19 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.362s CPU time. 2024-03-28T05:48:20.000 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:19 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:48:20.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.29 MB/sec warmup 91 sec latency 78251.167 ms 2024-03-28T05:48:20.260 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 podman[67957]: 2024-03-28 05:48:19.9119655 +0000 UTC m=+0.039783172 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:48:20.261 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 podman[67957]: 2024-03-28 05:48:20.057688617 +0000 UTC m=+0.185506278 container create b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-28T05:48:20.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 podman[67957]: 2024-03-28 05:48:20.344458387 +0000 UTC m=+0.472276079 container init b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2) 2024-03-28T05:48:20.817 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 podman[67957]: 2024-03-28 05:48:20.356202447 +0000 UTC m=+0.484020109 container start b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:48:20.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 ceph-mds[67976]: -- 172.21.15.86:0/2201834293 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aca6195a40 con 0x55aca6169000 2024-03-28T05:48:20.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: starting mds.h at 2024-03-28T05:48:20.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 bash[67957]: b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb 2024-03-28T05:48:20.818 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:20 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:21.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.28 MB/sec warmup 92 sec latency 79251.324 ms 2024-03-28T05:48:21.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: pgmap v537: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-28T05:48:21.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: daemon mds.h restarted 2024-03-28T05:48:21.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:21.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: osdmap e97: 12 total, 12 up, 12 in 2024-03-28T05:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:boot 2024-03-28T05:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:21 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: pgmap v537: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: daemon mds.h restarted 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: osdmap e97: 12 total, 12 up, 12 in 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:boot 2024-03-28T05:48:21.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:21 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:21.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: pgmap v537: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-28T05:48:21.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: daemon mds.h restarted 2024-03-28T05:48:21.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: osdmap e97: 12 total, 12 up, 12 in 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:boot 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:21 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:22.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.28 MB/sec warmup 93 sec latency 80251.446 ms 2024-03-28T05:48:22.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:22 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:resolve 2024-03-28T05:48:22.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:22 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:22.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:22 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:resolve 2024-03-28T05:48:22.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:22 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:22.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:22 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:resolve 2024-03-28T05:48:22.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:22 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:23.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.28 MB/sec warmup 94 sec latency 81251.571 ms 2024-03-28T05:48:23.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:23 smithi086 ceph-mon[35163]: pgmap v539: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-28T05:48:23.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:23 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:23.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:23 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:reconnect 2024-03-28T05:48:23.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:23 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:23.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:23 smithi159 ceph-mon[36109]: pgmap v539: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-28T05:48:23.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:23 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:23.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:23 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:reconnect 2024-03-28T05:48:23.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:23 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:23.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:23 smithi055 ceph-mon[31863]: pgmap v539: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-28T05:48:23.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:23 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:23.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:23 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:reconnect 2024-03-28T05:48:23.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:23 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:24.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.28 MB/sec warmup 95 sec latency 82251.729 ms 2024-03-28T05:48:24.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:rejoin 2024-03-28T05:48:24.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:24 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:24.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:24 smithi086 ceph-mon[35163]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:24.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:rejoin 2024-03-28T05:48:24.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:24.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-mon[36109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:24.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd131200700 time 2024-03-28T05:48:24.518955+0000 2024-03-28T05:48:24.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:24.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd13cab64a1] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: clone() 2024-03-28T05:48:24.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.521+0000 7fd131200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd131200700 time 2024-03-28T05:48:24.518955+0000 2024-03-28T05:48:24.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:24.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd13cab64a1] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: clone() 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: *** Caught signal (Aborted) ** 2024-03-28T05:48:24.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: in thread 7fd131200700 thread_name:ms_dispatch 2024-03-28T05:48:24.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd13b83dd20] 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: gsignal() 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: abort() 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd13cab64fb] 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 19: clone() 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.526+0000 7fd131200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: in thread 7fd131200700 thread_name:ms_dispatch 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd13b83dd20] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: gsignal() 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: abort() 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd13cab64fb] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 19: clone() 2024-03-28T05:48:24.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: -1> 2024-03-28T05:48:24.521+0000 7fd131200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd131200700 time 2024-03-28T05:48:24.518955+0000 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd13cab64a1] 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: clone() 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 0> 2024-03-28T05:48:24.526+0000 7fd131200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: in thread 7fd131200700 thread_name:ms_dispatch 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd13b83dd20] 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: gsignal() 2024-03-28T05:48:24.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: abort() 2024-03-28T05:48:24.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd13cab64fb] 2024-03-28T05:48:24.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 19: clone() 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: -1> 2024-03-28T05:48:24.521+0000 7fd131200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd131200700 time 2024-03-28T05:48:24.518955+0000 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd13cab64a1] 2024-03-28T05:48:24.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: clone() 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 0> 2024-03-28T05:48:24.526+0000 7fd131200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: in thread 7fd131200700 thread_name:ms_dispatch 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd13b83dd20] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2: gsignal() 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 3: abort() 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd13cab64fb] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd13cab6667] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55f18bf90223] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55f18be0a5d6] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55f18be0ada1] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55f18be3f09c] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55f18be5d233] 2024-03-28T05:48:24.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f18be5f197] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f18bd5e11b] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f18bd5e6bc] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55f18bd481ff] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd13cd48488] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 16: (DispatchQueue::entry()+0x51f) [0x7fd13cd4560f] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd13ce18e81] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd13b8331ca] 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 19: clone() 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:24.840 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69471]: 2024-03-28T05:48:24.841 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:24 smithi159 podman[69509]: 2024-03-28 05:48:24.638467808 +0000 UTC m=+0.033153022 container died 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-28T05:48:24.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:rejoin 2024-03-28T05:48:24.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:24 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:24.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:24 smithi055 ceph-mon[31863]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:25.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.27 MB/sec warmup 96 sec latency 83251.888 ms 2024-03-28T05:48:25.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:25 smithi159 podman[69509]: 2024-03-28 05:48:25.27201065 +0000 UTC m=+0.666695897 container remove 1e3289589044bf996640f957039fe1bda68111d67ef2ed79a70d664c767b717b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-28T05:48:25.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:25 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:48:25.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: pgmap v540: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:48:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:48:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:active 2024-03-28T05:48:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:25 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: pgmap v540: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:active 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:25.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:25 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: pgmap v540: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:48:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:48:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/611553321,v1:172.21.15.159:6839/611553321] up:active 2024-03-28T05:48:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:25 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:26.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:25 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:48:26.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:25 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.541s CPU time. 2024-03-28T05:48:26.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.27 MB/sec warmup 97 sec latency 84252.031 ms 2024-03-28T05:48:27.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.27 MB/sec warmup 98 sec latency 85252.166 ms 2024-03-28T05:48:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:27.424+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:48:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:27.425+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-28T05:48:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:27.425+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:48:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:27.425+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:48:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:27.425+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:48:27.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:27 smithi086 ceph-mon[35163]: pgmap v541: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:48:27.817 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:48:27 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:48:27.659+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:48:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:27 smithi159 ceph-mon[36109]: pgmap v541: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:48:27.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:27 smithi055 ceph-mon[31863]: pgmap v541: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:48:28.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.26 MB/sec warmup 99 sec latency 86252.297 ms 2024-03-28T05:48:28.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:48:28.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:48:28.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:48:29.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.26 MB/sec warmup 100 sec latency 87252.379 ms 2024-03-28T05:48:29.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:29 smithi086 ceph-mon[35163]: pgmap v542: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:48:29.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:29 smithi159 ceph-mon[36109]: pgmap v542: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:48:29.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:29 smithi055 ceph-mon[31863]: pgmap v542: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-03-28T05:48:30.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.26 MB/sec warmup 101 sec latency 88252.457 ms 2024-03-28T05:48:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:48:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:48:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:48:30.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:48:30.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:48:30.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:48:30.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:48:30.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:48:30.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:48:31.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.26 MB/sec warmup 102 sec latency 89252.599 ms 2024-03-28T05:48:32.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:31 smithi086 ceph-mon[35163]: pgmap v543: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:32.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:31 smithi159 ceph-mon[36109]: pgmap v543: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:32.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.25 MB/sec warmup 103 sec latency 90252.694 ms 2024-03-28T05:48:32.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:31 smithi055 ceph-mon[31863]: pgmap v543: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-28T05:48:33.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.25 MB/sec warmup 104 sec latency 91252.857 ms 2024-03-28T05:48:34.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:33 smithi086 ceph-mon[35163]: pgmap v544: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-03-28T05:48:34.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:33 smithi159 ceph-mon[36109]: pgmap v544: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-03-28T05:48:34.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.25 MB/sec warmup 105 sec latency 92252.960 ms 2024-03-28T05:48:34.120 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:33 smithi055 ceph-mon[31863]: pgmap v544: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-03-28T05:48:35.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.25 MB/sec warmup 106 sec latency 93253.126 ms 2024-03-28T05:48:36.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:35 smithi086 ceph-mon[35163]: pgmap v545: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:36.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:35 smithi159 ceph-mon[36109]: pgmap v545: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:36.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:35 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:48:36.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:35 smithi159 systemd[1]: Stopped Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:36.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:35 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.541s CPU time. 2024-03-28T05:48:36.068 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:35 smithi159 systemd[1]: Starting Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:48:36.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.24 MB/sec warmup 107 sec latency 94253.224 ms 2024-03-28T05:48:36.120 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:35 smithi055 ceph-mon[31863]: pgmap v545: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:36.475 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 podman[69736]: 2024-03-28 05:48:36.107381177 +0000 UTC m=+0.031330964 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:48:36.475 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 podman[69736]: 2024-03-28 05:48:36.230980224 +0000 UTC m=+0.154930042 container create 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True) 2024-03-28T05:48:36.475 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 podman[69736]: 2024-03-28 05:48:36.476522351 +0000 UTC m=+0.400472176 container init 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-28T05:48:36.808 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 podman[69736]: 2024-03-28 05:48:36.486369647 +0000 UTC m=+0.410319472 container start 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:48:36.808 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mds[69754]: -- 172.21.15.159:0/3887711211 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556aa487fa40 con 0x556aa4852800 2024-03-28T05:48:36.808 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: starting mds.i at 2024-03-28T05:48:36.808 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 bash[69736]: 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc 2024-03-28T05:48:36.808 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:36 smithi159 systemd[1]: Started Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: daemon mds.i restarted 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: osdmap e98: 12 total, 12 up, 12 in 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:boot 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:36 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: daemon mds.i restarted 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: osdmap e98: 12 total, 12 up, 12 in 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:boot 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:37.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:36 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:37.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.24 MB/sec warmup 108 sec latency 95253.382 ms 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: daemon mds.i restarted 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: osdmap e98: 12 total, 12 up, 12 in 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:boot 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:48:37.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:36 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:38.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:37 smithi086 ceph-mon[35163]: pgmap v546: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:38.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:37 smithi159 ceph-mon[36109]: pgmap v546: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:38.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.24 MB/sec warmup 109 sec latency 96253.522 ms 2024-03-28T05:48:38.120 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:37 smithi055 ceph-mon[31863]: pgmap v546: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:39.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.24 MB/sec warmup 110 sec latency 97253.676 ms 2024-03-28T05:48:39.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:38 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:resolve 2024-03-28T05:48:39.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:38 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:39.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:38 smithi055 ceph-mon[31863]: pgmap v548: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:48:39.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:38 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:resolve 2024-03-28T05:48:39.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:38 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:39.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:38 smithi086 ceph-mon[35163]: pgmap v548: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:48:39.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:38 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:resolve 2024-03-28T05:48:39.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:38 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:39.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:38 smithi159 ceph-mon[36109]: pgmap v548: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:48:40.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.24 MB/sec warmup 111 sec latency 98253.836 ms 2024-03-28T05:48:40.120 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:39 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:40.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:39 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:reconnect 2024-03-28T05:48:40.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:39 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:40.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:39 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:40.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:39 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:reconnect 2024-03-28T05:48:40.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:39 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:40.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:39 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:48:40.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:39 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:reconnect 2024-03-28T05:48:40.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:39 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:41.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.23 MB/sec warmup 112 sec latency 99253.971 ms 2024-03-28T05:48:41.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:40 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:rejoin 2024-03-28T05:48:41.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:40 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:41.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:40 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:41.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:40 smithi055 ceph-mon[31863]: pgmap v549: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:48:41.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:rejoin 2024-03-28T05:48:41.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:41.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:41.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-mon[35163]: pgmap v549: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0df2600700 time 2024-03-28T05:48:40.907584+0000 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0dfde244a1] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: clone() 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:40 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:rejoin 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:40 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:40 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:40 smithi159 ceph-mon[36109]: pgmap v549: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:40.908+0000 7f0df2600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0df2600700 time 2024-03-28T05:48:40.907584+0000 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0dfde244a1] 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: clone() 2024-03-28T05:48:41.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: *** Caught signal (Aborted) ** 2024-03-28T05:48:41.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: in thread 7f0df2600700 thread_name:ms_dispatch 2024-03-28T05:48:41.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0dfcbabd20] 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: gsignal() 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: abort() 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0dfde244fb] 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 19: clone() 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:40.911+0000 7f0df2600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: in thread 7f0df2600700 thread_name:ms_dispatch 2024-03-28T05:48:41.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0dfcbabd20] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: gsignal() 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: abort() 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0dfde244fb] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 19: clone() 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: -1> 2024-03-28T05:48:40.908+0000 7f0df2600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0df2600700 time 2024-03-28T05:48:40.907584+0000 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0dfde244a1] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: clone() 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 0> 2024-03-28T05:48:40.911+0000 7f0df2600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: in thread 7f0df2600700 thread_name:ms_dispatch 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0dfcbabd20] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: gsignal() 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: abort() 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0dfde244fb] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 19: clone() 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: -1> 2024-03-28T05:48:40.908+0000 7f0df2600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0df2600700 time 2024-03-28T05:48:40.907584+0000 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0dfde244a1] 2024-03-28T05:48:41.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: clone() 2024-03-28T05:48:41.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 0> 2024-03-28T05:48:40.911+0000 7f0df2600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: in thread 7f0df2600700 thread_name:ms_dispatch 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0dfcbabd20] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2: gsignal() 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 3: abort() 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0dfde244fb] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0dfde24667] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55aca45f5223] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55aca446f5d6] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55aca446fda1] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55aca44a409c] 2024-03-28T05:48:41.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55aca44c2233] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55aca44c4197] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55aca43c311b] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55aca43c36bc] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55aca43ad1ff] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0dfe0b6488] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 16: (DispatchQueue::entry()+0x51f) [0x7f0dfe0b360f] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0dfe186e81] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0dfcba11ca] 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 19: clone() 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:40 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[67972]: 2024-03-28T05:48:41.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:41 smithi086 podman[68143]: 2024-03-28 05:48:41.019725326 +0000 UTC m=+0.031914812 container died b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.build-date=20240319, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:41 smithi086 podman[68143]: 2024-03-28 05:48:41.722337954 +0000 UTC m=+0.734527444 container remove b5836ac811c0e1fac8277670f86d52c4c068aaee6885f6c7f3b230c265240ccb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319) 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:41 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:41 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:41 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:active 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:41 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:42.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:41 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:42.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.23 MB/sec warmup 113 sec latency 100254.078 ms 2024-03-28T05:48:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:41 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:41 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:48:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:active 2024-03-28T05:48:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:41 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:41 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:41 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:41 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:48:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/415139496,v1:172.21.15.86:6837/415139496] up:active 2024-03-28T05:48:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:41 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:41 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:42.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:42.437+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.86:6836/2422548949 2024-03-28T05:48:42.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:42.437+0000 7f531ea00640 1 client.15693 ms_handle_refused on v2:172.21.15.86:6836/2422548949 2024-03-28T05:48:42.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:42.437+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:48:42.565 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:42 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:48:42.566 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:42 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.445s CPU time. 2024-03-28T05:48:43.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:42 smithi086 ceph-mon[35163]: pgmap v550: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:48:43.066 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:48:42 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:48:42.661+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:48:43.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.23 MB/sec warmup 114 sec latency 101254.233 ms 2024-03-28T05:48:43.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:42 smithi159 ceph-mon[36109]: pgmap v550: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:48:43.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:42 smithi055 ceph-mon[31863]: pgmap v550: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:48:44.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.23 MB/sec warmup 115 sec latency 102254.382 ms 2024-03-28T05:48:45.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.23 MB/sec warmup 116 sec latency 103254.484 ms 2024-03-28T05:48:45.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:45 smithi086 ceph-mon[35163]: pgmap v551: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-03-28T05:48:45.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:45 smithi159 ceph-mon[36109]: pgmap v551: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-03-28T05:48:45.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:45 smithi055 ceph-mon[31863]: pgmap v551: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-03-28T05:48:46.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.22 MB/sec warmup 117 sec latency 104254.586 ms 2024-03-28T05:48:47.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.22 MB/sec warmup 118 sec latency 105254.751 ms 2024-03-28T05:48:47.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:47 smithi086 ceph-mon[35163]: pgmap v552: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:47.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:47 smithi159 ceph-mon[36109]: pgmap v552: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:47.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:47 smithi055 ceph-mon[31863]: pgmap v552: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-03-28T05:48:48.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.22 MB/sec warmup 119 sec latency 106254.956 ms 2024-03-28T05:48:49.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:49 smithi086 ceph-mon[35163]: pgmap v553: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:49.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:49 smithi159 ceph-mon[36109]: pgmap v553: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:49.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:49 smithi055 ceph-mon[31863]: pgmap v553: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:48:50.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 1 sec latency 108255.228 ms 2024-03-28T05:48:51.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 2 sec latency 109255.358 ms 2024-03-28T05:48:51.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:51 smithi086 ceph-mon[35163]: pgmap v554: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:51.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:51 smithi159 ceph-mon[36109]: pgmap v554: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:51.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:51 smithi055 ceph-mon[31863]: pgmap v554: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:52.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 3 sec latency 110255.487 ms 2024-03-28T05:48:52.717 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:48:52.717 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:52.717 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.445s CPU time. 2024-03-28T05:48:52.718 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:48:53.024 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 podman[68246]: 2024-03-28 05:48:52.626685732 +0000 UTC m=+0.035701935 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:48:53.024 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:52 smithi086 podman[68246]: 2024-03-28 05:48:52.798793442 +0000 UTC m=+0.207809682 container create aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:48:53.025 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 podman[68246]: 2024-03-28 05:48:53.026927043 +0000 UTC m=+0.435943290 container init aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:48:53.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 4 sec latency 111255.591 ms 2024-03-28T05:48:53.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:53 smithi086 ceph-mon[35163]: pgmap v555: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:53.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 podman[68246]: 2024-03-28 05:48:53.036473066 +0000 UTC m=+0.445489274 container start aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-28T05:48:53.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 ceph-mds[68266]: -- 172.21.15.86:0/1108670645 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f6e6f5a40 con 0x555f6e6c9000 2024-03-28T05:48:53.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: starting mds.h at 2024-03-28T05:48:53.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 bash[68246]: aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa 2024-03-28T05:48:53.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:48:53 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:48:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:53 smithi159 ceph-mon[36109]: pgmap v555: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:53 smithi055 ceph-mon[31863]: pgmap v555: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-03-28T05:48:54.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 5 sec latency 112255.705 ms 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: daemon mds.h restarted 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: osdmap e99: 12 total, 12 up, 12 in 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:boot 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:54.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:54 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: daemon mds.h restarted 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: osdmap e99: 12 total, 12 up, 12 in 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:boot 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:54 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: daemon mds.h restarted 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: osdmap e99: 12 total, 12 up, 12 in 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:boot 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:48:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:54 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:55.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 6 sec latency 113255.820 ms 2024-03-28T05:48:55.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:55 smithi086 ceph-mon[35163]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:48:55.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:55 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:resolve 2024-03-28T05:48:55.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:55 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:55.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:55 smithi159 ceph-mon[36109]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:48:55.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:55 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:resolve 2024-03-28T05:48:55.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:55 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:55.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:55 smithi055 ceph-mon[31863]: pgmap v557: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:48:55.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:55 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:resolve 2024-03-28T05:48:55.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:55 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:56.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 7 sec latency 114255.981 ms 2024-03-28T05:48:56.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:56 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:56.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:56 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:reconnect 2024-03-28T05:48:56.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:56 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:56.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:56 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:56.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:56 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:reconnect 2024-03-28T05:48:56.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:56 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:56.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:56 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:48:56.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:56 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:reconnect 2024-03-28T05:48:56.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:56 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:57.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 8 sec latency 115256.075 ms 2024-03-28T05:48:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:57.439+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T05:48:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:57.440+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2024-03-28T05:48:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:57.440+0000 7f5334e00640 1 -- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 msgr2=0x562e5ad9f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T05:48:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:57.440+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T05:48:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T05:48:57.440+0000 7f5334e00640 1 --2- 172.21.15.55:0/1025709264 >> [v2:172.21.15.86:6836/2422548949,v1:172.21.15.86:6837/2422548949] conn(0x562e5ad9d500 0x562e5ad9f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-03-28T05:48:57.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:57 smithi086 ceph-mon[35163]: pgmap v558: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:48:57.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:57 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:rejoin 2024-03-28T05:48:57.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:57 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:57.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:57 smithi086 ceph-mon[35163]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:57.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-mon[36109]: pgmap v558: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:48:57.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:rejoin 2024-03-28T05:48:57.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:57.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-mon[36109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c00e00700 time 2024-03-28T05:48:57.195972+0000 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c0c7f14a1] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.569 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: clone() 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.199+0000 7f8c00e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c00e00700 time 2024-03-28T05:48:57.195972+0000 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:57.570 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c0c7f14a1] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.571 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: clone() 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: *** Caught signal (Aborted) ** 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: in thread 7f8c00e00700 thread_name:ms_dispatch 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.572 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c0b578d20] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: gsignal() 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: abort() 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c0c7f14fb] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.573 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 19: clone() 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.204+0000 7f8c00e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: in thread 7f8c00e00700 thread_name:ms_dispatch 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c0b578d20] 2024-03-28T05:48:57.574 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: gsignal() 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: abort() 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c0c7f14fb] 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.575 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.576 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 19: clone() 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: -1> 2024-03-28T05:48:57.199+0000 7f8c00e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c00e00700 time 2024-03-28T05:48:57.195972+0000 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c0c7f14a1] 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.577 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.578 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: clone() 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 0> 2024-03-28T05:48:57.204+0000 7f8c00e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: in thread 7f8c00e00700 thread_name:ms_dispatch 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c0b578d20] 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: gsignal() 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: abort() 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c0c7f14fb] 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.579 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.580 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 19: clone() 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: -1> 2024-03-28T05:48:57.199+0000 7f8c00e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c00e00700 time 2024-03-28T05:48:57.195972+0000 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.581 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c0c7f14a1] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.582 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: clone() 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 0> 2024-03-28T05:48:57.204+0000 7f8c00e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: in thread 7f8c00e00700 thread_name:ms_dispatch 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c0b578d20] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2: gsignal() 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 3: abort() 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c0c7f14fb] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c0c7f1667] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556aa2b77223] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556aa29f15d6] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556aa29f1da1] 2024-03-28T05:48:57.583 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556aa2a2609c] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556aa2a44233] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556aa2a46197] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556aa294511b] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556aa29456bc] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556aa292f1ff] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c0ca83488] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c0ca8060f] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c0cb53e81] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c0b56e1ca] 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 19: clone() 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69750]: 2024-03-28T05:48:57.584 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:57 smithi159 podman[69788]: 2024-03-28 05:48:57.339683417 +0000 UTC m=+0.043919099 container died 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:48:57.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:57 smithi055 ceph-mon[31863]: pgmap v558: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:48:57.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:57 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:rejoin 2024-03-28T05:48:57.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:57 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:57.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:57 smithi055 ceph-mon[31863]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:48:58.066 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:48:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:48:57.661+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:48:58.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 9 sec latency 116256.230 ms 2024-03-28T05:48:58.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:58 smithi159 podman[69788]: 2024-03-28 05:48:58.011512852 +0000 UTC m=+0.715748561 container remove 82197da49b8106d9aaa639714cee9f0fa9552635042cd4fc6bec669151d4d0fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:58 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:58 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:58 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:active 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:58 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:58 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:48:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:active 2024-03-28T05:48:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:58.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:58 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:48:58.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:58 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:48:58.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/1455322102,v1:172.21.15.159:6839/1455322102] up:active 2024-03-28T05:48:58.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:48:58.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:48:58.817 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:58 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:48:58.817 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:48:58 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.556s CPU time. 2024-03-28T05:48:59.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 10 sec latency 117256.391 ms 2024-03-28T05:48:59.500 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:48:59 smithi159 ceph-mon[36109]: pgmap v559: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-28T05:48:59.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:48:59 smithi086 ceph-mon[35163]: pgmap v559: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-28T05:48:59.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:48:59 smithi055 ceph-mon[31863]: pgmap v559: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-28T05:49:00.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 11 sec latency 118256.487 ms 2024-03-28T05:49:01.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 12 sec latency 119256.643 ms 2024-03-28T05:49:01.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:01 smithi086 ceph-mon[35163]: pgmap v560: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-03-28T05:49:01.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:01 smithi159 ceph-mon[36109]: pgmap v560: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-03-28T05:49:01.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:01 smithi055 ceph-mon[31863]: pgmap v560: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-03-28T05:49:01.707 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-03-28T05:49:01.806 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-03-28T05:49:01.808 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 82, in _check_damage rdmg = self.fs.get_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/cephfs/filesystem.py", line 1777, in get_damage result[rank] = self.get_damage(rank=rank) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/cephfs/filesystem.py", line 1780, in get_damage return self.rank_tell(['damage', 'ls'], rank=rank) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/cephfs/filesystem.py", line 1319, in rank_tell out = self.get_ceph_cmd_stdout("tell", f"mds.{self.id}:{rank}", *command, timeout=timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-03-28T05:49:02.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 13 sec latency 120256.833 ms 2024-03-28T05:49:03.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 14 sec latency 121256.991 ms 2024-03-28T05:49:03.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:03 smithi086 ceph-mon[35163]: pgmap v561: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:49:03.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:03 smithi159 ceph-mon[36109]: pgmap v561: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:49:03.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:03 smithi055 ceph-mon[31863]: pgmap v561: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2024-03-28T05:49:04.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 15 sec latency 122257.137 ms 2024-03-28T05:49:05.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 16 sec latency 123257.273 ms 2024-03-28T05:49:05.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:05 smithi086 ceph-mon[35163]: pgmap v562: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-28T05:49:05.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:05 smithi159 ceph-mon[36109]: pgmap v562: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-28T05:49:05.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:05 smithi055 ceph-mon[31863]: pgmap v562: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-03-28T05:49:06.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 17 sec latency 124257.397 ms 2024-03-28T05:49:07.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 18 sec latency 125257.537 ms 2024-03-28T05:49:07.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:07 smithi086 ceph-mon[35163]: pgmap v563: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:07.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:07 smithi159 ceph-mon[36109]: pgmap v563: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:07.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:07 smithi055 ceph-mon[31863]: pgmap v563: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:08.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 19 sec latency 126257.680 ms 2024-03-28T05:49:08.967 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:49:08.967 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 systemd[1]: Stopped Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:08.967 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.556s CPU time. 2024-03-28T05:49:08.967 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 systemd[1]: Starting Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:49:09.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 20 sec latency 127257.856 ms 2024-03-28T05:49:09.230 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 podman[69893]: 2024-03-28 05:49:08.874298657 +0000 UTC m=+0.033897839 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:49:09.230 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:08 smithi159 podman[69893]: 2024-03-28 05:49:08.987451934 +0000 UTC m=+0.147051153 container create 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-28T05:49:09.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:09 smithi086 ceph-mon[35163]: pgmap v564: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:09.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:09 smithi159 ceph-mon[36109]: pgmap v564: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 podman[69893]: 2024-03-28 05:49:09.232370875 +0000 UTC m=+0.391970101 container init 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319) 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 podman[69893]: 2024-03-28 05:49:09.241825702 +0000 UTC m=+0.401424951 container start 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 ceph-mds[69912]: -- 172.21.15.159:0/2465511976 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c243787a40 con 0x55c24375b000 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: starting mds.i at 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 bash[69893]: 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 2024-03-28T05:49:09.568 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:09 smithi159 systemd[1]: Started Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:09.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:09 smithi055 ceph-mon[31863]: pgmap v564: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-28T05:49:10.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 21 sec latency 128257.955 ms 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: daemon mds.i restarted 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: osdmap e100: 12 total, 12 up, 12 in 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:boot 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:10.536 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:49:10.537 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:10 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:10.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: daemon mds.i restarted 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: osdmap e100: 12 total, 12 up, 12 in 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:boot 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:49:10.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:10 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:10.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: daemon mds.i restarted 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: osdmap e100: 12 total, 12 up, 12 in 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:boot 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-28T05:49:10.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:10 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:11.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 22 sec latency 129258.118 ms 2024-03-28T05:49:11.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:11 smithi159 ceph-mon[36109]: pgmap v566: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8 op/s 2024-03-28T05:49:11.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:11 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:resolve 2024-03-28T05:49:11.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:11 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:11.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:11 smithi055 ceph-mon[31863]: pgmap v566: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8 op/s 2024-03-28T05:49:11.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:11 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:resolve 2024-03-28T05:49:11.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:11 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:11.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:11 smithi086 ceph-mon[35163]: pgmap v566: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8 op/s 2024-03-28T05:49:11.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:11 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:resolve 2024-03-28T05:49:11.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:11 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 23 sec latency 130258.271 ms 2024-03-28T05:49:12.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:12 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:12.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:reconnect 2024-03-28T05:49:12.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:12 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:rejoin 2024-03-28T05:49:12.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:12 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:12 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:12.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:reconnect 2024-03-28T05:49:12.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:12 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:rejoin 2024-03-28T05:49:12.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:12 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:12 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:12.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:reconnect 2024-03-28T05:49:12.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:12 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:12.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:rejoin 2024-03-28T05:49:12.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:12 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:13.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 24 sec latency 131258.408 ms 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6cf9a00700 time 2024-03-28T05:49:13.028462+0000 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d0534b4a1] 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: clone() 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.029+0000 7f6cf9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6cf9a00700 time 2024-03-28T05:49:13.028462+0000 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d0534b4a1] 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: clone() 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: *** Caught signal (Aborted) ** 2024-03-28T05:49:13.319 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: in thread 7f6cf9a00700 thread_name:ms_dispatch 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d040d2d20] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: gsignal() 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: abort() 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d0534b4fb] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 19: clone() 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.032+0000 7f6cf9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: in thread 7f6cf9a00700 thread_name:ms_dispatch 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d040d2d20] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: gsignal() 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: abort() 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d0534b4fb] 2024-03-28T05:49:13.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 19: clone() 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: -1> 2024-03-28T05:49:13.029+0000 7f6cf9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6cf9a00700 time 2024-03-28T05:49:13.028462+0000 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d0534b4a1] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: clone() 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 0> 2024-03-28T05:49:13.032+0000 7f6cf9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: in thread 7f6cf9a00700 thread_name:ms_dispatch 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d040d2d20] 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: gsignal() 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: abort() 2024-03-28T05:49:13.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d0534b4fb] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 19: clone() 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: -1> 2024-03-28T05:49:13.029+0000 7f6cf9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6cf9a00700 time 2024-03-28T05:49:13.028462+0000 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d0534b4a1] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: clone() 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 0> 2024-03-28T05:49:13.032+0000 7f6cf9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: in thread 7f6cf9a00700 thread_name:ms_dispatch 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d040d2d20] 2024-03-28T05:49:13.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2: gsignal() 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 3: abort() 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d0534b4fb] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d0534b667] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f6d4b4223] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f6d32e5d6] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f6d32eda1] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f6d36309c] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f6d381233] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f6d383197] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f6d28211b] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f6d2826bc] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f6d26c1ff] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d055dd488] 2024-03-28T05:49:13.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d055da60f] 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d056ade81] 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d040c81ca] 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 19: clone() 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68262]: 2024-03-28T05:49:13.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 podman[68303]: 2024-03-28 05:49:13.144505842 +0000 UTC m=+0.038914454 container died aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: pgmap v567: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:active 2024-03-28T05:49:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: pgmap v567: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:active 2024-03-28T05:49:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: pgmap v567: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/215888931,v1:172.21.15.86:6837/215888931] up:active 2024-03-28T05:49:13.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:14.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 25 sec latency 132258.554 ms 2024-03-28T05:49:14.315 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 podman[68303]: 2024-03-28 05:49:13.889020678 +0000 UTC m=+0.783429332 container remove aae9dd4fb37e88645158bec979fe0f21b35d45ad705975bd56ad0eb62290d2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-28T05:49:14.315 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:13 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:49:14.816 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:14 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:49:14.816 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:14 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.420s CPU time. 2024-03-28T05:49:15.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 26 sec latency 133258.714 ms 2024-03-28T05:49:15.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:15 smithi055 ceph-mon[31863]: pgmap v568: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 614 B/s wr, 8 op/s 2024-03-28T05:49:15.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:15 smithi086 ceph-mon[35163]: pgmap v568: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 614 B/s wr, 8 op/s 2024-03-28T05:49:15.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:15 smithi159 ceph-mon[36109]: pgmap v568: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 614 B/s wr, 8 op/s 2024-03-28T05:49:16.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 27 sec latency 134258.877 ms 2024-03-28T05:49:17.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 28 sec latency 135259.015 ms 2024-03-28T05:49:17.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:17 smithi055 ceph-mon[31863]: pgmap v569: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 614 B/s wr, 11 op/s 2024-03-28T05:49:17.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:17 smithi086 ceph-mon[35163]: pgmap v569: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 614 B/s wr, 11 op/s 2024-03-28T05:49:17.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:17 smithi159 ceph-mon[36109]: pgmap v569: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 614 B/s wr, 11 op/s 2024-03-28T05:49:18.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 29 sec latency 136259.152 ms 2024-03-28T05:49:18.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:18.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:18.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:19.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 30 sec latency 137259.314 ms 2024-03-28T05:49:19.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:19 smithi086 ceph-mon[35163]: pgmap v570: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-03-28T05:49:19.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:19 smithi159 ceph-mon[36109]: pgmap v570: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-03-28T05:49:19.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:19 smithi055 ceph-mon[31863]: pgmap v570: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-03-28T05:49:20.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 31 sec latency 138259.453 ms 2024-03-28T05:49:21.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 32 sec latency 139259.610 ms 2024-03-28T05:49:21.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:21 smithi086 ceph-mon[35163]: pgmap v571: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:49:21.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:21 smithi159 ceph-mon[36109]: pgmap v571: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:49:21.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:21 smithi055 ceph-mon[31863]: pgmap v571: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:49:22.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 33 sec latency 140259.758 ms 2024-03-28T05:49:23.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 34 sec latency 141259.953 ms 2024-03-28T05:49:23.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:23 smithi086 ceph-mon[35163]: pgmap v572: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:23.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:23 smithi159 ceph-mon[36109]: pgmap v572: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:23.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:23 smithi055 ceph-mon[31863]: pgmap v572: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:24.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 35 sec latency 142260.093 ms 2024-03-28T05:49:24.985 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:24 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:49:24.985 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:24 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:24.985 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:24 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.420s CPU time. 2024-03-28T05:49:24.985 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:24 smithi086 systemd[1]: Starting Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:49:25.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 36 sec latency 143260.248 ms 2024-03-28T05:49:25.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:24 smithi086 podman[68393]: 2024-03-28 05:49:24.897279394 +0000 UTC m=+0.050156677 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:49:25.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 podman[68393]: 2024-03-28 05:49:25.056585272 +0000 UTC m=+0.209462545 container create 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-28T05:49:25.308 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 podman[68393]: 2024-03-28 05:49:25.310263829 +0000 UTC m=+0.463141143 container init 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319) 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: pgmap v573: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: daemon mds.h restarted 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: osdmap e101: 12 total, 12 up, 12 in 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:boot 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:25.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 podman[68393]: 2024-03-28 05:49:25.320068927 +0000 UTC m=+0.472946194 container start 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-mds[68411]: -- 172.21.15.86:0/865162066 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a935ada40 con 0x555a93580c00 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: starting mds.h at 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 bash[68393]: 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 2024-03-28T05:49:25.567 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:25 smithi086 systemd[1]: Started Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:25.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: pgmap v573: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:49:25.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: daemon mds.h restarted 2024-03-28T05:49:25.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: osdmap e101: 12 total, 12 up, 12 in 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:boot 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:49:25.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:25 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:25.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: pgmap v573: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:49:25.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: daemon mds.h restarted 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: osdmap e101: 12 total, 12 up, 12 in 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:boot 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-28T05:49:25.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:25 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:26.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 37 sec latency 144260.405 ms 2024-03-28T05:49:27.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 38 sec latency 145260.539 ms 2024-03-28T05:49:27.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:27 smithi086 ceph-mon[35163]: pgmap v575: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 818 B/s wr, 8 op/s 2024-03-28T05:49:27.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:27 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:resolve 2024-03-28T05:49:27.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:27 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:27.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:27 smithi159 ceph-mon[36109]: pgmap v575: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 818 B/s wr, 8 op/s 2024-03-28T05:49:27.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:27 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:resolve 2024-03-28T05:49:27.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:27 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:27.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:27 smithi055 ceph-mon[31863]: pgmap v575: 97 pgs: 97 active+clean; 22 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 818 B/s wr, 8 op/s 2024-03-28T05:49:27.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:27 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:resolve 2024-03-28T05:49:27.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:27 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:28.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 39 sec latency 146260.697 ms 2024-03-28T05:49:28.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:28 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:49:28.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:reconnect 2024-03-28T05:49:28.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:28 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:28.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:28 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:49:28.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:reconnect 2024-03-28T05:49:28.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:28 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:28.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:28 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:49:28.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:reconnect 2024-03-28T05:49:28.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:28 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:29.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 40 sec latency 147260.847 ms 2024-03-28T05:49:29.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: pgmap v576: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:49:29.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:rejoin 2024-03-28T05:49:29.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:29.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:49:29.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:29.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:29 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:49:29.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: pgmap v576: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:49:29.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:rejoin 2024-03-28T05:49:29.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:29.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:49:29.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:29.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:49:29.818 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6d6f200700 time 2024-03-28T05:49:29.489997+0000 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d7abb24a1] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.819 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.820 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: clone() 2024-03-28T05:49:29.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.492+0000 7f6d6f200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6d6f200700 time 2024-03-28T05:49:29.489997+0000 2024-03-28T05:49:29.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:29.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.821 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d7abb24a1] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.822 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: clone() 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: *** Caught signal (Aborted) ** 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: in thread 7f6d6f200700 thread_name:ms_dispatch 2024-03-28T05:49:29.823 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d79939d20] 2024-03-28T05:49:29.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: gsignal() 2024-03-28T05:49:29.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: abort() 2024-03-28T05:49:29.824 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d7abb24fb] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.825 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 19: clone() 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.497+0000 7f6d6f200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:29.826 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: in thread 7f6d6f200700 thread_name:ms_dispatch 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d79939d20] 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: gsignal() 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: abort() 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d7abb24fb] 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.827 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.828 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 19: clone() 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: -1> 2024-03-28T05:49:29.492+0000 7f6d6f200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6d6f200700 time 2024-03-28T05:49:29.489997+0000 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d7abb24a1] 2024-03-28T05:49:29.829 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.830 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.831 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: clone() 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 0> 2024-03-28T05:49:29.497+0000 7f6d6f200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: in thread 7f6d6f200700 thread_name:ms_dispatch 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d79939d20] 2024-03-28T05:49:29.832 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: gsignal() 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: abort() 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d7abb24fb] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.833 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 19: clone() 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: -1> 2024-03-28T05:49:29.492+0000 7f6d6f200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6d6f200700 time 2024-03-28T05:49:29.489997+0000 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:29.834 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d7abb24a1] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.835 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: clone() 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 0> 2024-03-28T05:49:29.497+0000 7f6d6f200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:29.836 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: in thread 7f6d6f200700 thread_name:ms_dispatch 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d79939d20] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2: gsignal() 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 3: abort() 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d7abb24fb] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6d7abb2667] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55c2418b7223] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55c2417315d6] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55c241731da1] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55c24176609c] 2024-03-28T05:49:29.837 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55c241784233] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c241786197] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c24168511b] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2416856bc] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55c24166f1ff] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6d7ae44488] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 16: (DispatchQueue::entry()+0x51f) [0x7f6d7ae4160f] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d7af14e81] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6d7992f1ca] 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 19: clone() 2024-03-28T05:49:29.838 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:29.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i[69908]: 2024-03-28T05:49:29.839 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:29 smithi159 podman[69947]: 2024-03-28 05:49:29.621466462 +0000 UTC m=+0.036563968 container died 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, ceph=True) 2024-03-28T05:49:29.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: pgmap v576: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:49:29.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:rejoin 2024-03-28T05:49:29.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:29.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-28T05:49:29.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:29.871 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:29 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:49:30.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 41 sec latency 148260.983 ms 2024-03-28T05:49:30.753 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:30 smithi159 podman[69947]: 2024-03-28 05:49:30.325060832 +0000 UTC m=+0.740158343 container remove 7f5a786d95c337ce0f088a4beca049fbb15968616ed395f6c9447bfb8dc79dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-i, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-28T05:49:30.753 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:49:30.753 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:30 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:active 2024-03-28T05:49:30.754 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:30.754 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:30.754 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:49:30.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:30 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:active 2024-03-28T05:49:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:30.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:49:30.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:30 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6838/4249379957,v1:172.21.15.159:6839/4249379957] up:active 2024-03-28T05:49:30.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-03-28T05:49:30.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-28T05:49:30.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:49:31.066 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:49:31.067 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.521s CPU time. 2024-03-28T05:49:31.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 42 sec latency 149261.089 ms 2024-03-28T05:49:31.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:31 smithi086 ceph-mon[35163]: pgmap v577: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:49:31.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:49:31.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:49:31.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:49:31.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:31 smithi159 ceph-mon[36109]: pgmap v577: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:49:31.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:49:31.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:49:31.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:49:31.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:31 smithi055 ceph-mon[31863]: pgmap v577: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:49:31.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:49:31.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:49:31.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:49:32.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 43 sec latency 150261.197 ms 2024-03-28T05:49:33.065 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:49:32 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:49:32.665+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:49:33.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 44 sec latency 151261.330 ms 2024-03-28T05:49:33.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:33 smithi086 ceph-mon[35163]: pgmap v578: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:49:33.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:33 smithi159 ceph-mon[36109]: pgmap v578: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:49:33.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:33 smithi055 ceph-mon[31863]: pgmap v578: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:49:34.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 45 sec latency 152261.473 ms 2024-03-28T05:49:35.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 46 sec latency 153261.637 ms 2024-03-28T05:49:35.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:35 smithi086 ceph-mon[35163]: pgmap v579: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:49:35.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:35 smithi159 ceph-mon[36109]: pgmap v579: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:49:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:35 smithi055 ceph-mon[31863]: pgmap v579: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:49:36.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 47 sec latency 154261.839 ms 2024-03-28T05:49:37.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 48 sec latency 155261.984 ms 2024-03-28T05:49:37.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:37 smithi086 ceph-mon[35163]: pgmap v580: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-03-28T05:49:37.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:37 smithi159 ceph-mon[36109]: pgmap v580: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-03-28T05:49:37.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:37 smithi055 ceph-mon[31863]: pgmap v580: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-03-28T05:49:38.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 49 sec latency 156262.144 ms 2024-03-28T05:49:39.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 50 sec latency 157262.309 ms 2024-03-28T05:49:39.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:39 smithi086 ceph-mon[35163]: pgmap v581: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:39.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:39 smithi159 ceph-mon[36109]: pgmap v581: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:39.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:39 smithi055 ceph-mon[31863]: pgmap v581: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-03-28T05:49:40.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 51 sec latency 158262.455 ms 2024-03-28T05:49:41.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 52 sec latency 159262.618 ms 2024-03-28T05:49:41.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:49:41.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: Stopped Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:41.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Consumed 1.521s CPU time. 2024-03-28T05:49:41.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Start request repeated too quickly. 2024-03-28T05:49:41.317 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.i.service: Failed with result 'exit-code'. 2024-03-28T05:49:41.318 INFO:journalctl@ceph.mds.i.smithi159.stdout:Mar 28 05:49:40 smithi159 systemd[1]: Failed to start Ceph mds.i for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:49:41.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:41 smithi086 ceph-mon[35163]: pgmap v582: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:41.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:41 smithi159 ceph-mon[36109]: pgmap v582: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:41.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:41 smithi055 ceph-mon[31863]: pgmap v582: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:42.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 53 sec latency 160262.779 ms 2024-03-28T05:49:43.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 54 sec latency 161262.976 ms 2024-03-28T05:49:43.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:43 smithi086 ceph-mon[35163]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:43.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:43 smithi159 ceph-mon[36109]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:43.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:43 smithi055 ceph-mon[31863]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:49:44.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 55 sec latency 162263.134 ms 2024-03-28T05:49:45.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 56 sec latency 163263.291 ms 2024-03-28T05:49:45.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:45 smithi086 ceph-mon[35163]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:49:45.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:45 smithi159 ceph-mon[36109]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:49:45.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:45 smithi055 ceph-mon[31863]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:49:46.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 57 sec latency 164263.433 ms 2024-03-28T05:49:47.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 58 sec latency 165263.574 ms 2024-03-28T05:49:47.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:47 smithi086 ceph-mon[35163]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:49:47.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:47 smithi159 ceph-mon[36109]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:49:47.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:47 smithi055 ceph-mon[31863]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:49:48.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 59 sec latency 166263.711 ms 2024-03-28T05:49:48.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:48 smithi055 ceph-mon[31863]: Replacing daemon mds.i as rank 1 with standby daemon mds.h 2024-03-28T05:49:48.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:48 smithi055 ceph-mon[31863]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-03-28T05:49:48.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:48 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:48.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:48 smithi055 ceph-mon[31863]: osdmap e102: 12 total, 12 up, 12 in 2024-03-28T05:49:48.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:48 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:49.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:48 smithi086 ceph-mon[35163]: Replacing daemon mds.i as rank 1 with standby daemon mds.h 2024-03-28T05:49:49.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:48 smithi086 ceph-mon[35163]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-03-28T05:49:49.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:48 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:49.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:48 smithi086 ceph-mon[35163]: osdmap e102: 12 total, 12 up, 12 in 2024-03-28T05:49:49.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:48 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:49.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:48 smithi159 ceph-mon[36109]: Replacing daemon mds.i as rank 1 with standby daemon mds.h 2024-03-28T05:49:49.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:48 smithi159 ceph-mon[36109]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-03-28T05:49:49.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:48 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:49:49.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:48 smithi159 ceph-mon[36109]: osdmap e102: 12 total, 12 up, 12 in 2024-03-28T05:49:49.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:48 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:49.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 60 sec latency 167263.840 ms 2024-03-28T05:49:49.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:49 smithi055 ceph-mon[31863]: pgmap v586: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:49:49.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:49 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:resolve 2024-03-28T05:49:49.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:49 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:50.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:49 smithi086 ceph-mon[35163]: pgmap v586: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:49:50.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:49 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:resolve 2024-03-28T05:49:50.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:49 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:50.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:49 smithi159 ceph-mon[36109]: pgmap v586: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:49:50.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:49 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:resolve 2024-03-28T05:49:50.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:49 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:50.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 61 sec latency 168264.001 ms 2024-03-28T05:49:51.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 62 sec latency 169264.091 ms 2024-03-28T05:49:51.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:51 smithi086 ceph-mon[35163]: pgmap v588: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:49:51.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:51 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:51.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:51 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:reconnect 2024-03-28T05:49:51.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:51 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:51.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:51 smithi159 ceph-mon[36109]: pgmap v588: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:49:51.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:51 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:51.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:51 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:reconnect 2024-03-28T05:49:51.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:51 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:51.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:51 smithi055 ceph-mon[31863]: pgmap v588: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:49:51.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:51 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199995 2024-03-28T05:49:51.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:51 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:reconnect 2024-03-28T05:49:51.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:51 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:52.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 63 sec latency 170264.289 ms 2024-03-28T05:49:52.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:rejoin 2024-03-28T05:49:52.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:52.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-mon[35163]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:52.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f847a600700 time 2024-03-28T05:49:52.091444+0000 2024-03-28T05:49:52.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:52.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.316 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8485eb04a1] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.317 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.318 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: clone() 2024-03-28T05:49:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:52 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:rejoin 2024-03-28T05:49:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:52 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:52 smithi159 ceph-mon[36109]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.091+0000 7f847a600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f847a600700 time 2024-03-28T05:49:52.091444+0000 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8485eb04a1] 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.320 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.321 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: clone() 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: *** Caught signal (Aborted) ** 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: in thread 7f847a600700 thread_name:ms_dispatch 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8484c37d20] 2024-03-28T05:49:52.322 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: gsignal() 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: abort() 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8485eb04fb] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.323 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 19: clone() 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.093+0000 7f847a600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: in thread 7f847a600700 thread_name:ms_dispatch 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.324 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8484c37d20] 2024-03-28T05:49:52.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: gsignal() 2024-03-28T05:49:52.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: abort() 2024-03-28T05:49:52.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8485eb04fb] 2024-03-28T05:49:52.325 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.326 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 19: clone() 2024-03-28T05:49:52.327 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: -1> 2024-03-28T05:49:52.091+0000 7f847a600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f847a600700 time 2024-03-28T05:49:52.091444+0000 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8485eb04a1] 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.328 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.329 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: clone() 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 0> 2024-03-28T05:49:52.093+0000 7f847a600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: in thread 7f847a600700 thread_name:ms_dispatch 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8484c37d20] 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: gsignal() 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: abort() 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8485eb04fb] 2024-03-28T05:49:52.330 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.331 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.333 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 19: clone() 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: -1> 2024-03-28T05:49:52.091+0000 7f847a600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f847a600700 time 2024-03-28T05:49:52.091444+0000 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8485eb04a1] 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.334 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.335 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.335 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.336 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: clone() 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 0> 2024-03-28T05:49:52.093+0000 7f847a600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: in thread 7f847a600700 thread_name:ms_dispatch 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8484c37d20] 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2: gsignal() 2024-03-28T05:49:52.337 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 3: abort() 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8485eb04fb] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8485eb0667] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a91b82223] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a919fc5d6] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a919fcda1] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a91a3109c] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a91a4f233] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a91a51197] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a9195011b] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a919506bc] 2024-03-28T05:49:52.338 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a9193a1ff] 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8486142488] 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 16: (DispatchQueue::entry()+0x51f) [0x7f848613f60f] 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8486212e81] 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8484c2d1ca] 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 19: clone() 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h[68407]: 2024-03-28T05:49:52.339 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 podman[68576]: 2024-03-28 05:49:52.191885514 +0000 UTC m=+0.040810482 container died 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:49:52.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:52 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:rejoin 2024-03-28T05:49:52.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:52 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:52.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:52 smithi055 ceph-mon[31863]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-28T05:49:52.976 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:49:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:49:52.666+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:49:52.977 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 podman[68576]: 2024-03-28 05:49:52.979752491 +0000 UTC m=+0.828677501 container remove 53a80ed4b331d041dd37cd7adfca72cbd647f27bfa003ccc37dc321505826c70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-28T05:49:53.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 64 sec latency 171264.446 ms 2024-03-28T05:49:53.315 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:52 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:49:53.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: pgmap v589: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:49:53.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:53.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:49:53.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:active 2024-03-28T05:49:53.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:53.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:53 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: pgmap v589: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:active 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:53.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:53 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: pgmap v589: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6836/2356259151,v1:172.21.15.86:6837/2356259151] up:active 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 6 up:standby 2024-03-28T05:49:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:53 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby 2024-03-28T05:49:53.814 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:53 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:49:53.814 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:49:53 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.471s CPU time. 2024-03-28T05:49:54.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 65 sec latency 172264.595 ms 2024-03-28T05:49:55.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 66 sec latency 173264.721 ms 2024-03-28T05:49:55.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:55 smithi159 ceph-mon[36109]: pgmap v590: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:49:55.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:55 smithi055 ceph-mon[31863]: pgmap v590: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:49:55.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:55 smithi086 ceph-mon[35163]: pgmap v590: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:49:56.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 67 sec latency 174264.875 ms 2024-03-28T05:49:57.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 68 sec latency 175265.006 ms 2024-03-28T05:49:57.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:57 smithi055 ceph-mon[31863]: pgmap v591: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:49:57.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:57 smithi086 ceph-mon[35163]: pgmap v591: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:49:57.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:57 smithi159 ceph-mon[36109]: pgmap v591: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:49:58.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 69 sec latency 176265.166 ms 2024-03-28T05:49:59.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 70 sec latency 177265.306 ms 2024-03-28T05:49:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:49:59 smithi055 ceph-mon[31863]: pgmap v592: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:49:59.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:49:59 smithi086 ceph-mon[35163]: pgmap v592: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:49:59.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:49:59 smithi159 ceph-mon[36109]: pgmap v592: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:00.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 71 sec latency 178265.466 ms 2024-03-28T05:50:00.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:00 smithi055 ceph-mon[31863]: overall HEALTH_OK 2024-03-28T05:50:00.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:00 smithi086 ceph-mon[35163]: overall HEALTH_OK 2024-03-28T05:50:00.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:00 smithi159 ceph-mon[36109]: overall HEALTH_OK 2024-03-28T05:50:01.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 72 sec latency 179265.609 ms 2024-03-28T05:50:01.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:01 smithi055 ceph-mon[31863]: pgmap v593: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:01.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:01 smithi086 ceph-mon[35163]: pgmap v593: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:01.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:01 smithi159 ceph-mon[36109]: pgmap v593: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:02.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 73 sec latency 180265.771 ms 2024-03-28T05:50:03.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 74 sec latency 181265.950 ms 2024-03-28T05:50:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:03 smithi055 ceph-mon[31863]: pgmap v594: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:03.370 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:03 smithi159 ceph-mon[36109]: pgmap v594: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:03.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:03 smithi086 ceph-mon[35163]: pgmap v594: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 6. 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: Stopped Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Consumed 1.471s CPU time. 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Start request repeated too quickly. 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2024-03-28T05:50:04.065 INFO:journalctl@ceph.mds.h.smithi086.stdout:Mar 28 05:50:03 smithi086 systemd[1]: Failed to start Ceph mds.h for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:04.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 75 sec latency 182266.046 ms 2024-03-28T05:50:05.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 76 sec latency 183266.201 ms 2024-03-28T05:50:05.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:05 smithi055 ceph-mon[31863]: pgmap v595: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:05.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:05 smithi086 ceph-mon[35163]: pgmap v595: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:05.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:05 smithi159 ceph-mon[36109]: pgmap v595: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:06.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 77 sec latency 184266.370 ms 2024-03-28T05:50:07.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 78 sec latency 185266.512 ms 2024-03-28T05:50:07.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:07 smithi055 ceph-mon[31863]: pgmap v596: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8 op/s 2024-03-28T05:50:07.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:07 smithi086 ceph-mon[35163]: pgmap v596: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8 op/s 2024-03-28T05:50:07.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:07 smithi159 ceph-mon[36109]: pgmap v596: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8 op/s 2024-03-28T05:50:08.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 79 sec latency 186266.631 ms 2024-03-28T05:50:08.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:08 smithi055 ceph-mon[31863]: Replacing daemon mds.h as rank 1 with standby daemon mds.f 2024-03-28T05:50:08.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:08 smithi055 ceph-mon[31863]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-03-28T05:50:08.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:08 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:08.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:08 smithi055 ceph-mon[31863]: osdmap e103: 12 total, 12 up, 12 in 2024-03-28T05:50:08.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:08 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:08.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:08 smithi086 ceph-mon[35163]: Replacing daemon mds.h as rank 1 with standby daemon mds.f 2024-03-28T05:50:08.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:08 smithi086 ceph-mon[35163]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-03-28T05:50:08.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:08 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:08.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:08 smithi086 ceph-mon[35163]: osdmap e103: 12 total, 12 up, 12 in 2024-03-28T05:50:08.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:08 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:08 smithi159 ceph-mon[36109]: Replacing daemon mds.h as rank 1 with standby daemon mds.f 2024-03-28T05:50:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:08 smithi159 ceph-mon[36109]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-03-28T05:50:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:08 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:08 smithi159 ceph-mon[36109]: osdmap e103: 12 total, 12 up, 12 in 2024-03-28T05:50:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:08 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:09.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 80 sec latency 187267.552 ms 2024-03-28T05:50:09.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:09 smithi086 ceph-mon[35163]: pgmap v597: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-03-28T05:50:09.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:09 smithi159 ceph-mon[36109]: pgmap v597: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-03-28T05:50:09.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:09 smithi055 ceph-mon[31863]: pgmap v597: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-03-28T05:50:10.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 81 sec latency 188267.680 ms 2024-03-28T05:50:10.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:10 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:resolve 2024-03-28T05:50:10.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:10 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:10.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:10 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:resolve 2024-03-28T05:50:10.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:10 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:10.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:10 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:resolve 2024-03-28T05:50:10.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:10 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:11.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 82 sec latency 189267.841 ms 2024-03-28T05:50:11.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:11 smithi086 ceph-mon[35163]: pgmap v599: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:50:11.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:11 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:50:11.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:11 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:reconnect 2024-03-28T05:50:11.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:11 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:11.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:11 smithi159 ceph-mon[36109]: pgmap v599: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:50:11.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:11 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:50:11.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:11 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:reconnect 2024-03-28T05:50:11.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:11 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:11.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:11 smithi055 ceph-mon[31863]: pgmap v599: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:50:11.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:11 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:50:11.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:11 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:reconnect 2024-03-28T05:50:11.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:11 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:12.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 83 sec latency 190267.996 ms 2024-03-28T05:50:12.534 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:rejoin 2024-03-28T05:50:12.534 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:12.535 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6de7600700 time 2024-03-28T05:50:12.210299+0000 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6df2f944a1] 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.536 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.537 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.538 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.538 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: clone() 2024-03-28T05:50:12.538 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.211+0000 7f6de7600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6de7600700 time 2024-03-28T05:50:12.210299+0000 2024-03-28T05:50:12.538 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6df2f944a1] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.539 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: clone() 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: *** Caught signal (Aborted) ** 2024-03-28T05:50:12.540 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: in thread 7f6de7600700 thread_name:ms_dispatch 2024-03-28T05:50:12.541 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.541 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6df1d1bd20] 2024-03-28T05:50:12.541 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: gsignal() 2024-03-28T05:50:12.541 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: abort() 2024-03-28T05:50:12.541 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6df2f944fb] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.542 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.543 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.543 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.543 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.543 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.543 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 19: clone() 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.214+0000 7f6de7600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: in thread 7f6de7600700 thread_name:ms_dispatch 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6df1d1bd20] 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: gsignal() 2024-03-28T05:50:12.545 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: abort() 2024-03-28T05:50:12.546 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6df2f944fb] 2024-03-28T05:50:12.546 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.548 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 19: clone() 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:12.549 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: -1> 2024-03-28T05:50:12.211+0000 7f6de7600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6de7600700 time 2024-03-28T05:50:12.210299+0000 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6df2f944a1] 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.550 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.551 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: clone() 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 0> 2024-03-28T05:50:12.214+0000 7f6de7600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: in thread 7f6de7600700 thread_name:ms_dispatch 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6df1d1bd20] 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: gsignal() 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: abort() 2024-03-28T05:50:12.552 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6df2f944fb] 2024-03-28T05:50:12.553 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.553 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.553 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.553 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.553 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.554 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 19: clone() 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: -1> 2024-03-28T05:50:12.211+0000 7f6de7600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6de7600700 time 2024-03-28T05:50:12.210299+0000 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:12.555 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6df2f944a1] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.556 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.557 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: clone() 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 0> 2024-03-28T05:50:12.214+0000 7f6de7600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: in thread 7f6de7600700 thread_name:ms_dispatch 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6df1d1bd20] 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2: gsignal() 2024-03-28T05:50:12.558 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 3: abort() 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6df2f944fb] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6df2f94667] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555f483ca223] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555f482445d6] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555f48244da1] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555f4827909c] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555f48297233] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f48299197] 2024-03-28T05:50:12.559 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f4819811b] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f481986bc] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555f481821ff] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6df3226488] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 16: (DispatchQueue::entry()+0x51f) [0x7f6df322360f] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6df32f6e81] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6df1d111ca] 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 19: clone() 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:12.560 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[66364]: 2024-03-28T05:50:12.561 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:12 smithi159 podman[70144]: 2024-03-28 05:50:12.311931548 +0000 UTC m=+0.034162130 container died c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux ) 2024-03-28T05:50:12.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:rejoin 2024-03-28T05:50:12.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:12 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:12.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:12 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:12.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:rejoin 2024-03-28T05:50:12.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:12 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:12.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:12 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:13.065 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:50:12 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:50:12.668+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:50:13.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:13 smithi159 podman[70144]: 2024-03-28 05:50:13.069394841 +0000 UTC m=+0.791625450 container remove c0fd609134770a2b3d314f9ca041bea4f9cbc22eb001129d2fba04b5e39f919c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.license=GPLv2) 2024-03-28T05:50:13.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 84 sec latency 191268.129 ms 2024-03-28T05:50:13.485 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:13 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:50:13.486 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: pgmap v600: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:50:13.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:13.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:50:13.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:active 2024-03-28T05:50:13.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:13.487 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:13.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: pgmap v600: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:50:13.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:13.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:50:13.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:active 2024-03-28T05:50:13.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:13.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:13.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: pgmap v600: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:50:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:50:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/721766197,v1:172.21.15.159:6835/721766197] up:active 2024-03-28T05:50:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:13.816 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:13 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:50:13.816 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:13 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.701s CPU time. 2024-03-28T05:50:14.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 85 sec latency 192268.258 ms 2024-03-28T05:50:15.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 86 sec latency 193268.399 ms 2024-03-28T05:50:15.422 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:15 smithi055 ceph-mon[31863]: pgmap v601: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:50:15.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:15 smithi086 ceph-mon[35163]: pgmap v601: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:50:15.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:15 smithi159 ceph-mon[36109]: pgmap v601: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:50:16.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 87 sec latency 194268.542 ms 2024-03-28T05:50:17.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 88 sec latency 195268.696 ms 2024-03-28T05:50:17.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:17 smithi086 ceph-mon[35163]: pgmap v602: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:50:17.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:17 smithi159 ceph-mon[36109]: pgmap v602: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:50:17.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:17 smithi055 ceph-mon[31863]: pgmap v602: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:50:18.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 89 sec latency 196268.788 ms 2024-03-28T05:50:19.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 90 sec latency 197268.978 ms 2024-03-28T05:50:19.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:19 smithi086 ceph-mon[35163]: pgmap v603: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:19.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:19 smithi159 ceph-mon[36109]: pgmap v603: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:19.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:19 smithi055 ceph-mon[31863]: pgmap v603: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:20.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 91 sec latency 198269.122 ms 2024-03-28T05:50:21.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 92 sec latency 199269.256 ms 2024-03-28T05:50:21.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:21 smithi086 ceph-mon[35163]: pgmap v604: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:21.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:21 smithi159 ceph-mon[36109]: pgmap v604: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:21.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:21 smithi055 ceph-mon[31863]: pgmap v604: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:22.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 93 sec latency 200269.397 ms 2024-03-28T05:50:23.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 94 sec latency 201269.534 ms 2024-03-28T05:50:23.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:23 smithi086 ceph-mon[35163]: pgmap v605: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:23.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:23 smithi159 ceph-mon[36109]: pgmap v605: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:23.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:23 smithi055 ceph-mon[31863]: pgmap v605: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:23.970 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:50:23.971 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:23.971 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.701s CPU time. 2024-03-28T05:50:23.971 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:50:24.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 95 sec latency 202269.676 ms 2024-03-28T05:50:24.287 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 podman[70252]: 2024-03-28 05:50:23.879626781 +0000 UTC m=+0.033073634 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:50:24.287 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:23 smithi159 podman[70252]: 2024-03-28 05:50:23.998074136 +0000 UTC m=+0.151521009 container create 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-28T05:50:24.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 podman[70252]: 2024-03-28 05:50:24.291240823 +0000 UTC m=+0.444687743 container init 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-28T05:50:24.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 podman[70252]: 2024-03-28 05:50:24.301495975 +0000 UTC m=+0.454942826 container start 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:50:24.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 ceph-mds[70271]: -- 172.21.15.159:0/884529490 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55718cc01a40 con 0x55718cbd5000 2024-03-28T05:50:24.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: starting mds.f at 2024-03-28T05:50:24.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 bash[70252]: 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b 2024-03-28T05:50:24.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:24 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:25.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 96 sec latency 203269.852 ms 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: pgmap v606: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: daemon mds.f restarted 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: osdmap e104: 12 total, 12 up, 12 in 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:boot 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:25.546 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:25 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: pgmap v606: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: daemon mds.f restarted 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: osdmap e104: 12 total, 12 up, 12 in 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:boot 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:25.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:25 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: pgmap v606: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: daemon mds.f restarted 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: osdmap e104: 12 total, 12 up, 12 in 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:boot 2024-03-28T05:50:25.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:25.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:25.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:25.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:25 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:26.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 97 sec latency 204270.023 ms 2024-03-28T05:50:27.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 98 sec latency 205270.153 ms 2024-03-28T05:50:27.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:27 smithi086 ceph-mon[35163]: pgmap v608: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:27.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:27 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:resolve 2024-03-28T05:50:27.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:27 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:27.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:27 smithi159 ceph-mon[36109]: pgmap v608: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:27.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:27 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:resolve 2024-03-28T05:50:27.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:27 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:27.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:27 smithi055 ceph-mon[31863]: pgmap v608: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:27.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:27 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:resolve 2024-03-28T05:50:27.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:27 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:28.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 99 sec latency 206270.284 ms 2024-03-28T05:50:28.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:28 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:28.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:reconnect 2024-03-28T05:50:28.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:28 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:28.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:28 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:28.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:reconnect 2024-03-28T05:50:28.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:28 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:28.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:28 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:28.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:reconnect 2024-03-28T05:50:28.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:28 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:29.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 100 sec latency 207270.434 ms 2024-03-28T05:50:29.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:29 smithi086 ceph-mon[35163]: pgmap v609: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:50:29.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:29 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:rejoin 2024-03-28T05:50:29.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:29 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:29.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:29 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:50:29.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-mon[36109]: pgmap v609: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:50:29.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:rejoin 2024-03-28T05:50:29.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:29.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:50:29.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9118000700 time 2024-03-28T05:50:29.304363+0000 2024-03-28T05:50:29.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:29.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f91238da4a1] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: clone() 2024-03-28T05:50:29.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.305+0000 7f9118000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9118000700 time 2024-03-28T05:50:29.304363+0000 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f91238da4a1] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: clone() 2024-03-28T05:50:29.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: *** Caught signal (Aborted) ** 2024-03-28T05:50:29.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: in thread 7f9118000700 thread_name:ms_dispatch 2024-03-28T05:50:29.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9122661d20] 2024-03-28T05:50:29.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: gsignal() 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: abort() 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f91238da4fb] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 19: clone() 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.307+0000 7f9118000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: in thread 7f9118000700 thread_name:ms_dispatch 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9122661d20] 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: gsignal() 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: abort() 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f91238da4fb] 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 19: clone() 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: -1> 2024-03-28T05:50:29.305+0000 7f9118000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9118000700 time 2024-03-28T05:50:29.304363+0000 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f91238da4a1] 2024-03-28T05:50:29.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: clone() 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 0> 2024-03-28T05:50:29.307+0000 7f9118000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: in thread 7f9118000700 thread_name:ms_dispatch 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9122661d20] 2024-03-28T05:50:29.581 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: gsignal() 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: abort() 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f91238da4fb] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.582 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 19: clone() 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: -1> 2024-03-28T05:50:29.305+0000 7f9118000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9118000700 time 2024-03-28T05:50:29.304363+0000 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:29.583 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f91238da4a1] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.584 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: clone() 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 0> 2024-03-28T05:50:29.307+0000 7f9118000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: in thread 7f9118000700 thread_name:ms_dispatch 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.585 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9122661d20] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2: gsignal() 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 3: abort() 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f91238da4fb] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f91238da667] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55cf5712d223] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55cf56fa75d6] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55cf56fa7da1] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55cf56fdc09c] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55cf56ffa233] 2024-03-28T05:50:29.586 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cf56ffc197] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cf56efb11b] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cf56efb6bc] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55cf56ee51ff] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9123b6c488] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 16: (DispatchQueue::entry()+0x51f) [0x7f9123b6960f] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9123c3ce81] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f91226571ca] 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 19: clone() 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[66058]: 2024-03-28T05:50:29.587 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:29 smithi159 podman[70305]: 2024-03-28 05:50:29.415529902 +0000 UTC m=+0.036220524 container died 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:50:29.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:29 smithi055 ceph-mon[31863]: pgmap v609: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:50:29.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:29 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:rejoin 2024-03-28T05:50:29.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:29 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:29.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:29 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:50:30.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 101 sec latency 208270.591 ms 2024-03-28T05:50:30.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:30 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:30.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:30 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:50:30.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:30 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:active 2024-03-28T05:50:30.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:30.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:30.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:30 smithi159 podman[70305]: 2024-03-28 05:50:30.068504191 +0000 UTC m=+0.689194829 container remove 44b9a45f99709c7c928827904437a647739a9cbdcc62f04fd4e636a61a9f1900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=) 2024-03-28T05:50:30.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:50:30.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:30 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:30.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:30 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:50:30.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:30 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:active 2024-03-28T05:50:30.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:30.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:30 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:30 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:50:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:30 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3865980537,v1:172.21.15.159:6833/3865980537] up:active 2024-03-28T05:50:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:30.816 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:50:30.816 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:30 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.775s CPU time. 2024-03-28T05:50:31.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 102 sec latency 209270.746 ms 2024-03-28T05:50:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:31 smithi086 ceph-mon[35163]: pgmap v610: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:50:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:31 smithi159 ceph-mon[36109]: pgmap v610: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:50:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:31 smithi055 ceph-mon[31863]: pgmap v610: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:50:32.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 103 sec latency 210270.871 ms 2024-03-28T05:50:32.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:50:32.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:50:32.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:50:33.065 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:50:32 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:50:32.669+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:50:33.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 104 sec latency 211270.958 ms 2024-03-28T05:50:33.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:33 smithi086 ceph-mon[35163]: pgmap v611: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:33.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:50:33.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:50:33.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:50:33.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:33 smithi159 ceph-mon[36109]: pgmap v611: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:33.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:50:33.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:50:33.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:50:33.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:33 smithi055 ceph-mon[31863]: pgmap v611: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:33.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:50:33.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:50:33.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:50:34.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 105 sec latency 212271.098 ms 2024-03-28T05:50:35.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 106 sec latency 213271.237 ms 2024-03-28T05:50:35.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:35 smithi055 ceph-mon[31863]: pgmap v612: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:35 smithi086 ceph-mon[35163]: pgmap v612: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:35.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:35 smithi159 ceph-mon[36109]: pgmap v612: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:36.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 107 sec latency 214271.363 ms 2024-03-28T05:50:37.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 108 sec latency 215271.503 ms 2024-03-28T05:50:37.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:37 smithi055 ceph-mon[31863]: pgmap v613: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:37.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:37 smithi086 ceph-mon[35163]: pgmap v613: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:37.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:37 smithi159 ceph-mon[36109]: pgmap v613: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:38.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 109 sec latency 216271.635 ms 2024-03-28T05:50:39.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 110 sec latency 217271.772 ms 2024-03-28T05:50:39.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:39 smithi055 ceph-mon[31863]: pgmap v614: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:39.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:39 smithi086 ceph-mon[35163]: pgmap v614: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:39.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:39 smithi159 ceph-mon[36109]: pgmap v614: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:40.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 111 sec latency 218271.936 ms 2024-03-28T05:50:40.951 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:50:40.951 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:40 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:40.951 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:40 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.775s CPU time. 2024-03-28T05:50:40.951 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:40 smithi159 systemd[1]: Starting Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:50:41.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 112 sec latency 219272.083 ms 2024-03-28T05:50:41.294 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:40 smithi159 podman[70529]: 2024-03-28 05:50:40.860406708 +0000 UTC m=+0.032956609 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:50:41.294 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 podman[70529]: 2024-03-28 05:50:41.01900538 +0000 UTC m=+0.191555305 container create 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:50:41.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:41 smithi159 ceph-mon[36109]: pgmap v615: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:41.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 podman[70529]: 2024-03-28 05:50:41.297658066 +0000 UTC m=+0.470207998 container init 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-03-28T05:50:41.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 podman[70529]: 2024-03-28 05:50:41.307830624 +0000 UTC m=+0.480380556 container start 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-28T05:50:41.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: starting mds.l at 2024-03-28T05:50:41.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 bash[70529]: 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 2024-03-28T05:50:41.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:50:41 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:41.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:41 smithi055 ceph-mon[31863]: pgmap v615: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:41.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:41 smithi086 ceph-mon[35163]: pgmap v615: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:50:42.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 113 sec latency 220272.215 ms 2024-03-28T05:50:42.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: daemon mds.l restarted 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: osdmap e105: 12 total, 12 up, 12 in 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:boot 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:50:42.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:42 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: daemon mds.l restarted 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: osdmap e105: 12 total, 12 up, 12 in 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:boot 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:50:42.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:42 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: daemon mds.l restarted 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: osdmap e105: 12 total, 12 up, 12 in 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:boot 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:50:42.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:42 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:43.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 114 sec latency 221272.342 ms 2024-03-28T05:50:43.715 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:43 smithi086 ceph-mon[35163]: pgmap v617: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:50:43.715 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:43 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:resolve 2024-03-28T05:50:43.716 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:43 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:43.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:43 smithi159 ceph-mon[36109]: pgmap v617: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:50:43.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:43 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:resolve 2024-03-28T05:50:43.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:43 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:43.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:43 smithi055 ceph-mon[31863]: pgmap v617: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:50:43.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:43 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:resolve 2024-03-28T05:50:43.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:43 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:44.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 115 sec latency 222272.461 ms 2024-03-28T05:50:44.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:44 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:44.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:44 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:reconnect 2024-03-28T05:50:44.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:44 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:44.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:44 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:44.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:44 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:reconnect 2024-03-28T05:50:44.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:44 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:44.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:44 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:50:44.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:44 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:reconnect 2024-03-28T05:50:44.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:44 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:45.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 116 sec latency 223272.598 ms 2024-03-28T05:50:45.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: pgmap v618: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:50:45.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:rejoin 2024-03-28T05:50:45.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:45.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:45.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:45.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: pgmap v618: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:rejoin 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:45.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:45 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: pgmap v618: 97 pgs: 97 active+clean; 22 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:rejoin 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:50:45.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:45 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:50:45.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb146e00700 time 2024-03-28T05:50:45.462106+0000 2024-03-28T05:50:45.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:45.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb1526b54a1] 2024-03-28T05:50:45.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: clone() 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.462+0000 7fb146e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb146e00700 time 2024-03-28T05:50:45.462106+0000 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb1526b54a1] 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: clone() 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: *** Caught signal (Aborted) ** 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: in thread 7fb146e00700 thread_name:ms_dispatch 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb15143cd20] 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: gsignal() 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: abort() 2024-03-28T05:50:45.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb1526b54fb] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 19: clone() 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.464+0000 7fb146e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: in thread 7fb146e00700 thread_name:ms_dispatch 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb15143cd20] 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: gsignal() 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: abort() 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb1526b54fb] 2024-03-28T05:50:45.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 19: clone() 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: -1> 2024-03-28T05:50:45.462+0000 7fb146e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb146e00700 time 2024-03-28T05:50:45.462106+0000 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb1526b54a1] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: clone() 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 0> 2024-03-28T05:50:45.464+0000 7fb146e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: in thread 7fb146e00700 thread_name:ms_dispatch 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb15143cd20] 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: gsignal() 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: abort() 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb1526b54fb] 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 19: clone() 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: -1> 2024-03-28T05:50:45.462+0000 7fb146e00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb146e00700 time 2024-03-28T05:50:45.462106+0000 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb1526b54a1] 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: clone() 2024-03-28T05:50:45.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 0> 2024-03-28T05:50:45.464+0000 7fb146e00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: in thread 7fb146e00700 thread_name:ms_dispatch 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb15143cd20] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2: gsignal() 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 3: abort() 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb1526b54fb] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb1526b5667] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55718b680223] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55718b4fa5d6] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55718b4fada1] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55718b52f09c] 2024-03-28T05:50:45.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55718b54d233] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55718b54f197] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55718b44e11b] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55718b44e6bc] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55718b4381ff] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb152947488] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 16: (DispatchQueue::entry()+0x51f) [0x7fb15294460f] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb152a17e81] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb1514321ca] 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 19: clone() 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70267]: 2024-03-28T05:50:45.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:45 smithi159 podman[70582]: 2024-03-28 05:50:45.548109693 +0000 UTC m=+0.031603821 container died 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=) 2024-03-28T05:50:46.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 117 sec latency 224272.723 ms 2024-03-28T05:50:46.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:46 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:active 2024-03-28T05:50:46.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:46 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:46.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:46 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:46.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:46 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:active 2024-03-28T05:50:46.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:46 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:46.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:46 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:46.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:46 smithi159 podman[70582]: 2024-03-28 05:50:46.360837159 +0000 UTC m=+0.844331355 container remove 5f54585662ae4e9c4456dd16b525de89ba0f5e8f0f3e38fbda59660ec1d6591b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:50:46.817 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:46 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:50:46.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:46 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1656241990,v1:172.21.15.159:6835/1656241990] up:active 2024-03-28T05:50:46.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:46 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:46.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:46 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:50:47.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 118 sec latency 225272.867 ms 2024-03-28T05:50:47.316 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:46 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:50:47.316 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:46 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.510s CPU time. 2024-03-28T05:50:47.814 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:50:47 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:50:47.670+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:50:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:47 smithi086 ceph-mon[35163]: pgmap v619: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:47.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:47 smithi159 ceph-mon[36109]: pgmap v619: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:47 smithi055 ceph-mon[31863]: pgmap v619: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:50:48.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 119 sec latency 226273.032 ms 2024-03-28T05:50:49.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 120 sec latency 227273.148 ms 2024-03-28T05:50:49.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:49 smithi086 ceph-mon[35163]: pgmap v620: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:50:49.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:49 smithi159 ceph-mon[36109]: pgmap v620: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:50:49.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:49 smithi055 ceph-mon[31863]: pgmap v620: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:50:50.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 121 sec latency 228273.286 ms 2024-03-28T05:50:51.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 122 sec latency 229273.424 ms 2024-03-28T05:50:51.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:51 smithi086 ceph-mon[35163]: pgmap v621: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:51.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:51 smithi159 ceph-mon[36109]: pgmap v621: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:51.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:51 smithi055 ceph-mon[31863]: pgmap v621: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:50:52.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 123 sec latency 230273.562 ms 2024-03-28T05:50:53.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 124 sec latency 231273.688 ms 2024-03-28T05:50:53.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:53 smithi086 ceph-mon[35163]: pgmap v622: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:50:53.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:53 smithi159 ceph-mon[36109]: pgmap v622: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:50:53.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:53 smithi055 ceph-mon[31863]: pgmap v622: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:50:54.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 125 sec latency 232273.843 ms 2024-03-28T05:50:55.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 126 sec latency 233273.978 ms 2024-03-28T05:50:55.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:55 smithi086 ceph-mon[35163]: pgmap v623: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:50:55.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:55 smithi159 ceph-mon[36109]: pgmap v623: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:50:55.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:55 smithi055 ceph-mon[31863]: pgmap v623: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:50:56.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 127 sec latency 234274.131 ms 2024-03-28T05:50:57.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 128 sec latency 235274.271 ms 2024-03-28T05:50:57.457 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:50:57.457 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:57.457 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.510s CPU time. 2024-03-28T05:50:57.457 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:50:57.743 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:57 smithi159 ceph-mon[36109]: pgmap v624: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:57.743 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 podman[70687]: 2024-03-28 05:50:57.368858703 +0000 UTC m=+0.038452648 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:50:57.743 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 podman[70687]: 2024-03-28 05:50:57.492466133 +0000 UTC m=+0.162060044 container create 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-28T05:50:57.744 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 podman[70687]: 2024-03-28 05:50:57.745870659 +0000 UTC m=+0.415464643 container init 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-28T05:50:57.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:57 smithi086 ceph-mon[35163]: pgmap v624: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:57.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:57 smithi055 ceph-mon[31863]: pgmap v624: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:50:58.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 podman[70687]: 2024-03-28 05:50:57.757004283 +0000 UTC m=+0.426598224 container start 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319) 2024-03-28T05:50:58.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 ceph-mds[70706]: -- 172.21.15.159:0/1611376529 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561405715a40 con 0x5614056e9000 2024-03-28T05:50:58.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: starting mds.f at 2024-03-28T05:50:58.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 bash[70687]: 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 2024-03-28T05:50:58.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:50:57 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:50:58.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 129 sec latency 236274.407 ms 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: daemon mds.f restarted 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: osdmap e106: 12 total, 12 up, 12 in 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:boot 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:58.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:58.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:58 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: daemon mds.f restarted 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: osdmap e106: 12 total, 12 up, 12 in 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:boot 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:58 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: daemon mds.f restarted 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: osdmap e106: 12 total, 12 up, 12 in 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:boot 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:50:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:50:58.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:58 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:59.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 130 sec latency 237274.552 ms 2024-03-28T05:50:59.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:59 smithi086 ceph-mon[35163]: pgmap v626: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:59.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:59 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:resolve 2024-03-28T05:50:59.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:50:59 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:59.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:59 smithi159 ceph-mon[36109]: pgmap v626: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:59.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:59 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:resolve 2024-03-28T05:50:59.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:50:59 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:50:59.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:59 smithi055 ceph-mon[31863]: pgmap v626: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:50:59.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:59 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:resolve 2024-03-28T05:50:59.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:50:59 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:00.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 131 sec latency 238274.698 ms 2024-03-28T05:51:01.120 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:00 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:01.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:00 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:reconnect 2024-03-28T05:51:01.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:00 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:01.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:00 smithi055 ceph-mon[31863]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:51:01.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 132 sec latency 239274.858 ms 2024-03-28T05:51:01.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:00 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:01.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:00 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:reconnect 2024-03-28T05:51:01.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:00 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:01.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:00 smithi086 ceph-mon[35163]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:51:01.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:00 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:01.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:00 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:reconnect 2024-03-28T05:51:01.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:00 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:01.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:00 smithi159 ceph-mon[36109]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:51:02.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 133 sec latency 240274.985 ms 2024-03-28T05:51:02.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:01 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:rejoin 2024-03-28T05:51:02.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:01 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:02.314 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:01 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:02.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:rejoin 2024-03-28T05:51:02.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:02.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9569c00700 time 2024-03-28T05:51:01.903795+0000 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f957555d4a1] 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.318 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.319 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.319 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.319 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: clone() 2024-03-28T05:51:02.319 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:01.904+0000 7f9569c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9569c00700 time 2024-03-28T05:51:01.903795+0000 2024-03-28T05:51:02.319 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f957555d4a1] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.320 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: clone() 2024-03-28T05:51:02.321 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.322 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: *** Caught signal (Aborted) ** 2024-03-28T05:51:02.322 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: in thread 7f9569c00700 thread_name:ms_dispatch 2024-03-28T05:51:02.322 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.322 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f95742e4d20] 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: gsignal() 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: abort() 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f957555d4fb] 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.323 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.324 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 19: clone() 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:01.907+0000 7f9569c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: in thread 7f9569c00700 thread_name:ms_dispatch 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f95742e4d20] 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: gsignal() 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: abort() 2024-03-28T05:51:02.325 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f957555d4fb] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.326 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 19: clone() 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: -1> 2024-03-28T05:51:01.904+0000 7f9569c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9569c00700 time 2024-03-28T05:51:01.903795+0000 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:02.327 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.328 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.328 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f957555d4a1] 2024-03-28T05:51:02.328 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.329 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: clone() 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 0> 2024-03-28T05:51:01.907+0000 7f9569c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:02.330 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: in thread 7f9569c00700 thread_name:ms_dispatch 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f95742e4d20] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: gsignal() 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: abort() 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f957555d4fb] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.331 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.332 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 19: clone() 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: -1> 2024-03-28T05:51:01.904+0000 7f9569c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9569c00700 time 2024-03-28T05:51:01.903795+0000 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f957555d4a1] 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.333 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.334 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: clone() 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 0> 2024-03-28T05:51:01.907+0000 7f9569c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: in thread 7f9569c00700 thread_name:ms_dispatch 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:02.335 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f95742e4d20] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2: gsignal() 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 3: abort() 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f957555d4fb] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f957555d667] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556f3973c223] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556f395b65d6] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556f395b6da1] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556f395eb09c] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556f39609233] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556f3960b197] 2024-03-28T05:51:02.336 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556f3950a11b] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556f3950a6bc] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556f394f41ff] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f95757ef488] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 16: (DispatchQueue::entry()+0x51f) [0x7f95757ec60f] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f95758bfe81] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f95742da1ca] 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 19: clone() 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:01 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70544]: 2024-03-28T05:51:02.337 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:02 smithi159 podman[70741]: 2024-03-28 05:51:02.009619699 +0000 UTC m=+0.032981248 container died 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-03-28T05:51:02.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:01 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:rejoin 2024-03-28T05:51:02.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:01 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:02.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:01 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:03.064 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:51:02.672+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:51:03.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:03.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:51:03.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:active 2024-03-28T05:51:03.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:03.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:03.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:02 smithi086 ceph-mon[35163]: pgmap v628: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:51:03.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:02 smithi159 podman[70741]: 2024-03-28 05:51:02.682157654 +0000 UTC m=+0.705519235 container remove 4ff1f2c96af50b00c543000cc04dbcc2241dfc00efb35f98e49f2615137790e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-28T05:51:03.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:02 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:51:03.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:03.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:51:03.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:active 2024-03-28T05:51:03.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:03.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:03.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:02 smithi159 ceph-mon[36109]: pgmap v628: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:51:03.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 134 sec latency 241275.085 ms 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/3136791569,v1:172.21.15.159:6833/3136791569] up:active 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:03.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:02 smithi055 ceph-mon[31863]: pgmap v628: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:51:03.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:51:03.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.516s CPU time. 2024-03-28T05:51:04.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 135 sec latency 242275.244 ms 2024-03-28T05:51:05.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 136 sec latency 243275.349 ms 2024-03-28T05:51:05.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:05 smithi055 ceph-mon[31863]: pgmap v629: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:51:05.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:05 smithi086 ceph-mon[35163]: pgmap v629: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:51:05.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:05 smithi159 ceph-mon[36109]: pgmap v629: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:51:06.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 137 sec latency 244275.484 ms 2024-03-28T05:51:07.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 138 sec latency 245275.646 ms 2024-03-28T05:51:07.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:07 smithi055 ceph-mon[31863]: pgmap v630: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:51:07.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:07 smithi086 ceph-mon[35163]: pgmap v630: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:51:07.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:07 smithi159 ceph-mon[36109]: pgmap v630: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:51:08.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 139 sec latency 246275.833 ms 2024-03-28T05:51:09.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 140 sec latency 247275.931 ms 2024-03-28T05:51:09.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:09 smithi055 ceph-mon[31863]: pgmap v631: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:09.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:09 smithi086 ceph-mon[35163]: pgmap v631: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:09.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:09 smithi159 ceph-mon[36109]: pgmap v631: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:10.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 141 sec latency 248276.070 ms 2024-03-28T05:51:11.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 142 sec latency 249276.232 ms 2024-03-28T05:51:11.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:11 smithi055 ceph-mon[31863]: pgmap v632: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:51:11.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:11 smithi086 ceph-mon[35163]: pgmap v632: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:51:11.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:11 smithi159 ceph-mon[36109]: pgmap v632: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:51:12.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 143 sec latency 250276.375 ms 2024-03-28T05:51:13.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 144 sec latency 251276.531 ms 2024-03-28T05:51:13.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:13 smithi086 ceph-mon[35163]: pgmap v633: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:13.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:13 smithi159 ceph-mon[36109]: pgmap v633: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:13.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:51:13.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:13.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.516s CPU time. 2024-03-28T05:51:13.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 systemd[1]: Starting Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:51:13.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:13 smithi055 ceph-mon[31863]: pgmap v633: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:14.007 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 podman[70831]: 2024-03-28 05:51:13.619768876 +0000 UTC m=+0.033172749 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:51:14.007 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:13 smithi159 podman[70831]: 2024-03-28 05:51:13.732664074 +0000 UTC m=+0.146067980 container create 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2) 2024-03-28T05:51:14.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 145 sec latency 252276.645 ms 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: daemon mds.l restarted 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: osdmap e107: 12 total, 12 up, 12 in 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:boot 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:14.316 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 podman[70831]: 2024-03-28 05:51:14.011290102 +0000 UTC m=+0.424694071 container init 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-28T05:51:14.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 podman[70831]: 2024-03-28 05:51:14.021370495 +0000 UTC m=+0.434774407 container start 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:51:14.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-mds[70850]: -- 172.21.15.159:0/3046099349 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606bdf6fa40 con 0x5606bdf43000 2024-03-28T05:51:14.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: starting mds.l at 2024-03-28T05:51:14.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 bash[70831]: 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 2024-03-28T05:51:14.317 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:14 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:14.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: daemon mds.l restarted 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: osdmap e107: 12 total, 12 up, 12 in 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:boot 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:14.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:14 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: daemon mds.l restarted 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: osdmap e107: 12 total, 12 up, 12 in 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:boot 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:14.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:14 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:15.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 146 sec latency 253276.822 ms 2024-03-28T05:51:15.520 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:15 smithi055 ceph-mon[31863]: pgmap v634: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:15.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:15 smithi086 ceph-mon[35163]: pgmap v634: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:15.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:15 smithi159 ceph-mon[36109]: pgmap v634: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:16.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 147 sec latency 254276.953 ms 2024-03-28T05:51:16.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:16 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:resolve 2024-03-28T05:51:16.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:16 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:16.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:16 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:resolve 2024-03-28T05:51:16.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:16 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:16.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:16 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:resolve 2024-03-28T05:51:16.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:16 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:17.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 148 sec latency 255277.108 ms 2024-03-28T05:51:17.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:17 smithi086 ceph-mon[35163]: pgmap v636: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-28T05:51:17.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:17 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:17.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:17 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:reconnect 2024-03-28T05:51:17.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:17 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:17.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:17 smithi159 ceph-mon[36109]: pgmap v636: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-28T05:51:17.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:17 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:17.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:17 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:reconnect 2024-03-28T05:51:17.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:17 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:17.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:17 smithi055 ceph-mon[31863]: pgmap v636: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-03-28T05:51:17.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:17 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:51:17.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:17 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:reconnect 2024-03-28T05:51:17.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:17 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:18.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 149 sec latency 256277.252 ms 2024-03-28T05:51:18.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:rejoin 2024-03-28T05:51:18.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:18.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:18.503 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:active 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ff359200700 time 2024-03-28T05:51:18.116711+0000 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff364b774a1] 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.504 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.505 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: clone() 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.118+0000 7ff359200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ff359200700 time 2024-03-28T05:51:18.116711+0000 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff364b774a1] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.506 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: clone() 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: *** Caught signal (Aborted) ** 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: in thread 7ff359200700 thread_name:ms_dispatch 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.507 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff3638fed20] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: gsignal() 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: abort() 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff364b774fb] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.508 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 19: clone() 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.120+0000 7ff359200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: in thread 7ff359200700 thread_name:ms_dispatch 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff3638fed20] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: gsignal() 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: abort() 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff364b774fb] 2024-03-28T05:51:18.509 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 19: clone() 2024-03-28T05:51:18.510 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: -1> 2024-03-28T05:51:18.118+0000 7ff359200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ff359200700 time 2024-03-28T05:51:18.116711+0000 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff364b774a1] 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.511 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: clone() 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 0> 2024-03-28T05:51:18.120+0000 7ff359200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: in thread 7ff359200700 thread_name:ms_dispatch 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.512 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff3638fed20] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: gsignal() 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: abort() 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff364b774fb] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.513 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 19: clone() 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: -1> 2024-03-28T05:51:18.118+0000 7ff359200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ff359200700 time 2024-03-28T05:51:18.116711+0000 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff364b774a1] 2024-03-28T05:51:18.514 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.515 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.515 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.515 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.516 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: clone() 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 0> 2024-03-28T05:51:18.120+0000 7ff359200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: in thread 7ff359200700 thread_name:ms_dispatch 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff3638fed20] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2: gsignal() 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 3: abort() 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff364b774fb] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ff364b77667] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x561403848223] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5614036c25d6] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5614036c2da1] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5614036f709c] 2024-03-28T05:51:18.517 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x561403715233] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561403717197] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56140361611b] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5614036166bc] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5614036001ff] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff364e09488] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 16: (DispatchQueue::entry()+0x51f) [0x7ff364e0660f] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff364ed9e81] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ff3638f41ca] 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 19: clone() 2024-03-28T05:51:18.518 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:18.519 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70702]: 2024-03-28T05:51:18.519 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 podman[70884]: 2024-03-28 05:51:18.219406776 +0000 UTC m=+0.033676830 container died 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:rejoin 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:active 2024-03-28T05:51:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:rejoin 2024-03-28T05:51:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:51:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1849732168,v1:172.21.15.159:6835/1849732168] up:active 2024-03-28T05:51:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:19.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 150 sec latency 257277.355 ms 2024-03-28T05:51:19.194 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 podman[70884]: 2024-03-28 05:51:18.863511611 +0000 UTC m=+0.677781708 container remove 275bb43f864e6548b8ee8294057bcd8d182df0cada9be2efc33d48f374bd91f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-28T05:51:19.194 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:18 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:51:19.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:19 smithi086 ceph-mon[35163]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:19.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:19 smithi159 ceph-mon[36109]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:19.565 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:51:19.565 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.521s CPU time. 2024-03-28T05:51:19.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:19 smithi055 ceph-mon[31863]: pgmap v637: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:20.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 151 sec latency 258277.496 ms 2024-03-28T05:51:21.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 152 sec latency 259277.637 ms 2024-03-28T05:51:21.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:21 smithi086 ceph-mon[35163]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:51:21.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:21 smithi159 ceph-mon[36109]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:51:21.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:21 smithi055 ceph-mon[31863]: pgmap v638: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:51:22.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 153 sec latency 260277.826 ms 2024-03-28T05:51:23.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 154 sec latency 261277.970 ms 2024-03-28T05:51:23.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:23 smithi086 ceph-mon[35163]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:51:23.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:23 smithi159 ceph-mon[36109]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:51:23.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:23 smithi055 ceph-mon[31863]: pgmap v639: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:51:24.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 155 sec latency 262278.126 ms 2024-03-28T05:51:25.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 156 sec latency 263278.268 ms 2024-03-28T05:51:25.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:25 smithi086 ceph-mon[35163]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:51:25.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:25 smithi159 ceph-mon[36109]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:51:25.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:25 smithi055 ceph-mon[31863]: pgmap v640: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:51:26.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 157 sec latency 264278.426 ms 2024-03-28T05:51:27.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 158 sec latency 265278.570 ms 2024-03-28T05:51:27.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:27 smithi086 ceph-mon[35163]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:27.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:27 smithi159 ceph-mon[36109]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:27.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:27 smithi055 ceph-mon[31863]: pgmap v641: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:28.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 159 sec latency 266278.717 ms 2024-03-28T05:51:29.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 160 sec latency 267278.874 ms 2024-03-28T05:51:29.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:29 smithi086 ceph-mon[35163]: pgmap v642: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:29.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:29 smithi159 ceph-mon[36109]: pgmap v642: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:29.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:29 smithi055 ceph-mon[31863]: pgmap v642: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:29.961 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:29 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:51:29.961 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:29 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:29.961 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:29 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.521s CPU time. 2024-03-28T05:51:29.961 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:29 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:51:30.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 161 sec latency 268278.963 ms 2024-03-28T05:51:30.246 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:29 smithi159 podman[70973]: 2024-03-28 05:51:29.87371764 +0000 UTC m=+0.040080600 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:51:30.246 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 podman[70973]: 2024-03-28 05:51:30.013954612 +0000 UTC m=+0.180317590 container create 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD) 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 podman[70973]: 2024-03-28 05:51:30.250579475 +0000 UTC m=+0.416942460 container init 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 podman[70973]: 2024-03-28 05:51:30.261459465 +0000 UTC m=+0.427822412 container start 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 ceph-mds[70991]: -- 172.21.15.159:0/377857525 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c961bfa40 con 0x556c96193000 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: starting mds.f at 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 bash[70973]: 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 2024-03-28T05:51:30.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:30 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:31.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 162 sec latency 269279.058 ms 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: pgmap v643: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: daemon mds.f restarted 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: osdmap e108: 12 total, 12 up, 12 in 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:boot 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:51:31.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:31 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:31.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: pgmap v643: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:51:31.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: daemon mds.f restarted 2024-03-28T05:51:31.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:31.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: osdmap e108: 12 total, 12 up, 12 in 2024-03-28T05:51:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:boot 2024-03-28T05:51:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:51:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:51:31.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:31 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:31.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: pgmap v643: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:51:31.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: daemon mds.f restarted 2024-03-28T05:51:31.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:31.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: osdmap e108: 12 total, 12 up, 12 in 2024-03-28T05:51:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:boot 2024-03-28T05:51:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:51:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:51:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:31 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:32.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 163 sec latency 270279.241 ms 2024-03-28T05:51:32.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:32 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:resolve 2024-03-28T05:51:32.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:32 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:32.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:32 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:resolve 2024-03-28T05:51:32.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:32 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:32.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:32 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:resolve 2024-03-28T05:51:32.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:32 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:33.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 164 sec latency 271279.376 ms 2024-03-28T05:51:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:33 smithi055 ceph-mon[31863]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:51:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:33 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:33 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:reconnect 2024-03-28T05:51:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:33 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:33.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:33 smithi159 ceph-mon[36109]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:51:33.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:33 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:33.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:33 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:reconnect 2024-03-28T05:51:33.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:33 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:33.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:33 smithi086 ceph-mon[35163]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:51:33.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:33 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:33.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:33 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:reconnect 2024-03-28T05:51:33.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:33 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:34.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 165 sec latency 272279.499 ms 2024-03-28T05:51:34.751 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:rejoin 2024-03-28T05:51:34.751 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:34.751 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:34.751 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6ce9800700 time 2024-03-28T05:51:34.400900+0000 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cf50e94a1] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.753 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: clone() 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.401+0000 7f6ce9800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6ce9800700 time 2024-03-28T05:51:34.400900+0000 2024-03-28T05:51:34.754 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cf50e94a1] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.755 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: clone() 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: *** Caught signal (Aborted) ** 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: in thread 7f6ce9800700 thread_name:ms_dispatch 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.756 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cf3e70d20] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: gsignal() 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: abort() 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cf50e94fb] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.757 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 19: clone() 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.403+0000 7f6ce9800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: in thread 7f6ce9800700 thread_name:ms_dispatch 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cf3e70d20] 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: gsignal() 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: abort() 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cf50e94fb] 2024-03-28T05:51:34.758 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 19: clone() 2024-03-28T05:51:34.759 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: -1> 2024-03-28T05:51:34.401+0000 7f6ce9800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6ce9800700 time 2024-03-28T05:51:34.400900+0000 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cf50e94a1] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.760 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: clone() 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 0> 2024-03-28T05:51:34.403+0000 7f6ce9800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: in thread 7f6ce9800700 thread_name:ms_dispatch 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.761 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cf3e70d20] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: gsignal() 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: abort() 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cf50e94fb] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.762 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 19: clone() 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: -1> 2024-03-28T05:51:34.401+0000 7f6ce9800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f6ce9800700 time 2024-03-28T05:51:34.400900+0000 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:34.763 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cf50e94a1] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.764 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: clone() 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 0> 2024-03-28T05:51:34.403+0000 7f6ce9800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: in thread 7f6ce9800700 thread_name:ms_dispatch 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cf3e70d20] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2: gsignal() 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 3: abort() 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cf50e94fb] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f6cf50e9667] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5606bc7cd223] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5606bc6475d6] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5606bc647da1] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5606bc67c09c] 2024-03-28T05:51:34.765 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5606bc69a233] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5606bc69c197] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5606bc59b11b] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5606bc59b6bc] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5606bc5851ff] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f6cf537b488] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 16: (DispatchQueue::entry()+0x51f) [0x7f6cf537860f] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cf544be81] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f6cf3e661ca] 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 19: clone() 2024-03-28T05:51:34.766 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:34.767 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[70846]: 2024-03-28T05:51:34.767 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:34 smithi159 podman[71107]: 2024-03-28 05:51:34.488720236 +0000 UTC m=+0.033645490 container died 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-28T05:51:34.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:34 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:rejoin 2024-03-28T05:51:34.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:34 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:34.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:34 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:34.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:51:34.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:34 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:rejoin 2024-03-28T05:51:34.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:34 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:34.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:34 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:51:34.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:51:35.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 166 sec latency 273279.620 ms 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:35 smithi159 podman[71107]: 2024-03-28 05:51:35.144797193 +0000 UTC m=+0.689722477 container remove 3c170f2e651a0ac1fa7c7b8df6d4b923df5226926af549243efd9da15aca7f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:35 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:active 2024-03-28T05:51:35.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:51:35.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:active 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:35.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:35.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:51:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1562439147,v1:172.21.15.159:6833/1562439147] up:active 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T05:51:35.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:51:35.870 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:51:36.065 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:35 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:51:36.065 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:35 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.473s CPU time. 2024-03-28T05:51:36.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 167 sec latency 274279.782 ms 2024-03-28T05:51:36.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:36 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T05:51:36.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:36 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T05:51:36.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:36 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T05:51:36.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:36 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T05:51:36.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:36 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T05:51:36.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:36 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T05:51:37.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 168 sec latency 275279.951 ms 2024-03-28T05:51:37.671 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:37 smithi086 ceph-mon[35163]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:51:37.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:37 smithi159 ceph-mon[36109]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:51:37.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:37 smithi055 ceph-mon[31863]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:51:38.063 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:51:37 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:51:37.675+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:51:38.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 169 sec latency 276280.080 ms 2024-03-28T05:51:39.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 170 sec latency 277280.232 ms 2024-03-28T05:51:39.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:39 smithi086 ceph-mon[35163]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:39.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:39 smithi159 ceph-mon[36109]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:39.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:39 smithi055 ceph-mon[31863]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:40.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 171 sec latency 278280.375 ms 2024-03-28T05:51:41.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 172 sec latency 279280.507 ms 2024-03-28T05:51:41.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:41 smithi086 ceph-mon[35163]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:41.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:41 smithi159 ceph-mon[36109]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:41.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:41 smithi055 ceph-mon[31863]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:42.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 173 sec latency 280280.670 ms 2024-03-28T05:51:43.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 174 sec latency 281280.841 ms 2024-03-28T05:51:43.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:43 smithi086 ceph-mon[35163]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:43.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:43 smithi159 ceph-mon[36109]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:43.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:43 smithi055 ceph-mon[31863]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:51:44.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 175 sec latency 282280.981 ms 2024-03-28T05:51:45.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 176 sec latency 283281.138 ms 2024-03-28T05:51:45.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:45 smithi086 ceph-mon[35163]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:51:45.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:45 smithi159 ceph-mon[36109]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:51:45.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:45 smithi055 ceph-mon[31863]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:51:46.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 177 sec latency 284281.284 ms 2024-03-28T05:51:46.201 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:45 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:51:46.201 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:45 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:46.201 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:45 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.473s CPU time. 2024-03-28T05:51:46.201 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:45 smithi159 systemd[1]: Starting Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:51:46.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 podman[71245]: 2024-03-28 05:51:46.111173364 +0000 UTC m=+0.033733095 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:51:46.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 podman[71245]: 2024-03-28 05:51:46.229729959 +0000 UTC m=+0.152289727 container create 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-28T05:51:46.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 podman[71245]: 2024-03-28 05:51:46.500254631 +0000 UTC m=+0.422814406 container init 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:51:46.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 podman[71245]: 2024-03-28 05:51:46.511364899 +0000 UTC m=+0.433924647 container start 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319) 2024-03-28T05:51:46.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 ceph-mds[71264]: -- 172.21.15.159:0/1855396107 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a59f71a40 con 0x555a59f44c00 2024-03-28T05:51:46.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: starting mds.l at 2024-03-28T05:51:46.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 bash[71245]: 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 2024-03-28T05:51:46.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:51:46 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:51:47.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 178 sec latency 285281.446 ms 2024-03-28T05:51:47.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: daemon mds.l restarted 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: osdmap e109: 12 total, 12 up, 12 in 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:boot 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:47.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:47 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: daemon mds.l restarted 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: osdmap e109: 12 total, 12 up, 12 in 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:boot 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:47.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:47 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:47.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:51:47.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: daemon mds.l restarted 2024-03-28T05:51:47.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:51:47.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: osdmap e109: 12 total, 12 up, 12 in 2024-03-28T05:51:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:boot 2024-03-28T05:51:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:51:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:51:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:51:47.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:47 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:48.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 179 sec latency 286281.603 ms 2024-03-28T05:51:49.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 180 sec latency 287281.743 ms 2024-03-28T05:51:49.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:49 smithi086 ceph-mon[35163]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:51:49.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:49 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:resolve 2024-03-28T05:51:49.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:49 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:49.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:49 smithi159 ceph-mon[36109]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:51:49.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:49 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:resolve 2024-03-28T05:51:49.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:49 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:49.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:49 smithi055 ceph-mon[31863]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:51:49.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:49 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:resolve 2024-03-28T05:51:49.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:49 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:50.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 181 sec latency 288281.882 ms 2024-03-28T05:51:50.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:50 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:50.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:50 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:reconnect 2024-03-28T05:51:50.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:50 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:50.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:50 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:50.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:50 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:reconnect 2024-03-28T05:51:50.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:50 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:50.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:50 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:51:50.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:50 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:reconnect 2024-03-28T05:51:50.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:50 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:51.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 182 sec latency 289282.042 ms 2024-03-28T05:51:51.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:51 smithi086 ceph-mon[35163]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:51:51.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:51 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:rejoin 2024-03-28T05:51:51.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:51 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:51.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:51 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:51.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-mon[36109]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:51:51.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:rejoin 2024-03-28T05:51:51.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:51.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb5d2a00700 time 2024-03-28T05:51:51.536223+0000 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5de3374a1] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.818 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: clone() 2024-03-28T05:51:51.819 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.537+0000 7fb5d2a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb5d2a00700 time 2024-03-28T05:51:51.536223+0000 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5de3374a1] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.820 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: clone() 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: *** Caught signal (Aborted) ** 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: in thread 7fb5d2a00700 thread_name:ms_dispatch 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.821 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5dd0bed20] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: gsignal() 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: abort() 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5de3374fb] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.822 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 19: clone() 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.540+0000 7fb5d2a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: in thread 7fb5d2a00700 thread_name:ms_dispatch 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5dd0bed20] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: gsignal() 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: abort() 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5de3374fb] 2024-03-28T05:51:51.823 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.824 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.825 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 19: clone() 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.826 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: -1> 2024-03-28T05:51:51.537+0000 7fb5d2a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb5d2a00700 time 2024-03-28T05:51:51.536223+0000 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5de3374a1] 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.827 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: clone() 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 0> 2024-03-28T05:51:51.540+0000 7fb5d2a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: in thread 7fb5d2a00700 thread_name:ms_dispatch 2024-03-28T05:51:51.828 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5dd0bed20] 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: gsignal() 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: abort() 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5de3374fb] 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.829 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.830 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 19: clone() 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: -1> 2024-03-28T05:51:51.537+0000 7fb5d2a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fb5d2a00700 time 2024-03-28T05:51:51.536223+0000 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5de3374a1] 2024-03-28T05:51:51.831 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: clone() 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.832 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 0> 2024-03-28T05:51:51.540+0000 7fb5d2a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: in thread 7fb5d2a00700 thread_name:ms_dispatch 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5dd0bed20] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2: gsignal() 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 3: abort() 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5de3374fb] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fb5de337667] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556c946d6223] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556c945505d6] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556c94550da1] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556c9458509c] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556c945a3233] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556c945a5197] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556c944a411b] 2024-03-28T05:51:51.833 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556c944a46bc] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556c9448e1ff] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fb5de5c9488] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 16: (DispatchQueue::entry()+0x51f) [0x7fb5de5c660f] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5de699e81] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb5dd0b41ca] 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 19: clone() 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[70987]: 2024-03-28T05:51:51.834 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:51 smithi159 podman[71298]: 2024-03-28 05:51:51.641845864 +0000 UTC m=+0.035189250 container died 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-28T05:51:51.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:51 smithi055 ceph-mon[31863]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:51:51.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:51 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:rejoin 2024-03-28T05:51:51.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:51 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:51.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:51 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:51:52.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 183 sec latency 290282.187 ms 2024-03-28T05:51:52.813 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:51:52.675+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:51:52.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:52.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:51:52.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:active 2024-03-28T05:51:52.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:52.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:52 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:52 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:52 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:active 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:52.815 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:52 smithi159 podman[71298]: 2024-03-28 05:51:52.35484438 +0000 UTC m=+0.748187792 container remove 6444dbba92af496bb0cbae4e0cd7399963b99ce65a4eb556f20a3681e163c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux ) 2024-03-28T05:51:52.816 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:52 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:51:52.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:52 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:51:52.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:52 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:51:52.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:52 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/1144708102,v1:172.21.15.159:6835/1144708102] up:active 2024-03-28T05:51:52.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:51:52.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:51:53.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 184 sec latency 291282.346 ms 2024-03-28T05:51:53.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:52 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:51:53.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:51:52 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.549s CPU time. 2024-03-28T05:51:53.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:53 smithi086 ceph-mon[35163]: pgmap v656: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:51:53.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:53 smithi159 ceph-mon[36109]: pgmap v656: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:51:53.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:53 smithi055 ceph-mon[31863]: pgmap v656: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:51:54.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 185 sec latency 292282.490 ms 2024-03-28T05:51:55.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 186 sec latency 293282.627 ms 2024-03-28T05:51:55.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:55 smithi086 ceph-mon[35163]: pgmap v657: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:55.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:55 smithi159 ceph-mon[36109]: pgmap v657: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:55.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:55 smithi055 ceph-mon[31863]: pgmap v657: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:51:56.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 187 sec latency 294282.758 ms 2024-03-28T05:51:57.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 188 sec latency 295282.924 ms 2024-03-28T05:51:57.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:57 smithi086 ceph-mon[35163]: pgmap v658: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:57.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:57 smithi159 ceph-mon[36109]: pgmap v658: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:57.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:57 smithi055 ceph-mon[31863]: pgmap v658: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:51:58.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 189 sec latency 296283.069 ms 2024-03-28T05:51:59.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 190 sec latency 297283.200 ms 2024-03-28T05:51:59.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:51:59 smithi086 ceph-mon[35163]: pgmap v659: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:51:59.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:51:59 smithi159 ceph-mon[36109]: pgmap v659: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:51:59.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:51:59 smithi055 ceph-mon[31863]: pgmap v659: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:52:00.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 191 sec latency 298283.350 ms 2024-03-28T05:52:01.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 192 sec latency 299283.485 ms 2024-03-28T05:52:01.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:01 smithi086 ceph-mon[35163]: pgmap v660: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:01.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:01 smithi159 ceph-mon[36109]: pgmap v660: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:01.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:01 smithi055 ceph-mon[31863]: pgmap v660: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:02.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 193 sec latency 300283.587 ms 2024-03-28T05:52:03.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 194 sec latency 301283.726 ms 2024-03-28T05:52:03.453 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:52:03.453 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:03.453 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.549s CPU time. 2024-03-28T05:52:03.453 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:52:03.712 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:03 smithi159 ceph-mon[36109]: pgmap v661: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:03.712 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 podman[71404]: 2024-03-28 05:52:03.362397891 +0000 UTC m=+0.033695738 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:52:03.712 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 podman[71404]: 2024-03-28 05:52:03.480027214 +0000 UTC m=+0.151325094 container create 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-28T05:52:03.713 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 podman[71404]: 2024-03-28 05:52:03.71735344 +0000 UTC m=+0.388651380 container init 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-28T05:52:03.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:03 smithi086 ceph-mon[35163]: pgmap v661: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:03.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:03 smithi055 ceph-mon[31863]: pgmap v661: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:04.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 podman[71404]: 2024-03-28 05:52:03.727774034 +0000 UTC m=+0.399071944 container start 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True) 2024-03-28T05:52:04.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 ceph-mds[71423]: -- 172.21.15.159:0/3191746218 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee93f71a40 con 0x55ee93f45000 2024-03-28T05:52:04.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: starting mds.f at 2024-03-28T05:52:04.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 bash[71404]: 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 2024-03-28T05:52:04.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:03 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:04.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 195 sec latency 302283.890 ms 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: daemon mds.f restarted 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: osdmap e110: 12 total, 12 up, 12 in 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:boot 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:04.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:04 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:04.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: daemon mds.f restarted 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: osdmap e110: 12 total, 12 up, 12 in 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:boot 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:04.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:04 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: daemon mds.f restarted 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: osdmap e110: 12 total, 12 up, 12 in 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:boot 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:04.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:04 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:05.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 196 sec latency 303284.032 ms 2024-03-28T05:52:06.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:05 smithi086 ceph-mon[35163]: pgmap v663: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:52:06.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:05 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:resolve 2024-03-28T05:52:06.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:05 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:06.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:05 smithi159 ceph-mon[36109]: pgmap v663: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:52:06.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:05 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:resolve 2024-03-28T05:52:06.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:05 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:06.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:05 smithi055 ceph-mon[31863]: pgmap v663: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:52:06.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:05 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:resolve 2024-03-28T05:52:06.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:05 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:06.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 197 sec latency 304284.120 ms 2024-03-28T05:52:07.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 198 sec latency 305284.272 ms 2024-03-28T05:52:07.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:07 smithi086 ceph-mon[35163]: pgmap v664: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:07.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:07 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:07.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:07 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:reconnect 2024-03-28T05:52:07.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:07 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:07 smithi159 ceph-mon[36109]: pgmap v664: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:07 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:07.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:07 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:reconnect 2024-03-28T05:52:07.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:07 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:07.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:07 smithi055 ceph-mon[31863]: pgmap v664: 97 pgs: 97 active+clean; 22 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:07.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:07 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:07.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:07 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:reconnect 2024-03-28T05:52:07.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:07 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:08.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 199 sec latency 306284.414 ms 2024-03-28T05:52:08.494 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4e03600700 time 2024-03-28T05:52:08.140894+0000 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4e0eefe4a1] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.495 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.496 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: clone() 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.143+0000 7f4e03600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4e03600700 time 2024-03-28T05:52:08.140894+0000 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4e0eefe4a1] 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.497 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.498 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: clone() 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: *** Caught signal (Aborted) ** 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: in thread 7f4e03600700 thread_name:ms_dispatch 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.499 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4e0dc85d20] 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: gsignal() 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: abort() 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4e0eefe4fb] 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.500 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.501 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 19: clone() 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.147+0000 7f4e03600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: in thread 7f4e03600700 thread_name:ms_dispatch 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4e0dc85d20] 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: gsignal() 2024-03-28T05:52:08.502 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: abort() 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4e0eefe4fb] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.503 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 19: clone() 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: -1> 2024-03-28T05:52:08.143+0000 7f4e03600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4e03600700 time 2024-03-28T05:52:08.140894+0000 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.504 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4e0eefe4a1] 2024-03-28T05:52:08.505 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.506 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: clone() 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 0> 2024-03-28T05:52:08.147+0000 7f4e03600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: in thread 7f4e03600700 thread_name:ms_dispatch 2024-03-28T05:52:08.507 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4e0dc85d20] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: gsignal() 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: abort() 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4e0eefe4fb] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.508 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.509 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 19: clone() 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: -1> 2024-03-28T05:52:08.143+0000 7f4e03600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4e03600700 time 2024-03-28T05:52:08.140894+0000 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4e0eefe4a1] 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.510 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.511 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: clone() 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 0> 2024-03-28T05:52:08.147+0000 7f4e03600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: in thread 7f4e03600700 thread_name:ms_dispatch 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4e0dc85d20] 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2: gsignal() 2024-03-28T05:52:08.512 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 3: abort() 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4e0eefe4fb] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4e0eefe667] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x555a5912b223] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x555a58fa55d6] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x555a58fa5da1] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x555a58fda09c] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x555a58ff8233] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555a58ffa197] 2024-03-28T05:52:08.513 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555a58ef911b] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555a58ef96bc] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x555a58ee31ff] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4e0f190488] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 16: (DispatchQueue::entry()+0x51f) [0x7f4e0f18d60f] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4e0f260e81] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4e0dc7b1ca] 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 19: clone() 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71260]: 2024-03-28T05:52:08.514 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 podman[71459]: 2024-03-28 05:52:08.249590438 +0000 UTC m=+0.032864439 container died 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:rejoin 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:52:08.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:active 2024-03-28T05:52:08.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:08 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:08.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:rejoin 2024-03-28T05:52:08.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:08.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:08.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:08.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:52:08.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:active 2024-03-28T05:52:08.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:08 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:09.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:rejoin 2024-03-28T05:52:09.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:09.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:09.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:09.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:52:09.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/1541753039,v1:172.21.15.159:6833/1541753039] up:active 2024-03-28T05:52:09.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:08 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:09.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 200 sec latency 307284.572 ms 2024-03-28T05:52:09.315 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 podman[71459]: 2024-03-28 05:52:08.961732525 +0000 UTC m=+0.745006573 container remove 9c175212c35b261f8fb3f89594c91d7f0cb410a127593d28bf489eaad1a5ae85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, ceph=True, org.label-schema.vendor=CentOS) 2024-03-28T05:52:09.315 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:08 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:52:09.815 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:09 smithi159 ceph-mon[36109]: pgmap v665: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:09.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:52:09.815 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.499s CPU time. 2024-03-28T05:52:09.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:09 smithi055 ceph-mon[31863]: pgmap v665: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:10.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:09 smithi086 ceph-mon[35163]: pgmap v665: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:10.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 201 sec latency 308284.724 ms 2024-03-28T05:52:11.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 202 sec latency 309284.854 ms 2024-03-28T05:52:11.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:11 smithi055 ceph-mon[31863]: pgmap v666: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:52:12.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:11 smithi086 ceph-mon[35163]: pgmap v666: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:52:12.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:11 smithi159 ceph-mon[36109]: pgmap v666: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:52:12.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 203 sec latency 310284.943 ms 2024-03-28T05:52:13.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 204 sec latency 311285.085 ms 2024-03-28T05:52:13.866 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:13 smithi086 ceph-mon[35163]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:52:13.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:13 smithi055 ceph-mon[31863]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:52:14.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:13 smithi159 ceph-mon[36109]: pgmap v667: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:52:14.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 205 sec latency 312285.183 ms 2024-03-28T05:52:15.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 206 sec latency 313285.341 ms 2024-03-28T05:52:15.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:15 smithi055 ceph-mon[31863]: pgmap v668: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:16.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:15 smithi086 ceph-mon[35163]: pgmap v668: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:16.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:15 smithi159 ceph-mon[36109]: pgmap v668: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:16.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 207 sec latency 314285.458 ms 2024-03-28T05:52:17.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 208 sec latency 315285.601 ms 2024-03-28T05:52:17.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:17 smithi055 ceph-mon[31863]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:18.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:17 smithi086 ceph-mon[35163]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:18.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:17 smithi159 ceph-mon[36109]: pgmap v669: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:18.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 209 sec latency 316285.735 ms 2024-03-28T05:52:19.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 210 sec latency 317285.891 ms 2024-03-28T05:52:19.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:19 smithi055 ceph-mon[31863]: pgmap v670: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:19.952 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:19 smithi159 ceph-mon[36109]: pgmap v670: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:19.952 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:52:19.952 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:19.952 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.499s CPU time. 2024-03-28T05:52:19.952 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 systemd[1]: Starting Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:52:20.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:19 smithi086 ceph-mon[35163]: pgmap v670: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:20.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 211 sec latency 318285.994 ms 2024-03-28T05:52:20.227 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 podman[71549]: 2024-03-28 05:52:19.861885045 +0000 UTC m=+0.033426136 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:52:20.227 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:19 smithi159 podman[71549]: 2024-03-28 05:52:19.970411664 +0000 UTC m=+0.141952783 container create e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-28T05:52:20.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 podman[71549]: 2024-03-28 05:52:20.232757254 +0000 UTC m=+0.404298417 container init e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:52:20.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 podman[71549]: 2024-03-28 05:52:20.242938362 +0000 UTC m=+0.414479488 container start e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD) 2024-03-28T05:52:20.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mds[71568]: -- 172.21.15.159:0/2907229852 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556cb9653a40 con 0x556cb9626800 2024-03-28T05:52:20.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: starting mds.l at 2024-03-28T05:52:20.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 bash[71549]: e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 2024-03-28T05:52:20.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:20 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:21.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: daemon mds.l restarted 2024-03-28T05:52:21.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:21.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: osdmap e111: 12 total, 12 up, 12 in 2024-03-28T05:52:21.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:boot 2024-03-28T05:52:21.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:21.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:21.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:21.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:20 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: daemon mds.l restarted 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: osdmap e111: 12 total, 12 up, 12 in 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:boot 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:21.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:20 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: daemon mds.l restarted 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: osdmap e111: 12 total, 12 up, 12 in 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:boot 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:21.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:20 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:21.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 212 sec latency 319286.137 ms 2024-03-28T05:52:22.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:21 smithi086 ceph-mon[35163]: pgmap v671: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:52:22.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:21 smithi159 ceph-mon[36109]: pgmap v671: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:52:22.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:21 smithi055 ceph-mon[31863]: pgmap v671: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:52:22.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 213 sec latency 320286.284 ms 2024-03-28T05:52:23.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:22 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:resolve 2024-03-28T05:52:23.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:22 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:23.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:22 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:resolve 2024-03-28T05:52:23.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:22 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:23.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:22 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:resolve 2024-03-28T05:52:23.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:22 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:23.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 214 sec latency 321286.414 ms 2024-03-28T05:52:24.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:23 smithi086 ceph-mon[35163]: pgmap v673: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:52:24.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:23 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:24.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:23 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:reconnect 2024-03-28T05:52:24.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:23 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:24.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:23 smithi159 ceph-mon[36109]: pgmap v673: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:52:24.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:23 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:24.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:23 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:reconnect 2024-03-28T05:52:24.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:23 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:24.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:23 smithi055 ceph-mon[31863]: pgmap v673: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:52:24.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:23 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:24.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:23 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:reconnect 2024-03-28T05:52:24.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:23 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:24.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 215 sec latency 322286.541 ms 2024-03-28T05:52:25.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:rejoin 2024-03-28T05:52:25.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:24 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:25.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:24 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:rejoin 2024-03-28T05:52:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f75e3c00700 time 2024-03-28T05:52:24.736199+0000 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75ef4574a1] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.066 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: clone() 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: *** Caught signal (Aborted) ** 2024-03-28T05:52:25.067 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: in thread 7f75e3c00700 thread_name:ms_dispatch 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:24.736+0000 7f75e3c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f75e3c00700 time 2024-03-28T05:52:24.736199+0000 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75ef4574a1] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.068 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: clone() 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75ee1ded20] 2024-03-28T05:52:25.069 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: gsignal() 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: abort() 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75ef4574fb] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.070 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 19: clone() 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:24.738+0000 7f75e3c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: in thread 7f75e3c00700 thread_name:ms_dispatch 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75ee1ded20] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: gsignal() 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: abort() 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75ef4574fb] 2024-03-28T05:52:25.071 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.072 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 19: clone() 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: -1> 2024-03-28T05:52:24.736+0000 7f75e3c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f75e3c00700 time 2024-03-28T05:52:24.736199+0000 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.073 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75ef4574a1] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.074 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: clone() 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 0> 2024-03-28T05:52:24.738+0000 7f75e3c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: in thread 7f75e3c00700 thread_name:ms_dispatch 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75ee1ded20] 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: gsignal() 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: abort() 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75ef4574fb] 2024-03-28T05:52:25.075 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.076 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.076 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.076 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 19: clone() 2024-03-28T05:52:25.077 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: -1> 2024-03-28T05:52:24.736+0000 7f75e3c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f75e3c00700 time 2024-03-28T05:52:24.736199+0000 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75ef4574a1] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.078 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: clone() 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 0> 2024-03-28T05:52:24.738+0000 7f75e3c00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: in thread 7f75e3c00700 thread_name:ms_dispatch 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75ee1ded20] 2024-03-28T05:52:25.079 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2: gsignal() 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 3: abort() 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75ef4574fb] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f75ef457667] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55ee920fc223] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55ee91f765d6] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55ee91f76da1] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55ee91fab09c] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55ee91fc9233] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ee91fcb197] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ee91eca11b] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ee91eca6bc] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55ee91eb41ff] 2024-03-28T05:52:25.080 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f75ef6e9488] 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 16: (DispatchQueue::entry()+0x51f) [0x7f75ef6e660f] 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75ef7b9e81] 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f75ee1d41ca] 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 19: clone() 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71419]: 2024-03-28T05:52:25.081 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:24 smithi159 podman[71602]: 2024-03-28 05:52:24.823556507 +0000 UTC m=+0.032913566 container died 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-28T05:52:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:rejoin 2024-03-28T05:52:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:24 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:24 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:25.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 216 sec latency 323286.642 ms 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: pgmap v674: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:active 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:25 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:25 smithi159 podman[71602]: 2024-03-28 05:52:25.57720867 +0000 UTC m=+0.786565802 container remove 8fe399375dfeb501e737223caf768b7ed40c891e803a5001e3f35ae607709ae9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-03-28T05:52:26.011 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:25 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: pgmap v674: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:active 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:26.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:25 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:26.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: pgmap v674: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:52:26.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:26.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:52:26.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/2897824953,v1:172.21.15.159:6835/2897824953] up:active 2024-03-28T05:52:26.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:26.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:25 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:26.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 217 sec latency 324286.834 ms 2024-03-28T05:52:26.314 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:26 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:52:26.314 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:26 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.457s CPU time. 2024-03-28T05:52:27.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 218 sec latency 325286.974 ms 2024-03-28T05:52:28.063 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:52:27 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:52:27.679+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:52:28.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:27 smithi086 ceph-mon[35163]: pgmap v675: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:52:28.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:27 smithi159 ceph-mon[36109]: pgmap v675: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:52:28.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:27 smithi055 ceph-mon[31863]: pgmap v675: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:52:28.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 219 sec latency 326287.116 ms 2024-03-28T05:52:29.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 220 sec latency 327287.269 ms 2024-03-28T05:52:30.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:29 smithi086 ceph-mon[35163]: pgmap v676: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:52:30.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:29 smithi159 ceph-mon[36109]: pgmap v676: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:52:30.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:29 smithi055 ceph-mon[31863]: pgmap v676: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:52:30.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 221 sec latency 328287.430 ms 2024-03-28T05:52:31.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 222 sec latency 329287.561 ms 2024-03-28T05:52:32.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:31 smithi086 ceph-mon[35163]: pgmap v677: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:32.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:31 smithi159 ceph-mon[36109]: pgmap v677: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:32.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:31 smithi055 ceph-mon[31863]: pgmap v677: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:52:32.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 223 sec latency 330287.651 ms 2024-03-28T05:52:33.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 224 sec latency 331287.837 ms 2024-03-28T05:52:34.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:33 smithi086 ceph-mon[35163]: pgmap v678: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:34.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:33 smithi159 ceph-mon[36109]: pgmap v678: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:34.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:33 smithi055 ceph-mon[31863]: pgmap v678: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:34.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 225 sec latency 332287.992 ms 2024-03-28T05:52:35.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 226 sec latency 333288.132 ms 2024-03-28T05:52:36.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:35 smithi086 ceph-mon[35163]: pgmap v679: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:52:36.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:52:36.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:35 smithi159 ceph-mon[36109]: pgmap v679: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:52:36.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:52:36.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:35 smithi055 ceph-mon[31863]: pgmap v679: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:52:36.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:52:36.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 227 sec latency 334288.208 ms 2024-03-28T05:52:36.446 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:52:36.446 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:36.447 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.457s CPU time. 2024-03-28T05:52:36.447 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 systemd[1]: Starting Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:52:36.737 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 podman[71773]: 2024-03-28 05:52:36.355934211 +0000 UTC m=+0.031664278 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:52:36.737 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 podman[71773]: 2024-03-28 05:52:36.486532967 +0000 UTC m=+0.162263058 container create 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319) 2024-03-28T05:52:36.737 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 podman[71773]: 2024-03-28 05:52:36.740918846 +0000 UTC m=+0.416648943 container init 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:52:37.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 podman[71773]: 2024-03-28 05:52:36.756245897 +0000 UTC m=+0.431975975 container start 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-mds[71806]: -- 172.21.15.159:0/2617837602 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5634b0095a40 con 0x5634b0068800 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: starting mds.f at 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 bash[71773]: 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 2024-03-28T05:52:37.065 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:36 smithi159 systemd[1]: Started Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:37.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T05:52:37.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 228 sec latency 335288.327 ms 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: pgmap v680: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: daemon mds.f restarted 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: osdmap e112: 12 total, 12 up, 12 in 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:boot 2024-03-28T05:52:38.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:52:38.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: pgmap v680: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: daemon mds.f restarted 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: osdmap e112: 12 total, 12 up, 12 in 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:boot 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:52:38.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:52:38.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: pgmap v680: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: daemon mds.f restarted 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: osdmap e112: 12 total, 12 up, 12 in 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:boot 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:52:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:52:38.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 229 sec latency 336288.483 ms 2024-03-28T05:52:39.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 230 sec latency 337288.641 ms 2024-03-28T05:52:40.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:39 smithi086 ceph-mon[35163]: pgmap v682: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:52:40.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:39 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:resolve 2024-03-28T05:52:40.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:39 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:40.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:39 smithi159 ceph-mon[36109]: pgmap v682: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:52:40.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:39 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:resolve 2024-03-28T05:52:40.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:39 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:40.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:39 smithi055 ceph-mon[31863]: pgmap v682: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:52:40.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:39 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:resolve 2024-03-28T05:52:40.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:39 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:40.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 231 sec latency 338288.773 ms 2024-03-28T05:52:41.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:40 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:41.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:40 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:reconnect 2024-03-28T05:52:41.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:40 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:41.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:40 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:41.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:40 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:reconnect 2024-03-28T05:52:41.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:40 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:41.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:40 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:52:41.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:40 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:reconnect 2024-03-28T05:52:41.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:40 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:41.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 232 sec latency 339288.940 ms 2024-03-28T05:52:42.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: pgmap v683: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:52:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:rejoin 2024-03-28T05:52:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:41 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:52:42.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: pgmap v683: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:52:42.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:rejoin 2024-03-28T05:52:42.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ffa24000700 time 2024-03-28T05:52:41.825828+0000 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:42.065 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffa2f8ef4a1] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.066 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: clone() 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:41.827+0000 7ffa24000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ffa24000700 time 2024-03-28T05:52:41.825828+0000 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffa2f8ef4a1] 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.067 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: clone() 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: *** Caught signal (Aborted) ** 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: in thread 7ffa24000700 thread_name:ms_dispatch 2024-03-28T05:52:42.068 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffa2e676d20] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: gsignal() 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: abort() 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffa2f8ef4fb] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.069 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 19: clone() 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:41.829+0000 7ffa24000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: in thread 7ffa24000700 thread_name:ms_dispatch 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffa2e676d20] 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: gsignal() 2024-03-28T05:52:42.070 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: abort() 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffa2f8ef4fb] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.071 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 19: clone() 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: -1> 2024-03-28T05:52:41.827+0000 7ffa24000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ffa24000700 time 2024-03-28T05:52:41.825828+0000 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffa2f8ef4a1] 2024-03-28T05:52:42.072 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.073 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: clone() 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 0> 2024-03-28T05:52:41.829+0000 7ffa24000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: in thread 7ffa24000700 thread_name:ms_dispatch 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffa2e676d20] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: gsignal() 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: abort() 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffa2f8ef4fb] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.074 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.075 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 19: clone() 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: -1> 2024-03-28T05:52:41.827+0000 7ffa24000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7ffa24000700 time 2024-03-28T05:52:41.825828+0000 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.076 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffa2f8ef4a1] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: clone() 2024-03-28T05:52:42.077 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 0> 2024-03-28T05:52:41.829+0000 7ffa24000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: in thread 7ffa24000700 thread_name:ms_dispatch 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffa2e676d20] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2: gsignal() 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 3: abort() 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffa2f8ef4fb] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7ffa2f8ef667] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x556cb7dce223] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x556cb7c485d6] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x556cb7c48da1] 2024-03-28T05:52:42.078 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x556cb7c7d09c] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x556cb7c9b233] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556cb7c9d197] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556cb7b9c11b] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556cb7b9c6bc] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x556cb7b861ff] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ffa2fb81488] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 16: (DispatchQueue::entry()+0x51f) [0x7ffa2fb7e60f] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffa2fc51e81] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7ffa2e66c1ca] 2024-03-28T05:52:42.079 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 19: clone() 2024-03-28T05:52:42.080 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:42.080 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71564]: 2024-03-28T05:52:42.080 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:41 smithi159 podman[71872]: 2024-03-28 05:52:41.922768063 +0000 UTC m=+0.032748077 container died e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: pgmap v683: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:rejoin 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:41 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:52:42.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 233 sec latency 340289.094 ms 2024-03-28T05:52:43.062 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:52:42 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:52:42.679+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:52:43.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:42 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:active 2024-03-28T05:52:43.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:42 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:43.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:42 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:43.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:42 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:active 2024-03-28T05:52:43.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:42 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:43.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:42 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:43.064 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:42 smithi159 podman[71872]: 2024-03-28 05:52:42.626956777 +0000 UTC m=+0.736936828 container remove e7f1fdb4493e06819e3de82f5d837c04928454d9e758ac04125ad46eba3877e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:52:43.064 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:42 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:52:43.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:42 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/2520990924,v1:172.21.15.159:6833/2520990924] up:active 2024-03-28T05:52:43.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:42 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:43.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:42 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:43.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 234 sec latency 341289.250 ms 2024-03-28T05:52:43.564 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:43 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:52:43.564 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:43 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.533s CPU time. 2024-03-28T05:52:44.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:43 smithi055 ceph-mon[31863]: pgmap v684: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:52:44.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 235 sec latency 342289.363 ms 2024-03-28T05:52:44.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:43 smithi086 ceph-mon[35163]: pgmap v684: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:52:44.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:43 smithi159 ceph-mon[36109]: pgmap v684: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-03-28T05:52:45.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 236 sec latency 343289.493 ms 2024-03-28T05:52:46.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:45 smithi055 ceph-mon[31863]: pgmap v685: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:52:46.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 237 sec latency 344289.636 ms 2024-03-28T05:52:46.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:45 smithi086 ceph-mon[35163]: pgmap v685: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:52:46.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:45 smithi159 ceph-mon[36109]: pgmap v685: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:52:47.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 238 sec latency 345289.779 ms 2024-03-28T05:52:48.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:47 smithi055 ceph-mon[31863]: pgmap v686: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:52:48.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 239 sec latency 346289.976 ms 2024-03-28T05:52:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:47 smithi086 ceph-mon[35163]: pgmap v686: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:52:48.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:47 smithi159 ceph-mon[36109]: pgmap v686: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:52:49.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 240 sec latency 347290.075 ms 2024-03-28T05:52:50.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:49 smithi055 ceph-mon[31863]: pgmap v687: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:52:50.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 241 sec latency 348290.202 ms 2024-03-28T05:52:50.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:49 smithi086 ceph-mon[35163]: pgmap v687: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:52:50.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:49 smithi159 ceph-mon[36109]: pgmap v687: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:52:51.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 242 sec latency 349290.332 ms 2024-03-28T05:52:52.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:51 smithi055 ceph-mon[31863]: pgmap v688: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:52.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 243 sec latency 350290.447 ms 2024-03-28T05:52:52.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:51 smithi086 ceph-mon[35163]: pgmap v688: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:52.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:51 smithi159 ceph-mon[36109]: pgmap v688: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:52:53.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 244 sec latency 351290.616 ms 2024-03-28T05:52:53.694 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:52:53.694 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:53.694 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.533s CPU time. 2024-03-28T05:52:53.694 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 systemd[1]: Starting Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:52:54.016 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:53 smithi159 ceph-mon[36109]: pgmap v689: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:54.017 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 podman[71964]: 2024-03-28 05:52:53.604923122 +0000 UTC m=+0.032739675 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:52:54.017 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:53 smithi159 podman[71964]: 2024-03-28 05:52:53.718855359 +0000 UTC m=+0.146671979 container create a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True) 2024-03-28T05:52:54.017 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 podman[71964]: 2024-03-28 05:52:54.022413444 +0000 UTC m=+0.450230060 container init a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-28T05:52:54.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:53 smithi055 ceph-mon[31863]: pgmap v689: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:54.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 245 sec latency 352290.777 ms 2024-03-28T05:52:54.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:53 smithi086 ceph-mon[35163]: pgmap v689: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:54.314 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 podman[71964]: 2024-03-28 05:52:54.03284189 +0000 UTC m=+0.460658487 container start a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0) 2024-03-28T05:52:54.314 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mds[71982]: -- 172.21.15.159:0/4006685556 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b447bba40 con 0x564b4478f000 2024-03-28T05:52:54.315 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: starting mds.l at 2024-03-28T05:52:54.315 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 bash[71964]: a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 2024-03-28T05:52:54.315 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:52:54 smithi159 systemd[1]: Started Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:52:55.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: daemon mds.l restarted 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: pgmap v690: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: osdmap e113: 12 total, 12 up, 12 in 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:boot 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:55.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:54 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:55.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 246 sec latency 353290.960 ms 2024-03-28T05:52:55.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: daemon mds.l restarted 2024-03-28T05:52:55.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: pgmap v690: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: osdmap e113: 12 total, 12 up, 12 in 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:boot 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:55.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:54 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:55.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: daemon mds.l restarted 2024-03-28T05:52:55.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:52:55.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: pgmap v690: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:52:55.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: osdmap e113: 12 total, 12 up, 12 in 2024-03-28T05:52:55.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:boot 2024-03-28T05:52:55.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-03-28T05:52:55.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-03-28T05:52:55.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-28T05:52:55.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:54 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:56.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 247 sec latency 354291.125 ms 2024-03-28T05:52:57.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 248 sec latency 355291.283 ms 2024-03-28T05:52:57.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:56 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:resolve 2024-03-28T05:52:57.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:56 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:57.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:56 smithi086 ceph-mon[35163]: pgmap v692: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-03-28T05:52:57.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:56 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:resolve 2024-03-28T05:52:57.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:56 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:57.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:56 smithi159 ceph-mon[36109]: pgmap v692: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-03-28T05:52:57.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:56 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:resolve 2024-03-28T05:52:57.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:56 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:57.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:56 smithi055 ceph-mon[31863]: pgmap v692: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-03-28T05:52:58.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 249 sec latency 356291.398 ms 2024-03-28T05:52:58.166 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:57 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:52:58.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:57 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:reconnect 2024-03-28T05:52:58.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:57 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:57 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:52:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:57 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:reconnect 2024-03-28T05:52:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:57 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:58.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:57 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:52:58.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:57 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:reconnect 2024-03-28T05:52:58.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:57 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:58.565 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f59af400700 time 2024-03-28T05:52:58.173387+0000 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59bac9e4a1] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.566 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: clone() 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: *** Caught signal (Aborted) ** 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: in thread 7f59af400700 thread_name:ms_dispatch 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.175+0000 7f59af400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f59af400700 time 2024-03-28T05:52:58.173387+0000 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59bac9e4a1] 2024-03-28T05:52:58.567 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: clone() 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.568 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.569 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59b9a25d20] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: gsignal() 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: abort() 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59bac9e4fb] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.570 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 19: clone() 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.178+0000 7f59af400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: in thread 7f59af400700 thread_name:ms_dispatch 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59b9a25d20] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: gsignal() 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: abort() 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59bac9e4fb] 2024-03-28T05:52:58.571 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.572 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 19: clone() 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: -1> 2024-03-28T05:52:58.175+0000 7f59af400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f59af400700 time 2024-03-28T05:52:58.173387+0000 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59bac9e4a1] 2024-03-28T05:52:58.573 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.574 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: clone() 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 0> 2024-03-28T05:52:58.178+0000 7f59af400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: in thread 7f59af400700 thread_name:ms_dispatch 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59b9a25d20] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: gsignal() 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: abort() 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59bac9e4fb] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.575 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.576 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 19: clone() 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: -1> 2024-03-28T05:52:58.175+0000 7f59af400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f59af400700 time 2024-03-28T05:52:58.173387+0000 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59bac9e4a1] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.577 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.578 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: clone() 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 0> 2024-03-28T05:52:58.178+0000 7f59af400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: in thread 7f59af400700 thread_name:ms_dispatch 2024-03-28T05:52:58.579 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59b9a25d20] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2: gsignal() 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 3: abort() 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59bac9e4fb] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f59bac9e667] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5634ad52a223] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5634ad3a45d6] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5634ad3a4da1] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5634ad3d909c] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5634ad3f7233] 2024-03-28T05:52:58.580 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5634ad3f9197] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5634ad2f811b] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5634ad2f86bc] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5634ad2e21ff] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f59baf30488] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 16: (DispatchQueue::entry()+0x51f) [0x7f59baf2d60f] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59bb000e81] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f59b9a1b1ca] 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 19: clone() 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f[71802]: 2024-03-28T05:52:58.581 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:58 smithi159 podman[72016]: 2024-03-28 05:52:58.28491529 +0000 UTC m=+0.031657528 container died 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-28T05:52:59.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 250 sec latency 357291.554 ms 2024-03-28T05:52:59.166 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:59 smithi159 podman[72016]: 2024-03-28 05:52:59.158577509 +0000 UTC m=+0.905319791 container remove 91baaf32779a95125a3279cdee2af3ddc1138a97f01a37b54ef395bdc5d44b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:52:59.166 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:59 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:52:59.166 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:rejoin 2024-03-28T05:52:59.166 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:59.166 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:59.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: pgmap v693: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:59.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:59.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:52:59.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:active 2024-03-28T05:52:59.167 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:52:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:59.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:rejoin 2024-03-28T05:52:59.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: pgmap v693: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:active 2024-03-28T05:52:59.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:52:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:rejoin 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:active} 2 up:standby-replay 5 up:standby 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: pgmap v693: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:52:59.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:52:59.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6834/959210508,v1:172.21.15.159:6835/959210508] up:active 2024-03-28T05:52:59.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:52:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-03-28T05:53:00.064 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:59 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:53:00.064 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:52:59 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.535s CPU time. 2024-03-28T05:53:00.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 251 sec latency 358291.683 ms 2024-03-28T05:53:01.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 252 sec latency 359291.827 ms 2024-03-28T05:53:01.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:01 smithi159 ceph-mon[36109]: pgmap v694: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:53:01.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:01 smithi086 ceph-mon[35163]: pgmap v694: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:53:01.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:01 smithi055 ceph-mon[31863]: pgmap v694: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:53:02.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 253 sec latency 360291.961 ms 2024-03-28T05:53:03.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 254 sec latency 361292.054 ms 2024-03-28T05:53:03.467 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:03 smithi159 ceph-mon[36109]: pgmap v695: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:53:03.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:03 smithi086 ceph-mon[35163]: pgmap v695: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:53:03.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:03 smithi055 ceph-mon[31863]: pgmap v695: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 102 B/s wr, 12 op/s 2024-03-28T05:53:04.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 255 sec latency 362292.192 ms 2024-03-28T05:53:05.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 256 sec latency 363292.324 ms 2024-03-28T05:53:05.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:05 smithi086 ceph-mon[35163]: pgmap v696: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:53:05.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:05 smithi159 ceph-mon[36109]: pgmap v696: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:53:05.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:05 smithi055 ceph-mon[31863]: pgmap v696: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:53:06.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 257 sec latency 364292.425 ms 2024-03-28T05:53:07.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 258 sec latency 365292.574 ms 2024-03-28T05:53:07.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:07 smithi086 ceph-mon[35163]: pgmap v697: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:07.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:07 smithi159 ceph-mon[36109]: pgmap v697: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:07.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:07 smithi055 ceph-mon[31863]: pgmap v697: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:08.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 259 sec latency 366292.721 ms 2024-03-28T05:53:09.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 260 sec latency 367292.866 ms 2024-03-28T05:53:09.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:09 smithi086 ceph-mon[35163]: pgmap v698: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:09.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:09 smithi159 ceph-mon[36109]: pgmap v698: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:09.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:09 smithi055 ceph-mon[31863]: pgmap v698: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:10.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 261 sec latency 368293.017 ms 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Scheduled restart job, restart counter is at 6. 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: Stopped Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Consumed 1.535s CPU time. 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Start request repeated too quickly. 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.f.service: Failed with result 'exit-code'. 2024-03-28T05:53:10.315 INFO:journalctl@ceph.mds.f.smithi159.stdout:Mar 28 05:53:09 smithi159 systemd[1]: Failed to start Ceph mds.f for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:11.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 262 sec latency 369293.168 ms 2024-03-28T05:53:11.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:11 smithi086 ceph-mon[35163]: pgmap v699: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:53:11.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:11 smithi159 ceph-mon[36109]: pgmap v699: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:53:11.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:11 smithi055 ceph-mon[31863]: pgmap v699: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:53:12.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 263 sec latency 370293.305 ms 2024-03-28T05:53:13.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 264 sec latency 371293.402 ms 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: pgmap v700: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: Replacing daemon mds.f as rank 1 with standby daemon mds.l 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: osdmap e114: 12 total, 12 up, 12 in 2024-03-28T05:53:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:13 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: pgmap v700: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: Replacing daemon mds.f as rank 1 with standby daemon mds.l 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: osdmap e114: 12 total, 12 up, 12 in 2024-03-28T05:53:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:13 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: pgmap v700: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: Replacing daemon mds.f as rank 1 with standby daemon mds.l 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: osdmap e114: 12 total, 12 up, 12 in 2024-03-28T05:53:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:13 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:14.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 265 sec latency 372293.558 ms 2024-03-28T05:53:15.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 266 sec latency 373293.691 ms 2024-03-28T05:53:15.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:15 smithi086 ceph-mon[35163]: pgmap v702: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:53:15.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:15 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:resolve 2024-03-28T05:53:15.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:15 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:15.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:15 smithi159 ceph-mon[36109]: pgmap v702: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:53:15.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:15 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:resolve 2024-03-28T05:53:15.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:15 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:15.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:15 smithi055 ceph-mon[31863]: pgmap v702: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:53:15.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:15 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:resolve 2024-03-28T05:53:15.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:15 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:16.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 267 sec latency 374293.856 ms 2024-03-28T05:53:16.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:16 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:53:16.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:16 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:reconnect 2024-03-28T05:53:16.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:16 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:16.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:16 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:53:16.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:16 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:reconnect 2024-03-28T05:53:16.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:16 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:16.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:16 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:53:16.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:16 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:reconnect 2024-03-28T05:53:16.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:16 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:17.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 268 sec latency 375294.018 ms 2024-03-28T05:53:17.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:17 smithi086 ceph-mon[35163]: pgmap v703: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:17.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:17 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:rejoin 2024-03-28T05:53:17.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:17 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:17.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:17 smithi086 ceph-mon[35163]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:53:17.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-mon[36109]: pgmap v703: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:17.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:rejoin 2024-03-28T05:53:17.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:17.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-mon[36109]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f82c9a00700 time 2024-03-28T05:53:17.317860+0000 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f82d533a4a1] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.565 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.566 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: clone() 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.320+0000 7f82c9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f82c9a00700 time 2024-03-28T05:53:17.317860+0000 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f82d533a4a1] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.567 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: clone() 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: *** Caught signal (Aborted) ** 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: in thread 7f82c9a00700 thread_name:ms_dispatch 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f82d40c1d20] 2024-03-28T05:53:17.568 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: gsignal() 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: abort() 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f82d533a4fb] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.569 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 19: clone() 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.324+0000 7f82c9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: in thread 7f82c9a00700 thread_name:ms_dispatch 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f82d40c1d20] 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: gsignal() 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: abort() 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f82d533a4fb] 2024-03-28T05:53:17.570 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.571 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 19: clone() 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: -1> 2024-03-28T05:53:17.320+0000 7f82c9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f82c9a00700 time 2024-03-28T05:53:17.317860+0000 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f82d533a4a1] 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.572 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: clone() 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 0> 2024-03-28T05:53:17.324+0000 7f82c9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: in thread 7f82c9a00700 thread_name:ms_dispatch 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.573 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f82d40c1d20] 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: gsignal() 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: abort() 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f82d533a4fb] 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.574 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 19: clone() 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: -1> 2024-03-28T05:53:17.320+0000 7f82c9a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f82c9a00700 time 2024-03-28T05:53:17.317860+0000 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f82d533a4a1] 2024-03-28T05:53:17.576 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: clone() 2024-03-28T05:53:17.577 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 0> 2024-03-28T05:53:17.324+0000 7f82c9a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: in thread 7f82c9a00700 thread_name:ms_dispatch 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f82d40c1d20] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2: gsignal() 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 3: abort() 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f82d533a4fb] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f82d533a667] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564b438db223] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564b437555d6] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564b43755da1] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564b4378a09c] 2024-03-28T05:53:17.578 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564b437a8233] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564b437aa197] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564b436a911b] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564b436a96bc] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564b436931ff] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f82d55cc488] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 16: (DispatchQueue::entry()+0x51f) [0x7f82d55c960f] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f82d569ce81] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f82d40b71ca] 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 19: clone() 2024-03-28T05:53:17.579 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:17.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l[71978]: 2024-03-28T05:53:17.580 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:17 smithi159 podman[72073]: 2024-03-28 05:53:17.428831082 +0000 UTC m=+0.035118463 container died a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:53:17.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:17 smithi055 ceph-mon[31863]: pgmap v703: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:17.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:17 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:rejoin 2024-03-28T05:53:17.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:17 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:17.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:17 smithi055 ceph-mon[31863]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-03-28T05:53:18.062 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:53:17 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:53:17.683+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:53:18.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 269 sec latency 376294.177 ms 2024-03-28T05:53:18.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:18 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:18.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:18 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:53:18.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:active 2024-03-28T05:53:18.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:18.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:18 smithi159 podman[72073]: 2024-03-28 05:53:18.114706854 +0000 UTC m=+0.720994278 container remove a1f84162166ae673982cf2627cd9981909bae75c3bda76c8df2744d0bee42362 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-l, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:18 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:18 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:18 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:active 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:18.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-03-28T05:53:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:18 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:18 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:53:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.159:6832/351988265,v1:172.21.15.159:6833/351988265] up:active 2024-03-28T05:53:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-03-28T05:53:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-03-28T05:53:19.064 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:18 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:53:19.064 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:18 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.635s CPU time. 2024-03-28T05:53:19.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 270 sec latency 377294.319 ms 2024-03-28T05:53:19.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:19 smithi086 ceph-mon[35163]: pgmap v704: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:19.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:19 smithi159 ceph-mon[36109]: pgmap v704: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:19.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:19 smithi055 ceph-mon[31863]: pgmap v704: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:20.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 271 sec latency 378294.458 ms 2024-03-28T05:53:21.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 272 sec latency 379294.589 ms 2024-03-28T05:53:21.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:21 smithi086 ceph-mon[35163]: pgmap v705: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:21.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:21 smithi159 ceph-mon[36109]: pgmap v705: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:21.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:21 smithi055 ceph-mon[31863]: pgmap v705: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:22.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 273 sec latency 380294.724 ms 2024-03-28T05:53:23.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 274 sec latency 381294.880 ms 2024-03-28T05:53:23.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:23 smithi086 ceph-mon[35163]: pgmap v706: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:23.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:23 smithi159 ceph-mon[36109]: pgmap v706: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:23.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:23 smithi055 ceph-mon[31863]: pgmap v706: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:24.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 275 sec latency 382295.024 ms 2024-03-28T05:53:25.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 276 sec latency 383295.161 ms 2024-03-28T05:53:25.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:25 smithi086 ceph-mon[35163]: pgmap v707: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:25.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:25 smithi159 ceph-mon[36109]: pgmap v707: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:25 smithi055 ceph-mon[31863]: pgmap v707: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:26.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 277 sec latency 384295.298 ms 2024-03-28T05:53:27.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 278 sec latency 385295.398 ms 2024-03-28T05:53:27.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:27 smithi086 ceph-mon[35163]: pgmap v708: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:27.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:27 smithi159 ceph-mon[36109]: pgmap v708: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:27.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:27 smithi055 ceph-mon[31863]: pgmap v708: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:28.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 279 sec latency 386295.515 ms 2024-03-28T05:53:29.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 280 sec latency 387295.679 ms 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Scheduled restart job, restart counter is at 6. 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: Stopped Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Consumed 1.635s CPU time. 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Start request repeated too quickly. 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.l.service: Failed with result 'exit-code'. 2024-03-28T05:53:29.312 INFO:journalctl@ceph.mds.l.smithi159.stdout:Mar 28 05:53:28 smithi159 systemd[1]: Failed to start Ceph mds.l for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:29.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:29 smithi086 ceph-mon[35163]: pgmap v709: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:29.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:29 smithi159 ceph-mon[36109]: pgmap v709: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:29.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:29 smithi055 ceph-mon[31863]: pgmap v709: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:30.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 281 sec latency 388295.825 ms 2024-03-28T05:53:31.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 282 sec latency 389295.984 ms 2024-03-28T05:53:31.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:31 smithi055 ceph-mon[31863]: pgmap v710: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:53:31.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:31 smithi086 ceph-mon[35163]: pgmap v710: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:53:31.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:31 smithi159 ceph-mon[36109]: pgmap v710: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:53:32.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 283 sec latency 390296.086 ms 2024-03-28T05:53:33.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 284 sec latency 391296.185 ms 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: pgmap v711: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: Replacing daemon mds.l as rank 1 with standby daemon mds.a 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: osdmap e115: 12 total, 12 up, 12 in 2024-03-28T05:53:33.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:33 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: pgmap v711: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: Replacing daemon mds.l as rank 1 with standby daemon mds.a 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: osdmap e115: 12 total, 12 up, 12 in 2024-03-28T05:53:33.618 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:33 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:33.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: pgmap v711: 97 pgs: 97 active+clean; 22 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-03-28T05:53:33.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: Replacing daemon mds.l as rank 1 with standby daemon mds.a 2024-03-28T05:53:33.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-03-28T05:53:33.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:33.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: osdmap e115: 12 total, 12 up, 12 in 2024-03-28T05:53:33.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:33 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:34.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 285 sec latency 392296.347 ms 2024-03-28T05:53:35.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 286 sec latency 393296.489 ms 2024-03-28T05:53:35.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:35 smithi055 ceph-mon[31863]: pgmap v713: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:53:35.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:35 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:resolve 2024-03-28T05:53:35.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:35 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:35.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:35 smithi086 ceph-mon[35163]: pgmap v713: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:53:35.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:35 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:resolve 2024-03-28T05:53:35.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:35 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:35 smithi159 ceph-mon[36109]: pgmap v713: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:53:35.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:35 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:resolve 2024-03-28T05:53:35.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:35 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:36.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 287 sec latency 394296.614 ms 2024-03-28T05:53:36.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:36 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:36.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:36 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:reconnect 2024-03-28T05:53:36.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:36 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:36.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:36 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:36.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:36 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:reconnect 2024-03-28T05:53:36.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:36 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:36.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:36 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:36.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:36 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:reconnect 2024-03-28T05:53:36.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:36 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:37.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 288 sec latency 395296.771 ms 2024-03-28T05:53:37.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-mon[35163]: pgmap v714: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:37.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:rejoin 2024-03-28T05:53:37.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:37.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-mon[35163]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:53:37.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:53:37.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:37 smithi159 ceph-mon[36109]: pgmap v714: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:37.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:37 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:rejoin 2024-03-28T05:53:37.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:37 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:37.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:37 smithi159 ceph-mon[36109]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:53:37.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:53:37.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-mon[31863]: pgmap v714: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:53:37.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:rejoin 2024-03-28T05:53:37.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:37.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-mon[31863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:53:37.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f99cb000700 time 2024-03-28T05:53:37.421436+0000 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f99d69614a1] 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: clone() 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.422+0000 7f99cb000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f99cb000700 time 2024-03-28T05:53:37.421436+0000 2024-03-28T05:53:37.869 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f99d69614a1] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: clone() 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: *** Caught signal (Aborted) ** 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: in thread 7f99cb000700 thread_name:ms_dispatch 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f99d56e8d20] 2024-03-28T05:53:37.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: gsignal() 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: abort() 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f99d69614fb] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 19: clone() 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.426+0000 7f99cb000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: in thread 7f99cb000700 thread_name:ms_dispatch 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f99d56e8d20] 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: gsignal() 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: abort() 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f99d69614fb] 2024-03-28T05:53:37.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 19: clone() 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: -1> 2024-03-28T05:53:37.422+0000 7f99cb000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f99cb000700 time 2024-03-28T05:53:37.421436+0000 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f99d69614a1] 2024-03-28T05:53:37.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: clone() 2024-03-28T05:53:37.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 0> 2024-03-28T05:53:37.426+0000 7f99cb000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: in thread 7f99cb000700 thread_name:ms_dispatch 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f99d56e8d20] 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: gsignal() 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: abort() 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f99d69614fb] 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 19: clone() 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: -4> 2024-03-28T05:53:37.422+0000 7f99cb000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f99cb000700 time 2024-03-28T05:53:37.421436+0000 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f99d69614a1] 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: clone() 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: -3> 2024-03-28T05:53:37.426+0000 7f99cb000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: in thread 7f99cb000700 thread_name:ms_dispatch 2024-03-28T05:53:37.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f99d56e8d20] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2: gsignal() 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 3: abort() 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f99d69614fb] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f99d6961667] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55a239cc9223] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55a239b435d6] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55a239b43da1] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55a239b7809c] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55a239b96233] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a239b98197] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a239a9711b] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a239a976bc] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55a239a811ff] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f99d6bf3488] 2024-03-28T05:53:37.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 16: (DispatchQueue::entry()+0x51f) [0x7f99d6bf060f] 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f99d6cc3e81] 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f99d56de1ca] 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 19: clone() 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[71953]: 2024-03-28T05:53:37.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:37 smithi055 podman[86019]: 2024-03-28 05:53:37.548301918 +0000 UTC m=+0.036647163 container died 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-28T05:53:38.061 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:53:37 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:53:37.684+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:53:38.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 289 sec latency 396296.962 ms 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:38 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:38 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:38 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:active 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:38 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:38 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:38 smithi055 podman[86019]: 2024-03-28 05:53:38.306084326 +0000 UTC m=+0.794429608 container remove 3d1ce2c9b3d9389202f346780e7c1ab6d0e55e1e5e03bea839f1b2bd3d8aaefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:53:38.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:38 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:53:38.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:38 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:38.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:38 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:53:38.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:38 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:active 2024-03-28T05:53:38.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:38 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:38.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:38 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:38.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:38 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:38.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:38 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:53:38.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:38 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/3684039614,v1:172.21.15.55:6841/3684039614] up:active 2024-03-28T05:53:38.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:38 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:38.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:38 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:39.116 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:38 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:53:39.116 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:38 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.915s CPU time. 2024-03-28T05:53:39.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 290 sec latency 397297.087 ms 2024-03-28T05:53:39.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:39 smithi086 ceph-mon[35163]: pgmap v715: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:39.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:53:39.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:53:39.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:53:39.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:39 smithi159 ceph-mon[36109]: pgmap v715: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:39.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:53:39.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:53:39.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:53:39.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:39 smithi055 ceph-mon[31863]: pgmap v715: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:53:39.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:53:39.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:53:39.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:53:40.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 291 sec latency 398297.237 ms 2024-03-28T05:53:41.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 292 sec latency 399297.366 ms 2024-03-28T05:53:41.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:41 smithi086 ceph-mon[35163]: pgmap v716: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:41.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:41 smithi159 ceph-mon[36109]: pgmap v716: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:41.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:41 smithi055 ceph-mon[31863]: pgmap v716: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:53:42.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 293 sec latency 400297.532 ms 2024-03-28T05:53:43.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 294 sec latency 401297.627 ms 2024-03-28T05:53:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:43 smithi086 ceph-mon[35163]: pgmap v717: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:43.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:43 smithi159 ceph-mon[36109]: pgmap v717: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:43.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:43 smithi055 ceph-mon[31863]: pgmap v717: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:53:44.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 295 sec latency 402297.735 ms 2024-03-28T05:53:45.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 296 sec latency 403297.880 ms 2024-03-28T05:53:45.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:45 smithi086 ceph-mon[35163]: pgmap v718: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:45.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:45 smithi159 ceph-mon[36109]: pgmap v718: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:45.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:45 smithi055 ceph-mon[31863]: pgmap v718: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:53:46.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 297 sec latency 404298.028 ms 2024-03-28T05:53:47.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 298 sec latency 405298.123 ms 2024-03-28T05:53:47.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:47 smithi086 ceph-mon[35163]: pgmap v719: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:47.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:47 smithi159 ceph-mon[36109]: pgmap v719: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:47.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:47 smithi055 ceph-mon[31863]: pgmap v719: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:48.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 299 sec latency 406298.211 ms 2024-03-28T05:53:49.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 300 sec latency 407298.292 ms 2024-03-28T05:53:49.267 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:48 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:53:49.267 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:48 smithi055 systemd[1]: Stopped Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:49.267 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:48 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.915s CPU time. 2024-03-28T05:53:49.268 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:48 smithi055 systemd[1]: Starting Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:53:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:49 smithi055 ceph-mon[31863]: pgmap v720: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:49.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 podman[86192]: 2024-03-28 05:53:49.180422754 +0000 UTC m=+0.036982115 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:53:49.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 podman[86192]: 2024-03-28 05:53:49.500284507 +0000 UTC m=+0.356843888 container create 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:53:49.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:49 smithi086 ceph-mon[35163]: pgmap v720: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:49.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:49 smithi159 ceph-mon[36109]: pgmap v720: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 podman[86192]: 2024-03-28 05:53:49.770605529 +0000 UTC m=+0.627164917 container init 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 podman[86192]: 2024-03-28 05:53:49.782272855 +0000 UTC m=+0.638832205 container start 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 ceph-mds[86211]: -- 172.21.15.55:0/3541444619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5603cd8504e0 con 0x5603cd827000 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 ceph-mds[86211]: -- 172.21.15.55:0/3541444619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5603cd853a40 con 0x5603cd827000 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: starting mds.a at 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 bash[86192]: 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb 2024-03-28T05:53:50.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:53:49 smithi055 systemd[1]: Started Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:53:50.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 301 sec latency 408298.373 ms 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: daemon mds.a restarted 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: osdmap e116: 12 total, 12 up, 12 in 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:boot 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:53:50.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:50 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:50.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: daemon mds.a restarted 2024-03-28T05:53:50.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: osdmap e116: 12 total, 12 up, 12 in 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:boot 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:53:50.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:50 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: daemon mds.a restarted 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: osdmap e116: 12 total, 12 up, 12 in 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:boot 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:53:50.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:50 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:51.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 302 sec latency 409298.471 ms 2024-03-28T05:53:52.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:51 smithi055 ceph-mon[31863]: pgmap v722: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9 op/s 2024-03-28T05:53:52.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:51 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:resolve 2024-03-28T05:53:52.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:51 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:52.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 303 sec latency 410298.581 ms 2024-03-28T05:53:52.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:51 smithi086 ceph-mon[35163]: pgmap v722: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9 op/s 2024-03-28T05:53:52.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:51 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:resolve 2024-03-28T05:53:52.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:51 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:52.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:51 smithi159 ceph-mon[36109]: pgmap v722: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9 op/s 2024-03-28T05:53:52.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:51 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:resolve 2024-03-28T05:53:52.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:51 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:53.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 304 sec latency 411298.701 ms 2024-03-28T05:53:53.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:53 smithi086 ceph-mon[35163]: pgmap v723: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:53:53.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:53 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:53.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:53 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:reconnect 2024-03-28T05:53:53.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:53 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:53 smithi159 ceph-mon[36109]: pgmap v723: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:53:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:53 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:53 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:reconnect 2024-03-28T05:53:53.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:53 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:53.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:53 smithi055 ceph-mon[31863]: pgmap v723: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:53:53.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:53 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:53:53.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:53 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:reconnect 2024-03-28T05:53:53.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:53 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:54.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 305 sec latency 412298.857 ms 2024-03-28T05:53:54.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:54 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:rejoin 2024-03-28T05:53:54.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:54 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:54.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:54 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:53:54.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:54 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:rejoin 2024-03-28T05:53:54.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:54 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:54.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:54 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:53:54.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:rejoin 2024-03-28T05:53:54.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:54.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f2606800700 time 2024-03-28T05:53:54.524718+0000 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f261201e4a1] 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: clone() 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: *** Caught signal (Aborted) ** 2024-03-28T05:53:54.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: in thread 7f2606800700 thread_name:ms_dispatch 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.525+0000 7f2606800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f2606800700 time 2024-03-28T05:53:54.524718+0000 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f261201e4a1] 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: clone() 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2610da5d20] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: gsignal() 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: abort() 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f261201e4fb] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 19: clone() 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.528+0000 7f2606800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: in thread 7f2606800700 thread_name:ms_dispatch 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2610da5d20] 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: gsignal() 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: abort() 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f261201e4fb] 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 19: clone() 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: -1> 2024-03-28T05:53:54.525+0000 7f2606800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f2606800700 time 2024-03-28T05:53:54.524718+0000 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f261201e4a1] 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: clone() 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 0> 2024-03-28T05:53:54.528+0000 7f2606800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:54.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: in thread 7f2606800700 thread_name:ms_dispatch 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2610da5d20] 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: gsignal() 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: abort() 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f261201e4fb] 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 19: clone() 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: -1> 2024-03-28T05:53:54.525+0000 7f2606800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f2606800700 time 2024-03-28T05:53:54.524718+0000 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f261201e4a1] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: clone() 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 0> 2024-03-28T05:53:54.528+0000 7f2606800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: in thread 7f2606800700 thread_name:ms_dispatch 2024-03-28T05:53:54.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2610da5d20] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2: gsignal() 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 3: abort() 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f261201e4fb] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f261201e667] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5643bf828223] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5643bf6a25d6] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5643bf6a2da1] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5643bf6d709c] 2024-03-28T05:53:54.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5643bf6f5233] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5643bf6f7197] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5643bf5f611b] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5643bf5f66bc] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5643bf5e01ff] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f26122b0488] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 16: (DispatchQueue::entry()+0x51f) [0x7f26122ad60f] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2612380e81] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f2610d9b1ca] 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 19: clone() 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[71556]: 2024-03-28T05:53:54.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:54 smithi055 podman[86247]: 2024-03-28 05:53:54.642539219 +0000 UTC m=+0.035431254 container died 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, ceph=True, GIT_BRANCH=HEAD) 2024-03-28T05:53:55.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 306 sec latency 413299.000 ms 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: pgmap v724: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:active 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:55 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:55 smithi055 podman[86247]: 2024-03-28 05:53:55.365529133 +0000 UTC m=+0.758421225 container remove 7fcfb84c1714da547498a7f8ccfa159369caeb277f28afb6562c85ac35c01847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=) 2024-03-28T05:53:55.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:55 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: pgmap v724: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:active 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:55.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:55 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:55.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: pgmap v724: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:53:55.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:53:55.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:53:55.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/849759534,v1:172.21.15.55:6839/849759534] up:active 2024-03-28T05:53:55.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:53:55.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:55 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:53:56.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 307 sec latency 414299.126 ms 2024-03-28T05:53:56.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:55 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:53:56.367 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:53:55 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.966s CPU time. 2024-03-28T05:53:57.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 308 sec latency 415299.291 ms 2024-03-28T05:53:57.761 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:57 smithi055 ceph-mon[31863]: pgmap v725: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:53:57.811 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:53:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:53:57.687+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:53:57.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:57 smithi086 ceph-mon[35163]: pgmap v725: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:53:57.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:57 smithi159 ceph-mon[36109]: pgmap v725: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:53:58.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 309 sec latency 416299.430 ms 2024-03-28T05:53:59.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 310 sec latency 417299.588 ms 2024-03-28T05:53:59.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:53:59 smithi086 ceph-mon[35163]: pgmap v726: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:53:59.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:53:59 smithi159 ceph-mon[36109]: pgmap v726: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:53:59.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:53:59 smithi055 ceph-mon[31863]: pgmap v726: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:54:00.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 311 sec latency 418299.729 ms 2024-03-28T05:54:01.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 312 sec latency 419299.871 ms 2024-03-28T05:54:01.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:01 smithi086 ceph-mon[35163]: pgmap v727: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:01.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:01 smithi159 ceph-mon[36109]: pgmap v727: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:01.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:01 smithi055 ceph-mon[31863]: pgmap v727: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:02.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 313 sec latency 420299.968 ms 2024-03-28T05:54:03.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 314 sec latency 421300.119 ms 2024-03-28T05:54:03.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:03 smithi086 ceph-mon[35163]: pgmap v728: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:03.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:03 smithi159 ceph-mon[36109]: pgmap v728: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:03.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:03 smithi055 ceph-mon[31863]: pgmap v728: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:04.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 315 sec latency 422300.277 ms 2024-03-28T05:54:05.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 316 sec latency 423300.371 ms 2024-03-28T05:54:05.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:05 smithi086 ceph-mon[35163]: pgmap v729: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:05.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:05 smithi159 ceph-mon[36109]: pgmap v729: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:05.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:05 smithi055 ceph-mon[31863]: pgmap v729: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:06.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 317 sec latency 424300.474 ms 2024-03-28T05:54:06.526 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:54:06.526 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:06.526 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.966s CPU time. 2024-03-28T05:54:06.526 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:54:06.830 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 podman[86341]: 2024-03-28 05:54:06.438134491 +0000 UTC m=+0.037539054 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:54:06.830 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 podman[86341]: 2024-03-28 05:54:06.583330817 +0000 UTC m=+0.182735405 container create c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-03-28T05:54:06.830 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 podman[86341]: 2024-03-28 05:54:06.836309873 +0000 UTC m=+0.435714531 container init c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-03-28T05:54:07.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 podman[86341]: 2024-03-28 05:54:06.847654148 +0000 UTC m=+0.447058726 container start c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-03-28T05:54:07.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 ceph-mds[86360]: -- 172.21.15.55:0/139202109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5598a7a3da40 con 0x5598a7a11000 2024-03-28T05:54:07.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:06 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: starting mds.g at 2024-03-28T05:54:07.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:07 smithi055 bash[86341]: c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 2024-03-28T05:54:07.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:07 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:07.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 318 sec latency 425300.612 ms 2024-03-28T05:54:07.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: pgmap v730: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: daemon mds.g restarted 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: osdmap e117: 12 total, 12 up, 12 in 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:boot 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:07.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:07 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:07.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: pgmap v730: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:07.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: daemon mds.g restarted 2024-03-28T05:54:07.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: osdmap e117: 12 total, 12 up, 12 in 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:boot 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:07.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:07 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: pgmap v730: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: daemon mds.g restarted 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: osdmap e117: 12 total, 12 up, 12 in 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:boot 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:07.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:07 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:08.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 319 sec latency 426300.736 ms 2024-03-28T05:54:09.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 320 sec latency 427300.878 ms 2024-03-28T05:54:09.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:09 smithi086 ceph-mon[35163]: pgmap v732: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:54:09.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:09 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:resolve 2024-03-28T05:54:09.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:09 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:09.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:09 smithi159 ceph-mon[36109]: pgmap v732: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:54:09.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:09 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:resolve 2024-03-28T05:54:09.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:09 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:09 smithi055 ceph-mon[31863]: pgmap v732: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:54:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:09 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:resolve 2024-03-28T05:54:09.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:09 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 321 sec latency 428301.031 ms 2024-03-28T05:54:10.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:10 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:10.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:10 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:reconnect 2024-03-28T05:54:10.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:10 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:10 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:rejoin 2024-03-28T05:54:10.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:10 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:10 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:10.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:10 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:reconnect 2024-03-28T05:54:10.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:10 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:10 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:rejoin 2024-03-28T05:54:10.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:10 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:10 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:10.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:10 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:reconnect 2024-03-28T05:54:10.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:10 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:10.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:10 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:rejoin 2024-03-28T05:54:10.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:10 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:11.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 322 sec latency 429301.175 ms 2024-03-28T05:54:11.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:11 smithi159 ceph-mon[36109]: pgmap v733: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:54:11.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:11 smithi159 ceph-mon[36109]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:11.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-mon[31863]: pgmap v733: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:54:11.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-mon[31863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:11.867 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fc7fb600700 time 2024-03-28T05:54:11.626748+0000 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc806efb4a1] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.868 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.870 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.871 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: clone() 2024-03-28T05:54:11.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.629+0000 7fc7fb600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fc7fb600700 time 2024-03-28T05:54:11.626748+0000 2024-03-28T05:54:11.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:11.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.872 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc806efb4a1] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.873 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: clone() 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: *** Caught signal (Aborted) ** 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: in thread 7fc7fb600700 thread_name:ms_dispatch 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc805c82d20] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: gsignal() 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: abort() 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc806efb4fb] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.874 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 19: clone() 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.633+0000 7fc7fb600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: in thread 7fc7fb600700 thread_name:ms_dispatch 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.875 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc805c82d20] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: gsignal() 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: abort() 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc806efb4fb] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.876 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 19: clone() 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: -1> 2024-03-28T05:54:11.629+0000 7fc7fb600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fc7fb600700 time 2024-03-28T05:54:11.626748+0000 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc806efb4a1] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.877 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: clone() 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 0> 2024-03-28T05:54:11.633+0000 7fc7fb600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: in thread 7fc7fb600700 thread_name:ms_dispatch 2024-03-28T05:54:11.878 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc805c82d20] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: gsignal() 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: abort() 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc806efb4fb] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.879 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 19: clone() 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: -1> 2024-03-28T05:54:11.629+0000 7fc7fb600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fc7fb600700 time 2024-03-28T05:54:11.626748+0000 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc806efb4a1] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.880 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: clone() 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.881 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 0> 2024-03-28T05:54:11.633+0000 7fc7fb600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: in thread 7fc7fb600700 thread_name:ms_dispatch 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc805c82d20] 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2: gsignal() 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 3: abort() 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc806efb4fb] 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fc806efb667] 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5603caf81223] 2024-03-28T05:54:11.882 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5603cadfb5d6] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5603cadfbda1] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5603cae3009c] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5603cae4e233] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5603cae50197] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5603cad4f11b] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5603cad4f6bc] 2024-03-28T05:54:11.883 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5603cad391ff] 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fc80718d488] 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 16: (DispatchQueue::entry()+0x51f) [0x7fc80718a60f] 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc80725de81] 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc805c781ca] 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 19: clone() 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86207]: 2024-03-28T05:54:11.884 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:11 smithi055 podman[86396]: 2024-03-28 05:54:11.73563392 +0000 UTC m=+0.035744227 container died 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD) 2024-03-28T05:54:12.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:11 smithi086 ceph-mon[35163]: pgmap v733: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:54:12.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:11 smithi086 ceph-mon[35163]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:12.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 323 sec latency 430301.334 ms 2024-03-28T05:54:12.866 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:12 smithi055 podman[86396]: 2024-03-28 05:54:12.482058898 +0000 UTC m=+0.782169244 container remove 57bd4cb08632856966af6da1445bbae8912f9ea9913f096c46dcc1f7ed09d1fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:12 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:12 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:12 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:active 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:12 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:12.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:12 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:13.061 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:54:12.687+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:54:13.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:13.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:54:13.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:active 2024-03-28T05:54:13.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:13.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:12 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:13.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:12 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:13.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:12 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:54:13.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/2380583821,v1:172.21.15.55:6841/2380583821] up:active 2024-03-28T05:54:13.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:12 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:13.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:12 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:13.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 324 sec latency 431301.457 ms 2024-03-28T05:54:13.366 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:12 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:54:13.366 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.625s CPU time. 2024-03-28T05:54:13.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:13 smithi055 ceph-mon[31863]: pgmap v734: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:54:13.963 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:13 smithi086 ceph-mon[35163]: pgmap v734: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:54:14.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:13 smithi159 ceph-mon[36109]: pgmap v734: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:54:14.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 325 sec latency 432301.606 ms 2024-03-28T05:54:15.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 326 sec latency 433301.738 ms 2024-03-28T05:54:15.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:15 smithi055 ceph-mon[31863]: pgmap v735: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:54:16.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:15 smithi086 ceph-mon[35163]: pgmap v735: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:54:16.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:15 smithi159 ceph-mon[36109]: pgmap v735: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:54:16.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 327 sec latency 434301.874 ms 2024-03-28T05:54:17.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 328 sec latency 435302.015 ms 2024-03-28T05:54:17.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:17 smithi055 ceph-mon[31863]: pgmap v736: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:18.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:17 smithi086 ceph-mon[35163]: pgmap v736: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:18.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:17 smithi159 ceph-mon[36109]: pgmap v736: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:18.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 329 sec latency 436302.165 ms 2024-03-28T05:54:19.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 330 sec latency 437302.320 ms 2024-03-28T05:54:20.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:19 smithi086 ceph-mon[35163]: pgmap v737: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:54:20.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:19 smithi159 ceph-mon[36109]: pgmap v737: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:54:20.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:19 smithi055 ceph-mon[31863]: pgmap v737: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:54:20.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 331 sec latency 438302.451 ms 2024-03-28T05:54:21.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 332 sec latency 439302.540 ms 2024-03-28T05:54:22.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:21 smithi086 ceph-mon[35163]: pgmap v738: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:54:22.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:21 smithi159 ceph-mon[36109]: pgmap v738: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:54:22.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:21 smithi055 ceph-mon[31863]: pgmap v738: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:54:22.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 333 sec latency 440302.703 ms 2024-03-28T05:54:23.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 334 sec latency 441302.840 ms 2024-03-28T05:54:23.523 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:54:23.523 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 systemd[1]: Stopped Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:23.523 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.625s CPU time. 2024-03-28T05:54:23.524 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 systemd[1]: Starting Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:54:23.837 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:23 smithi055 ceph-mon[31863]: pgmap v739: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:23.837 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 podman[86486]: 2024-03-28 05:54:23.436132834 +0000 UTC m=+0.038340882 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:54:23.837 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 podman[86486]: 2024-03-28 05:54:23.541128899 +0000 UTC m=+0.143336936 container create 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-28T05:54:24.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:23 smithi086 ceph-mon[35163]: pgmap v739: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:24.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:23 smithi159 ceph-mon[36109]: pgmap v739: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:24.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 335 sec latency 442302.997 ms 2024-03-28T05:54:24.366 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 podman[86486]: 2024-03-28 05:54:23.928332374 +0000 UTC m=+0.530540456 container init 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-03-28T05:54:24.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 podman[86486]: 2024-03-28 05:54:23.938676038 +0000 UTC m=+0.540884144 container start 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-28T05:54:24.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 ceph-mds[86504]: -- 172.21.15.55:0/1459455313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56357150fa40 con 0x5635714e2800 2024-03-28T05:54:24.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: starting mds.a at 2024-03-28T05:54:24.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:24 smithi055 bash[86486]: 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 2024-03-28T05:54:24.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:24 smithi055 systemd[1]: Started Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: daemon mds.a restarted 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: osdmap e118: 12 total, 12 up, 12 in 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:boot 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:25.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:24 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:25.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: daemon mds.a restarted 2024-03-28T05:54:25.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:25.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: osdmap e118: 12 total, 12 up, 12 in 2024-03-28T05:54:25.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:boot 2024-03-28T05:54:25.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:25.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:24 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:25.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: daemon mds.a restarted 2024-03-28T05:54:25.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: osdmap e118: 12 total, 12 up, 12 in 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:boot 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:25.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:24 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:25.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 336 sec latency 443303.126 ms 2024-03-28T05:54:26.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:25 smithi086 ceph-mon[35163]: pgmap v741: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:54:26.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:25 smithi159 ceph-mon[36109]: pgmap v741: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:54:26.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:25 smithi055 ceph-mon[31863]: pgmap v741: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 8 op/s 2024-03-28T05:54:26.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 337 sec latency 444303.266 ms 2024-03-28T05:54:27.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:26 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:resolve 2024-03-28T05:54:27.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:26 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:27.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:26 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:resolve 2024-03-28T05:54:27.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:26 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:27.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:26 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:resolve 2024-03-28T05:54:27.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:26 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:27.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 338 sec latency 445303.421 ms 2024-03-28T05:54:28.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:27 smithi086 ceph-mon[35163]: pgmap v742: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:54:28.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:27 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:28.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:27 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:reconnect 2024-03-28T05:54:28.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:27 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:28.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:27 smithi159 ceph-mon[36109]: pgmap v742: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:54:28.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:27 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:28.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:27 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:reconnect 2024-03-28T05:54:28.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:27 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:28.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:27 smithi055 ceph-mon[31863]: pgmap v742: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:54:28.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:27 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:28.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:27 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:reconnect 2024-03-28T05:54:28.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:27 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:28.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 339 sec latency 446303.551 ms 2024-03-28T05:54:28.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd69c400700 time 2024-03-28T05:54:28.225817+0000 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6a7d1f4a1] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: clone() 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: *** Caught signal (Aborted) ** 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: in thread 7fd69c400700 thread_name:ms_dispatch 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.226+0000 7fd69c400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd69c400700 time 2024-03-28T05:54:28.225817+0000 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:28.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6a7d1f4a1] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: clone() 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6a6aa6d20] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: gsignal() 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: abort() 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd6a7d1f4fb] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 19: clone() 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.228+0000 7fd69c400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: in thread 7fd69c400700 thread_name:ms_dispatch 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6a6aa6d20] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: gsignal() 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: abort() 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd6a7d1f4fb] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 19: clone() 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: -1> 2024-03-28T05:54:28.226+0000 7fd69c400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd69c400700 time 2024-03-28T05:54:28.225817+0000 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6a7d1f4a1] 2024-03-28T05:54:28.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: clone() 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 0> 2024-03-28T05:54:28.228+0000 7fd69c400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: in thread 7fd69c400700 thread_name:ms_dispatch 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6a6aa6d20] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: gsignal() 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: abort() 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd6a7d1f4fb] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 19: clone() 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: -1> 2024-03-28T05:54:28.226+0000 7fd69c400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fd69c400700 time 2024-03-28T05:54:28.225817+0000 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6a7d1f4a1] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: clone() 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 0> 2024-03-28T05:54:28.228+0000 7fd69c400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: in thread 7fd69c400700 thread_name:ms_dispatch 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:28.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6a6aa6d20] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2: gsignal() 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 3: abort() 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd6a7d1f4fb] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fd6a7d1f667] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5598a6c53223] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5598a6acd5d6] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5598a6acdda1] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5598a6b0209c] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5598a6b20233] 2024-03-28T05:54:28.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5598a6b22197] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5598a6a2111b] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5598a6a216bc] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5598a6a0b1ff] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fd6a7fb1488] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 16: (DispatchQueue::entry()+0x51f) [0x7fd6a7fae60f] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6a8081e81] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fd6a6a9c1ca] 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 19: clone() 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86356]: 2024-03-28T05:54:28.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:28 smithi055 podman[86540]: 2024-03-28 05:54:28.318165232 +0000 UTC m=+0.034654137 container died c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-03-28T05:54:29.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:rejoin 2024-03-28T05:54:29.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:29.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:54:29.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:29.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:54:29.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:active 2024-03-28T05:54:29.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:28 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:rejoin 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:active 2024-03-28T05:54:29.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:28 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:rejoin 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/4269934474,v1:172.21.15.55:6839/4269934474] up:active 2024-03-28T05:54:29.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:28 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:29.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 340 sec latency 447303.695 ms 2024-03-28T05:54:29.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:29 smithi055 podman[86540]: 2024-03-28 05:54:29.13961945 +0000 UTC m=+0.856108413 container remove c1634abea2d1eb44b7b4d291c7ac3a51720e74bcea4f46f55b437c8a3dd46fa1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-28T05:54:29.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:29 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:54:30.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:29 smithi086 ceph-mon[35163]: pgmap v743: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:54:30.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:29 smithi159 ceph-mon[36109]: pgmap v743: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:54:30.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:29 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:54:30.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:29 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.573s CPU time. 2024-03-28T05:54:30.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:29 smithi055 ceph-mon[31863]: pgmap v743: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:54:30.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 341 sec latency 448303.826 ms 2024-03-28T05:54:31.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 342 sec latency 449303.982 ms 2024-03-28T05:54:32.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:31 smithi086 ceph-mon[35163]: pgmap v744: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 8 op/s 2024-03-28T05:54:32.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:31 smithi159 ceph-mon[36109]: pgmap v744: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 8 op/s 2024-03-28T05:54:32.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:31 smithi055 ceph-mon[31863]: pgmap v744: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 8 op/s 2024-03-28T05:54:32.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 343 sec latency 450304.078 ms 2024-03-28T05:54:33.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 344 sec latency 451304.235 ms 2024-03-28T05:54:34.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:33 smithi086 ceph-mon[35163]: pgmap v745: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:54:34.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:33 smithi159 ceph-mon[36109]: pgmap v745: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:54:34.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:33 smithi055 ceph-mon[31863]: pgmap v745: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:54:34.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 345 sec latency 452304.391 ms 2024-03-28T05:54:35.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 346 sec latency 453304.538 ms 2024-03-28T05:54:36.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:35 smithi086 ceph-mon[35163]: pgmap v746: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:36.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:35 smithi159 ceph-mon[36109]: pgmap v746: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:36.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:35 smithi055 ceph-mon[31863]: pgmap v746: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:36.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 347 sec latency 454304.688 ms 2024-03-28T05:54:37.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 348 sec latency 455304.833 ms 2024-03-28T05:54:38.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:37 smithi086 ceph-mon[35163]: pgmap v747: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:38.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:37 smithi159 ceph-mon[36109]: pgmap v747: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:38.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:37 smithi055 ceph-mon[31863]: pgmap v747: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:38.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 349 sec latency 456304.968 ms 2024-03-28T05:54:39.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 350 sec latency 457305.120 ms 2024-03-28T05:54:40.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:39 smithi086 ceph-mon[35163]: pgmap v748: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:40.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:54:40.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:39 smithi159 ceph-mon[36109]: pgmap v748: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:40.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:39 smithi055 ceph-mon[31863]: pgmap v748: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:39 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:39 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:39 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.573s CPU time. 2024-03-28T05:54:40.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:39 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:54:40.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 351 sec latency 458305.188 ms 2024-03-28T05:54:40.571 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 podman[86698]: 2024-03-28 05:54:40.18633513 +0000 UTC m=+0.034850396 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:54:40.571 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 podman[86698]: 2024-03-28 05:54:40.30768138 +0000 UTC m=+0.156196641 container create 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 podman[86698]: 2024-03-28 05:54:40.578261175 +0000 UTC m=+0.426776468 container init 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 podman[86698]: 2024-03-28 05:54:40.588537267 +0000 UTC m=+0.437052543 container start 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 ceph-mds[86737]: -- 172.21.15.55:0/2800680398 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5563ddcc5a40 con 0x5563ddc98800 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: starting mds.g at 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 bash[86698]: 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 2024-03-28T05:54:40.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:54:40 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:41.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 352 sec latency 459305.290 ms 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: pgmap v749: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: daemon mds.g restarted 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: osdmap e119: 12 total, 12 up, 12 in 2024-03-28T05:54:41.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:boot 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:41 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: pgmap v749: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: daemon mds.g restarted 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: osdmap e119: 12 total, 12 up, 12 in 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:boot 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:41.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:41 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: pgmap v749: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: daemon mds.g restarted 2024-03-28T05:54:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: osdmap e119: 12 total, 12 up, 12 in 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:boot 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:54:41.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:41 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:42.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 353 sec latency 460305.388 ms 2024-03-28T05:54:43.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:42 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:resolve 2024-03-28T05:54:43.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:42 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:43.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:54:43.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:54:43.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:43.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:42 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:resolve 2024-03-28T05:54:43.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:42 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:43.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:54:43.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:54:43.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:43.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:42 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:resolve 2024-03-28T05:54:43.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:42 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:43.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:54:43.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:54:43.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:54:43.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 354 sec latency 461305.475 ms 2024-03-28T05:54:44.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:43 smithi086 ceph-mon[35163]: pgmap v751: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:54:44.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:43 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:44.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:43 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:reconnect 2024-03-28T05:54:44.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:43 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:44.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:43 smithi159 ceph-mon[36109]: pgmap v751: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:54:44.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:43 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:44.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:43 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:reconnect 2024-03-28T05:54:44.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:43 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:44.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:43 smithi055 ceph-mon[31863]: pgmap v751: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:54:44.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:43 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:54:44.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:43 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:reconnect 2024-03-28T05:54:44.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:43 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:44.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 355 sec latency 462305.615 ms 2024-03-28T05:54:45.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:44 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:rejoin 2024-03-28T05:54:45.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:44 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:45.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:44 smithi086 ceph-mon[35163]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:45.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:44 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:rejoin 2024-03-28T05:54:45.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:44 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:45.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:44 smithi159 ceph-mon[36109]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:45.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:rejoin 2024-03-28T05:54:45.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:45.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-mon[31863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f433b400700 time 2024-03-28T05:54:44.836607+0000 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4346c774a1] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.118 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: clone() 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: *** Caught signal (Aborted) ** 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: in thread 7f433b400700 thread_name:ms_dispatch 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:44.837+0000 7f433b400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f433b400700 time 2024-03-28T05:54:44.836607+0000 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:45.119 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4346c774a1] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.120 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: clone() 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f43459fed20] 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: gsignal() 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: abort() 2024-03-28T05:54:45.121 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4346c774fb] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.122 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 19: clone() 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:44.840+0000 7f433b400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: in thread 7f433b400700 thread_name:ms_dispatch 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f43459fed20] 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: gsignal() 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: abort() 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4346c774fb] 2024-03-28T05:54:45.123 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.124 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 19: clone() 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: -1> 2024-03-28T05:54:44.837+0000 7f433b400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f433b400700 time 2024-03-28T05:54:44.836607+0000 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4346c774a1] 2024-03-28T05:54:45.125 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.126 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: clone() 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 0> 2024-03-28T05:54:44.840+0000 7f433b400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: in thread 7f433b400700 thread_name:ms_dispatch 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f43459fed20] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: gsignal() 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: abort() 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4346c774fb] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.127 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 19: clone() 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: -1> 2024-03-28T05:54:44.837+0000 7f433b400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f433b400700 time 2024-03-28T05:54:44.836607+0000 2024-03-28T05:54:45.128 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4346c774a1] 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.129 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: clone() 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 0> 2024-03-28T05:54:44.840+0000 7f433b400700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:54:45.130 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: in thread 7f433b400700 thread_name:ms_dispatch 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f43459fed20] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2: gsignal() 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 3: abort() 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4346c774fb] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4346c77667] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56356f47e223] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56356f2f85d6] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56356f2f8da1] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56356f32d09c] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56356f34b233] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56356f34d197] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56356f24c11b] 2024-03-28T05:54:45.131 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56356f24c6bc] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56356f2361ff] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4346f09488] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 16: (DispatchQueue::entry()+0x51f) [0x7f4346f0660f] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4346fd9e81] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f43459f41ca] 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 19: clone() 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[86500]: 2024-03-28T05:54:45.132 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:44 smithi055 podman[86904]: 2024-03-28 05:54:44.942193406 +0000 UTC m=+0.033060951 container died 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:54:45.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 356 sec latency 463305.762 ms 2024-03-28T05:54:46.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: pgmap v752: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:54:46.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:46.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:54:46.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:active 2024-03-28T05:54:46.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:46.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:45 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: pgmap v752: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:active 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:46.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:45 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: pgmap v752: 97 pgs: 97 active+clean; 22 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/923726251,v1:172.21.15.55:6841/923726251] up:active 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:46.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:45 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:54:46.117 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:45 smithi055 podman[86904]: 2024-03-28 05:54:45.644457156 +0000 UTC m=+0.735324756 container remove 1d04882d9fa5e260e401341e517bcda8a880b855ed1c309d98810f45f20231b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:54:46.117 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:45 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:54:46.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 357 sec latency 464305.931 ms 2024-03-28T05:54:46.597 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:46 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:54:46.597 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:46 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.661s CPU time. 2024-03-28T05:54:47.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 358 sec latency 465306.057 ms 2024-03-28T05:54:48.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:47 smithi086 ceph-mon[35163]: pgmap v753: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:54:48.062 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:54:47 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:54:47.690+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:54:48.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:47 smithi159 ceph-mon[36109]: pgmap v753: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:54:48.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:47 smithi055 ceph-mon[31863]: pgmap v753: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:54:48.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 359 sec latency 466306.189 ms 2024-03-28T05:54:49.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 360 sec latency 467306.288 ms 2024-03-28T05:54:50.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:49 smithi086 ceph-mon[35163]: pgmap v754: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:54:50.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:49 smithi159 ceph-mon[36109]: pgmap v754: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:54:50.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:49 smithi055 ceph-mon[31863]: pgmap v754: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:54:50.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 361 sec latency 468306.397 ms 2024-03-28T05:54:51.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 362 sec latency 469306.541 ms 2024-03-28T05:54:52.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:51 smithi055 ceph-mon[31863]: pgmap v755: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:52.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 363 sec latency 470306.677 ms 2024-03-28T05:54:52.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:51 smithi086 ceph-mon[35163]: pgmap v755: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:52.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:51 smithi159 ceph-mon[36109]: pgmap v755: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:54:53.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 364 sec latency 471306.844 ms 2024-03-28T05:54:54.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:53 smithi055 ceph-mon[31863]: pgmap v756: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:54.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 365 sec latency 472306.937 ms 2024-03-28T05:54:54.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:53 smithi086 ceph-mon[35163]: pgmap v756: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:54.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:53 smithi159 ceph-mon[36109]: pgmap v756: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:55.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 366 sec latency 473307.065 ms 2024-03-28T05:54:56.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:55 smithi055 ceph-mon[31863]: pgmap v757: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:56.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 367 sec latency 474307.193 ms 2024-03-28T05:54:56.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:55 smithi086 ceph-mon[35163]: pgmap v757: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:56.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:55 smithi159 ceph-mon[36109]: pgmap v757: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:54:56.766 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:54:56.766 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 systemd[1]: Stopped Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:56.766 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.661s CPU time. 2024-03-28T05:54:56.766 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 systemd[1]: Starting Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:54:57.048 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 podman[87008]: 2024-03-28 05:54:56.676289623 +0000 UTC m=+0.032788743 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:54:57.048 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:56 smithi055 podman[87008]: 2024-03-28 05:54:56.800521265 +0000 UTC m=+0.157020420 container create 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:54:57.048 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 podman[87008]: 2024-03-28 05:54:57.054503465 +0000 UTC m=+0.411002629 container init 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:54:57.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 368 sec latency 475307.306 ms 2024-03-28T05:54:57.317 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 podman[87008]: 2024-03-28 05:54:57.064373857 +0000 UTC m=+0.420872996 container start 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-28T05:54:57.317 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mds[87027]: -- 172.21.15.55:0/3437621009 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b7fc217a40 con 0x55b7fc1ea800 2024-03-28T05:54:57.317 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: starting mds.a at 2024-03-28T05:54:57.317 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 bash[87008]: 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 2024-03-28T05:54:57.317 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:54:57 smithi055 systemd[1]: Started Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:54:58.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: pgmap v758: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:58.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: daemon mds.a restarted 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: osdmap e120: 12 total, 12 up, 12 in 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:boot 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:58.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:57 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:58.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 369 sec latency 476307.426 ms 2024-03-28T05:54:58.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: pgmap v758: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:58.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: daemon mds.a restarted 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: osdmap e120: 12 total, 12 up, 12 in 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:boot 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:58.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:57 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: pgmap v758: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: daemon mds.a restarted 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: osdmap e120: 12 total, 12 up, 12 in 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:boot 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:54:58.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:54:58.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:57 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:54:59.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 370 sec latency 477307.551 ms 2024-03-28T05:55:00.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:59 smithi055 ceph-mon[31863]: pgmap v760: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8 op/s 2024-03-28T05:55:00.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:59 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:resolve 2024-03-28T05:55:00.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:54:59 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:00.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 371 sec latency 478307.674 ms 2024-03-28T05:55:00.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:59 smithi086 ceph-mon[35163]: pgmap v760: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8 op/s 2024-03-28T05:55:00.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:59 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:resolve 2024-03-28T05:55:00.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:54:59 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:00.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:59 smithi159 ceph-mon[36109]: pgmap v760: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8 op/s 2024-03-28T05:55:00.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:59 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:resolve 2024-03-28T05:55:00.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:54:59 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:01.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 372 sec latency 479307.846 ms 2024-03-28T05:55:01.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:00 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:55:01.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:00 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:reconnect 2024-03-28T05:55:01.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:00 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:01.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:00 smithi086 ceph-mon[35163]: pgmap v761: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:55:01.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:00 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:55:01.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:00 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:reconnect 2024-03-28T05:55:01.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:00 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:01.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:00 smithi159 ceph-mon[36109]: pgmap v761: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:55:01.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:00 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:55:01.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:00 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:reconnect 2024-03-28T05:55:01.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:00 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:01.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:00 smithi055 ceph-mon[31863]: pgmap v761: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:55:02.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 373 sec latency 480307.939 ms 2024-03-28T05:55:02.256 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:rejoin 2024-03-28T05:55:02.256 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:02.256 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:02.258 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f336b000700 time 2024-03-28T05:55:01.948687+0000 2024-03-28T05:55:02.258 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:02.258 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.258 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f337694b4a1] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.259 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: clone() 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: *** Caught signal (Aborted) ** 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: in thread 7f336b000700 thread_name:ms_dispatch 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:01.949+0000 7f336b000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f336b000700 time 2024-03-28T05:55:01.948687+0000 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f337694b4a1] 2024-03-28T05:55:02.260 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: clone() 2024-03-28T05:55:02.261 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.262 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.262 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f33756d2d20] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: gsignal() 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: abort() 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f337694b4fb] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.263 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 19: clone() 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:01.952+0000 7f336b000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: in thread 7f336b000700 thread_name:ms_dispatch 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f33756d2d20] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: gsignal() 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: abort() 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f337694b4fb] 2024-03-28T05:55:02.264 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.265 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 19: clone() 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: -1> 2024-03-28T05:55:01.949+0000 7f336b000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f336b000700 time 2024-03-28T05:55:01.948687+0000 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f337694b4a1] 2024-03-28T05:55:02.266 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.267 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: clone() 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 0> 2024-03-28T05:55:01.952+0000 7f336b000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: in thread 7f336b000700 thread_name:ms_dispatch 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f33756d2d20] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: gsignal() 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: abort() 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f337694b4fb] 2024-03-28T05:55:02.268 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.269 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 19: clone() 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: -1> 2024-03-28T05:55:01.949+0000 7f336b000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f336b000700 time 2024-03-28T05:55:01.948687+0000 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f337694b4a1] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.270 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: clone() 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 0> 2024-03-28T05:55:01.952+0000 7f336b000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: in thread 7f336b000700 thread_name:ms_dispatch 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f33756d2d20] 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2: gsignal() 2024-03-28T05:55:02.272 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 3: abort() 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f337694b4fb] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f337694b667] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5563dcf9f223] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5563dce195d6] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5563dce19da1] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5563dce4e09c] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5563dce6c233] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5563dce6e197] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5563dcd6d11b] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5563dcd6d6bc] 2024-03-28T05:55:02.273 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5563dcd571ff] 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f3376bdd488] 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 16: (DispatchQueue::entry()+0x51f) [0x7f3376bda60f] 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3376cade81] 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f33756c81ca] 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 19: clone() 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:01 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[86727]: 2024-03-28T05:55:02.274 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:02 smithi055 podman[87063]: 2024-03-28 05:55:02.051978951 +0000 UTC m=+0.035205779 container died 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:55:02.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:01 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:rejoin 2024-03-28T05:55:02.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:01 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:02.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:01 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:02.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:01 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:rejoin 2024-03-28T05:55:02.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:01 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:02.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:01 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:02.911 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:02 smithi055 podman[87063]: 2024-03-28 05:55:02.63189445 +0000 UTC m=+0.615121321 container remove 1842b126debdca866a7f3a48952040eab52b1cad838505df0934cb86d21e62c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:55:02.911 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:02 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:55:03.061 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:55:02.691+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:55:03.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:03.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:55:03.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:active 2024-03-28T05:55:03.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:03.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:03.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:02 smithi086 ceph-mon[35163]: pgmap v762: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:55:03.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 374 sec latency 481308.035 ms 2024-03-28T05:55:03.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:55:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:active 2024-03-28T05:55:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:02 smithi159 ceph-mon[36109]: pgmap v762: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:03 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:03 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.547s CPU time. 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2066892795,v1:172.21.15.55:6839/2066892795] up:active 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:03.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:02 smithi055 ceph-mon[31863]: pgmap v762: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:55:04.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 375 sec latency 482308.130 ms 2024-03-28T05:55:05.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 376 sec latency 483308.254 ms 2024-03-28T05:55:05.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:05 smithi086 ceph-mon[35163]: pgmap v763: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:55:05.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:05 smithi159 ceph-mon[36109]: pgmap v763: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:55:05.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:05 smithi055 ceph-mon[31863]: pgmap v763: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:55:06.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 377 sec latency 484308.411 ms 2024-03-28T05:55:07.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 378 sec latency 485308.569 ms 2024-03-28T05:55:07.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:07 smithi086 ceph-mon[35163]: pgmap v764: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:55:07.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:07 smithi159 ceph-mon[36109]: pgmap v764: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:55:07.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:07 smithi055 ceph-mon[31863]: pgmap v764: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:55:08.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 379 sec latency 486308.715 ms 2024-03-28T05:55:09.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 380 sec latency 487308.840 ms 2024-03-28T05:55:09.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:09 smithi086 ceph-mon[35163]: pgmap v765: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:55:09.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:09 smithi159 ceph-mon[36109]: pgmap v765: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:55:09.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:09 smithi055 ceph-mon[31863]: pgmap v765: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:55:10.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 381 sec latency 488309.000 ms 2024-03-28T05:55:11.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 382 sec latency 489309.155 ms 2024-03-28T05:55:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:11 smithi086 ceph-mon[35163]: pgmap v766: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:55:11.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:11 smithi159 ceph-mon[36109]: pgmap v766: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:55:11.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:11 smithi055 ceph-mon[31863]: pgmap v766: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:55:12.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 383 sec latency 490309.296 ms 2024-03-28T05:55:13.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 384 sec latency 491309.422 ms 2024-03-28T05:55:13.537 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:55:13.537 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:13.537 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.547s CPU time. 2024-03-28T05:55:13.537 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:55:13.537 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:13 smithi055 ceph-mon[31863]: pgmap v767: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:13 smithi086 ceph-mon[35163]: pgmap v767: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:13 smithi159 ceph-mon[36109]: pgmap v767: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:13.830 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 podman[87155]: 2024-03-28 05:55:13.450275102 +0000 UTC m=+0.039725972 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:55:13.831 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 podman[87155]: 2024-03-28 05:55:13.566485863 +0000 UTC m=+0.155936828 container create 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-28T05:55:13.831 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 podman[87155]: 2024-03-28 05:55:13.836656135 +0000 UTC m=+0.426107073 container init 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True) 2024-03-28T05:55:14.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 podman[87155]: 2024-03-28 05:55:13.847616797 +0000 UTC m=+0.437067699 container start 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-28T05:55:14.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 ceph-mds[87174]: -- 172.21.15.55:0/1589712409 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55576de4da40 con 0x55576de20c00 2024-03-28T05:55:14.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: starting mds.g at 2024-03-28T05:55:14.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 bash[87155]: 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 2024-03-28T05:55:14.117 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:13 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:14.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 385 sec latency 492309.561 ms 2024-03-28T05:55:14.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: daemon mds.g restarted 2024-03-28T05:55:14.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:14.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: osdmap e121: 12 total, 12 up, 12 in 2024-03-28T05:55:14.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:boot 2024-03-28T05:55:14.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:14.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:14.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:14.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:14 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: daemon mds.g restarted 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: osdmap e121: 12 total, 12 up, 12 in 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:boot 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:14.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:14 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: daemon mds.g restarted 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: osdmap e121: 12 total, 12 up, 12 in 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:boot 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:14.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:14 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:15.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 386 sec latency 493309.724 ms 2024-03-28T05:55:15.520 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:15 smithi055 ceph-mon[31863]: pgmap v769: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 op/s 2024-03-28T05:55:15.520 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:15 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:resolve 2024-03-28T05:55:15.520 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:15 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:15.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:15 smithi086 ceph-mon[35163]: pgmap v769: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 op/s 2024-03-28T05:55:15.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:15 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:resolve 2024-03-28T05:55:15.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:15 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:15.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:15 smithi159 ceph-mon[36109]: pgmap v769: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 10 op/s 2024-03-28T05:55:15.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:15 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:resolve 2024-03-28T05:55:15.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:15 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:16.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 387 sec latency 494309.853 ms 2024-03-28T05:55:17.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 388 sec latency 495310.005 ms 2024-03-28T05:55:17.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:16 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:55:17.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:16 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:reconnect 2024-03-28T05:55:17.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:16 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:17.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:16 smithi086 ceph-mon[35163]: pgmap v770: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:55:17.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:16 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:55:17.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:16 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:reconnect 2024-03-28T05:55:17.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:16 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:17.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:16 smithi159 ceph-mon[36109]: pgmap v770: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:55:17.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:16 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:55:17.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:16 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:reconnect 2024-03-28T05:55:17.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:16 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:17.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:16 smithi055 ceph-mon[31863]: pgmap v770: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:55:18.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 389 sec latency 496310.104 ms 2024-03-28T05:55:18.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:17 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:rejoin 2024-03-28T05:55:18.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:17 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:18.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:17 smithi086 ceph-mon[35163]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:18.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:17 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:rejoin 2024-03-28T05:55:18.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:17 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:18.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:17 smithi159 ceph-mon[36109]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:18.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:rejoin 2024-03-28T05:55:18.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:18.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-mon[31863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:18.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f1e81200700 time 2024-03-28T05:55:17.995382+0000 2024-03-28T05:55:18.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:18.367 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1e8cb074a1] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.368 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: clone() 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: *** Caught signal (Aborted) ** 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: in thread 7f1e81200700 thread_name:ms_dispatch 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:17.995+0000 7f1e81200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f1e81200700 time 2024-03-28T05:55:17.995382+0000 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1e8cb074a1] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.369 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: clone() 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.370 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.371 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1e8b88ed20] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: gsignal() 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: abort() 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1e8cb074fb] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.372 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 19: clone() 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:17.997+0000 7f1e81200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: in thread 7f1e81200700 thread_name:ms_dispatch 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1e8b88ed20] 2024-03-28T05:55:18.373 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: gsignal() 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: abort() 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1e8cb074fb] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.374 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 19: clone() 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:17 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: -1> 2024-03-28T05:55:17.995+0000 7f1e81200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f1e81200700 time 2024-03-28T05:55:17.995382+0000 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1e8cb074a1] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.375 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: clone() 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 0> 2024-03-28T05:55:17.997+0000 7f1e81200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: in thread 7f1e81200700 thread_name:ms_dispatch 2024-03-28T05:55:18.376 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1e8b88ed20] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: gsignal() 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: abort() 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1e8cb074fb] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.377 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 19: clone() 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: -1> 2024-03-28T05:55:17.995+0000 7f1e81200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f1e81200700 time 2024-03-28T05:55:17.995382+0000 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1e8cb074a1] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.378 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: clone() 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 0> 2024-03-28T05:55:17.997+0000 7f1e81200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: in thread 7f1e81200700 thread_name:ms_dispatch 2024-03-28T05:55:18.379 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1e8b88ed20] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2: gsignal() 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 3: abort() 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1e8cb074fb] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f1e8cb07667] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b7fa7f5223] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b7fa66f5d6] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b7fa66fda1] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b7fa6a409c] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b7fa6c2233] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b7fa6c4197] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b7fa5c311b] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b7fa5c36bc] 2024-03-28T05:55:18.380 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b7fa5ad1ff] 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f1e8cd99488] 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 16: (DispatchQueue::entry()+0x51f) [0x7f1e8cd9660f] 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1e8ce69e81] 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f1e8b8841ca] 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 19: clone() 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87023]: 2024-03-28T05:55:18.381 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 podman[87210]: 2024-03-28 05:55:18.09746865 +0000 UTC m=+0.040575145 container died 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:55:19.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 390 sec latency 497310.227 ms 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:active 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:19.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:18 smithi086 ceph-mon[35163]: pgmap v771: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:active 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:19.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:18 smithi159 ceph-mon[36109]: pgmap v771: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/1567549774,v1:172.21.15.55:6841/1567549774] up:active 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:18 smithi055 ceph-mon[31863]: pgmap v771: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 podman[87210]: 2024-03-28 05:55:18.923969778 +0000 UTC m=+0.867076289 container remove 681d452defff5b88d416ce08a277c61c9784610ce8839384c61097119f9d9f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-28T05:55:19.366 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:18 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:55:19.865 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:19 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:55:19.866 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:19 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.573s CPU time. 2024-03-28T05:55:20.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 391 sec latency 498310.393 ms 2024-03-28T05:55:21.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 392 sec latency 499310.541 ms 2024-03-28T05:55:21.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:21 smithi086 ceph-mon[35163]: pgmap v772: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:55:21.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:21 smithi159 ceph-mon[36109]: pgmap v772: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:55:21.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:21 smithi055 ceph-mon[31863]: pgmap v772: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:55:22.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 393 sec latency 500310.664 ms 2024-03-28T05:55:23.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 394 sec latency 501310.831 ms 2024-03-28T05:55:23.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:23 smithi086 ceph-mon[35163]: pgmap v773: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:55:23.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:23 smithi159 ceph-mon[36109]: pgmap v773: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:55:23.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:23 smithi055 ceph-mon[31863]: pgmap v773: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 204 B/s wr, 12 op/s 2024-03-28T05:55:24.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 395 sec latency 502310.935 ms 2024-03-28T05:55:25.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 396 sec latency 503311.075 ms 2024-03-28T05:55:25.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:25 smithi086 ceph-mon[35163]: pgmap v774: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:55:25.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:25 smithi159 ceph-mon[36109]: pgmap v774: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:55:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:25 smithi055 ceph-mon[31863]: pgmap v774: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:55:26.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 397 sec latency 504311.217 ms 2024-03-28T05:55:27.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 398 sec latency 505311.380 ms 2024-03-28T05:55:27.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:27 smithi086 ceph-mon[35163]: pgmap v775: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:27.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:27 smithi159 ceph-mon[36109]: pgmap v775: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:27.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:27 smithi055 ceph-mon[31863]: pgmap v775: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:28.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 399 sec latency 506311.541 ms 2024-03-28T05:55:29.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 400 sec latency 507311.695 ms 2024-03-28T05:55:29.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:29 smithi086 ceph-mon[35163]: pgmap v776: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:29.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:29 smithi159 ceph-mon[36109]: pgmap v776: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:29.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:29 smithi055 ceph-mon[31863]: pgmap v776: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:30.012 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:29 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:55:30.012 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:29 smithi055 systemd[1]: Stopped Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:30.012 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:29 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.573s CPU time. 2024-03-28T05:55:30.013 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:29 smithi055 systemd[1]: Starting Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:55:30.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 401 sec latency 508311.818 ms 2024-03-28T05:55:30.314 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 podman[87301]: 2024-03-28 05:55:29.9266868 +0000 UTC m=+0.037648668 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:55:30.314 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 podman[87301]: 2024-03-28 05:55:30.058490603 +0000 UTC m=+0.169452497 container create 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True) 2024-03-28T05:55:30.314 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 podman[87301]: 2024-03-28 05:55:30.320506233 +0000 UTC m=+0.431468134 container init 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:55:30.616 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 podman[87301]: 2024-03-28 05:55:30.331712155 +0000 UTC m=+0.442674034 container start 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:55:30.616 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 ceph-mds[87319]: -- 172.21.15.55:0/3012554258 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55715c481a40 con 0x55715c454c00 2024-03-28T05:55:30.616 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: starting mds.a at 2024-03-28T05:55:30.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 bash[87301]: 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd 2024-03-28T05:55:30.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:30 smithi055 systemd[1]: Started Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:31.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 402 sec latency 509311.934 ms 2024-03-28T05:55:31.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: pgmap v777: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:55:31.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: daemon mds.a restarted 2024-03-28T05:55:31.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: osdmap e122: 12 total, 12 up, 12 in 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:boot 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:55:31.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:31 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: pgmap v777: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: daemon mds.a restarted 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: osdmap e122: 12 total, 12 up, 12 in 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:boot 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:55:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:31 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: pgmap v777: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1023 B/s wr, 11 op/s 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: daemon mds.a restarted 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: osdmap e122: 12 total, 12 up, 12 in 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:boot 2024-03-28T05:55:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:55:31.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:31.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-28T05:55:31.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:31 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:32.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 403 sec latency 510312.070 ms 2024-03-28T05:55:32.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:32 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:resolve 2024-03-28T05:55:32.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:32 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:32.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:32 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:resolve 2024-03-28T05:55:32.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:32 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:32.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:32 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:resolve 2024-03-28T05:55:32.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:32 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:33.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 404 sec latency 511312.213 ms 2024-03-28T05:55:33.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:33 smithi159 ceph-mon[36109]: pgmap v779: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:55:33.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:33 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:33.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:33 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:reconnect 2024-03-28T05:55:33.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:33 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:33 smithi086 ceph-mon[35163]: pgmap v779: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:55:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:33 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:33 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:reconnect 2024-03-28T05:55:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:33 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:33.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:33 smithi055 ceph-mon[31863]: pgmap v779: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:55:33.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:33 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:33.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:33 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:reconnect 2024-03-28T05:55:33.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:33 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:34.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 405 sec latency 512312.377 ms 2024-03-28T05:55:34.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:34 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:rejoin 2024-03-28T05:55:34.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:34 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:34.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:34 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:34.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:34 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:rejoin 2024-03-28T05:55:34.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:34 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:34.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:34 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:34.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:rejoin 2024-03-28T05:55:34.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:34.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe8ace00700 time 2024-03-28T05:55:34.498417+0000 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe8b873c4a1] 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: clone() 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.498+0000 7fe8ace00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe8ace00700 time 2024-03-28T05:55:34.498417+0000 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe8b873c4a1] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: clone() 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: *** Caught signal (Aborted) ** 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: in thread 7fe8ace00700 thread_name:ms_dispatch 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe8b74c3d20] 2024-03-28T05:55:34.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: gsignal() 2024-03-28T05:55:34.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: abort() 2024-03-28T05:55:34.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe8b873c4fb] 2024-03-28T05:55:34.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 19: clone() 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.501+0000 7fe8ace00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: in thread 7fe8ace00700 thread_name:ms_dispatch 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe8b74c3d20] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: gsignal() 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: abort() 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe8b873c4fb] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 19: clone() 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: -1> 2024-03-28T05:55:34.498+0000 7fe8ace00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe8ace00700 time 2024-03-28T05:55:34.498417+0000 2024-03-28T05:55:34.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:34.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe8b873c4a1] 2024-03-28T05:55:34.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: clone() 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 0> 2024-03-28T05:55:34.501+0000 7fe8ace00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: in thread 7fe8ace00700 thread_name:ms_dispatch 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe8b74c3d20] 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: gsignal() 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: abort() 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe8b873c4fb] 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 19: clone() 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: -1> 2024-03-28T05:55:34.498+0000 7fe8ace00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe8ace00700 time 2024-03-28T05:55:34.498417+0000 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe8b873c4a1] 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: clone() 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 0> 2024-03-28T05:55:34.501+0000 7fe8ace00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: in thread 7fe8ace00700 thread_name:ms_dispatch 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe8b74c3d20] 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2: gsignal() 2024-03-28T05:55:34.884 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 3: abort() 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe8b873c4fb] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe8b873c667] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55576c26f223] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55576c0e95d6] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55576c0e9da1] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55576c11e09c] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55576c13c233] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55576c13e197] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55576c03d11b] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55576c03d6bc] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55576c0271ff] 2024-03-28T05:55:34.885 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe8b89ce488] 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 16: (DispatchQueue::entry()+0x51f) [0x7fe8b89cb60f] 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe8b8a9ee81] 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe8b74b91ca] 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 19: clone() 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87170]: 2024-03-28T05:55:34.886 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:34 smithi055 podman[87355]: 2024-03-28 05:55:34.591899833 +0000 UTC m=+0.034875523 container died 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-28T05:55:35.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 406 sec latency 513312.528 ms 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: pgmap v780: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: Cluster is now healthy 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:active 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:35.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:35 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: pgmap v780: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: Cluster is now healthy 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:active 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:35.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:35 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:35.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:35 smithi055 podman[87355]: 2024-03-28 05:55:35.624227987 +0000 UTC m=+1.067203741 container remove 8c3f2cee99b097e76d1ca2f0a2a2fe76a295eb6e6412bbbdf3c0dcddb2a87ad1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-28T05:55:35.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:35 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:55:35.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: pgmap v780: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:55:35.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:35.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: Cluster is now healthy 2024-03-28T05:55:35.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/476442511,v1:172.21.15.55:6839/476442511] up:active 2024-03-28T05:55:35.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:35.867 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:35 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:36.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 407 sec latency 514312.669 ms 2024-03-28T05:55:36.615 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:36 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:55:36.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:36 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.591s CPU time. 2024-03-28T05:55:37.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 408 sec latency 515312.830 ms 2024-03-28T05:55:37.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:37 smithi086 ceph-mon[35163]: pgmap v781: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:55:37.811 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:55:37 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:55:37.694+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:55:37.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:37 smithi159 ceph-mon[36109]: pgmap v781: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:55:37.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:37 smithi055 ceph-mon[31863]: pgmap v781: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:55:38.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 409 sec latency 516312.978 ms 2024-03-28T05:55:39.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 410 sec latency 517313.117 ms 2024-03-28T05:55:39.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:39 smithi086 ceph-mon[35163]: pgmap v782: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:55:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:39 smithi159 ceph-mon[36109]: pgmap v782: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:55:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:39 smithi055 ceph-mon[31863]: pgmap v782: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:55:40.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 411 sec latency 518313.256 ms 2024-03-28T05:55:41.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 412 sec latency 519313.398 ms 2024-03-28T05:55:41.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:41 smithi086 ceph-mon[35163]: pgmap v783: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:55:41.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:41 smithi159 ceph-mon[36109]: pgmap v783: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:55:41.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:41 smithi055 ceph-mon[31863]: pgmap v783: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:55:42.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 413 sec latency 520313.560 ms 2024-03-28T05:55:42.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:55:42.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:55:42.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:55:43.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 414 sec latency 521313.651 ms 2024-03-28T05:55:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:43 smithi086 ceph-mon[35163]: pgmap v784: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:43.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:43 smithi159 ceph-mon[36109]: pgmap v784: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:43.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:43.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:43.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:43 smithi055 ceph-mon[31863]: pgmap v784: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:55:43.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:43.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:44.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 415 sec latency 522313.769 ms 2024-03-28T05:55:45.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 416 sec latency 523314.012 ms 2024-03-28T05:55:45.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:45 smithi086 ceph-mon[35163]: pgmap v785: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:55:45.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:45.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:45 smithi159 ceph-mon[36109]: pgmap v785: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:55:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:45.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:45.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:45 smithi055 ceph-mon[31863]: pgmap v785: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:55:45.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:45.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:46.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 417 sec latency 524314.106 ms 2024-03-28T05:55:46.593 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:55:46.593 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:46.593 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.591s CPU time. 2024-03-28T05:55:46.593 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:55:46.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 podman[87862]: 2024-03-28 05:55:46.657390928 +0000 UTC m=+0.046046310 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:55:46.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:46 smithi055 podman[87862]: 2024-03-28 05:55:46.771236105 +0000 UTC m=+0.159891514 container create 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2) 2024-03-28T05:55:47.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 418 sec latency 525314.173 ms 2024-03-28T05:55:47.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:46 smithi086 ceph-mon[35163]: pgmap v786: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:55:47.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:46 smithi159 ceph-mon[36109]: pgmap v786: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:55:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:46 smithi055 ceph-mon[31863]: pgmap v786: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 podman[87862]: 2024-03-28 05:55:47.050692866 +0000 UTC m=+0.439348285 container init 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 podman[87862]: 2024-03-28 05:55:47.064540509 +0000 UTC m=+0.453195886 container start 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 ceph-mds[87896]: -- 172.21.15.55:0/313880139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55789aa9da40 con 0x55789aa71000 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: starting mds.g at 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 bash[87862]: 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c 2024-03-28T05:55:47.366 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:55:47 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:55:48.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 419 sec latency 526314.296 ms 2024-03-28T05:55:48.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: daemon mds.g restarted 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: osdmap e123: 12 total, 12 up, 12 in 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:boot 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:48.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:48 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: daemon mds.g restarted 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: osdmap e123: 12 total, 12 up, 12 in 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:boot 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:48.313 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:48.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:48 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: daemon mds.g restarted 2024-03-28T05:55:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: osdmap e123: 12 total, 12 up, 12 in 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:boot 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:55:48.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:48 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:49.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 420 sec latency 527314.421 ms 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:resolve 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: pgmap v788: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: pgmap v789: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:55:49.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:resolve 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: pgmap v788: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: pgmap v789: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:55:49.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:49.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:resolve 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: pgmap v788: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8 op/s 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: pgmap v789: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:55:49.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:55:50.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 421 sec latency 528314.577 ms 2024-03-28T05:55:50.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:50 smithi086 ceph-mon[35163]: Health check failed: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T05:55:50.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:50 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:50.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:50 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:reconnect 2024-03-28T05:55:50.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:50 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:50.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:50 smithi159 ceph-mon[36109]: Health check failed: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T05:55:50.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:50 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:50.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:50 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:reconnect 2024-03-28T05:55:50.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:50 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:50.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:50 smithi055 ceph-mon[31863]: Health check failed: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T05:55:50.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:50 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:55:50.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:50 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:reconnect 2024-03-28T05:55:50.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:50 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:51.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 422 sec latency 529314.668 ms 2024-03-28T05:55:51.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:51 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:rejoin 2024-03-28T05:55:51.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:51 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:51.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:51 smithi086 ceph-mon[35163]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:51.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:51 smithi086 ceph-mon[35163]: pgmap v790: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:55:51.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:51 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:rejoin 2024-03-28T05:55:51.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:51 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:51.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:51 smithi159 ceph-mon[36109]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:51.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:51 smithi159 ceph-mon[36109]: pgmap v790: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:55:51.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:rejoin 2024-03-28T05:55:51.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:51.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-mon[31863]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-03-28T05:55:51.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-mon[31863]: pgmap v790: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-03-28T05:55:51.617 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f051ae00700 time 2024-03-28T05:55:51.209651+0000 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f05266fa4a1] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.618 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: clone() 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.210+0000 7f051ae00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f051ae00700 time 2024-03-28T05:55:51.209651+0000 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:51.619 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f05266fa4a1] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.620 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: clone() 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: *** Caught signal (Aborted) ** 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: in thread 7f051ae00700 thread_name:ms_dispatch 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0525481d20] 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: gsignal() 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: abort() 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f05266fa4fb] 2024-03-28T05:55:51.621 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 19: clone() 2024-03-28T05:55:51.622 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.212+0000 7f051ae00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: in thread 7f051ae00700 thread_name:ms_dispatch 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0525481d20] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: gsignal() 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: abort() 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f05266fa4fb] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.623 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 19: clone() 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: -1> 2024-03-28T05:55:51.210+0000 7f051ae00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f051ae00700 time 2024-03-28T05:55:51.209651+0000 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:51.624 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f05266fa4a1] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.625 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: clone() 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 0> 2024-03-28T05:55:51.212+0000 7f051ae00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: in thread 7f051ae00700 thread_name:ms_dispatch 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0525481d20] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: gsignal() 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: abort() 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f05266fa4fb] 2024-03-28T05:55:51.626 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.627 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 19: clone() 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: -1> 2024-03-28T05:55:51.210+0000 7f051ae00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f051ae00700 time 2024-03-28T05:55:51.209651+0000 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f05266fa4a1] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.628 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.630 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: clone() 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 0> 2024-03-28T05:55:51.212+0000 7f051ae00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: in thread 7f051ae00700 thread_name:ms_dispatch 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0525481d20] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2: gsignal() 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 3: abort() 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f05266fa4fb] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f05266fa667] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55715a71f223] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55715a5995d6] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55715a599da1] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55715a5ce09c] 2024-03-28T05:55:51.631 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55715a5ec233] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55715a5ee197] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55715a4ed11b] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55715a4ed6bc] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55715a4d71ff] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f052698c488] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 16: (DispatchQueue::entry()+0x51f) [0x7f052698960f] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0526a5ce81] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f05254771ca] 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 19: clone() 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a[87315]: 2024-03-28T05:55:51.632 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:51 smithi055 podman[87981]: 2024-03-28 05:55:51.304613744 +0000 UTC m=+0.035356315 container died 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319) 2024-03-28T05:55:52.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 423 sec latency 530314.742 ms 2024-03-28T05:55:52.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:52 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:52.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:52 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:active 2024-03-28T05:55:52.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:52.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:52 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:52.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:52 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:52.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:52 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:active 2024-03-28T05:55:52.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:52.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:52 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:52.615 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:52 smithi055 podman[87981]: 2024-03-28 05:55:52.178946561 +0000 UTC m=+0.909689157 container remove 7f3e10def52df088c6366de3789000beb87308f66e0fc33b3d1d0a2df8b2e8fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-a, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-28T05:55:52.615 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:52 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:55:52.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:52 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:55:52.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:52 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6840/983243293,v1:172.21.15.55:6841/983243293] up:active 2024-03-28T05:55:52.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 2 up:standby-replay 3 up:standby 2024-03-28T05:55:52.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:52 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby 2024-03-28T05:55:53.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:55:52 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:55:52.695+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:55:53.115 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:52 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:55:53.116 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:55:52 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.649s CPU time. 2024-03-28T05:55:53.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 424 sec latency 531314.866 ms 2024-03-28T05:55:53.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:53 smithi086 ceph-mon[35163]: pgmap v791: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-28T05:55:53.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:53 smithi159 ceph-mon[36109]: pgmap v791: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-28T05:55:53.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:53 smithi055 ceph-mon[31863]: pgmap v791: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-28T05:55:54.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 425 sec latency 532315.031 ms 2024-03-28T05:55:55.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 426 sec latency 533315.120 ms 2024-03-28T05:55:55.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:55 smithi159 ceph-mon[36109]: pgmap v792: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:55:55.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:55 smithi055 ceph-mon[31863]: pgmap v792: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:55:55.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:55 smithi086 ceph-mon[35163]: pgmap v792: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:55:56.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 427 sec latency 534315.250 ms 2024-03-28T05:55:57.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 428 sec latency 535315.389 ms 2024-03-28T05:55:57.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:57 smithi055 ceph-mon[31863]: pgmap v793: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-03-28T05:55:57.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:57 smithi086 ceph-mon[35163]: pgmap v793: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-03-28T05:55:57.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:57 smithi159 ceph-mon[36109]: pgmap v793: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-03-28T05:55:58.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 429 sec latency 536315.516 ms 2024-03-28T05:55:59.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 430 sec latency 537315.665 ms 2024-03-28T05:55:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:55:59 smithi055 ceph-mon[31863]: pgmap v794: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:55:59.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:55:59 smithi086 ceph-mon[35163]: pgmap v794: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:55:59.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:55:59 smithi159 ceph-mon[36109]: pgmap v794: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:00.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 431 sec latency 538315.823 ms 2024-03-28T05:56:01.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 432 sec latency 539315.913 ms 2024-03-28T05:56:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:01 smithi055 ceph-mon[31863]: pgmap v795: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:01.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:01 smithi086 ceph-mon[35163]: pgmap v795: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:01.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:01 smithi159 ceph-mon[36109]: pgmap v795: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:02.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 433 sec latency 540316.008 ms 2024-03-28T05:56:03.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 434 sec latency 541316.166 ms 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: Stopped Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Consumed 1.649s CPU time. 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Start request repeated too quickly. 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.a.service: Failed with result 'exit-code'. 2024-03-28T05:56:03.359 INFO:journalctl@ceph.mds.a.smithi055.stdout:Mar 28 05:56:02 smithi055 systemd[1]: Failed to start Ceph mds.a for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:03.615 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:03 smithi159 ceph-mon[36109]: pgmap v796: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:03.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:03 smithi055 ceph-mon[31863]: pgmap v796: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:03.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:03 smithi086 ceph-mon[35163]: pgmap v796: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:04.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 435 sec latency 542316.768 ms 2024-03-28T05:56:05.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 436 sec latency 543316.962 ms 2024-03-28T05:56:05.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:05 smithi159 ceph-mon[36109]: pgmap v797: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:05.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:05 smithi055 ceph-mon[31863]: pgmap v797: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:05.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:05 smithi086 ceph-mon[35163]: pgmap v797: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:06.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 437 sec latency 544317.091 ms 2024-03-28T05:56:07.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 438 sec latency 545317.251 ms 2024-03-28T05:56:07.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:07 smithi086 ceph-mon[35163]: pgmap v798: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-03-28T05:56:07.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:07 smithi159 ceph-mon[36109]: pgmap v798: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-03-28T05:56:07.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:07 smithi055 ceph-mon[31863]: pgmap v798: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-03-28T05:56:08.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 439 sec latency 546317.379 ms 2024-03-28T05:56:08.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:08 smithi086 ceph-mon[35163]: Replacing daemon mds.a as rank 1 with standby daemon mds.g 2024-03-28T05:56:08.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:08 smithi086 ceph-mon[35163]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-03-28T05:56:08.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:08 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:08.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:08 smithi086 ceph-mon[35163]: osdmap e124: 12 total, 12 up, 12 in 2024-03-28T05:56:08.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:08 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:08.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:08 smithi159 ceph-mon[36109]: Replacing daemon mds.a as rank 1 with standby daemon mds.g 2024-03-28T05:56:08.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:08 smithi159 ceph-mon[36109]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-03-28T05:56:08.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:08 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:08.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:08 smithi159 ceph-mon[36109]: osdmap e124: 12 total, 12 up, 12 in 2024-03-28T05:56:08.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:08 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:08.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:08 smithi055 ceph-mon[31863]: Replacing daemon mds.a as rank 1 with standby daemon mds.g 2024-03-28T05:56:08.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:08 smithi055 ceph-mon[31863]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-03-28T05:56:08.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:08 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:08.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:08 smithi055 ceph-mon[31863]: osdmap e124: 12 total, 12 up, 12 in 2024-03-28T05:56:08.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:08 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:09.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 440 sec latency 547317.541 ms 2024-03-28T05:56:09.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:09 smithi086 ceph-mon[35163]: pgmap v800: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:56:09.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:09 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:resolve 2024-03-28T05:56:09.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:09 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:09.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:09 smithi159 ceph-mon[36109]: pgmap v800: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:56:09.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:09 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:resolve 2024-03-28T05:56:09.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:09 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:09 smithi055 ceph-mon[31863]: pgmap v800: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:56:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:09 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:resolve 2024-03-28T05:56:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:09 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:10.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 441 sec latency 548317.689 ms 2024-03-28T05:56:11.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 442 sec latency 549317.843 ms 2024-03-28T05:56:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:11 smithi086 ceph-mon[35163]: pgmap v801: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:56:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:11 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:11 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:reconnect 2024-03-28T05:56:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:11 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:11.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:11 smithi159 ceph-mon[36109]: pgmap v801: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:56:11.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:11 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:11.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:11 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:reconnect 2024-03-28T05:56:11.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:11 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:11.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:11 smithi055 ceph-mon[31863]: pgmap v801: 97 pgs: 97 active+clean; 22 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:56:11.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:11 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:11.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:11 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:reconnect 2024-03-28T05:56:11.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:11 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:12.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 443 sec latency 550317.973 ms 2024-03-28T05:56:12.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:rejoin 2024-03-28T05:56:12.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:12 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:12.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:12 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:12.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:rejoin 2024-03-28T05:56:12.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:12 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:12.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:12 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:12.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:rejoin 2024-03-28T05:56:12.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:12.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:12.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4cae200700 time 2024-03-28T05:56:12.340716+0000 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4cb9bc34a1] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.617 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.618 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: clone() 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.341+0000 7f4cae200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4cae200700 time 2024-03-28T05:56:12.340716+0000 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4cb9bc34a1] 2024-03-28T05:56:12.619 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.620 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: clone() 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: *** Caught signal (Aborted) ** 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: in thread 7f4cae200700 thread_name:ms_dispatch 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.621 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4cb894ad20] 2024-03-28T05:56:12.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: gsignal() 2024-03-28T05:56:12.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: abort() 2024-03-28T05:56:12.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4cb9bc34fb] 2024-03-28T05:56:12.622 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.623 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 19: clone() 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.343+0000 7f4cae200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: in thread 7f4cae200700 thread_name:ms_dispatch 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.624 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4cb894ad20] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: gsignal() 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: abort() 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4cb9bc34fb] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.625 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 19: clone() 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:12.626 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: -1> 2024-03-28T05:56:12.341+0000 7f4cae200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4cae200700 time 2024-03-28T05:56:12.340716+0000 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4cb9bc34a1] 2024-03-28T05:56:12.627 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.628 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: clone() 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.629 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 0> 2024-03-28T05:56:12.343+0000 7f4cae200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: in thread 7f4cae200700 thread_name:ms_dispatch 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4cb894ad20] 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: gsignal() 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: abort() 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4cb9bc34fb] 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.630 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.631 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 19: clone() 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: -1> 2024-03-28T05:56:12.341+0000 7f4cae200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f4cae200700 time 2024-03-28T05:56:12.340716+0000 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f4cb9bc34a1] 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.632 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.633 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: clone() 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 0> 2024-03-28T05:56:12.343+0000 7f4cae200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: in thread 7f4cae200700 thread_name:ms_dispatch 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4cb894ad20] 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2: gsignal() 2024-03-28T05:56:12.634 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 3: abort() 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4cb9bc34fb] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f4cb9bc3667] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x557898a14223] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55789888e5d6] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55789888eda1] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5578988c309c] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5578988e1233] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5578988e3197] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5578987e211b] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5578987e26bc] 2024-03-28T05:56:12.635 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5578987cc1ff] 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f4cb9e55488] 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 16: (DispatchQueue::entry()+0x51f) [0x7f4cb9e5260f] 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4cb9f25e81] 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f4cb89401ca] 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 19: clone() 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[87889]: 2024-03-28T05:56:12.636 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:12 smithi055 podman[88041]: 2024-03-28 05:56:12.437026306 +0000 UTC m=+0.033432566 container died 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-28T05:56:13.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:56:12 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:56:12.698+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:56:13.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 444 sec latency 551318.127 ms 2024-03-28T05:56:13.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:13 smithi086 ceph-mon[35163]: pgmap v802: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:13 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:13 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:active 2024-03-28T05:56:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:13 smithi159 ceph-mon[36109]: pgmap v802: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:13 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:13 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:active 2024-03-28T05:56:13.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:13.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:13.615 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:13 smithi055 podman[88041]: 2024-03-28 05:56:13.35286225 +0000 UTC m=+0.949268550 container remove 1c9c3e264ed83d80321e1cd4861497b88e50c496f31cb488718413bca5cb3d0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:56:13.615 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:56:13.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:13 smithi055 ceph-mon[31863]: pgmap v802: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:13.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:13 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:13.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:13 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/2251649856,v1:172.21.15.55:6839/2251649856] up:active 2024-03-28T05:56:13.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:13.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:14.115 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:56:14.116 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:13 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.600s CPU time. 2024-03-28T05:56:14.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 445 sec latency 552318.285 ms 2024-03-28T05:56:15.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 446 sec latency 553318.381 ms 2024-03-28T05:56:15.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:15 smithi086 ceph-mon[35163]: pgmap v803: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:56:15.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:15 smithi159 ceph-mon[36109]: pgmap v803: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:56:15.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:15 smithi055 ceph-mon[31863]: pgmap v803: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-03-28T05:56:16.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 447 sec latency 554318.523 ms 2024-03-28T05:56:17.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 448 sec latency 555318.666 ms 2024-03-28T05:56:17.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:17 smithi086 ceph-mon[35163]: pgmap v804: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:56:17.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:17 smithi159 ceph-mon[36109]: pgmap v804: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:56:17.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:17 smithi055 ceph-mon[31863]: pgmap v804: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:56:18.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 449 sec latency 556318.831 ms 2024-03-28T05:56:19.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 450 sec latency 557318.982 ms 2024-03-28T05:56:19.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:19 smithi086 ceph-mon[35163]: pgmap v805: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:19.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:19 smithi159 ceph-mon[36109]: pgmap v805: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:19.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:19 smithi055 ceph-mon[31863]: pgmap v805: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:20.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 451 sec latency 558319.076 ms 2024-03-28T05:56:21.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 452 sec latency 559319.235 ms 2024-03-28T05:56:21.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:21 smithi055 ceph-mon[31863]: pgmap v806: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:21.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:21 smithi086 ceph-mon[35163]: pgmap v806: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:21.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:21 smithi159 ceph-mon[36109]: pgmap v806: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:22.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 453 sec latency 560319.375 ms 2024-03-28T05:56:23.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 454 sec latency 561319.511 ms 2024-03-28T05:56:23.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:23 smithi055 ceph-mon[31863]: pgmap v807: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:23.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:23 smithi086 ceph-mon[35163]: pgmap v807: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:23.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:23 smithi159 ceph-mon[36109]: pgmap v807: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:56:24.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 455 sec latency 562319.611 ms 2024-03-28T05:56:24.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:23 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:56:24.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:23 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:24.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:23 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.600s CPU time. 2024-03-28T05:56:24.271 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:23 smithi055 systemd[1]: Starting Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:56:24.582 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 podman[88130]: 2024-03-28 05:56:24.185472656 +0000 UTC m=+0.035885502 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:56:24.582 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 podman[88130]: 2024-03-28 05:56:24.293696018 +0000 UTC m=+0.144108896 container create a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319) 2024-03-28T05:56:24.865 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 podman[88130]: 2024-03-28 05:56:24.589580353 +0000 UTC m=+0.439993235 container init a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-28T05:56:24.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 podman[88130]: 2024-03-28 05:56:24.599763801 +0000 UTC m=+0.450176651 container start a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:56:24.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 ceph-mds[88149]: -- 172.21.15.55:0/3423266815 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5587386efa40 con 0x5587386c2c00 2024-03-28T05:56:24.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: starting mds.g at 2024-03-28T05:56:24.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 bash[88130]: a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd 2024-03-28T05:56:24.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:24 smithi055 systemd[1]: Started Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:25.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 456 sec latency 563319.742 ms 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: pgmap v808: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: daemon mds.g restarted 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: osdmap e125: 12 total, 12 up, 12 in 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:boot 2024-03-28T05:56:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:56:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:56:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:25 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: pgmap v808: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: daemon mds.g restarted 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: osdmap e125: 12 total, 12 up, 12 in 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:boot 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:56:25.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:25 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: pgmap v808: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: daemon mds.g restarted 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: osdmap e125: 12 total, 12 up, 12 in 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:boot 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:56:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:25.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-28T05:56:25.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:25 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:26.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 457 sec latency 564319.891 ms 2024-03-28T05:56:27.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 458 sec latency 565320.023 ms 2024-03-28T05:56:27.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:27 smithi055 ceph-mon[31863]: pgmap v810: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:56:27.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:27 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:resolve 2024-03-28T05:56:27.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:27 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:27.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:27 smithi086 ceph-mon[35163]: pgmap v810: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:56:27.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:27 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:resolve 2024-03-28T05:56:27.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:27 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:27.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:27 smithi159 ceph-mon[36109]: pgmap v810: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7 op/s 2024-03-28T05:56:27.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:27 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:resolve 2024-03-28T05:56:27.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:27 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:28.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 459 sec latency 566320.205 ms 2024-03-28T05:56:28.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:28 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:28.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:reconnect 2024-03-28T05:56:28.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:28 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:28.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:28 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:28.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:reconnect 2024-03-28T05:56:28.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:28 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:28.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:28 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:28.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:reconnect 2024-03-28T05:56:28.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:28 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:29.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 460 sec latency 567320.362 ms 2024-03-28T05:56:29.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:29 smithi086 ceph-mon[35163]: pgmap v811: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:56:29.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:29 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:rejoin 2024-03-28T05:56:29.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:29 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:29.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:29 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:56:29.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:29 smithi159 ceph-mon[36109]: pgmap v811: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:56:29.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:29 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:rejoin 2024-03-28T05:56:29.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:29 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:29.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:29 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:56:29.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-mon[31863]: pgmap v811: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:56:29.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:rejoin 2024-03-28T05:56:29.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:29.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe985800700 time 2024-03-28T05:56:29.443579+0000 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe9911d34a1] 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.868 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.869 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: clone() 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.444+0000 7fe985800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe985800700 time 2024-03-28T05:56:29.443579+0000 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe9911d34a1] 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.870 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.871 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: clone() 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: *** Caught signal (Aborted) ** 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: in thread 7fe985800700 thread_name:ms_dispatch 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.872 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe98ff5ad20] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: gsignal() 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: abort() 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe9911d34fb] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.873 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 19: clone() 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.447+0000 7fe985800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:29.874 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: in thread 7fe985800700 thread_name:ms_dispatch 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe98ff5ad20] 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: gsignal() 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: abort() 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe9911d34fb] 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.875 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 19: clone() 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:29.876 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: -1> 2024-03-28T05:56:29.444+0000 7fe985800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe985800700 time 2024-03-28T05:56:29.443579+0000 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe9911d34a1] 2024-03-28T05:56:29.877 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.878 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: clone() 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 0> 2024-03-28T05:56:29.447+0000 7fe985800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:29.879 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: in thread 7fe985800700 thread_name:ms_dispatch 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe98ff5ad20] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: gsignal() 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: abort() 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe9911d34fb] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.880 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 19: clone() 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: -1> 2024-03-28T05:56:29.444+0000 7fe985800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fe985800700 time 2024-03-28T05:56:29.443579+0000 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:29.881 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe9911d34a1] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.882 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: clone() 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 0> 2024-03-28T05:56:29.447+0000 7fe985800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: in thread 7fe985800700 thread_name:ms_dispatch 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.883 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe98ff5ad20] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2: gsignal() 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 3: abort() 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe9911d34fb] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fe9911d3667] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564a7f9d7223] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564a7f8515d6] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564a7f851da1] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564a7f88609c] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564a7f8a4233] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564a7f8a6197] 2024-03-28T05:56:29.884 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564a7f7a511b] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564a7f7a56bc] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564a7f78f1ff] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fe991465488] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 16: (DispatchQueue::entry()+0x51f) [0x7fe99146260f] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe991535e81] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fe98ff501ca] 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 19: clone() 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[70875]: 2024-03-28T05:56:29.885 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:29 smithi055 podman[88185]: 2024-03-28 05:56:29.564294359 +0000 UTC m=+0.035485412 container died 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-28T05:56:30.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 461 sec latency 568320.455 ms 2024-03-28T05:56:30.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:30 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:30.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:30 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:active 2024-03-28T05:56:30.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:30.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:30.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:30 smithi055 podman[88185]: 2024-03-28 05:56:30.291866547 +0000 UTC m=+0.763057601 container remove 2a233a2c19e828d41a90192670b8831596ab04a132f9cae68e78539f4cf1eabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:56:30.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:30 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:56:30.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:30 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:30.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:30 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:active 2024-03-28T05:56:30.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:30.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:30.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:30 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:30.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:30 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1204847109,v1:172.21.15.55:6837/1204847109] up:active 2024-03-28T05:56:30.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:30.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:31.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:30 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:56:31.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:30 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 2.067s CPU time. 2024-03-28T05:56:31.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 462 sec latency 569320.624 ms 2024-03-28T05:56:31.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:31 smithi086 ceph-mon[35163]: pgmap v812: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:56:31.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:31 smithi159 ceph-mon[36109]: pgmap v812: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:56:31.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:31 smithi055 ceph-mon[31863]: pgmap v812: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:56:32.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 463 sec latency 570320.759 ms 2024-03-28T05:56:33.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:56:32 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:56:32.698+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:56:33.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 464 sec latency 571320.950 ms 2024-03-28T05:56:33.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:33 smithi086 ceph-mon[35163]: pgmap v813: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-28T05:56:33.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:33 smithi159 ceph-mon[36109]: pgmap v813: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-28T05:56:33.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:33 smithi055 ceph-mon[31863]: pgmap v813: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-28T05:56:34.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 465 sec latency 572321.080 ms 2024-03-28T05:56:35.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 466 sec latency 573321.211 ms 2024-03-28T05:56:35.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:35 smithi086 ceph-mon[35163]: pgmap v814: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:35.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:35 smithi159 ceph-mon[36109]: pgmap v814: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:35.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:35 smithi055 ceph-mon[31863]: pgmap v814: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:36.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 467 sec latency 574321.353 ms 2024-03-28T05:56:37.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 468 sec latency 575321.489 ms 2024-03-28T05:56:37.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:37 smithi086 ceph-mon[35163]: pgmap v815: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:37.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:37 smithi159 ceph-mon[36109]: pgmap v815: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:37.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:37 smithi055 ceph-mon[31863]: pgmap v815: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:38.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 469 sec latency 576321.632 ms 2024-03-28T05:56:39.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 470 sec latency 577321.773 ms 2024-03-28T05:56:39.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:39 smithi086 ceph-mon[35163]: pgmap v816: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:39 smithi159 ceph-mon[36109]: pgmap v816: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:39 smithi055 ceph-mon[31863]: pgmap v816: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:40.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 471 sec latency 578321.963 ms 2024-03-28T05:56:41.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 472 sec latency 579322.034 ms 2024-03-28T05:56:41.265 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:40 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:56:41.265 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:40 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:41.265 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:40 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 2.067s CPU time. 2024-03-28T05:56:41.265 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:40 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:56:41.572 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:41 smithi055 ceph-mon[31863]: pgmap v817: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:41.573 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 podman[88279]: 2024-03-28 05:56:41.178096677 +0000 UTC m=+0.036598380 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:56:41.573 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 podman[88279]: 2024-03-28 05:56:41.292939072 +0000 UTC m=+0.151440798 container create aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240319) 2024-03-28T05:56:41.573 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 podman[88279]: 2024-03-28 05:56:41.580127166 +0000 UTC m=+0.438628902 container init aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:56:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:41 smithi086 ceph-mon[35163]: pgmap v817: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:41.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:41 smithi159 ceph-mon[36109]: pgmap v817: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:56:41.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 podman[88279]: 2024-03-28 05:56:41.590885735 +0000 UTC m=+0.449387491 container start aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-28T05:56:41.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 ceph-mds[88297]: -- 172.21.15.55:0/1248997695 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c96c07a40 con 0x558c96bda800 2024-03-28T05:56:41.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: starting mds.d at 2024-03-28T05:56:42.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 473 sec latency 580322.162 ms 2024-03-28T05:56:42.365 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 bash[88279]: aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 2024-03-28T05:56:42.365 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:56:41 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:42.482 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: daemon mds.d restarted 2024-03-28T05:56:42.483 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:42.483 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: osdmap e126: 12 total, 12 up, 12 in 2024-03-28T05:56:42.483 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:boot 2024-03-28T05:56:42.483 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:56:42.483 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:42.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:56:42.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:42 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:42.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: daemon mds.d restarted 2024-03-28T05:56:42.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:42.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: osdmap e126: 12 total, 12 up, 12 in 2024-03-28T05:56:42.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:boot 2024-03-28T05:56:42.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:56:42.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:42.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:56:42.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:42 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:42.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: daemon mds.d restarted 2024-03-28T05:56:42.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: osdmap e126: 12 total, 12 up, 12 in 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:boot 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:56:42.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:42 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:43.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 474 sec latency 581322.318 ms 2024-03-28T05:56:44.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:43 smithi086 ceph-mon[35163]: pgmap v819: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:56:44.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:43 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:resolve 2024-03-28T05:56:44.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:43 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:44.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:43 smithi159 ceph-mon[36109]: pgmap v819: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:56:44.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:43 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:resolve 2024-03-28T05:56:44.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:43 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:44.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:43 smithi055 ceph-mon[31863]: pgmap v819: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:56:44.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:43 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:resolve 2024-03-28T05:56:44.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:43 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:44.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 475 sec latency 582322.458 ms 2024-03-28T05:56:45.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 476 sec latency 583322.615 ms 2024-03-28T05:56:45.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:45 smithi086 ceph-mon[35163]: pgmap v820: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:56:45.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:45 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:45.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:45 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:reconnect 2024-03-28T05:56:45.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:45 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:45 smithi159 ceph-mon[36109]: pgmap v820: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:56:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:45 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:45 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:reconnect 2024-03-28T05:56:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:45 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:45.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:45 smithi055 ceph-mon[31863]: pgmap v820: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-28T05:56:45.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:45 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:56:45.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:45 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:reconnect 2024-03-28T05:56:45.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:45 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:46.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 477 sec latency 584322.774 ms 2024-03-28T05:56:46.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:46 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:rejoin 2024-03-28T05:56:46.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:46 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:46.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:46 smithi086 ceph-mon[35163]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:46.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:46 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:rejoin 2024-03-28T05:56:46.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:46 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:46.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:46 smithi159 ceph-mon[36109]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:46.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:rejoin 2024-03-28T05:56:46.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:46.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-mon[31863]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-03-28T05:56:46.866 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0b8b600700 time 2024-03-28T05:56:46.550923+0000 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0b96eef4a1] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.867 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: clone() 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.551+0000 7f0b8b600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0b8b600700 time 2024-03-28T05:56:46.550923+0000 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:46.868 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0b96eef4a1] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.869 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: clone() 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: *** Caught signal (Aborted) ** 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: in thread 7f0b8b600700 thread_name:ms_dispatch 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.870 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0b95c76d20] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: gsignal() 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: abort() 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0b96eef4fb] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.871 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 19: clone() 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.554+0000 7f0b8b600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: in thread 7f0b8b600700 thread_name:ms_dispatch 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.872 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0b95c76d20] 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: gsignal() 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: abort() 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0b96eef4fb] 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.873 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.874 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 19: clone() 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: -1> 2024-03-28T05:56:46.551+0000 7f0b8b600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0b8b600700 time 2024-03-28T05:56:46.550923+0000 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0b96eef4a1] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.875 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: clone() 2024-03-28T05:56:46.876 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 0> 2024-03-28T05:56:46.554+0000 7f0b8b600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: in thread 7f0b8b600700 thread_name:ms_dispatch 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0b95c76d20] 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: gsignal() 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: abort() 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0b96eef4fb] 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.877 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.878 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 19: clone() 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: -1> 2024-03-28T05:56:46.551+0000 7f0b8b600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f0b8b600700 time 2024-03-28T05:56:46.550923+0000 2024-03-28T05:56:46.879 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0b96eef4a1] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.880 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: clone() 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 0> 2024-03-28T05:56:46.554+0000 7f0b8b600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: in thread 7f0b8b600700 thread_name:ms_dispatch 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0b95c76d20] 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2: gsignal() 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 3: abort() 2024-03-28T05:56:46.881 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0b96eef4fb] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f0b96eef667] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558737189223] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5587370035d6] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558737003da1] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55873703809c] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558737056233] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558737058197] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558736f5711b] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558736f576bc] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558736f411ff] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f0b97181488] 2024-03-28T05:56:46.882 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 16: (DispatchQueue::entry()+0x51f) [0x7f0b9717e60f] 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0b97251e81] 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f0b95c6c1ca] 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 19: clone() 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g[88145]: 2024-03-28T05:56:46.883 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:46 smithi055 podman[88333]: 2024-03-28 05:56:46.661331367 +0000 UTC m=+0.037486949 container died a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319) 2024-03-28T05:56:47.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 478 sec latency 585322.943 ms 2024-03-28T05:56:47.615 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:47 smithi055 podman[88333]: 2024-03-28 05:56:47.358761884 +0000 UTC m=+0.734917503 container remove a89e9d065551d34ae565dbb1d161641bb631a32ca98f23637138d5b857009ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-g, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-28T05:56:47.615 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:56:47.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:47 smithi055 ceph-mon[31863]: pgmap v821: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:47.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:47 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:47.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:47 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:active 2024-03-28T05:56:47.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:47 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:47.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:47 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-mon[35163]: pgmap v821: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:active 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:47.810 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:56:47 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:56:47.700+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:56:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:47 smithi159 ceph-mon[36109]: pgmap v821: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-28T05:56:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:47 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:56:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:47 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6838/373679931,v1:172.21.15.55:6839/373679931] up:active 2024-03-28T05:56:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:47 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 2 up:standby-replay 2 up:standby 2024-03-28T05:56:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:47 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby 2024-03-28T05:56:48.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 479 sec latency 586323.029 ms 2024-03-28T05:56:48.365 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:56:48.365 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.664s CPU time. 2024-03-28T05:56:49.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 480 sec latency 587323.111 ms 2024-03-28T05:56:49.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:49 smithi086 ceph-mon[35163]: pgmap v822: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:56:49.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:56:49.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:49 smithi159 ceph-mon[36109]: pgmap v822: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:56:49.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:56:49.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:49 smithi055 ceph-mon[31863]: pgmap v822: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:56:49.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:56:50.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 481 sec latency 588323.204 ms 2024-03-28T05:56:50.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:56:50.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:56:50.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:56:50.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:56:50.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:56:50.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:56:50.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:56:50.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:56:50.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:56:51.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 482 sec latency 589323.350 ms 2024-03-28T05:56:51.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:51 smithi086 ceph-mon[35163]: pgmap v823: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:56:51.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:51 smithi086 ceph-mon[35163]: pgmap v824: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:56:51.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:51 smithi159 ceph-mon[36109]: pgmap v823: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:56:51.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:51 smithi159 ceph-mon[36109]: pgmap v824: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:56:51.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:51 smithi055 ceph-mon[31863]: pgmap v823: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:56:51.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:51 smithi055 ceph-mon[31863]: pgmap v824: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-03-28T05:56:52.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 483 sec latency 590323.497 ms 2024-03-28T05:56:53.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 484 sec latency 591323.653 ms 2024-03-28T05:56:53.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:53 smithi086 ceph-mon[35163]: pgmap v825: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:53 smithi159 ceph-mon[36109]: pgmap v825: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:53 smithi055 ceph-mon[31863]: pgmap v825: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:54.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 485 sec latency 592323.757 ms 2024-03-28T05:56:55.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 486 sec latency 593323.902 ms 2024-03-28T05:56:55.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:55 smithi086 ceph-mon[35163]: pgmap v826: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:55.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:55 smithi159 ceph-mon[36109]: pgmap v826: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:55.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:55 smithi055 ceph-mon[31863]: pgmap v826: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:56:56.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 487 sec latency 594324.062 ms 2024-03-28T05:56:57.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 488 sec latency 595324.201 ms 2024-03-28T05:56:57.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:57 smithi086 ceph-mon[35163]: pgmap v827: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:57.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:57 smithi159 ceph-mon[36109]: pgmap v827: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:57.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:57 smithi055 ceph-mon[31863]: pgmap v827: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:56:58.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 489 sec latency 596324.335 ms 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Scheduled restart job, restart counter is at 6. 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: Stopped Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Consumed 1.664s CPU time. 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Start request repeated too quickly. 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.g.service: Failed with result 'exit-code'. 2024-03-28T05:56:58.616 INFO:journalctl@ceph.mds.g.smithi055.stdout:Mar 28 05:56:58 smithi055 systemd[1]: Failed to start Ceph mds.g for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:56:59.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 490 sec latency 597324.425 ms 2024-03-28T05:56:59.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:56:59 smithi055 ceph-mon[31863]: pgmap v828: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 B/s wr, 9 op/s 2024-03-28T05:57:00.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:56:59 smithi086 ceph-mon[35163]: pgmap v828: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 B/s wr, 9 op/s 2024-03-28T05:57:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:56:59 smithi159 ceph-mon[36109]: pgmap v828: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 104 B/s wr, 9 op/s 2024-03-28T05:57:00.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 491 sec latency 598324.564 ms 2024-03-28T05:57:01.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 492 sec latency 599324.717 ms 2024-03-28T05:57:01.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:01 smithi055 ceph-mon[31863]: pgmap v829: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7 op/s 2024-03-28T05:57:02.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:01 smithi086 ceph-mon[35163]: pgmap v829: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7 op/s 2024-03-28T05:57:02.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:01 smithi159 ceph-mon[36109]: pgmap v829: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7 op/s 2024-03-28T05:57:02.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 493 sec latency 600324.864 ms 2024-03-28T05:57:03.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 494 sec latency 601325.023 ms 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: pgmap v830: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: Replacing daemon mds.g as rank 1 with standby daemon mds.d 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: osdmap e127: 12 total, 12 up, 12 in 2024-03-28T05:57:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:03 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: pgmap v830: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: Replacing daemon mds.g as rank 1 with standby daemon mds.d 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: osdmap e127: 12 total, 12 up, 12 in 2024-03-28T05:57:03.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:03 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:04.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: pgmap v830: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-03-28T05:57:04.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: Replacing daemon mds.g as rank 1 with standby daemon mds.d 2024-03-28T05:57:04.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: MDS daemon mds.g is removed because it is dead or otherwise unavailable. 2024-03-28T05:57:04.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:04.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: osdmap e127: 12 total, 12 up, 12 in 2024-03-28T05:57:04.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:03 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:04.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 495 sec latency 602325.166 ms 2024-03-28T05:57:05.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 496 sec latency 603325.262 ms 2024-03-28T05:57:05.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:05 smithi055 ceph-mon[31863]: pgmap v832: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:05.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:05 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:resolve 2024-03-28T05:57:05.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:05 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:06.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:05 smithi086 ceph-mon[35163]: pgmap v832: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:06.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:05 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:resolve 2024-03-28T05:57:06.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:05 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:06.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:05 smithi159 ceph-mon[36109]: pgmap v832: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:06.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:05 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:resolve 2024-03-28T05:57:06.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:05 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:06.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 497 sec latency 604325.421 ms 2024-03-28T05:57:06.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:06 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:06.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:06 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:reconnect 2024-03-28T05:57:06.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:06 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:07.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:06 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:07.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:06 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:reconnect 2024-03-28T05:57:07.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:06 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:07.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:06 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:07.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:06 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:reconnect 2024-03-28T05:57:07.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:06 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:07.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 498 sec latency 605325.565 ms 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:57:07.701+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-mon[35163]: pgmap v833: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:rejoin 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:07 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:08.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:07 smithi159 ceph-mon[36109]: pgmap v833: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:57:08.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:07 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:rejoin 2024-03-28T05:57:08.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:07 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:08.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:07 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:08.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:07 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-mon[31863]: pgmap v833: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:57:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:rejoin 2024-03-28T05:57:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7faf8da00700 time 2024-03-28T05:57:07.657697+0000 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7faf9938a4a1] 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: clone() 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:07.659+0000 7faf8da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7faf8da00700 time 2024-03-28T05:57:07.657697+0000 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7faf9938a4a1] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: clone() 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: *** Caught signal (Aborted) ** 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: in thread 7faf8da00700 thread_name:ms_dispatch 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faf98111d20] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: gsignal() 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: abort() 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7faf9938a4fb] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 19: clone() 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:07.661+0000 7faf8da00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: in thread 7faf8da00700 thread_name:ms_dispatch 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faf98111d20] 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: gsignal() 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: abort() 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7faf9938a4fb] 2024-03-28T05:57:08.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 19: clone() 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: -1> 2024-03-28T05:57:07.659+0000 7faf8da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7faf8da00700 time 2024-03-28T05:57:07.657697+0000 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7faf9938a4a1] 2024-03-28T05:57:08.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: clone() 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 0> 2024-03-28T05:57:07.661+0000 7faf8da00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: in thread 7faf8da00700 thread_name:ms_dispatch 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faf98111d20] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: gsignal() 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: abort() 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7faf9938a4fb] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 19: clone() 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: -1> 2024-03-28T05:57:07.659+0000 7faf8da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7faf8da00700 time 2024-03-28T05:57:07.657697+0000 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7faf9938a4a1] 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: clone() 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 0> 2024-03-28T05:57:07.661+0000 7faf8da00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:08.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: in thread 7faf8da00700 thread_name:ms_dispatch 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7faf98111d20] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2: gsignal() 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 3: abort() 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7faf9938a4fb] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7faf9938a667] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x558c9488c223] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x558c947065d6] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x558c94706da1] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x558c9473b09c] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x558c94759233] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558c9475b197] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558c9465a11b] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558c9465a6bc] 2024-03-28T05:57:08.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x558c946441ff] 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7faf9961c488] 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 16: (DispatchQueue::entry()+0x51f) [0x7faf9961960f] 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7faf996ece81] 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7faf981071ca] 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 19: clone() 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88293]: 2024-03-28T05:57:08.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:07 smithi055 podman[88519]: 2024-03-28 05:57:07.767376533 +0000 UTC m=+0.032331221 container died aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319) 2024-03-28T05:57:08.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 499 sec latency 606325.694 ms 2024-03-28T05:57:09.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:08 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:active 2024-03-28T05:57:09.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:08 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:09.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:08 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:09.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:08 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:active 2024-03-28T05:57:09.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:08 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:09.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:08 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:09.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:08 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3187967134,v1:172.21.15.55:6837/3187967134] up:active 2024-03-28T05:57:09.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:08 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:09.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:08 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:09.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:08 smithi055 podman[88519]: 2024-03-28 05:57:08.622509765 +0000 UTC m=+0.887464507 container remove aaf214e4d6704be2f433b80f6674b7fca8836c35ec6d55f6695c70fcb99ced32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-28T05:57:09.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:08 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:57:09.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 500 sec latency 607325.839 ms 2024-03-28T05:57:09.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:09 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:57:09.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:09 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.631s CPU time. 2024-03-28T05:57:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:09 smithi086 ceph-mon[35163]: pgmap v834: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:57:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:09 smithi159 ceph-mon[36109]: pgmap v834: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:57:10.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:09 smithi055 ceph-mon[31863]: pgmap v834: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-28T05:57:10.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 501 sec latency 608325.930 ms 2024-03-28T05:57:11.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 502 sec latency 609326.015 ms 2024-03-28T05:57:12.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:11 smithi086 ceph-mon[35163]: pgmap v835: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:12.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:11 smithi159 ceph-mon[36109]: pgmap v835: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:12.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:11 smithi055 ceph-mon[31863]: pgmap v835: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:12.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 503 sec latency 610326.108 ms 2024-03-28T05:57:13.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 504 sec latency 611326.263 ms 2024-03-28T05:57:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:13 smithi086 ceph-mon[35163]: pgmap v836: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:14.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:13 smithi159 ceph-mon[36109]: pgmap v836: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:14.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:13 smithi055 ceph-mon[31863]: pgmap v836: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:14.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 505 sec latency 612326.420 ms 2024-03-28T05:57:15.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 506 sec latency 613326.561 ms 2024-03-28T05:57:15.917 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:15 smithi055 ceph-mon[31863]: pgmap v837: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:57:16.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:15 smithi086 ceph-mon[35163]: pgmap v837: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:57:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:15 smithi159 ceph-mon[36109]: pgmap v837: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:57:16.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 507 sec latency 614326.698 ms 2024-03-28T05:57:17.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 508 sec latency 615326.831 ms 2024-03-28T05:57:18.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:17 smithi086 ceph-mon[35163]: pgmap v838: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:18.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:17 smithi159 ceph-mon[36109]: pgmap v838: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:18.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:17 smithi055 ceph-mon[31863]: pgmap v838: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:18.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 509 sec latency 616326.926 ms 2024-03-28T05:57:19.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 510 sec latency 617327.079 ms 2024-03-28T05:57:19.680 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:57:19.681 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:19.681 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.631s CPU time. 2024-03-28T05:57:19.681 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:57:19.958 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:19 smithi055 ceph-mon[31863]: pgmap v839: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:19.959 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 podman[88620]: 2024-03-28 05:57:19.695679437 +0000 UTC m=+0.035392549 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:57:19.959 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:19 smithi055 podman[88620]: 2024-03-28 05:57:19.791020547 +0000 UTC m=+0.130733701 container create d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0) 2024-03-28T05:57:20.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:19 smithi086 ceph-mon[35163]: pgmap v839: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:20.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:19 smithi159 ceph-mon[36109]: pgmap v839: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:20.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 511 sec latency 618327.164 ms 2024-03-28T05:57:20.365 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 podman[88620]: 2024-03-28 05:57:20.069911594 +0000 UTC m=+0.409624750 container init d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD) 2024-03-28T05:57:20.365 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 podman[88620]: 2024-03-28 05:57:20.080558158 +0000 UTC m=+0.420271313 container start d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, ceph=True) 2024-03-28T05:57:20.365 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mds[88639]: -- 172.21.15.55:0/2516284836 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56360826ba40 con 0x56360823e800 2024-03-28T05:57:20.366 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: starting mds.d at 2024-03-28T05:57:20.366 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 bash[88620]: d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 2024-03-28T05:57:20.366 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:20 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:21.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: daemon mds.d restarted 2024-03-28T05:57:21.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: osdmap e128: 12 total, 12 up, 12 in 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:boot 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:21.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:20 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: daemon mds.d restarted 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: osdmap e128: 12 total, 12 up, 12 in 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:boot 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:21.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:21.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:21.063 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:20 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:21.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: daemon mds.d restarted 2024-03-28T05:57:21.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:21.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: osdmap e128: 12 total, 12 up, 12 in 2024-03-28T05:57:21.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:boot 2024-03-28T05:57:21.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:21.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:21.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:21.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:20 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:21.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 512 sec latency 619327.293 ms 2024-03-28T05:57:22.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:21 smithi086 ceph-mon[35163]: pgmap v840: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:57:22.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:21 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:resolve 2024-03-28T05:57:22.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:21 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:22.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:21 smithi159 ceph-mon[36109]: pgmap v840: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:57:22.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:21 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:resolve 2024-03-28T05:57:22.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:21 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:22.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:21 smithi055 ceph-mon[31863]: pgmap v840: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 85 B/s wr, 10 op/s 2024-03-28T05:57:22.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:21 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:resolve 2024-03-28T05:57:22.116 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:21 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:22.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 513 sec latency 620327.436 ms 2024-03-28T05:57:23.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 514 sec latency 621327.561 ms 2024-03-28T05:57:23.474 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-mon[31863]: pgmap v842: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:57:23.474 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:23.474 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:reconnect 2024-03-28T05:57:23.474 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:23.475 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8970200700 time 2024-03-28T05:57:23.335872+0000 2024-03-28T05:57:23.475 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f897ba034a1] 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.476 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.477 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: clone() 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.337+0000 7f8970200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8970200700 time 2024-03-28T05:57:23.335872+0000 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f897ba034a1] 2024-03-28T05:57:23.478 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.479 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: clone() 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: *** Caught signal (Aborted) ** 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: in thread 7f8970200700 thread_name:ms_dispatch 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f897a78ad20] 2024-03-28T05:57:23.480 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: gsignal() 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: abort() 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f897ba034fb] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.481 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 19: clone() 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.342+0000 7f8970200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:23.482 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: in thread 7f8970200700 thread_name:ms_dispatch 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f897a78ad20] 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: gsignal() 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: abort() 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f897ba034fb] 2024-03-28T05:57:23.483 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.485 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 19: clone() 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.486 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: -1> 2024-03-28T05:57:23.337+0000 7f8970200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8970200700 time 2024-03-28T05:57:23.335872+0000 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f897ba034a1] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.487 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: clone() 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.488 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 0> 2024-03-28T05:57:23.342+0000 7f8970200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: in thread 7f8970200700 thread_name:ms_dispatch 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f897a78ad20] 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: gsignal() 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: abort() 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f897ba034fb] 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.489 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.490 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 19: clone() 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: -1> 2024-03-28T05:57:23.337+0000 7f8970200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8970200700 time 2024-03-28T05:57:23.335872+0000 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f897ba034a1] 2024-03-28T05:57:23.491 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.492 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: clone() 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 0> 2024-03-28T05:57:23.342+0000 7f8970200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: in thread 7f8970200700 thread_name:ms_dispatch 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f897a78ad20] 2024-03-28T05:57:23.493 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2: gsignal() 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 3: abort() 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f897ba034fb] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f897ba03667] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560a05b53223] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560a059cd5d6] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560a059cdda1] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560a05a0209c] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560a05a20233] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a05a22197] 2024-03-28T05:57:23.494 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a0592111b] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a059216bc] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560a0590b1ff] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f897bc95488] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 16: (DispatchQueue::entry()+0x51f) [0x7f897bc9260f] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f897bd65e81] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f897a7801ca] 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 19: clone() 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[70492]: 2024-03-28T05:57:23.495 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:23 smithi055 podman[88675]: 2024-03-28 05:57:23.482413937 +0000 UTC m=+0.036512697 container died 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, ceph=True) 2024-03-28T05:57:23.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:23 smithi086 ceph-mon[35163]: pgmap v842: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:57:23.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:23 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:23.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:23 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:reconnect 2024-03-28T05:57:23.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:23 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:23.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:23 smithi159 ceph-mon[36109]: pgmap v842: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:57:23.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:23 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:23.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:23 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:reconnect 2024-03-28T05:57:23.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:23 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:24.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 515 sec latency 622327.685 ms 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:rejoin 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:active 2024-03-28T05:57:24.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:24 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:rejoin 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:active 2024-03-28T05:57:24.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:24 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:rejoin 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/204524138,v1:172.21.15.55:6835/204524138] up:active 2024-03-28T05:57:24.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:24 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:24.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:24 smithi055 podman[88675]: 2024-03-28 05:57:24.381709014 +0000 UTC m=+0.935807807 container remove 686e2d0e0ae400e83329414b03cde5fa0e366d3da9c241c0dc5af47932c51208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:57:24.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:24 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:57:25.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 516 sec latency 623327.821 ms 2024-03-28T05:57:25.294 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:24 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T05:57:25.294 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:24 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 2.166s CPU time. 2024-03-28T05:57:25.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:25 smithi086 ceph-mon[35163]: pgmap v843: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:57:25.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:25 smithi159 ceph-mon[36109]: pgmap v843: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:57:25.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:25 smithi055 ceph-mon[31863]: pgmap v843: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:57:26.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 517 sec latency 624327.958 ms 2024-03-28T05:57:27.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 518 sec latency 625328.094 ms 2024-03-28T05:57:27.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:27 smithi086 ceph-mon[35163]: pgmap v844: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:57:27.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:27 smithi159 ceph-mon[36109]: pgmap v844: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:57:27.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:27 smithi055 ceph-mon[31863]: pgmap v844: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 102 B/s wr, 9 op/s 2024-03-28T05:57:28.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 519 sec latency 626328.241 ms 2024-03-28T05:57:29.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 520 sec latency 627328.400 ms 2024-03-28T05:57:29.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:29 smithi086 ceph-mon[35163]: pgmap v845: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:29.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:29 smithi159 ceph-mon[36109]: pgmap v845: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:29.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:29 smithi055 ceph-mon[31863]: pgmap v845: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:30.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 521 sec latency 628328.531 ms 2024-03-28T05:57:31.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 522 sec latency 629328.687 ms 2024-03-28T05:57:31.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:31 smithi055 ceph-mon[31863]: pgmap v846: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:57:31.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:31 smithi086 ceph-mon[35163]: pgmap v846: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:57:31.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:31 smithi159 ceph-mon[36109]: pgmap v846: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:57:32.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 523 sec latency 630328.841 ms 2024-03-28T05:57:33.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 524 sec latency 631329.007 ms 2024-03-28T05:57:33.614 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:33 smithi159 ceph-mon[36109]: pgmap v847: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:33.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:33 smithi055 ceph-mon[31863]: pgmap v847: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:33.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:33 smithi086 ceph-mon[35163]: pgmap v847: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:34.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 525 sec latency 632329.110 ms 2024-03-28T05:57:35.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 526 sec latency 633329.209 ms 2024-03-28T05:57:35.532 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:35 smithi055 ceph-mon[31863]: pgmap v848: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:57:35.532 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 1. 2024-03-28T05:57:35.532 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:35.533 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 2.166s CPU time. 2024-03-28T05:57:35.533 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:57:35.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:35 smithi086 ceph-mon[35163]: pgmap v848: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:57:35.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:35 smithi159 ceph-mon[36109]: pgmap v848: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:57:35.820 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 podman[88769]: 2024-03-28 05:57:35.446539033 +0000 UTC m=+0.039194247 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:57:35.820 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 podman[88769]: 2024-03-28 05:57:35.566468084 +0000 UTC m=+0.159123335 container create 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c) 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 podman[88769]: 2024-03-28 05:57:35.82826859 +0000 UTC m=+0.420923847 container init 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 podman[88769]: 2024-03-28 05:57:35.838572986 +0000 UTC m=+0.431228208 container start 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5) 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 ceph-mds[88788]: -- 172.21.15.55:0/1278171806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3e186ba40 con 0x55b3e183f000 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: starting mds.j at 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 bash[88769]: 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea 2024-03-28T05:57:36.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:35 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:36.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 527 sec latency 634329.334 ms 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: daemon mds.j restarted 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: osdmap e129: 12 total, 12 up, 12 in 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:boot 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:57:36.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:36.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:57:36.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:36 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:36.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: daemon mds.j restarted 2024-03-28T05:57:36.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:36.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: osdmap e129: 12 total, 12 up, 12 in 2024-03-28T05:57:36.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:boot 2024-03-28T05:57:36.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:57:36.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:36.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:57:36.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:36 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:36.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: daemon mds.j restarted 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: osdmap e129: 12 total, 12 up, 12 in 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:boot 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:57:36.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:36 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:37.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 528 sec latency 635329.490 ms 2024-03-28T05:57:37.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:37 smithi055 ceph-mon[31863]: pgmap v850: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:57:37.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:37 smithi086 ceph-mon[35163]: pgmap v850: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:57:37.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:37 smithi159 ceph-mon[36109]: pgmap v850: 97 pgs: 97 active+clean; 22 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-28T05:57:38.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 529 sec latency 636329.628 ms 2024-03-28T05:57:38.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:38 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:resolve 2024-03-28T05:57:38.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:38 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:38.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:38 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:resolve 2024-03-28T05:57:38.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:38 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:38.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:38 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:resolve 2024-03-28T05:57:38.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:38 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:39.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 530 sec latency 637329.763 ms 2024-03-28T05:57:39.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:39 smithi086 ceph-mon[35163]: pgmap v851: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:57:39.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:39 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:39.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:39 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:reconnect 2024-03-28T05:57:39.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:39 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:39.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:39 smithi159 ceph-mon[36109]: pgmap v851: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:57:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:39 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:39 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:reconnect 2024-03-28T05:57:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:39 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:39 smithi055 ceph-mon[31863]: pgmap v851: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:57:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:39 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:57:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:39 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:reconnect 2024-03-28T05:57:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:39 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:40.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 531 sec latency 638329.966 ms 2024-03-28T05:57:40.488 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:rejoin 2024-03-28T05:57:40.488 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:40.488 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:40.488 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f58ab600700 time 2024-03-28T05:57:40.443415+0000 2024-03-28T05:57:40.488 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f58b6fd54a1] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.489 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.490 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: clone() 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.444+0000 7f58ab600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f58ab600700 time 2024-03-28T05:57:40.443415+0000 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f58b6fd54a1] 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.491 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.492 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: clone() 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: *** Caught signal (Aborted) ** 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: in thread 7f58ab600700 thread_name:ms_dispatch 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f58b5d5cd20] 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: gsignal() 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: abort() 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f58b6fd54fb] 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.493 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 19: clone() 2024-03-28T05:57:40.494 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.447+0000 7f58ab600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: in thread 7f58ab600700 thread_name:ms_dispatch 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f58b5d5cd20] 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: gsignal() 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: abort() 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f58b6fd54fb] 2024-03-28T05:57:40.495 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.496 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.496 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.496 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.496 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 19: clone() 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.497 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: -1> 2024-03-28T05:57:40.444+0000 7f58ab600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f58ab600700 time 2024-03-28T05:57:40.443415+0000 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f58b6fd54a1] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.498 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: clone() 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 0> 2024-03-28T05:57:40.447+0000 7f58ab600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: in thread 7f58ab600700 thread_name:ms_dispatch 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f58b5d5cd20] 2024-03-28T05:57:40.499 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: gsignal() 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: abort() 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f58b6fd54fb] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.500 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 19: clone() 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: -1> 2024-03-28T05:57:40.444+0000 7f58ab600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f58ab600700 time 2024-03-28T05:57:40.443415+0000 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f58b6fd54a1] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.501 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: clone() 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.502 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 0> 2024-03-28T05:57:40.447+0000 7f58ab600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: in thread 7f58ab600700 thread_name:ms_dispatch 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f58b5d5cd20] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2: gsignal() 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 3: abort() 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f58b6fd54fb] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f58b6fd5667] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x563605649223] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5636054c35d6] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5636054c3da1] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5636054f809c] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x563605516233] 2024-03-28T05:57:40.503 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563605518197] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56360541711b] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5636054176bc] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5636054011ff] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f58b7267488] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 16: (DispatchQueue::entry()+0x51f) [0x7f58b726460f] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f58b7337e81] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58b5d521ca] 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 19: clone() 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:40.504 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[88635]: 2024-03-28T05:57:40.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:40 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:rejoin 2024-03-28T05:57:40.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:40 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:40.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:40 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:40.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:40 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:rejoin 2024-03-28T05:57:40.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:40 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:40.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:40 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:57:40.844 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:40 smithi055 podman[88824]: 2024-03-28 05:57:40.55167595 +0000 UTC m=+0.034425020 container died d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:57:41.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 532 sec latency 639330.126 ms 2024-03-28T05:57:41.397 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:41 smithi055 podman[88824]: 2024-03-28 05:57:41.273398506 +0000 UTC m=+0.756147601 container remove d1ff940ab808e15cfb03355ed20a0a2edd4d23b2ad854053a9451febcb61e1a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-28T05:57:41.397 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:41 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:57:41.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:41 smithi055 ceph-mon[31863]: pgmap v852: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:57:41.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:41 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:41.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:active 2024-03-28T05:57:41.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:41 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:41.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:41 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:41.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:41 smithi086 ceph-mon[35163]: pgmap v852: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:57:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:41 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:active 2024-03-28T05:57:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:41 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:41 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:41.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:41 smithi159 ceph-mon[36109]: pgmap v852: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-03-28T05:57:41.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:41 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:41.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/1908001929,v1:172.21.15.55:6837/1908001929] up:active 2024-03-28T05:57:41.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:41 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:41.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:41 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:42.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:41 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:57:42.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:41 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.622s CPU time. 2024-03-28T05:57:42.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 533 sec latency 640330.283 ms 2024-03-28T05:57:43.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:57:42 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:57:42.704+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:57:43.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 534 sec latency 641330.442 ms 2024-03-28T05:57:43.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:43 smithi086 ceph-mon[35163]: pgmap v853: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9 op/s 2024-03-28T05:57:43.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:43 smithi159 ceph-mon[36109]: pgmap v853: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9 op/s 2024-03-28T05:57:43.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:43 smithi055 ceph-mon[31863]: pgmap v853: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9 op/s 2024-03-28T05:57:44.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 535 sec latency 642330.582 ms 2024-03-28T05:57:45.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 536 sec latency 643330.673 ms 2024-03-28T05:57:45.668 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:45 smithi055 ceph-mon[31863]: pgmap v854: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:45.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:45 smithi086 ceph-mon[35163]: pgmap v854: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:45.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:45 smithi159 ceph-mon[36109]: pgmap v854: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:57:46.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 537 sec latency 644330.831 ms 2024-03-28T05:57:47.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 538 sec latency 645330.984 ms 2024-03-28T05:57:47.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:47 smithi086 ceph-mon[35163]: pgmap v855: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:47.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:47 smithi159 ceph-mon[36109]: pgmap v855: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:47.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:47 smithi055 ceph-mon[31863]: pgmap v855: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:57:48.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 539 sec latency 646331.086 ms 2024-03-28T05:57:49.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 540 sec latency 647331.244 ms 2024-03-28T05:57:49.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:49 smithi086 ceph-mon[35163]: pgmap v856: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:49.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:49 smithi159 ceph-mon[36109]: pgmap v856: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:49.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:49 smithi055 ceph-mon[31863]: pgmap v856: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:50.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 541 sec latency 648331.365 ms 2024-03-28T05:57:51.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 542 sec latency 649331.491 ms 2024-03-28T05:57:51.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:51 smithi086 ceph-mon[35163]: pgmap v857: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:57:51.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:57:51.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:51 smithi159 ceph-mon[36109]: pgmap v857: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:57:51.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:57:51.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:51 smithi055 ceph-mon[31863]: pgmap v857: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:57:51.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:57:52.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 543 sec latency 650331.611 ms 2024-03-28T05:57:52.249 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:51 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:57:52.249 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:51 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:52.249 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:51 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.622s CPU time. 2024-03-28T05:57:52.249 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:51 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:57:52.587 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:57:52.587 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:57:52.587 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mon[31863]: pgmap v858: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:52.587 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mon[31863]: pgmap v859: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:52.587 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:57:52.588 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 podman[89049]: 2024-03-28 05:57:52.16229397 +0000 UTC m=+0.035024275 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:57:52.588 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 podman[89049]: 2024-03-28 05:57:52.257469213 +0000 UTC m=+0.130199549 container create 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-28T05:57:52.588 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 podman[89049]: 2024-03-28 05:57:52.595176043 +0000 UTC m=+0.467906391 container init 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-03-28T05:57:52.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:57:52.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:57:52.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:52 smithi086 ceph-mon[35163]: pgmap v858: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:52.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:52 smithi086 ceph-mon[35163]: pgmap v859: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:52.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:57:52.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:57:52.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:57:52.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:52 smithi159 ceph-mon[36109]: pgmap v858: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:57:52.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:52 smithi159 ceph-mon[36109]: pgmap v859: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-03-28T05:57:52.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:57:52.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 podman[89049]: 2024-03-28 05:57:52.605561862 +0000 UTC m=+0.478292177 container start 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-28T05:57:52.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-mds[89068]: -- 172.21.15.55:0/3848097532 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564bf636fa40 con 0x564bf6342800 2024-03-28T05:57:52.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: starting mds.d at 2024-03-28T05:57:52.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 bash[89049]: 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 2024-03-28T05:57:52.865 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:57:52 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:57:53.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 544 sec latency 651331.764 ms 2024-03-28T05:57:53.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: daemon mds.d restarted 2024-03-28T05:57:53.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: osdmap e130: 12 total, 12 up, 12 in 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:boot 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:53 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: daemon mds.d restarted 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: osdmap e130: 12 total, 12 up, 12 in 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:boot 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:53.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:53 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: daemon mds.d restarted 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: osdmap e130: 12 total, 12 up, 12 in 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:boot 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:57:53.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:53 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:54.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 545 sec latency 652331.989 ms 2024-03-28T05:57:54.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:54 smithi086 ceph-mon[35163]: pgmap v861: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-28T05:57:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:54 smithi159 ceph-mon[36109]: pgmap v861: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-28T05:57:54.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:54 smithi055 ceph-mon[31863]: pgmap v861: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-28T05:57:55.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 546 sec latency 653332.120 ms 2024-03-28T05:57:55.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:55 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:resolve 2024-03-28T05:57:55.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:55 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:55.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:55 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:resolve 2024-03-28T05:57:55.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:55 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:55.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:55 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:resolve 2024-03-28T05:57:55.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:55 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 547 sec latency 654332.245 ms 2024-03-28T05:57:56.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:57:56.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:reconnect 2024-03-28T05:57:56.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: pgmap v862: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:56.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:rejoin 2024-03-28T05:57:56.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:56 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:57:56.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:reconnect 2024-03-28T05:57:56.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: pgmap v862: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:56.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:rejoin 2024-03-28T05:57:56.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:56 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:57:56.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:reconnect 2024-03-28T05:57:56.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:56.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: pgmap v862: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-03-28T05:57:56.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:rejoin 2024-03-28T05:57:56.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:56 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:57.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 548 sec latency 655332.401 ms 2024-03-28T05:57:57.809 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:57:57 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:57:57.704+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:57:57.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:57 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:57.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:57 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:57.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:57 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:57.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:57 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:57.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:57:57.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fa5d4a00700 time 2024-03-28T05:57:57.531793+0000 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa5e03c64a1] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: clone() 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.532+0000 7fa5d4a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fa5d4a00700 time 2024-03-28T05:57:57.531793+0000 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa5e03c64a1] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: clone() 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: *** Caught signal (Aborted) ** 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: in thread 7fa5d4a00700 thread_name:ms_dispatch 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa5df14dd20] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: gsignal() 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: abort() 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa5e03c64fb] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 19: clone() 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.534+0000 7fa5d4a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: in thread 7fa5d4a00700 thread_name:ms_dispatch 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa5df14dd20] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: gsignal() 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: abort() 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa5e03c64fb] 2024-03-28T05:57:57.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 19: clone() 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: -1> 2024-03-28T05:57:57.532+0000 7fa5d4a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fa5d4a00700 time 2024-03-28T05:57:57.531793+0000 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa5e03c64a1] 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: clone() 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 0> 2024-03-28T05:57:57.534+0000 7fa5d4a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:57.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: in thread 7fa5d4a00700 thread_name:ms_dispatch 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa5df14dd20] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: gsignal() 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: abort() 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa5e03c64fb] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 19: clone() 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: -1> 2024-03-28T05:57:57.532+0000 7fa5d4a00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fa5d4a00700 time 2024-03-28T05:57:57.531793+0000 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:57:57.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa5e03c64a1] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: clone() 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 0> 2024-03-28T05:57:57.534+0000 7fa5d4a00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: in thread 7fa5d4a00700 thread_name:ms_dispatch 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa5df14dd20] 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2: gsignal() 2024-03-28T05:57:57.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 3: abort() 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa5e03c64fb] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fa5e03c6667] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b3df2ef223] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b3df1695d6] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b3df169da1] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b3df19e09c] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b3df1bc233] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3df1be197] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3df0bd11b] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3df0bd6bc] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b3df0a71ff] 2024-03-28T05:57:57.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fa5e0658488] 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 16: (DispatchQueue::entry()+0x51f) [0x7fa5e065560f] 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa5e0728e81] 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa5df1431ca] 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 19: clone() 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[88784]: 2024-03-28T05:57:57.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:57 smithi055 podman[89104]: 2024-03-28 05:57:57.649691909 +0000 UTC m=+0.041167283 container died 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:57:58.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 549 sec latency 656332.523 ms 2024-03-28T05:57:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:active 2024-03-28T05:57:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:58 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:58 smithi055 ceph-mon[31863]: pgmap v863: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-28T05:57:58.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:58 smithi055 podman[89104]: 2024-03-28 05:57:58.281434189 +0000 UTC m=+0.672909579 container remove 650cc25313a7389f824db71ba3c838da76e0130d20793849f6f7ada88ef560ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-28T05:57:58.615 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:57:58.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:active 2024-03-28T05:57:58.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:58.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:58 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:58.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:58 smithi086 ceph-mon[35163]: pgmap v863: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-28T05:57:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2204223481,v1:172.21.15.55:6835/2204223481] up:active 2024-03-28T05:57:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:57:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:58 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:57:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:58 smithi159 ceph-mon[36109]: pgmap v863: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-28T05:57:59.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T05:57:59.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:57:58 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.625s CPU time. 2024-03-28T05:57:59.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 550 sec latency 657332.682 ms 2024-03-28T05:58:00.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 551 sec latency 658332.839 ms 2024-03-28T05:58:00.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:57:59 smithi086 ceph-mon[35163]: pgmap v864: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:58:00.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:57:59 smithi159 ceph-mon[36109]: pgmap v864: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:58:00.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:57:59 smithi055 ceph-mon[31863]: pgmap v864: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-28T05:58:01.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 552 sec latency 659332.991 ms 2024-03-28T05:58:02.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 553 sec latency 660333.149 ms 2024-03-28T05:58:02.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:01 smithi086 ceph-mon[35163]: pgmap v865: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:02.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:01 smithi159 ceph-mon[36109]: pgmap v865: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:02.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:01 smithi055 ceph-mon[31863]: pgmap v865: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:03.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 554 sec latency 661333.280 ms 2024-03-28T05:58:04.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 555 sec latency 662333.441 ms 2024-03-28T05:58:04.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:03 smithi086 ceph-mon[35163]: pgmap v866: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:58:04.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:03 smithi159 ceph-mon[36109]: pgmap v866: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:58:04.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:03 smithi055 ceph-mon[31863]: pgmap v866: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:58:05.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 556 sec latency 663333.570 ms 2024-03-28T05:58:06.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 557 sec latency 664333.731 ms 2024-03-28T05:58:06.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:05 smithi086 ceph-mon[35163]: pgmap v867: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:06.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:05 smithi159 ceph-mon[36109]: pgmap v867: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:06.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:05 smithi055 ceph-mon[31863]: pgmap v867: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:07.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 558 sec latency 665333.888 ms 2024-03-28T05:58:08.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 559 sec latency 666334.048 ms 2024-03-28T05:58:08.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:07 smithi086 ceph-mon[35163]: pgmap v868: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:08.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:07 smithi159 ceph-mon[36109]: pgmap v868: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:08.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:07 smithi055 ceph-mon[31863]: pgmap v868: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:09.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 560 sec latency 667334.129 ms 2024-03-28T05:58:09.269 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:08 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 2. 2024-03-28T05:58:09.269 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:08 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:09.269 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:08 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.625s CPU time. 2024-03-28T05:58:09.269 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:08 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:58:09.552 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 podman[89197]: 2024-03-28 05:58:09.186563901 +0000 UTC m=+0.041815008 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:58:09.553 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 podman[89197]: 2024-03-28 05:58:09.299121134 +0000 UTC m=+0.154372275 container create ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-28T05:58:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: daemon mds.j restarted 2024-03-28T05:58:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: osdmap e131: 12 total, 12 up, 12 in 2024-03-28T05:58:09.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:boot 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 podman[89197]: 2024-03-28 05:58:09.560982406 +0000 UTC m=+0.416233550 container init ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 podman[89197]: 2024-03-28 05:58:09.571548031 +0000 UTC m=+0.426799175 container start ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-28T05:58:09.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mds[89215]: -- 172.21.15.55:0/1258347122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b21cbe64e0 con 0x55b21cbbd000 2024-03-28T05:58:09.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-mds[89215]: -- 172.21.15.55:0/1258347122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b21cbe9a40 con 0x55b21cbbd000 2024-03-28T05:58:09.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: starting mds.j at 2024-03-28T05:58:09.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 bash[89197]: ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 2024-03-28T05:58:09.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:09 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: daemon mds.j restarted 2024-03-28T05:58:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: osdmap e131: 12 total, 12 up, 12 in 2024-03-28T05:58:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:boot 2024-03-28T05:58:10.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:10.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:10.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:10.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:09 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:10.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: daemon mds.j restarted 2024-03-28T05:58:10.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: osdmap e131: 12 total, 12 up, 12 in 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:boot 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:10.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:09 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:10.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 561 sec latency 668334.276 ms 2024-03-28T05:58:11.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:10 smithi086 ceph-mon[35163]: pgmap v870: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9 op/s 2024-03-28T05:58:11.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:10 smithi159 ceph-mon[36109]: pgmap v870: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9 op/s 2024-03-28T05:58:11.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:10 smithi055 ceph-mon[31863]: pgmap v870: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9 op/s 2024-03-28T05:58:11.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 562 sec latency 669334.435 ms 2024-03-28T05:58:12.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:11 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:resolve 2024-03-28T05:58:12.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:11 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:12.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:11 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:resolve 2024-03-28T05:58:12.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:11 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:12.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:11 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:resolve 2024-03-28T05:58:12.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:11 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:12.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 563 sec latency 670334.576 ms 2024-03-28T05:58:13.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:12 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:13.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:reconnect 2024-03-28T05:58:13.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:12 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:13.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:12 smithi086 ceph-mon[35163]: pgmap v871: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s 2024-03-28T05:58:13.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:12 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:rejoin 2024-03-28T05:58:13.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:12 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:13.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:reconnect 2024-03-28T05:58:13.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:12 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:13.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:12 smithi159 ceph-mon[36109]: pgmap v871: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s 2024-03-28T05:58:13.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:12 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:rejoin 2024-03-28T05:58:13.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:12 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:13.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:reconnect 2024-03-28T05:58:13.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:12 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:13.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:12 smithi055 ceph-mon[31863]: pgmap v871: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s 2024-03-28T05:58:13.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:12 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:rejoin 2024-03-28T05:58:13.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 564 sec latency 671334.701 ms 2024-03-28T05:58:13.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f51b5600700 time 2024-03-28T05:58:13.365812+0000 2024-03-28T05:58:13.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f51c0e444a1] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: clone() 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: *** Caught signal (Aborted) ** 2024-03-28T05:58:13.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: in thread 7f51b5600700 thread_name:ms_dispatch 2024-03-28T05:58:13.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.366+0000 7f51b5600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f51b5600700 time 2024-03-28T05:58:13.365812+0000 2024-03-28T05:58:13.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:13.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f51c0e444a1] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: clone() 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f51bfbcbd20] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: gsignal() 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: abort() 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f51c0e444fb] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 19: clone() 2024-03-28T05:58:13.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.368+0000 7f51b5600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: in thread 7f51b5600700 thread_name:ms_dispatch 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f51bfbcbd20] 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: gsignal() 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: abort() 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f51c0e444fb] 2024-03-28T05:58:13.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 19: clone() 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: -1> 2024-03-28T05:58:13.366+0000 7f51b5600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f51b5600700 time 2024-03-28T05:58:13.365812+0000 2024-03-28T05:58:13.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:13.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f51c0e444a1] 2024-03-28T05:58:13.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: clone() 2024-03-28T05:58:13.631 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 0> 2024-03-28T05:58:13.368+0000 7f51b5600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: in thread 7f51b5600700 thread_name:ms_dispatch 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f51bfbcbd20] 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: gsignal() 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: abort() 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f51c0e444fb] 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.632 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.633 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 19: clone() 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.634 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: -1> 2024-03-28T05:58:13.366+0000 7f51b5600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f51b5600700 time 2024-03-28T05:58:13.365812+0000 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f51c0e444a1] 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.635 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.636 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.636 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.636 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.636 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: clone() 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.637 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 0> 2024-03-28T05:58:13.368+0000 7f51b5600700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: in thread 7f51b5600700 thread_name:ms_dispatch 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f51bfbcbd20] 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2: gsignal() 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 3: abort() 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f51c0e444fb] 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f51c0e44667] 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x564bf3cf1223] 2024-03-28T05:58:13.638 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x564bf3b6b5d6] 2024-03-28T05:58:13.639 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x564bf3b6bda1] 2024-03-28T05:58:13.639 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x564bf3ba009c] 2024-03-28T05:58:13.639 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x564bf3bbe233] 2024-03-28T05:58:13.639 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564bf3bc0197] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564bf3abf11b] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564bf3abf6bc] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x564bf3aa91ff] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f51c10d6488] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 16: (DispatchQueue::entry()+0x51f) [0x7f51c10d360f] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f51c11a6e81] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f51bfbc11ca] 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 19: clone() 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89064]: 2024-03-28T05:58:13.640 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:13 smithi055 podman[89251]: 2024-03-28 05:58:13.468927694 +0000 UTC m=+0.038866869 container died 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-28T05:58:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:13 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:13 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:13 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:13 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:active 2024-03-28T05:58:14.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:13 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:14.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:13 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:14.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:13 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:14.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:13 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:14.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:13 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:active 2024-03-28T05:58:14.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:13 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:14.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:14.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:14.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:14.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/3622495211,v1:172.21.15.55:6837/3622495211] up:active 2024-03-28T05:58:14.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:13 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:14.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 565 sec latency 672334.850 ms 2024-03-28T05:58:14.614 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:14 smithi055 podman[89251]: 2024-03-28 05:58:14.189391718 +0000 UTC m=+0.759330927 container remove 8559d3da5aab97de1b6e329dfedd68d0066fd80526476f5218ff7480b71604a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-28T05:58:14.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:14 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:58:15.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:14 smithi086 ceph-mon[35163]: pgmap v872: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:15.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:14 smithi159 ceph-mon[36109]: pgmap v872: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:15.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:14 smithi055 ceph-mon[31863]: pgmap v872: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:15.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:14 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:58:15.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:14 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.554s CPU time. 2024-03-28T05:58:15.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 566 sec latency 673334.983 ms 2024-03-28T05:58:16.093 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:15 smithi055 ceph-mon[31863]: pgmap v873: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:58:16.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 567 sec latency 674335.090 ms 2024-03-28T05:58:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:15 smithi086 ceph-mon[35163]: pgmap v873: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:58:16.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:15 smithi159 ceph-mon[36109]: pgmap v873: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:58:17.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 568 sec latency 675335.202 ms 2024-03-28T05:58:18.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 569 sec latency 676335.355 ms 2024-03-28T05:58:18.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:17 smithi086 ceph-mon[35163]: pgmap v874: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:18.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:17 smithi159 ceph-mon[36109]: pgmap v874: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:18.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:17 smithi055 ceph-mon[31863]: pgmap v874: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:19.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 570 sec latency 677335.506 ms 2024-03-28T05:58:20.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 571 sec latency 678335.632 ms 2024-03-28T05:58:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:19 smithi086 ceph-mon[35163]: pgmap v875: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:19 smithi159 ceph-mon[36109]: pgmap v875: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:20.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:19 smithi055 ceph-mon[31863]: pgmap v875: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:21.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 572 sec latency 679335.772 ms 2024-03-28T05:58:22.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 573 sec latency 680335.905 ms 2024-03-28T05:58:22.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:21 smithi086 ceph-mon[35163]: pgmap v876: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:22.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:21 smithi159 ceph-mon[36109]: pgmap v876: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:22.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:21 smithi055 ceph-mon[31863]: pgmap v876: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:23.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 574 sec latency 681336.058 ms 2024-03-28T05:58:24.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 575 sec latency 682336.216 ms 2024-03-28T05:58:24.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:23 smithi086 ceph-mon[35163]: pgmap v877: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:24.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:23 smithi159 ceph-mon[36109]: pgmap v877: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:24.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:23 smithi055 ceph-mon[31863]: pgmap v877: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:25.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 576 sec latency 683336.315 ms 2024-03-28T05:58:25.254 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:24 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:58:25.254 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:24 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:25.254 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:24 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.554s CPU time. 2024-03-28T05:58:25.254 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:24 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:58:25.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 podman[89354]: 2024-03-28 05:58:25.167441009 +0000 UTC m=+0.032879735 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:58:25.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 podman[89354]: 2024-03-28 05:58:25.284147447 +0000 UTC m=+0.149586166 container create 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux ) 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: daemon mds.d restarted 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: osdmap e132: 12 total, 12 up, 12 in 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:boot 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:26.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:58:26.061 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:25 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:26.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: daemon mds.d restarted 2024-03-28T05:58:26.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: osdmap e132: 12 total, 12 up, 12 in 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:boot 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:58:26.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:25 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:26.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: daemon mds.d restarted 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: osdmap e132: 12 total, 12 up, 12 in 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:boot 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:58:26.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 podman[89354]: 2024-03-28 05:58:25.627780406 +0000 UTC m=+0.493219131 container init 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 podman[89354]: 2024-03-28 05:58:25.639454743 +0000 UTC m=+0.504893435 container start 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mds[89373]: -- 172.21.15.55:0/32981293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5573bc44c4e0 con 0x5573bc422800 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-mds[89373]: -- 172.21.15.55:0/32981293 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5573bc44fa40 con 0x5573bc422800 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: starting mds.d at 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 bash[89354]: 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 2024-03-28T05:58:26.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:25 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:26.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 577 sec latency 684336.885 ms 2024-03-28T05:58:27.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:26 smithi086 ceph-mon[35163]: pgmap v879: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:58:27.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:26 smithi159 ceph-mon[36109]: pgmap v879: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:58:27.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:26 smithi055 ceph-mon[31863]: pgmap v879: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:58:27.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 578 sec latency 685337.030 ms 2024-03-28T05:58:28.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:27 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:resolve 2024-03-28T05:58:28.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:27 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:28.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:27 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:resolve 2024-03-28T05:58:28.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:27 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:28.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:27 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:resolve 2024-03-28T05:58:28.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:27 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:28.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 579 sec latency 686337.167 ms 2024-03-28T05:58:29.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:28 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:58:29.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:28 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:reconnect 2024-03-28T05:58:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:28 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:29.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:28 smithi086 ceph-mon[35163]: pgmap v880: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:58:29.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:28 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:58:29.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:28 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:reconnect 2024-03-28T05:58:29.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:28 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:29.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:28 smithi159 ceph-mon[36109]: pgmap v880: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:58:29.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:28 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00399992 2024-03-28T05:58:29.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:28 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:reconnect 2024-03-28T05:58:29.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:28 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:29.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:28 smithi055 ceph-mon[31863]: pgmap v880: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-03-28T05:58:29.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 580 sec latency 687337.333 ms 2024-03-28T05:58:30.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:rejoin 2024-03-28T05:58:30.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:30.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:58:30.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c4be00700 time 2024-03-28T05:58:29.859047+0000 2024-03-28T05:58:30.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c577a04a1] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: clone() 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:29.860+0000 7f8c4be00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c4be00700 time 2024-03-28T05:58:29.859047+0000 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c577a04a1] 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: clone() 2024-03-28T05:58:30.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: *** Caught signal (Aborted) ** 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: in thread 7f8c4be00700 thread_name:ms_dispatch 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c56527d20] 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: gsignal() 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: abort() 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c577a04fb] 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 19: clone() 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:29.863+0000 7f8c4be00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: in thread 7f8c4be00700 thread_name:ms_dispatch 2024-03-28T05:58:30.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c56527d20] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: gsignal() 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: abort() 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c577a04fb] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 19: clone() 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: -1> 2024-03-28T05:58:29.860+0000 7f8c4be00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c4be00700 time 2024-03-28T05:58:29.859047+0000 2024-03-28T05:58:30.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:30.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c577a04a1] 2024-03-28T05:58:30.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: clone() 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 0> 2024-03-28T05:58:29.863+0000 7f8c4be00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: in thread 7f8c4be00700 thread_name:ms_dispatch 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c56527d20] 2024-03-28T05:58:30.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: gsignal() 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: abort() 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c577a04fb] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 19: clone() 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: -1> 2024-03-28T05:58:29.860+0000 7f8c4be00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f8c4be00700 time 2024-03-28T05:58:29.859047+0000 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8c577a04a1] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: clone() 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 0> 2024-03-28T05:58:29.863+0000 7f8c4be00700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: in thread 7f8c4be00700 thread_name:ms_dispatch 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:30.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8c56527d20] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2: gsignal() 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 3: abort() 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8c577a04fb] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f8c577a0667] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55b21b109223] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55b21af835d6] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55b21af83da1] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55b21afb809c] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55b21afd6233] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b21afd8197] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b21aed711b] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b21aed76bc] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55b21aec11ff] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f8c57a32488] 2024-03-28T05:58:30.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 16: (DispatchQueue::entry()+0x51f) [0x7f8c57a2f60f] 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8c57b02e81] 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f8c5651d1ca] 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 19: clone() 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89211]: 2024-03-28T05:58:30.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:29 smithi055 podman[89409]: 2024-03-28 05:58:29.989316445 +0000 UTC m=+0.034918392 container died ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-28T05:58:30.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 581 sec latency 688337.430 ms 2024-03-28T05:58:30.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:29 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:rejoin 2024-03-28T05:58:30.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:29 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:30.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:29 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:58:30.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:29 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:rejoin 2024-03-28T05:58:30.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:29 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:30.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:29 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:58:31.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:30 smithi055 podman[89409]: 2024-03-28 05:58:30.79837756 +0000 UTC m=+0.843979550 container remove ffcd9e0fcad101be5be0e0d9b8a1aa3404e93f2f760b5e7afca3af40f39ef506 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:58:31.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:30 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:58:31.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:30 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:31.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:30 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:active 2024-03-28T05:58:31.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:31.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:30 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:31.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:30 smithi055 ceph-mon[31863]: pgmap v881: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:31.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 582 sec latency 689337.530 ms 2024-03-28T05:58:31.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:30 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:31.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:30 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:active 2024-03-28T05:58:31.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:31.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:30 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:31.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:30 smithi086 ceph-mon[35163]: pgmap v881: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:31.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:30 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:31.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:30 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/612434037,v1:172.21.15.55:6835/612434037] up:active 2024-03-28T05:58:31.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:31.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:30 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:31.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:30 smithi159 ceph-mon[36109]: pgmap v881: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-03-28T05:58:31.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T05:58:31.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.674s CPU time. 2024-03-28T05:58:32.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 583 sec latency 690337.677 ms 2024-03-28T05:58:32.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:31 smithi086 ceph-mon[35163]: pgmap v882: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:58:32.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:31 smithi159 ceph-mon[36109]: pgmap v882: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:58:32.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:31 smithi055 ceph-mon[31863]: pgmap v882: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-03-28T05:58:33.059 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:58:32 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:58:32.707+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:58:33.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 584 sec latency 691337.851 ms 2024-03-28T05:58:34.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 585 sec latency 692338.006 ms 2024-03-28T05:58:34.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:33 smithi086 ceph-mon[35163]: pgmap v883: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:34.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:33 smithi159 ceph-mon[36109]: pgmap v883: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:34.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:33 smithi055 ceph-mon[31863]: pgmap v883: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:35.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 586 sec latency 693338.147 ms 2024-03-28T05:58:36.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 587 sec latency 694338.285 ms 2024-03-28T05:58:36.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:35 smithi086 ceph-mon[35163]: pgmap v884: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:58:36.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:35 smithi159 ceph-mon[36109]: pgmap v884: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:58:36.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:35 smithi055 ceph-mon[31863]: pgmap v884: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-28T05:58:37.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 588 sec latency 695338.439 ms 2024-03-28T05:58:38.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 589 sec latency 696338.594 ms 2024-03-28T05:58:38.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:37 smithi086 ceph-mon[35163]: pgmap v885: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:38.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:37 smithi159 ceph-mon[36109]: pgmap v885: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:38.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:37 smithi055 ceph-mon[31863]: pgmap v885: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:58:39.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 590 sec latency 697338.745 ms 2024-03-28T05:58:40.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 591 sec latency 698338.877 ms 2024-03-28T05:58:40.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:39 smithi086 ceph-mon[35163]: pgmap v886: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:58:40.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:39 smithi159 ceph-mon[36109]: pgmap v886: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:58:40.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:39 smithi055 ceph-mon[31863]: pgmap v886: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:58:41.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 592 sec latency 699338.967 ms 2024-03-28T05:58:41.750 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 3. 2024-03-28T05:58:41.750 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:41.750 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.674s CPU time. 2024-03-28T05:58:41.750 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:58:42.069 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:41 smithi055 ceph-mon[31863]: pgmap v887: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:58:42.070 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 podman[89502]: 2024-03-28 05:58:41.667721042 +0000 UTC m=+0.039950260 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:58:42.070 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:41 smithi055 podman[89502]: 2024-03-28 05:58:41.783087329 +0000 UTC m=+0.155316557 container create 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:58:42.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 593 sec latency 700339.059 ms 2024-03-28T05:58:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:41 smithi086 ceph-mon[35163]: pgmap v887: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:58:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:41 smithi159 ceph-mon[36109]: pgmap v887: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:58:42.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 podman[89502]: 2024-03-28 05:58:42.078483431 +0000 UTC m=+0.450712665 container init 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux ) 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 podman[89502]: 2024-03-28 05:58:42.08899868 +0000 UTC m=+0.461227915 container start 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mds[89522]: -- 172.21.15.55:0/1469029523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5624425344e0 con 0x56244250a800 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mds[89522]: -- 172.21.15.55:0/1469029523 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562442537a40 con 0x56244250a800 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: starting mds.j at 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 bash[89502]: 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 2024-03-28T05:58:42.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:58:42 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:43.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 594 sec latency 701339.215 ms 2024-03-28T05:58:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: daemon mds.j restarted 2024-03-28T05:58:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: osdmap e133: 12 total, 12 up, 12 in 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:boot 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:43.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:42 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: daemon mds.j restarted 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: osdmap e133: 12 total, 12 up, 12 in 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:boot 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:43.312 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:42 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: daemon mds.j restarted 2024-03-28T05:58:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:58:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: osdmap e133: 12 total, 12 up, 12 in 2024-03-28T05:58:43.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:boot 2024-03-28T05:58:43.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:58:43.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:58:43.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:58:43.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:42 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:44.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 595 sec latency 702339.305 ms 2024-03-28T05:58:44.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:44 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:resolve 2024-03-28T05:58:44.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:44 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:44.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:44 smithi086 ceph-mon[35163]: pgmap v889: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:58:44.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:44 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:resolve 2024-03-28T05:58:44.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:44 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:44.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:44 smithi159 ceph-mon[36109]: pgmap v889: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:58:44.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:44 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:resolve 2024-03-28T05:58:44.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:44 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:44.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:44 smithi055 ceph-mon[31863]: pgmap v889: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-28T05:58:45.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 596 sec latency 703339.433 ms 2024-03-28T05:58:45.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:45 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:45.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:45 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:reconnect 2024-03-28T05:58:45.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:45 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:45.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:45 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:45.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:45 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:reconnect 2024-03-28T05:58:45.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:45 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:45.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:45 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:58:45.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:45 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:reconnect 2024-03-28T05:58:45.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:45 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:46.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 597 sec latency 704339.534 ms 2024-03-28T05:58:46.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:46 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:rejoin 2024-03-28T05:58:46.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:46 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:46.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:46 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:46.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:46 smithi086 ceph-mon[35163]: pgmap v890: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:58:46.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:46 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:rejoin 2024-03-28T05:58:46.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:46 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:46.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:46 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:46.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:46 smithi159 ceph-mon[36109]: pgmap v890: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:58:46.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:rejoin 2024-03-28T05:58:46.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:46.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:58:46.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-mon[31863]: pgmap v890: 97 pgs: 97 active+clean; 22 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f585a200700 time 2024-03-28T05:58:46.247547+0000 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f5865ac64a1] 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.615 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.616 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: clone() 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.249+0000 7f585a200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f585a200700 time 2024-03-28T05:58:46.247547+0000 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f5865ac64a1] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.617 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: clone() 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: *** Caught signal (Aborted) ** 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: in thread 7f585a200700 thread_name:ms_dispatch 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.618 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f586484dd20] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: gsignal() 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: abort() 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f5865ac64fb] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.619 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 19: clone() 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.253+0000 7f585a200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: in thread 7f585a200700 thread_name:ms_dispatch 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f586484dd20] 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: gsignal() 2024-03-28T05:58:46.620 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: abort() 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f5865ac64fb] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.621 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 19: clone() 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: -1> 2024-03-28T05:58:46.249+0000 7f585a200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f585a200700 time 2024-03-28T05:58:46.247547+0000 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.622 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f5865ac64a1] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.623 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: clone() 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 0> 2024-03-28T05:58:46.253+0000 7f585a200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: in thread 7f585a200700 thread_name:ms_dispatch 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.624 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f586484dd20] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: gsignal() 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: abort() 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f5865ac64fb] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.625 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 19: clone() 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: -1> 2024-03-28T05:58:46.249+0000 7f585a200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f585a200700 time 2024-03-28T05:58:46.247547+0000 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f5865ac64a1] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.626 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.627 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: clone() 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 0> 2024-03-28T05:58:46.253+0000 7f585a200700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: in thread 7f585a200700 thread_name:ms_dispatch 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f586484dd20] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2: gsignal() 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 3: abort() 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f5865ac64fb] 2024-03-28T05:58:46.628 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f5865ac6667] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x5573b97db223] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x5573b96555d6] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x5573b9655da1] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x5573b968a09c] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x5573b96a8233] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573b96aa197] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5573b95a911b] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573b95a96bc] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x5573b95931ff] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f5865d58488] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 16: (DispatchQueue::entry()+0x51f) [0x7f5865d5560f] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f5865e28e81] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f58648431ca] 2024-03-28T05:58:46.629 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 19: clone() 2024-03-28T05:58:46.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:58:46.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89369]: 2024-03-28T05:58:46.630 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:46 smithi055 podman[89558]: 2024-03-28 05:58:46.354506352 +0000 UTC m=+0.036574321 container died 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-28T05:58:47.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 598 sec latency 705339.627 ms 2024-03-28T05:58:47.364 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:47 smithi055 podman[89558]: 2024-03-28 05:58:47.106729544 +0000 UTC m=+0.788797560 container remove 9221f06ad36a2db55b10b10db5529bc2f888d64c8d537af99d566e9b91a5b186 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-28T05:58:47.364 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:58:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:47 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:47 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:active 2024-03-28T05:58:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:47 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:47.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:47 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:47.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:47 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:47.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:47 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:active 2024-03-28T05:58:47.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:47 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:47.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:47 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:47.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:47 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:58:47.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:47 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/2126098721,v1:172.21.15.55:6837/2126098721] up:active 2024-03-28T05:58:47.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:47 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:58:47.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:47 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:58:48.059 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:58:47 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:58:47.708+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:58:48.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:58:48.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:47 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.638s CPU time. 2024-03-28T05:58:48.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 1616 0.00 MB/sec execute 599 sec latency 706339.760 ms 2024-03-28T05:58:48.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:48 smithi086 ceph-mon[35163]: pgmap v891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:58:48.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:48 smithi159 ceph-mon[36109]: pgmap v891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:58:48.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:48 smithi055 ceph-mon[31863]: pgmap v891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-03-28T05:58:49.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 600 sec 2024-03-28T05:58:50.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 601 sec 2024-03-28T05:58:50.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:49 smithi086 ceph-mon[35163]: pgmap v892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:50.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:49 smithi159 ceph-mon[36109]: pgmap v892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:50.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:49 smithi055 ceph-mon[31863]: pgmap v892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T05:58:51.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 602 sec 2024-03-28T05:58:52.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 603 sec 2024-03-28T05:58:52.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:51 smithi086 ceph-mon[35163]: pgmap v893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:52.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:51 smithi159 ceph-mon[36109]: pgmap v893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:52.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:51 smithi055 ceph-mon[31863]: pgmap v893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:53.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 604 sec 2024-03-28T05:58:53.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:58:53.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:58:53.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:58:54.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 605 sec 2024-03-28T05:58:54.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:58:54.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:58:54.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:54 smithi055 ceph-mon[31863]: pgmap v894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:54.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:54 smithi055 ceph-mon[31863]: pgmap v895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:54.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:58:54.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:58:54.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:58:54.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:54 smithi086 ceph-mon[35163]: pgmap v894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:54.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:54 smithi086 ceph-mon[35163]: pgmap v895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:54.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:58:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:58:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:58:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:54 smithi159 ceph-mon[36109]: pgmap v894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-03-28T05:58:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:54 smithi159 ceph-mon[36109]: pgmap v895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:54.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:58:55.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 606 sec 2024-03-28T05:58:56.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 607 sec 2024-03-28T05:58:57.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:56 smithi086 ceph-mon[35163]: pgmap v896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:57.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:56 smithi159 ceph-mon[36109]: pgmap v896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:57.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:56 smithi055 ceph-mon[31863]: pgmap v896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:58:57.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 608 sec 2024-03-28T05:58:58.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 609 sec 2024-03-28T05:58:58.248 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:57 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:58:58.248 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:57 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:58.248 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:57 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.638s CPU time. 2024-03-28T05:58:58.249 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:57 smithi055 systemd[1]: Starting Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:58:58.586 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 podman[89779]: 2024-03-28 05:58:58.161966263 +0000 UTC m=+0.033078846 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:58:58.586 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 podman[89779]: 2024-03-28 05:58:58.324833907 +0000 UTC m=+0.195946514 container create 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:58:58.586 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 podman[89779]: 2024-03-28 05:58:58.594602135 +0000 UTC m=+0.465714749 container init 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:58 smithi055 ceph-mon[31863]: pgmap v897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 105 B/s wr, 9 op/s 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 podman[89779]: 2024-03-28 05:58:58.605520453 +0000 UTC m=+0.476633040 container start 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, ceph=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5) 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 ceph-mds[89798]: -- 172.21.15.55:0/1885330432 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56443f49da40 con 0x56443f470c00 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: starting mds.d at 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 bash[89779]: 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 2024-03-28T05:58:58.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:58:58 smithi055 systemd[1]: Started Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:58:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:58 smithi086 ceph-mon[35163]: pgmap v897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 105 B/s wr, 9 op/s 2024-03-28T05:58:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:58 smithi159 ceph-mon[36109]: pgmap v897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 105 B/s wr, 9 op/s 2024-03-28T05:58:59.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 610 sec 2024-03-28T05:59:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: daemon mds.d restarted 2024-03-28T05:59:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: osdmap e134: 12 total, 12 up, 12 in 2024-03-28T05:59:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:boot 2024-03-28T05:59:00.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:00.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:00.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:59:00.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:58:59 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: daemon mds.d restarted 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: osdmap e134: 12 total, 12 up, 12 in 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:boot 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:59:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:58:59 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: daemon mds.d restarted 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: osdmap e134: 12 total, 12 up, 12 in 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:boot 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-28T05:59:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:58:59 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:00.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 611 sec 2024-03-28T05:59:01.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:00 smithi086 ceph-mon[35163]: pgmap v899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:01.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:00 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:resolve 2024-03-28T05:59:01.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:00 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:01.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:00 smithi159 ceph-mon[36109]: pgmap v899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:01.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:00 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:resolve 2024-03-28T05:59:01.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:00 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:01.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:00 smithi055 ceph-mon[31863]: pgmap v899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:01.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:00 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:resolve 2024-03-28T05:59:01.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:00 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:01.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 612 sec 2024-03-28T05:59:02.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:01 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:02.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:01 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:reconnect 2024-03-28T05:59:02.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:01 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:02.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:01 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:02.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:01 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:reconnect 2024-03-28T05:59:02.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:01 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:01 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:01 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:reconnect 2024-03-28T05:59:02.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:01 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:02.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 613 sec 2024-03-28T05:59:03.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:02 smithi086 ceph-mon[35163]: pgmap v900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:59:03.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:02 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:rejoin 2024-03-28T05:59:03.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:02 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:03.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:02 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:03.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:02 smithi159 ceph-mon[36109]: pgmap v900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:59:03.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:02 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:rejoin 2024-03-28T05:59:03.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:02 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:03.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:02 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:03.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-mon[31863]: pgmap v900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-28T05:59:03.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:rejoin 2024-03-28T05:59:03.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:03.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:03.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f199c800700 time 2024-03-28T05:59:02.786005+0000 2024-03-28T05:59:03.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:03.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.115 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f19a817a4a1] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.116 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.117 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: clone() 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:02.787+0000 7f199c800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f199c800700 time 2024-03-28T05:59:02.786005+0000 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f19a817a4a1] 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.118 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.119 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: clone() 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: *** Caught signal (Aborted) ** 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: in thread 7f199c800700 thread_name:ms_dispatch 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.120 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f19a6f01d20] 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: gsignal() 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: abort() 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f19a817a4fb] 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.121 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.122 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 19: clone() 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:02.789+0000 7f199c800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: in thread 7f199c800700 thread_name:ms_dispatch 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f19a6f01d20] 2024-03-28T05:59:03.123 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: gsignal() 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: abort() 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f19a817a4fb] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.124 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 19: clone() 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.125 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: -1> 2024-03-28T05:59:02.787+0000 7f199c800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f199c800700 time 2024-03-28T05:59:02.786005+0000 2024-03-28T05:59:03.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:03.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f19a817a4a1] 2024-03-28T05:59:03.126 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.127 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: clone() 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 0> 2024-03-28T05:59:02.789+0000 7f199c800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:03.128 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: in thread 7f199c800700 thread_name:ms_dispatch 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f19a6f01d20] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: gsignal() 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: abort() 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f19a817a4fb] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.129 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.130 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 19: clone() 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: -1> 2024-03-28T05:59:02.787+0000 7f199c800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f199c800700 time 2024-03-28T05:59:02.786005+0000 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f19a817a4a1] 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.131 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.132 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.132 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.132 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.132 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: clone() 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.133 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 0> 2024-03-28T05:59:02.789+0000 7f199c800700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: in thread 7f199c800700 thread_name:ms_dispatch 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f19a6f01d20] 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2: gsignal() 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 3: abort() 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f19a817a4fb] 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f19a817a667] 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56243f948223] 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56243f7c25d6] 2024-03-28T05:59:03.134 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56243f7c2da1] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56243f7f709c] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56243f815233] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56243f817197] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56243f71611b] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56243f7166bc] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56243f7001ff] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f19a840c488] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 16: (DispatchQueue::entry()+0x51f) [0x7f19a840960f] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f19a84dce81] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f19a6ef71ca] 2024-03-28T05:59:03.135 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 19: clone() 2024-03-28T05:59:03.136 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:03.136 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89518]: 2024-03-28T05:59:03.136 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:02 smithi055 podman[89834]: 2024-03-28 05:59:02.894352458 +0000 UTC m=+0.040118469 container died 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-28T05:59:03.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 614 sec 2024-03-28T05:59:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:03 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:03 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:active 2024-03-28T05:59:04.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:03 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:04.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:03 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:03 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:03 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:active 2024-03-28T05:59:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:03 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:04.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:03 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:04.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:03 smithi055 podman[89834]: 2024-03-28 05:59:03.681912498 +0000 UTC m=+0.827678530 container remove 6d54c9a923c9b8fd88a3a93258217954654aededac2ee4cc8327656c1a3bd605 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-28T05:59:04.114 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:03 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:59:04.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:03 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:04.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:03 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1613176231,v1:172.21.15.55:6835/1613176231] up:active 2024-03-28T05:59:04.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:03 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:04.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:03 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:04.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 615 sec 2024-03-28T05:59:04.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:04 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T05:59:04.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:04 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.614s CPU time. 2024-03-28T05:59:05.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:04 smithi086 ceph-mon[35163]: pgmap v901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-28T05:59:05.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:04 smithi159 ceph-mon[36109]: pgmap v901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-28T05:59:05.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:04 smithi055 ceph-mon[31863]: pgmap v901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-28T05:59:05.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 616 sec 2024-03-28T05:59:06.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 617 sec 2024-03-28T05:59:07.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:06 smithi086 ceph-mon[35163]: pgmap v902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:07.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:06 smithi159 ceph-mon[36109]: pgmap v902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:07.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:06 smithi055 ceph-mon[31863]: pgmap v902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:07.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 618 sec 2024-03-28T05:59:08.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 619 sec 2024-03-28T05:59:09.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:08 smithi086 ceph-mon[35163]: pgmap v903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:59:09.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:08 smithi159 ceph-mon[36109]: pgmap v903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:59:09.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:08 smithi055 ceph-mon[31863]: pgmap v903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-03-28T05:59:09.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 620 sec 2024-03-28T05:59:10.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 621 sec 2024-03-28T05:59:11.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:10 smithi086 ceph-mon[35163]: pgmap v904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:11.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:10 smithi159 ceph-mon[36109]: pgmap v904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:11.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:10 smithi055 ceph-mon[31863]: pgmap v904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:11.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 622 sec 2024-03-28T05:59:12.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 623 sec 2024-03-28T05:59:13.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:12 smithi086 ceph-mon[35163]: pgmap v905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:13.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:12 smithi159 ceph-mon[36109]: pgmap v905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:13.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:12 smithi055 ceph-mon[31863]: pgmap v905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:13.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 624 sec 2024-03-28T05:59:14.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 625 sec 2024-03-28T05:59:14.763 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 4. 2024-03-28T05:59:14.763 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:14.763 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.614s CPU time. 2024-03-28T05:59:14.763 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:59:15.053 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:14 smithi055 ceph-mon[31863]: pgmap v906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:15.053 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 podman[89923]: 2024-03-28 05:59:14.676990349 +0000 UTC m=+0.033732703 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:59:15.053 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:14 smithi055 podman[89923]: 2024-03-28 05:59:14.79116102 +0000 UTC m=+0.147903394 container create 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T05:59:15.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:14 smithi086 ceph-mon[35163]: pgmap v906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:15.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:14 smithi159 ceph-mon[36109]: pgmap v906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:15.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 626 sec 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 podman[89923]: 2024-03-28 05:59:15.061631612 +0000 UTC m=+0.418374033 container init 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 podman[89923]: 2024-03-28 05:59:15.072346578 +0000 UTC m=+0.429088923 container start 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mds[89943]: -- 172.21.15.55:0/1113671411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8a6f4fa40 con 0x55d8a6f22c00 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: starting mds.j at 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 bash[89923]: 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 2024-03-28T05:59:15.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:15 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: daemon mds.j restarted 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: osdmap e135: 12 total, 12 up, 12 in 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:boot 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:16.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:16.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:15 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: daemon mds.j restarted 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: osdmap e135: 12 total, 12 up, 12 in 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:boot 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:16.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:16.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:15 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:16.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 627 sec 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: daemon mds.j restarted 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: osdmap e135: 12 total, 12 up, 12 in 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:boot 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:15 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:17.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:16 smithi055 ceph-mon[31863]: pgmap v908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8 op/s 2024-03-28T05:59:17.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 628 sec 2024-03-28T05:59:17.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:16 smithi086 ceph-mon[35163]: pgmap v908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8 op/s 2024-03-28T05:59:17.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:16 smithi159 ceph-mon[36109]: pgmap v908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8 op/s 2024-03-28T05:59:18.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:17 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:resolve 2024-03-28T05:59:18.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:17 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:18.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 629 sec 2024-03-28T05:59:18.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:17 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:resolve 2024-03-28T05:59:18.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:17 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:18.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:17 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:resolve 2024-03-28T05:59:18.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:17 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: pgmap v909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:59:19.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:19.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:reconnect 2024-03-28T05:59:19.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:rejoin 2024-03-28T05:59:19.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:18 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 630 sec 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: pgmap v909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:reconnect 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:rejoin 2024-03-28T05:59:19.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:18 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: pgmap v909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:reconnect 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:rejoin 2024-03-28T05:59:19.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:18 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:20.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-mon[31863]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:59:20.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:20.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:active 2024-03-28T05:59:20.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:20.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fef4d000700 time 2024-03-28T05:59:19.872170+0000 2024-03-28T05:59:20.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:20.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.115 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fef589494a1] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.116 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: clone() 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: *** Caught signal (Aborted) ** 2024-03-28T05:59:20.117 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: in thread 7fef4d000700 thread_name:ms_dispatch 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:19.872+0000 7fef4d000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fef4d000700 time 2024-03-28T05:59:19.872170+0000 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fef589494a1] 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.118 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: clone() 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.119 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fef576d0d20] 2024-03-28T05:59:20.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: gsignal() 2024-03-28T05:59:20.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: abort() 2024-03-28T05:59:20.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fef589494fb] 2024-03-28T05:59:20.120 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.121 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 19: clone() 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:19.875+0000 7fef4d000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: in thread 7fef4d000700 thread_name:ms_dispatch 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fef576d0d20] 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: gsignal() 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: abort() 2024-03-28T05:59:20.122 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fef589494fb] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.123 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 19: clone() 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: -1> 2024-03-28T05:59:19.872+0000 7fef4d000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fef4d000700 time 2024-03-28T05:59:19.872170+0000 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fef589494a1] 2024-03-28T05:59:20.124 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.125 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: clone() 2024-03-28T05:59:20.126 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 0> 2024-03-28T05:59:19.875+0000 7fef4d000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: in thread 7fef4d000700 thread_name:ms_dispatch 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fef576d0d20] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: gsignal() 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: abort() 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fef589494fb] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.127 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 19: clone() 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.128 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: -1> 2024-03-28T05:59:19.872+0000 7fef4d000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7fef4d000700 time 2024-03-28T05:59:19.872170+0000 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fef589494a1] 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.129 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: clone() 2024-03-28T05:59:20.130 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 0> 2024-03-28T05:59:19.875+0000 7fef4d000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: in thread 7fef4d000700 thread_name:ms_dispatch 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fef576d0d20] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2: gsignal() 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 3: abort() 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fef589494fb] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7fef58949667] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x56443d2e2223] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x56443d15c5d6] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x56443d15cda1] 2024-03-28T05:59:20.131 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x56443d19109c] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x56443d1af233] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56443d1b1197] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56443d0b011b] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56443d0b06bc] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x56443d09a1ff] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7fef58bdb488] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 16: (DispatchQueue::entry()+0x51f) [0x7fef58bd860f] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fef58cabe81] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fef576c61ca] 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 19: clone() 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d[89794]: 2024-03-28T05:59:20.132 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:19 smithi055 podman[89991]: 2024-03-28 05:59:19.971338733 +0000 UTC m=+0.033593006 container died 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-28T05:59:20.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 631 sec 2024-03-28T05:59:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:19 smithi086 ceph-mon[35163]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:59:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:19 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:19 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:active 2024-03-28T05:59:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:19 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:19 smithi159 ceph-mon[36109]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-03-28T05:59:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:19 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:19 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6836/389513488,v1:172.21.15.55:6837/389513488] up:active 2024-03-28T05:59:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:19 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby 2024-03-28T05:59:21.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:20 smithi055 podman[89991]: 2024-03-28 05:59:20.822863668 +0000 UTC m=+0.885118008 container remove 1b5362184ea11e6ef092083250d5eec32a538ccb97245ddf773ec5eed04013a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-d, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-28T05:59:21.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:20 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:59:21.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:20 smithi055 ceph-mon[31863]: pgmap v910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:59:21.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:20 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:21.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 632 sec 2024-03-28T05:59:21.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:20 smithi086 ceph-mon[35163]: pgmap v910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:59:21.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:20 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:21.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:20 smithi159 ceph-mon[36109]: pgmap v910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-03-28T05:59:21.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:20 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 2024-03-28T05:59:21.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:21 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:59:21.864 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:21 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.662s CPU time. 2024-03-28T05:59:22.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 633 sec 2024-03-28T05:59:23.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:22 smithi086 ceph-mon[35163]: pgmap v911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:23.060 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 05:59:22 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T05:59:22.711+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T05:59:23.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:22 smithi055 ceph-mon[31863]: pgmap v911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:23.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 634 sec 2024-03-28T05:59:23.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:22 smithi159 ceph-mon[36109]: pgmap v911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:24.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 635 sec 2024-03-28T05:59:25.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:24 smithi055 ceph-mon[31863]: pgmap v912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:25.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 636 sec 2024-03-28T05:59:25.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:24 smithi086 ceph-mon[35163]: pgmap v912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:25.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:24 smithi159 ceph-mon[36109]: pgmap v912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-03-28T05:59:26.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 637 sec 2024-03-28T05:59:27.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 638 sec 2024-03-28T05:59:27.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:26 smithi086 ceph-mon[35163]: pgmap v913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:27.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:26 smithi159 ceph-mon[36109]: pgmap v913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:27.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:26 smithi055 ceph-mon[31863]: pgmap v913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-03-28T05:59:28.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 639 sec 2024-03-28T05:59:29.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 640 sec 2024-03-28T05:59:29.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:28 smithi086 ceph-mon[35163]: pgmap v914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:59:29.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:28 smithi159 ceph-mon[36109]: pgmap v914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:59:29.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:28 smithi055 ceph-mon[31863]: pgmap v914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T05:59:30.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 641 sec 2024-03-28T05:59:31.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 642 sec 2024-03-28T05:59:31.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:30 smithi086 ceph-mon[35163]: pgmap v915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:31.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:30 smithi159 ceph-mon[36109]: pgmap v915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:31.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:30 smithi055 ceph-mon[31863]: pgmap v915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Scheduled restart job, restart counter is at 6. 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: Stopped Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Consumed 1.662s CPU time. 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Start request repeated too quickly. 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.d.service: Failed with result 'exit-code'. 2024-03-28T05:59:32.114 INFO:journalctl@ceph.mds.d.smithi055.stdout:Mar 28 05:59:31 smithi055 systemd[1]: Failed to start Ceph mds.d for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:32.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 643 sec 2024-03-28T05:59:33.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 644 sec 2024-03-28T05:59:33.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:32 smithi086 ceph-mon[35163]: pgmap v916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:59:33.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:32 smithi159 ceph-mon[36109]: pgmap v916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:59:33.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:32 smithi055 ceph-mon[31863]: pgmap v916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1023 B/s wr, 12 op/s 2024-03-28T05:59:34.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 645 sec 2024-03-28T05:59:35.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 646 sec 2024-03-28T05:59:35.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:34 smithi086 ceph-mon[35163]: pgmap v917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T05:59:35.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:34 smithi159 ceph-mon[36109]: pgmap v917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T05:59:35.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:34 smithi055 ceph-mon[31863]: pgmap v917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T05:59:36.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 647 sec 2024-03-28T05:59:37.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 648 sec 2024-03-28T05:59:37.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:36 smithi086 ceph-mon[35163]: pgmap v918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7 op/s 2024-03-28T05:59:37.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:36 smithi159 ceph-mon[36109]: pgmap v918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7 op/s 2024-03-28T05:59:37.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:36 smithi055 ceph-mon[31863]: pgmap v918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7 op/s 2024-03-28T05:59:38.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 649 sec 2024-03-28T05:59:39.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 650 sec 2024-03-28T05:59:39.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: pgmap v919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:59:39.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: Replacing daemon mds.d as rank 1 with standby daemon mds.j 2024-03-28T05:59:39.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-03-28T05:59:39.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:39.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: osdmap e136: 12 total, 12 up, 12 in 2024-03-28T05:59:39.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:38 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: pgmap v919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: Replacing daemon mds.d as rank 1 with standby daemon mds.j 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: osdmap e136: 12 total, 12 up, 12 in 2024-03-28T05:59:39.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:38 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: pgmap v919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: Replacing daemon mds.d as rank 1 with standby daemon mds.j 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: osdmap e136: 12 total, 12 up, 12 in 2024-03-28T05:59:39.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:38 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:40.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 651 sec 2024-03-28T05:59:41.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 652 sec 2024-03-28T05:59:41.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:40 smithi086 ceph-mon[35163]: pgmap v921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:59:41.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:40 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:resolve 2024-03-28T05:59:41.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:40 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:41.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:40 smithi159 ceph-mon[36109]: pgmap v921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:59:41.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:40 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:resolve 2024-03-28T05:59:41.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:40 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:41.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:40 smithi055 ceph-mon[31863]: pgmap v921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-28T05:59:41.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:40 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:resolve 2024-03-28T05:59:41.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:40 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:42.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 653 sec 2024-03-28T05:59:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:41 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:59:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:reconnect 2024-03-28T05:59:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:41 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:41 smithi086 ceph-mon[35163]: pgmap v922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:42.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:41 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:rejoin 2024-03-28T05:59:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:41 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:59:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:reconnect 2024-03-28T05:59:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:41 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:41 smithi159 ceph-mon[36109]: pgmap v922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:41 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:rejoin 2024-03-28T05:59:42.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:41 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00199996 2024-03-28T05:59:42.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:reconnect 2024-03-28T05:59:42.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:41 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:42.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:41 smithi055 ceph-mon[31863]: pgmap v922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-28T05:59:42.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:41 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:rejoin 2024-03-28T05:59:43.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 654 sec 2024-03-28T05:59:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:42 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:42 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:42 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:43.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:42 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:42 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:42 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:42 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:42 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:42 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T05:59:43.365 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f72ab000700 time 2024-03-28T05:59:43.007322+0000 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f72b68c94a1] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.366 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: clone() 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.010+0000 7f72ab000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f72ab000700 time 2024-03-28T05:59:43.007322+0000 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f72b68c94a1] 2024-03-28T05:59:43.367 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: clone() 2024-03-28T05:59:43.368 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: *** Caught signal (Aborted) ** 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: in thread 7f72ab000700 thread_name:ms_dispatch 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f72b5650d20] 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: gsignal() 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: abort() 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f72b68c94fb] 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.369 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 19: clone() 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.015+0000 7f72ab000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:43.370 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: in thread 7f72ab000700 thread_name:ms_dispatch 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f72b5650d20] 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: gsignal() 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: abort() 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f72b68c94fb] 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.371 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 19: clone() 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.372 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: -1> 2024-03-28T05:59:43.010+0000 7f72ab000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f72ab000700 time 2024-03-28T05:59:43.007322+0000 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f72b68c94a1] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.373 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: clone() 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 0> 2024-03-28T05:59:43.015+0000 7f72ab000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: in thread 7f72ab000700 thread_name:ms_dispatch 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.374 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f72b5650d20] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: gsignal() 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: abort() 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f72b68c94fb] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.375 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 19: clone() 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: -1> 2024-03-28T05:59:43.010+0000 7f72ab000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f72ab000700 time 2024-03-28T05:59:43.007322+0000 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.376 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f72b68c94a1] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.377 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: clone() 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 0> 2024-03-28T05:59:43.015+0000 7f72ab000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: in thread 7f72ab000700 thread_name:ms_dispatch 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f72b5650d20] 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2: gsignal() 2024-03-28T05:59:43.378 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 3: abort() 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f72b68c94fb] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f72b68c9667] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x55d8a5f11223] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x55d8a5d8b5d6] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x55d8a5d8bda1] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x55d8a5dc009c] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x55d8a5dde233] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d8a5de0197] 2024-03-28T05:59:43.379 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d8a5cdf11b] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d8a5cdf6bc] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x55d8a5cc91ff] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f72b6b5b488] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 16: (DispatchQueue::entry()+0x51f) [0x7f72b6b5860f] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f72b6c2be81] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f72b56461ca] 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 19: clone() 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[89939]: 2024-03-28T05:59:43.380 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:43 smithi055 podman[90039]: 2024-03-28 05:59:43.153475645 +0000 UTC m=+0.036356658 container died 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux ) 2024-03-28T05:59:44.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 655 sec 2024-03-28T05:59:44.212 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:43 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:active 2024-03-28T05:59:44.212 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:43 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:44.212 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:43 smithi086 ceph-mon[35163]: pgmap v923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:44.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:43 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:active 2024-03-28T05:59:44.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:43 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:44.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:43 smithi159 ceph-mon[36109]: pgmap v923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:44.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:44 smithi055 podman[90039]: 2024-03-28 05:59:44.019572799 +0000 UTC m=+0.902453846 container remove 0ec2d3161acfcd6178eb76296d766be30b75c0e2026eb33a85a7bdb980fd3837 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2) 2024-03-28T05:59:44.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:44 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T05:59:44.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/1393918936,v1:172.21.15.55:6835/1393918936] up:active 2024-03-28T05:59:44.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:44.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:43 smithi055 ceph-mon[31863]: pgmap v923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-03-28T05:59:44.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:44 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T05:59:44.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:44 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.776s CPU time. 2024-03-28T05:59:45.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 656 sec 2024-03-28T05:59:46.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 657 sec 2024-03-28T05:59:47.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:46 smithi086 ceph-mon[35163]: pgmap v924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:59:47.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:46 smithi159 ceph-mon[36109]: pgmap v924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:59:47.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:46 smithi055 ceph-mon[31863]: pgmap v924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 204 B/s wr, 9 op/s 2024-03-28T05:59:47.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 658 sec 2024-03-28T05:59:48.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 659 sec 2024-03-28T05:59:49.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:48 smithi086 ceph-mon[35163]: pgmap v925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:59:49.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:48 smithi159 ceph-mon[36109]: pgmap v925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:59:49.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:48 smithi055 ceph-mon[31863]: pgmap v925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 204 B/s wr, 11 op/s 2024-03-28T05:59:49.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 660 sec 2024-03-28T05:59:50.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 661 sec 2024-03-28T05:59:51.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:50 smithi086 ceph-mon[35163]: pgmap v926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:59:51.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:50 smithi159 ceph-mon[36109]: pgmap v926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:59:51.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:50 smithi055 ceph-mon[31863]: pgmap v926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-03-28T05:59:51.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 662 sec 2024-03-28T05:59:52.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 663 sec 2024-03-28T05:59:53.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:52 smithi086 ceph-mon[35163]: pgmap v927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:53.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:52 smithi159 ceph-mon[36109]: pgmap v927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:53.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:52 smithi055 ceph-mon[31863]: pgmap v927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:53.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 664 sec 2024-03-28T05:59:54.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 665 sec 2024-03-28T05:59:55.007 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:54 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 5. 2024-03-28T05:59:55.008 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:54 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:55.008 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:54 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.776s CPU time. 2024-03-28T05:59:55.008 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:54 smithi055 systemd[1]: Starting Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715... 2024-03-28T05:59:55.008 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:54 smithi055 ceph-mon[31863]: pgmap v928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:55.008 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:59:55.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:54 smithi086 ceph-mon[35163]: pgmap v928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:55.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:59:55.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:54 smithi159 ceph-mon[36109]: pgmap v928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T05:59:55.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T05:59:55.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 666 sec 2024-03-28T05:59:55.363 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 podman[90205]: 2024-03-28 05:59:54.921334921 +0000 UTC m=+0.035974302 image pull c664afe56bb01db4f9afa9532c20598e201e664f2e9ba2be50db0d52674a26d2 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc 2024-03-28T05:59:55.364 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 podman[90205]: 2024-03-28 05:59:55.062143059 +0000 UTC m=+0.176782484 container create 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 podman[90205]: 2024-03-28 05:59:55.440108072 +0000 UTC m=+0.554747450 container init 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, CEPH_POINT_RELEASE=) 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 podman[90205]: 2024-03-28 05:59:55.449971324 +0000 UTC m=+0.564610701 container start 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mds[90272]: -- 172.21.15.55:0/3145664297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56016850fa40 con 0x5601684e3000 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: starting mds.j at 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 bash[90205]: 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c 2024-03-28T05:59:55.705 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:55 smithi055 systemd[1]: Started Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: daemon mds.j restarted 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:56.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: osdmap e137: 12 total, 12 up, 12 in 2024-03-28T05:59:56.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:boot 2024-03-28T05:59:56.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:56.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:56.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:56.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:55 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: daemon mds.j restarted 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: osdmap e137: 12 total, 12 up, 12 in 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:boot 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:56.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:55 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: daemon mds.j restarted 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: osdmap e137: 12 total, 12 up, 12 in 2024-03-28T05:59:56.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:boot 2024-03-28T05:59:56.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-03-28T05:59:56.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-03-28T05:59:56.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-28T05:59:56.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:55 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:56.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 667 sec 2024-03-28T05:59:57.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:56 smithi086 ceph-mon[35163]: pgmap v929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2024-03-28T05:59:57.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:56 smithi086 ceph-mon[35163]: pgmap v930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:59:57.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:56 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:resolve 2024-03-28T05:59:57.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:56 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:57.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:56 smithi159 ceph-mon[36109]: pgmap v929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2024-03-28T05:59:57.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:56 smithi159 ceph-mon[36109]: pgmap v930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:59:57.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:56 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:resolve 2024-03-28T05:59:57.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:56 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:57.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:56 smithi055 ceph-mon[31863]: pgmap v929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2024-03-28T05:59:57.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:56 smithi055 ceph-mon[31863]: pgmap v930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-28T05:59:57.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:56 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:resolve 2024-03-28T05:59:57.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:56 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:57.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 668 sec 2024-03-28T05:59:58.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 669 sec 2024-03-28T05:59:58.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:58 smithi086 ceph-mon[35163]: pgmap v932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-03-28T05:59:58.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:58 smithi086 ceph-mon[35163]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:58.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:58 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:reconnect 2024-03-28T05:59:58.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:58 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:58.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:58 smithi159 ceph-mon[36109]: pgmap v932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-03-28T05:59:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:58 smithi159 ceph-mon[36109]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:58 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:reconnect 2024-03-28T05:59:58.811 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:58 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:58.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:58 smithi055 ceph-mon[31863]: pgmap v932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-03-28T05:59:58.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:58 smithi055 ceph-mon[31863]: reconnect by client.15270 192.168.0.1:0/1775161137 after 0.00299994 2024-03-28T05:59:58.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:58 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:reconnect 2024-03-28T05:59:58.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:58 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:59.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 670 sec 2024-03-28T05:59:59.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:59 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:rejoin 2024-03-28T05:59:59.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:59 smithi086 ceph-mon[35163]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:59.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 05:59:59 smithi086 ceph-mon[35163]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:59.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:59 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:rejoin 2024-03-28T05:59:59.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:59 smithi159 ceph-mon[36109]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:59.810 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 05:59:59 smithi159 ceph-mon[36109]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:59.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:rejoin 2024-03-28T05:59:59.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-mon[31863]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=e=up:active} 2 up:standby-replay 2024-03-28T05:59:59.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-mon[31863]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9bc9000700 time 2024-03-28T05:59:59.608303+0000 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9bd49ab4a1] 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.866 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: clone() 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.611+0000 7f9bc9000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9bc9000700 time 2024-03-28T05:59:59.608303+0000 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9bd49ab4a1] 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.867 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: clone() 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: *** Caught signal (Aborted) ** 2024-03-28T05:59:59.868 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: in thread 7f9bc9000700 thread_name:ms_dispatch 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9bd3732d20] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: gsignal() 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: abort() 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9bd49ab4fb] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.869 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 19: clone() 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.617+0000 7f9bc9000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:59.870 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: in thread 7f9bc9000700 thread_name:ms_dispatch 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9bd3732d20] 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: gsignal() 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: abort() 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9bd49ab4fb] 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.871 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 19: clone() 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:59.872 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: -1> 2024-03-28T05:59:59.611+0000 7f9bc9000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9bc9000700 time 2024-03-28T05:59:59.608303+0000 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9bd49ab4a1] 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.873 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: clone() 2024-03-28T05:59:59.874 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 0> 2024-03-28T05:59:59.617+0000 7f9bc9000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: in thread 7f9bc9000700 thread_name:ms_dispatch 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9bd3732d20] 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: gsignal() 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: abort() 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9bd49ab4fb] 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.875 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.876 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 19: clone() 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: -1> 2024-03-28T05:59:59.611+0000 7f9bc9000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: In function 'void Locker::set_xlocks_done(MutationImpl*, bool)' thread 7f9bc9000700 time 2024-03-28T05:59:59.608303+0000 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el8/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/mds/Locker.cc: 626: FAILED ceph_assert(obj->is_auth()) 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.877 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9bd49ab4a1] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.878 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: clone() 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 0> 2024-03-28T05:59:59.617+0000 7f9bc9000700 -1 *** Caught signal (Aborted) ** 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: in thread 7f9bc9000700 thread_name:ms_dispatch 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: ceph version 19.0.0-2145-g3be9a5c9 (3be9a5c9bc793e11e2800a8c0c696e8b46742033) squid (dev) 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9bd3732d20] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2: gsignal() 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 3: abort() 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9bd49ab4fb] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d2667) [0x7f9bd49ab667] 2024-03-28T05:59:59.879 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 6: (Locker::set_xlocks_done(MutationImpl*, bool)+0x493) [0x560166e4c223] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 7: (Server::early_reply(boost::intrusive_ptr const&, CInode*, CDentry*)+0x3e6) [0x560166cc65d6] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 8: (Server::journal_and_reply(boost::intrusive_ptr const&, CInode*, CDentry*, LogEvent*, MDSLogContextBase*)+0xc1) [0x560166cc6da1] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 9: (Server::handle_client_openc(boost::intrusive_ptr const&)+0xa9c) [0x560166cfb09c] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 10: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x733) [0x560166d19233] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 11: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560166d1b197] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560166c1a11b] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560166c1a6bc] 2024-03-28T05:59:59.880 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bf) [0x560166c041ff] 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 15: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7f9bd4c3d488] 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 16: (DispatchQueue::entry()+0x51f) [0x7f9bd4c3a60f] 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9bd4d0de81] 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9bd37281ca] 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 19: clone() 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j[90236]: 2024-03-28T05:59:59.881 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 05:59:59 smithi055 podman[90308]: 2024-03-28 05:59:59.752326972 +0000 UTC m=+0.041984590 container died 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-28T06:00:00.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 671 sec 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: pgmap v933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 133 B/s wr, 5 op/s 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:active 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: Health detail: HEALTH_WARN 5 failed cephadm daemon(s) 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: [WRN] CEPHADM_FAILED_DAEMON: 5 failed cephadm daemon(s) 2024-03-28T06:00:00.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: daemon mds.g on smithi055 is in unknown state 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: daemon mds.h on smithi086 is in error state 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: daemon mds.l on smithi159 is in error state 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: daemon mds.f on smithi159 is in error state 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:00 smithi086 ceph-mon[35163]: daemon mds.i on smithi159 is in error state 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:00 smithi055 podman[90308]: 2024-03-28 06:00:00.786574883 +0000 UTC m=+1.076232522 container remove 2de39eebecec23f3d7bd2ee7b7ab29c423d315b9929e6a8065fc4775cc33217c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9b48cbed4f912cd766666ab034815156a50a4f9b95481e98a662f737d54a2abc, name=ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-main-20240318.032620-3be9a5c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:00 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-03-28T06:00:00.811 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: pgmap v933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 133 B/s wr, 5 op/s 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:active 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: Health detail: HEALTH_WARN 5 failed cephadm daemon(s) 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: [WRN] CEPHADM_FAILED_DAEMON: 5 failed cephadm daemon(s) 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: daemon mds.g on smithi055 is in unknown state 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: daemon mds.h on smithi086 is in error state 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: daemon mds.l on smithi159 is in error state 2024-03-28T06:00:00.812 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: daemon mds.f on smithi159 is in error state 2024-03-28T06:00:00.813 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:00 smithi055 ceph-mon[31863]: daemon mds.i on smithi159 is in error state 2024-03-28T06:00:00.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: pgmap v933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 133 B/s wr, 5 op/s 2024-03-28T06:00:00.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-28T06:00:00.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.55:6834/2974869858,v1:172.21.15.55:6835/2974869858] up:active 2024-03-28T06:00:00.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: Health detail: HEALTH_WARN 5 failed cephadm daemon(s) 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: [WRN] CEPHADM_FAILED_DAEMON: 5 failed cephadm daemon(s) 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: daemon mds.g on smithi055 is in unknown state 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: daemon mds.h on smithi086 is in error state 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: daemon mds.l on smithi159 is in error state 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: daemon mds.f on smithi159 is in error state 2024-03-28T06:00:00.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:00 smithi159 ceph-mon[36109]: daemon mds.i on smithi159 is in error state 2024-03-28T06:00:01.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 672 sec 2024-03-28T06:00:01.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:01 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T06:00:01.614 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:01 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.579s CPU time. 2024-03-28T06:00:02.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 673 sec 2024-03-28T06:00:02.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:02 smithi055 ceph-mon[31863]: pgmap v934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 133 B/s wr, 8 op/s 2024-03-28T06:00:03.059 INFO:journalctl@ceph.mds.b.smithi086.stdout:Mar 28 06:00:02 smithi086 ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715-mds-b[65309]: 2024-03-28T06:00:02.715+0000 7f3661400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T06:00:03.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:02 smithi086 ceph-mon[35163]: pgmap v934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 133 B/s wr, 8 op/s 2024-03-28T06:00:03.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:02 smithi159 ceph-mon[36109]: pgmap v934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 133 B/s wr, 8 op/s 2024-03-28T06:00:03.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 674 sec 2024-03-28T06:00:04.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 675 sec 2024-03-28T06:00:04.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:04 smithi055 ceph-mon[31863]: pgmap v935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-28T06:00:05.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:04 smithi086 ceph-mon[35163]: pgmap v935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-28T06:00:05.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:04 smithi159 ceph-mon[36109]: pgmap v935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-03-28T06:00:05.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 676 sec 2024-03-28T06:00:06.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 677 sec 2024-03-28T06:00:06.863 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:06 smithi159 ceph-mon[36109]: pgmap v936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T06:00:06.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:06 smithi055 ceph-mon[31863]: pgmap v936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T06:00:07.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:06 smithi086 ceph-mon[35163]: pgmap v936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-03-28T06:00:07.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 678 sec 2024-03-28T06:00:08.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 679 sec 2024-03-28T06:00:08.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:08 smithi055 ceph-mon[31863]: pgmap v937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T06:00:09.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:08 smithi086 ceph-mon[35163]: pgmap v937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T06:00:09.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:08 smithi159 ceph-mon[36109]: pgmap v937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-03-28T06:00:09.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 680 sec 2024-03-28T06:00:10.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 681 sec 2024-03-28T06:00:10.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:10 smithi055 ceph-mon[31863]: pgmap v938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T06:00:11.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:10 smithi086 ceph-mon[35163]: pgmap v938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T06:00:11.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:10 smithi159 ceph-mon[36109]: pgmap v938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-03-28T06:00:11.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 682 sec 2024-03-28T06:00:11.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Scheduled restart job, restart counter is at 6. 2024-03-28T06:00:11.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: Stopped Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T06:00:11.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Consumed 1.579s CPU time. 2024-03-28T06:00:11.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Start request repeated too quickly. 2024-03-28T06:00:11.864 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: ceph-5f86a62c-ecc4-11ee-95d0-87774f69a715@mds.j.service: Failed with result 'exit-code'. 2024-03-28T06:00:11.865 INFO:journalctl@ceph.mds.j.smithi055.stdout:Mar 28 06:00:11 smithi055 systemd[1]: Failed to start Ceph mds.j for 5f86a62c-ecc4-11ee-95d0-87774f69a715. 2024-03-28T06:00:12.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 683 sec 2024-03-28T06:00:12.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:12 smithi055 ceph-mon[31863]: pgmap v939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T06:00:13.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:12 smithi086 ceph-mon[35163]: pgmap v939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T06:00:13.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:12 smithi159 ceph-mon[36109]: pgmap v939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 1023 B/s wr, 10 op/s 2024-03-28T06:00:13.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 684 sec 2024-03-28T06:00:14.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 685 sec 2024-03-28T06:00:14.861 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:14 smithi086 ceph-mon[35163]: pgmap v940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 8 op/s 2024-03-28T06:00:14.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:14 smithi055 ceph-mon[31863]: pgmap v940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 8 op/s 2024-03-28T06:00:15.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:14 smithi159 ceph-mon[36109]: pgmap v940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 8 op/s 2024-03-28T06:00:15.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 686 sec 2024-03-28T06:00:16.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 687 sec 2024-03-28T06:00:16.864 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:16 smithi055 ceph-mon[31863]: pgmap v941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-03-28T06:00:17.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:16 smithi086 ceph-mon[35163]: pgmap v941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-03-28T06:00:17.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:16 smithi159 ceph-mon[36109]: pgmap v941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-03-28T06:00:17.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 688 sec 2024-03-28T06:00:18.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 689 sec 2024-03-28T06:00:19.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:18 smithi086 ceph-mon[35163]: pgmap v942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:19.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:18 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:19.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:18 smithi159 ceph-mon[36109]: pgmap v942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:19.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:18 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:19.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:18 smithi055 ceph-mon[31863]: pgmap v942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:19.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:18 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:00:19.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 690 sec 2024-03-28T06:00:20.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 691 sec 2024-03-28T06:00:21.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:20 smithi086 ceph-mon[35163]: pgmap v943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:21.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:20 smithi159 ceph-mon[36109]: pgmap v943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:21.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:20 smithi055 ceph-mon[31863]: pgmap v943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:21.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 692 sec 2024-03-28T06:00:22.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 693 sec 2024-03-28T06:00:23.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:22 smithi086 ceph-mon[35163]: pgmap v944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:23.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:22 smithi159 ceph-mon[36109]: pgmap v944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:23.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:22 smithi055 ceph-mon[31863]: pgmap v944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:23.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 694 sec 2024-03-28T06:00:24.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 695 sec 2024-03-28T06:00:25.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:24 smithi086 ceph-mon[35163]: pgmap v945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:25.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:24 smithi159 ceph-mon[36109]: pgmap v945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:25.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:24 smithi055 ceph-mon[31863]: pgmap v945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:25.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 696 sec 2024-03-28T06:00:26.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 697 sec 2024-03-28T06:00:26.982 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:26 smithi086 ceph-mon[35163]: pgmap v946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:27.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:26 smithi159 ceph-mon[36109]: pgmap v946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:27.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:26 smithi055 ceph-mon[31863]: pgmap v946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:27.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 698 sec 2024-03-28T06:00:28.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 699 sec 2024-03-28T06:00:29.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:28 smithi086 ceph-mon[35163]: pgmap v947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:29.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:28 smithi159 ceph-mon[36109]: pgmap v947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:29.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:28 smithi055 ceph-mon[31863]: pgmap v947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:29.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 700 sec 2024-03-28T06:00:30.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 701 sec 2024-03-28T06:00:31.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:30 smithi086 ceph-mon[35163]: pgmap v948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:31.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:30 smithi159 ceph-mon[36109]: pgmap v948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:31.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:30 smithi055 ceph-mon[31863]: pgmap v948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:31.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 702 sec 2024-03-28T06:00:32.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 703 sec 2024-03-28T06:00:33.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:32 smithi086 ceph-mon[35163]: pgmap v949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:33.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:32 smithi159 ceph-mon[36109]: pgmap v949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:33.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:32 smithi055 ceph-mon[31863]: pgmap v949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:33.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 704 sec 2024-03-28T06:00:34.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 705 sec 2024-03-28T06:00:35.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:34 smithi086 ceph-mon[35163]: pgmap v950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:35.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:34 smithi159 ceph-mon[36109]: pgmap v950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:35.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:34 smithi055 ceph-mon[31863]: pgmap v950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:35.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 706 sec 2024-03-28T06:00:36.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 707 sec 2024-03-28T06:00:37.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:36 smithi086 ceph-mon[35163]: pgmap v951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:37.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:36 smithi159 ceph-mon[36109]: pgmap v951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:37.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:36 smithi055 ceph-mon[31863]: pgmap v951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:37.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 708 sec 2024-03-28T06:00:38.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 709 sec 2024-03-28T06:00:39.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:38 smithi086 ceph-mon[35163]: pgmap v952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:39.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:38 smithi159 ceph-mon[36109]: pgmap v952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:39.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:38 smithi055 ceph-mon[31863]: pgmap v952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:39.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 710 sec 2024-03-28T06:00:40.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 711 sec 2024-03-28T06:00:41.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:40 smithi086 ceph-mon[35163]: pgmap v953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:41.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:40 smithi159 ceph-mon[36109]: pgmap v953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:41.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:40 smithi055 ceph-mon[31863]: pgmap v953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:41.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 712 sec 2024-03-28T06:00:42.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 713 sec 2024-03-28T06:00:43.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:42 smithi086 ceph-mon[35163]: pgmap v954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:43.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:42 smithi159 ceph-mon[36109]: pgmap v954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:43.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:42 smithi055 ceph-mon[31863]: pgmap v954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:43.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 714 sec 2024-03-28T06:00:44.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 715 sec 2024-03-28T06:00:45.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:44 smithi086 ceph-mon[35163]: pgmap v955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:45.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:44 smithi159 ceph-mon[36109]: pgmap v955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:45.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:44 smithi055 ceph-mon[31863]: pgmap v955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:45.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 716 sec 2024-03-28T06:00:46.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 717 sec 2024-03-28T06:00:47.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:46 smithi086 ceph-mon[35163]: pgmap v956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:47.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:46 smithi159 ceph-mon[36109]: pgmap v956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:47.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:46 smithi055 ceph-mon[31863]: pgmap v956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:47.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 718 sec 2024-03-28T06:00:48.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 719 sec 2024-03-28T06:00:49.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:48 smithi086 ceph-mon[35163]: pgmap v957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:49.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:48 smithi159 ceph-mon[36109]: pgmap v957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:49.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:48 smithi055 ceph-mon[31863]: pgmap v957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:49.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 720 sec 2024-03-28T06:00:50.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 721 sec 2024-03-28T06:00:51.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:50 smithi086 ceph-mon[35163]: pgmap v958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:51.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:50 smithi159 ceph-mon[36109]: pgmap v958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:51.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:50 smithi055 ceph-mon[31863]: pgmap v958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:51.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 722 sec 2024-03-28T06:00:52.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 723 sec 2024-03-28T06:00:53.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:52 smithi086 ceph-mon[35163]: pgmap v959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:53.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:52 smithi159 ceph-mon[36109]: pgmap v959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:53.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:52 smithi055 ceph-mon[31863]: pgmap v959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:53.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 724 sec 2024-03-28T06:00:54.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 725 sec 2024-03-28T06:00:55.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:54 smithi086 ceph-mon[35163]: pgmap v960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:55.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:54 smithi159 ceph-mon[36109]: pgmap v960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:55.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:54 smithi055 ceph-mon[31863]: pgmap v960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:55.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 726 sec 2024-03-28T06:00:56.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:00:56.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:00:56.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:00:56.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 727 sec 2024-03-28T06:00:57.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:56 smithi086 ceph-mon[35163]: pgmap v961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:57.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:56 smithi159 ceph-mon[36109]: pgmap v961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:57.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:56 smithi055 ceph-mon[31863]: pgmap v961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:00:57.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 728 sec 2024-03-28T06:00:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:00:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:00:58.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:57 smithi086 ceph-mon[35163]: pgmap v962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:58.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:57 smithi086 ceph-mon[35163]: pgmap v963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:58.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:00:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:00:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:00:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:57 smithi159 ceph-mon[36109]: pgmap v962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:57 smithi159 ceph-mon[36109]: pgmap v963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:00:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:00:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:00:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:57 smithi055 ceph-mon[31863]: pgmap v962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:00:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:57 smithi055 ceph-mon[31863]: pgmap v963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:00:58.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 729 sec 2024-03-28T06:00:59.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 730 sec 2024-03-28T06:00:59.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:00:59 smithi086 ceph-mon[35163]: pgmap v964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:59.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:00:59 smithi159 ceph-mon[36109]: pgmap v964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:00:59.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:00:59 smithi055 ceph-mon[31863]: pgmap v964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:00.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 731 sec 2024-03-28T06:01:01.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 732 sec 2024-03-28T06:01:01.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:01 smithi086 ceph-mon[35163]: pgmap v965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:01 smithi159 ceph-mon[36109]: pgmap v965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:01 smithi055 ceph-mon[31863]: pgmap v965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:02.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 733 sec 2024-03-28T06:01:03.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 734 sec 2024-03-28T06:01:03.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:03 smithi086 ceph-mon[35163]: pgmap v966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:03.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:03 smithi159 ceph-mon[36109]: pgmap v966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:03.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:03 smithi055 ceph-mon[31863]: pgmap v966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:04.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 735 sec 2024-03-28T06:01:05.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 736 sec 2024-03-28T06:01:05.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:05 smithi086 ceph-mon[35163]: pgmap v967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:05.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:05 smithi159 ceph-mon[36109]: pgmap v967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:05.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:05 smithi055 ceph-mon[31863]: pgmap v967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:06.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 737 sec 2024-03-28T06:01:07.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 738 sec 2024-03-28T06:01:07.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:07 smithi086 ceph-mon[35163]: pgmap v968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:07.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:07 smithi159 ceph-mon[36109]: pgmap v968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:07.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:07 smithi055 ceph-mon[31863]: pgmap v968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:08.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 739 sec 2024-03-28T06:01:09.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 740 sec 2024-03-28T06:01:09.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:09 smithi086 ceph-mon[35163]: pgmap v969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:09.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:09 smithi159 ceph-mon[36109]: pgmap v969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:09.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:09 smithi055 ceph-mon[31863]: pgmap v969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:10.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 741 sec 2024-03-28T06:01:11.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 742 sec 2024-03-28T06:01:12.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 743 sec 2024-03-28T06:01:12.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:12 smithi086 ceph-mon[35163]: pgmap v970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:12.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:12 smithi159 ceph-mon[36109]: pgmap v970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:12.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:12 smithi055 ceph-mon[31863]: pgmap v970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:13.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 744 sec 2024-03-28T06:01:14.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 745 sec 2024-03-28T06:01:14.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:14 smithi086 ceph-mon[35163]: pgmap v971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:14.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:14 smithi159 ceph-mon[36109]: pgmap v971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:14.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:14 smithi055 ceph-mon[31863]: pgmap v971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:15.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 746 sec 2024-03-28T06:01:16.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 747 sec 2024-03-28T06:01:16.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:16 smithi086 ceph-mon[35163]: pgmap v972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:16.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:16 smithi159 ceph-mon[36109]: pgmap v972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:16.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:16 smithi055 ceph-mon[31863]: pgmap v972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:17.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 748 sec 2024-03-28T06:01:18.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 749 sec 2024-03-28T06:01:18.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:18 smithi086 ceph-mon[35163]: pgmap v973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:18.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:18 smithi159 ceph-mon[36109]: pgmap v973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:18.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:18 smithi055 ceph-mon[31863]: pgmap v973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:19.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 750 sec 2024-03-28T06:01:20.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 751 sec 2024-03-28T06:01:20.311 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:20 smithi086 ceph-mon[35163]: pgmap v974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:20 smithi159 ceph-mon[36109]: pgmap v974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:20.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:20 smithi055 ceph-mon[31863]: pgmap v974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:21.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 752 sec 2024-03-28T06:01:22.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 753 sec 2024-03-28T06:01:22.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:22 smithi086 ceph-mon[35163]: pgmap v975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:22.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:22 smithi159 ceph-mon[36109]: pgmap v975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:22.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:22 smithi055 ceph-mon[31863]: pgmap v975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:23.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 754 sec 2024-03-28T06:01:24.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 755 sec 2024-03-28T06:01:24.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:24 smithi086 ceph-mon[35163]: pgmap v976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:24.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:24 smithi159 ceph-mon[36109]: pgmap v976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:24.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:24 smithi055 ceph-mon[31863]: pgmap v976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:25.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 756 sec 2024-03-28T06:01:26.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 757 sec 2024-03-28T06:01:26.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:26 smithi086 ceph-mon[35163]: pgmap v977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:26.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:26 smithi159 ceph-mon[36109]: pgmap v977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:26.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:26 smithi055 ceph-mon[31863]: pgmap v977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:01:27.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 758 sec 2024-03-28T06:01:28.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 759 sec 2024-03-28T06:01:28.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:28 smithi055 ceph-mon[31863]: pgmap v978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:28.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:28 smithi086 ceph-mon[35163]: pgmap v978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:28.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:28 smithi159 ceph-mon[36109]: pgmap v978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:29.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 760 sec 2024-03-28T06:01:30.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 761 sec 2024-03-28T06:01:30.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:30 smithi055 ceph-mon[31863]: pgmap v979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:30.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:30 smithi086 ceph-mon[35163]: pgmap v979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:30.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:30 smithi159 ceph-mon[36109]: pgmap v979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:31.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 762 sec 2024-03-28T06:01:32.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 763 sec 2024-03-28T06:01:32.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:32 smithi055 ceph-mon[31863]: pgmap v980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:32.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:32 smithi086 ceph-mon[35163]: pgmap v980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:32.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:32 smithi159 ceph-mon[36109]: pgmap v980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:33.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 764 sec 2024-03-28T06:01:34.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 765 sec 2024-03-28T06:01:34.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:34 smithi055 ceph-mon[31863]: pgmap v981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:34.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:34 smithi086 ceph-mon[35163]: pgmap v981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:34.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:34 smithi159 ceph-mon[36109]: pgmap v981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:01:35.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 766 sec 2024-03-28T06:01:36.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 767 sec 2024-03-28T06:01:36.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:36 smithi055 ceph-mon[31863]: pgmap v982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:36.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:36 smithi086 ceph-mon[35163]: pgmap v982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:36.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:36 smithi159 ceph-mon[36109]: pgmap v982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:37.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 768 sec 2024-03-28T06:01:38.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 769 sec 2024-03-28T06:01:38.363 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:38 smithi159 ceph-mon[36109]: pgmap v983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:38.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:38 smithi055 ceph-mon[31863]: pgmap v983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:38.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:38 smithi086 ceph-mon[35163]: pgmap v983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:39.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 770 sec 2024-03-28T06:01:40.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 771 sec 2024-03-28T06:01:40.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:40 smithi086 ceph-mon[35163]: pgmap v984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:40.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:40 smithi159 ceph-mon[36109]: pgmap v984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:40.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:40 smithi055 ceph-mon[31863]: pgmap v984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:41.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 772 sec 2024-03-28T06:01:42.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 773 sec 2024-03-28T06:01:42.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:42 smithi086 ceph-mon[35163]: pgmap v985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:42.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:42 smithi159 ceph-mon[36109]: pgmap v985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:42.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:42 smithi055 ceph-mon[31863]: pgmap v985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:43.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 774 sec 2024-03-28T06:01:44.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 775 sec 2024-03-28T06:01:44.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:44 smithi086 ceph-mon[35163]: pgmap v986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:44.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:44 smithi159 ceph-mon[36109]: pgmap v986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:44.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:44 smithi055 ceph-mon[31863]: pgmap v986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:45.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 776 sec 2024-03-28T06:01:46.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 777 sec 2024-03-28T06:01:46.415 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:46 smithi055 ceph-mon[31863]: pgmap v987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:46.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:46 smithi086 ceph-mon[35163]: pgmap v987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:46.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:46 smithi159 ceph-mon[36109]: pgmap v987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:47.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 778 sec 2024-03-28T06:01:48.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 779 sec 2024-03-28T06:01:48.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:48 smithi086 ceph-mon[35163]: pgmap v988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:48.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:48 smithi159 ceph-mon[36109]: pgmap v988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:48.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:48 smithi055 ceph-mon[31863]: pgmap v988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:49.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 780 sec 2024-03-28T06:01:50.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 781 sec 2024-03-28T06:01:50.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:50 smithi086 ceph-mon[35163]: pgmap v989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:50.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:50 smithi159 ceph-mon[36109]: pgmap v989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:50.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:50 smithi055 ceph-mon[31863]: pgmap v989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:51.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 782 sec 2024-03-28T06:01:52.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 783 sec 2024-03-28T06:01:52.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:52 smithi086 ceph-mon[35163]: pgmap v990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:52.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:52 smithi159 ceph-mon[36109]: pgmap v990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:52.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:52 smithi055 ceph-mon[31863]: pgmap v990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:53.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 784 sec 2024-03-28T06:01:54.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 785 sec 2024-03-28T06:01:54.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:54 smithi086 ceph-mon[35163]: pgmap v991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:54.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:54 smithi159 ceph-mon[36109]: pgmap v991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:54.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:54 smithi055 ceph-mon[31863]: pgmap v991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:55.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 786 sec 2024-03-28T06:01:56.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 787 sec 2024-03-28T06:01:56.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:56 smithi086 ceph-mon[35163]: pgmap v992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:56.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:56 smithi159 ceph-mon[36109]: pgmap v992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:56.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:56 smithi055 ceph-mon[31863]: pgmap v992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:01:57.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 788 sec 2024-03-28T06:01:58.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 789 sec 2024-03-28T06:01:58.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:58 smithi086 ceph-mon[35163]: pgmap v993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:58.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:01:58.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:58 smithi159 ceph-mon[36109]: pgmap v993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:58.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:01:58.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:58 smithi055 ceph-mon[31863]: pgmap v993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:58.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:01:59.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 790 sec 2024-03-28T06:01:59.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:01:59.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:01:59.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:01:59.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: pgmap v994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:59.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: pgmap v995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:59.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:01:59.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: pgmap v994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: pgmap v995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:59.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:01:59.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: pgmap v994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: pgmap v995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:01:59.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:02:00.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 791 sec 2024-03-28T06:02:01.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 792 sec 2024-03-28T06:02:02.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:01 smithi055 ceph-mon[31863]: pgmap v996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:02.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 793 sec 2024-03-28T06:02:02.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:01 smithi086 ceph-mon[35163]: pgmap v996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:02.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:01 smithi159 ceph-mon[36109]: pgmap v996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:03.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 794 sec 2024-03-28T06:02:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:03 smithi055 ceph-mon[31863]: pgmap v997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:02:04.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 795 sec 2024-03-28T06:02:04.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:03 smithi086 ceph-mon[35163]: pgmap v997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:02:04.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:03 smithi159 ceph-mon[36109]: pgmap v997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:02:05.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 796 sec 2024-03-28T06:02:06.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:05 smithi055 ceph-mon[31863]: pgmap v998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:06.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 797 sec 2024-03-28T06:02:06.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:05 smithi086 ceph-mon[35163]: pgmap v998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:06.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:05 smithi159 ceph-mon[36109]: pgmap v998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:07.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 798 sec 2024-03-28T06:02:08.113 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:07 smithi159 ceph-mon[36109]: pgmap v999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:08.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:07 smithi055 ceph-mon[31863]: pgmap v999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:08.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 799 sec 2024-03-28T06:02:08.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:07 smithi086 ceph-mon[35163]: pgmap v999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:02:09.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 800 sec 2024-03-28T06:02:10.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:09 smithi055 ceph-mon[31863]: pgmap v1000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:10.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 801 sec 2024-03-28T06:02:10.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:09 smithi086 ceph-mon[35163]: pgmap v1000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:10.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:09 smithi159 ceph-mon[36109]: pgmap v1000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:02:11.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 802 sec 2024-03-28T06:02:12.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:11 smithi055 ceph-mon[31863]: pgmap v1001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:12.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 803 sec 2024-03-28T06:02:12.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:11 smithi086 ceph-mon[35163]: pgmap v1001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:12.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:11 smithi159 ceph-mon[36109]: pgmap v1001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:13.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 804 sec 2024-03-28T06:02:14.111 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:13 smithi086 ceph-mon[35163]: pgmap v1002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:14.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:13 smithi055 ceph-mon[31863]: pgmap v1002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:14.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 805 sec 2024-03-28T06:02:14.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:13 smithi159 ceph-mon[36109]: pgmap v1002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:15.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 806 sec 2024-03-28T06:02:16.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 807 sec 2024-03-28T06:02:16.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:15 smithi086 ceph-mon[35163]: pgmap v1003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:16.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:15 smithi159 ceph-mon[36109]: pgmap v1003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:16.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:15 smithi055 ceph-mon[31863]: pgmap v1003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:17.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 808 sec 2024-03-28T06:02:18.165 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:17 smithi055 ceph-mon[31863]: pgmap v1004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:18.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 809 sec 2024-03-28T06:02:18.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:17 smithi086 ceph-mon[35163]: pgmap v1004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:18.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:17 smithi159 ceph-mon[36109]: pgmap v1004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:19.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 810 sec 2024-03-28T06:02:20.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 811 sec 2024-03-28T06:02:20.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:19 smithi086 ceph-mon[35163]: pgmap v1005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:20.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:19 smithi159 ceph-mon[36109]: pgmap v1005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:20.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:19 smithi055 ceph-mon[31863]: pgmap v1005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:21.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 812 sec 2024-03-28T06:02:22.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 813 sec 2024-03-28T06:02:22.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:21 smithi086 ceph-mon[35163]: pgmap v1006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:22.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:21 smithi159 ceph-mon[36109]: pgmap v1006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:22.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:21 smithi055 ceph-mon[31863]: pgmap v1006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:23.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 814 sec 2024-03-28T06:02:24.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 815 sec 2024-03-28T06:02:24.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:23 smithi086 ceph-mon[35163]: pgmap v1007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:24.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:23 smithi159 ceph-mon[36109]: pgmap v1007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:24.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:23 smithi055 ceph-mon[31863]: pgmap v1007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:25.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 816 sec 2024-03-28T06:02:26.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 817 sec 2024-03-28T06:02:26.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:25 smithi086 ceph-mon[35163]: pgmap v1008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:26.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:25 smithi159 ceph-mon[36109]: pgmap v1008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:26.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:25 smithi055 ceph-mon[31863]: pgmap v1008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:27.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 818 sec 2024-03-28T06:02:28.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 819 sec 2024-03-28T06:02:28.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:27 smithi086 ceph-mon[35163]: pgmap v1009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:28.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:27 smithi159 ceph-mon[36109]: pgmap v1009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:28.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:27 smithi055 ceph-mon[31863]: pgmap v1009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:29.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 820 sec 2024-03-28T06:02:30.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 821 sec 2024-03-28T06:02:30.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:29 smithi086 ceph-mon[35163]: pgmap v1010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:30.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:29 smithi159 ceph-mon[36109]: pgmap v1010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:30.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:29 smithi055 ceph-mon[31863]: pgmap v1010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:31.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 822 sec 2024-03-28T06:02:32.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 823 sec 2024-03-28T06:02:32.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:31 smithi086 ceph-mon[35163]: pgmap v1011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:32.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:31 smithi159 ceph-mon[36109]: pgmap v1011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:32.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:31 smithi055 ceph-mon[31863]: pgmap v1011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:33.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 824 sec 2024-03-28T06:02:34.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 825 sec 2024-03-28T06:02:34.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:33 smithi086 ceph-mon[35163]: pgmap v1012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:34.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:33 smithi159 ceph-mon[36109]: pgmap v1012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:34.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:33 smithi055 ceph-mon[31863]: pgmap v1012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:35.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 826 sec 2024-03-28T06:02:36.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 827 sec 2024-03-28T06:02:36.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:35 smithi086 ceph-mon[35163]: pgmap v1013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:36.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:35 smithi159 ceph-mon[36109]: pgmap v1013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:36.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:35 smithi055 ceph-mon[31863]: pgmap v1013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:37.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 828 sec 2024-03-28T06:02:37.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:37 smithi086 ceph-mon[35163]: pgmap v1014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:37.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:37 smithi159 ceph-mon[36109]: pgmap v1014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:37.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:37 smithi055 ceph-mon[31863]: pgmap v1014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:38.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 829 sec 2024-03-28T06:02:39.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 830 sec 2024-03-28T06:02:40.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:39 smithi055 ceph-mon[31863]: pgmap v1015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:40.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 831 sec 2024-03-28T06:02:40.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:39 smithi086 ceph-mon[35163]: pgmap v1015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:40.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:39 smithi159 ceph-mon[36109]: pgmap v1015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:41.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 832 sec 2024-03-28T06:02:42.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:41 smithi055 ceph-mon[31863]: pgmap v1016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:42.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 833 sec 2024-03-28T06:02:42.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:41 smithi086 ceph-mon[35163]: pgmap v1016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:42.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:41 smithi159 ceph-mon[36109]: pgmap v1016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:43.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 834 sec 2024-03-28T06:02:44.111 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:43 smithi086 ceph-mon[35163]: pgmap v1017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:44.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:43 smithi055 ceph-mon[31863]: pgmap v1017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:44.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 835 sec 2024-03-28T06:02:44.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:43 smithi159 ceph-mon[36109]: pgmap v1017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:45.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 836 sec 2024-03-28T06:02:46.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:45 smithi055 ceph-mon[31863]: pgmap v1018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:46.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 837 sec 2024-03-28T06:02:46.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:45 smithi086 ceph-mon[35163]: pgmap v1018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:46.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:45 smithi159 ceph-mon[36109]: pgmap v1018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:47.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 838 sec 2024-03-28T06:02:48.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 839 sec 2024-03-28T06:02:48.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:47 smithi086 ceph-mon[35163]: pgmap v1019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:48.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:47 smithi159 ceph-mon[36109]: pgmap v1019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:48.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:47 smithi055 ceph-mon[31863]: pgmap v1019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:49.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 840 sec 2024-03-28T06:02:50.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:49 smithi055 ceph-mon[31863]: pgmap v1020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:50.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 841 sec 2024-03-28T06:02:50.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:49 smithi086 ceph-mon[35163]: pgmap v1020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:50.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:49 smithi159 ceph-mon[36109]: pgmap v1020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:51.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 842 sec 2024-03-28T06:02:52.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 843 sec 2024-03-28T06:02:52.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:51 smithi086 ceph-mon[35163]: pgmap v1021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:52.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:51 smithi159 ceph-mon[36109]: pgmap v1021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:52.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:51 smithi055 ceph-mon[31863]: pgmap v1021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:02:53.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 844 sec 2024-03-28T06:02:54.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 845 sec 2024-03-28T06:02:54.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:53 smithi086 ceph-mon[35163]: pgmap v1022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:54.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:53 smithi159 ceph-mon[36109]: pgmap v1022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:54.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:53 smithi055 ceph-mon[31863]: pgmap v1022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:02:55.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 846 sec 2024-03-28T06:02:56.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 847 sec 2024-03-28T06:02:56.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:55 smithi086 ceph-mon[35163]: pgmap v1023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:56.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:55 smithi159 ceph-mon[36109]: pgmap v1023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:56.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:55 smithi055 ceph-mon[31863]: pgmap v1023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:57.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 848 sec 2024-03-28T06:02:58.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 849 sec 2024-03-28T06:02:58.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:57 smithi086 ceph-mon[35163]: pgmap v1024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:58.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:57 smithi159 ceph-mon[36109]: pgmap v1024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:58.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:57 smithi055 ceph-mon[31863]: pgmap v1024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:02:59.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 850 sec 2024-03-28T06:03:00.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 851 sec 2024-03-28T06:03:00.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:59 smithi086 ceph-mon[35163]: pgmap v1025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:00.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:02:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:03:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:59 smithi159 ceph-mon[36109]: pgmap v1025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:00.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:02:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:03:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:59 smithi055 ceph-mon[31863]: pgmap v1025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:00.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:02:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:03:01.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 852 sec 2024-03-28T06:03:01.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:03:01.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:03:01.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:03:01.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:03:01.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:03:02.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 853 sec 2024-03-28T06:03:02.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:01 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:03:02.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:01 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:03:02.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:01 smithi086 ceph-mon[35163]: pgmap v1026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:02.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:01 smithi086 ceph-mon[35163]: pgmap v1027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:02.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:01 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:03:02.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:01 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:03:02.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:01 smithi159 ceph-mon[36109]: pgmap v1026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:02.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:01 smithi159 ceph-mon[36109]: pgmap v1027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:02.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:01 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:03:02.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:01 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:03:02.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:01 smithi055 ceph-mon[31863]: pgmap v1026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:02.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:01 smithi055 ceph-mon[31863]: pgmap v1027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:03.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 854 sec 2024-03-28T06:03:03.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:02 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 182.780277 secs 2024-03-28T06:03:03.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:02 smithi086 ceph-mon[35163]: slow request 182.780277 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:03:03.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:02 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 182.780277 secs 2024-03-28T06:03:03.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:02 smithi159 ceph-mon[36109]: slow request 182.780277 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:03:03.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:02 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 182.780277 secs 2024-03-28T06:03:03.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:02 smithi055 ceph-mon[31863]: slow request 182.780277 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:03:04.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 855 sec 2024-03-28T06:03:04.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:03 smithi086 ceph-mon[35163]: pgmap v1028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:04.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:03 smithi159 ceph-mon[36109]: pgmap v1028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:04.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:03 smithi055 ceph-mon[31863]: pgmap v1028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:05.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 856 sec 2024-03-28T06:03:05.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:05 smithi086 ceph-mon[35163]: pgmap v1029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:05.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:05 smithi159 ceph-mon[36109]: pgmap v1029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:05.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:05 smithi055 ceph-mon[31863]: pgmap v1029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:06.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 857 sec 2024-03-28T06:03:06.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:06 smithi055 ceph-mon[31863]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-03-28T06:03:06.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:06 smithi055 ceph-mon[31863]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T06:03:06.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:06 smithi055 ceph-mon[31863]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:03:06.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:06 smithi086 ceph-mon[35163]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-03-28T06:03:06.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:06 smithi086 ceph-mon[35163]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T06:03:06.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:06 smithi086 ceph-mon[35163]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:03:06.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:06 smithi159 ceph-mon[36109]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-03-28T06:03:06.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:06 smithi159 ceph-mon[36109]: mds.? [v2:172.21.15.86:6838/3285549085,v1:172.21.15.86:6839/3285549085] up:active 2024-03-28T06:03:06.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:06 smithi159 ceph-mon[36109]: fsmap cephfs:3 {0=b=up:active,1=j=up:active(laggy or crashed),2=e=up:active} 2 up:standby-replay 2024-03-28T06:03:07.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 858 sec 2024-03-28T06:03:07.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:07 smithi055 ceph-mon[31863]: pgmap v1030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:07.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:07 smithi086 ceph-mon[35163]: pgmap v1030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:07.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:07 smithi159 ceph-mon[36109]: pgmap v1030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:08.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 859 sec 2024-03-28T06:03:08.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 187.780401 secs 2024-03-28T06:03:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 187.780401 secs 2024-03-28T06:03:08.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 187.780401 secs 2024-03-28T06:03:09.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 860 sec 2024-03-28T06:03:09.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:09 smithi055 ceph-mon[31863]: pgmap v1031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:09.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:09 smithi086 ceph-mon[35163]: pgmap v1031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:09.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:09 smithi159 ceph-mon[36109]: pgmap v1031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:10.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 861 sec 2024-03-28T06:03:11.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 862 sec 2024-03-28T06:03:11.808 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:11 smithi086 ceph-mon[35163]: pgmap v1032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:03:11.809 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:11 smithi159 ceph-mon[36109]: pgmap v1032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:03:11.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:11 smithi055 ceph-mon[31863]: pgmap v1032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:03:12.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 863 sec 2024-03-28T06:03:12.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 192.780485 secs 2024-03-28T06:03:13.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 192.780485 secs 2024-03-28T06:03:13.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 192.780485 secs 2024-03-28T06:03:13.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 864 sec 2024-03-28T06:03:13.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:13 smithi055 ceph-mon[31863]: pgmap v1033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:14.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:13 smithi086 ceph-mon[35163]: pgmap v1033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:14.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:13 smithi159 ceph-mon[36109]: pgmap v1033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:14.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 865 sec 2024-03-28T06:03:15.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 866 sec 2024-03-28T06:03:15.860 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:15 smithi086 ceph-mon[35163]: pgmap v1034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:15.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:15 smithi055 ceph-mon[31863]: pgmap v1034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:16.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:15 smithi159 ceph-mon[36109]: pgmap v1034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:16.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 867 sec 2024-03-28T06:03:17.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 868 sec 2024-03-28T06:03:17.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:17 smithi055 ceph-mon[31863]: pgmap v1035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:17.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 197.780547 secs 2024-03-28T06:03:18.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:17 smithi086 ceph-mon[35163]: pgmap v1035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:18.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 197.780547 secs 2024-03-28T06:03:18.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:17 smithi159 ceph-mon[36109]: pgmap v1035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:18.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 197.780547 secs 2024-03-28T06:03:18.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 869 sec 2024-03-28T06:03:19.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 870 sec 2024-03-28T06:03:19.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:19 smithi055 ceph-mon[31863]: pgmap v1036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:20.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:19 smithi086 ceph-mon[35163]: pgmap v1036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:20.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:19 smithi159 ceph-mon[36109]: pgmap v1036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:20.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 871 sec 2024-03-28T06:03:21.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 872 sec 2024-03-28T06:03:21.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:21 smithi055 ceph-mon[31863]: pgmap v1037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:22.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:21 smithi086 ceph-mon[35163]: pgmap v1037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:22.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:21 smithi159 ceph-mon[36109]: pgmap v1037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:22.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 873 sec 2024-03-28T06:03:22.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 202.780610 secs 2024-03-28T06:03:23.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 202.780610 secs 2024-03-28T06:03:23.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 202.780610 secs 2024-03-28T06:03:23.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 874 sec 2024-03-28T06:03:23.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:23 smithi055 ceph-mon[31863]: pgmap v1038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:24.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:23 smithi086 ceph-mon[35163]: pgmap v1038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:24.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:23 smithi159 ceph-mon[36109]: pgmap v1038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:24.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 875 sec 2024-03-28T06:03:25.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 876 sec 2024-03-28T06:03:26.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:25 smithi086 ceph-mon[35163]: pgmap v1039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:26.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:25 smithi159 ceph-mon[36109]: pgmap v1039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:26.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:25 smithi055 ceph-mon[31863]: pgmap v1039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:26.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 877 sec 2024-03-28T06:03:27.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 878 sec 2024-03-28T06:03:28.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:27 smithi086 ceph-mon[35163]: pgmap v1040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:28.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 207.780730 secs 2024-03-28T06:03:28.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:27 smithi159 ceph-mon[36109]: pgmap v1040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:28.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 207.780730 secs 2024-03-28T06:03:28.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:27 smithi055 ceph-mon[31863]: pgmap v1040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:28.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 207.780730 secs 2024-03-28T06:03:28.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 879 sec 2024-03-28T06:03:29.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 880 sec 2024-03-28T06:03:30.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:29 smithi086 ceph-mon[35163]: pgmap v1041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:30.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:29 smithi159 ceph-mon[36109]: pgmap v1041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:30.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:29 smithi055 ceph-mon[31863]: pgmap v1041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:30.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 881 sec 2024-03-28T06:03:31.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 882 sec 2024-03-28T06:03:32.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:31 smithi086 ceph-mon[35163]: pgmap v1042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:32.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:31 smithi159 ceph-mon[36109]: pgmap v1042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:32.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:31 smithi055 ceph-mon[31863]: pgmap v1042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:32.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 883 sec 2024-03-28T06:03:33.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 212.780854 secs 2024-03-28T06:03:33.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 212.780854 secs 2024-03-28T06:03:33.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 212.780854 secs 2024-03-28T06:03:33.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 884 sec 2024-03-28T06:03:34.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:33 smithi086 ceph-mon[35163]: pgmap v1043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:34.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:33 smithi159 ceph-mon[36109]: pgmap v1043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:34.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:33 smithi055 ceph-mon[31863]: pgmap v1043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:34.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 885 sec 2024-03-28T06:03:35.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 886 sec 2024-03-28T06:03:36.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:35 smithi086 ceph-mon[35163]: pgmap v1044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:36.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:35 smithi159 ceph-mon[36109]: pgmap v1044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:36.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:35 smithi055 ceph-mon[31863]: pgmap v1044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:36.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 887 sec 2024-03-28T06:03:37.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 888 sec 2024-03-28T06:03:38.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:37 smithi086 ceph-mon[35163]: pgmap v1045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:38.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 217.780971 secs 2024-03-28T06:03:38.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:37 smithi159 ceph-mon[36109]: pgmap v1045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:38.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 217.780971 secs 2024-03-28T06:03:38.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:37 smithi055 ceph-mon[31863]: pgmap v1045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:38.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 217.780971 secs 2024-03-28T06:03:38.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 889 sec 2024-03-28T06:03:39.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 890 sec 2024-03-28T06:03:40.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:39 smithi086 ceph-mon[35163]: pgmap v1046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:40.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:39 smithi159 ceph-mon[36109]: pgmap v1046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:40.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:39 smithi055 ceph-mon[31863]: pgmap v1046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:40.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 891 sec 2024-03-28T06:03:41.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 892 sec 2024-03-28T06:03:42.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:41 smithi086 ceph-mon[35163]: pgmap v1047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:42.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:41 smithi159 ceph-mon[36109]: pgmap v1047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:42.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:41 smithi055 ceph-mon[31863]: pgmap v1047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:42.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 893 sec 2024-03-28T06:03:43.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 222.781055 secs 2024-03-28T06:03:43.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 222.781055 secs 2024-03-28T06:03:43.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 222.781055 secs 2024-03-28T06:03:43.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 894 sec 2024-03-28T06:03:44.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:43 smithi086 ceph-mon[35163]: pgmap v1048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:44.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:43 smithi159 ceph-mon[36109]: pgmap v1048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:44.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:43 smithi055 ceph-mon[31863]: pgmap v1048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:44.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 895 sec 2024-03-28T06:03:45.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 896 sec 2024-03-28T06:03:46.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:45 smithi086 ceph-mon[35163]: pgmap v1049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:46.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:45 smithi159 ceph-mon[36109]: pgmap v1049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:46.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:45 smithi055 ceph-mon[31863]: pgmap v1049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:46.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 897 sec 2024-03-28T06:03:47.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 898 sec 2024-03-28T06:03:48.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:47 smithi086 ceph-mon[35163]: pgmap v1050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:48.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 227.781094 secs 2024-03-28T06:03:48.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:47 smithi159 ceph-mon[36109]: pgmap v1050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:48.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 227.781094 secs 2024-03-28T06:03:48.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:47 smithi055 ceph-mon[31863]: pgmap v1050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:48.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 227.781094 secs 2024-03-28T06:03:48.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 899 sec 2024-03-28T06:03:49.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 900 sec 2024-03-28T06:03:50.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:49 smithi086 ceph-mon[35163]: pgmap v1051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:50.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:49 smithi159 ceph-mon[36109]: pgmap v1051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:50.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:49 smithi055 ceph-mon[31863]: pgmap v1051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:50.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 901 sec 2024-03-28T06:03:51.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 902 sec 2024-03-28T06:03:52.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:51 smithi086 ceph-mon[35163]: pgmap v1052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:52.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:51 smithi159 ceph-mon[36109]: pgmap v1052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:52.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:51 smithi055 ceph-mon[31863]: pgmap v1052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:03:52.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 903 sec 2024-03-28T06:03:53.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 232.781121 secs 2024-03-28T06:03:53.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 232.781121 secs 2024-03-28T06:03:53.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 232.781121 secs 2024-03-28T06:03:53.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 904 sec 2024-03-28T06:03:54.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:53 smithi086 ceph-mon[35163]: pgmap v1053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:54.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:53 smithi159 ceph-mon[36109]: pgmap v1053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:54.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:53 smithi055 ceph-mon[31863]: pgmap v1053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:03:54.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 905 sec 2024-03-28T06:03:55.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 906 sec 2024-03-28T06:03:56.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:55 smithi086 ceph-mon[35163]: pgmap v1054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:56.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:55 smithi159 ceph-mon[36109]: pgmap v1054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:56.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:55 smithi055 ceph-mon[31863]: pgmap v1054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:56.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 907 sec 2024-03-28T06:03:57.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 908 sec 2024-03-28T06:03:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:57 smithi086 ceph-mon[35163]: pgmap v1055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 237.781241 secs 2024-03-28T06:03:58.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:57 smithi159 ceph-mon[36109]: pgmap v1055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:58.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 237.781241 secs 2024-03-28T06:03:58.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:57 smithi055 ceph-mon[31863]: pgmap v1055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:03:58.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 237.781241 secs 2024-03-28T06:03:58.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 909 sec 2024-03-28T06:03:59.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 910 sec 2024-03-28T06:04:00.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:03:59 smithi086 ceph-mon[35163]: pgmap v1056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:00.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:03:59 smithi159 ceph-mon[36109]: pgmap v1056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:00.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:03:59 smithi055 ceph-mon[31863]: pgmap v1056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:00.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 911 sec 2024-03-28T06:04:01.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 912 sec 2024-03-28T06:04:02.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:01 smithi086 ceph-mon[35163]: pgmap v1057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:04:02.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:04:02.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:01 smithi159 ceph-mon[36109]: pgmap v1057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:04:02.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:04:02.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:01 smithi055 ceph-mon[31863]: pgmap v1057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:04:02.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:04:02.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 913 sec 2024-03-28T06:04:03.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 242.781305 secs 2024-03-28T06:04:03.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 242.781305 secs 2024-03-28T06:04:03.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 242.781305 secs 2024-03-28T06:04:03.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 914 sec 2024-03-28T06:04:04.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: pgmap v1058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:04.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:04:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:04:04.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: pgmap v1058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:04:04.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: pgmap v1058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:04:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:04:04.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 915 sec 2024-03-28T06:04:05.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:04 smithi086 ceph-mon[35163]: pgmap v1059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:04 smithi086 ceph-mon[35163]: pgmap v1060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:04 smithi159 ceph-mon[36109]: pgmap v1059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:04 smithi159 ceph-mon[36109]: pgmap v1060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:04 smithi055 ceph-mon[31863]: pgmap v1059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:04 smithi055 ceph-mon[31863]: pgmap v1060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:05.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 916 sec 2024-03-28T06:04:06.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 917 sec 2024-03-28T06:04:07.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:06 smithi086 ceph-mon[35163]: pgmap v1061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:07.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:06 smithi159 ceph-mon[36109]: pgmap v1061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:07.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:06 smithi055 ceph-mon[31863]: pgmap v1061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:07.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 918 sec 2024-03-28T06:04:08.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 247.781385 secs 2024-03-28T06:04:08.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 919 sec 2024-03-28T06:04:08.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 247.781385 secs 2024-03-28T06:04:08.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 247.781385 secs 2024-03-28T06:04:09.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:08 smithi055 ceph-mon[31863]: pgmap v1062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:09.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 920 sec 2024-03-28T06:04:09.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:08 smithi086 ceph-mon[35163]: pgmap v1062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:09.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:08 smithi159 ceph-mon[36109]: pgmap v1062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:10.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 921 sec 2024-03-28T06:04:11.112 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:10 smithi159 ceph-mon[36109]: pgmap v1063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:11.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:10 smithi055 ceph-mon[31863]: pgmap v1063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:11.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 922 sec 2024-03-28T06:04:11.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:10 smithi086 ceph-mon[35163]: pgmap v1063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:12.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 923 sec 2024-03-28T06:04:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:12 smithi055 ceph-mon[31863]: pgmap v1064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 252.781509 secs 2024-03-28T06:04:13.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 924 sec 2024-03-28T06:04:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:12 smithi086 ceph-mon[35163]: pgmap v1064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 252.781509 secs 2024-03-28T06:04:13.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:12 smithi159 ceph-mon[36109]: pgmap v1064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:04:13.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 252.781509 secs 2024-03-28T06:04:14.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 925 sec 2024-03-28T06:04:15.109 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:14 smithi086 ceph-mon[35163]: pgmap v1065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:04:15.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:14 smithi055 ceph-mon[31863]: pgmap v1065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:04:15.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 926 sec 2024-03-28T06:04:15.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:14 smithi159 ceph-mon[36109]: pgmap v1065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:04:16.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 927 sec 2024-03-28T06:04:17.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:16 smithi055 ceph-mon[31863]: pgmap v1066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:17.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 928 sec 2024-03-28T06:04:17.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:16 smithi086 ceph-mon[35163]: pgmap v1066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:17.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:16 smithi159 ceph-mon[36109]: pgmap v1066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:18.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 929 sec 2024-03-28T06:04:18.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 257.781629 secs 2024-03-28T06:04:18.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 257.781629 secs 2024-03-28T06:04:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 257.781629 secs 2024-03-28T06:04:19.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 930 sec 2024-03-28T06:04:19.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:18 smithi086 ceph-mon[35163]: pgmap v1067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:19.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:18 smithi159 ceph-mon[36109]: pgmap v1067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:19.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:18 smithi055 ceph-mon[31863]: pgmap v1067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:20.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 931 sec 2024-03-28T06:04:21.165 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:20 smithi055 ceph-mon[31863]: pgmap v1068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:21.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 932 sec 2024-03-28T06:04:21.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:20 smithi086 ceph-mon[35163]: pgmap v1068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:21.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:20 smithi159 ceph-mon[36109]: pgmap v1068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:22.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 933 sec 2024-03-28T06:04:23.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 934 sec 2024-03-28T06:04:23.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:22 smithi086 ceph-mon[35163]: pgmap v1069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:23.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 262.781749 secs 2024-03-28T06:04:23.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:22 smithi159 ceph-mon[36109]: pgmap v1069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:23.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 262.781749 secs 2024-03-28T06:04:23.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:22 smithi055 ceph-mon[31863]: pgmap v1069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:23.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 262.781749 secs 2024-03-28T06:04:24.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 935 sec 2024-03-28T06:04:25.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 936 sec 2024-03-28T06:04:25.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:24 smithi086 ceph-mon[35163]: pgmap v1070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:25.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:24 smithi159 ceph-mon[36109]: pgmap v1070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:25.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:24 smithi055 ceph-mon[31863]: pgmap v1070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:26.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 937 sec 2024-03-28T06:04:27.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 938 sec 2024-03-28T06:04:27.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:26 smithi086 ceph-mon[35163]: pgmap v1071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:27.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:26 smithi159 ceph-mon[36109]: pgmap v1071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:27.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:26 smithi055 ceph-mon[31863]: pgmap v1071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:28.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 939 sec 2024-03-28T06:04:28.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 267.781815 secs 2024-03-28T06:04:28.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 267.781815 secs 2024-03-28T06:04:28.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 267.781815 secs 2024-03-28T06:04:29.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 940 sec 2024-03-28T06:04:29.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:28 smithi086 ceph-mon[35163]: pgmap v1072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:29.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:28 smithi159 ceph-mon[36109]: pgmap v1072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:29.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:28 smithi055 ceph-mon[31863]: pgmap v1072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:30.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 941 sec 2024-03-28T06:04:31.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 942 sec 2024-03-28T06:04:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:30 smithi086 ceph-mon[35163]: pgmap v1073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:31.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:30 smithi159 ceph-mon[36109]: pgmap v1073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:31.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:30 smithi055 ceph-mon[31863]: pgmap v1073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:32.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 943 sec 2024-03-28T06:04:33.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 944 sec 2024-03-28T06:04:33.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:32 smithi086 ceph-mon[35163]: pgmap v1074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:33.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 272.781880 secs 2024-03-28T06:04:33.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:32 smithi159 ceph-mon[36109]: pgmap v1074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:33.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 272.781880 secs 2024-03-28T06:04:33.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:32 smithi055 ceph-mon[31863]: pgmap v1074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:33.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 272.781880 secs 2024-03-28T06:04:34.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 945 sec 2024-03-28T06:04:35.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 946 sec 2024-03-28T06:04:35.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:34 smithi086 ceph-mon[35163]: pgmap v1075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:35.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:34 smithi159 ceph-mon[36109]: pgmap v1075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:35.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:34 smithi055 ceph-mon[31863]: pgmap v1075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:36.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 947 sec 2024-03-28T06:04:37.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 948 sec 2024-03-28T06:04:37.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:36 smithi086 ceph-mon[35163]: pgmap v1076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:37.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:36 smithi159 ceph-mon[36109]: pgmap v1076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:37.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:36 smithi055 ceph-mon[31863]: pgmap v1076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:38.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 949 sec 2024-03-28T06:04:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 277.782001 secs 2024-03-28T06:04:38.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 277.782001 secs 2024-03-28T06:04:38.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 277.782001 secs 2024-03-28T06:04:39.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 950 sec 2024-03-28T06:04:39.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:38 smithi086 ceph-mon[35163]: pgmap v1077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:39.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:38 smithi159 ceph-mon[36109]: pgmap v1077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:39.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:38 smithi055 ceph-mon[31863]: pgmap v1077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:40.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 951 sec 2024-03-28T06:04:41.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 952 sec 2024-03-28T06:04:41.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:40 smithi086 ceph-mon[35163]: pgmap v1078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:41.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:40 smithi159 ceph-mon[36109]: pgmap v1078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:41.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:40 smithi055 ceph-mon[31863]: pgmap v1078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:42.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 953 sec 2024-03-28T06:04:43.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 954 sec 2024-03-28T06:04:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:42 smithi086 ceph-mon[35163]: pgmap v1079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 282.782121 secs 2024-03-28T06:04:43.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:42 smithi159 ceph-mon[36109]: pgmap v1079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:43.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 282.782121 secs 2024-03-28T06:04:43.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:42 smithi055 ceph-mon[31863]: pgmap v1079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:43.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 282.782121 secs 2024-03-28T06:04:44.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 955 sec 2024-03-28T06:04:45.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 956 sec 2024-03-28T06:04:45.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:45 smithi086 ceph-mon[35163]: pgmap v1080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:45.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:45 smithi159 ceph-mon[36109]: pgmap v1080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:45.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:44 smithi055 ceph-mon[31863]: pgmap v1080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:46.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 957 sec 2024-03-28T06:04:46.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:46 smithi086 ceph-mon[35163]: pgmap v1081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:46.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:46 smithi159 ceph-mon[36109]: pgmap v1081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:46.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:46 smithi055 ceph-mon[31863]: pgmap v1081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:47.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 958 sec 2024-03-28T06:04:48.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 959 sec 2024-03-28T06:04:48.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:48 smithi086 ceph-mon[35163]: pgmap v1082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:48.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 287.782244 secs 2024-03-28T06:04:48.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:48 smithi159 ceph-mon[36109]: pgmap v1082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:48.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 287.782244 secs 2024-03-28T06:04:48.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:48 smithi055 ceph-mon[31863]: pgmap v1082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:48.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 287.782244 secs 2024-03-28T06:04:49.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 960 sec 2024-03-28T06:04:50.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 961 sec 2024-03-28T06:04:50.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:50 smithi086 ceph-mon[35163]: pgmap v1083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:50.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:50 smithi159 ceph-mon[36109]: pgmap v1083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:50.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:50 smithi055 ceph-mon[31863]: pgmap v1083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:51.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 962 sec 2024-03-28T06:04:52.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 963 sec 2024-03-28T06:04:52.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:52 smithi086 ceph-mon[35163]: pgmap v1084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:52.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:52 smithi159 ceph-mon[36109]: pgmap v1084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:52.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:52 smithi055 ceph-mon[31863]: pgmap v1084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:53.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 964 sec 2024-03-28T06:04:53.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 292.782371 secs 2024-03-28T06:04:53.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 292.782371 secs 2024-03-28T06:04:53.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 292.782371 secs 2024-03-28T06:04:54.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 965 sec 2024-03-28T06:04:54.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:54 smithi086 ceph-mon[35163]: pgmap v1085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:54.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:54 smithi159 ceph-mon[36109]: pgmap v1085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:54.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:54 smithi055 ceph-mon[31863]: pgmap v1085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:55.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 966 sec 2024-03-28T06:04:56.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 967 sec 2024-03-28T06:04:56.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:56 smithi086 ceph-mon[35163]: pgmap v1086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:56.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:56 smithi159 ceph-mon[36109]: pgmap v1086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:56.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:56 smithi055 ceph-mon[31863]: pgmap v1086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:04:57.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 968 sec 2024-03-28T06:04:58.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 969 sec 2024-03-28T06:04:58.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:58 smithi086 ceph-mon[35163]: pgmap v1087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:58.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 297.782492 secs 2024-03-28T06:04:58.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:58 smithi159 ceph-mon[36109]: pgmap v1087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:58.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 297.782492 secs 2024-03-28T06:04:58.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:58 smithi055 ceph-mon[31863]: pgmap v1087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:04:58.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 297.782492 secs 2024-03-28T06:04:59.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 970 sec 2024-03-28T06:05:00.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 971 sec 2024-03-28T06:05:00.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:00 smithi086 ceph-mon[35163]: pgmap v1088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:00.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:00 smithi159 ceph-mon[36109]: pgmap v1088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:00.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:00 smithi055 ceph-mon[31863]: pgmap v1088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:01.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 972 sec 2024-03-28T06:05:02.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 973 sec 2024-03-28T06:05:02.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:02 smithi086 ceph-mon[35163]: pgmap v1089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:02.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:02 smithi159 ceph-mon[36109]: pgmap v1089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:02.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:02 smithi055 ceph-mon[31863]: pgmap v1089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:03.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 974 sec 2024-03-28T06:05:03.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 302.782570 secs 2024-03-28T06:05:03.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 302.782570 secs 2024-03-28T06:05:03.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 302.782570 secs 2024-03-28T06:05:04.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 975 sec 2024-03-28T06:05:04.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: pgmap v1090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:04.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:05:04.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:04.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:04.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:04.863 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: pgmap v1090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: pgmap v1090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:05.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 976 sec 2024-03-28T06:05:06.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 977 sec 2024-03-28T06:05:07.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: pgmap v1091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: pgmap v1092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: pgmap v1093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: pgmap v1091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:05:07.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: pgmap v1092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: pgmap v1093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: pgmap v1091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:07.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:05:07.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:05:07.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: pgmap v1092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: pgmap v1093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:07.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:05:07.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 978 sec 2024-03-28T06:05:08.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 307.782690 secs 2024-03-28T06:05:08.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 307.782690 secs 2024-03-28T06:05:08.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 307.782690 secs 2024-03-28T06:05:08.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 979 sec 2024-03-28T06:05:09.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:08 smithi086 ceph-mon[35163]: pgmap v1094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:09.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:08 smithi159 ceph-mon[36109]: pgmap v1094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:09.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:08 smithi055 ceph-mon[31863]: pgmap v1094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:09.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 980 sec 2024-03-28T06:05:10.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 981 sec 2024-03-28T06:05:11.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 982 sec 2024-03-28T06:05:11.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:10 smithi086 ceph-mon[35163]: pgmap v1095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:11.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:10 smithi159 ceph-mon[36109]: pgmap v1095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:11.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:10 smithi055 ceph-mon[31863]: pgmap v1095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:12.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 983 sec 2024-03-28T06:05:13.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 984 sec 2024-03-28T06:05:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:12 smithi086 ceph-mon[35163]: pgmap v1096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 312.782813 secs 2024-03-28T06:05:13.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:12 smithi159 ceph-mon[36109]: pgmap v1096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:13.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 312.782813 secs 2024-03-28T06:05:13.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:12 smithi055 ceph-mon[31863]: pgmap v1096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:13.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 312.782813 secs 2024-03-28T06:05:14.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 985 sec 2024-03-28T06:05:14.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:14 smithi055 ceph-mon[31863]: pgmap v1097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:15.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:14 smithi086 ceph-mon[35163]: pgmap v1097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:15.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:14 smithi159 ceph-mon[36109]: pgmap v1097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:05:15.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 986 sec 2024-03-28T06:05:16.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 987 sec 2024-03-28T06:05:17.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 988 sec 2024-03-28T06:05:17.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:16 smithi086 ceph-mon[35163]: pgmap v1098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:05:17.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:16 smithi159 ceph-mon[36109]: pgmap v1098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:05:17.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:16 smithi055 ceph-mon[31863]: pgmap v1098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:05:18.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 989 sec 2024-03-28T06:05:18.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 317.782935 secs 2024-03-28T06:05:18.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 317.782935 secs 2024-03-28T06:05:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 317.782935 secs 2024-03-28T06:05:19.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 990 sec 2024-03-28T06:05:19.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:18 smithi086 ceph-mon[35163]: pgmap v1099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:19.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:18 smithi159 ceph-mon[36109]: pgmap v1099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:19.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:18 smithi055 ceph-mon[31863]: pgmap v1099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:20.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 991 sec 2024-03-28T06:05:21.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 992 sec 2024-03-28T06:05:21.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:20 smithi086 ceph-mon[35163]: pgmap v1100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:21.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:20 smithi159 ceph-mon[36109]: pgmap v1100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:21.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:20 smithi055 ceph-mon[31863]: pgmap v1100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:22.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 993 sec 2024-03-28T06:05:23.164 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:22 smithi055 ceph-mon[31863]: pgmap v1101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:23.164 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 322.783058 secs 2024-03-28T06:05:23.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 994 sec 2024-03-28T06:05:23.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:22 smithi086 ceph-mon[35163]: pgmap v1101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:23.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 322.783058 secs 2024-03-28T06:05:23.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:22 smithi159 ceph-mon[36109]: pgmap v1101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:23.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 322.783058 secs 2024-03-28T06:05:24.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 995 sec 2024-03-28T06:05:25.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 996 sec 2024-03-28T06:05:25.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:24 smithi086 ceph-mon[35163]: pgmap v1102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:25.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:24 smithi159 ceph-mon[36109]: pgmap v1102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:25.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:24 smithi055 ceph-mon[31863]: pgmap v1102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:26.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 997 sec 2024-03-28T06:05:27.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 998 sec 2024-03-28T06:05:27.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:26 smithi086 ceph-mon[35163]: pgmap v1103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:27.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:26 smithi159 ceph-mon[36109]: pgmap v1103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:27.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:26 smithi055 ceph-mon[31863]: pgmap v1103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:28.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 999 sec 2024-03-28T06:05:28.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 327.783176 secs 2024-03-28T06:05:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 327.783176 secs 2024-03-28T06:05:28.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 327.783176 secs 2024-03-28T06:05:29.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1000 sec 2024-03-28T06:05:29.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:28 smithi086 ceph-mon[35163]: pgmap v1104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:29.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:28 smithi159 ceph-mon[36109]: pgmap v1104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:29.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:28 smithi055 ceph-mon[31863]: pgmap v1104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:30.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1001 sec 2024-03-28T06:05:31.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1002 sec 2024-03-28T06:05:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:30 smithi086 ceph-mon[35163]: pgmap v1105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:30 smithi159 ceph-mon[36109]: pgmap v1105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:31.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:30 smithi055 ceph-mon[31863]: pgmap v1105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:32.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1003 sec 2024-03-28T06:05:33.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1004 sec 2024-03-28T06:05:33.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:32 smithi086 ceph-mon[35163]: pgmap v1106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:33.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 332.783269 secs 2024-03-28T06:05:33.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:32 smithi159 ceph-mon[36109]: pgmap v1106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:33.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 332.783269 secs 2024-03-28T06:05:33.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:32 smithi055 ceph-mon[31863]: pgmap v1106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:33.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 332.783269 secs 2024-03-28T06:05:34.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1005 sec 2024-03-28T06:05:35.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1006 sec 2024-03-28T06:05:35.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:34 smithi086 ceph-mon[35163]: pgmap v1107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:35.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:34 smithi159 ceph-mon[36109]: pgmap v1107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:35.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:34 smithi055 ceph-mon[31863]: pgmap v1107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:36.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1007 sec 2024-03-28T06:05:37.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1008 sec 2024-03-28T06:05:37.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:36 smithi086 ceph-mon[35163]: pgmap v1108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:37.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:36 smithi159 ceph-mon[36109]: pgmap v1108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:37.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:36 smithi055 ceph-mon[31863]: pgmap v1108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:38.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1009 sec 2024-03-28T06:05:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 337.783330 secs 2024-03-28T06:05:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 337.783330 secs 2024-03-28T06:05:38.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 337.783330 secs 2024-03-28T06:05:39.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1010 sec 2024-03-28T06:05:39.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:39 smithi086 ceph-mon[35163]: pgmap v1109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:39.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:39 smithi159 ceph-mon[36109]: pgmap v1109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:39.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:39 smithi055 ceph-mon[31863]: pgmap v1109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:40.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1011 sec 2024-03-28T06:05:40.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:40 smithi086 ceph-mon[35163]: pgmap v1110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:40.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:40 smithi159 ceph-mon[36109]: pgmap v1110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:40.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:40 smithi055 ceph-mon[31863]: pgmap v1110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:41.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1012 sec 2024-03-28T06:05:42.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1013 sec 2024-03-28T06:05:43.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1014 sec 2024-03-28T06:05:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:42 smithi086 ceph-mon[35163]: pgmap v1111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 342.783394 secs 2024-03-28T06:05:43.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:42 smithi159 ceph-mon[36109]: pgmap v1111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:43.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 342.783394 secs 2024-03-28T06:05:43.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:42 smithi055 ceph-mon[31863]: pgmap v1111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:43.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 342.783394 secs 2024-03-28T06:05:44.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1015 sec 2024-03-28T06:05:45.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1016 sec 2024-03-28T06:05:45.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:44 smithi086 ceph-mon[35163]: pgmap v1112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:45.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:44 smithi159 ceph-mon[36109]: pgmap v1112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:45.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:44 smithi055 ceph-mon[31863]: pgmap v1112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:46.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1017 sec 2024-03-28T06:05:47.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1018 sec 2024-03-28T06:05:47.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:46 smithi086 ceph-mon[35163]: pgmap v1113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:47.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:46 smithi159 ceph-mon[36109]: pgmap v1113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:47.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:46 smithi055 ceph-mon[31863]: pgmap v1113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:48.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1019 sec 2024-03-28T06:05:48.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 347.783520 secs 2024-03-28T06:05:48.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 347.783520 secs 2024-03-28T06:05:48.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 347.783520 secs 2024-03-28T06:05:49.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1020 sec 2024-03-28T06:05:49.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:48 smithi086 ceph-mon[35163]: pgmap v1114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:49.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:48 smithi159 ceph-mon[36109]: pgmap v1114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:49.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:48 smithi055 ceph-mon[31863]: pgmap v1114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:50.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1021 sec 2024-03-28T06:05:51.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1022 sec 2024-03-28T06:05:51.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:50 smithi086 ceph-mon[35163]: pgmap v1115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:51.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:50 smithi159 ceph-mon[36109]: pgmap v1115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:51.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:50 smithi055 ceph-mon[31863]: pgmap v1115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:52.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1023 sec 2024-03-28T06:05:53.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1024 sec 2024-03-28T06:05:53.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:52 smithi086 ceph-mon[35163]: pgmap v1116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:53.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 352.783643 secs 2024-03-28T06:05:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:52 smithi159 ceph-mon[36109]: pgmap v1116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:53.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 352.783643 secs 2024-03-28T06:05:53.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:52 smithi055 ceph-mon[31863]: pgmap v1116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:53.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 352.783643 secs 2024-03-28T06:05:54.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1025 sec 2024-03-28T06:05:55.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1026 sec 2024-03-28T06:05:55.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:54 smithi086 ceph-mon[35163]: pgmap v1117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:55.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:54 smithi159 ceph-mon[36109]: pgmap v1117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:55.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:54 smithi055 ceph-mon[31863]: pgmap v1117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:05:56.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1027 sec 2024-03-28T06:05:57.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1028 sec 2024-03-28T06:05:57.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:56 smithi086 ceph-mon[35163]: pgmap v1118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:57.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:56 smithi159 ceph-mon[36109]: pgmap v1118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:57.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:56 smithi055 ceph-mon[31863]: pgmap v1118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:05:58.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1029 sec 2024-03-28T06:05:58.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 357.783759 secs 2024-03-28T06:05:58.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 357.783759 secs 2024-03-28T06:05:58.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 357.783759 secs 2024-03-28T06:05:59.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1030 sec 2024-03-28T06:05:59.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:05:58 smithi086 ceph-mon[35163]: pgmap v1119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:59.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:05:58 smithi159 ceph-mon[36109]: pgmap v1119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:05:59.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:05:58 smithi055 ceph-mon[31863]: pgmap v1119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:00.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1031 sec 2024-03-28T06:06:01.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1032 sec 2024-03-28T06:06:01.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:01 smithi086 ceph-mon[35163]: pgmap v1120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:01.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:01 smithi159 ceph-mon[36109]: pgmap v1120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:01.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:01 smithi055 ceph-mon[31863]: pgmap v1120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:02.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1033 sec 2024-03-28T06:06:03.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1034 sec 2024-03-28T06:06:03.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:03 smithi086 ceph-mon[35163]: pgmap v1121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:03.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:03 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 362.783864 secs 2024-03-28T06:06:03.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:03 smithi086 ceph-mon[35163]: slow request 362.783864 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:06:03.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:03 smithi159 ceph-mon[36109]: pgmap v1121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:03.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:03 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 362.783864 secs 2024-03-28T06:06:03.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:03 smithi159 ceph-mon[36109]: slow request 362.783864 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:06:03.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:03 smithi055 ceph-mon[31863]: pgmap v1121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:03.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:03 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 362.783864 secs 2024-03-28T06:06:03.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:03 smithi055 ceph-mon[31863]: slow request 362.783864 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:06:04.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1035 sec 2024-03-28T06:06:05.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1036 sec 2024-03-28T06:06:05.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:05 smithi086 ceph-mon[35163]: pgmap v1122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:05.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:05 smithi159 ceph-mon[36109]: pgmap v1122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:05.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:05 smithi055 ceph-mon[31863]: pgmap v1122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:06.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1037 sec 2024-03-28T06:06:06.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:06 smithi055 ceph-mon[31863]: pgmap v1123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:06:06.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:06 smithi086 ceph-mon[35163]: pgmap v1123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:06:06.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:06 smithi159 ceph-mon[36109]: pgmap v1123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:06:07.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1038 sec 2024-03-28T06:06:07.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:06:07.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:06:07.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:06:08.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1039 sec 2024-03-28T06:06:08.469 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.469 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.469 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 367.783939 secs 2024-03-28T06:06:08.469 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:08 smithi159 ceph-mon[36109]: pgmap v1124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 367.783939 secs 2024-03-28T06:06:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:08 smithi086 ceph-mon[35163]: pgmap v1124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:08.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:08.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 367.783939 secs 2024-03-28T06:06:08.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:08 smithi055 ceph-mon[31863]: pgmap v1124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:09.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1040 sec 2024-03-28T06:06:10.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1041 sec 2024-03-28T06:06:10.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:10 smithi086 ceph-mon[35163]: pgmap v1125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:10.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:10 smithi159 ceph-mon[36109]: pgmap v1125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:10.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:10.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:10 smithi055 ceph-mon[31863]: pgmap v1125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:11.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1042 sec 2024-03-28T06:06:12.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1043 sec 2024-03-28T06:06:12.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:12.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:12 smithi055 ceph-mon[31863]: pgmap v1126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:06:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:06:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:13.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 372.784031 secs 2024-03-28T06:06:13.212 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:12 smithi159 ceph-mon[36109]: pgmap v1126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:13.212 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:06:13.212 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:06:13.212 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:13.212 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 372.784031 secs 2024-03-28T06:06:13.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1044 sec 2024-03-28T06:06:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:12 smithi086 ceph-mon[35163]: pgmap v1126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:06:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:06:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:06:13.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 372.784031 secs 2024-03-28T06:06:14.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1045 sec 2024-03-28T06:06:14.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:13 smithi086 ceph-mon[35163]: pgmap v1127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:06:14.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:13 smithi086 ceph-mon[35163]: pgmap v1128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:14.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:13 smithi086 ceph-mon[35163]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T06:06:14.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:13 smithi159 ceph-mon[36109]: pgmap v1127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:06:14.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:13 smithi159 ceph-mon[36109]: pgmap v1128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:14.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:13 smithi159 ceph-mon[36109]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T06:06:14.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:13 smithi055 ceph-mon[31863]: pgmap v1127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:06:14.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:13 smithi055 ceph-mon[31863]: pgmap v1128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:14.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:13 smithi055 ceph-mon[31863]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-28T06:06:15.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1046 sec 2024-03-28T06:06:16.134 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:15 smithi086 ceph-mon[35163]: pgmap v1129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:06:16.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1047 sec 2024-03-28T06:06:16.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:15 smithi159 ceph-mon[36109]: pgmap v1129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:06:16.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:15 smithi055 ceph-mon[31863]: pgmap v1129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:06:17.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1048 sec 2024-03-28T06:06:18.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1049 sec 2024-03-28T06:06:18.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:17 smithi086 ceph-mon[35163]: pgmap v1130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:18.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 377.784123 secs 2024-03-28T06:06:18.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:17 smithi159 ceph-mon[36109]: pgmap v1130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:18.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 377.784123 secs 2024-03-28T06:06:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:17 smithi055 ceph-mon[31863]: pgmap v1130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 377.784123 secs 2024-03-28T06:06:19.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1050 sec 2024-03-28T06:06:20.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1051 sec 2024-03-28T06:06:20.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:19 smithi086 ceph-mon[35163]: pgmap v1131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:20.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:19 smithi159 ceph-mon[36109]: pgmap v1131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:20.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:19 smithi055 ceph-mon[31863]: pgmap v1131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:06:21.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1052 sec 2024-03-28T06:06:22.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1053 sec 2024-03-28T06:06:22.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:21 smithi086 ceph-mon[35163]: pgmap v1132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:22.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:21 smithi159 ceph-mon[36109]: pgmap v1132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:22.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:21 smithi055 ceph-mon[31863]: pgmap v1132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:06:23.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1054 sec 2024-03-28T06:06:23.264 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 382.784197 secs 2024-03-28T06:06:23.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 382.784197 secs 2024-03-28T06:06:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 382.784197 secs 2024-03-28T06:06:24.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1055 sec 2024-03-28T06:06:24.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:23 smithi086 ceph-mon[35163]: pgmap v1133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:06:24.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:23 smithi159 ceph-mon[36109]: pgmap v1133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:06:24.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:23 smithi055 ceph-mon[31863]: pgmap v1133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:06:25.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1056 sec 2024-03-28T06:06:26.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1057 sec 2024-03-28T06:06:26.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:25 smithi086 ceph-mon[35163]: pgmap v1134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:26.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:25 smithi159 ceph-mon[36109]: pgmap v1134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:26.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:25 smithi055 ceph-mon[31863]: pgmap v1134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:27.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1058 sec 2024-03-28T06:06:28.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1059 sec 2024-03-28T06:06:28.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:27 smithi086 ceph-mon[35163]: pgmap v1135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:28.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 387.784263 secs 2024-03-28T06:06:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:27 smithi159 ceph-mon[36109]: pgmap v1135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 387.784263 secs 2024-03-28T06:06:28.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:27 smithi055 ceph-mon[31863]: pgmap v1135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:28.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 387.784263 secs 2024-03-28T06:06:29.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1060 sec 2024-03-28T06:06:30.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1061 sec 2024-03-28T06:06:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:29 smithi086 ceph-mon[35163]: pgmap v1136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:30.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:29 smithi159 ceph-mon[36109]: pgmap v1136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:29 smithi055 ceph-mon[31863]: pgmap v1136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:31.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1062 sec 2024-03-28T06:06:32.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1063 sec 2024-03-28T06:06:32.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:31 smithi086 ceph-mon[35163]: pgmap v1137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:32.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:31 smithi159 ceph-mon[36109]: pgmap v1137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:32.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:31 smithi055 ceph-mon[31863]: pgmap v1137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:33.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1064 sec 2024-03-28T06:06:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 392.784327 secs 2024-03-28T06:06:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 392.784327 secs 2024-03-28T06:06:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 392.784327 secs 2024-03-28T06:06:34.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1065 sec 2024-03-28T06:06:34.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:33 smithi086 ceph-mon[35163]: pgmap v1138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:34.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:33 smithi159 ceph-mon[36109]: pgmap v1138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:34.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:33 smithi055 ceph-mon[31863]: pgmap v1138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:35.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1066 sec 2024-03-28T06:06:36.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1067 sec 2024-03-28T06:06:36.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:35 smithi086 ceph-mon[35163]: pgmap v1139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:36.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:35 smithi159 ceph-mon[36109]: pgmap v1139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:36.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:35 smithi055 ceph-mon[31863]: pgmap v1139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:37.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1068 sec 2024-03-28T06:06:38.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1069 sec 2024-03-28T06:06:38.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:37 smithi086 ceph-mon[35163]: pgmap v1140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 397.784388 secs 2024-03-28T06:06:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:37 smithi159 ceph-mon[36109]: pgmap v1140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 397.784388 secs 2024-03-28T06:06:38.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:37 smithi055 ceph-mon[31863]: pgmap v1140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:38.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 397.784388 secs 2024-03-28T06:06:39.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1070 sec 2024-03-28T06:06:40.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1071 sec 2024-03-28T06:06:40.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:39 smithi086 ceph-mon[35163]: pgmap v1141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:40.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:39 smithi159 ceph-mon[36109]: pgmap v1141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:40.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:39 smithi055 ceph-mon[31863]: pgmap v1141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:41.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1072 sec 2024-03-28T06:06:42.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1073 sec 2024-03-28T06:06:42.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:42 smithi086 ceph-mon[35163]: pgmap v1142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:42.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:42 smithi159 ceph-mon[36109]: pgmap v1142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:42.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:42 smithi055 ceph-mon[31863]: pgmap v1142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:43.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1074 sec 2024-03-28T06:06:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 402.784511 secs 2024-03-28T06:06:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 402.784511 secs 2024-03-28T06:06:43.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 402.784511 secs 2024-03-28T06:06:44.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1075 sec 2024-03-28T06:06:44.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:44 smithi086 ceph-mon[35163]: pgmap v1143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:44.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:44 smithi159 ceph-mon[36109]: pgmap v1143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:44.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:44 smithi055 ceph-mon[31863]: pgmap v1143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:45.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1076 sec 2024-03-28T06:06:46.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1077 sec 2024-03-28T06:06:46.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:46 smithi086 ceph-mon[35163]: pgmap v1144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:46.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:46 smithi159 ceph-mon[36109]: pgmap v1144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:46.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:46 smithi055 ceph-mon[31863]: pgmap v1144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:47.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1078 sec 2024-03-28T06:06:47.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:47 smithi055 ceph-mon[31863]: pgmap v1145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:47.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:47 smithi086 ceph-mon[35163]: pgmap v1145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:47.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:47 smithi159 ceph-mon[36109]: pgmap v1145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:48.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1079 sec 2024-03-28T06:06:48.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 407.784632 secs 2024-03-28T06:06:48.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 407.784632 secs 2024-03-28T06:06:48.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 407.784632 secs 2024-03-28T06:06:49.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1080 sec 2024-03-28T06:06:49.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:49 smithi055 ceph-mon[31863]: pgmap v1146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:49.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:49 smithi086 ceph-mon[35163]: pgmap v1146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:49.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:49 smithi159 ceph-mon[36109]: pgmap v1146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:50.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1081 sec 2024-03-28T06:06:51.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1082 sec 2024-03-28T06:06:51.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:51 smithi086 ceph-mon[35163]: pgmap v1147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:51.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:51 smithi159 ceph-mon[36109]: pgmap v1147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:51.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:51 smithi055 ceph-mon[31863]: pgmap v1147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:06:52.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1083 sec 2024-03-28T06:06:53.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1084 sec 2024-03-28T06:06:53.665 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:53 smithi055 ceph-mon[31863]: pgmap v1148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:53.665 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 412.784757 secs 2024-03-28T06:06:53.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:53 smithi086 ceph-mon[35163]: pgmap v1148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:53.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 412.784757 secs 2024-03-28T06:06:53.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:53 smithi159 ceph-mon[36109]: pgmap v1148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:53.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 412.784757 secs 2024-03-28T06:06:54.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1085 sec 2024-03-28T06:06:55.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1086 sec 2024-03-28T06:06:55.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:55 smithi086 ceph-mon[35163]: pgmap v1149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:55.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:55 smithi159 ceph-mon[36109]: pgmap v1149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:55.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:55 smithi055 ceph-mon[31863]: pgmap v1149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:06:56.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1087 sec 2024-03-28T06:06:57.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1088 sec 2024-03-28T06:06:57.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:57 smithi086 ceph-mon[35163]: pgmap v1150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:06:57.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:57 smithi159 ceph-mon[36109]: pgmap v1150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:06:57.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:57 smithi055 ceph-mon[31863]: pgmap v1150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:06:58.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1089 sec 2024-03-28T06:06:58.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 417.784839 secs 2024-03-28T06:06:58.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 417.784839 secs 2024-03-28T06:06:58.862 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 417.784839 secs 2024-03-28T06:06:59.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1090 sec 2024-03-28T06:06:59.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:06:59 smithi086 ceph-mon[35163]: pgmap v1151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:06:59.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:06:59 smithi159 ceph-mon[36109]: pgmap v1151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:06:59.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:06:59 smithi055 ceph-mon[31863]: pgmap v1151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:00.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1091 sec 2024-03-28T06:07:01.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1092 sec 2024-03-28T06:07:01.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:01 smithi086 ceph-mon[35163]: pgmap v1152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:07:01.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:01 smithi159 ceph-mon[36109]: pgmap v1152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:07:01.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:01 smithi055 ceph-mon[31863]: pgmap v1152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:07:02.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1093 sec 2024-03-28T06:07:03.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1094 sec 2024-03-28T06:07:03.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:03 smithi086 ceph-mon[35163]: pgmap v1153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:03.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 422.784967 secs 2024-03-28T06:07:03.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:03 smithi159 ceph-mon[36109]: pgmap v1153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:03.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 422.784967 secs 2024-03-28T06:07:03.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:03 smithi055 ceph-mon[31863]: pgmap v1153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:03.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 422.784967 secs 2024-03-28T06:07:04.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1095 sec 2024-03-28T06:07:05.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1096 sec 2024-03-28T06:07:05.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:05 smithi086 ceph-mon[35163]: pgmap v1154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:05.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:05 smithi159 ceph-mon[36109]: pgmap v1154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:05.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:05 smithi055 ceph-mon[31863]: pgmap v1154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:06.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1097 sec 2024-03-28T06:07:07.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1098 sec 2024-03-28T06:07:07.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:07 smithi086 ceph-mon[35163]: pgmap v1155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:07.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:07 smithi159 ceph-mon[36109]: pgmap v1155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:07.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:07 smithi055 ceph-mon[31863]: pgmap v1155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:08.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1099 sec 2024-03-28T06:07:08.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 427.785087 secs 2024-03-28T06:07:08.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 427.785087 secs 2024-03-28T06:07:08.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 427.785087 secs 2024-03-28T06:07:09.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1100 sec 2024-03-28T06:07:10.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:09 smithi086 ceph-mon[35163]: pgmap v1156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:10.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:09 smithi159 ceph-mon[36109]: pgmap v1156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:10.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:09 smithi055 ceph-mon[31863]: pgmap v1156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:10.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1101 sec 2024-03-28T06:07:11.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1102 sec 2024-03-28T06:07:12.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:11 smithi086 ceph-mon[35163]: pgmap v1157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:12.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:11 smithi159 ceph-mon[36109]: pgmap v1157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:12.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:11 smithi055 ceph-mon[31863]: pgmap v1157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:12.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1103 sec 2024-03-28T06:07:13.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 432.785163 secs 2024-03-28T06:07:13.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 432.785163 secs 2024-03-28T06:07:13.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 432.785163 secs 2024-03-28T06:07:13.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1104 sec 2024-03-28T06:07:13.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:13 smithi159 ceph-mon[36109]: pgmap v1158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:13.961 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:07:14.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:13 smithi086 ceph-mon[35163]: pgmap v1158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:14.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:07:14.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:13 smithi055 ceph-mon[31863]: pgmap v1158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:14.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:07:14.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1105 sec 2024-03-28T06:07:15.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:07:15.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:07:15.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:07:15.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:07:15.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:07:15.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:07:15.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:07:15.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:07:15.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:07:15.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1106 sec 2024-03-28T06:07:16.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:15 smithi086 ceph-mon[35163]: pgmap v1159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:16.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:15 smithi086 ceph-mon[35163]: pgmap v1160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:16.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:15 smithi159 ceph-mon[36109]: pgmap v1159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:16.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:15 smithi159 ceph-mon[36109]: pgmap v1160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:16.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:15 smithi055 ceph-mon[31863]: pgmap v1159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:16.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:15 smithi055 ceph-mon[31863]: pgmap v1160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:07:16.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1107 sec 2024-03-28T06:07:17.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1108 sec 2024-03-28T06:07:18.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:17 smithi086 ceph-mon[35163]: pgmap v1161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:18.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 437.785224 secs 2024-03-28T06:07:18.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:17 smithi159 ceph-mon[36109]: pgmap v1161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:18.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 437.785224 secs 2024-03-28T06:07:18.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:17 smithi055 ceph-mon[31863]: pgmap v1161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:18.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 437.785224 secs 2024-03-28T06:07:18.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1109 sec 2024-03-28T06:07:19.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1110 sec 2024-03-28T06:07:20.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:19 smithi086 ceph-mon[35163]: pgmap v1162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:20.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:19 smithi159 ceph-mon[36109]: pgmap v1162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:20.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:19 smithi055 ceph-mon[31863]: pgmap v1162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:20.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1111 sec 2024-03-28T06:07:21.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1112 sec 2024-03-28T06:07:22.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:21 smithi086 ceph-mon[35163]: pgmap v1163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:22.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:21 smithi159 ceph-mon[36109]: pgmap v1163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:22.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:21 smithi055 ceph-mon[31863]: pgmap v1163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:22.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1113 sec 2024-03-28T06:07:23.014 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 442.785291 secs 2024-03-28T06:07:23.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 442.785291 secs 2024-03-28T06:07:23.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 442.785291 secs 2024-03-28T06:07:23.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1114 sec 2024-03-28T06:07:24.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:23 smithi086 ceph-mon[35163]: pgmap v1164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:24.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:23 smithi159 ceph-mon[36109]: pgmap v1164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:24.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:23 smithi055 ceph-mon[31863]: pgmap v1164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:24.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1115 sec 2024-03-28T06:07:25.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1116 sec 2024-03-28T06:07:26.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:25 smithi086 ceph-mon[35163]: pgmap v1165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:07:26.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:25 smithi159 ceph-mon[36109]: pgmap v1165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:07:26.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:25 smithi055 ceph-mon[31863]: pgmap v1165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:07:26.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1117 sec 2024-03-28T06:07:27.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1118 sec 2024-03-28T06:07:28.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:27 smithi086 ceph-mon[35163]: pgmap v1166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 447.785414 secs 2024-03-28T06:07:28.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:27 smithi159 ceph-mon[36109]: pgmap v1166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:28.067 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 447.785414 secs 2024-03-28T06:07:28.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:27 smithi055 ceph-mon[31863]: pgmap v1166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:28.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 447.785414 secs 2024-03-28T06:07:28.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1119 sec 2024-03-28T06:07:29.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1120 sec 2024-03-28T06:07:30.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:29 smithi086 ceph-mon[35163]: pgmap v1167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:30.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:29 smithi159 ceph-mon[36109]: pgmap v1167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:30.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:29 smithi055 ceph-mon[31863]: pgmap v1167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:30.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1121 sec 2024-03-28T06:07:31.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1122 sec 2024-03-28T06:07:32.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:31 smithi086 ceph-mon[35163]: pgmap v1168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:32.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:31 smithi159 ceph-mon[36109]: pgmap v1168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:32.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:31 smithi055 ceph-mon[31863]: pgmap v1168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:32.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1123 sec 2024-03-28T06:07:33.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 452.785537 secs 2024-03-28T06:07:33.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 452.785537 secs 2024-03-28T06:07:33.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 452.785537 secs 2024-03-28T06:07:33.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1124 sec 2024-03-28T06:07:34.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:33 smithi086 ceph-mon[35163]: pgmap v1169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:34.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:33 smithi159 ceph-mon[36109]: pgmap v1169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:34.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:33 smithi055 ceph-mon[31863]: pgmap v1169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:34.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1125 sec 2024-03-28T06:07:35.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1126 sec 2024-03-28T06:07:36.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:35 smithi086 ceph-mon[35163]: pgmap v1170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:36.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:35 smithi159 ceph-mon[36109]: pgmap v1170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:36.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:35 smithi055 ceph-mon[31863]: pgmap v1170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:36.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1127 sec 2024-03-28T06:07:37.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1128 sec 2024-03-28T06:07:38.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:37 smithi086 ceph-mon[35163]: pgmap v1171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:38.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 457.785660 secs 2024-03-28T06:07:38.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:37 smithi159 ceph-mon[36109]: pgmap v1171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:38.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 457.785660 secs 2024-03-28T06:07:38.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:37 smithi055 ceph-mon[31863]: pgmap v1171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:38.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 457.785660 secs 2024-03-28T06:07:38.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1129 sec 2024-03-28T06:07:39.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1130 sec 2024-03-28T06:07:40.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:39 smithi055 ceph-mon[31863]: pgmap v1172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:40.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1131 sec 2024-03-28T06:07:40.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:39 smithi086 ceph-mon[35163]: pgmap v1172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:40.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:39 smithi159 ceph-mon[36109]: pgmap v1172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:41.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1132 sec 2024-03-28T06:07:42.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:41 smithi055 ceph-mon[31863]: pgmap v1173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:42.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1133 sec 2024-03-28T06:07:42.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:41 smithi086 ceph-mon[35163]: pgmap v1173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:42.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:41 smithi159 ceph-mon[36109]: pgmap v1173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:43.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 462.785809 secs 2024-03-28T06:07:43.210 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 462.785809 secs 2024-03-28T06:07:43.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1134 sec 2024-03-28T06:07:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 462.785809 secs 2024-03-28T06:07:44.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:43 smithi055 ceph-mon[31863]: pgmap v1174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:44.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1135 sec 2024-03-28T06:07:44.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:43 smithi086 ceph-mon[35163]: pgmap v1174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:44.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:43 smithi159 ceph-mon[36109]: pgmap v1174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:45.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1136 sec 2024-03-28T06:07:46.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:45 smithi055 ceph-mon[31863]: pgmap v1175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:46.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1137 sec 2024-03-28T06:07:46.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:45 smithi086 ceph-mon[35163]: pgmap v1175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:46.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:45 smithi159 ceph-mon[36109]: pgmap v1175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:47.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1138 sec 2024-03-28T06:07:48.109 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:47 smithi086 ceph-mon[35163]: pgmap v1176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:48.109 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 467.785878 secs 2024-03-28T06:07:48.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:47 smithi055 ceph-mon[31863]: pgmap v1176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:48.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 467.785878 secs 2024-03-28T06:07:48.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1139 sec 2024-03-28T06:07:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:47 smithi159 ceph-mon[36109]: pgmap v1176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 467.785878 secs 2024-03-28T06:07:49.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1140 sec 2024-03-28T06:07:50.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:49 smithi055 ceph-mon[31863]: pgmap v1177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:50.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1141 sec 2024-03-28T06:07:50.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:49 smithi086 ceph-mon[35163]: pgmap v1177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:50.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:49 smithi159 ceph-mon[36109]: pgmap v1177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:51.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1142 sec 2024-03-28T06:07:52.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1143 sec 2024-03-28T06:07:52.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:51 smithi086 ceph-mon[35163]: pgmap v1178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:52.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:51 smithi159 ceph-mon[36109]: pgmap v1178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:52.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:51 smithi055 ceph-mon[31863]: pgmap v1178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:07:53.263 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 472.785962 secs 2024-03-28T06:07:53.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1144 sec 2024-03-28T06:07:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 472.785962 secs 2024-03-28T06:07:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 472.785962 secs 2024-03-28T06:07:54.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1145 sec 2024-03-28T06:07:54.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:53 smithi086 ceph-mon[35163]: pgmap v1179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:54.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:53 smithi159 ceph-mon[36109]: pgmap v1179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:54.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:53 smithi055 ceph-mon[31863]: pgmap v1179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:55.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1146 sec 2024-03-28T06:07:56.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1147 sec 2024-03-28T06:07:56.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:55 smithi086 ceph-mon[35163]: pgmap v1180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:56.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:55 smithi159 ceph-mon[36109]: pgmap v1180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:56.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:55 smithi055 ceph-mon[31863]: pgmap v1180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:57.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1148 sec 2024-03-28T06:07:58.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1149 sec 2024-03-28T06:07:58.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:57 smithi086 ceph-mon[35163]: pgmap v1181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:58.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 477.786078 secs 2024-03-28T06:07:58.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:57 smithi159 ceph-mon[36109]: pgmap v1181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:58.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 477.786078 secs 2024-03-28T06:07:58.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:57 smithi055 ceph-mon[31863]: pgmap v1181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:07:58.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 477.786078 secs 2024-03-28T06:07:59.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1150 sec 2024-03-28T06:08:00.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1151 sec 2024-03-28T06:08:00.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:07:59 smithi086 ceph-mon[35163]: pgmap v1182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:07:59 smithi159 ceph-mon[36109]: pgmap v1182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:07:59 smithi055 ceph-mon[31863]: pgmap v1182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:01.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1152 sec 2024-03-28T06:08:02.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1153 sec 2024-03-28T06:08:02.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:01 smithi086 ceph-mon[35163]: pgmap v1183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:02.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:01 smithi159 ceph-mon[36109]: pgmap v1183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:02.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:01 smithi055 ceph-mon[31863]: pgmap v1183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:03.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1154 sec 2024-03-28T06:08:03.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 482.786146 secs 2024-03-28T06:08:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 482.786146 secs 2024-03-28T06:08:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 482.786146 secs 2024-03-28T06:08:04.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1155 sec 2024-03-28T06:08:04.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:03 smithi086 ceph-mon[35163]: pgmap v1184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:04.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:03 smithi159 ceph-mon[36109]: pgmap v1184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:04.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:03 smithi055 ceph-mon[31863]: pgmap v1184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:05.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1156 sec 2024-03-28T06:08:06.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1157 sec 2024-03-28T06:08:06.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:05 smithi086 ceph-mon[35163]: pgmap v1185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:06.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:05 smithi159 ceph-mon[36109]: pgmap v1185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:06.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:05 smithi055 ceph-mon[31863]: pgmap v1185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:07.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1158 sec 2024-03-28T06:08:08.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1159 sec 2024-03-28T06:08:08.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:07 smithi086 ceph-mon[35163]: pgmap v1186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:08.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 487.786264 secs 2024-03-28T06:08:08.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:07 smithi159 ceph-mon[36109]: pgmap v1186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:08.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 487.786264 secs 2024-03-28T06:08:08.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:07 smithi055 ceph-mon[31863]: pgmap v1186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:08.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 487.786264 secs 2024-03-28T06:08:09.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1160 sec 2024-03-28T06:08:10.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1161 sec 2024-03-28T06:08:10.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:09 smithi086 ceph-mon[35163]: pgmap v1187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:10.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:09 smithi159 ceph-mon[36109]: pgmap v1187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:10.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:09 smithi055 ceph-mon[31863]: pgmap v1187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:11.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1162 sec 2024-03-28T06:08:12.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1163 sec 2024-03-28T06:08:12.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:11 smithi086 ceph-mon[35163]: pgmap v1188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:12.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:11 smithi159 ceph-mon[36109]: pgmap v1188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:12.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:11 smithi055 ceph-mon[31863]: pgmap v1188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:13.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1164 sec 2024-03-28T06:08:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 492.786331 secs 2024-03-28T06:08:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 492.786331 secs 2024-03-28T06:08:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 492.786331 secs 2024-03-28T06:08:14.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1165 sec 2024-03-28T06:08:14.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:13 smithi086 ceph-mon[35163]: pgmap v1189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:14.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:13 smithi159 ceph-mon[36109]: pgmap v1189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:14.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:13 smithi055 ceph-mon[31863]: pgmap v1189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:15.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1166 sec 2024-03-28T06:08:15.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:08:15.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:08:15.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:08:16.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1167 sec 2024-03-28T06:08:16.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:16 smithi086 ceph-mon[35163]: pgmap v1190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:16.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:08:16.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:08:16.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:08:16.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:16 smithi159 ceph-mon[36109]: pgmap v1190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:16.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:08:16.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:08:16.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:08:16.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:16 smithi055 ceph-mon[31863]: pgmap v1190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:16.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:08:16.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:08:16.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:08:17.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1168 sec 2024-03-28T06:08:17.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:17 smithi086 ceph-mon[35163]: pgmap v1191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:17.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:17 smithi086 ceph-mon[35163]: pgmap v1192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:17.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:17 smithi159 ceph-mon[36109]: pgmap v1191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:17.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:17 smithi159 ceph-mon[36109]: pgmap v1192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:17.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:17 smithi055 ceph-mon[31863]: pgmap v1191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:17.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:17 smithi055 ceph-mon[31863]: pgmap v1192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:18.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1169 sec 2024-03-28T06:08:18.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 497.786391 secs 2024-03-28T06:08:18.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 497.786391 secs 2024-03-28T06:08:18.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 497.786391 secs 2024-03-28T06:08:19.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1170 sec 2024-03-28T06:08:19.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:19 smithi086 ceph-mon[35163]: pgmap v1193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:19.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:19 smithi159 ceph-mon[36109]: pgmap v1193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:19.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:19 smithi055 ceph-mon[31863]: pgmap v1193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:20.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1171 sec 2024-03-28T06:08:21.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1172 sec 2024-03-28T06:08:21.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:21 smithi086 ceph-mon[35163]: pgmap v1194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:21.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:21 smithi159 ceph-mon[36109]: pgmap v1194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:21.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:21 smithi055 ceph-mon[31863]: pgmap v1194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:08:22.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1173 sec 2024-03-28T06:08:23.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1174 sec 2024-03-28T06:08:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:23 smithi086 ceph-mon[35163]: pgmap v1195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 502.786456 secs 2024-03-28T06:08:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:23 smithi159 ceph-mon[36109]: pgmap v1195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 502.786456 secs 2024-03-28T06:08:23.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:23 smithi055 ceph-mon[31863]: pgmap v1195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:23.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 502.786456 secs 2024-03-28T06:08:24.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1175 sec 2024-03-28T06:08:24.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:24 smithi055 ceph-mon[31863]: pgmap v1196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:24.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:24 smithi086 ceph-mon[35163]: pgmap v1196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:24.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:24 smithi159 ceph-mon[36109]: pgmap v1196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:25.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1176 sec 2024-03-28T06:08:26.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1177 sec 2024-03-28T06:08:27.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1178 sec 2024-03-28T06:08:27.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:26 smithi086 ceph-mon[35163]: pgmap v1197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:27.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:26 smithi159 ceph-mon[36109]: pgmap v1197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:27.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:26 smithi055 ceph-mon[31863]: pgmap v1197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:28.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1179 sec 2024-03-28T06:08:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 507.786519 secs 2024-03-28T06:08:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 507.786519 secs 2024-03-28T06:08:28.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 507.786519 secs 2024-03-28T06:08:29.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1180 sec 2024-03-28T06:08:29.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:29 smithi086 ceph-mon[35163]: pgmap v1198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:29.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:29 smithi159 ceph-mon[36109]: pgmap v1198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:29.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:29 smithi055 ceph-mon[31863]: pgmap v1198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:30.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1181 sec 2024-03-28T06:08:31.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1182 sec 2024-03-28T06:08:31.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:31 smithi086 ceph-mon[35163]: pgmap v1199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:31 smithi159 ceph-mon[36109]: pgmap v1199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:31 smithi055 ceph-mon[31863]: pgmap v1199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:32.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1183 sec 2024-03-28T06:08:33.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1184 sec 2024-03-28T06:08:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:33 smithi086 ceph-mon[35163]: pgmap v1200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 512.786606 secs 2024-03-28T06:08:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:33 smithi159 ceph-mon[36109]: pgmap v1200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 512.786606 secs 2024-03-28T06:08:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:33 smithi055 ceph-mon[31863]: pgmap v1200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 512.786606 secs 2024-03-28T06:08:34.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1185 sec 2024-03-28T06:08:35.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1186 sec 2024-03-28T06:08:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:35 smithi086 ceph-mon[35163]: pgmap v1201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:35 smithi159 ceph-mon[36109]: pgmap v1201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:35 smithi055 ceph-mon[31863]: pgmap v1201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:36.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1187 sec 2024-03-28T06:08:37.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1188 sec 2024-03-28T06:08:37.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:37 smithi086 ceph-mon[35163]: pgmap v1202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:37.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:37 smithi159 ceph-mon[36109]: pgmap v1202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:37 smithi055 ceph-mon[31863]: pgmap v1202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:38.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1189 sec 2024-03-28T06:08:38.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 517.786727 secs 2024-03-28T06:08:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 517.786727 secs 2024-03-28T06:08:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 517.786727 secs 2024-03-28T06:08:39.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1190 sec 2024-03-28T06:08:39.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:39 smithi086 ceph-mon[35163]: pgmap v1203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:39.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:39 smithi159 ceph-mon[36109]: pgmap v1203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:39.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:39 smithi055 ceph-mon[31863]: pgmap v1203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:40.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1191 sec 2024-03-28T06:08:40.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:40 smithi055 ceph-mon[31863]: pgmap v1204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:40.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:40 smithi086 ceph-mon[35163]: pgmap v1204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:40.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:40 smithi159 ceph-mon[36109]: pgmap v1204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:41.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1192 sec 2024-03-28T06:08:42.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1193 sec 2024-03-28T06:08:43.262 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:42 smithi159 ceph-mon[36109]: pgmap v1205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:43.263 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 522.786861 secs 2024-03-28T06:08:43.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1194 sec 2024-03-28T06:08:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:42 smithi086 ceph-mon[35163]: pgmap v1205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 522.786861 secs 2024-03-28T06:08:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:42 smithi055 ceph-mon[31863]: pgmap v1205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 522.786861 secs 2024-03-28T06:08:44.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1195 sec 2024-03-28T06:08:45.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1196 sec 2024-03-28T06:08:45.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:44 smithi086 ceph-mon[35163]: pgmap v1206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:45.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:44 smithi159 ceph-mon[36109]: pgmap v1206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:45.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:44 smithi055 ceph-mon[31863]: pgmap v1206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:46.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1197 sec 2024-03-28T06:08:47.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1198 sec 2024-03-28T06:08:47.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:47 smithi086 ceph-mon[35163]: pgmap v1207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:47.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:47 smithi159 ceph-mon[36109]: pgmap v1207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:47.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:47 smithi055 ceph-mon[31863]: pgmap v1207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:48.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1199 sec 2024-03-28T06:08:48.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 527.786935 secs 2024-03-28T06:08:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 527.786935 secs 2024-03-28T06:08:48.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 527.786935 secs 2024-03-28T06:08:49.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1200 sec 2024-03-28T06:08:49.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:49 smithi086 ceph-mon[35163]: pgmap v1208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:49.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:49 smithi159 ceph-mon[36109]: pgmap v1208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:49.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:49 smithi055 ceph-mon[31863]: pgmap v1208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:50.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1201 sec 2024-03-28T06:08:51.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1202 sec 2024-03-28T06:08:51.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:51 smithi086 ceph-mon[35163]: pgmap v1209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:51.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:51 smithi159 ceph-mon[36109]: pgmap v1209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:51.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:51 smithi055 ceph-mon[31863]: pgmap v1209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:08:52.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1203 sec 2024-03-28T06:08:53.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1204 sec 2024-03-28T06:08:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:53 smithi086 ceph-mon[35163]: pgmap v1210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 532.787055 secs 2024-03-28T06:08:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:53 smithi159 ceph-mon[36109]: pgmap v1210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 532.787055 secs 2024-03-28T06:08:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:53 smithi055 ceph-mon[31863]: pgmap v1210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:08:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 532.787055 secs 2024-03-28T06:08:54.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1205 sec 2024-03-28T06:08:55.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1206 sec 2024-03-28T06:08:55.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:55 smithi086 ceph-mon[35163]: pgmap v1211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:55.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:55 smithi159 ceph-mon[36109]: pgmap v1211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:55.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:55 smithi055 ceph-mon[31863]: pgmap v1211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:56.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1207 sec 2024-03-28T06:08:57.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1208 sec 2024-03-28T06:08:57.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:57 smithi086 ceph-mon[35163]: pgmap v1212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:57.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:57 smithi159 ceph-mon[36109]: pgmap v1212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:57.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:57 smithi055 ceph-mon[31863]: pgmap v1212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:58.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1209 sec 2024-03-28T06:08:58.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 537.787188 secs 2024-03-28T06:08:58.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 537.787188 secs 2024-03-28T06:08:58.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 537.787188 secs 2024-03-28T06:08:59.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1210 sec 2024-03-28T06:08:59.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:08:59 smithi086 ceph-mon[35163]: pgmap v1213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:59.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:08:59 smithi159 ceph-mon[36109]: pgmap v1213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:08:59.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:08:59 smithi055 ceph-mon[31863]: pgmap v1213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:09:00.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1211 sec 2024-03-28T06:09:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:00 smithi055 ceph-mon[31863]: pgmap v1214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:09:00.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:00 smithi086 ceph-mon[35163]: pgmap v1214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:09:00.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:00 smithi159 ceph-mon[36109]: pgmap v1214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:09:01.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1212 sec 2024-03-28T06:09:02.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1213 sec 2024-03-28T06:09:03.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1214 sec 2024-03-28T06:09:03.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:02 smithi086 ceph-mon[35163]: pgmap v1215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:03.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 542.787273 secs 2024-03-28T06:09:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:02 smithi159 ceph-mon[36109]: pgmap v1215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 542.787273 secs 2024-03-28T06:09:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:02 smithi055 ceph-mon[31863]: pgmap v1215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 542.787273 secs 2024-03-28T06:09:04.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1215 sec 2024-03-28T06:09:05.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1216 sec 2024-03-28T06:09:05.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:05 smithi086 ceph-mon[35163]: pgmap v1216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:05.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:05 smithi159 ceph-mon[36109]: pgmap v1216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:05.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:05 smithi055 ceph-mon[31863]: pgmap v1216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:06.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1217 sec 2024-03-28T06:09:07.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1218 sec 2024-03-28T06:09:07.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:07 smithi086 ceph-mon[35163]: pgmap v1217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:07.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:07 smithi159 ceph-mon[36109]: pgmap v1217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:07.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:07 smithi055 ceph-mon[31863]: pgmap v1217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:08.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1219 sec 2024-03-28T06:09:08.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 547.787336 secs 2024-03-28T06:09:08.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 547.787336 secs 2024-03-28T06:09:08.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 547.787336 secs 2024-03-28T06:09:09.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1220 sec 2024-03-28T06:09:09.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:09 smithi086 ceph-mon[35163]: pgmap v1218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:09.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:09 smithi159 ceph-mon[36109]: pgmap v1218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:09.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:09 smithi055 ceph-mon[31863]: pgmap v1218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:10.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1221 sec 2024-03-28T06:09:11.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1222 sec 2024-03-28T06:09:11.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:11 smithi086 ceph-mon[35163]: pgmap v1219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:11.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:11 smithi159 ceph-mon[36109]: pgmap v1219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:11.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:11 smithi055 ceph-mon[31863]: pgmap v1219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:12.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1223 sec 2024-03-28T06:09:13.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1224 sec 2024-03-28T06:09:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:13 smithi086 ceph-mon[35163]: pgmap v1220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 552.787459 secs 2024-03-28T06:09:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:13 smithi159 ceph-mon[36109]: pgmap v1220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 552.787459 secs 2024-03-28T06:09:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:13 smithi055 ceph-mon[31863]: pgmap v1220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 552.787459 secs 2024-03-28T06:09:14.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1225 sec 2024-03-28T06:09:15.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1226 sec 2024-03-28T06:09:15.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:15 smithi086 ceph-mon[35163]: pgmap v1221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:15.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:15 smithi159 ceph-mon[36109]: pgmap v1221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:15.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:15 smithi055 ceph-mon[31863]: pgmap v1221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:16.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1227 sec 2024-03-28T06:09:17.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1228 sec 2024-03-28T06:09:17.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:17 smithi086 ceph-mon[35163]: pgmap v1222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:17.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:09:17.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:17 smithi159 ceph-mon[36109]: pgmap v1222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:17.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:09:17.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:17 smithi055 ceph-mon[31863]: pgmap v1222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:17.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:09:18.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1229 sec 2024-03-28T06:09:18.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 557.787530 secs 2024-03-28T06:09:18.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:09:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:09:18.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:09:18.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 557.787530 secs 2024-03-28T06:09:18.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:09:18.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:09:18.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:09:18.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 557.787530 secs 2024-03-28T06:09:18.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:09:18.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:09:18.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:09:19.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1230 sec 2024-03-28T06:09:19.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:19 smithi055 ceph-mon[31863]: pgmap v1223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:19.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:19 smithi055 ceph-mon[31863]: pgmap v1224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:09:19.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:19 smithi086 ceph-mon[35163]: pgmap v1223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:19.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:19 smithi086 ceph-mon[35163]: pgmap v1224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:09:19.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:19 smithi159 ceph-mon[36109]: pgmap v1223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:19.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:19 smithi159 ceph-mon[36109]: pgmap v1224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:09:20.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1231 sec 2024-03-28T06:09:20.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:20 smithi055 ceph-mon[31863]: pgmap v1225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:20.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:20 smithi086 ceph-mon[35163]: pgmap v1225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:20.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:20 smithi159 ceph-mon[36109]: pgmap v1225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:21.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1232 sec 2024-03-28T06:09:22.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1233 sec 2024-03-28T06:09:23.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:22 smithi055 ceph-mon[31863]: pgmap v1226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:23.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 562.787646 secs 2024-03-28T06:09:23.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1234 sec 2024-03-28T06:09:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:22 smithi086 ceph-mon[35163]: pgmap v1226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 562.787646 secs 2024-03-28T06:09:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:22 smithi159 ceph-mon[36109]: pgmap v1226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 562.787646 secs 2024-03-28T06:09:24.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1235 sec 2024-03-28T06:09:25.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:24 smithi055 ceph-mon[31863]: pgmap v1227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:25.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1236 sec 2024-03-28T06:09:25.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:24 smithi086 ceph-mon[35163]: pgmap v1227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:25.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:24 smithi159 ceph-mon[36109]: pgmap v1227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:26.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1237 sec 2024-03-28T06:09:27.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:26 smithi055 ceph-mon[31863]: pgmap v1228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:27.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1238 sec 2024-03-28T06:09:27.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:26 smithi086 ceph-mon[35163]: pgmap v1228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:27.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:26 smithi159 ceph-mon[36109]: pgmap v1228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:09:28.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1239 sec 2024-03-28T06:09:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 567.787747 secs 2024-03-28T06:09:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 567.787747 secs 2024-03-28T06:09:28.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 567.787747 secs 2024-03-28T06:09:29.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1240 sec 2024-03-28T06:09:29.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:28 smithi086 ceph-mon[35163]: pgmap v1229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:09:29.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:28 smithi159 ceph-mon[36109]: pgmap v1229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:09:29.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:28 smithi055 ceph-mon[31863]: pgmap v1229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:09:30.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1241 sec 2024-03-28T06:09:31.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1242 sec 2024-03-28T06:09:31.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:30 smithi086 ceph-mon[35163]: pgmap v1230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:30 smithi159 ceph-mon[36109]: pgmap v1230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:30 smithi055 ceph-mon[31863]: pgmap v1230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:32.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1243 sec 2024-03-28T06:09:33.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1244 sec 2024-03-28T06:09:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:32 smithi086 ceph-mon[35163]: pgmap v1231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 572.787871 secs 2024-03-28T06:09:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:32 smithi159 ceph-mon[36109]: pgmap v1231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 572.787871 secs 2024-03-28T06:09:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:32 smithi055 ceph-mon[31863]: pgmap v1231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 572.787871 secs 2024-03-28T06:09:34.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1245 sec 2024-03-28T06:09:35.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1246 sec 2024-03-28T06:09:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:34 smithi086 ceph-mon[35163]: pgmap v1232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:34 smithi159 ceph-mon[36109]: pgmap v1232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:34 smithi055 ceph-mon[31863]: pgmap v1232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:36.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1247 sec 2024-03-28T06:09:37.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1248 sec 2024-03-28T06:09:37.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:36 smithi086 ceph-mon[35163]: pgmap v1233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:37.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:36 smithi159 ceph-mon[36109]: pgmap v1233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:36 smithi055 ceph-mon[31863]: pgmap v1233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:38.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1249 sec 2024-03-28T06:09:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 577.787936 secs 2024-03-28T06:09:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 577.787936 secs 2024-03-28T06:09:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 577.787936 secs 2024-03-28T06:09:39.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1250 sec 2024-03-28T06:09:39.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:38 smithi086 ceph-mon[35163]: pgmap v1234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:39.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:38 smithi159 ceph-mon[36109]: pgmap v1234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:39.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:38 smithi055 ceph-mon[31863]: pgmap v1234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:40.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1251 sec 2024-03-28T06:09:41.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1252 sec 2024-03-28T06:09:41.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:40 smithi086 ceph-mon[35163]: pgmap v1235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:41.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:40 smithi159 ceph-mon[36109]: pgmap v1235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:41.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:40 smithi055 ceph-mon[31863]: pgmap v1235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:42.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1253 sec 2024-03-28T06:09:43.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1254 sec 2024-03-28T06:09:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:42 smithi086 ceph-mon[35163]: pgmap v1236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 582.788056 secs 2024-03-28T06:09:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:42 smithi159 ceph-mon[36109]: pgmap v1236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 582.788056 secs 2024-03-28T06:09:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:42 smithi055 ceph-mon[31863]: pgmap v1236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 582.788056 secs 2024-03-28T06:09:44.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1255 sec 2024-03-28T06:09:45.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1256 sec 2024-03-28T06:09:45.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:44 smithi086 ceph-mon[35163]: pgmap v1237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:45.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:44 smithi159 ceph-mon[36109]: pgmap v1237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:45.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:44 smithi055 ceph-mon[31863]: pgmap v1237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:46.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1257 sec 2024-03-28T06:09:47.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1258 sec 2024-03-28T06:09:47.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:46 smithi086 ceph-mon[35163]: pgmap v1238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:47.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:46 smithi159 ceph-mon[36109]: pgmap v1238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:47.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:46 smithi055 ceph-mon[31863]: pgmap v1238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:48.207 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 587.788140 secs 2024-03-28T06:09:48.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1259 sec 2024-03-28T06:09:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 587.788140 secs 2024-03-28T06:09:48.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 587.788140 secs 2024-03-28T06:09:49.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1260 sec 2024-03-28T06:09:49.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:48 smithi086 ceph-mon[35163]: pgmap v1239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:49.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:48 smithi159 ceph-mon[36109]: pgmap v1239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:49.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:48 smithi055 ceph-mon[31863]: pgmap v1239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:50.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1261 sec 2024-03-28T06:09:51.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1262 sec 2024-03-28T06:09:51.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:50 smithi086 ceph-mon[35163]: pgmap v1240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:51.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:50 smithi159 ceph-mon[36109]: pgmap v1240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:51.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:50 smithi055 ceph-mon[31863]: pgmap v1240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:52.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1263 sec 2024-03-28T06:09:53.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1264 sec 2024-03-28T06:09:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:52 smithi086 ceph-mon[35163]: pgmap v1241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 592.788263 secs 2024-03-28T06:09:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:52 smithi159 ceph-mon[36109]: pgmap v1241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 592.788263 secs 2024-03-28T06:09:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:52 smithi055 ceph-mon[31863]: pgmap v1241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 592.788263 secs 2024-03-28T06:09:54.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1265 sec 2024-03-28T06:09:55.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1266 sec 2024-03-28T06:09:55.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:54 smithi086 ceph-mon[35163]: pgmap v1242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:55.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:54 smithi159 ceph-mon[36109]: pgmap v1242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:55.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:54 smithi055 ceph-mon[31863]: pgmap v1242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:56.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1267 sec 2024-03-28T06:09:57.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1268 sec 2024-03-28T06:09:57.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:56 smithi086 ceph-mon[35163]: pgmap v1243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:57.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:56 smithi159 ceph-mon[36109]: pgmap v1243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:57.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:56 smithi055 ceph-mon[31863]: pgmap v1243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:09:58.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1269 sec 2024-03-28T06:09:58.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 597.788384 secs 2024-03-28T06:09:58.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 597.788384 secs 2024-03-28T06:09:58.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 597.788384 secs 2024-03-28T06:09:59.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1270 sec 2024-03-28T06:09:59.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:09:59 smithi086 ceph-mon[35163]: pgmap v1244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:59.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:09:59 smithi159 ceph-mon[36109]: pgmap v1244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:09:59.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:09:59 smithi055 ceph-mon[31863]: pgmap v1244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:00.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1271 sec 2024-03-28T06:10:00.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:10:00.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-03-28T06:10:00.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.j on smithi055 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.d on smithi055 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.g on smithi055 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.a on smithi055 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.h on smithi086 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.l on smithi159 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.f on smithi159 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: daemon mds.i on smithi159 is in error state 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-03-28T06:10:00.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:00 smithi086 ceph-mon[35163]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.j on smithi055 is in error state 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.d on smithi055 is in error state 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.g on smithi055 is in error state 2024-03-28T06:10:00.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.a on smithi055 is in error state 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.h on smithi086 is in error state 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.l on smithi159 is in error state 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.f on smithi159 is in error state 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: daemon mds.i on smithi159 is in error state 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-03-28T06:10:00.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:00 smithi159 ceph-mon[36109]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2024-03-28T06:10:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:10:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-03-28T06:10:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.j on smithi055 is in error state 2024-03-28T06:10:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.d on smithi055 is in error state 2024-03-28T06:10:00.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.g on smithi055 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.a on smithi055 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.h on smithi086 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.l on smithi159 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.f on smithi159 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: daemon mds.i on smithi159 is in error state 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-03-28T06:10:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:00 smithi055 ceph-mon[31863]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2024-03-28T06:10:01.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1272 sec 2024-03-28T06:10:01.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:01 smithi086 ceph-mon[35163]: pgmap v1245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:01.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:01 smithi159 ceph-mon[36109]: pgmap v1245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:01.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:01 smithi055 ceph-mon[31863]: pgmap v1245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:02.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1273 sec 2024-03-28T06:10:03.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1274 sec 2024-03-28T06:10:03.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:03 smithi086 ceph-mon[35163]: pgmap v1246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:03.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 602.788507 secs 2024-03-28T06:10:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:03 smithi159 ceph-mon[36109]: pgmap v1246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 602.788507 secs 2024-03-28T06:10:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:03 smithi055 ceph-mon[31863]: pgmap v1246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 602.788507 secs 2024-03-28T06:10:04.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1275 sec 2024-03-28T06:10:05.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1276 sec 2024-03-28T06:10:05.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:05 smithi086 ceph-mon[35163]: pgmap v1247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:05.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:05 smithi159 ceph-mon[36109]: pgmap v1247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:05.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:05 smithi055 ceph-mon[31863]: pgmap v1247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:06.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1277 sec 2024-03-28T06:10:07.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1278 sec 2024-03-28T06:10:07.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:07 smithi086 ceph-mon[35163]: pgmap v1248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:07.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:07 smithi159 ceph-mon[36109]: pgmap v1248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:07.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:07 smithi055 ceph-mon[31863]: pgmap v1248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:08.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1279 sec 2024-03-28T06:10:08.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 607.788618 secs 2024-03-28T06:10:08.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 607.788618 secs 2024-03-28T06:10:08.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 607.788618 secs 2024-03-28T06:10:09.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1280 sec 2024-03-28T06:10:09.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:09 smithi055 ceph-mon[31863]: pgmap v1249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:09.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:09 smithi086 ceph-mon[35163]: pgmap v1249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:09.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:09 smithi159 ceph-mon[36109]: pgmap v1249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:10.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1281 sec 2024-03-28T06:10:10.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:10 smithi055 ceph-mon[31863]: pgmap v1250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:10.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:10 smithi086 ceph-mon[35163]: pgmap v1250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:10.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:10 smithi159 ceph-mon[36109]: pgmap v1250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:11.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1282 sec 2024-03-28T06:10:12.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1283 sec 2024-03-28T06:10:13.262 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:12 smithi159 ceph-mon[36109]: pgmap v1251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:13.262 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 612.788683 secs 2024-03-28T06:10:13.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1284 sec 2024-03-28T06:10:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:12 smithi086 ceph-mon[35163]: pgmap v1251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 612.788683 secs 2024-03-28T06:10:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:12 smithi055 ceph-mon[31863]: pgmap v1251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 612.788683 secs 2024-03-28T06:10:14.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1285 sec 2024-03-28T06:10:15.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1286 sec 2024-03-28T06:10:15.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:14 smithi086 ceph-mon[35163]: pgmap v1252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:15.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:14 smithi159 ceph-mon[36109]: pgmap v1252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:15.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:14 smithi055 ceph-mon[31863]: pgmap v1252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:16.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1287 sec 2024-03-28T06:10:17.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1288 sec 2024-03-28T06:10:17.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:16 smithi086 ceph-mon[35163]: pgmap v1253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:17.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:16 smithi159 ceph-mon[36109]: pgmap v1253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:17.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:16 smithi055 ceph-mon[31863]: pgmap v1253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:18.207 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 617.788743 secs 2024-03-28T06:10:18.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1289 sec 2024-03-28T06:10:18.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 617.788743 secs 2024-03-28T06:10:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 617.788743 secs 2024-03-28T06:10:19.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1290 sec 2024-03-28T06:10:19.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:18 smithi086 ceph-mon[35163]: pgmap v1254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:19.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:10:19.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:18 smithi159 ceph-mon[36109]: pgmap v1254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:19.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:10:19.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:18 smithi055 ceph-mon[31863]: pgmap v1254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:19.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:10:20.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1291 sec 2024-03-28T06:10:20.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:10:20.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:10:20.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:10:20.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:10:20.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:10:20.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:10:20.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:10:20.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:10:20.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:10:21.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1292 sec 2024-03-28T06:10:21.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:20 smithi086 ceph-mon[35163]: pgmap v1255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:21.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:20 smithi086 ceph-mon[35163]: pgmap v1256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:21.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:20 smithi159 ceph-mon[36109]: pgmap v1255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:21.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:20 smithi159 ceph-mon[36109]: pgmap v1256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:21.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:20 smithi055 ceph-mon[31863]: pgmap v1255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:21.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:20 smithi055 ceph-mon[31863]: pgmap v1256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:22.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1293 sec 2024-03-28T06:10:23.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1294 sec 2024-03-28T06:10:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:22 smithi086 ceph-mon[35163]: pgmap v1257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 622.788835 secs 2024-03-28T06:10:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:22 smithi159 ceph-mon[36109]: pgmap v1257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 622.788835 secs 2024-03-28T06:10:23.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:22 smithi055 ceph-mon[31863]: pgmap v1257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:23.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 622.788835 secs 2024-03-28T06:10:24.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1295 sec 2024-03-28T06:10:25.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:24 smithi055 ceph-mon[31863]: pgmap v1258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:25.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1296 sec 2024-03-28T06:10:25.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:24 smithi086 ceph-mon[35163]: pgmap v1258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:25.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:24 smithi159 ceph-mon[36109]: pgmap v1258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:26.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1297 sec 2024-03-28T06:10:27.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1298 sec 2024-03-28T06:10:27.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:26 smithi086 ceph-mon[35163]: pgmap v1259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:27.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:26 smithi159 ceph-mon[36109]: pgmap v1259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:27.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:26 smithi055 ceph-mon[31863]: pgmap v1259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:28.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1299 sec 2024-03-28T06:10:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 627.788958 secs 2024-03-28T06:10:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 627.788958 secs 2024-03-28T06:10:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 627.788958 secs 2024-03-28T06:10:29.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1300 sec 2024-03-28T06:10:29.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:28 smithi086 ceph-mon[35163]: pgmap v1260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:29.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:28 smithi159 ceph-mon[36109]: pgmap v1260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:29.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:28 smithi055 ceph-mon[31863]: pgmap v1260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:10:30.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1301 sec 2024-03-28T06:10:31.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1302 sec 2024-03-28T06:10:31.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:30 smithi086 ceph-mon[35163]: pgmap v1261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:30 smithi159 ceph-mon[36109]: pgmap v1261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:30 smithi055 ceph-mon[31863]: pgmap v1261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:32.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1303 sec 2024-03-28T06:10:33.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1304 sec 2024-03-28T06:10:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:32 smithi086 ceph-mon[35163]: pgmap v1262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 632.789021 secs 2024-03-28T06:10:33.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:32 smithi159 ceph-mon[36109]: pgmap v1262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 632.789021 secs 2024-03-28T06:10:33.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:32 smithi055 ceph-mon[31863]: pgmap v1262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:33.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 632.789021 secs 2024-03-28T06:10:34.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1305 sec 2024-03-28T06:10:35.226 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:34 smithi055 ceph-mon[31863]: pgmap v1263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:35.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1306 sec 2024-03-28T06:10:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:34 smithi086 ceph-mon[35163]: pgmap v1263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:35.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:34 smithi159 ceph-mon[36109]: pgmap v1263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:36.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1307 sec 2024-03-28T06:10:37.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1308 sec 2024-03-28T06:10:37.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:36 smithi086 ceph-mon[35163]: pgmap v1264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:37.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:36 smithi159 ceph-mon[36109]: pgmap v1264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:37.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:36 smithi055 ceph-mon[31863]: pgmap v1264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:38.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1309 sec 2024-03-28T06:10:38.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 637.789142 secs 2024-03-28T06:10:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 637.789142 secs 2024-03-28T06:10:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 637.789142 secs 2024-03-28T06:10:39.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1310 sec 2024-03-28T06:10:39.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:39 smithi086 ceph-mon[35163]: pgmap v1265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:39.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:39 smithi159 ceph-mon[36109]: pgmap v1265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:39.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:39 smithi055 ceph-mon[31863]: pgmap v1265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:40.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1311 sec 2024-03-28T06:10:41.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1312 sec 2024-03-28T06:10:41.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:41 smithi086 ceph-mon[35163]: pgmap v1266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:41.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:41 smithi159 ceph-mon[36109]: pgmap v1266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:41.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:41 smithi055 ceph-mon[31863]: pgmap v1266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:42.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1313 sec 2024-03-28T06:10:43.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1314 sec 2024-03-28T06:10:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:43 smithi086 ceph-mon[35163]: pgmap v1267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:43.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 642.789265 secs 2024-03-28T06:10:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:43 smithi159 ceph-mon[36109]: pgmap v1267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 642.789265 secs 2024-03-28T06:10:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:43 smithi055 ceph-mon[31863]: pgmap v1267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 642.789265 secs 2024-03-28T06:10:44.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1315 sec 2024-03-28T06:10:45.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1316 sec 2024-03-28T06:10:45.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:45 smithi086 ceph-mon[35163]: pgmap v1268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:45.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:45 smithi159 ceph-mon[36109]: pgmap v1268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:45.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:45 smithi055 ceph-mon[31863]: pgmap v1268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:46.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1317 sec 2024-03-28T06:10:47.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1318 sec 2024-03-28T06:10:47.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:47 smithi086 ceph-mon[35163]: pgmap v1269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:47.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:47 smithi159 ceph-mon[36109]: pgmap v1269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:47.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:47 smithi055 ceph-mon[31863]: pgmap v1269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:10:48.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1319 sec 2024-03-28T06:10:48.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 647.789330 secs 2024-03-28T06:10:48.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 647.789330 secs 2024-03-28T06:10:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 647.789330 secs 2024-03-28T06:10:49.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1320 sec 2024-03-28T06:10:49.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:49 smithi086 ceph-mon[35163]: pgmap v1270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:49.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:49 smithi159 ceph-mon[36109]: pgmap v1270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:49.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:49 smithi055 ceph-mon[31863]: pgmap v1270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:10:50.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1321 sec 2024-03-28T06:10:51.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1322 sec 2024-03-28T06:10:51.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:51 smithi086 ceph-mon[35163]: pgmap v1271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:51.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:51 smithi159 ceph-mon[36109]: pgmap v1271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:51.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:51 smithi055 ceph-mon[31863]: pgmap v1271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:52.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1323 sec 2024-03-28T06:10:53.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1324 sec 2024-03-28T06:10:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:53 smithi055 ceph-mon[31863]: pgmap v1272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 652.789449 secs 2024-03-28T06:10:53.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:53 smithi086 ceph-mon[35163]: pgmap v1272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:53.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 652.789449 secs 2024-03-28T06:10:53.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:53 smithi159 ceph-mon[36109]: pgmap v1272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:53.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 652.789449 secs 2024-03-28T06:10:54.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1325 sec 2024-03-28T06:10:54.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:54 smithi086 ceph-mon[35163]: pgmap v1273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:54.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:54 smithi159 ceph-mon[36109]: pgmap v1273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:54.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:54 smithi055 ceph-mon[31863]: pgmap v1273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:10:55.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1326 sec 2024-03-28T06:10:56.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1327 sec 2024-03-28T06:10:57.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:56 smithi086 ceph-mon[35163]: pgmap v1274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:57.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:56 smithi159 ceph-mon[36109]: pgmap v1274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:57.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:56 smithi055 ceph-mon[31863]: pgmap v1274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:10:57.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1328 sec 2024-03-28T06:10:58.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 657.789534 secs 2024-03-28T06:10:58.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 657.789534 secs 2024-03-28T06:10:58.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 657.789534 secs 2024-03-28T06:10:58.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1329 sec 2024-03-28T06:10:59.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:10:58 smithi086 ceph-mon[35163]: pgmap v1275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:10:59.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:10:58 smithi159 ceph-mon[36109]: pgmap v1275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:10:59.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:10:58 smithi055 ceph-mon[31863]: pgmap v1275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:10:59.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1330 sec 2024-03-28T06:11:00.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1331 sec 2024-03-28T06:11:01.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:00 smithi086 ceph-mon[35163]: pgmap v1276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:01.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:00 smithi159 ceph-mon[36109]: pgmap v1276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:01.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:00 smithi055 ceph-mon[31863]: pgmap v1276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:01.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1332 sec 2024-03-28T06:11:02.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1333 sec 2024-03-28T06:11:03.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:02 smithi086 ceph-mon[35163]: pgmap v1277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:03.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 662.789610 secs 2024-03-28T06:11:03.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:02 smithi159 ceph-mon[36109]: pgmap v1277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:03.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 662.789610 secs 2024-03-28T06:11:03.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:02 smithi055 ceph-mon[31863]: pgmap v1277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:03.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 662.789610 secs 2024-03-28T06:11:03.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1334 sec 2024-03-28T06:11:04.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1335 sec 2024-03-28T06:11:05.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:04 smithi086 ceph-mon[35163]: pgmap v1278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:05.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:04 smithi159 ceph-mon[36109]: pgmap v1278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:05.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:04 smithi055 ceph-mon[31863]: pgmap v1278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:11:05.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1336 sec 2024-03-28T06:11:06.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1337 sec 2024-03-28T06:11:07.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:06 smithi086 ceph-mon[35163]: pgmap v1279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:07.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:06 smithi159 ceph-mon[36109]: pgmap v1279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:07.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:06 smithi055 ceph-mon[31863]: pgmap v1279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:07.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1338 sec 2024-03-28T06:11:08.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 667.789695 secs 2024-03-28T06:11:08.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 667.789695 secs 2024-03-28T06:11:08.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 667.789695 secs 2024-03-28T06:11:08.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1339 sec 2024-03-28T06:11:09.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:08 smithi086 ceph-mon[35163]: pgmap v1280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:09.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:08 smithi159 ceph-mon[36109]: pgmap v1280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:09.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:08 smithi055 ceph-mon[31863]: pgmap v1280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:09.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1340 sec 2024-03-28T06:11:10.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1341 sec 2024-03-28T06:11:11.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:10 smithi086 ceph-mon[35163]: pgmap v1281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:11.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:10 smithi159 ceph-mon[36109]: pgmap v1281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:11.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:10 smithi055 ceph-mon[31863]: pgmap v1281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:11.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1342 sec 2024-03-28T06:11:12.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1343 sec 2024-03-28T06:11:13.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:12 smithi086 ceph-mon[35163]: pgmap v1282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:13.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 672.789827 secs 2024-03-28T06:11:13.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:12 smithi159 ceph-mon[36109]: pgmap v1282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:13.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 672.789827 secs 2024-03-28T06:11:13.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:12 smithi055 ceph-mon[31863]: pgmap v1282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:13.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 672.789827 secs 2024-03-28T06:11:13.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1344 sec 2024-03-28T06:11:14.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1345 sec 2024-03-28T06:11:15.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:14 smithi086 ceph-mon[35163]: pgmap v1283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:15.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:14 smithi159 ceph-mon[36109]: pgmap v1283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:15.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:14 smithi055 ceph-mon[31863]: pgmap v1283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:15.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1346 sec 2024-03-28T06:11:16.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1347 sec 2024-03-28T06:11:17.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:16 smithi086 ceph-mon[35163]: pgmap v1284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:17.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:16 smithi159 ceph-mon[36109]: pgmap v1284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:17.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:16 smithi055 ceph-mon[31863]: pgmap v1284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:17.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1348 sec 2024-03-28T06:11:18.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 677.789943 secs 2024-03-28T06:11:18.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1349 sec 2024-03-28T06:11:18.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 677.789943 secs 2024-03-28T06:11:18.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 677.789943 secs 2024-03-28T06:11:19.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:18 smithi055 ceph-mon[31863]: pgmap v1285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:19.207 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:18 smithi086 ceph-mon[35163]: pgmap v1285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:19.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1350 sec 2024-03-28T06:11:19.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:18 smithi159 ceph-mon[36109]: pgmap v1285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:20.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1351 sec 2024-03-28T06:11:21.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:20 smithi055 ceph-mon[31863]: pgmap v1286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:21.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:11:21.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1352 sec 2024-03-28T06:11:21.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:20 smithi086 ceph-mon[35163]: pgmap v1286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:21.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:11:21.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:20 smithi159 ceph-mon[36109]: pgmap v1286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:21.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:11:22.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1353 sec 2024-03-28T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:22 smithi086 ceph-mon[35163]: pgmap v1287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 682.789977 secs 2024-03-28T06:11:23.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:22 smithi055 ceph-mon[31863]: pgmap v1287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:23.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 682.789977 secs 2024-03-28T06:11:23.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1354 sec 2024-03-28T06:11:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:22 smithi159 ceph-mon[36109]: pgmap v1287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 682.789977 secs 2024-03-28T06:11:24.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1355 sec 2024-03-28T06:11:25.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:24 smithi055 ceph-mon[31863]: pgmap v1288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:25.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1356 sec 2024-03-28T06:11:25.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:24 smithi086 ceph-mon[35163]: pgmap v1288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:25.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:24 smithi159 ceph-mon[36109]: pgmap v1288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:26.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1357 sec 2024-03-28T06:11:27.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:26 smithi086 ceph-mon[35163]: pgmap v1289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:27.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:27.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:27.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:26 smithi055 ceph-mon[31863]: pgmap v1289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:27.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:27.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:27.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1358 sec 2024-03-28T06:11:27.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:26 smithi159 ceph-mon[36109]: pgmap v1289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:27.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:27.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1359 sec 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: pgmap v1290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: pgmap v1291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.611 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 687.790038 secs 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: pgmap v1290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: pgmap v1291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 687.790038 secs 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: pgmap v1290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: pgmap v1291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:11:28.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 687.790038 secs 2024-03-28T06:11:29.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1360 sec 2024-03-28T06:11:30.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1361 sec 2024-03-28T06:11:30.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:30 smithi086 ceph-mon[35163]: pgmap v1292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:30.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:30 smithi159 ceph-mon[36109]: pgmap v1292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:30.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:30 smithi055 ceph-mon[31863]: pgmap v1292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:31.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1362 sec 2024-03-28T06:11:32.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1363 sec 2024-03-28T06:11:32.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:32 smithi086 ceph-mon[35163]: pgmap v1293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:32.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:32 smithi159 ceph-mon[36109]: pgmap v1293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:32.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:32 smithi055 ceph-mon[31863]: pgmap v1293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:33.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1364 sec 2024-03-28T06:11:33.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 692.790146 secs 2024-03-28T06:11:33.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 692.790146 secs 2024-03-28T06:11:33.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 692.790146 secs 2024-03-28T06:11:34.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1365 sec 2024-03-28T06:11:34.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:34 smithi086 ceph-mon[35163]: pgmap v1294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:34.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:34 smithi159 ceph-mon[36109]: pgmap v1294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:34.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:34 smithi055 ceph-mon[31863]: pgmap v1294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:35.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1366 sec 2024-03-28T06:11:36.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1367 sec 2024-03-28T06:11:36.711 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:36 smithi086 ceph-mon[35163]: pgmap v1295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:36.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:36 smithi159 ceph-mon[36109]: pgmap v1295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:36.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:36 smithi055 ceph-mon[31863]: pgmap v1295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:37.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1368 sec 2024-03-28T06:11:38.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1369 sec 2024-03-28T06:11:38.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:38 smithi086 ceph-mon[35163]: pgmap v1296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:38.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 697.790206 secs 2024-03-28T06:11:38.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:38 smithi159 ceph-mon[36109]: pgmap v1296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:38.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 697.790206 secs 2024-03-28T06:11:38.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:38 smithi055 ceph-mon[31863]: pgmap v1296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:11:38.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 697.790206 secs 2024-03-28T06:11:39.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1370 sec 2024-03-28T06:11:40.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1371 sec 2024-03-28T06:11:40.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:40 smithi086 ceph-mon[35163]: pgmap v1297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:40.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:40 smithi159 ceph-mon[36109]: pgmap v1297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:40.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:40 smithi055 ceph-mon[31863]: pgmap v1297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:41.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1372 sec 2024-03-28T06:11:42.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1373 sec 2024-03-28T06:11:42.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:42 smithi086 ceph-mon[35163]: pgmap v1298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:42.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:42 smithi159 ceph-mon[36109]: pgmap v1298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:42.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:42 smithi055 ceph-mon[31863]: pgmap v1298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:43.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1374 sec 2024-03-28T06:11:43.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 702.790270 secs 2024-03-28T06:11:43.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 702.790270 secs 2024-03-28T06:11:43.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 702.790270 secs 2024-03-28T06:11:44.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1375 sec 2024-03-28T06:11:44.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:44 smithi086 ceph-mon[35163]: pgmap v1299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:44.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:44 smithi159 ceph-mon[36109]: pgmap v1299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:44.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:44 smithi055 ceph-mon[31863]: pgmap v1299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:45.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1376 sec 2024-03-28T06:11:46.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1377 sec 2024-03-28T06:11:46.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:46 smithi086 ceph-mon[35163]: pgmap v1300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:46.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:46 smithi159 ceph-mon[36109]: pgmap v1300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:46.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:46 smithi055 ceph-mon[31863]: pgmap v1300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:47.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1378 sec 2024-03-28T06:11:48.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1379 sec 2024-03-28T06:11:48.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:48 smithi086 ceph-mon[35163]: pgmap v1301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:48.806 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 707.790333 secs 2024-03-28T06:11:48.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:48 smithi159 ceph-mon[36109]: pgmap v1301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:48.808 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 707.790333 secs 2024-03-28T06:11:48.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:48 smithi055 ceph-mon[31863]: pgmap v1301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:48.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 707.790333 secs 2024-03-28T06:11:49.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1380 sec 2024-03-28T06:11:50.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1381 sec 2024-03-28T06:11:51.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:50 smithi055 ceph-mon[31863]: pgmap v1302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:51.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1382 sec 2024-03-28T06:11:51.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:50 smithi086 ceph-mon[35163]: pgmap v1302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:51.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:50 smithi159 ceph-mon[36109]: pgmap v1302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:52.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1383 sec 2024-03-28T06:11:53.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:52 smithi055 ceph-mon[31863]: pgmap v1303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:53.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 712.790404 secs 2024-03-28T06:11:53.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1384 sec 2024-03-28T06:11:53.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:52 smithi086 ceph-mon[35163]: pgmap v1303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:53.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 712.790404 secs 2024-03-28T06:11:53.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:52 smithi159 ceph-mon[36109]: pgmap v1303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:53.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 712.790404 secs 2024-03-28T06:11:54.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1385 sec 2024-03-28T06:11:55.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:54 smithi055 ceph-mon[31863]: pgmap v1304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:55.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1386 sec 2024-03-28T06:11:55.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:54 smithi086 ceph-mon[35163]: pgmap v1304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:55.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:54 smithi159 ceph-mon[36109]: pgmap v1304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:11:56.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1387 sec 2024-03-28T06:11:57.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:56 smithi055 ceph-mon[31863]: pgmap v1305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:57.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1388 sec 2024-03-28T06:11:57.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:56 smithi086 ceph-mon[35163]: pgmap v1305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:57.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:56 smithi159 ceph-mon[36109]: pgmap v1305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:11:58.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1389 sec 2024-03-28T06:11:58.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 717.790521 secs 2024-03-28T06:11:58.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 717.790521 secs 2024-03-28T06:11:58.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 717.790521 secs 2024-03-28T06:11:59.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1390 sec 2024-03-28T06:11:59.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:11:58 smithi086 ceph-mon[35163]: pgmap v1306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:59.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:11:58 smithi159 ceph-mon[36109]: pgmap v1306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:11:59.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:11:58 smithi055 ceph-mon[31863]: pgmap v1306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:00.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1391 sec 2024-03-28T06:12:01.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1392 sec 2024-03-28T06:12:01.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:00 smithi086 ceph-mon[35163]: pgmap v1307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:01.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:00 smithi159 ceph-mon[36109]: pgmap v1307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:01.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:00 smithi055 ceph-mon[31863]: pgmap v1307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:02.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1393 sec 2024-03-28T06:12:03.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1394 sec 2024-03-28T06:12:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:02 smithi086 ceph-mon[35163]: pgmap v1308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:02 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 722.790619 secs 2024-03-28T06:12:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:02 smithi086 ceph-mon[35163]: slow request 722.790619 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:12:03.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:02 smithi159 ceph-mon[36109]: pgmap v1308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:03.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:02 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 722.790619 secs 2024-03-28T06:12:03.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:02 smithi159 ceph-mon[36109]: slow request 722.790619 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:12:03.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:02 smithi055 ceph-mon[31863]: pgmap v1308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:02 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 722.790619 secs 2024-03-28T06:12:03.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:02 smithi055 ceph-mon[31863]: slow request 722.790619 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:12:04.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1395 sec 2024-03-28T06:12:05.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1396 sec 2024-03-28T06:12:05.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:04 smithi086 ceph-mon[35163]: pgmap v1309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:05.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:04 smithi159 ceph-mon[36109]: pgmap v1309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:05.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:04 smithi055 ceph-mon[31863]: pgmap v1309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:06.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1397 sec 2024-03-28T06:12:07.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:06 smithi055 ceph-mon[31863]: pgmap v1310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:07.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1398 sec 2024-03-28T06:12:07.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:06 smithi086 ceph-mon[35163]: pgmap v1310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:07.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:06 smithi159 ceph-mon[36109]: pgmap v1310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:08.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1399 sec 2024-03-28T06:12:08.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 727.790692 secs 2024-03-28T06:12:08.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 727.790692 secs 2024-03-28T06:12:08.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 727.790692 secs 2024-03-28T06:12:09.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1400 sec 2024-03-28T06:12:09.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:08 smithi086 ceph-mon[35163]: pgmap v1311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:09.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:08 smithi159 ceph-mon[36109]: pgmap v1311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:09.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:08 smithi055 ceph-mon[31863]: pgmap v1311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:10.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1401 sec 2024-03-28T06:12:11.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1402 sec 2024-03-28T06:12:11.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:10 smithi086 ceph-mon[35163]: pgmap v1312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:11.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:10 smithi159 ceph-mon[36109]: pgmap v1312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:11.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:10 smithi055 ceph-mon[31863]: pgmap v1312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:12.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1403 sec 2024-03-28T06:12:13.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1404 sec 2024-03-28T06:12:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:12 smithi086 ceph-mon[35163]: pgmap v1313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 732.790759 secs 2024-03-28T06:12:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:12 smithi159 ceph-mon[36109]: pgmap v1313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 732.790759 secs 2024-03-28T06:12:13.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:12 smithi055 ceph-mon[31863]: pgmap v1313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:13.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 732.790759 secs 2024-03-28T06:12:14.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1405 sec 2024-03-28T06:12:15.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1406 sec 2024-03-28T06:12:15.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:14 smithi086 ceph-mon[35163]: pgmap v1314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:15.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:14 smithi159 ceph-mon[36109]: pgmap v1314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:15.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:14 smithi055 ceph-mon[31863]: pgmap v1314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:16.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1407 sec 2024-03-28T06:12:17.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1408 sec 2024-03-28T06:12:17.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:16 smithi086 ceph-mon[35163]: pgmap v1315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:17.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:16 smithi159 ceph-mon[36109]: pgmap v1315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:17.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:16 smithi055 ceph-mon[31863]: pgmap v1315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:18.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1409 sec 2024-03-28T06:12:18.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 737.790861 secs 2024-03-28T06:12:18.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 737.790861 secs 2024-03-28T06:12:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 737.790861 secs 2024-03-28T06:12:19.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1410 sec 2024-03-28T06:12:19.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:18 smithi086 ceph-mon[35163]: pgmap v1316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:19.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:18 smithi159 ceph-mon[36109]: pgmap v1316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:19.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:18 smithi055 ceph-mon[31863]: pgmap v1316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:20.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1411 sec 2024-03-28T06:12:21.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1412 sec 2024-03-28T06:12:21.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:20 smithi086 ceph-mon[35163]: pgmap v1317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:21.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:20 smithi159 ceph-mon[36109]: pgmap v1317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:21.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:20 smithi055 ceph-mon[31863]: pgmap v1317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:22.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1413 sec 2024-03-28T06:12:23.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1414 sec 2024-03-28T06:12:23.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:23 smithi086 ceph-mon[35163]: pgmap v1318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 742.790977 secs 2024-03-28T06:12:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:23 smithi159 ceph-mon[36109]: pgmap v1318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 742.790977 secs 2024-03-28T06:12:23.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:23 smithi055 ceph-mon[31863]: pgmap v1318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:23.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 742.790977 secs 2024-03-28T06:12:24.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1415 sec 2024-03-28T06:12:25.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1416 sec 2024-03-28T06:12:25.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:25 smithi086 ceph-mon[35163]: pgmap v1319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:25.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:25 smithi159 ceph-mon[36109]: pgmap v1319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:25.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:25 smithi055 ceph-mon[31863]: pgmap v1319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:26.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1417 sec 2024-03-28T06:12:27.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1418 sec 2024-03-28T06:12:27.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:27 smithi086 ceph-mon[35163]: pgmap v1320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:27.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:27 smithi159 ceph-mon[36109]: pgmap v1320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:27.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:27 smithi055 ceph-mon[31863]: pgmap v1320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:12:28.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1419 sec 2024-03-28T06:12:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 747.791058 secs 2024-03-28T06:12:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:12:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 747.791058 secs 2024-03-28T06:12:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:12:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 747.791058 secs 2024-03-28T06:12:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:12:29.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1420 sec 2024-03-28T06:12:29.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:29 smithi086 ceph-mon[35163]: pgmap v1321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:29.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:29 smithi159 ceph-mon[36109]: pgmap v1321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:29.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:29 smithi055 ceph-mon[31863]: pgmap v1321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.294 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1421 sec 2024-03-28T06:12:30.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:12:31.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1422 sec 2024-03-28T06:12:31.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:31 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:12:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:31 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:12:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:31 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:12:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:31 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:12:31.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:31 smithi086 ceph-mon[35163]: pgmap v1322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:31.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:31 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:12:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:31 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:12:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:31 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:12:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:31 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:12:31.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:31 smithi159 ceph-mon[36109]: pgmap v1322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:31 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:12:31.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:31 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:12:31.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:31 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:12:31.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:31 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:12:31.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:31 smithi055 ceph-mon[31863]: pgmap v1322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:32.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1423 sec 2024-03-28T06:12:33.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:33 smithi086 ceph-mon[35163]: pgmap v1323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 752.791144 secs 2024-03-28T06:12:33.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1424 sec 2024-03-28T06:12:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:33 smithi159 ceph-mon[36109]: pgmap v1323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 752.791144 secs 2024-03-28T06:12:33.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:33 smithi055 ceph-mon[31863]: pgmap v1323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 752.791144 secs 2024-03-28T06:12:34.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1425 sec 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: pgmap v1324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:12:35.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1426 sec 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: pgmap v1324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:12:35.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: pgmap v1324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:12:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:12:35.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:12:36.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:36 smithi086 ceph-mon[35163]: pgmap v1325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:12:36.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:36 smithi086 ceph-mon[35163]: pgmap v1326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:12:36.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1427 sec 2024-03-28T06:12:36.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:36 smithi159 ceph-mon[36109]: pgmap v1325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:12:36.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:36 smithi159 ceph-mon[36109]: pgmap v1326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:12:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:36 smithi055 ceph-mon[31863]: pgmap v1325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:12:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:36 smithi055 ceph-mon[31863]: pgmap v1326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:12:37.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1428 sec 2024-03-28T06:12:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:38 smithi086 ceph-mon[35163]: pgmap v1327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:38.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 757.791264 secs 2024-03-28T06:12:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:38 smithi159 ceph-mon[36109]: pgmap v1327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 757.791264 secs 2024-03-28T06:12:38.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1429 sec 2024-03-28T06:12:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:38 smithi055 ceph-mon[31863]: pgmap v1327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 757.791264 secs 2024-03-28T06:12:39.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1430 sec 2024-03-28T06:12:40.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1431 sec 2024-03-28T06:12:40.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:40 smithi055 ceph-mon[31863]: pgmap v1328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:40 smithi086 ceph-mon[35163]: pgmap v1328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:40 smithi159 ceph-mon[36109]: pgmap v1328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:41.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1432 sec 2024-03-28T06:12:42.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1433 sec 2024-03-28T06:12:42.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:42 smithi055 ceph-mon[31863]: pgmap v1329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:42 smithi086 ceph-mon[35163]: pgmap v1329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:42 smithi159 ceph-mon[36109]: pgmap v1329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:43.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1434 sec 2024-03-28T06:12:43.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 762.791349 secs 2024-03-28T06:12:43.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 762.791349 secs 2024-03-28T06:12:43.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 762.791349 secs 2024-03-28T06:12:44.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1435 sec 2024-03-28T06:12:44.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:44 smithi055 ceph-mon[31863]: pgmap v1330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:44.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:44 smithi086 ceph-mon[35163]: pgmap v1330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:44.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:44 smithi159 ceph-mon[36109]: pgmap v1330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:45.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1436 sec 2024-03-28T06:12:45.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:45 smithi055 ceph-mon[31863]: pgmap v1331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:12:45.459 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:45 smithi159 ceph-mon[36109]: pgmap v1331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:12:45.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:45 smithi086 ceph-mon[35163]: pgmap v1331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:12:46.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1437 sec 2024-03-28T06:12:47.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1438 sec 2024-03-28T06:12:48.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:47 smithi086 ceph-mon[35163]: pgmap v1332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:48.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 767.791446 secs 2024-03-28T06:12:48.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:47 smithi159 ceph-mon[36109]: pgmap v1332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:48.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 767.791446 secs 2024-03-28T06:12:48.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:47 smithi055 ceph-mon[31863]: pgmap v1332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:48.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 767.791446 secs 2024-03-28T06:12:48.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1439 sec 2024-03-28T06:12:49.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1440 sec 2024-03-28T06:12:50.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:49 smithi086 ceph-mon[35163]: pgmap v1333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:50.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:49 smithi159 ceph-mon[36109]: pgmap v1333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:50.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:49 smithi055 ceph-mon[31863]: pgmap v1333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:50.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1441 sec 2024-03-28T06:12:51.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1442 sec 2024-03-28T06:12:52.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:51 smithi086 ceph-mon[35163]: pgmap v1334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:52.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:51 smithi159 ceph-mon[36109]: pgmap v1334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:52.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:51 smithi055 ceph-mon[31863]: pgmap v1334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:52.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1443 sec 2024-03-28T06:12:53.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 772.791726 secs 2024-03-28T06:12:53.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 772.791726 secs 2024-03-28T06:12:53.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 772.791726 secs 2024-03-28T06:12:53.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1444 sec 2024-03-28T06:12:54.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:53 smithi055 ceph-mon[31863]: pgmap v1335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:54.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:53 smithi086 ceph-mon[35163]: pgmap v1335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:54.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:53 smithi159 ceph-mon[36109]: pgmap v1335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:54.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1445 sec 2024-03-28T06:12:55.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1446 sec 2024-03-28T06:12:56.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:55 smithi055 ceph-mon[31863]: pgmap v1336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:56.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:55 smithi086 ceph-mon[35163]: pgmap v1336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:56.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:55 smithi159 ceph-mon[36109]: pgmap v1336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:12:56.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1447 sec 2024-03-28T06:12:57.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1448 sec 2024-03-28T06:12:58.096 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:57 smithi159 ceph-mon[36109]: pgmap v1337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:58.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 777.791848 secs 2024-03-28T06:12:58.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:57 smithi055 ceph-mon[31863]: pgmap v1337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:58.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 777.791848 secs 2024-03-28T06:12:58.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:57 smithi086 ceph-mon[35163]: pgmap v1337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:12:58.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 777.791848 secs 2024-03-28T06:12:58.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1449 sec 2024-03-28T06:12:59.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1450 sec 2024-03-28T06:13:00.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:12:59 smithi055 ceph-mon[31863]: pgmap v1338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:00.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:12:59 smithi086 ceph-mon[35163]: pgmap v1338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:00.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:12:59 smithi159 ceph-mon[36109]: pgmap v1338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:00.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1451 sec 2024-03-28T06:13:01.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1452 sec 2024-03-28T06:13:02.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:01 smithi055 ceph-mon[31863]: pgmap v1339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:02.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:01 smithi086 ceph-mon[35163]: pgmap v1339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:02.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:01 smithi159 ceph-mon[36109]: pgmap v1339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:02.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1453 sec 2024-03-28T06:13:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 782.791928 secs 2024-03-28T06:13:03.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 782.791928 secs 2024-03-28T06:13:03.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1454 sec 2024-03-28T06:13:03.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 782.791928 secs 2024-03-28T06:13:04.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:03 smithi086 ceph-mon[35163]: pgmap v1340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:04.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:03 smithi159 ceph-mon[36109]: pgmap v1340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:04.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1455 sec 2024-03-28T06:13:04.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:03 smithi055 ceph-mon[31863]: pgmap v1340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:05.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1456 sec 2024-03-28T06:13:06.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:05 smithi086 ceph-mon[35163]: pgmap v1341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:06.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:05 smithi159 ceph-mon[36109]: pgmap v1341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:06.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1457 sec 2024-03-28T06:13:06.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:05 smithi055 ceph-mon[31863]: pgmap v1341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:07.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1458 sec 2024-03-28T06:13:08.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:07 smithi086 ceph-mon[35163]: pgmap v1342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:08.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 787.792047 secs 2024-03-28T06:13:08.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:07 smithi159 ceph-mon[36109]: pgmap v1342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:08.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 787.792047 secs 2024-03-28T06:13:08.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1459 sec 2024-03-28T06:13:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:07 smithi055 ceph-mon[31863]: pgmap v1342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 787.792047 secs 2024-03-28T06:13:09.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1460 sec 2024-03-28T06:13:10.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:09 smithi086 ceph-mon[35163]: pgmap v1343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:10.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:09 smithi159 ceph-mon[36109]: pgmap v1343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:10.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1461 sec 2024-03-28T06:13:10.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:09 smithi055 ceph-mon[31863]: pgmap v1343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:11.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1462 sec 2024-03-28T06:13:12.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:11 smithi086 ceph-mon[35163]: pgmap v1344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:12.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:11 smithi159 ceph-mon[36109]: pgmap v1344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:12.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1463 sec 2024-03-28T06:13:12.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:11 smithi055 ceph-mon[31863]: pgmap v1344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:13.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 792.792129 secs 2024-03-28T06:13:13.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 792.792129 secs 2024-03-28T06:13:13.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1464 sec 2024-03-28T06:13:13.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 792.792129 secs 2024-03-28T06:13:14.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:13 smithi086 ceph-mon[35163]: pgmap v1345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:14.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:13 smithi159 ceph-mon[36109]: pgmap v1345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:14.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1465 sec 2024-03-28T06:13:14.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:13 smithi055 ceph-mon[31863]: pgmap v1345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:15.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1466 sec 2024-03-28T06:13:16.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:15 smithi086 ceph-mon[35163]: pgmap v1346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:16.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:15 smithi159 ceph-mon[36109]: pgmap v1346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:16.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1467 sec 2024-03-28T06:13:16.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:15 smithi055 ceph-mon[31863]: pgmap v1346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:17.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1468 sec 2024-03-28T06:13:18.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:17 smithi086 ceph-mon[35163]: pgmap v1347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:18.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 797.792159 secs 2024-03-28T06:13:18.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:17 smithi159 ceph-mon[36109]: pgmap v1347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:18.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 797.792159 secs 2024-03-28T06:13:18.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1469 sec 2024-03-28T06:13:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:17 smithi055 ceph-mon[31863]: pgmap v1347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 797.792159 secs 2024-03-28T06:13:19.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1470 sec 2024-03-28T06:13:20.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:19 smithi086 ceph-mon[35163]: pgmap v1348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:20.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:19 smithi159 ceph-mon[36109]: pgmap v1348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:20.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1471 sec 2024-03-28T06:13:20.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:19 smithi055 ceph-mon[31863]: pgmap v1348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:21.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1472 sec 2024-03-28T06:13:22.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:21 smithi086 ceph-mon[35163]: pgmap v1349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:22.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:21 smithi159 ceph-mon[36109]: pgmap v1349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:22.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1473 sec 2024-03-28T06:13:22.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:21 smithi055 ceph-mon[31863]: pgmap v1349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:23.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 802.792225 secs 2024-03-28T06:13:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 802.792225 secs 2024-03-28T06:13:23.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1474 sec 2024-03-28T06:13:23.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 802.792225 secs 2024-03-28T06:13:24.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:23 smithi086 ceph-mon[35163]: pgmap v1350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:24.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:23 smithi159 ceph-mon[36109]: pgmap v1350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:24.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1475 sec 2024-03-28T06:13:24.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:23 smithi055 ceph-mon[31863]: pgmap v1350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:25.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1476 sec 2024-03-28T06:13:26.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:26 smithi086 ceph-mon[35163]: pgmap v1351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:26.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:26 smithi159 ceph-mon[36109]: pgmap v1351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:26.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1477 sec 2024-03-28T06:13:26.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:26 smithi055 ceph-mon[31863]: pgmap v1351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:27.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1478 sec 2024-03-28T06:13:28.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:28 smithi086 ceph-mon[35163]: pgmap v1352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:28.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 807.792353 secs 2024-03-28T06:13:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:28 smithi159 ceph-mon[36109]: pgmap v1352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 807.792353 secs 2024-03-28T06:13:28.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1479 sec 2024-03-28T06:13:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:28 smithi055 ceph-mon[31863]: pgmap v1352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 807.792353 secs 2024-03-28T06:13:29.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1480 sec 2024-03-28T06:13:30.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:30 smithi086 ceph-mon[35163]: pgmap v1353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:30.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:30 smithi159 ceph-mon[36109]: pgmap v1353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:30.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1481 sec 2024-03-28T06:13:30.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:30 smithi055 ceph-mon[31863]: pgmap v1353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:31.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1482 sec 2024-03-28T06:13:32.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:32 smithi086 ceph-mon[35163]: pgmap v1354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:32.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:32 smithi159 ceph-mon[36109]: pgmap v1354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:32.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1483 sec 2024-03-28T06:13:32.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:32 smithi055 ceph-mon[31863]: pgmap v1354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:33.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 812.792477 secs 2024-03-28T06:13:33.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 812.792477 secs 2024-03-28T06:13:33.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1484 sec 2024-03-28T06:13:33.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 812.792477 secs 2024-03-28T06:13:34.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:34 smithi086 ceph-mon[35163]: pgmap v1355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:34.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:34 smithi159 ceph-mon[36109]: pgmap v1355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:34.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1485 sec 2024-03-28T06:13:34.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:34 smithi055 ceph-mon[31863]: pgmap v1355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:35.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1486 sec 2024-03-28T06:13:36.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:36 smithi086 ceph-mon[35163]: pgmap v1356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:36.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:13:36.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:36 smithi159 ceph-mon[36109]: pgmap v1356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:36.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:13:36.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1487 sec 2024-03-28T06:13:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:36 smithi055 ceph-mon[31863]: pgmap v1356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:13:37.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1488 sec 2024-03-28T06:13:37.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:13:37.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:13:37.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:13:37.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:13:37.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:13:37.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:13:37.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:13:37.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:13:37.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:13:38.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1489 sec 2024-03-28T06:13:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:38 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:13:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:38 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:13:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:38 smithi055 ceph-mon[31863]: pgmap v1357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:38 smithi055 ceph-mon[31863]: pgmap v1358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 817.792584 secs 2024-03-28T06:13:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:38 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:13:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:38 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:13:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:38 smithi086 ceph-mon[35163]: pgmap v1357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:38 smithi086 ceph-mon[35163]: pgmap v1358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 817.792584 secs 2024-03-28T06:13:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:38 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:13:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:38 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:13:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:38 smithi159 ceph-mon[36109]: pgmap v1357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:38 smithi159 ceph-mon[36109]: pgmap v1358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 817.792584 secs 2024-03-28T06:13:39.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1490 sec 2024-03-28T06:13:40.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1491 sec 2024-03-28T06:13:40.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:40 smithi055 ceph-mon[31863]: pgmap v1359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:40 smithi086 ceph-mon[35163]: pgmap v1359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:40 smithi159 ceph-mon[36109]: pgmap v1359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:41.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1492 sec 2024-03-28T06:13:42.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1493 sec 2024-03-28T06:13:42.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:42 smithi055 ceph-mon[31863]: pgmap v1360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:42 smithi086 ceph-mon[35163]: pgmap v1360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:42 smithi159 ceph-mon[36109]: pgmap v1360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:43.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1494 sec 2024-03-28T06:13:43.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 822.792704 secs 2024-03-28T06:13:43.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 822.792704 secs 2024-03-28T06:13:43.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 822.792704 secs 2024-03-28T06:13:44.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1495 sec 2024-03-28T06:13:44.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:44 smithi055 ceph-mon[31863]: pgmap v1361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:13:44.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:44 smithi086 ceph-mon[35163]: pgmap v1361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:13:44.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:44 smithi159 ceph-mon[36109]: pgmap v1361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:13:45.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1496 sec 2024-03-28T06:13:46.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1497 sec 2024-03-28T06:13:46.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:46 smithi055 ceph-mon[31863]: pgmap v1362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:46.361 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:46 smithi159 ceph-mon[36109]: pgmap v1362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:46.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:46 smithi086 ceph-mon[35163]: pgmap v1362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:13:47.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1498 sec 2024-03-28T06:13:47.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:47 smithi086 ceph-mon[35163]: pgmap v1363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:47.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:47 smithi159 ceph-mon[36109]: pgmap v1363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:47.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:47 smithi055 ceph-mon[31863]: pgmap v1363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:13:48.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 827.792770 secs 2024-03-28T06:13:48.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1499 sec 2024-03-28T06:13:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 827.792770 secs 2024-03-28T06:13:48.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 827.792770 secs 2024-03-28T06:13:49.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:49 smithi159 ceph-mon[36109]: pgmap v1364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:49.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1500 sec 2024-03-28T06:13:49.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:49 smithi086 ceph-mon[35163]: pgmap v1364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:49.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:49 smithi055 ceph-mon[31863]: pgmap v1364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:50.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1501 sec 2024-03-28T06:13:51.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1502 sec 2024-03-28T06:13:51.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:51 smithi055 ceph-mon[31863]: pgmap v1365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:13:52.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:51 smithi086 ceph-mon[35163]: pgmap v1365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:13:52.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:51 smithi159 ceph-mon[36109]: pgmap v1365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:13:52.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1503 sec 2024-03-28T06:13:53.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1504 sec 2024-03-28T06:13:53.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 832.792863 secs 2024-03-28T06:13:53.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:53 smithi055 ceph-mon[31863]: pgmap v1366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:54.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 832.792863 secs 2024-03-28T06:13:54.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:53 smithi086 ceph-mon[35163]: pgmap v1366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:54.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 832.792863 secs 2024-03-28T06:13:54.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:53 smithi159 ceph-mon[36109]: pgmap v1366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:13:54.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1505 sec 2024-03-28T06:13:55.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1506 sec 2024-03-28T06:13:55.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:55 smithi055 ceph-mon[31863]: pgmap v1367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:56.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:55 smithi086 ceph-mon[35163]: pgmap v1367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:56.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:55 smithi159 ceph-mon[36109]: pgmap v1367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:56.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1507 sec 2024-03-28T06:13:57.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1508 sec 2024-03-28T06:13:57.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:57 smithi055 ceph-mon[31863]: pgmap v1368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:57.861 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 837.792976 secs 2024-03-28T06:13:58.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:57 smithi086 ceph-mon[35163]: pgmap v1368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:58.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 837.792976 secs 2024-03-28T06:13:58.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:57 smithi159 ceph-mon[36109]: pgmap v1368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:13:58.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 837.792976 secs 2024-03-28T06:13:58.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1509 sec 2024-03-28T06:13:59.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1510 sec 2024-03-28T06:13:59.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:13:59 smithi055 ceph-mon[31863]: pgmap v1369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:00.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:13:59 smithi086 ceph-mon[35163]: pgmap v1369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:00.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:13:59 smithi159 ceph-mon[36109]: pgmap v1369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:00.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1511 sec 2024-03-28T06:14:01.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1512 sec 2024-03-28T06:14:02.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:01 smithi086 ceph-mon[35163]: pgmap v1370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:02.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:01 smithi159 ceph-mon[36109]: pgmap v1370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:02.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:01 smithi055 ceph-mon[31863]: pgmap v1370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:02.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1513 sec 2024-03-28T06:14:03.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 842.793098 secs 2024-03-28T06:14:03.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 842.793098 secs 2024-03-28T06:14:03.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 842.793098 secs 2024-03-28T06:14:03.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1514 sec 2024-03-28T06:14:04.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:03 smithi086 ceph-mon[35163]: pgmap v1371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:04.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:03 smithi159 ceph-mon[36109]: pgmap v1371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:04.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:03 smithi055 ceph-mon[31863]: pgmap v1371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:04.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1515 sec 2024-03-28T06:14:05.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1516 sec 2024-03-28T06:14:06.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:05 smithi086 ceph-mon[35163]: pgmap v1372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:06.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:05 smithi159 ceph-mon[36109]: pgmap v1372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:06.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:05 smithi055 ceph-mon[31863]: pgmap v1372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:06.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1517 sec 2024-03-28T06:14:07.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1518 sec 2024-03-28T06:14:08.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:07 smithi086 ceph-mon[35163]: pgmap v1373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:08.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 847.793161 secs 2024-03-28T06:14:08.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:07 smithi159 ceph-mon[36109]: pgmap v1373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:08.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 847.793161 secs 2024-03-28T06:14:08.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:07 smithi055 ceph-mon[31863]: pgmap v1373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:08.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 847.793161 secs 2024-03-28T06:14:08.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1519 sec 2024-03-28T06:14:09.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1520 sec 2024-03-28T06:14:10.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:09 smithi086 ceph-mon[35163]: pgmap v1374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:10.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:09 smithi159 ceph-mon[36109]: pgmap v1374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:10.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:09 smithi055 ceph-mon[31863]: pgmap v1374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:10.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1521 sec 2024-03-28T06:14:11.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1522 sec 2024-03-28T06:14:12.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:11 smithi086 ceph-mon[35163]: pgmap v1375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:12.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:11 smithi159 ceph-mon[36109]: pgmap v1375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:12.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:11 smithi055 ceph-mon[31863]: pgmap v1375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:12.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1523 sec 2024-03-28T06:14:13.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 852.793228 secs 2024-03-28T06:14:13.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 852.793228 secs 2024-03-28T06:14:13.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 852.793228 secs 2024-03-28T06:14:13.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1524 sec 2024-03-28T06:14:14.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:13 smithi086 ceph-mon[35163]: pgmap v1376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:14.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:13 smithi159 ceph-mon[36109]: pgmap v1376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:14.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:13 smithi055 ceph-mon[31863]: pgmap v1376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:14.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1525 sec 2024-03-28T06:14:15.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1526 sec 2024-03-28T06:14:16.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:15 smithi086 ceph-mon[35163]: pgmap v1377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:16.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:15 smithi159 ceph-mon[36109]: pgmap v1377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:16.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:15 smithi055 ceph-mon[31863]: pgmap v1377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:16.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1527 sec 2024-03-28T06:14:17.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1528 sec 2024-03-28T06:14:18.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:17 smithi086 ceph-mon[35163]: pgmap v1378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:18.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 857.793291 secs 2024-03-28T06:14:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:17 smithi159 ceph-mon[36109]: pgmap v1378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 857.793291 secs 2024-03-28T06:14:18.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:17 smithi055 ceph-mon[31863]: pgmap v1378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:18.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 857.793291 secs 2024-03-28T06:14:18.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1529 sec 2024-03-28T06:14:19.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1530 sec 2024-03-28T06:14:20.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:19 smithi086 ceph-mon[35163]: pgmap v1379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:20.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:19 smithi159 ceph-mon[36109]: pgmap v1379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:20.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:19 smithi055 ceph-mon[31863]: pgmap v1379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:20.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1531 sec 2024-03-28T06:14:21.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1532 sec 2024-03-28T06:14:22.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:21 smithi086 ceph-mon[35163]: pgmap v1380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:22.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:21 smithi159 ceph-mon[36109]: pgmap v1380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:22.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:21 smithi055 ceph-mon[31863]: pgmap v1380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:22.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1533 sec 2024-03-28T06:14:23.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 862.793414 secs 2024-03-28T06:14:23.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 862.793414 secs 2024-03-28T06:14:23.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 862.793414 secs 2024-03-28T06:14:23.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1534 sec 2024-03-28T06:14:24.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:23 smithi086 ceph-mon[35163]: pgmap v1381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:24.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:23 smithi159 ceph-mon[36109]: pgmap v1381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:24.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:23 smithi055 ceph-mon[31863]: pgmap v1381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:24.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1535 sec 2024-03-28T06:14:25.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1536 sec 2024-03-28T06:14:26.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:25 smithi086 ceph-mon[35163]: pgmap v1382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:26.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:25 smithi159 ceph-mon[36109]: pgmap v1382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:26.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:25 smithi055 ceph-mon[31863]: pgmap v1382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:26.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1537 sec 2024-03-28T06:14:27.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1538 sec 2024-03-28T06:14:28.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:27 smithi086 ceph-mon[35163]: pgmap v1383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:28.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 867.793538 secs 2024-03-28T06:14:28.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:27 smithi159 ceph-mon[36109]: pgmap v1383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:28.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 867.793538 secs 2024-03-28T06:14:28.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:27 smithi055 ceph-mon[31863]: pgmap v1383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:28.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 867.793538 secs 2024-03-28T06:14:28.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1539 sec 2024-03-28T06:14:29.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1540 sec 2024-03-28T06:14:30.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:29 smithi086 ceph-mon[35163]: pgmap v1384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:30.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:29 smithi159 ceph-mon[36109]: pgmap v1384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:30.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:29 smithi055 ceph-mon[31863]: pgmap v1384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:30.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1541 sec 2024-03-28T06:14:31.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1542 sec 2024-03-28T06:14:32.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:31 smithi086 ceph-mon[35163]: pgmap v1385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:32.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:31 smithi159 ceph-mon[36109]: pgmap v1385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:32.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:31 smithi055 ceph-mon[31863]: pgmap v1385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:32.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1543 sec 2024-03-28T06:14:33.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 872.793655 secs 2024-03-28T06:14:33.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 872.793655 secs 2024-03-28T06:14:33.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 872.793655 secs 2024-03-28T06:14:33.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1544 sec 2024-03-28T06:14:34.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:33 smithi086 ceph-mon[35163]: pgmap v1386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:14:34.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:33 smithi159 ceph-mon[36109]: pgmap v1386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:14:34.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:33 smithi055 ceph-mon[31863]: pgmap v1386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:14:34.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1545 sec 2024-03-28T06:14:35.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1546 sec 2024-03-28T06:14:36.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:35 smithi086 ceph-mon[35163]: pgmap v1387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:36.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:35 smithi159 ceph-mon[36109]: pgmap v1387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:36.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:35 smithi055 ceph-mon[31863]: pgmap v1387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:36.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1547 sec 2024-03-28T06:14:37.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1548 sec 2024-03-28T06:14:38.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:37 smithi086 ceph-mon[35163]: pgmap v1388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:38.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:14:38.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 877.793792 secs 2024-03-28T06:14:38.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:37 smithi159 ceph-mon[36109]: pgmap v1388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:38.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:14:38.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 877.793792 secs 2024-03-28T06:14:38.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:37 smithi055 ceph-mon[31863]: pgmap v1388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:38.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:14:38.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 877.793792 secs 2024-03-28T06:14:38.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1549 sec 2024-03-28T06:14:39.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:14:39.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:14:39.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:14:39.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:14:39.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:14:39.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:14:39.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:14:39.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:14:39.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:14:39.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1550 sec 2024-03-28T06:14:40.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:39 smithi055 ceph-mon[31863]: pgmap v1389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:39 smithi055 ceph-mon[31863]: pgmap v1390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:39 smithi086 ceph-mon[35163]: pgmap v1389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:39 smithi086 ceph-mon[35163]: pgmap v1390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:39 smithi159 ceph-mon[36109]: pgmap v1389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:39 smithi159 ceph-mon[36109]: pgmap v1390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:40.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1551 sec 2024-03-28T06:14:41.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1552 sec 2024-03-28T06:14:42.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:41 smithi055 ceph-mon[31863]: pgmap v1391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:42.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:41 smithi086 ceph-mon[35163]: pgmap v1391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:42.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:41 smithi159 ceph-mon[36109]: pgmap v1391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:42.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1553 sec 2024-03-28T06:14:43.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 882.793855 secs 2024-03-28T06:14:43.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 882.793855 secs 2024-03-28T06:14:43.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 882.793855 secs 2024-03-28T06:14:43.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1554 sec 2024-03-28T06:14:44.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:43 smithi055 ceph-mon[31863]: pgmap v1392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:44.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:43 smithi086 ceph-mon[35163]: pgmap v1392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:44.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:43 smithi159 ceph-mon[36109]: pgmap v1392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:44.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1555 sec 2024-03-28T06:14:45.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1556 sec 2024-03-28T06:14:46.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:45 smithi055 ceph-mon[31863]: pgmap v1393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:46.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:45 smithi086 ceph-mon[35163]: pgmap v1393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:46.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:45 smithi159 ceph-mon[36109]: pgmap v1393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:46.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1557 sec 2024-03-28T06:14:47.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1558 sec 2024-03-28T06:14:48.111 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:47 smithi159 ceph-mon[36109]: pgmap v1394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:48.111 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 887.793939 secs 2024-03-28T06:14:48.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:47 smithi055 ceph-mon[31863]: pgmap v1394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:48.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 887.793939 secs 2024-03-28T06:14:48.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:47 smithi086 ceph-mon[35163]: pgmap v1394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:14:48.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 887.793939 secs 2024-03-28T06:14:48.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1559 sec 2024-03-28T06:14:49.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1560 sec 2024-03-28T06:14:50.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:49 smithi055 ceph-mon[31863]: pgmap v1395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:50.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:49 smithi086 ceph-mon[35163]: pgmap v1395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:50.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:49 smithi159 ceph-mon[36109]: pgmap v1395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:14:50.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1561 sec 2024-03-28T06:14:51.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1562 sec 2024-03-28T06:14:52.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:51 smithi055 ceph-mon[31863]: pgmap v1396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:52.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:51 smithi086 ceph-mon[35163]: pgmap v1396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:52.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:51 smithi159 ceph-mon[36109]: pgmap v1396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:14:52.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1563 sec 2024-03-28T06:14:53.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 892.794018 secs 2024-03-28T06:14:53.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 892.794018 secs 2024-03-28T06:14:53.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1564 sec 2024-03-28T06:14:53.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 892.794018 secs 2024-03-28T06:14:54.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:53 smithi086 ceph-mon[35163]: pgmap v1397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:54.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:53 smithi159 ceph-mon[36109]: pgmap v1397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:54.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1565 sec 2024-03-28T06:14:54.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:53 smithi055 ceph-mon[31863]: pgmap v1397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:14:55.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1566 sec 2024-03-28T06:14:56.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:55 smithi086 ceph-mon[35163]: pgmap v1398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:56.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:55 smithi159 ceph-mon[36109]: pgmap v1398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:56.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1567 sec 2024-03-28T06:14:56.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:55 smithi055 ceph-mon[31863]: pgmap v1398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:57.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1568 sec 2024-03-28T06:14:58.162 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:57 smithi055 ceph-mon[31863]: pgmap v1399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:58.162 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 897.794102 secs 2024-03-28T06:14:58.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:57 smithi086 ceph-mon[35163]: pgmap v1399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:58.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 897.794102 secs 2024-03-28T06:14:58.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:57 smithi159 ceph-mon[36109]: pgmap v1399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:14:58.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 897.794102 secs 2024-03-28T06:14:58.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1569 sec 2024-03-28T06:14:59.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1570 sec 2024-03-28T06:15:00.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:14:59 smithi086 ceph-mon[35163]: pgmap v1400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:00.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:14:59 smithi159 ceph-mon[36109]: pgmap v1400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:00.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1571 sec 2024-03-28T06:15:00.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:14:59 smithi055 ceph-mon[31863]: pgmap v1400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:01.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1572 sec 2024-03-28T06:15:02.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:01 smithi086 ceph-mon[35163]: pgmap v1401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:02.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:01 smithi159 ceph-mon[36109]: pgmap v1401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:02.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1573 sec 2024-03-28T06:15:02.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:01 smithi055 ceph-mon[31863]: pgmap v1401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 902.794225 secs 2024-03-28T06:15:03.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 902.794225 secs 2024-03-28T06:15:03.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1574 sec 2024-03-28T06:15:03.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 902.794225 secs 2024-03-28T06:15:04.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:03 smithi086 ceph-mon[35163]: pgmap v1402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:04.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:03 smithi159 ceph-mon[36109]: pgmap v1402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:04.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1575 sec 2024-03-28T06:15:04.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:03 smithi055 ceph-mon[31863]: pgmap v1402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:05.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1576 sec 2024-03-28T06:15:06.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:05 smithi086 ceph-mon[35163]: pgmap v1403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:06.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:05 smithi159 ceph-mon[36109]: pgmap v1403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:06.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1577 sec 2024-03-28T06:15:06.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:05 smithi055 ceph-mon[31863]: pgmap v1403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:07.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1578 sec 2024-03-28T06:15:08.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:07 smithi086 ceph-mon[35163]: pgmap v1404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:08.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 907.794341 secs 2024-03-28T06:15:08.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:07 smithi159 ceph-mon[36109]: pgmap v1404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:08.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 907.794341 secs 2024-03-28T06:15:08.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1579 sec 2024-03-28T06:15:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:07 smithi055 ceph-mon[31863]: pgmap v1404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 907.794341 secs 2024-03-28T06:15:09.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1580 sec 2024-03-28T06:15:10.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:09 smithi086 ceph-mon[35163]: pgmap v1405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:10.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:09 smithi159 ceph-mon[36109]: pgmap v1405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:10.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1581 sec 2024-03-28T06:15:10.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:09 smithi055 ceph-mon[31863]: pgmap v1405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:11.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1582 sec 2024-03-28T06:15:12.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:11 smithi086 ceph-mon[35163]: pgmap v1406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:12.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:11 smithi159 ceph-mon[36109]: pgmap v1406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:12.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1583 sec 2024-03-28T06:15:12.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:11 smithi055 ceph-mon[31863]: pgmap v1406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:13.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 912.794465 secs 2024-03-28T06:15:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 912.794465 secs 2024-03-28T06:15:13.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1584 sec 2024-03-28T06:15:13.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 912.794465 secs 2024-03-28T06:15:14.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:13 smithi086 ceph-mon[35163]: pgmap v1407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:14.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:13 smithi159 ceph-mon[36109]: pgmap v1407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:14.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1585 sec 2024-03-28T06:15:14.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:13 smithi055 ceph-mon[31863]: pgmap v1407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:15.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1586 sec 2024-03-28T06:15:16.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:16 smithi086 ceph-mon[35163]: pgmap v1408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:16.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:16 smithi159 ceph-mon[36109]: pgmap v1408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:16.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1587 sec 2024-03-28T06:15:16.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:16 smithi055 ceph-mon[31863]: pgmap v1408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:17.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1588 sec 2024-03-28T06:15:18.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:18 smithi086 ceph-mon[35163]: pgmap v1409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:18.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 917.794585 secs 2024-03-28T06:15:18.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:18 smithi159 ceph-mon[36109]: pgmap v1409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:18.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 917.794585 secs 2024-03-28T06:15:18.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1589 sec 2024-03-28T06:15:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:18 smithi055 ceph-mon[31863]: pgmap v1409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 917.794585 secs 2024-03-28T06:15:19.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1590 sec 2024-03-28T06:15:20.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:20 smithi086 ceph-mon[35163]: pgmap v1410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:20.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:20 smithi159 ceph-mon[36109]: pgmap v1410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:20.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1591 sec 2024-03-28T06:15:20.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:20 smithi055 ceph-mon[31863]: pgmap v1410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:21.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1592 sec 2024-03-28T06:15:22.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:22 smithi086 ceph-mon[35163]: pgmap v1411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:22.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:22 smithi159 ceph-mon[36109]: pgmap v1411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:22.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1593 sec 2024-03-28T06:15:22.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:22 smithi055 ceph-mon[31863]: pgmap v1411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:23.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 922.794654 secs 2024-03-28T06:15:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 922.794654 secs 2024-03-28T06:15:23.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1594 sec 2024-03-28T06:15:23.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 922.794654 secs 2024-03-28T06:15:24.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:24 smithi086 ceph-mon[35163]: pgmap v1412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:24.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:24 smithi159 ceph-mon[36109]: pgmap v1412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:24.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1595 sec 2024-03-28T06:15:24.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:24 smithi055 ceph-mon[31863]: pgmap v1412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:25.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1596 sec 2024-03-28T06:15:26.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:26 smithi086 ceph-mon[35163]: pgmap v1413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:26.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:26 smithi159 ceph-mon[36109]: pgmap v1413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:26.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1597 sec 2024-03-28T06:15:26.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:26 smithi055 ceph-mon[31863]: pgmap v1413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:27.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1598 sec 2024-03-28T06:15:28.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:28 smithi086 ceph-mon[35163]: pgmap v1414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:28.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 927.794731 secs 2024-03-28T06:15:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:28 smithi159 ceph-mon[36109]: pgmap v1414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:28.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 927.794731 secs 2024-03-28T06:15:28.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1599 sec 2024-03-28T06:15:28.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:28 smithi055 ceph-mon[31863]: pgmap v1414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:28.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 927.794731 secs 2024-03-28T06:15:29.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1600 sec 2024-03-28T06:15:30.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:30 smithi086 ceph-mon[35163]: pgmap v1415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:30.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:30 smithi159 ceph-mon[36109]: pgmap v1415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:30.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1601 sec 2024-03-28T06:15:30.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:30 smithi055 ceph-mon[31863]: pgmap v1415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:31.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1602 sec 2024-03-28T06:15:32.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1603 sec 2024-03-28T06:15:32.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:32 smithi055 ceph-mon[31863]: pgmap v1416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:32.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:32 smithi086 ceph-mon[35163]: pgmap v1416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:32.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:32 smithi159 ceph-mon[36109]: pgmap v1416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:33.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1604 sec 2024-03-28T06:15:33.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 932.794816 secs 2024-03-28T06:15:33.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 932.794816 secs 2024-03-28T06:15:33.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 932.794816 secs 2024-03-28T06:15:34.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1605 sec 2024-03-28T06:15:34.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:34 smithi055 ceph-mon[31863]: pgmap v1417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:34.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:34 smithi086 ceph-mon[35163]: pgmap v1417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:34.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:34 smithi159 ceph-mon[36109]: pgmap v1417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:35.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1606 sec 2024-03-28T06:15:36.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1607 sec 2024-03-28T06:15:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:36 smithi055 ceph-mon[31863]: pgmap v1418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:36.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:36 smithi086 ceph-mon[35163]: pgmap v1418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:36.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:36 smithi159 ceph-mon[36109]: pgmap v1418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:37.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1608 sec 2024-03-28T06:15:38.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1609 sec 2024-03-28T06:15:38.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:38 smithi055 ceph-mon[31863]: pgmap v1419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 937.794934 secs 2024-03-28T06:15:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:38 smithi086 ceph-mon[35163]: pgmap v1419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 937.794934 secs 2024-03-28T06:15:38.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:38 smithi159 ceph-mon[36109]: pgmap v1419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 937.794934 secs 2024-03-28T06:15:39.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1610 sec 2024-03-28T06:15:39.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:15:39.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:15:39.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:15:40.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1611 sec 2024-03-28T06:15:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:40 smithi086 ceph-mon[35163]: pgmap v1420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:40 smithi159 ceph-mon[36109]: pgmap v1420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:40 smithi055 ceph-mon[31863]: pgmap v1420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:40.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:40.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:41.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1612 sec 2024-03-28T06:15:41.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:15:41.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:15:41.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:41.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:15:41.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:15:41.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:41.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:15:41.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:15:41.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:15:42.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1613 sec 2024-03-28T06:15:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:42 smithi086 ceph-mon[35163]: pgmap v1421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:42 smithi086 ceph-mon[35163]: pgmap v1422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:15:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:42 smithi086 ceph-mon[35163]: pgmap v1423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:42 smithi159 ceph-mon[36109]: pgmap v1421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:42 smithi159 ceph-mon[36109]: pgmap v1422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:15:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:42 smithi159 ceph-mon[36109]: pgmap v1423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:42.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:42 smithi055 ceph-mon[31863]: pgmap v1421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:15:42.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:42 smithi055 ceph-mon[31863]: pgmap v1422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:15:42.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:42 smithi055 ceph-mon[31863]: pgmap v1423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:43.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1614 sec 2024-03-28T06:15:43.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 942.794976 secs 2024-03-28T06:15:43.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:43 smithi086 ceph-mon[35163]: pgmap v1424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:43.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 942.794976 secs 2024-03-28T06:15:43.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:43 smithi159 ceph-mon[36109]: pgmap v1424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:43.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 942.794976 secs 2024-03-28T06:15:43.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:43 smithi055 ceph-mon[31863]: pgmap v1424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:15:44.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1615 sec 2024-03-28T06:15:45.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1616 sec 2024-03-28T06:15:46.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1617 sec 2024-03-28T06:15:46.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:46 smithi055 ceph-mon[31863]: pgmap v1425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:46.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:46 smithi086 ceph-mon[35163]: pgmap v1425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:46.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:46 smithi159 ceph-mon[36109]: pgmap v1425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:47.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1618 sec 2024-03-28T06:15:48.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1619 sec 2024-03-28T06:15:48.360 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:48 smithi159 ceph-mon[36109]: pgmap v1426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:48.360 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 947.795021 secs 2024-03-28T06:15:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:48 smithi055 ceph-mon[31863]: pgmap v1426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 947.795021 secs 2024-03-28T06:15:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:48 smithi086 ceph-mon[35163]: pgmap v1426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 947.795021 secs 2024-03-28T06:15:49.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1620 sec 2024-03-28T06:15:50.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1621 sec 2024-03-28T06:15:50.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:50 smithi055 ceph-mon[31863]: pgmap v1427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:15:50.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:50 smithi086 ceph-mon[35163]: pgmap v1427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:15:50.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:50 smithi159 ceph-mon[36109]: pgmap v1427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:15:51.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1622 sec 2024-03-28T06:15:52.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1623 sec 2024-03-28T06:15:52.357 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:52 smithi086 ceph-mon[35163]: pgmap v1428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:15:52.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:52 smithi055 ceph-mon[31863]: pgmap v1428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:15:52.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:52 smithi159 ceph-mon[36109]: pgmap v1428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:15:53.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1624 sec 2024-03-28T06:15:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 952.795150 secs 2024-03-28T06:15:53.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 952.795150 secs 2024-03-28T06:15:53.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 952.795150 secs 2024-03-28T06:15:54.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1625 sec 2024-03-28T06:15:54.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:54 smithi086 ceph-mon[35163]: pgmap v1429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:54.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:54 smithi159 ceph-mon[36109]: pgmap v1429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:54.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:54 smithi055 ceph-mon[31863]: pgmap v1429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:55.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1626 sec 2024-03-28T06:15:56.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1627 sec 2024-03-28T06:15:56.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:56 smithi086 ceph-mon[35163]: pgmap v1430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:56.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:56 smithi159 ceph-mon[36109]: pgmap v1430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:56.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:56 smithi055 ceph-mon[31863]: pgmap v1430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:15:57.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1628 sec 2024-03-28T06:15:57.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:57 smithi086 ceph-mon[35163]: pgmap v1431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:57.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:57 smithi159 ceph-mon[36109]: pgmap v1431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:57.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:57 smithi055 ceph-mon[31863]: pgmap v1431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:58.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1629 sec 2024-03-28T06:15:58.512 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 957.795234 secs 2024-03-28T06:15:58.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 957.795234 secs 2024-03-28T06:15:58.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 957.795234 secs 2024-03-28T06:15:59.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1630 sec 2024-03-28T06:15:59.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:15:59 smithi086 ceph-mon[35163]: pgmap v1432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:59.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:15:59 smithi159 ceph-mon[36109]: pgmap v1432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:15:59.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:15:59 smithi055 ceph-mon[31863]: pgmap v1432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:00.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1631 sec 2024-03-28T06:16:01.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1632 sec 2024-03-28T06:16:02.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1633 sec 2024-03-28T06:16:02.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:02 smithi055 ceph-mon[31863]: pgmap v1433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:02.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:02 smithi086 ceph-mon[35163]: pgmap v1433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:02.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:02 smithi159 ceph-mon[36109]: pgmap v1433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:03.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1634 sec 2024-03-28T06:16:03.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 962.795316 secs 2024-03-28T06:16:03.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 962.795316 secs 2024-03-28T06:16:03.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 962.795316 secs 2024-03-28T06:16:04.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1635 sec 2024-03-28T06:16:04.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:04 smithi055 ceph-mon[31863]: pgmap v1434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:04.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:04 smithi086 ceph-mon[35163]: pgmap v1434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:04.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:04 smithi159 ceph-mon[36109]: pgmap v1434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:05.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1636 sec 2024-03-28T06:16:06.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1637 sec 2024-03-28T06:16:06.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:06 smithi055 ceph-mon[31863]: pgmap v1435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:06.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:06 smithi086 ceph-mon[35163]: pgmap v1435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:06.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:06 smithi159 ceph-mon[36109]: pgmap v1435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:07.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1638 sec 2024-03-28T06:16:08.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1639 sec 2024-03-28T06:16:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:08 smithi055 ceph-mon[31863]: pgmap v1436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 967.795432 secs 2024-03-28T06:16:08.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:08 smithi086 ceph-mon[35163]: pgmap v1436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:08.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 967.795432 secs 2024-03-28T06:16:08.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:08 smithi159 ceph-mon[36109]: pgmap v1436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:08.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 967.795432 secs 2024-03-28T06:16:09.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1640 sec 2024-03-28T06:16:10.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1641 sec 2024-03-28T06:16:10.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:10 smithi086 ceph-mon[35163]: pgmap v1437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:10.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:10 smithi159 ceph-mon[36109]: pgmap v1437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:10.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:10 smithi055 ceph-mon[31863]: pgmap v1437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:11.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1642 sec 2024-03-28T06:16:12.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1643 sec 2024-03-28T06:16:12.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:12 smithi086 ceph-mon[35163]: pgmap v1438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:12.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:12 smithi159 ceph-mon[36109]: pgmap v1438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:12.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:12 smithi055 ceph-mon[31863]: pgmap v1438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:13.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1644 sec 2024-03-28T06:16:13.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 972.795523 secs 2024-03-28T06:16:13.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 972.795523 secs 2024-03-28T06:16:13.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 972.795523 secs 2024-03-28T06:16:14.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1645 sec 2024-03-28T06:16:14.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:14 smithi086 ceph-mon[35163]: pgmap v1439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:14.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:14 smithi159 ceph-mon[36109]: pgmap v1439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:14.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:14 smithi055 ceph-mon[31863]: pgmap v1439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:15.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1646 sec 2024-03-28T06:16:15.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:15 smithi086 ceph-mon[35163]: pgmap v1440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:15.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:15 smithi159 ceph-mon[36109]: pgmap v1440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:15.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:15 smithi055 ceph-mon[31863]: pgmap v1440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:16.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1647 sec 2024-03-28T06:16:17.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1648 sec 2024-03-28T06:16:18.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1649 sec 2024-03-28T06:16:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:18 smithi055 ceph-mon[31863]: pgmap v1441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:18.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 977.795604 secs 2024-03-28T06:16:18.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:18 smithi086 ceph-mon[35163]: pgmap v1441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:18.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 977.795604 secs 2024-03-28T06:16:18.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:18 smithi159 ceph-mon[36109]: pgmap v1441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:18.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 977.795604 secs 2024-03-28T06:16:19.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1650 sec 2024-03-28T06:16:20.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1651 sec 2024-03-28T06:16:20.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:20 smithi055 ceph-mon[31863]: pgmap v1442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:20.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:20 smithi086 ceph-mon[35163]: pgmap v1442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:20.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:20 smithi159 ceph-mon[36109]: pgmap v1442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:21.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1652 sec 2024-03-28T06:16:22.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1653 sec 2024-03-28T06:16:22.357 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:22 smithi086 ceph-mon[35163]: pgmap v1443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:22.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:22 smithi055 ceph-mon[31863]: pgmap v1443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:22.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:22 smithi159 ceph-mon[36109]: pgmap v1443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:23.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1654 sec 2024-03-28T06:16:23.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 982.795677 secs 2024-03-28T06:16:23.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 982.795677 secs 2024-03-28T06:16:23.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 982.795677 secs 2024-03-28T06:16:24.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1655 sec 2024-03-28T06:16:24.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:24 smithi086 ceph-mon[35163]: pgmap v1444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:24.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:24 smithi159 ceph-mon[36109]: pgmap v1444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:24.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:24 smithi055 ceph-mon[31863]: pgmap v1444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:25.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1656 sec 2024-03-28T06:16:26.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1657 sec 2024-03-28T06:16:26.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:26 smithi086 ceph-mon[35163]: pgmap v1445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:26.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:26 smithi159 ceph-mon[36109]: pgmap v1445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:26.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:26 smithi055 ceph-mon[31863]: pgmap v1445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:27.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1658 sec 2024-03-28T06:16:28.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1659 sec 2024-03-28T06:16:28.412 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:28 smithi055 ceph-mon[31863]: pgmap v1446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:28.412 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 987.795765 secs 2024-03-28T06:16:28.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:28 smithi086 ceph-mon[35163]: pgmap v1446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:28.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 987.795765 secs 2024-03-28T06:16:28.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:28 smithi159 ceph-mon[36109]: pgmap v1446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:28.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 987.795765 secs 2024-03-28T06:16:29.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1660 sec 2024-03-28T06:16:30.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1661 sec 2024-03-28T06:16:30.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:30 smithi086 ceph-mon[35163]: pgmap v1447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:30.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:30 smithi159 ceph-mon[36109]: pgmap v1447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:30.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:30 smithi055 ceph-mon[31863]: pgmap v1447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:31.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1662 sec 2024-03-28T06:16:31.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:31 smithi086 ceph-mon[35163]: pgmap v1448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:31.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:31 smithi159 ceph-mon[36109]: pgmap v1448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:31.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:31 smithi055 ceph-mon[31863]: pgmap v1448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:32.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1663 sec 2024-03-28T06:16:33.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 992.795820 secs 2024-03-28T06:16:33.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 992.795820 secs 2024-03-28T06:16:33.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 992.795820 secs 2024-03-28T06:16:33.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1664 sec 2024-03-28T06:16:34.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:33 smithi086 ceph-mon[35163]: pgmap v1449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:34.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:33 smithi159 ceph-mon[36109]: pgmap v1449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:34.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:33 smithi055 ceph-mon[31863]: pgmap v1449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:34.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1665 sec 2024-03-28T06:16:35.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1666 sec 2024-03-28T06:16:36.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1667 sec 2024-03-28T06:16:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:36 smithi055 ceph-mon[31863]: pgmap v1450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:36.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:36 smithi086 ceph-mon[35163]: pgmap v1450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:36.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:36 smithi159 ceph-mon[36109]: pgmap v1450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:16:37.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1668 sec 2024-03-28T06:16:38.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1669 sec 2024-03-28T06:16:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:38 smithi055 ceph-mon[31863]: pgmap v1451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 997.795938 secs 2024-03-28T06:16:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:38 smithi086 ceph-mon[35163]: pgmap v1451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 997.795938 secs 2024-03-28T06:16:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:38 smithi159 ceph-mon[36109]: pgmap v1451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:38.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 997.795938 secs 2024-03-28T06:16:39.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1670 sec 2024-03-28T06:16:40.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1671 sec 2024-03-28T06:16:40.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:40 smithi055 ceph-mon[31863]: pgmap v1452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:40.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:40 smithi086 ceph-mon[35163]: pgmap v1452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:40.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:40 smithi159 ceph-mon[36109]: pgmap v1452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:16:41.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1672 sec 2024-03-28T06:16:42.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1673 sec 2024-03-28T06:16:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:42 smithi086 ceph-mon[35163]: pgmap v1453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:16:42.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:42 smithi159 ceph-mon[36109]: pgmap v1453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:42.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:16:42.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:42 smithi055 ceph-mon[31863]: pgmap v1453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:42.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:16:43.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1674 sec 2024-03-28T06:16:43.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1002.796004 secs 2024-03-28T06:16:43.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:43 smithi055 ceph-mon[31863]: pgmap v1454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:43.729 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.729 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.729 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1002.796004 secs 2024-03-28T06:16:43.730 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:43 smithi159 ceph-mon[36109]: pgmap v1454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:43.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:43.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1002.796004 secs 2024-03-28T06:16:43.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:43 smithi086 ceph-mon[35163]: pgmap v1454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:44.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1675 sec 2024-03-28T06:16:45.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1676 sec 2024-03-28T06:16:45.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:45 smithi086 ceph-mon[35163]: pgmap v1455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:45.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:45 smithi159 ceph-mon[36109]: pgmap v1455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:45.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:45.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:45 smithi055 ceph-mon[31863]: pgmap v1455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:46.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1677 sec 2024-03-28T06:16:47.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1678 sec 2024-03-28T06:16:47.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:47.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:48.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1679 sec 2024-03-28T06:16:48.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:48 smithi055 ceph-mon[31863]: pgmap v1456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1007.796089 secs 2024-03-28T06:16:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:16:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:16:48.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:48.459 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:48 smithi159 ceph-mon[36109]: pgmap v1456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:48.459 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1007.796089 secs 2024-03-28T06:16:48.459 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:16:48.459 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:16:48.460 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:48.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:48 smithi086 ceph-mon[35163]: pgmap v1456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:16:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1007.796089 secs 2024-03-28T06:16:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:16:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:16:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:16:49.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1680 sec 2024-03-28T06:16:49.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:49 smithi086 ceph-mon[35163]: pgmap v1457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:49.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:49 smithi086 ceph-mon[35163]: pgmap v1458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:49.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:49 smithi159 ceph-mon[36109]: pgmap v1457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:49.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:49 smithi159 ceph-mon[36109]: pgmap v1458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:49.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:49 smithi055 ceph-mon[31863]: pgmap v1457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:49.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:49 smithi055 ceph-mon[31863]: pgmap v1458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:16:50.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1681 sec 2024-03-28T06:16:51.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1682 sec 2024-03-28T06:16:51.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:51 smithi086 ceph-mon[35163]: pgmap v1459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:51.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:51 smithi159 ceph-mon[36109]: pgmap v1459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:51.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:51 smithi055 ceph-mon[31863]: pgmap v1459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:52.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1683 sec 2024-03-28T06:16:53.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1684 sec 2024-03-28T06:16:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:53 smithi086 ceph-mon[35163]: pgmap v1460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1012.796212 secs 2024-03-28T06:16:53.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:53 smithi159 ceph-mon[36109]: pgmap v1460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:53.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1012.796212 secs 2024-03-28T06:16:53.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:53 smithi055 ceph-mon[31863]: pgmap v1460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:16:53.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1012.796212 secs 2024-03-28T06:16:54.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1685 sec 2024-03-28T06:16:55.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1686 sec 2024-03-28T06:16:55.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:55 smithi086 ceph-mon[35163]: pgmap v1461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:55.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:55 smithi159 ceph-mon[36109]: pgmap v1461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:55.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:55 smithi055 ceph-mon[31863]: pgmap v1461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:56.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1687 sec 2024-03-28T06:16:57.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1688 sec 2024-03-28T06:16:57.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:57 smithi086 ceph-mon[35163]: pgmap v1462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:57.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:57 smithi159 ceph-mon[36109]: pgmap v1462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:57.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:57 smithi055 ceph-mon[31863]: pgmap v1462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:16:58.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1689 sec 2024-03-28T06:16:58.511 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1017.796331 secs 2024-03-28T06:16:58.511 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:16:58 smithi055 ceph-mon[31863]: pgmap v1463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:16:58.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1017.796331 secs 2024-03-28T06:16:58.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:16:58 smithi086 ceph-mon[35163]: pgmap v1463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:16:58.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1017.796331 secs 2024-03-28T06:16:58.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:16:58 smithi159 ceph-mon[36109]: pgmap v1463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:16:59.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1690 sec 2024-03-28T06:17:00.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1691 sec 2024-03-28T06:17:01.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:00 smithi086 ceph-mon[35163]: pgmap v1464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:01.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:00 smithi159 ceph-mon[36109]: pgmap v1464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:01.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:00 smithi055 ceph-mon[31863]: pgmap v1464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:01.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1692 sec 2024-03-28T06:17:02.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1693 sec 2024-03-28T06:17:03.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:02 smithi086 ceph-mon[35163]: pgmap v1465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:03.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1022.796419 secs 2024-03-28T06:17:03.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:02 smithi159 ceph-mon[36109]: pgmap v1465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:03.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1022.796419 secs 2024-03-28T06:17:03.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:02 smithi055 ceph-mon[31863]: pgmap v1465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:03.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1022.796419 secs 2024-03-28T06:17:03.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1694 sec 2024-03-28T06:17:04.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1695 sec 2024-03-28T06:17:05.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:04 smithi086 ceph-mon[35163]: pgmap v1466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:05.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:04 smithi159 ceph-mon[36109]: pgmap v1466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:05.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:04 smithi055 ceph-mon[31863]: pgmap v1466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:05.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1696 sec 2024-03-28T06:17:06.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1697 sec 2024-03-28T06:17:07.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:06 smithi086 ceph-mon[35163]: pgmap v1467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:07.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:06 smithi159 ceph-mon[36109]: pgmap v1467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:07.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:06 smithi055 ceph-mon[31863]: pgmap v1467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:07.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1698 sec 2024-03-28T06:17:08.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1027.796505 secs 2024-03-28T06:17:08.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1027.796505 secs 2024-03-28T06:17:08.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1027.796505 secs 2024-03-28T06:17:08.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1699 sec 2024-03-28T06:17:09.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:08 smithi086 ceph-mon[35163]: pgmap v1468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:09.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:08 smithi159 ceph-mon[36109]: pgmap v1468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:09.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:08 smithi055 ceph-mon[31863]: pgmap v1468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:09.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1700 sec 2024-03-28T06:17:10.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1701 sec 2024-03-28T06:17:11.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:10 smithi086 ceph-mon[35163]: pgmap v1469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:11.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:10 smithi159 ceph-mon[36109]: pgmap v1469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:11.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:10 smithi055 ceph-mon[31863]: pgmap v1469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:11.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1702 sec 2024-03-28T06:17:12.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1703 sec 2024-03-28T06:17:13.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:12 smithi086 ceph-mon[35163]: pgmap v1470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:13.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1032.796623 secs 2024-03-28T06:17:13.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:12 smithi159 ceph-mon[36109]: pgmap v1470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:13.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1032.796623 secs 2024-03-28T06:17:13.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:12 smithi055 ceph-mon[31863]: pgmap v1470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:13.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1032.796623 secs 2024-03-28T06:17:13.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1704 sec 2024-03-28T06:17:14.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1705 sec 2024-03-28T06:17:15.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:14 smithi086 ceph-mon[35163]: pgmap v1471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:15.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:14 smithi159 ceph-mon[36109]: pgmap v1471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:15.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:14 smithi055 ceph-mon[31863]: pgmap v1471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:15.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1706 sec 2024-03-28T06:17:16.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1707 sec 2024-03-28T06:17:17.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:16 smithi086 ceph-mon[35163]: pgmap v1472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:17.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:16 smithi159 ceph-mon[36109]: pgmap v1472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:17.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:16 smithi055 ceph-mon[31863]: pgmap v1472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:17.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1708 sec 2024-03-28T06:17:18.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1037.796743 secs 2024-03-28T06:17:18.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1037.796743 secs 2024-03-28T06:17:18.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1037.796743 secs 2024-03-28T06:17:18.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1709 sec 2024-03-28T06:17:19.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:18 smithi086 ceph-mon[35163]: pgmap v1473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:19.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:18 smithi159 ceph-mon[36109]: pgmap v1473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:19.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:18 smithi055 ceph-mon[31863]: pgmap v1473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:19.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1710 sec 2024-03-28T06:17:20.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1711 sec 2024-03-28T06:17:21.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:20 smithi086 ceph-mon[35163]: pgmap v1474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:21.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:20 smithi159 ceph-mon[36109]: pgmap v1474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:21.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:20 smithi055 ceph-mon[31863]: pgmap v1474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:21.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1712 sec 2024-03-28T06:17:22.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1713 sec 2024-03-28T06:17:23.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:22 smithi086 ceph-mon[35163]: pgmap v1475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:23.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1042.796862 secs 2024-03-28T06:17:23.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:22 smithi159 ceph-mon[36109]: pgmap v1475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:23.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1042.796862 secs 2024-03-28T06:17:23.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:22 smithi055 ceph-mon[31863]: pgmap v1475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:23.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1042.796862 secs 2024-03-28T06:17:23.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1714 sec 2024-03-28T06:17:24.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1715 sec 2024-03-28T06:17:25.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:24 smithi086 ceph-mon[35163]: pgmap v1476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:25.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:24 smithi159 ceph-mon[36109]: pgmap v1476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:25.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:24 smithi055 ceph-mon[31863]: pgmap v1476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:25.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1716 sec 2024-03-28T06:17:26.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1717 sec 2024-03-28T06:17:27.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:26 smithi086 ceph-mon[35163]: pgmap v1477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:27.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:26 smithi159 ceph-mon[36109]: pgmap v1477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:27.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:26 smithi055 ceph-mon[31863]: pgmap v1477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:27.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1718 sec 2024-03-28T06:17:28.012 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1047.796983 secs 2024-03-28T06:17:28.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1047.796983 secs 2024-03-28T06:17:28.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1047.796983 secs 2024-03-28T06:17:28.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1719 sec 2024-03-28T06:17:29.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:28 smithi086 ceph-mon[35163]: pgmap v1478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:29.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:28 smithi159 ceph-mon[36109]: pgmap v1478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:29.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:28 smithi055 ceph-mon[31863]: pgmap v1478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:29.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1720 sec 2024-03-28T06:17:30.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1721 sec 2024-03-28T06:17:31.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:30 smithi086 ceph-mon[35163]: pgmap v1479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:31.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:30 smithi159 ceph-mon[36109]: pgmap v1479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:31.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:30 smithi055 ceph-mon[31863]: pgmap v1479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:31.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1722 sec 2024-03-28T06:17:32.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1723 sec 2024-03-28T06:17:33.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:32 smithi086 ceph-mon[35163]: pgmap v1480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:33.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1052.797100 secs 2024-03-28T06:17:33.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:32 smithi159 ceph-mon[36109]: pgmap v1480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:33.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1052.797100 secs 2024-03-28T06:17:33.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:32 smithi055 ceph-mon[31863]: pgmap v1480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:33.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1052.797100 secs 2024-03-28T06:17:33.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1724 sec 2024-03-28T06:17:34.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1725 sec 2024-03-28T06:17:35.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:34 smithi086 ceph-mon[35163]: pgmap v1481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:35.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:34 smithi159 ceph-mon[36109]: pgmap v1481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:35.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:34 smithi055 ceph-mon[31863]: pgmap v1481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:35.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1726 sec 2024-03-28T06:17:36.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1727 sec 2024-03-28T06:17:37.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:36 smithi086 ceph-mon[35163]: pgmap v1482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:37.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:36 smithi159 ceph-mon[36109]: pgmap v1482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:37.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:36 smithi055 ceph-mon[31863]: pgmap v1482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:37.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1728 sec 2024-03-28T06:17:38.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1057.797221 secs 2024-03-28T06:17:38.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1057.797221 secs 2024-03-28T06:17:38.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1057.797221 secs 2024-03-28T06:17:38.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1729 sec 2024-03-28T06:17:39.054 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:38 smithi086 ceph-mon[35163]: pgmap v1483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:39.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:38 smithi159 ceph-mon[36109]: pgmap v1483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:39.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:38 smithi055 ceph-mon[31863]: pgmap v1483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:39.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1730 sec 2024-03-28T06:17:40.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1731 sec 2024-03-28T06:17:41.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:40 smithi055 ceph-mon[31863]: pgmap v1484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:41.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:40 smithi086 ceph-mon[35163]: pgmap v1484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:41.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:40 smithi159 ceph-mon[36109]: pgmap v1484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:41.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1732 sec 2024-03-28T06:17:42.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1733 sec 2024-03-28T06:17:43.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:42 smithi055 ceph-mon[31863]: pgmap v1485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:43.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1062.797341 secs 2024-03-28T06:17:43.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:42 smithi086 ceph-mon[35163]: pgmap v1485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:43.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1062.797341 secs 2024-03-28T06:17:43.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:42 smithi159 ceph-mon[36109]: pgmap v1485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:43.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1062.797341 secs 2024-03-28T06:17:43.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1734 sec 2024-03-28T06:17:44.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1735 sec 2024-03-28T06:17:45.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:44 smithi055 ceph-mon[31863]: pgmap v1486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:45.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:44 smithi086 ceph-mon[35163]: pgmap v1486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:45.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:44 smithi159 ceph-mon[36109]: pgmap v1486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:45.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1736 sec 2024-03-28T06:17:46.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1737 sec 2024-03-28T06:17:47.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:46 smithi055 ceph-mon[31863]: pgmap v1487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:47.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:46 smithi086 ceph-mon[35163]: pgmap v1487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:47.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:46 smithi159 ceph-mon[36109]: pgmap v1487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:17:47.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1738 sec 2024-03-28T06:17:48.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1067.797462 secs 2024-03-28T06:17:48.208 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1067.797462 secs 2024-03-28T06:17:48.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1067.797462 secs 2024-03-28T06:17:48.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1739 sec 2024-03-28T06:17:49.109 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:48 smithi055 ceph-mon[31863]: pgmap v1488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:49.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:17:49.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:48 smithi086 ceph-mon[35163]: pgmap v1488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:49.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:17:49.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:48 smithi159 ceph-mon[36109]: pgmap v1488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:17:49.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:17:49.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1740 sec 2024-03-28T06:17:50.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:17:50.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:17:50.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:17:50.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:17:50.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:17:50.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:17:50.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1741 sec 2024-03-28T06:17:50.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:17:50.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:17:50.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:17:51.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:50 smithi086 ceph-mon[35163]: pgmap v1489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:51.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:50 smithi086 ceph-mon[35163]: pgmap v1490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:51.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:50 smithi159 ceph-mon[36109]: pgmap v1489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:51.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:50 smithi159 ceph-mon[36109]: pgmap v1490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:51.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1742 sec 2024-03-28T06:17:51.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:50 smithi055 ceph-mon[31863]: pgmap v1489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:17:51.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:50 smithi055 ceph-mon[31863]: pgmap v1490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:52.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1743 sec 2024-03-28T06:17:53.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:52 smithi086 ceph-mon[35163]: pgmap v1491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:53.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1072.797583 secs 2024-03-28T06:17:53.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:52 smithi159 ceph-mon[36109]: pgmap v1491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:53.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1072.797583 secs 2024-03-28T06:17:53.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1744 sec 2024-03-28T06:17:53.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:52 smithi055 ceph-mon[31863]: pgmap v1491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:53.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1072.797583 secs 2024-03-28T06:17:54.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1745 sec 2024-03-28T06:17:55.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:54 smithi086 ceph-mon[35163]: pgmap v1492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:55.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:54 smithi159 ceph-mon[36109]: pgmap v1492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:55.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1746 sec 2024-03-28T06:17:55.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:54 smithi055 ceph-mon[31863]: pgmap v1492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:56.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1747 sec 2024-03-28T06:17:57.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:56 smithi086 ceph-mon[35163]: pgmap v1493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:57.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:56 smithi159 ceph-mon[36109]: pgmap v1493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:57.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1748 sec 2024-03-28T06:17:57.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:56 smithi055 ceph-mon[31863]: pgmap v1493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:58.262 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1077.797651 secs 2024-03-28T06:17:58.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1077.797651 secs 2024-03-28T06:17:58.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1077.797651 secs 2024-03-28T06:17:58.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1749 sec 2024-03-28T06:17:59.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:17:58 smithi086 ceph-mon[35163]: pgmap v1494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:59.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:17:58 smithi159 ceph-mon[36109]: pgmap v1494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:17:59.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1750 sec 2024-03-28T06:17:59.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:17:58 smithi055 ceph-mon[31863]: pgmap v1494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:00.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1751 sec 2024-03-28T06:18:01.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:00 smithi086 ceph-mon[35163]: pgmap v1495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:18:01.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:00 smithi159 ceph-mon[36109]: pgmap v1495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:18:01.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1752 sec 2024-03-28T06:18:01.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:00 smithi055 ceph-mon[31863]: pgmap v1495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:18:02.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1753 sec 2024-03-28T06:18:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:02 smithi086 ceph-mon[35163]: pgmap v1496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:03.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1082.797772 secs 2024-03-28T06:18:03.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:02 smithi159 ceph-mon[36109]: pgmap v1496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:03.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1082.797772 secs 2024-03-28T06:18:03.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1754 sec 2024-03-28T06:18:03.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:02 smithi055 ceph-mon[31863]: pgmap v1496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:03.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1082.797772 secs 2024-03-28T06:18:04.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1755 sec 2024-03-28T06:18:05.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:04 smithi086 ceph-mon[35163]: pgmap v1497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:05.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:04 smithi159 ceph-mon[36109]: pgmap v1497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:05.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1756 sec 2024-03-28T06:18:05.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:04 smithi055 ceph-mon[31863]: pgmap v1497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:06.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1757 sec 2024-03-28T06:18:07.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:06 smithi086 ceph-mon[35163]: pgmap v1498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:07.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:06 smithi159 ceph-mon[36109]: pgmap v1498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:07.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1758 sec 2024-03-28T06:18:07.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:06 smithi055 ceph-mon[31863]: pgmap v1498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:08.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1087.797850 secs 2024-03-28T06:18:08.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1087.797850 secs 2024-03-28T06:18:08.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1759 sec 2024-03-28T06:18:08.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1087.797850 secs 2024-03-28T06:18:09.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:08 smithi086 ceph-mon[35163]: pgmap v1499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:09.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:08 smithi159 ceph-mon[36109]: pgmap v1499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:09.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1760 sec 2024-03-28T06:18:09.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:08 smithi055 ceph-mon[31863]: pgmap v1499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:10.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1761 sec 2024-03-28T06:18:11.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:10 smithi086 ceph-mon[35163]: pgmap v1500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:11.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:10 smithi159 ceph-mon[36109]: pgmap v1500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:11.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1762 sec 2024-03-28T06:18:11.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:10 smithi055 ceph-mon[31863]: pgmap v1500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:12.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1763 sec 2024-03-28T06:18:13.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:12 smithi086 ceph-mon[35163]: pgmap v1501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:13.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1092.797974 secs 2024-03-28T06:18:13.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:12 smithi159 ceph-mon[36109]: pgmap v1501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:13.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1092.797974 secs 2024-03-28T06:18:13.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1764 sec 2024-03-28T06:18:13.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:12 smithi055 ceph-mon[31863]: pgmap v1501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:13.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1092.797974 secs 2024-03-28T06:18:14.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1765 sec 2024-03-28T06:18:15.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:14 smithi086 ceph-mon[35163]: pgmap v1502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:15.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:14 smithi159 ceph-mon[36109]: pgmap v1502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:15.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1766 sec 2024-03-28T06:18:15.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:14 smithi055 ceph-mon[31863]: pgmap v1502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:16.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1767 sec 2024-03-28T06:18:17.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:17 smithi086 ceph-mon[35163]: pgmap v1503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:17.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:17 smithi159 ceph-mon[36109]: pgmap v1503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:17.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1768 sec 2024-03-28T06:18:17.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:17 smithi055 ceph-mon[31863]: pgmap v1503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:18.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1097.798035 secs 2024-03-28T06:18:18.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1097.798035 secs 2024-03-28T06:18:18.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1769 sec 2024-03-28T06:18:18.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1097.798035 secs 2024-03-28T06:18:19.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:19 smithi086 ceph-mon[35163]: pgmap v1504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:19.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:19 smithi159 ceph-mon[36109]: pgmap v1504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:19.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1770 sec 2024-03-28T06:18:19.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:19 smithi055 ceph-mon[31863]: pgmap v1504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:20.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1771 sec 2024-03-28T06:18:21.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:21 smithi086 ceph-mon[35163]: pgmap v1505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:21.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:21 smithi159 ceph-mon[36109]: pgmap v1505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:21.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1772 sec 2024-03-28T06:18:21.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:21 smithi055 ceph-mon[31863]: pgmap v1505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:22.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1773 sec 2024-03-28T06:18:23.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:23 smithi086 ceph-mon[35163]: pgmap v1506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:23.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1102.798054 secs 2024-03-28T06:18:23.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:23 smithi159 ceph-mon[36109]: pgmap v1506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:23.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1102.798054 secs 2024-03-28T06:18:23.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1774 sec 2024-03-28T06:18:23.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:23 smithi055 ceph-mon[31863]: pgmap v1506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:23.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1102.798054 secs 2024-03-28T06:18:24.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1775 sec 2024-03-28T06:18:25.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:25 smithi086 ceph-mon[35163]: pgmap v1507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:25.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:25 smithi159 ceph-mon[36109]: pgmap v1507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:25.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1776 sec 2024-03-28T06:18:25.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:25 smithi055 ceph-mon[31863]: pgmap v1507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:26.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1777 sec 2024-03-28T06:18:27.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:27 smithi086 ceph-mon[35163]: pgmap v1508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:27.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:27 smithi159 ceph-mon[36109]: pgmap v1508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:27.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1778 sec 2024-03-28T06:18:27.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:27 smithi055 ceph-mon[31863]: pgmap v1508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:28.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1107.798117 secs 2024-03-28T06:18:28.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1107.798117 secs 2024-03-28T06:18:28.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1779 sec 2024-03-28T06:18:28.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1107.798117 secs 2024-03-28T06:18:29.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:29 smithi086 ceph-mon[35163]: pgmap v1509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:29.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:29 smithi159 ceph-mon[36109]: pgmap v1509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:29.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1780 sec 2024-03-28T06:18:29.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:29 smithi055 ceph-mon[31863]: pgmap v1509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:30.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1781 sec 2024-03-28T06:18:31.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:31 smithi086 ceph-mon[35163]: pgmap v1510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:31.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:31 smithi159 ceph-mon[36109]: pgmap v1510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:31.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1782 sec 2024-03-28T06:18:31.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:31 smithi055 ceph-mon[31863]: pgmap v1510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:32.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1783 sec 2024-03-28T06:18:33.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1784 sec 2024-03-28T06:18:33.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:33 smithi055 ceph-mon[31863]: pgmap v1511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:33.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1112.798181 secs 2024-03-28T06:18:33.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:33 smithi086 ceph-mon[35163]: pgmap v1511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:33.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1112.798181 secs 2024-03-28T06:18:33.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:33 smithi159 ceph-mon[36109]: pgmap v1511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:33.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1112.798181 secs 2024-03-28T06:18:34.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1785 sec 2024-03-28T06:18:35.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1786 sec 2024-03-28T06:18:35.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:35 smithi055 ceph-mon[31863]: pgmap v1512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:35.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:35 smithi086 ceph-mon[35163]: pgmap v1512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:35.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:35 smithi159 ceph-mon[36109]: pgmap v1512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:36.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1787 sec 2024-03-28T06:18:37.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1788 sec 2024-03-28T06:18:37.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:37 smithi055 ceph-mon[31863]: pgmap v1513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:37.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:37 smithi086 ceph-mon[35163]: pgmap v1513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:37.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:37 smithi159 ceph-mon[36109]: pgmap v1513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:38.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1789 sec 2024-03-28T06:18:38.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1117.798244 secs 2024-03-28T06:18:38.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1117.798244 secs 2024-03-28T06:18:38.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1117.798244 secs 2024-03-28T06:18:39.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1790 sec 2024-03-28T06:18:39.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:39 smithi055 ceph-mon[31863]: pgmap v1514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:39.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:39 smithi086 ceph-mon[35163]: pgmap v1514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:39.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:39 smithi159 ceph-mon[36109]: pgmap v1514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:40.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1791 sec 2024-03-28T06:18:41.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1792 sec 2024-03-28T06:18:41.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:41 smithi055 ceph-mon[31863]: pgmap v1515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:41.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:41 smithi086 ceph-mon[35163]: pgmap v1515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:41.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:41 smithi159 ceph-mon[36109]: pgmap v1515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:42.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1793 sec 2024-03-28T06:18:43.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1794 sec 2024-03-28T06:18:43.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:43 smithi055 ceph-mon[31863]: pgmap v1516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:43.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1122.798313 secs 2024-03-28T06:18:43.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:43 smithi086 ceph-mon[35163]: pgmap v1516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:43.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1122.798313 secs 2024-03-28T06:18:43.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:43 smithi159 ceph-mon[36109]: pgmap v1516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:43.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1122.798313 secs 2024-03-28T06:18:44.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1795 sec 2024-03-28T06:18:45.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1796 sec 2024-03-28T06:18:45.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:45 smithi086 ceph-mon[35163]: pgmap v1517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:45.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:45 smithi159 ceph-mon[36109]: pgmap v1517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:45.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:45 smithi055 ceph-mon[31863]: pgmap v1517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:46.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1797 sec 2024-03-28T06:18:47.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1798 sec 2024-03-28T06:18:47.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:47 smithi086 ceph-mon[35163]: pgmap v1518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:47.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:47 smithi159 ceph-mon[36109]: pgmap v1518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:47.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:47 smithi055 ceph-mon[31863]: pgmap v1518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:18:48.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1799 sec 2024-03-28T06:18:48.458 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1127.798434 secs 2024-03-28T06:18:48.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1127.798434 secs 2024-03-28T06:18:48.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1127.798434 secs 2024-03-28T06:18:49.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1800 sec 2024-03-28T06:18:49.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:49 smithi086 ceph-mon[35163]: pgmap v1519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:49.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:49 smithi159 ceph-mon[36109]: pgmap v1519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:49.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:49 smithi055 ceph-mon[31863]: pgmap v1519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:18:50.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1801 sec 2024-03-28T06:18:50.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:18:50.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:18:50.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:18:51.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1802 sec 2024-03-28T06:18:51.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:51 smithi086 ceph-mon[35163]: pgmap v1520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:51.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:51 smithi159 ceph-mon[36109]: pgmap v1520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:51.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:51 smithi055 ceph-mon[31863]: pgmap v1520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:52.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1803 sec 2024-03-28T06:18:52.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:18:52.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:18:52.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:18:52.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:18:52.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:18:52.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:18:52.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:18:52.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:18:52.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:18:53.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1804 sec 2024-03-28T06:18:53.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:53 smithi086 ceph-mon[35163]: pgmap v1521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:53 smithi086 ceph-mon[35163]: pgmap v1522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1132.798516 secs 2024-03-28T06:18:53.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:53 smithi159 ceph-mon[36109]: pgmap v1521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:53.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:53 smithi159 ceph-mon[36109]: pgmap v1522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:53.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1132.798516 secs 2024-03-28T06:18:53.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:53 smithi055 ceph-mon[31863]: pgmap v1521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:18:53.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:53 smithi055 ceph-mon[31863]: pgmap v1522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:53.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1132.798516 secs 2024-03-28T06:18:54.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1805 sec 2024-03-28T06:18:54.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:54 smithi086 ceph-mon[35163]: pgmap v1523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:54.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:54 smithi159 ceph-mon[36109]: pgmap v1523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:54.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:54 smithi055 ceph-mon[31863]: pgmap v1523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:55.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1806 sec 2024-03-28T06:18:56.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1807 sec 2024-03-28T06:18:56.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:56 smithi086 ceph-mon[35163]: pgmap v1524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:18:56.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:56 smithi159 ceph-mon[36109]: pgmap v1524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:18:56.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:56 smithi055 ceph-mon[31863]: pgmap v1524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:18:57.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1808 sec 2024-03-28T06:18:58.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1809 sec 2024-03-28T06:18:58.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:58 smithi086 ceph-mon[35163]: pgmap v1525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:58.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:18:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1137.798637 secs 2024-03-28T06:18:58.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:58 smithi159 ceph-mon[36109]: pgmap v1525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:58.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:18:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1137.798637 secs 2024-03-28T06:18:58.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:58 smithi055 ceph-mon[31863]: pgmap v1525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:18:58.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:18:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1137.798637 secs 2024-03-28T06:18:59.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1810 sec 2024-03-28T06:19:00.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1811 sec 2024-03-28T06:19:00.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:00 smithi086 ceph-mon[35163]: pgmap v1526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:19:00.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:00 smithi159 ceph-mon[36109]: pgmap v1526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:19:00.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:00 smithi055 ceph-mon[31863]: pgmap v1526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:19:01.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1812 sec 2024-03-28T06:19:02.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1813 sec 2024-03-28T06:19:02.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:02 smithi086 ceph-mon[35163]: pgmap v1527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:19:02.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:02 smithi159 ceph-mon[36109]: pgmap v1527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:19:02.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:02 smithi055 ceph-mon[31863]: pgmap v1527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:19:03.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1814 sec 2024-03-28T06:19:03.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1142.798759 secs 2024-03-28T06:19:03.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1142.798759 secs 2024-03-28T06:19:03.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1142.798759 secs 2024-03-28T06:19:04.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1815 sec 2024-03-28T06:19:04.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:04 smithi086 ceph-mon[35163]: pgmap v1528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:04.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:04 smithi159 ceph-mon[36109]: pgmap v1528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:04.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:04 smithi055 ceph-mon[31863]: pgmap v1528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:05.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1816 sec 2024-03-28T06:19:06.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1817 sec 2024-03-28T06:19:06.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:06 smithi086 ceph-mon[35163]: pgmap v1529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:06.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:06 smithi159 ceph-mon[36109]: pgmap v1529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:06.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:06 smithi055 ceph-mon[31863]: pgmap v1529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:07.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1818 sec 2024-03-28T06:19:08.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1819 sec 2024-03-28T06:19:08.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:08 smithi086 ceph-mon[35163]: pgmap v1530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:08.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1147.798835 secs 2024-03-28T06:19:08.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:08 smithi159 ceph-mon[36109]: pgmap v1530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:08.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1147.798835 secs 2024-03-28T06:19:08.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:08 smithi055 ceph-mon[31863]: pgmap v1530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:08.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1147.798835 secs 2024-03-28T06:19:09.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1820 sec 2024-03-28T06:19:10.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1821 sec 2024-03-28T06:19:10.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:10 smithi086 ceph-mon[35163]: pgmap v1531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:10.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:10 smithi159 ceph-mon[36109]: pgmap v1531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:10.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:10 smithi055 ceph-mon[31863]: pgmap v1531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:11.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1822 sec 2024-03-28T06:19:12.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1823 sec 2024-03-28T06:19:12.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:12 smithi086 ceph-mon[35163]: pgmap v1532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:12.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:12 smithi159 ceph-mon[36109]: pgmap v1532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:12.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:12 smithi055 ceph-mon[31863]: pgmap v1532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:13.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1824 sec 2024-03-28T06:19:13.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1152.798919 secs 2024-03-28T06:19:13.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1152.798919 secs 2024-03-28T06:19:13.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1152.798919 secs 2024-03-28T06:19:14.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1825 sec 2024-03-28T06:19:14.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:14 smithi055 ceph-mon[31863]: pgmap v1533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:14.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:14 smithi086 ceph-mon[35163]: pgmap v1533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:14.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:14 smithi159 ceph-mon[36109]: pgmap v1533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:15.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1826 sec 2024-03-28T06:19:16.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1827 sec 2024-03-28T06:19:16.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:16 smithi055 ceph-mon[31863]: pgmap v1534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:16.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:16 smithi086 ceph-mon[35163]: pgmap v1534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:16.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:16 smithi159 ceph-mon[36109]: pgmap v1534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:17.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1828 sec 2024-03-28T06:19:18.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1829 sec 2024-03-28T06:19:18.609 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:18 smithi159 ceph-mon[36109]: pgmap v1535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:18.609 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1157.799041 secs 2024-03-28T06:19:18.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:18 smithi055 ceph-mon[31863]: pgmap v1535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:18.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1157.799041 secs 2024-03-28T06:19:18.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:18 smithi086 ceph-mon[35163]: pgmap v1535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:18.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1157.799041 secs 2024-03-28T06:19:19.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1830 sec 2024-03-28T06:19:20.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1831 sec 2024-03-28T06:19:20.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:20 smithi055 ceph-mon[31863]: pgmap v1536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:20.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:20 smithi086 ceph-mon[35163]: pgmap v1536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:20.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:20 smithi159 ceph-mon[36109]: pgmap v1536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:21.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1832 sec 2024-03-28T06:19:22.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1833 sec 2024-03-28T06:19:22.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:22 smithi055 ceph-mon[31863]: pgmap v1537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:22.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:22 smithi086 ceph-mon[35163]: pgmap v1537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:22.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:22 smithi159 ceph-mon[36109]: pgmap v1537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:23.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1834 sec 2024-03-28T06:19:23.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1162.799164 secs 2024-03-28T06:19:23.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1162.799164 secs 2024-03-28T06:19:23.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1162.799164 secs 2024-03-28T06:19:24.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1835 sec 2024-03-28T06:19:24.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:24 smithi055 ceph-mon[31863]: pgmap v1538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:24.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:24 smithi086 ceph-mon[35163]: pgmap v1538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:24.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:24 smithi159 ceph-mon[36109]: pgmap v1538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:25.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1836 sec 2024-03-28T06:19:26.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1837 sec 2024-03-28T06:19:26.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:26 smithi086 ceph-mon[35163]: pgmap v1539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:26.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:26 smithi159 ceph-mon[36109]: pgmap v1539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:26.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:26 smithi055 ceph-mon[31863]: pgmap v1539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:27.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1838 sec 2024-03-28T06:19:28.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1839 sec 2024-03-28T06:19:28.662 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:28 smithi055 ceph-mon[31863]: pgmap v1540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:28.663 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1167.799238 secs 2024-03-28T06:19:28.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:28 smithi086 ceph-mon[35163]: pgmap v1540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:28.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1167.799238 secs 2024-03-28T06:19:28.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:28 smithi159 ceph-mon[36109]: pgmap v1540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:28.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1167.799238 secs 2024-03-28T06:19:29.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1840 sec 2024-03-28T06:19:30.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1841 sec 2024-03-28T06:19:30.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:30 smithi086 ceph-mon[35163]: pgmap v1541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:30.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:30 smithi159 ceph-mon[36109]: pgmap v1541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:30.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:30 smithi055 ceph-mon[31863]: pgmap v1541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:31.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1842 sec 2024-03-28T06:19:32.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1843 sec 2024-03-28T06:19:32.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:32 smithi086 ceph-mon[35163]: pgmap v1542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:32.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:32 smithi159 ceph-mon[36109]: pgmap v1542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:32.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:32 smithi055 ceph-mon[31863]: pgmap v1542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:33.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1844 sec 2024-03-28T06:19:33.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1172.799314 secs 2024-03-28T06:19:33.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1172.799314 secs 2024-03-28T06:19:33.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1172.799314 secs 2024-03-28T06:19:34.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1845 sec 2024-03-28T06:19:34.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:34 smithi086 ceph-mon[35163]: pgmap v1543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:34.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:34 smithi159 ceph-mon[36109]: pgmap v1543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:34.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:34 smithi055 ceph-mon[31863]: pgmap v1543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:35.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1846 sec 2024-03-28T06:19:36.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1847 sec 2024-03-28T06:19:36.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:36 smithi086 ceph-mon[35163]: pgmap v1544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:36.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:36 smithi159 ceph-mon[36109]: pgmap v1544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:36.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:36 smithi055 ceph-mon[31863]: pgmap v1544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:37.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1848 sec 2024-03-28T06:19:38.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1849 sec 2024-03-28T06:19:38.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:38 smithi086 ceph-mon[35163]: pgmap v1545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:38.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1177.799435 secs 2024-03-28T06:19:38.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:38 smithi159 ceph-mon[36109]: pgmap v1545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:38.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1177.799435 secs 2024-03-28T06:19:38.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:38 smithi055 ceph-mon[31863]: pgmap v1545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:38.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1177.799435 secs 2024-03-28T06:19:39.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1850 sec 2024-03-28T06:19:40.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1851 sec 2024-03-28T06:19:40.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:40 smithi086 ceph-mon[35163]: pgmap v1546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:40.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:40 smithi159 ceph-mon[36109]: pgmap v1546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:40.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:40 smithi055 ceph-mon[31863]: pgmap v1546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:41.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1852 sec 2024-03-28T06:19:42.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1853 sec 2024-03-28T06:19:42.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:42 smithi086 ceph-mon[35163]: pgmap v1547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:42.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:42 smithi159 ceph-mon[36109]: pgmap v1547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:42.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:42 smithi055 ceph-mon[31863]: pgmap v1547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:43.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1854 sec 2024-03-28T06:19:43.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1182.799554 secs 2024-03-28T06:19:43.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1182.799554 secs 2024-03-28T06:19:43.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1182.799554 secs 2024-03-28T06:19:44.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1855 sec 2024-03-28T06:19:44.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:44 smithi086 ceph-mon[35163]: pgmap v1548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:44.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:44 smithi159 ceph-mon[36109]: pgmap v1548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:44.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:44 smithi055 ceph-mon[31863]: pgmap v1548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:45.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1856 sec 2024-03-28T06:19:46.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1857 sec 2024-03-28T06:19:46.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:46 smithi086 ceph-mon[35163]: pgmap v1549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:46.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:46 smithi159 ceph-mon[36109]: pgmap v1549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:46.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:46 smithi055 ceph-mon[31863]: pgmap v1549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:19:47.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1858 sec 2024-03-28T06:19:48.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1859 sec 2024-03-28T06:19:48.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:48 smithi086 ceph-mon[35163]: pgmap v1550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:48.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1187.799667 secs 2024-03-28T06:19:48.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:48 smithi159 ceph-mon[36109]: pgmap v1550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:48.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1187.799667 secs 2024-03-28T06:19:48.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:48 smithi055 ceph-mon[31863]: pgmap v1550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:19:48.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1187.799667 secs 2024-03-28T06:19:49.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1860 sec 2024-03-28T06:19:50.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1861 sec 2024-03-28T06:19:50.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:50 smithi086 ceph-mon[35163]: pgmap v1551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:50.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:50 smithi159 ceph-mon[36109]: pgmap v1551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:50.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:50 smithi055 ceph-mon[31863]: pgmap v1551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:51.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1862 sec 2024-03-28T06:19:52.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1863 sec 2024-03-28T06:19:52.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:52 smithi086 ceph-mon[35163]: pgmap v1552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:52.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:19:52.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:52 smithi159 ceph-mon[36109]: pgmap v1552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:52.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:19:52.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:52 smithi055 ceph-mon[31863]: pgmap v1552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:52.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:19:53.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1864 sec 2024-03-28T06:19:53.804 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1192.799722 secs 2024-03-28T06:19:53.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:19:53.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:19:53.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: pgmap v1553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: pgmap v1554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.805 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:19:53.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1192.799722 secs 2024-03-28T06:19:53.806 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:19:53.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:19:53.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: pgmap v1553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: pgmap v1554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.807 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:19:53.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1192.799722 secs 2024-03-28T06:19:53.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:19:53.859 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:19:53.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: pgmap v1553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: pgmap v1554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:53.860 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:19:54.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1865 sec 2024-03-28T06:19:55.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1866 sec 2024-03-28T06:19:56.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:56 smithi086 ceph-mon[35163]: pgmap v1555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:19:56.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:56 smithi159 ceph-mon[36109]: pgmap v1555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:19:56.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:56 smithi055 ceph-mon[31863]: pgmap v1555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:19:56.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1867 sec 2024-03-28T06:19:57.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1868 sec 2024-03-28T06:19:58.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:58 smithi086 ceph-mon[35163]: pgmap v1556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:58.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:19:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1197.799851 secs 2024-03-28T06:19:58.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:58 smithi159 ceph-mon[36109]: pgmap v1556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:58.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:19:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1197.799851 secs 2024-03-28T06:19:58.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:58 smithi055 ceph-mon[31863]: pgmap v1556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:19:58.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:19:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1197.799851 secs 2024-03-28T06:19:58.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1869 sec 2024-03-28T06:19:59.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1870 sec 2024-03-28T06:20:00.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:00 smithi086 ceph-mon[35163]: pgmap v1557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:00.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:20:00.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:00 smithi159 ceph-mon[36109]: pgmap v1557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:00.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:20:00.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:00 smithi055 ceph-mon[31863]: pgmap v1557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:00.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:20:00.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1871 sec 2024-03-28T06:20:01.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1872 sec 2024-03-28T06:20:02.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:02 smithi055 ceph-mon[31863]: pgmap v1558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:02.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1873 sec 2024-03-28T06:20:02.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:02 smithi086 ceph-mon[35163]: pgmap v1558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:02.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:02 smithi159 ceph-mon[36109]: pgmap v1558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:03.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1202.799975 secs 2024-03-28T06:20:03.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1874 sec 2024-03-28T06:20:03.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1202.799975 secs 2024-03-28T06:20:03.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1202.799975 secs 2024-03-28T06:20:04.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:04 smithi055 ceph-mon[31863]: pgmap v1559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:20:04.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1875 sec 2024-03-28T06:20:04.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:04 smithi086 ceph-mon[35163]: pgmap v1559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:20:04.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:04 smithi159 ceph-mon[36109]: pgmap v1559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:20:05.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1876 sec 2024-03-28T06:20:06.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:06 smithi055 ceph-mon[31863]: pgmap v1560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:06.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1877 sec 2024-03-28T06:20:06.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:06 smithi086 ceph-mon[35163]: pgmap v1560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:06.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:06 smithi159 ceph-mon[36109]: pgmap v1560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:07.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1878 sec 2024-03-28T06:20:08.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:08 smithi055 ceph-mon[31863]: pgmap v1561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:08.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1207.800092 secs 2024-03-28T06:20:08.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1879 sec 2024-03-28T06:20:08.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:08 smithi086 ceph-mon[35163]: pgmap v1561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:08.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1207.800092 secs 2024-03-28T06:20:08.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:08 smithi159 ceph-mon[36109]: pgmap v1561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:08.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1207.800092 secs 2024-03-28T06:20:09.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1880 sec 2024-03-28T06:20:10.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:10 smithi055 ceph-mon[31863]: pgmap v1562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:10.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1881 sec 2024-03-28T06:20:10.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:10 smithi086 ceph-mon[35163]: pgmap v1562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:10.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:10 smithi159 ceph-mon[36109]: pgmap v1562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:11.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1882 sec 2024-03-28T06:20:12.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:12 smithi055 ceph-mon[31863]: pgmap v1563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:12.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1883 sec 2024-03-28T06:20:12.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:12 smithi086 ceph-mon[35163]: pgmap v1563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:12.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:12 smithi159 ceph-mon[36109]: pgmap v1563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:13.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1884 sec 2024-03-28T06:20:13.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1212.800212 secs 2024-03-28T06:20:13.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1212.800212 secs 2024-03-28T06:20:13.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1212.800212 secs 2024-03-28T06:20:14.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1885 sec 2024-03-28T06:20:14.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:14 smithi086 ceph-mon[35163]: pgmap v1564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:14.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:14 smithi159 ceph-mon[36109]: pgmap v1564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:14.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:14 smithi055 ceph-mon[31863]: pgmap v1564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:15.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1886 sec 2024-03-28T06:20:16.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1887 sec 2024-03-28T06:20:16.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:16 smithi086 ceph-mon[35163]: pgmap v1565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:16.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:16 smithi159 ceph-mon[36109]: pgmap v1565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:16.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:16 smithi055 ceph-mon[31863]: pgmap v1565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:17.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1888 sec 2024-03-28T06:20:18.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1889 sec 2024-03-28T06:20:18.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:18 smithi086 ceph-mon[35163]: pgmap v1566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:18.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1217.800333 secs 2024-03-28T06:20:18.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:18 smithi159 ceph-mon[36109]: pgmap v1566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:18.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1217.800333 secs 2024-03-28T06:20:18.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:18 smithi055 ceph-mon[31863]: pgmap v1566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:18.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1217.800333 secs 2024-03-28T06:20:19.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1890 sec 2024-03-28T06:20:20.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1891 sec 2024-03-28T06:20:20.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:20 smithi086 ceph-mon[35163]: pgmap v1567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:20.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:20 smithi159 ceph-mon[36109]: pgmap v1567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:20.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:20 smithi055 ceph-mon[31863]: pgmap v1567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:21.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1892 sec 2024-03-28T06:20:22.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1893 sec 2024-03-28T06:20:22.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:22 smithi086 ceph-mon[35163]: pgmap v1568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:22.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:22 smithi159 ceph-mon[36109]: pgmap v1568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:22.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:22 smithi055 ceph-mon[31863]: pgmap v1568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:23.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1894 sec 2024-03-28T06:20:23.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1222.800413 secs 2024-03-28T06:20:23.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1222.800413 secs 2024-03-28T06:20:23.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1222.800413 secs 2024-03-28T06:20:24.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1895 sec 2024-03-28T06:20:24.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:24 smithi086 ceph-mon[35163]: pgmap v1569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:24.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:24 smithi159 ceph-mon[36109]: pgmap v1569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:24.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:24 smithi055 ceph-mon[31863]: pgmap v1569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:25.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1896 sec 2024-03-28T06:20:26.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1897 sec 2024-03-28T06:20:26.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:26 smithi086 ceph-mon[35163]: pgmap v1570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:26.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:26 smithi159 ceph-mon[36109]: pgmap v1570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:26.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:26 smithi055 ceph-mon[31863]: pgmap v1570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:27.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1898 sec 2024-03-28T06:20:28.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1899 sec 2024-03-28T06:20:28.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:28 smithi086 ceph-mon[35163]: pgmap v1571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:28.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1227.800535 secs 2024-03-28T06:20:28.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:28 smithi159 ceph-mon[36109]: pgmap v1571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:28.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1227.800535 secs 2024-03-28T06:20:28.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:28 smithi055 ceph-mon[31863]: pgmap v1571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:28.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1227.800535 secs 2024-03-28T06:20:29.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1900 sec 2024-03-28T06:20:29.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:29 smithi086 ceph-mon[35163]: pgmap v1572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:29.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:29 smithi159 ceph-mon[36109]: pgmap v1572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:29.609 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:29 smithi055 ceph-mon[31863]: pgmap v1572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:30.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1901 sec 2024-03-28T06:20:31.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1902 sec 2024-03-28T06:20:32.304 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:32 smithi086 ceph-mon[35163]: pgmap v1573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:32.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:32 smithi159 ceph-mon[36109]: pgmap v1573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:32.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:32 smithi055 ceph-mon[31863]: pgmap v1573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:32.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1903 sec 2024-03-28T06:20:33.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1232.800660 secs 2024-03-28T06:20:33.306 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1232.800660 secs 2024-03-28T06:20:33.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1232.800660 secs 2024-03-28T06:20:33.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1904 sec 2024-03-28T06:20:34.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:34 smithi159 ceph-mon[36109]: pgmap v1574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:34.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:34 smithi055 ceph-mon[31863]: pgmap v1574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:34.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1905 sec 2024-03-28T06:20:34.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:34 smithi086 ceph-mon[35163]: pgmap v1574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:35.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1906 sec 2024-03-28T06:20:36.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:36 smithi055 ceph-mon[31863]: pgmap v1575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:36.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1907 sec 2024-03-28T06:20:36.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:36 smithi086 ceph-mon[35163]: pgmap v1575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:36.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:36 smithi159 ceph-mon[36109]: pgmap v1575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:37.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1908 sec 2024-03-28T06:20:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:38 smithi055 ceph-mon[31863]: pgmap v1576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:38.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1237.800797 secs 2024-03-28T06:20:38.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1909 sec 2024-03-28T06:20:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:38 smithi086 ceph-mon[35163]: pgmap v1576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:38.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1237.800797 secs 2024-03-28T06:20:38.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:38 smithi159 ceph-mon[36109]: pgmap v1576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:38.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1237.800797 secs 2024-03-28T06:20:39.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1910 sec 2024-03-28T06:20:40.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:40 smithi055 ceph-mon[31863]: pgmap v1577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:40.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1911 sec 2024-03-28T06:20:40.554 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:40 smithi086 ceph-mon[35163]: pgmap v1577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:40.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:40 smithi159 ceph-mon[36109]: pgmap v1577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:41.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1912 sec 2024-03-28T06:20:42.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:42 smithi055 ceph-mon[31863]: pgmap v1578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:42.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1913 sec 2024-03-28T06:20:42.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:42 smithi086 ceph-mon[35163]: pgmap v1578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:42.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:42 smithi159 ceph-mon[36109]: pgmap v1578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:43.359 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1242.800915 secs 2024-03-28T06:20:43.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1914 sec 2024-03-28T06:20:43.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1242.800915 secs 2024-03-28T06:20:43.556 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1242.800915 secs 2024-03-28T06:20:44.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1915 sec 2024-03-28T06:20:44.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:44 smithi086 ceph-mon[35163]: pgmap v1579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:44.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:44 smithi159 ceph-mon[36109]: pgmap v1579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:44.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:44 smithi055 ceph-mon[31863]: pgmap v1579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:45.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1916 sec 2024-03-28T06:20:46.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1917 sec 2024-03-28T06:20:46.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:46 smithi086 ceph-mon[35163]: pgmap v1580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:46.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:46 smithi159 ceph-mon[36109]: pgmap v1580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:46.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:46 smithi055 ceph-mon[31863]: pgmap v1580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:47.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1918 sec 2024-03-28T06:20:48.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1919 sec 2024-03-28T06:20:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:48 smithi086 ceph-mon[35163]: pgmap v1581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:48.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1247.801023 secs 2024-03-28T06:20:48.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:48 smithi159 ceph-mon[36109]: pgmap v1581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:48.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1247.801023 secs 2024-03-28T06:20:48.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:48 smithi055 ceph-mon[31863]: pgmap v1581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:48.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1247.801023 secs 2024-03-28T06:20:49.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1920 sec 2024-03-28T06:20:50.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1921 sec 2024-03-28T06:20:50.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:50 smithi086 ceph-mon[35163]: pgmap v1582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:50.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:50 smithi159 ceph-mon[36109]: pgmap v1582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:50.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:50 smithi055 ceph-mon[31863]: pgmap v1582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:51.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1922 sec 2024-03-28T06:20:52.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1923 sec 2024-03-28T06:20:52.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:52 smithi086 ceph-mon[35163]: pgmap v1583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:52.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:52 smithi159 ceph-mon[36109]: pgmap v1583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:52.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:52 smithi055 ceph-mon[31863]: pgmap v1583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:53.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1924 sec 2024-03-28T06:20:53.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1252.801118 secs 2024-03-28T06:20:53.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1252.801118 secs 2024-03-28T06:20:53.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1252.801118 secs 2024-03-28T06:20:54.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1925 sec 2024-03-28T06:20:54.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:54 smithi086 ceph-mon[35163]: pgmap v1584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:54.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:20:54.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:54 smithi159 ceph-mon[36109]: pgmap v1584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:54.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:20:54.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:54 smithi055 ceph-mon[31863]: pgmap v1584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:54.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:20:55.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1926 sec 2024-03-28T06:20:55.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:20:55.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:20:55.556 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:20:55.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:20:55.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:20:55.558 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:20:55.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:20:55.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:20:55.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:20:56.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1927 sec 2024-03-28T06:20:56.456 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:56 smithi086 ceph-mon[35163]: pgmap v1585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:56.457 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:56 smithi086 ceph-mon[35163]: pgmap v1586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:56.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:56 smithi159 ceph-mon[36109]: pgmap v1585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:56.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:56 smithi159 ceph-mon[36109]: pgmap v1586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:56.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:56 smithi055 ceph-mon[31863]: pgmap v1585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:20:56.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:56 smithi055 ceph-mon[31863]: pgmap v1586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:57.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1928 sec 2024-03-28T06:20:58.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1929 sec 2024-03-28T06:20:58.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:58 smithi086 ceph-mon[35163]: pgmap v1587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:58.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1257.801199 secs 2024-03-28T06:20:58.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:58 smithi159 ceph-mon[36109]: pgmap v1587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:58.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1257.801199 secs 2024-03-28T06:20:58.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:58 smithi055 ceph-mon[31863]: pgmap v1587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:20:58.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1257.801199 secs 2024-03-28T06:20:59.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1930 sec 2024-03-28T06:21:00.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1931 sec 2024-03-28T06:21:00.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:00 smithi086 ceph-mon[35163]: pgmap v1588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:00.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:00 smithi159 ceph-mon[36109]: pgmap v1588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:00.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:00 smithi055 ceph-mon[31863]: pgmap v1588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:01.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1932 sec 2024-03-28T06:21:01.555 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:01 smithi086 ceph-mon[35163]: pgmap v1589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:01.557 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:01 smithi159 ceph-mon[36109]: pgmap v1589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:01.610 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:01 smithi055 ceph-mon[31863]: pgmap v1589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:02.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1933 sec 2024-03-28T06:21:03.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1262.801323 secs 2024-03-28T06:21:03.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1262.801323 secs 2024-03-28T06:21:03.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1262.801323 secs 2024-03-28T06:21:03.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1934 sec 2024-03-28T06:21:04.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:03 smithi086 ceph-mon[35163]: pgmap v1590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:21:04.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:03 smithi159 ceph-mon[36109]: pgmap v1590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:21:04.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:03 smithi055 ceph-mon[31863]: pgmap v1590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:21:04.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1935 sec 2024-03-28T06:21:05.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1936 sec 2024-03-28T06:21:06.055 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:05 smithi086 ceph-mon[35163]: pgmap v1591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:06.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:05 smithi159 ceph-mon[36109]: pgmap v1591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:06.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:05 smithi055 ceph-mon[31863]: pgmap v1591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:06.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1937 sec 2024-03-28T06:21:07.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1938 sec 2024-03-28T06:21:08.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:07 smithi086 ceph-mon[35163]: pgmap v1592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:08.056 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1267.801438 secs 2024-03-28T06:21:08.057 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:07 smithi159 ceph-mon[36109]: pgmap v1592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:08.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1267.801438 secs 2024-03-28T06:21:08.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:07 smithi055 ceph-mon[31863]: pgmap v1592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:08.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1267.801438 secs 2024-03-28T06:21:08.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1939 sec 2024-03-28T06:21:09.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1940 sec 2024-03-28T06:21:10.058 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:09 smithi159 ceph-mon[36109]: pgmap v1593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:10.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:09 smithi055 ceph-mon[31863]: pgmap v1593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:10.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:09 smithi086 ceph-mon[35163]: pgmap v1593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:10.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1941 sec 2024-03-28T06:21:11.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1942 sec 2024-03-28T06:21:12.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:11 smithi055 ceph-mon[31863]: pgmap v1594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:12.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:11 smithi086 ceph-mon[35163]: pgmap v1594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:12.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:11 smithi159 ceph-mon[36109]: pgmap v1594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:21:12.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1943 sec 2024-03-28T06:21:13.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1272.801518 secs 2024-03-28T06:21:13.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1272.801518 secs 2024-03-28T06:21:13.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1272.801518 secs 2024-03-28T06:21:13.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1944 sec 2024-03-28T06:21:14.110 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:13 smithi055 ceph-mon[31863]: pgmap v1595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:14.305 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:13 smithi086 ceph-mon[35163]: pgmap v1595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:14.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:13 smithi159 ceph-mon[36109]: pgmap v1595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:14.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1945 sec 2024-03-28T06:21:15.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1946 sec 2024-03-28T06:21:16.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:15 smithi055 ceph-mon[31863]: pgmap v1596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:16.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:15 smithi086 ceph-mon[35163]: pgmap v1596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:16.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:15 smithi159 ceph-mon[36109]: pgmap v1596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:16.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1947 sec 2024-03-28T06:21:17.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1948 sec 2024-03-28T06:21:18.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:17 smithi055 ceph-mon[31863]: pgmap v1597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:18.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1277.801593 secs 2024-03-28T06:21:18.111 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:17 smithi159 ceph-mon[36109]: pgmap v1597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:18.111 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1277.801593 secs 2024-03-28T06:21:18.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:17 smithi086 ceph-mon[35163]: pgmap v1597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:18.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1277.801593 secs 2024-03-28T06:21:18.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1949 sec 2024-03-28T06:21:19.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1950 sec 2024-03-28T06:21:20.111 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:19 smithi055 ceph-mon[31863]: pgmap v1598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:20.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:19 smithi086 ceph-mon[35163]: pgmap v1598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:20.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:19 smithi159 ceph-mon[36109]: pgmap v1598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:20.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1951 sec 2024-03-28T06:21:21.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1952 sec 2024-03-28T06:21:22.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:21 smithi086 ceph-mon[35163]: pgmap v1599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:22.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:21 smithi159 ceph-mon[36109]: pgmap v1599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:22.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:21 smithi055 ceph-mon[31863]: pgmap v1599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:22.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1953 sec 2024-03-28T06:21:23.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1282.801705 secs 2024-03-28T06:21:23.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1282.801705 secs 2024-03-28T06:21:23.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1282.801705 secs 2024-03-28T06:21:23.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1954 sec 2024-03-28T06:21:24.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:23 smithi086 ceph-mon[35163]: pgmap v1600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:24.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:23 smithi159 ceph-mon[36109]: pgmap v1600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:24.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:23 smithi055 ceph-mon[31863]: pgmap v1600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:24.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1955 sec 2024-03-28T06:21:25.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1956 sec 2024-03-28T06:21:26.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:25 smithi086 ceph-mon[35163]: pgmap v1601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:26.307 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:25 smithi159 ceph-mon[36109]: pgmap v1601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:26.360 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:25 smithi055 ceph-mon[31863]: pgmap v1601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:26.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1957 sec 2024-03-28T06:21:27.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1958 sec 2024-03-28T06:21:28.164 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:27 smithi055 ceph-mon[31863]: pgmap v1602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:28.164 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1287.801829 secs 2024-03-28T06:21:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:27 smithi086 ceph-mon[35163]: pgmap v1602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:28.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1287.801829 secs 2024-03-28T06:21:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:27 smithi159 ceph-mon[36109]: pgmap v1602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:28.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1287.801829 secs 2024-03-28T06:21:28.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1959 sec 2024-03-28T06:21:29.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1960 sec 2024-03-28T06:21:30.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:29 smithi086 ceph-mon[35163]: pgmap v1603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:30.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:29 smithi159 ceph-mon[36109]: pgmap v1603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:30.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:29 smithi055 ceph-mon[31863]: pgmap v1603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:30.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1961 sec 2024-03-28T06:21:31.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1962 sec 2024-03-28T06:21:32.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:31 smithi086 ceph-mon[35163]: pgmap v1604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:32.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:31 smithi159 ceph-mon[36109]: pgmap v1604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:32.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:31 smithi055 ceph-mon[31863]: pgmap v1604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:32.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1963 sec 2024-03-28T06:21:33.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1292.801910 secs 2024-03-28T06:21:33.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1292.801910 secs 2024-03-28T06:21:33.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1292.801910 secs 2024-03-28T06:21:33.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1964 sec 2024-03-28T06:21:34.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:33 smithi086 ceph-mon[35163]: pgmap v1605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:34.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:33 smithi159 ceph-mon[36109]: pgmap v1605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:34.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:33 smithi055 ceph-mon[31863]: pgmap v1605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:34.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1965 sec 2024-03-28T06:21:35.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1966 sec 2024-03-28T06:21:36.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:35 smithi086 ceph-mon[35163]: pgmap v1606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:36.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:35 smithi159 ceph-mon[36109]: pgmap v1606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:36.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:35 smithi055 ceph-mon[31863]: pgmap v1606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:36.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1967 sec 2024-03-28T06:21:37.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1968 sec 2024-03-28T06:21:38.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:37 smithi086 ceph-mon[35163]: pgmap v1607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:38.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1297.802011 secs 2024-03-28T06:21:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:37 smithi159 ceph-mon[36109]: pgmap v1607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:38.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1297.802011 secs 2024-03-28T06:21:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:37 smithi055 ceph-mon[31863]: pgmap v1607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:38.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1297.802011 secs 2024-03-28T06:21:38.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1969 sec 2024-03-28T06:21:39.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1970 sec 2024-03-28T06:21:40.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:39 smithi086 ceph-mon[35163]: pgmap v1608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:40.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:39 smithi159 ceph-mon[36109]: pgmap v1608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:40.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:39 smithi055 ceph-mon[31863]: pgmap v1608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:40.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1971 sec 2024-03-28T06:21:41.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1972 sec 2024-03-28T06:21:42.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:41 smithi086 ceph-mon[35163]: pgmap v1609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:42.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:41 smithi159 ceph-mon[36109]: pgmap v1609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:42.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:41 smithi055 ceph-mon[31863]: pgmap v1609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:42.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1973 sec 2024-03-28T06:21:43.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1302.802056 secs 2024-03-28T06:21:43.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1302.802056 secs 2024-03-28T06:21:43.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1302.802056 secs 2024-03-28T06:21:43.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1974 sec 2024-03-28T06:21:44.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:44 smithi086 ceph-mon[35163]: pgmap v1610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:44.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:44 smithi159 ceph-mon[36109]: pgmap v1610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:44.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:44 smithi055 ceph-mon[31863]: pgmap v1610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:44.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1975 sec 2024-03-28T06:21:45.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1976 sec 2024-03-28T06:21:46.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:46 smithi086 ceph-mon[35163]: pgmap v1611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:46.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:46 smithi159 ceph-mon[36109]: pgmap v1611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:46.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:46 smithi055 ceph-mon[31863]: pgmap v1611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:21:46.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1977 sec 2024-03-28T06:21:47.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1978 sec 2024-03-28T06:21:48.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:48 smithi086 ceph-mon[35163]: pgmap v1612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:48.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1307.802182 secs 2024-03-28T06:21:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:48 smithi159 ceph-mon[36109]: pgmap v1612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:48.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1307.802182 secs 2024-03-28T06:21:48.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:48 smithi055 ceph-mon[31863]: pgmap v1612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:21:48.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1307.802182 secs 2024-03-28T06:21:48.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1979 sec 2024-03-28T06:21:49.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1980 sec 2024-03-28T06:21:50.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:50 smithi086 ceph-mon[35163]: pgmap v1613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:50.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:50 smithi159 ceph-mon[36109]: pgmap v1613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:50.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:50 smithi055 ceph-mon[31863]: pgmap v1613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:50.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1981 sec 2024-03-28T06:21:51.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1982 sec 2024-03-28T06:21:52.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:52 smithi086 ceph-mon[35163]: pgmap v1614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:52.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:52 smithi159 ceph-mon[36109]: pgmap v1614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:52.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:52 smithi055 ceph-mon[31863]: pgmap v1614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:52.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1983 sec 2024-03-28T06:21:53.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1312.802303 secs 2024-03-28T06:21:53.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1312.802303 secs 2024-03-28T06:21:53.361 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1312.802303 secs 2024-03-28T06:21:53.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1984 sec 2024-03-28T06:21:54.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:54 smithi086 ceph-mon[35163]: pgmap v1615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:54.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:54 smithi159 ceph-mon[36109]: pgmap v1615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:54.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:54 smithi055 ceph-mon[31863]: pgmap v1615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:21:54.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1985 sec 2024-03-28T06:21:55.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1986 sec 2024-03-28T06:21:56.306 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:56 smithi086 ceph-mon[35163]: pgmap v1616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:21:56.307 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:21:56.308 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:56 smithi159 ceph-mon[36109]: pgmap v1616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:21:56.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:21:56.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:56 smithi055 ceph-mon[31863]: pgmap v1616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:21:56.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:21:56.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1987 sec 2024-03-28T06:21:57.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:21:57.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:21:57.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:21:57.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1988 sec 2024-03-28T06:21:57.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:21:57.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:21:57.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:21:57.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:21:57.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:21:57.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:21:58.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:58 smithi055 ceph-mon[31863]: pgmap v1617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:21:58.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:58 smithi055 ceph-mon[31863]: pgmap v1618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:21:58.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:21:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1317.802434 secs 2024-03-28T06:21:58.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1989 sec 2024-03-28T06:21:58.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:58 smithi086 ceph-mon[35163]: pgmap v1617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:21:58.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:58 smithi086 ceph-mon[35163]: pgmap v1618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:21:58.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:21:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1317.802434 secs 2024-03-28T06:21:58.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:58 smithi159 ceph-mon[36109]: pgmap v1617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:21:58.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:58 smithi159 ceph-mon[36109]: pgmap v1618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:21:58.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:21:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1317.802434 secs 2024-03-28T06:21:59.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1990 sec 2024-03-28T06:22:00.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:00 smithi055 ceph-mon[31863]: pgmap v1619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:00.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1991 sec 2024-03-28T06:22:00.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:00 smithi086 ceph-mon[35163]: pgmap v1619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:00.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:00 smithi159 ceph-mon[36109]: pgmap v1619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:01.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1992 sec 2024-03-28T06:22:02.309 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:02 smithi159 ceph-mon[36109]: pgmap v1620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:02.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:02 smithi055 ceph-mon[31863]: pgmap v1620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:02.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1993 sec 2024-03-28T06:22:02.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:02 smithi086 ceph-mon[35163]: pgmap v1620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:03.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1322.802553 secs 2024-03-28T06:22:03.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1994 sec 2024-03-28T06:22:03.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1322.802553 secs 2024-03-28T06:22:03.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1322.802553 secs 2024-03-28T06:22:04.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:04 smithi055 ceph-mon[31863]: pgmap v1621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:22:04.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1995 sec 2024-03-28T06:22:04.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:04 smithi086 ceph-mon[35163]: pgmap v1621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:22:04.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:04 smithi159 ceph-mon[36109]: pgmap v1621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:22:05.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1996 sec 2024-03-28T06:22:06.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:06 smithi055 ceph-mon[31863]: pgmap v1622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:06.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1997 sec 2024-03-28T06:22:06.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:06 smithi086 ceph-mon[35163]: pgmap v1622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:06.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:06 smithi159 ceph-mon[36109]: pgmap v1622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:07.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1998 sec 2024-03-28T06:22:08.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:08 smithi055 ceph-mon[31863]: pgmap v1623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:08.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1327.802627 secs 2024-03-28T06:22:08.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 1999 sec 2024-03-28T06:22:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:08 smithi086 ceph-mon[35163]: pgmap v1623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:08.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1327.802627 secs 2024-03-28T06:22:08.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:08 smithi159 ceph-mon[36109]: pgmap v1623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:08.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1327.802627 secs 2024-03-28T06:22:09.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2000 sec 2024-03-28T06:22:10.362 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:10 smithi055 ceph-mon[31863]: pgmap v1624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:10.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2001 sec 2024-03-28T06:22:10.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:10 smithi086 ceph-mon[35163]: pgmap v1624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:10.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:10 smithi159 ceph-mon[36109]: pgmap v1624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:11.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2002 sec 2024-03-28T06:22:12.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2003 sec 2024-03-28T06:22:12.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:12 smithi086 ceph-mon[35163]: pgmap v1625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:12.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:12 smithi159 ceph-mon[36109]: pgmap v1625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:12.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:12 smithi055 ceph-mon[31863]: pgmap v1625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:13.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2004 sec 2024-03-28T06:22:13.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1332.802712 secs 2024-03-28T06:22:13.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1332.802712 secs 2024-03-28T06:22:13.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1332.802712 secs 2024-03-28T06:22:14.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2005 sec 2024-03-28T06:22:14.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:14 smithi086 ceph-mon[35163]: pgmap v1626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:14.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:14 smithi159 ceph-mon[36109]: pgmap v1626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:14.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:14 smithi055 ceph-mon[31863]: pgmap v1626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:15.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2006 sec 2024-03-28T06:22:16.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2007 sec 2024-03-28T06:22:16.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:16 smithi086 ceph-mon[35163]: pgmap v1627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:16.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:16 smithi159 ceph-mon[36109]: pgmap v1627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:16.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:16 smithi055 ceph-mon[31863]: pgmap v1627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:17.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2008 sec 2024-03-28T06:22:18.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2009 sec 2024-03-28T06:22:18.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:18 smithi086 ceph-mon[35163]: pgmap v1628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:18.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1337.802839 secs 2024-03-28T06:22:18.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:18 smithi159 ceph-mon[36109]: pgmap v1628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:18.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1337.802839 secs 2024-03-28T06:22:18.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:18 smithi055 ceph-mon[31863]: pgmap v1628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:18.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1337.802839 secs 2024-03-28T06:22:19.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2010 sec 2024-03-28T06:22:20.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:20 smithi159 ceph-mon[36109]: pgmap v1629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:20.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2011 sec 2024-03-28T06:22:20.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:20 smithi086 ceph-mon[35163]: pgmap v1629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:20.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:20 smithi055 ceph-mon[31863]: pgmap v1629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:21.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2012 sec 2024-03-28T06:22:22.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2013 sec 2024-03-28T06:22:22.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:22 smithi086 ceph-mon[35163]: pgmap v1630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:22.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:22 smithi159 ceph-mon[36109]: pgmap v1630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:22.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:22 smithi055 ceph-mon[31863]: pgmap v1630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:23.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2014 sec 2024-03-28T06:22:23.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1342.802961 secs 2024-03-28T06:22:23.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1342.802961 secs 2024-03-28T06:22:23.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1342.802961 secs 2024-03-28T06:22:24.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2015 sec 2024-03-28T06:22:24.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:24 smithi086 ceph-mon[35163]: pgmap v1631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:24.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:24 smithi159 ceph-mon[36109]: pgmap v1631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:24.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:24 smithi055 ceph-mon[31863]: pgmap v1631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:25.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2016 sec 2024-03-28T06:22:26.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2017 sec 2024-03-28T06:22:26.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:26 smithi086 ceph-mon[35163]: pgmap v1632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:26.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:26 smithi159 ceph-mon[36109]: pgmap v1632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:26.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:26 smithi055 ceph-mon[31863]: pgmap v1632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:27.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2018 sec 2024-03-28T06:22:28.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2019 sec 2024-03-28T06:22:28.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:28 smithi086 ceph-mon[35163]: pgmap v1633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:28.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1347.803081 secs 2024-03-28T06:22:28.559 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:28 smithi159 ceph-mon[36109]: pgmap v1633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:28.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1347.803081 secs 2024-03-28T06:22:28.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:28 smithi055 ceph-mon[31863]: pgmap v1633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:28.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1347.803081 secs 2024-03-28T06:22:29.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2020 sec 2024-03-28T06:22:30.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2021 sec 2024-03-28T06:22:30.557 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:30 smithi086 ceph-mon[35163]: pgmap v1634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:30.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:30 smithi159 ceph-mon[36109]: pgmap v1634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:30.613 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:30 smithi055 ceph-mon[31863]: pgmap v1634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:31.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:31 smithi159 ceph-mon[36109]: pgmap v1635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:31.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2022 sec 2024-03-28T06:22:31.558 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:31 smithi086 ceph-mon[35163]: pgmap v1635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:31.612 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:31 smithi055 ceph-mon[31863]: pgmap v1635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:22:32.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2023 sec 2024-03-28T06:22:33.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2024 sec 2024-03-28T06:22:34.057 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1352.803165 secs 2024-03-28T06:22:34.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:33 smithi086 ceph-mon[35163]: pgmap v1636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:22:34.059 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1352.803165 secs 2024-03-28T06:22:34.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:33 smithi159 ceph-mon[36109]: pgmap v1636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:22:34.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1352.803165 secs 2024-03-28T06:22:34.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:33 smithi055 ceph-mon[31863]: pgmap v1636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:22:34.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2025 sec 2024-03-28T06:22:35.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2026 sec 2024-03-28T06:22:36.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:35 smithi086 ceph-mon[35163]: pgmap v1637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:36.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:35 smithi159 ceph-mon[36109]: pgmap v1637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:36.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:35 smithi055 ceph-mon[31863]: pgmap v1637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:36.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2027 sec 2024-03-28T06:22:37.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2028 sec 2024-03-28T06:22:38.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:37 smithi086 ceph-mon[35163]: pgmap v1638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:38.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:37 smithi159 ceph-mon[36109]: pgmap v1638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:38.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:37 smithi055 ceph-mon[31863]: pgmap v1638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:22:38.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2029 sec 2024-03-28T06:22:39.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1357.803286 secs 2024-03-28T06:22:39.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1357.803286 secs 2024-03-28T06:22:39.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1357.803286 secs 2024-03-28T06:22:39.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2030 sec 2024-03-28T06:22:40.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:39 smithi086 ceph-mon[35163]: pgmap v1639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:40.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:39 smithi159 ceph-mon[36109]: pgmap v1639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:40.112 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:39 smithi055 ceph-mon[31863]: pgmap v1639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:40.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2031 sec 2024-03-28T06:22:41.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2032 sec 2024-03-28T06:22:42.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:41 smithi086 ceph-mon[35163]: pgmap v1640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:42.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:41 smithi159 ceph-mon[36109]: pgmap v1640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:42.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:41 smithi055 ceph-mon[31863]: pgmap v1640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:42.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2033 sec 2024-03-28T06:22:43.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1362.803407 secs 2024-03-28T06:22:43.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1362.803407 secs 2024-03-28T06:22:43.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1362.803407 secs 2024-03-28T06:22:43.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2034 sec 2024-03-28T06:22:44.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:43 smithi086 ceph-mon[35163]: pgmap v1641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:44.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:43 smithi159 ceph-mon[36109]: pgmap v1641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:44.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:43 smithi055 ceph-mon[31863]: pgmap v1641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:44.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2035 sec 2024-03-28T06:22:45.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2036 sec 2024-03-28T06:22:46.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:45 smithi086 ceph-mon[35163]: pgmap v1642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:46.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:45 smithi159 ceph-mon[36109]: pgmap v1642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:46.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:45 smithi055 ceph-mon[31863]: pgmap v1642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:46.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2037 sec 2024-03-28T06:22:47.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2038 sec 2024-03-28T06:22:48.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:47 smithi086 ceph-mon[35163]: pgmap v1643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:48.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1367.803493 secs 2024-03-28T06:22:48.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:47 smithi159 ceph-mon[36109]: pgmap v1643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:48.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1367.803493 secs 2024-03-28T06:22:48.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:47 smithi055 ceph-mon[31863]: pgmap v1643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:48.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1367.803493 secs 2024-03-28T06:22:48.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2039 sec 2024-03-28T06:22:49.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2040 sec 2024-03-28T06:22:50.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:49 smithi086 ceph-mon[35163]: pgmap v1644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:50.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:49 smithi159 ceph-mon[36109]: pgmap v1644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:50.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:49 smithi055 ceph-mon[31863]: pgmap v1644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:50.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2041 sec 2024-03-28T06:22:51.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2042 sec 2024-03-28T06:22:52.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:51 smithi086 ceph-mon[35163]: pgmap v1645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:52.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:51 smithi159 ceph-mon[36109]: pgmap v1645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:52.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:51 smithi055 ceph-mon[31863]: pgmap v1645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:22:52.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2043 sec 2024-03-28T06:22:53.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1372.803534 secs 2024-03-28T06:22:53.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1372.803534 secs 2024-03-28T06:22:53.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1372.803534 secs 2024-03-28T06:22:53.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2044 sec 2024-03-28T06:22:54.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:53 smithi086 ceph-mon[35163]: pgmap v1646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:54.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:53 smithi159 ceph-mon[36109]: pgmap v1646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:54.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:53 smithi055 ceph-mon[31863]: pgmap v1646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:22:54.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2045 sec 2024-03-28T06:22:55.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2046 sec 2024-03-28T06:22:56.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:55 smithi086 ceph-mon[35163]: pgmap v1647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:56.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:55 smithi159 ceph-mon[36109]: pgmap v1647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:56.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:55 smithi055 ceph-mon[31863]: pgmap v1647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:56.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2047 sec 2024-03-28T06:22:57.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2048 sec 2024-03-28T06:22:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:57 smithi086 ceph-mon[35163]: pgmap v1648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:22:58.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1377.803653 secs 2024-03-28T06:22:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:57 smithi159 ceph-mon[36109]: pgmap v1648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:22:58.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1377.803653 secs 2024-03-28T06:22:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:57 smithi055 ceph-mon[31863]: pgmap v1648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:22:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:22:58.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1377.803653 secs 2024-03-28T06:22:58.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2049 sec 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:22:59.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:22:59.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:22:59.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:22:59.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:22:59.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:22:59.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:22:59.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2050 sec 2024-03-28T06:23:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:59 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:23:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:59 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:23:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:59 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:23:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:59 smithi086 ceph-mon[35163]: pgmap v1649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:00.059 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:22:59 smithi086 ceph-mon[35163]: pgmap v1650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:00.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:59 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:23:00.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:59 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:23:00.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:59 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:23:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:59 smithi159 ceph-mon[36109]: pgmap v1649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:00.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:22:59 smithi159 ceph-mon[36109]: pgmap v1650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:00.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:59 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:23:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:59 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:23:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:59 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:23:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:59 smithi055 ceph-mon[31863]: pgmap v1649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:00.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:22:59 smithi055 ceph-mon[31863]: pgmap v1650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:00.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2051 sec 2024-03-28T06:23:01.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2052 sec 2024-03-28T06:23:02.058 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:01 smithi086 ceph-mon[35163]: pgmap v1651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:02.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:01 smithi159 ceph-mon[36109]: pgmap v1651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:02.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:01 smithi055 ceph-mon[31863]: pgmap v1651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:02.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2053 sec 2024-03-28T06:23:03.060 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1382.803771 secs 2024-03-28T06:23:03.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1382.803771 secs 2024-03-28T06:23:03.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1382.803771 secs 2024-03-28T06:23:03.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2054 sec 2024-03-28T06:23:04.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:03 smithi055 ceph-mon[31863]: pgmap v1652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:04.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:03 smithi086 ceph-mon[35163]: pgmap v1652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:04.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:03 smithi159 ceph-mon[36109]: pgmap v1652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:04.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2055 sec 2024-03-28T06:23:05.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2056 sec 2024-03-28T06:23:06.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:05 smithi055 ceph-mon[31863]: pgmap v1653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:06.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:05 smithi086 ceph-mon[35163]: pgmap v1653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:06.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:05 smithi159 ceph-mon[36109]: pgmap v1653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:06.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2057 sec 2024-03-28T06:23:07.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2058 sec 2024-03-28T06:23:08.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:07 smithi055 ceph-mon[31863]: pgmap v1654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:08.113 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1387.803834 secs 2024-03-28T06:23:08.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:07 smithi086 ceph-mon[35163]: pgmap v1654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:08.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1387.803834 secs 2024-03-28T06:23:08.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:07 smithi159 ceph-mon[36109]: pgmap v1654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:23:08.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1387.803834 secs 2024-03-28T06:23:08.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2059 sec 2024-03-28T06:23:09.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2060 sec 2024-03-28T06:23:10.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:09 smithi055 ceph-mon[31863]: pgmap v1655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:23:10.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:09 smithi086 ceph-mon[35163]: pgmap v1655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:23:10.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:09 smithi159 ceph-mon[36109]: pgmap v1655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:23:10.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2061 sec 2024-03-28T06:23:11.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2062 sec 2024-03-28T06:23:12.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:11 smithi055 ceph-mon[31863]: pgmap v1656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:12.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:11 smithi086 ceph-mon[35163]: pgmap v1656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:12.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:11 smithi159 ceph-mon[36109]: pgmap v1656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:12.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2063 sec 2024-03-28T06:23:13.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1392.803958 secs 2024-03-28T06:23:13.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1392.803958 secs 2024-03-28T06:23:13.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1392.803958 secs 2024-03-28T06:23:13.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2064 sec 2024-03-28T06:23:14.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:13 smithi086 ceph-mon[35163]: pgmap v1657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:14.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:13 smithi159 ceph-mon[36109]: pgmap v1657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:14.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:13 smithi055 ceph-mon[31863]: pgmap v1657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:14.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2065 sec 2024-03-28T06:23:15.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2066 sec 2024-03-28T06:23:16.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:15 smithi086 ceph-mon[35163]: pgmap v1658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:16.310 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:15 smithi159 ceph-mon[36109]: pgmap v1658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:16.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:15 smithi055 ceph-mon[31863]: pgmap v1658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:16.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2067 sec 2024-03-28T06:23:17.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2068 sec 2024-03-28T06:23:18.308 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:17 smithi086 ceph-mon[35163]: pgmap v1659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:18.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1397.804077 secs 2024-03-28T06:23:18.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:17 smithi159 ceph-mon[36109]: pgmap v1659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:18.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1397.804077 secs 2024-03-28T06:23:18.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:17 smithi055 ceph-mon[31863]: pgmap v1659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:18.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1397.804077 secs 2024-03-28T06:23:18.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2069 sec 2024-03-28T06:23:19.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2070 sec 2024-03-28T06:23:20.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:19 smithi086 ceph-mon[35163]: pgmap v1660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:20.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:19 smithi159 ceph-mon[36109]: pgmap v1660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:20.363 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:19 smithi055 ceph-mon[31863]: pgmap v1660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:20.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2071 sec 2024-03-28T06:23:21.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2072 sec 2024-03-28T06:23:22.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:21 smithi086 ceph-mon[35163]: pgmap v1661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:22.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:21 smithi159 ceph-mon[36109]: pgmap v1661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:22.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:21 smithi055 ceph-mon[31863]: pgmap v1661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:22.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2073 sec 2024-03-28T06:23:23.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1402.804137 secs 2024-03-28T06:23:23.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1402.804137 secs 2024-03-28T06:23:23.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1402.804137 secs 2024-03-28T06:23:23.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2074 sec 2024-03-28T06:23:24.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:23 smithi086 ceph-mon[35163]: pgmap v1662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:24.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:23 smithi159 ceph-mon[36109]: pgmap v1662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:24.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:23 smithi055 ceph-mon[31863]: pgmap v1662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:24.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2075 sec 2024-03-28T06:23:25.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2076 sec 2024-03-28T06:23:26.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:25 smithi086 ceph-mon[35163]: pgmap v1663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:26.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:25 smithi159 ceph-mon[36109]: pgmap v1663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:26.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:25 smithi055 ceph-mon[31863]: pgmap v1663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:26.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2077 sec 2024-03-28T06:23:27.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2078 sec 2024-03-28T06:23:28.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:27 smithi086 ceph-mon[35163]: pgmap v1664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:28.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1407.804254 secs 2024-03-28T06:23:28.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:27 smithi159 ceph-mon[36109]: pgmap v1664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:28.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1407.804254 secs 2024-03-28T06:23:28.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:27 smithi055 ceph-mon[31863]: pgmap v1664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:28.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1407.804254 secs 2024-03-28T06:23:28.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2079 sec 2024-03-28T06:23:29.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2080 sec 2024-03-28T06:23:30.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:29 smithi086 ceph-mon[35163]: pgmap v1665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:30.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:29 smithi159 ceph-mon[36109]: pgmap v1665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:30.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:29 smithi055 ceph-mon[31863]: pgmap v1665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:30.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2081 sec 2024-03-28T06:23:31.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2082 sec 2024-03-28T06:23:32.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:31 smithi086 ceph-mon[35163]: pgmap v1666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:32.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:31 smithi159 ceph-mon[36109]: pgmap v1666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:32.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:31 smithi055 ceph-mon[31863]: pgmap v1666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:32.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2083 sec 2024-03-28T06:23:33.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1412.804377 secs 2024-03-28T06:23:33.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1412.804377 secs 2024-03-28T06:23:33.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1412.804377 secs 2024-03-28T06:23:33.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2084 sec 2024-03-28T06:23:34.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:33 smithi086 ceph-mon[35163]: pgmap v1667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:34.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:33 smithi159 ceph-mon[36109]: pgmap v1667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:34.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:33 smithi055 ceph-mon[31863]: pgmap v1667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:34.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2085 sec 2024-03-28T06:23:35.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2086 sec 2024-03-28T06:23:36.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:36 smithi086 ceph-mon[35163]: pgmap v1668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:36.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:36 smithi159 ceph-mon[36109]: pgmap v1668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:36.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:36 smithi055 ceph-mon[31863]: pgmap v1668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:36.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2087 sec 2024-03-28T06:23:37.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2088 sec 2024-03-28T06:23:38.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:38 smithi086 ceph-mon[35163]: pgmap v1669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:38.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1417.804493 secs 2024-03-28T06:23:38.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:38 smithi159 ceph-mon[36109]: pgmap v1669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:38.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1417.804493 secs 2024-03-28T06:23:38.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:38 smithi055 ceph-mon[31863]: pgmap v1669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:38.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1417.804493 secs 2024-03-28T06:23:38.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2089 sec 2024-03-28T06:23:39.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2090 sec 2024-03-28T06:23:40.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:40 smithi086 ceph-mon[35163]: pgmap v1670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:40.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:40 smithi159 ceph-mon[36109]: pgmap v1670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:40.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:40 smithi055 ceph-mon[31863]: pgmap v1670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:40.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2091 sec 2024-03-28T06:23:41.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2092 sec 2024-03-28T06:23:42.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:42 smithi086 ceph-mon[35163]: pgmap v1671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:42.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:42 smithi159 ceph-mon[36109]: pgmap v1671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:42.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:42 smithi055 ceph-mon[31863]: pgmap v1671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:42.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2093 sec 2024-03-28T06:23:43.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1422.804558 secs 2024-03-28T06:23:43.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1422.804558 secs 2024-03-28T06:23:43.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1422.804558 secs 2024-03-28T06:23:43.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2094 sec 2024-03-28T06:23:44.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:44 smithi086 ceph-mon[35163]: pgmap v1672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:44.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:44 smithi159 ceph-mon[36109]: pgmap v1672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:44.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:44 smithi055 ceph-mon[31863]: pgmap v1672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:44.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2095 sec 2024-03-28T06:23:45.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2096 sec 2024-03-28T06:23:46.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:46 smithi086 ceph-mon[35163]: pgmap v1673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:46.311 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:46 smithi159 ceph-mon[36109]: pgmap v1673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:46.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:46 smithi055 ceph-mon[31863]: pgmap v1673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:46.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2097 sec 2024-03-28T06:23:47.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2098 sec 2024-03-28T06:23:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:48 smithi055 ceph-mon[31863]: pgmap v1674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:48.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1427.804677 secs 2024-03-28T06:23:48.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2099 sec 2024-03-28T06:23:48.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:48 smithi086 ceph-mon[35163]: pgmap v1674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:48.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1427.804677 secs 2024-03-28T06:23:48.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:48 smithi159 ceph-mon[36109]: pgmap v1674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:48.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1427.804677 secs 2024-03-28T06:23:49.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2100 sec 2024-03-28T06:23:50.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:50 smithi055 ceph-mon[31863]: pgmap v1675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:50.365 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:50 smithi159 ceph-mon[36109]: pgmap v1675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:50.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2101 sec 2024-03-28T06:23:50.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:50 smithi086 ceph-mon[35163]: pgmap v1675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:51.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2102 sec 2024-03-28T06:23:52.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:52 smithi055 ceph-mon[31863]: pgmap v1676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:52.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2103 sec 2024-03-28T06:23:52.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:52 smithi086 ceph-mon[35163]: pgmap v1676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:52.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:52 smithi159 ceph-mon[36109]: pgmap v1676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:23:53.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1432.804763 secs 2024-03-28T06:23:53.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2104 sec 2024-03-28T06:23:53.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1432.804763 secs 2024-03-28T06:23:53.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1432.804763 secs 2024-03-28T06:23:54.364 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:54 smithi055 ceph-mon[31863]: pgmap v1677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:54.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2105 sec 2024-03-28T06:23:54.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:54 smithi086 ceph-mon[35163]: pgmap v1677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:54.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:54 smithi159 ceph-mon[36109]: pgmap v1677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:23:55.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2106 sec 2024-03-28T06:23:56.365 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:56 smithi055 ceph-mon[31863]: pgmap v1678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:56.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2107 sec 2024-03-28T06:23:56.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:56 smithi086 ceph-mon[35163]: pgmap v1678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:56.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:56 smithi159 ceph-mon[36109]: pgmap v1678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:57.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2108 sec 2024-03-28T06:23:58.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2109 sec 2024-03-28T06:23:58.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:58 smithi086 ceph-mon[35163]: pgmap v1679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:58.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1437.804882 secs 2024-03-28T06:23:58.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:58 smithi159 ceph-mon[36109]: pgmap v1679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:58.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1437.804882 secs 2024-03-28T06:23:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:58 smithi055 ceph-mon[31863]: pgmap v1679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:23:58.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1437.804882 secs 2024-03-28T06:23:59.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2110 sec 2024-03-28T06:23:59.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:23:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:23:59.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:23:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:23:59.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:23:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:24:00.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2111 sec 2024-03-28T06:24:00.516 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:00 smithi055 ceph-mon[31863]: pgmap v1680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:00.517 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.517 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.517 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.517 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:00 smithi086 ceph-mon[35163]: pgmap v1680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:00.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:00 smithi159 ceph-mon[36109]: pgmap v1680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:00.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:00.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:24:01.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2112 sec 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: pgmap v1681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: pgmap v1682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:24:01.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: pgmap v1681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: pgmap v1682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:24:01.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: pgmap v1681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: pgmap v1682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:24:01.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:24:02.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2113 sec 2024-03-28T06:24:02.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:02 smithi086 ceph-mon[35163]: pgmap v1683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:02.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:02 smithi159 ceph-mon[36109]: pgmap v1683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:02.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:02 smithi055 ceph-mon[31863]: pgmap v1683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:03.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2114 sec 2024-03-28T06:24:03.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:03 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 1442.805003 secs 2024-03-28T06:24:03.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:03 smithi086 ceph-mon[35163]: slow request 1442.805003 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:24:03.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:03 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 1442.805003 secs 2024-03-28T06:24:03.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:03 smithi159 ceph-mon[36109]: slow request 1442.805003 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:24:03.614 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:03 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 1442.805003 secs 2024-03-28T06:24:03.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:03 smithi055 ceph-mon[31863]: slow request 1442.805003 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:24:04.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2115 sec 2024-03-28T06:24:04.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:04 smithi086 ceph-mon[35163]: pgmap v1684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:04.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:04 smithi159 ceph-mon[36109]: pgmap v1684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:04.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:04 smithi055 ceph-mon[31863]: pgmap v1684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:05.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2116 sec 2024-03-28T06:24:06.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2117 sec 2024-03-28T06:24:06.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:06 smithi086 ceph-mon[35163]: pgmap v1685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:06.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:06 smithi159 ceph-mon[36109]: pgmap v1685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:06.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:06 smithi055 ceph-mon[31863]: pgmap v1685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:07.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2118 sec 2024-03-28T06:24:08.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1447.805126 secs 2024-03-28T06:24:08.061 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1447.805126 secs 2024-03-28T06:24:08.115 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1447.805126 secs 2024-03-28T06:24:08.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2119 sec 2024-03-28T06:24:09.060 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:08 smithi086 ceph-mon[35163]: pgmap v1686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:09.062 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:08 smithi159 ceph-mon[36109]: pgmap v1686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:09.114 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:08 smithi055 ceph-mon[31863]: pgmap v1686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:24:09.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2120 sec 2024-03-28T06:24:10.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2121 sec 2024-03-28T06:24:11.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2122 sec 2024-03-28T06:24:11.559 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:11 smithi086 ceph-mon[35163]: pgmap v1687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:24:11.561 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:11 smithi159 ceph-mon[36109]: pgmap v1687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:24:11.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:11 smithi055 ceph-mon[31863]: pgmap v1687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:24:12.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2123 sec 2024-03-28T06:24:13.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2124 sec 2024-03-28T06:24:13.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:13 smithi086 ceph-mon[35163]: pgmap v1688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:13.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1452.805212 secs 2024-03-28T06:24:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:13 smithi159 ceph-mon[36109]: pgmap v1688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:13.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1452.805212 secs 2024-03-28T06:24:13.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:13 smithi055 ceph-mon[31863]: pgmap v1688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:13.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1452.805212 secs 2024-03-28T06:24:14.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2125 sec 2024-03-28T06:24:15.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2126 sec 2024-03-28T06:24:15.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:15 smithi086 ceph-mon[35163]: pgmap v1689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:15.562 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:15 smithi159 ceph-mon[36109]: pgmap v1689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:15.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:15 smithi055 ceph-mon[31863]: pgmap v1689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:16.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2127 sec 2024-03-28T06:24:17.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2128 sec 2024-03-28T06:24:17.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:17 smithi055 ceph-mon[31863]: pgmap v1690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:17.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:17 smithi086 ceph-mon[35163]: pgmap v1690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:17.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:17 smithi159 ceph-mon[36109]: pgmap v1690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:18.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2129 sec 2024-03-28T06:24:18.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1457.805290 secs 2024-03-28T06:24:18.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1457.805290 secs 2024-03-28T06:24:18.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1457.805290 secs 2024-03-28T06:24:19.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2130 sec 2024-03-28T06:24:19.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:19 smithi055 ceph-mon[31863]: pgmap v1691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:19.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:19 smithi086 ceph-mon[35163]: pgmap v1691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:19.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:19 smithi159 ceph-mon[36109]: pgmap v1691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:20.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2131 sec 2024-03-28T06:24:21.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2132 sec 2024-03-28T06:24:21.615 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:21 smithi159 ceph-mon[36109]: pgmap v1692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:21.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:21 smithi055 ceph-mon[31863]: pgmap v1692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:21.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:21 smithi086 ceph-mon[35163]: pgmap v1692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:22.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2133 sec 2024-03-28T06:24:23.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2134 sec 2024-03-28T06:24:23.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:23 smithi055 ceph-mon[31863]: pgmap v1693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:23.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1462.805411 secs 2024-03-28T06:24:23.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:23 smithi086 ceph-mon[35163]: pgmap v1693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:23.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1462.805411 secs 2024-03-28T06:24:23.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:23 smithi159 ceph-mon[36109]: pgmap v1693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:23.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1462.805411 secs 2024-03-28T06:24:24.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2135 sec 2024-03-28T06:24:25.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2136 sec 2024-03-28T06:24:25.615 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:25 smithi055 ceph-mon[31863]: pgmap v1694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:25.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:25 smithi086 ceph-mon[35163]: pgmap v1694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:25.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:25 smithi159 ceph-mon[36109]: pgmap v1694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:26.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2137 sec 2024-03-28T06:24:27.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2138 sec 2024-03-28T06:24:27.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:27 smithi086 ceph-mon[35163]: pgmap v1695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:27.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:27 smithi159 ceph-mon[36109]: pgmap v1695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:27.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:27 smithi055 ceph-mon[31863]: pgmap v1695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:28.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2139 sec 2024-03-28T06:24:28.712 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1467.805534 secs 2024-03-28T06:24:28.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1467.805534 secs 2024-03-28T06:24:28.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1467.805534 secs 2024-03-28T06:24:29.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2140 sec 2024-03-28T06:24:29.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:29 smithi086 ceph-mon[35163]: pgmap v1696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:29.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:29 smithi159 ceph-mon[36109]: pgmap v1696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:29.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:29 smithi055 ceph-mon[31863]: pgmap v1696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:30.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2141 sec 2024-03-28T06:24:31.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2142 sec 2024-03-28T06:24:31.668 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:31 smithi055 ceph-mon[31863]: pgmap v1697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:31.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:31 smithi086 ceph-mon[35163]: pgmap v1697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:31.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:31 smithi159 ceph-mon[36109]: pgmap v1697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:32.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2143 sec 2024-03-28T06:24:33.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2144 sec 2024-03-28T06:24:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:33 smithi086 ceph-mon[35163]: pgmap v1698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:33.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1472.805620 secs 2024-03-28T06:24:33.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:33 smithi159 ceph-mon[36109]: pgmap v1698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:33.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1472.805620 secs 2024-03-28T06:24:33.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:33 smithi055 ceph-mon[31863]: pgmap v1698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:33.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1472.805620 secs 2024-03-28T06:24:34.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2145 sec 2024-03-28T06:24:35.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2146 sec 2024-03-28T06:24:35.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:35 smithi086 ceph-mon[35163]: pgmap v1699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:35.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:35 smithi159 ceph-mon[36109]: pgmap v1699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:35.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:35 smithi055 ceph-mon[31863]: pgmap v1699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:36.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2147 sec 2024-03-28T06:24:37.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2148 sec 2024-03-28T06:24:37.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:37 smithi086 ceph-mon[35163]: pgmap v1700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:37.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:37 smithi159 ceph-mon[36109]: pgmap v1700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:37.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:37 smithi055 ceph-mon[31863]: pgmap v1700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:38.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2149 sec 2024-03-28T06:24:38.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1477.805741 secs 2024-03-28T06:24:38.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1477.805741 secs 2024-03-28T06:24:38.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1477.805741 secs 2024-03-28T06:24:39.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2150 sec 2024-03-28T06:24:39.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:39 smithi086 ceph-mon[35163]: pgmap v1701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:39.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:39 smithi159 ceph-mon[36109]: pgmap v1701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:39.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:39 smithi055 ceph-mon[31863]: pgmap v1701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:40.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2151 sec 2024-03-28T06:24:41.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2152 sec 2024-03-28T06:24:41.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:41 smithi086 ceph-mon[35163]: pgmap v1702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:41.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:41 smithi159 ceph-mon[36109]: pgmap v1702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:41.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:41 smithi055 ceph-mon[31863]: pgmap v1702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:42.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2153 sec 2024-03-28T06:24:43.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2154 sec 2024-03-28T06:24:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:43 smithi086 ceph-mon[35163]: pgmap v1703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:43.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1482.805815 secs 2024-03-28T06:24:43.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:43 smithi159 ceph-mon[36109]: pgmap v1703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:43.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1482.805815 secs 2024-03-28T06:24:43.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:43 smithi055 ceph-mon[31863]: pgmap v1703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:43.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1482.805815 secs 2024-03-28T06:24:44.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2155 sec 2024-03-28T06:24:45.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2156 sec 2024-03-28T06:24:45.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:45 smithi086 ceph-mon[35163]: pgmap v1704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:45.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:45 smithi159 ceph-mon[36109]: pgmap v1704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:45.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:45 smithi055 ceph-mon[31863]: pgmap v1704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:46.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2157 sec 2024-03-28T06:24:47.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2158 sec 2024-03-28T06:24:47.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:47 smithi086 ceph-mon[35163]: pgmap v1705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:47.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:47 smithi159 ceph-mon[36109]: pgmap v1705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:47.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:47 smithi055 ceph-mon[31863]: pgmap v1705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:48.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2159 sec 2024-03-28T06:24:48.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1487.805875 secs 2024-03-28T06:24:48.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1487.805875 secs 2024-03-28T06:24:48.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1487.805875 secs 2024-03-28T06:24:49.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2160 sec 2024-03-28T06:24:49.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:49 smithi086 ceph-mon[35163]: pgmap v1706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:49.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:49 smithi159 ceph-mon[36109]: pgmap v1706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:49.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:49 smithi055 ceph-mon[31863]: pgmap v1706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:50.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2161 sec 2024-03-28T06:24:51.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2162 sec 2024-03-28T06:24:51.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:51 smithi086 ceph-mon[35163]: pgmap v1707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:51.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:51 smithi159 ceph-mon[36109]: pgmap v1707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:51.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:51 smithi055 ceph-mon[31863]: pgmap v1707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:24:52.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2163 sec 2024-03-28T06:24:53.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2164 sec 2024-03-28T06:24:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:53 smithi086 ceph-mon[35163]: pgmap v1708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:53.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1492.805975 secs 2024-03-28T06:24:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:53 smithi159 ceph-mon[36109]: pgmap v1708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:53.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1492.805975 secs 2024-03-28T06:24:53.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:53 smithi055 ceph-mon[31863]: pgmap v1708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:24:53.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1492.805975 secs 2024-03-28T06:24:54.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2165 sec 2024-03-28T06:24:55.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2166 sec 2024-03-28T06:24:55.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:55 smithi086 ceph-mon[35163]: pgmap v1709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:55.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:55 smithi159 ceph-mon[36109]: pgmap v1709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:55.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:55 smithi055 ceph-mon[31863]: pgmap v1709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:56.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2167 sec 2024-03-28T06:24:57.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2168 sec 2024-03-28T06:24:57.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:57 smithi086 ceph-mon[35163]: pgmap v1710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:57.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:57 smithi159 ceph-mon[36109]: pgmap v1710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:57.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:57 smithi055 ceph-mon[31863]: pgmap v1710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:58.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2169 sec 2024-03-28T06:24:58.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1497.806092 secs 2024-03-28T06:24:58.812 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1497.806092 secs 2024-03-28T06:24:58.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1497.806092 secs 2024-03-28T06:24:59.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2170 sec 2024-03-28T06:24:59.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:24:59 smithi086 ceph-mon[35163]: pgmap v1711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:59.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:24:59 smithi159 ceph-mon[36109]: pgmap v1711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:24:59.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:24:59 smithi055 ceph-mon[31863]: pgmap v1711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:00.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2171 sec 2024-03-28T06:25:01.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2172 sec 2024-03-28T06:25:01.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:01 smithi086 ceph-mon[35163]: pgmap v1712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:25:01.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:25:01.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:01 smithi159 ceph-mon[36109]: pgmap v1712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:25:01.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:25:01.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:01 smithi055 ceph-mon[31863]: pgmap v1712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:25:01.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:25:02.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2173 sec 2024-03-28T06:25:02.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:25:02.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:25:02.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:02 smithi086 ceph-mon[35163]: pgmap v1713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:02.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:02 smithi086 ceph-mon[35163]: pgmap v1714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:02.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:25:02.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:25:02.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:25:02.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:02 smithi159 ceph-mon[36109]: pgmap v1713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:02.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:02 smithi159 ceph-mon[36109]: pgmap v1714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:02.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:25:02.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:25:02.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:25:02.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:02 smithi055 ceph-mon[31863]: pgmap v1713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:02.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:02 smithi055 ceph-mon[31863]: pgmap v1714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:02.866 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:25:03.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2174 sec 2024-03-28T06:25:03.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1502.806161 secs 2024-03-28T06:25:03.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1502.806161 secs 2024-03-28T06:25:03.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1502.806161 secs 2024-03-28T06:25:04.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2175 sec 2024-03-28T06:25:04.811 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:04 smithi086 ceph-mon[35163]: pgmap v1715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:04.813 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:04 smithi159 ceph-mon[36109]: pgmap v1715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:04.865 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:04 smithi055 ceph-mon[31863]: pgmap v1715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:05.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2176 sec 2024-03-28T06:25:06.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2177 sec 2024-03-28T06:25:07.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:07 smithi055 ceph-mon[31863]: pgmap v1716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:07.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2178 sec 2024-03-28T06:25:07.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:07 smithi086 ceph-mon[35163]: pgmap v1716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:07.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:07 smithi159 ceph-mon[36109]: pgmap v1716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:08.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1507.806288 secs 2024-03-28T06:25:08.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2179 sec 2024-03-28T06:25:08.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1507.806288 secs 2024-03-28T06:25:08.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1507.806288 secs 2024-03-28T06:25:09.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:09 smithi055 ceph-mon[31863]: pgmap v1717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:09.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2180 sec 2024-03-28T06:25:09.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:09 smithi086 ceph-mon[35163]: pgmap v1717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:09.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:09 smithi159 ceph-mon[36109]: pgmap v1717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:25:10.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2181 sec 2024-03-28T06:25:11.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:11 smithi055 ceph-mon[31863]: pgmap v1718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:25:11.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2182 sec 2024-03-28T06:25:11.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:11 smithi086 ceph-mon[35163]: pgmap v1718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:25:11.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:11 smithi159 ceph-mon[36109]: pgmap v1718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:25:12.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2183 sec 2024-03-28T06:25:13.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:13 smithi055 ceph-mon[31863]: pgmap v1719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:25:13.366 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1512.806412 secs 2024-03-28T06:25:13.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2184 sec 2024-03-28T06:25:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:13 smithi086 ceph-mon[35163]: pgmap v1719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:25:13.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1512.806412 secs 2024-03-28T06:25:13.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:13 smithi159 ceph-mon[36109]: pgmap v1719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:25:13.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1512.806412 secs 2024-03-28T06:25:14.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2185 sec 2024-03-28T06:25:15.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2186 sec 2024-03-28T06:25:15.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:15 smithi086 ceph-mon[35163]: pgmap v1720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:15.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:15 smithi159 ceph-mon[36109]: pgmap v1720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:15.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:15 smithi055 ceph-mon[31863]: pgmap v1720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:16.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2187 sec 2024-03-28T06:25:17.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2188 sec 2024-03-28T06:25:17.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:17 smithi086 ceph-mon[35163]: pgmap v1721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:17.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:17 smithi159 ceph-mon[36109]: pgmap v1721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:17.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:17 smithi055 ceph-mon[31863]: pgmap v1721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:18.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2189 sec 2024-03-28T06:25:18.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1517.806534 secs 2024-03-28T06:25:18.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1517.806534 secs 2024-03-28T06:25:18.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1517.806534 secs 2024-03-28T06:25:19.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2190 sec 2024-03-28T06:25:19.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:19 smithi086 ceph-mon[35163]: pgmap v1722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:19.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:19 smithi159 ceph-mon[36109]: pgmap v1722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:19.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:19 smithi055 ceph-mon[31863]: pgmap v1722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:20.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2191 sec 2024-03-28T06:25:21.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2192 sec 2024-03-28T06:25:21.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:21 smithi086 ceph-mon[35163]: pgmap v1723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:21.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:21 smithi159 ceph-mon[36109]: pgmap v1723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:21.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:21 smithi055 ceph-mon[31863]: pgmap v1723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:22.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2193 sec 2024-03-28T06:25:23.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2194 sec 2024-03-28T06:25:23.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:23 smithi086 ceph-mon[35163]: pgmap v1724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:23.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1522.806623 secs 2024-03-28T06:25:23.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:23 smithi159 ceph-mon[36109]: pgmap v1724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:23.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1522.806623 secs 2024-03-28T06:25:23.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:23 smithi055 ceph-mon[31863]: pgmap v1724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:23.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1522.806623 secs 2024-03-28T06:25:24.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2195 sec 2024-03-28T06:25:25.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2196 sec 2024-03-28T06:25:25.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:25 smithi086 ceph-mon[35163]: pgmap v1725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:25.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:25 smithi159 ceph-mon[36109]: pgmap v1725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:25.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:25 smithi055 ceph-mon[31863]: pgmap v1725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:26.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2197 sec 2024-03-28T06:25:27.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2198 sec 2024-03-28T06:25:27.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:27 smithi086 ceph-mon[35163]: pgmap v1726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:27.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:27 smithi159 ceph-mon[36109]: pgmap v1726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:27.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:27 smithi055 ceph-mon[31863]: pgmap v1726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:28.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2199 sec 2024-03-28T06:25:28.462 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1527.806694 secs 2024-03-28T06:25:28.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1527.806694 secs 2024-03-28T06:25:28.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1527.806694 secs 2024-03-28T06:25:29.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2200 sec 2024-03-28T06:25:29.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:29 smithi086 ceph-mon[35163]: pgmap v1727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:29.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:29 smithi159 ceph-mon[36109]: pgmap v1727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:29.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:29 smithi055 ceph-mon[31863]: pgmap v1727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:30.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2201 sec 2024-03-28T06:25:31.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2202 sec 2024-03-28T06:25:31.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:31 smithi086 ceph-mon[35163]: pgmap v1728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:31.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:31 smithi159 ceph-mon[36109]: pgmap v1728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:31.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:31 smithi055 ceph-mon[31863]: pgmap v1728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:32.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2203 sec 2024-03-28T06:25:33.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2204 sec 2024-03-28T06:25:33.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:33 smithi086 ceph-mon[35163]: pgmap v1729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:33.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1532.806767 secs 2024-03-28T06:25:33.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:33 smithi159 ceph-mon[36109]: pgmap v1729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:33.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1532.806767 secs 2024-03-28T06:25:33.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:33 smithi055 ceph-mon[31863]: pgmap v1729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:33.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1532.806767 secs 2024-03-28T06:25:34.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2205 sec 2024-03-28T06:25:35.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2206 sec 2024-03-28T06:25:35.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:35 smithi086 ceph-mon[35163]: pgmap v1730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:35.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:35 smithi159 ceph-mon[36109]: pgmap v1730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:35.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:35 smithi055 ceph-mon[31863]: pgmap v1730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:36.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2207 sec 2024-03-28T06:25:37.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2208 sec 2024-03-28T06:25:37.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:37 smithi086 ceph-mon[35163]: pgmap v1731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:37.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:37 smithi159 ceph-mon[36109]: pgmap v1731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:37.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:37 smithi055 ceph-mon[31863]: pgmap v1731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:38.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2209 sec 2024-03-28T06:25:38.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1537.806866 secs 2024-03-28T06:25:38.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1537.806866 secs 2024-03-28T06:25:38.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1537.806866 secs 2024-03-28T06:25:39.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2210 sec 2024-03-28T06:25:39.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:39 smithi086 ceph-mon[35163]: pgmap v1732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:39.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:39 smithi159 ceph-mon[36109]: pgmap v1732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:39.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:39 smithi055 ceph-mon[31863]: pgmap v1732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:40.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2211 sec 2024-03-28T06:25:41.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2212 sec 2024-03-28T06:25:41.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:41 smithi086 ceph-mon[35163]: pgmap v1733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:41.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:41 smithi159 ceph-mon[36109]: pgmap v1733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:41.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:41 smithi055 ceph-mon[31863]: pgmap v1733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:42.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2213 sec 2024-03-28T06:25:43.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2214 sec 2024-03-28T06:25:43.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:43 smithi086 ceph-mon[35163]: pgmap v1734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:43.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1542.806946 secs 2024-03-28T06:25:43.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:43 smithi159 ceph-mon[36109]: pgmap v1734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:43.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1542.806946 secs 2024-03-28T06:25:43.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:43 smithi055 ceph-mon[31863]: pgmap v1734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:43.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1542.806946 secs 2024-03-28T06:25:44.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2215 sec 2024-03-28T06:25:45.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2216 sec 2024-03-28T06:25:45.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:45 smithi086 ceph-mon[35163]: pgmap v1735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:45.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:45 smithi159 ceph-mon[36109]: pgmap v1735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:45.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:45 smithi055 ceph-mon[31863]: pgmap v1735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:46.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2217 sec 2024-03-28T06:25:47.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2218 sec 2024-03-28T06:25:47.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:47 smithi086 ceph-mon[35163]: pgmap v1736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:47.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:47 smithi159 ceph-mon[36109]: pgmap v1736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:47.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:47 smithi055 ceph-mon[31863]: pgmap v1736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:48.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2219 sec 2024-03-28T06:25:48.561 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1547.807023 secs 2024-03-28T06:25:48.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:48 smithi086 ceph-mon[35163]: pgmap v1737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:48.563 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1547.807023 secs 2024-03-28T06:25:48.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:48 smithi159 ceph-mon[36109]: pgmap v1737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:48.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1547.807023 secs 2024-03-28T06:25:48.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:48 smithi055 ceph-mon[31863]: pgmap v1737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:49.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2220 sec 2024-03-28T06:25:50.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2221 sec 2024-03-28T06:25:51.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:51 smithi055 ceph-mon[31863]: pgmap v1738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:51.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2222 sec 2024-03-28T06:25:51.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:51 smithi086 ceph-mon[35163]: pgmap v1738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:51.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:51 smithi159 ceph-mon[36109]: pgmap v1738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:25:52.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2223 sec 2024-03-28T06:25:53.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:53 smithi055 ceph-mon[31863]: pgmap v1739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:53.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1552.807108 secs 2024-03-28T06:25:53.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2224 sec 2024-03-28T06:25:53.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:53 smithi086 ceph-mon[35163]: pgmap v1739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:53.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1552.807108 secs 2024-03-28T06:25:53.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:53 smithi159 ceph-mon[36109]: pgmap v1739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:53.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1552.807108 secs 2024-03-28T06:25:54.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2225 sec 2024-03-28T06:25:55.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2226 sec 2024-03-28T06:25:55.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:55 smithi086 ceph-mon[35163]: pgmap v1740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:55.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:55 smithi159 ceph-mon[36109]: pgmap v1740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:55.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:55 smithi055 ceph-mon[31863]: pgmap v1740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:56.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2227 sec 2024-03-28T06:25:57.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2228 sec 2024-03-28T06:25:57.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:57 smithi086 ceph-mon[35163]: pgmap v1741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:57.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:57 smithi159 ceph-mon[36109]: pgmap v1741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:57.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:57 smithi055 ceph-mon[31863]: pgmap v1741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:58.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2229 sec 2024-03-28T06:25:58.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1557.807194 secs 2024-03-28T06:25:58.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1557.807194 secs 2024-03-28T06:25:58.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1557.807194 secs 2024-03-28T06:25:59.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2230 sec 2024-03-28T06:25:59.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:25:59 smithi086 ceph-mon[35163]: pgmap v1742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:59.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:25:59 smithi159 ceph-mon[36109]: pgmap v1742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:25:59.616 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:25:59 smithi055 ceph-mon[31863]: pgmap v1742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:00.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2231 sec 2024-03-28T06:26:01.420 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:01 smithi055 ceph-mon[31863]: pgmap v1743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:01.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2232 sec 2024-03-28T06:26:01.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:01 smithi086 ceph-mon[35163]: pgmap v1743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:01.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:01 smithi159 ceph-mon[36109]: pgmap v1743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:02.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2233 sec 2024-03-28T06:26:03.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2234 sec 2024-03-28T06:26:03.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:03 smithi086 ceph-mon[35163]: pgmap v1744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:03.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1562.807292 secs 2024-03-28T06:26:03.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:26:03.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:03 smithi159 ceph-mon[36109]: pgmap v1744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:03.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1562.807292 secs 2024-03-28T06:26:03.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:26:03.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:03 smithi055 ceph-mon[31863]: pgmap v1744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:03.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1562.807292 secs 2024-03-28T06:26:03.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:26:04.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2235 sec 2024-03-28T06:26:04.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:04.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:05.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2236 sec 2024-03-28T06:26:05.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:05 smithi086 ceph-mon[35163]: pgmap v1745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:05.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:26:05.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:26:05.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:05.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:05 smithi159 ceph-mon[36109]: pgmap v1745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:05.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:26:05.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:26:05.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:05.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:05 smithi055 ceph-mon[31863]: pgmap v1745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:05.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:26:05.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:26:05.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:26:06.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2237 sec 2024-03-28T06:26:06.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:06 smithi086 ceph-mon[35163]: pgmap v1746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:26:06.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:06 smithi086 ceph-mon[35163]: pgmap v1747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:06.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:06 smithi159 ceph-mon[36109]: pgmap v1746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:26:06.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:06 smithi159 ceph-mon[36109]: pgmap v1747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:06.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:06 smithi055 ceph-mon[31863]: pgmap v1746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:26:06.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:06 smithi055 ceph-mon[31863]: pgmap v1747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:07.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2238 sec 2024-03-28T06:26:08.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2239 sec 2024-03-28T06:26:08.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:08 smithi086 ceph-mon[35163]: pgmap v1748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:08.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1567.807416 secs 2024-03-28T06:26:08.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:08 smithi159 ceph-mon[36109]: pgmap v1748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:08.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1567.807416 secs 2024-03-28T06:26:08.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:08 smithi055 ceph-mon[31863]: pgmap v1748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:08.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1567.807416 secs 2024-03-28T06:26:09.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2240 sec 2024-03-28T06:26:10.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2241 sec 2024-03-28T06:26:10.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:10 smithi086 ceph-mon[35163]: pgmap v1749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:10.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:10 smithi159 ceph-mon[36109]: pgmap v1749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:10.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:10 smithi055 ceph-mon[31863]: pgmap v1749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:11.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2242 sec 2024-03-28T06:26:12.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2243 sec 2024-03-28T06:26:12.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:12 smithi086 ceph-mon[35163]: pgmap v1750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:12.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:12 smithi159 ceph-mon[36109]: pgmap v1750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:12.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:12 smithi055 ceph-mon[31863]: pgmap v1750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:26:13.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2244 sec 2024-03-28T06:26:13.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1572.807539 secs 2024-03-28T06:26:13.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1572.807539 secs 2024-03-28T06:26:13.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1572.807539 secs 2024-03-28T06:26:14.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2245 sec 2024-03-28T06:26:14.562 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:14 smithi086 ceph-mon[35163]: pgmap v1751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:14.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:14 smithi159 ceph-mon[36109]: pgmap v1751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:14.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:14 smithi055 ceph-mon[31863]: pgmap v1751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:15.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2246 sec 2024-03-28T06:26:15.617 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:15 smithi055 ceph-mon[31863]: pgmap v1752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:26:15.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:15 smithi086 ceph-mon[35163]: pgmap v1752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:26:15.814 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:15 smithi159 ceph-mon[36109]: pgmap v1752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:26:16.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2247 sec 2024-03-28T06:26:17.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2248 sec 2024-03-28T06:26:18.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:17 smithi086 ceph-mon[35163]: pgmap v1753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:18.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1577.807655 secs 2024-03-28T06:26:18.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:17 smithi159 ceph-mon[36109]: pgmap v1753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:18.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1577.807655 secs 2024-03-28T06:26:18.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:17 smithi055 ceph-mon[31863]: pgmap v1753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:18.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1577.807655 secs 2024-03-28T06:26:18.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2249 sec 2024-03-28T06:26:19.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2250 sec 2024-03-28T06:26:20.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:19 smithi086 ceph-mon[35163]: pgmap v1754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:20.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:19 smithi159 ceph-mon[36109]: pgmap v1754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:20.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:19 smithi055 ceph-mon[31863]: pgmap v1754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:20.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2251 sec 2024-03-28T06:26:21.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2252 sec 2024-03-28T06:26:22.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:21 smithi086 ceph-mon[35163]: pgmap v1755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:22.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:21 smithi159 ceph-mon[36109]: pgmap v1755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:22.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:21 smithi055 ceph-mon[31863]: pgmap v1755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:22.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2253 sec 2024-03-28T06:26:23.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1582.807804 secs 2024-03-28T06:26:23.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1582.807804 secs 2024-03-28T06:26:23.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1582.807804 secs 2024-03-28T06:26:23.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2254 sec 2024-03-28T06:26:24.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:23 smithi086 ceph-mon[35163]: pgmap v1756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:24.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:23 smithi159 ceph-mon[36109]: pgmap v1756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:24.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:23 smithi055 ceph-mon[31863]: pgmap v1756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:24.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2255 sec 2024-03-28T06:26:25.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2256 sec 2024-03-28T06:26:26.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:25 smithi086 ceph-mon[35163]: pgmap v1757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:26.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:25 smithi159 ceph-mon[36109]: pgmap v1757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:26.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:25 smithi055 ceph-mon[31863]: pgmap v1757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:26.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2257 sec 2024-03-28T06:26:27.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2258 sec 2024-03-28T06:26:28.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:27 smithi086 ceph-mon[35163]: pgmap v1758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:28.062 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1587.807895 secs 2024-03-28T06:26:28.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:27 smithi159 ceph-mon[36109]: pgmap v1758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:28.064 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1587.807895 secs 2024-03-28T06:26:28.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:27 smithi055 ceph-mon[31863]: pgmap v1758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:28.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1587.807895 secs 2024-03-28T06:26:28.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2259 sec 2024-03-28T06:26:29.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2260 sec 2024-03-28T06:26:30.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:29 smithi055 ceph-mon[31863]: pgmap v1759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:30.206 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:29 smithi086 ceph-mon[35163]: pgmap v1759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:30.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:29 smithi159 ceph-mon[36109]: pgmap v1759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:30.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2261 sec 2024-03-28T06:26:31.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2262 sec 2024-03-28T06:26:32.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:31 smithi055 ceph-mon[31863]: pgmap v1760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:32.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:31 smithi086 ceph-mon[35163]: pgmap v1760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:32.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:31 smithi159 ceph-mon[36109]: pgmap v1760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:32.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2263 sec 2024-03-28T06:26:33.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1592.808014 secs 2024-03-28T06:26:33.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1592.808014 secs 2024-03-28T06:26:33.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1592.808014 secs 2024-03-28T06:26:33.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2264 sec 2024-03-28T06:26:34.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:33 smithi055 ceph-mon[31863]: pgmap v1761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:34.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:33 smithi086 ceph-mon[35163]: pgmap v1761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:34.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:33 smithi159 ceph-mon[36109]: pgmap v1761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:34.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2265 sec 2024-03-28T06:26:35.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2266 sec 2024-03-28T06:26:36.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:35 smithi055 ceph-mon[31863]: pgmap v1762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:36.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:35 smithi086 ceph-mon[35163]: pgmap v1762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:36.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:35 smithi159 ceph-mon[36109]: pgmap v1762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:36.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2267 sec 2024-03-28T06:26:37.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2268 sec 2024-03-28T06:26:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:37 smithi055 ceph-mon[31863]: pgmap v1763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:38.118 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1597.808133 secs 2024-03-28T06:26:38.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:37 smithi086 ceph-mon[35163]: pgmap v1763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:38.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1597.808133 secs 2024-03-28T06:26:38.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:37 smithi159 ceph-mon[36109]: pgmap v1763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:38.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1597.808133 secs 2024-03-28T06:26:38.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2269 sec 2024-03-28T06:26:39.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2270 sec 2024-03-28T06:26:40.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:39 smithi055 ceph-mon[31863]: pgmap v1764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:40.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:39 smithi086 ceph-mon[35163]: pgmap v1764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:40.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:39 smithi159 ceph-mon[36109]: pgmap v1764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:40.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2271 sec 2024-03-28T06:26:41.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2272 sec 2024-03-28T06:26:42.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:41 smithi086 ceph-mon[35163]: pgmap v1765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:42.117 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:41 smithi055 ceph-mon[31863]: pgmap v1765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:42.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:41 smithi159 ceph-mon[36109]: pgmap v1765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:42.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2273 sec 2024-03-28T06:26:43.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1602.808231 secs 2024-03-28T06:26:43.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1602.808231 secs 2024-03-28T06:26:43.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1602.808231 secs 2024-03-28T06:26:43.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2274 sec 2024-03-28T06:26:44.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:43 smithi086 ceph-mon[35163]: pgmap v1766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:44.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:43 smithi159 ceph-mon[36109]: pgmap v1766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:44.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:43 smithi055 ceph-mon[31863]: pgmap v1766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:44.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2275 sec 2024-03-28T06:26:45.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2276 sec 2024-03-28T06:26:46.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:45 smithi086 ceph-mon[35163]: pgmap v1767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:46.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:45 smithi159 ceph-mon[36109]: pgmap v1767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:46.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:45 smithi055 ceph-mon[31863]: pgmap v1767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:46.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2277 sec 2024-03-28T06:26:47.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2278 sec 2024-03-28T06:26:48.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:47 smithi086 ceph-mon[35163]: pgmap v1768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:48.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1607.808310 secs 2024-03-28T06:26:48.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:47 smithi159 ceph-mon[36109]: pgmap v1768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:48.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1607.808310 secs 2024-03-28T06:26:48.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:47 smithi055 ceph-mon[31863]: pgmap v1768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:48.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1607.808310 secs 2024-03-28T06:26:48.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2279 sec 2024-03-28T06:26:49.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2280 sec 2024-03-28T06:26:50.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:49 smithi086 ceph-mon[35163]: pgmap v1769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:50.330 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:49 smithi159 ceph-mon[36109]: pgmap v1769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:50.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:49 smithi055 ceph-mon[31863]: pgmap v1769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:50.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2281 sec 2024-03-28T06:26:51.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2282 sec 2024-03-28T06:26:52.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:51 smithi086 ceph-mon[35163]: pgmap v1770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:52.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:51 smithi159 ceph-mon[36109]: pgmap v1770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:52.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:51 smithi055 ceph-mon[31863]: pgmap v1770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:26:52.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2283 sec 2024-03-28T06:26:53.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1612.808398 secs 2024-03-28T06:26:53.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1612.808398 secs 2024-03-28T06:26:53.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1612.808398 secs 2024-03-28T06:26:53.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2284 sec 2024-03-28T06:26:54.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:53 smithi086 ceph-mon[35163]: pgmap v1771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:54.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:53 smithi159 ceph-mon[36109]: pgmap v1771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:54.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:53 smithi055 ceph-mon[31863]: pgmap v1771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:26:54.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2285 sec 2024-03-28T06:26:55.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2286 sec 2024-03-28T06:26:56.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:55 smithi086 ceph-mon[35163]: pgmap v1772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:56.314 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:55 smithi159 ceph-mon[36109]: pgmap v1772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:56.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:55 smithi055 ceph-mon[31863]: pgmap v1772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:56.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2287 sec 2024-03-28T06:26:57.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2288 sec 2024-03-28T06:26:58.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:57 smithi086 ceph-mon[35163]: pgmap v1773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:58.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1617.808467 secs 2024-03-28T06:26:58.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:57 smithi159 ceph-mon[36109]: pgmap v1773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:58.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1617.808467 secs 2024-03-28T06:26:58.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:57 smithi055 ceph-mon[31863]: pgmap v1773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:26:58.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1617.808467 secs 2024-03-28T06:26:58.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2289 sec 2024-03-28T06:26:59.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2290 sec 2024-03-28T06:27:00.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:26:59 smithi086 ceph-mon[35163]: pgmap v1774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:00.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:26:59 smithi159 ceph-mon[36109]: pgmap v1774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:00.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:26:59 smithi055 ceph-mon[31863]: pgmap v1774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:00.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2291 sec 2024-03-28T06:27:01.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2292 sec 2024-03-28T06:27:02.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:01 smithi086 ceph-mon[35163]: pgmap v1775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:02.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:01 smithi159 ceph-mon[36109]: pgmap v1775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:02.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:01 smithi055 ceph-mon[31863]: pgmap v1775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:02.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2293 sec 2024-03-28T06:27:03.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1622.808587 secs 2024-03-28T06:27:03.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1622.808587 secs 2024-03-28T06:27:03.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1622.808587 secs 2024-03-28T06:27:03.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2294 sec 2024-03-28T06:27:04.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:03 smithi086 ceph-mon[35163]: pgmap v1776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:04.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:03 smithi159 ceph-mon[36109]: pgmap v1776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:04.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:03 smithi055 ceph-mon[31863]: pgmap v1776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:04.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2295 sec 2024-03-28T06:27:05.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2296 sec 2024-03-28T06:27:06.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:05 smithi086 ceph-mon[35163]: pgmap v1777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:06.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:27:06.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:05 smithi159 ceph-mon[36109]: pgmap v1777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:06.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:27:06.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:05 smithi055 ceph-mon[31863]: pgmap v1777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:06.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:27:06.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2297 sec 2024-03-28T06:27:07.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.313 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:07.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2298 sec 2024-03-28T06:27:08.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:08 smithi055 ceph-mon[31863]: pgmap v1778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:08.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1627.808653 secs 2024-03-28T06:27:08.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2299 sec 2024-03-28T06:27:08.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:08 smithi086 ceph-mon[35163]: pgmap v1778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:08.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1627.808653 secs 2024-03-28T06:27:08.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:08 smithi159 ceph-mon[36109]: pgmap v1778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:08.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1627.808653 secs 2024-03-28T06:27:09.367 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:09.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:09.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2300 sec 2024-03-28T06:27:09.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:09.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:09.564 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:09.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:10 smithi055 ceph-mon[31863]: pgmap v1779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:10.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.369 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2301 sec 2024-03-28T06:27:10.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:10 smithi086 ceph-mon[35163]: pgmap v1779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:10.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:10 smithi159 ceph-mon[36109]: pgmap v1779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:10.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:10.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:11.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2302 sec 2024-03-28T06:27:12.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:12 smithi055 ceph-mon[31863]: pgmap v1780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:12.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:27:12.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:27:12.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:12.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2303 sec 2024-03-28T06:27:12.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:12 smithi086 ceph-mon[35163]: pgmap v1780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:12.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:27:12.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:27:12.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:12.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:12 smithi159 ceph-mon[36109]: pgmap v1780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:12.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:27:12.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:27:12.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:27:13.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:13 smithi055 ceph-mon[31863]: pgmap v1781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:27:13.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:13 smithi055 ceph-mon[31863]: pgmap v1782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:13.368 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1632.808738 secs 2024-03-28T06:27:13.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2304 sec 2024-03-28T06:27:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:13 smithi086 ceph-mon[35163]: pgmap v1781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:27:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:13 smithi086 ceph-mon[35163]: pgmap v1782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:13.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1632.808738 secs 2024-03-28T06:27:13.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:13 smithi159 ceph-mon[36109]: pgmap v1781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:27:13.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:13 smithi159 ceph-mon[36109]: pgmap v1782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:13.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1632.808738 secs 2024-03-28T06:27:14.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2305 sec 2024-03-28T06:27:15.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2306 sec 2024-03-28T06:27:15.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:15 smithi086 ceph-mon[35163]: pgmap v1783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:15.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:15 smithi159 ceph-mon[36109]: pgmap v1783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:15.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:15 smithi055 ceph-mon[31863]: pgmap v1783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:16.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2307 sec 2024-03-28T06:27:17.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2308 sec 2024-03-28T06:27:17.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:17 smithi086 ceph-mon[35163]: pgmap v1784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:17.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:17 smithi159 ceph-mon[36109]: pgmap v1784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:17.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:17 smithi055 ceph-mon[31863]: pgmap v1784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:27:18.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2309 sec 2024-03-28T06:27:18.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1637.808827 secs 2024-03-28T06:27:18.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1637.808827 secs 2024-03-28T06:27:18.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1637.808827 secs 2024-03-28T06:27:19.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2310 sec 2024-03-28T06:27:19.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:19 smithi086 ceph-mon[35163]: pgmap v1785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:19.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:19 smithi159 ceph-mon[36109]: pgmap v1785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:19.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:19 smithi055 ceph-mon[31863]: pgmap v1785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:20.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2311 sec 2024-03-28T06:27:21.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2312 sec 2024-03-28T06:27:21.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:21 smithi086 ceph-mon[35163]: pgmap v1786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:27:21.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:21 smithi159 ceph-mon[36109]: pgmap v1786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:27:21.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:21 smithi055 ceph-mon[31863]: pgmap v1786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:27:22.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2313 sec 2024-03-28T06:27:23.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2314 sec 2024-03-28T06:27:23.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:23 smithi086 ceph-mon[35163]: pgmap v1787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:27:23.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1642.808947 secs 2024-03-28T06:27:23.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:23 smithi159 ceph-mon[36109]: pgmap v1787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:27:23.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1642.808947 secs 2024-03-28T06:27:23.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:23 smithi055 ceph-mon[31863]: pgmap v1787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:27:23.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1642.808947 secs 2024-03-28T06:27:24.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2315 sec 2024-03-28T06:27:25.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2316 sec 2024-03-28T06:27:25.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:25 smithi086 ceph-mon[35163]: pgmap v1788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:25.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:25 smithi159 ceph-mon[36109]: pgmap v1788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:25.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:25 smithi055 ceph-mon[31863]: pgmap v1788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:26.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2317 sec 2024-03-28T06:27:27.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2318 sec 2024-03-28T06:27:27.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:27 smithi086 ceph-mon[35163]: pgmap v1789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:27.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:27 smithi159 ceph-mon[36109]: pgmap v1789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:27.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:27 smithi055 ceph-mon[31863]: pgmap v1789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:28.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2319 sec 2024-03-28T06:27:28.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1647.809035 secs 2024-03-28T06:27:28.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1647.809035 secs 2024-03-28T06:27:28.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1647.809035 secs 2024-03-28T06:27:29.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2320 sec 2024-03-28T06:27:29.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:29 smithi086 ceph-mon[35163]: pgmap v1790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:29.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:29 smithi159 ceph-mon[36109]: pgmap v1790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:29.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:29 smithi055 ceph-mon[31863]: pgmap v1790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:30.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2321 sec 2024-03-28T06:27:31.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2322 sec 2024-03-28T06:27:31.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:31 smithi086 ceph-mon[35163]: pgmap v1791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:31.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:31 smithi159 ceph-mon[36109]: pgmap v1791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:31.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:31 smithi055 ceph-mon[31863]: pgmap v1791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:32.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2323 sec 2024-03-28T06:27:33.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2324 sec 2024-03-28T06:27:33.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:33 smithi086 ceph-mon[35163]: pgmap v1792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:33.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1652.809127 secs 2024-03-28T06:27:33.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:33 smithi159 ceph-mon[36109]: pgmap v1792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:33.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1652.809127 secs 2024-03-28T06:27:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:33 smithi055 ceph-mon[31863]: pgmap v1792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:33.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1652.809127 secs 2024-03-28T06:27:34.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2325 sec 2024-03-28T06:27:35.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2326 sec 2024-03-28T06:27:35.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:35 smithi086 ceph-mon[35163]: pgmap v1793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:35.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:35 smithi159 ceph-mon[36109]: pgmap v1793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:35.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:35 smithi055 ceph-mon[31863]: pgmap v1793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:36.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2327 sec 2024-03-28T06:27:37.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2328 sec 2024-03-28T06:27:37.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:37 smithi086 ceph-mon[35163]: pgmap v1794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:37.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:37 smithi159 ceph-mon[36109]: pgmap v1794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:37.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:37 smithi055 ceph-mon[31863]: pgmap v1794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:38.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2329 sec 2024-03-28T06:27:38.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1657.809249 secs 2024-03-28T06:27:38.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1657.809249 secs 2024-03-28T06:27:38.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1657.809249 secs 2024-03-28T06:27:39.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2330 sec 2024-03-28T06:27:39.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:39 smithi086 ceph-mon[35163]: pgmap v1795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:39.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:39 smithi159 ceph-mon[36109]: pgmap v1795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:39.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:39 smithi055 ceph-mon[31863]: pgmap v1795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:40.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2331 sec 2024-03-28T06:27:41.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2332 sec 2024-03-28T06:27:41.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:41 smithi086 ceph-mon[35163]: pgmap v1796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:41.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:41 smithi159 ceph-mon[36109]: pgmap v1796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:41.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:41 smithi055 ceph-mon[31863]: pgmap v1796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:42.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2333 sec 2024-03-28T06:27:43.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2334 sec 2024-03-28T06:27:43.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:43 smithi086 ceph-mon[35163]: pgmap v1797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:43.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1662.809374 secs 2024-03-28T06:27:43.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:43 smithi159 ceph-mon[36109]: pgmap v1797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:43.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1662.809374 secs 2024-03-28T06:27:43.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:43 smithi055 ceph-mon[31863]: pgmap v1797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:43.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1662.809374 secs 2024-03-28T06:27:44.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2335 sec 2024-03-28T06:27:45.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2336 sec 2024-03-28T06:27:45.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:45 smithi086 ceph-mon[35163]: pgmap v1798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:45.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:45 smithi159 ceph-mon[36109]: pgmap v1798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:45.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:45 smithi055 ceph-mon[31863]: pgmap v1798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:46.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2337 sec 2024-03-28T06:27:47.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2338 sec 2024-03-28T06:27:47.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:47 smithi086 ceph-mon[35163]: pgmap v1799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:47.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:47 smithi159 ceph-mon[36109]: pgmap v1799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:47.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:47 smithi055 ceph-mon[31863]: pgmap v1799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:48.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2339 sec 2024-03-28T06:27:48.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1667.809458 secs 2024-03-28T06:27:48.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1667.809458 secs 2024-03-28T06:27:48.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1667.809458 secs 2024-03-28T06:27:49.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2340 sec 2024-03-28T06:27:49.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:49 smithi086 ceph-mon[35163]: pgmap v1800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:49.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:49 smithi159 ceph-mon[36109]: pgmap v1800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:49.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:49 smithi055 ceph-mon[31863]: pgmap v1800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:50.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2341 sec 2024-03-28T06:27:51.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2342 sec 2024-03-28T06:27:51.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:51 smithi086 ceph-mon[35163]: pgmap v1801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:51.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:51 smithi159 ceph-mon[36109]: pgmap v1801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:51.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:51 smithi055 ceph-mon[31863]: pgmap v1801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:52.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2343 sec 2024-03-28T06:27:52.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:52 smithi086 ceph-mon[35163]: pgmap v1802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:52.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:52 smithi159 ceph-mon[36109]: pgmap v1802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:52.618 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:52 smithi055 ceph-mon[31863]: pgmap v1802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:53.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2344 sec 2024-03-28T06:27:53.563 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1672.809582 secs 2024-03-28T06:27:53.565 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1672.809582 secs 2024-03-28T06:27:53.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1672.809582 secs 2024-03-28T06:27:54.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2345 sec 2024-03-28T06:27:54.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:54 smithi055 ceph-mon[31863]: pgmap v1803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:54.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:54 smithi086 ceph-mon[35163]: pgmap v1803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:54.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:54 smithi159 ceph-mon[36109]: pgmap v1803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:27:55.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2346 sec 2024-03-28T06:27:56.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2347 sec 2024-03-28T06:27:56.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:56 smithi086 ceph-mon[35163]: pgmap v1804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:56.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:56 smithi159 ceph-mon[36109]: pgmap v1804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:56.868 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:56 smithi055 ceph-mon[31863]: pgmap v1804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:27:57.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2348 sec 2024-03-28T06:27:58.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2349 sec 2024-03-28T06:27:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:58 smithi086 ceph-mon[35163]: pgmap v1805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:58.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:27:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1677.809697 secs 2024-03-28T06:27:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:58 smithi159 ceph-mon[36109]: pgmap v1805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:58.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:27:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1677.809697 secs 2024-03-28T06:27:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:58 smithi055 ceph-mon[31863]: pgmap v1805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:27:58.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:27:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1677.809697 secs 2024-03-28T06:27:59.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2350 sec 2024-03-28T06:28:00.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2351 sec 2024-03-28T06:28:00.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:00 smithi086 ceph-mon[35163]: pgmap v1806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:00.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:00 smithi159 ceph-mon[36109]: pgmap v1806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:00.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:00 smithi055 ceph-mon[31863]: pgmap v1806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:01.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2352 sec 2024-03-28T06:28:02.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2353 sec 2024-03-28T06:28:02.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:02 smithi086 ceph-mon[35163]: pgmap v1807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:02.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:02 smithi159 ceph-mon[36109]: pgmap v1807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:02.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:02 smithi055 ceph-mon[31863]: pgmap v1807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:03.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2354 sec 2024-03-28T06:28:03.771 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1682.809761 secs 2024-03-28T06:28:03.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1682.809761 secs 2024-03-28T06:28:03.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1682.809761 secs 2024-03-28T06:28:04.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2355 sec 2024-03-28T06:28:04.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:04 smithi086 ceph-mon[35163]: pgmap v1808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:04.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:04 smithi159 ceph-mon[36109]: pgmap v1808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:04.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:04 smithi055 ceph-mon[31863]: pgmap v1808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:05.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2356 sec 2024-03-28T06:28:06.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2357 sec 2024-03-28T06:28:06.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:06 smithi086 ceph-mon[35163]: pgmap v1809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:28:06.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:06 smithi159 ceph-mon[36109]: pgmap v1809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:28:06.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:06 smithi055 ceph-mon[31863]: pgmap v1809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:28:07.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2358 sec 2024-03-28T06:28:08.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2359 sec 2024-03-28T06:28:08.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:08 smithi086 ceph-mon[35163]: pgmap v1810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:08.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1687.809867 secs 2024-03-28T06:28:08.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:08 smithi159 ceph-mon[36109]: pgmap v1810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:08.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1687.809867 secs 2024-03-28T06:28:08.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:08 smithi055 ceph-mon[31863]: pgmap v1810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:08.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1687.809867 secs 2024-03-28T06:28:09.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2360 sec 2024-03-28T06:28:10.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2361 sec 2024-03-28T06:28:10.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:10 smithi086 ceph-mon[35163]: pgmap v1811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:10.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:10 smithi159 ceph-mon[36109]: pgmap v1811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:10.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:10 smithi055 ceph-mon[31863]: pgmap v1811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:11.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2362 sec 2024-03-28T06:28:12.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2363 sec 2024-03-28T06:28:12.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:12 smithi086 ceph-mon[35163]: pgmap v1812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:12.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:28:12.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:12 smithi159 ceph-mon[36109]: pgmap v1812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:12.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:28:12.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:12 smithi055 ceph-mon[31863]: pgmap v1812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:12.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:28:13.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2364 sec 2024-03-28T06:28:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1692.809983 secs 2024-03-28T06:28:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:28:13.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:28:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: pgmap v1813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: pgmap v1814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:13.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1692.809983 secs 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: pgmap v1813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: pgmap v1814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:13.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1692.809983 secs 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: pgmap v1813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: pgmap v1814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:13.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:28:14.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2365 sec 2024-03-28T06:28:15.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2366 sec 2024-03-28T06:28:15.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:15 smithi086 ceph-mon[35163]: pgmap v1815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T06:28:15.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:15 smithi159 ceph-mon[36109]: pgmap v1815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T06:28:15.869 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:15 smithi055 ceph-mon[31863]: pgmap v1815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T06:28:16.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2367 sec 2024-03-28T06:28:17.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2368 sec 2024-03-28T06:28:18.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2369 sec 2024-03-28T06:28:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:18 smithi086 ceph-mon[35163]: pgmap v1816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:18.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1697.810101 secs 2024-03-28T06:28:18.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:18 smithi159 ceph-mon[36109]: pgmap v1816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:18.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1697.810101 secs 2024-03-28T06:28:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:18 smithi055 ceph-mon[31863]: pgmap v1816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1697.810101 secs 2024-03-28T06:28:19.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2370 sec 2024-03-28T06:28:20.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2371 sec 2024-03-28T06:28:20.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:20 smithi086 ceph-mon[35163]: pgmap v1817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:20.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:20 smithi159 ceph-mon[36109]: pgmap v1817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:20.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:20 smithi055 ceph-mon[31863]: pgmap v1817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:28:21.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2372 sec 2024-03-28T06:28:22.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2373 sec 2024-03-28T06:28:22.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:22 smithi086 ceph-mon[35163]: pgmap v1818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:22.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:22 smithi159 ceph-mon[36109]: pgmap v1818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:22.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:22 smithi055 ceph-mon[31863]: pgmap v1818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:28:23.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2374 sec 2024-03-28T06:28:23.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1702.810165 secs 2024-03-28T06:28:23.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1702.810165 secs 2024-03-28T06:28:23.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1702.810165 secs 2024-03-28T06:28:24.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2375 sec 2024-03-28T06:28:24.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:24 smithi086 ceph-mon[35163]: pgmap v1819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:28:24.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:24 smithi159 ceph-mon[36109]: pgmap v1819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:28:24.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:24 smithi055 ceph-mon[31863]: pgmap v1819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:28:25.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2376 sec 2024-03-28T06:28:26.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2377 sec 2024-03-28T06:28:26.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:26 smithi086 ceph-mon[35163]: pgmap v1820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:26.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:26 smithi159 ceph-mon[36109]: pgmap v1820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:26.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:26 smithi055 ceph-mon[31863]: pgmap v1820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:27.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2378 sec 2024-03-28T06:28:28.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2379 sec 2024-03-28T06:28:28.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:28 smithi086 ceph-mon[35163]: pgmap v1821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:28.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1707.810281 secs 2024-03-28T06:28:28.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:28 smithi159 ceph-mon[36109]: pgmap v1821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:28.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1707.810281 secs 2024-03-28T06:28:28.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:28 smithi055 ceph-mon[31863]: pgmap v1821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:28.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1707.810281 secs 2024-03-28T06:28:29.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2380 sec 2024-03-28T06:28:30.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2381 sec 2024-03-28T06:28:30.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:30 smithi086 ceph-mon[35163]: pgmap v1822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:30.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:30 smithi159 ceph-mon[36109]: pgmap v1822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:30.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:30 smithi055 ceph-mon[31863]: pgmap v1822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:31.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2382 sec 2024-03-28T06:28:32.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2383 sec 2024-03-28T06:28:32.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:32 smithi086 ceph-mon[35163]: pgmap v1823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:32.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:32 smithi159 ceph-mon[36109]: pgmap v1823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:32.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:32 smithi055 ceph-mon[31863]: pgmap v1823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:33.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2384 sec 2024-03-28T06:28:33.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1712.810404 secs 2024-03-28T06:28:33.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1712.810404 secs 2024-03-28T06:28:33.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1712.810404 secs 2024-03-28T06:28:34.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2385 sec 2024-03-28T06:28:34.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:34 smithi086 ceph-mon[35163]: pgmap v1824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:34.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:34 smithi159 ceph-mon[36109]: pgmap v1824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:34.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:34 smithi055 ceph-mon[31863]: pgmap v1824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:35.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2386 sec 2024-03-28T06:28:36.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2387 sec 2024-03-28T06:28:36.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:36 smithi086 ceph-mon[35163]: pgmap v1825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:36.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:36 smithi159 ceph-mon[36109]: pgmap v1825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:36.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:36 smithi055 ceph-mon[31863]: pgmap v1825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:37.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2388 sec 2024-03-28T06:28:38.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2389 sec 2024-03-28T06:28:38.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:38 smithi086 ceph-mon[35163]: pgmap v1826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:38.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1717.810526 secs 2024-03-28T06:28:38.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:38 smithi159 ceph-mon[36109]: pgmap v1826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:38.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1717.810526 secs 2024-03-28T06:28:38.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:38 smithi055 ceph-mon[31863]: pgmap v1826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:38.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1717.810526 secs 2024-03-28T06:28:39.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2390 sec 2024-03-28T06:28:39.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:39 smithi055 ceph-mon[31863]: pgmap v1827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:39.814 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:39 smithi086 ceph-mon[35163]: pgmap v1827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:39.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:39 smithi159 ceph-mon[36109]: pgmap v1827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:40.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2391 sec 2024-03-28T06:28:41.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2392 sec 2024-03-28T06:28:42.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2393 sec 2024-03-28T06:28:42.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:42 smithi086 ceph-mon[35163]: pgmap v1828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:42.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:42 smithi159 ceph-mon[36109]: pgmap v1828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:42.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:42 smithi055 ceph-mon[31863]: pgmap v1828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:43.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2394 sec 2024-03-28T06:28:43.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1722.810646 secs 2024-03-28T06:28:43.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1722.810646 secs 2024-03-28T06:28:43.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1722.810646 secs 2024-03-28T06:28:44.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2395 sec 2024-03-28T06:28:44.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:44 smithi086 ceph-mon[35163]: pgmap v1829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:44.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:44 smithi159 ceph-mon[36109]: pgmap v1829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:44.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:44 smithi055 ceph-mon[31863]: pgmap v1829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:45.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2396 sec 2024-03-28T06:28:46.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2397 sec 2024-03-28T06:28:46.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:46 smithi086 ceph-mon[35163]: pgmap v1830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:46.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:46 smithi159 ceph-mon[36109]: pgmap v1830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:46.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:46 smithi055 ceph-mon[31863]: pgmap v1830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:47.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2398 sec 2024-03-28T06:28:48.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2399 sec 2024-03-28T06:28:48.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:48 smithi086 ceph-mon[35163]: pgmap v1831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:48.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1727.810770 secs 2024-03-28T06:28:48.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:48 smithi159 ceph-mon[36109]: pgmap v1831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:48.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1727.810770 secs 2024-03-28T06:28:48.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:48 smithi055 ceph-mon[31863]: pgmap v1831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:48.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1727.810770 secs 2024-03-28T06:28:49.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2400 sec 2024-03-28T06:28:50.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2401 sec 2024-03-28T06:28:50.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:50 smithi086 ceph-mon[35163]: pgmap v1832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:50.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:50 smithi159 ceph-mon[36109]: pgmap v1832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:50.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:50 smithi055 ceph-mon[31863]: pgmap v1832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:51.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2402 sec 2024-03-28T06:28:52.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2403 sec 2024-03-28T06:28:52.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:52 smithi086 ceph-mon[35163]: pgmap v1833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:52.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:52 smithi159 ceph-mon[36109]: pgmap v1833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:52.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:52 smithi055 ceph-mon[31863]: pgmap v1833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:53.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2404 sec 2024-03-28T06:28:53.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1732.810868 secs 2024-03-28T06:28:53.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1732.810868 secs 2024-03-28T06:28:53.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1732.810868 secs 2024-03-28T06:28:54.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2405 sec 2024-03-28T06:28:54.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:54 smithi086 ceph-mon[35163]: pgmap v1834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:54.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:54 smithi159 ceph-mon[36109]: pgmap v1834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:54.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:54 smithi055 ceph-mon[31863]: pgmap v1834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:55.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2406 sec 2024-03-28T06:28:56.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2407 sec 2024-03-28T06:28:56.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:56 smithi086 ceph-mon[35163]: pgmap v1835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:56.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:56 smithi159 ceph-mon[36109]: pgmap v1835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:56.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:56 smithi055 ceph-mon[31863]: pgmap v1835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:28:57.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2408 sec 2024-03-28T06:28:58.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2409 sec 2024-03-28T06:28:58.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:58 smithi086 ceph-mon[35163]: pgmap v1836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:58.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:28:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1737.810932 secs 2024-03-28T06:28:58.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:58 smithi159 ceph-mon[36109]: pgmap v1836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:58.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:28:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1737.810932 secs 2024-03-28T06:28:58.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:58 smithi055 ceph-mon[31863]: pgmap v1836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:28:58.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:28:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1737.810932 secs 2024-03-28T06:28:59.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2410 sec 2024-03-28T06:29:00.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2411 sec 2024-03-28T06:29:00.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:00 smithi086 ceph-mon[35163]: pgmap v1837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:00.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:00 smithi159 ceph-mon[36109]: pgmap v1837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:00.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:00 smithi055 ceph-mon[31863]: pgmap v1837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:01.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2412 sec 2024-03-28T06:29:01.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:01 smithi055 ceph-mon[31863]: pgmap v1838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:01.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:01 smithi086 ceph-mon[35163]: pgmap v1838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:01.816 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:01 smithi159 ceph-mon[36109]: pgmap v1838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:02.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2413 sec 2024-03-28T06:29:03.064 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1742.810996 secs 2024-03-28T06:29:03.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1742.810996 secs 2024-03-28T06:29:03.119 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1742.810996 secs 2024-03-28T06:29:03.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2414 sec 2024-03-28T06:29:04.065 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:03 smithi086 ceph-mon[35163]: pgmap v1839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:04.066 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:03 smithi159 ceph-mon[36109]: pgmap v1839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:04.119 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:03 smithi055 ceph-mon[31863]: pgmap v1839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:04.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2415 sec 2024-03-28T06:29:05.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2416 sec 2024-03-28T06:29:06.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2417 sec 2024-03-28T06:29:06.564 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:06 smithi086 ceph-mon[35163]: pgmap v1840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:06.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:06 smithi159 ceph-mon[36109]: pgmap v1840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:06.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:06 smithi055 ceph-mon[31863]: pgmap v1840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:07.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2418 sec 2024-03-28T06:29:08.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2419 sec 2024-03-28T06:29:08.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:08 smithi086 ceph-mon[35163]: pgmap v1841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:08.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1747.811111 secs 2024-03-28T06:29:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:08 smithi159 ceph-mon[36109]: pgmap v1841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1747.811111 secs 2024-03-28T06:29:08.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:08 smithi055 ceph-mon[31863]: pgmap v1841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:08.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1747.811111 secs 2024-03-28T06:29:09.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2420 sec 2024-03-28T06:29:10.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2421 sec 2024-03-28T06:29:10.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:10 smithi086 ceph-mon[35163]: pgmap v1842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:10.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:10 smithi159 ceph-mon[36109]: pgmap v1842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:10.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:10 smithi055 ceph-mon[31863]: pgmap v1842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:11.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2422 sec 2024-03-28T06:29:12.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2423 sec 2024-03-28T06:29:12.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:12 smithi086 ceph-mon[35163]: pgmap v1843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:12.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:12 smithi159 ceph-mon[36109]: pgmap v1843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:12.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:12 smithi055 ceph-mon[31863]: pgmap v1843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:13.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2424 sec 2024-03-28T06:29:13.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1752.811200 secs 2024-03-28T06:29:13.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1752.811200 secs 2024-03-28T06:29:13.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1752.811200 secs 2024-03-28T06:29:14.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2425 sec 2024-03-28T06:29:14.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:14 smithi086 ceph-mon[35163]: pgmap v1844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:14.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:29:14.566 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:14 smithi159 ceph-mon[36109]: pgmap v1844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:14.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:29:14.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:14 smithi055 ceph-mon[31863]: pgmap v1844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:14.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:29:15.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2426 sec 2024-03-28T06:29:15.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:29:15.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:29:15.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:29:15.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:29:15.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:29:15.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:29:15.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:29:15.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:29:15.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:29:16.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2427 sec 2024-03-28T06:29:16.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:16 smithi086 ceph-mon[35163]: pgmap v1845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:29:16.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:16 smithi086 ceph-mon[35163]: pgmap v1846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:29:16.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:16 smithi159 ceph-mon[36109]: pgmap v1845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:29:16.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:16 smithi159 ceph-mon[36109]: pgmap v1846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:29:16.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:16 smithi055 ceph-mon[31863]: pgmap v1845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:29:16.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:16 smithi055 ceph-mon[31863]: pgmap v1846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:29:17.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2428 sec 2024-03-28T06:29:18.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2429 sec 2024-03-28T06:29:18.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:18 smithi086 ceph-mon[35163]: pgmap v1847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:18.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1757.811321 secs 2024-03-28T06:29:18.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:18 smithi159 ceph-mon[36109]: pgmap v1847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:18.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1757.811321 secs 2024-03-28T06:29:18.619 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:18 smithi055 ceph-mon[31863]: pgmap v1847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:18.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1757.811321 secs 2024-03-28T06:29:19.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2430 sec 2024-03-28T06:29:20.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2431 sec 2024-03-28T06:29:20.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:20 smithi086 ceph-mon[35163]: pgmap v1848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:20.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:20 smithi159 ceph-mon[36109]: pgmap v1848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:20.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:20 smithi055 ceph-mon[31863]: pgmap v1848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:21.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2432 sec 2024-03-28T06:29:22.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2433 sec 2024-03-28T06:29:22.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:22 smithi086 ceph-mon[35163]: pgmap v1849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:22.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:22 smithi159 ceph-mon[36109]: pgmap v1849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:22.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:22 smithi055 ceph-mon[31863]: pgmap v1849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:23.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2434 sec 2024-03-28T06:29:23.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1762.811444 secs 2024-03-28T06:29:23.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1762.811444 secs 2024-03-28T06:29:23.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1762.811444 secs 2024-03-28T06:29:24.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2435 sec 2024-03-28T06:29:24.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:24 smithi055 ceph-mon[31863]: pgmap v1850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:24.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:24 smithi086 ceph-mon[35163]: pgmap v1850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:24.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:24 smithi159 ceph-mon[36109]: pgmap v1850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:25.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2436 sec 2024-03-28T06:29:25.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:25 smithi055 ceph-mon[31863]: pgmap v1851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:25.815 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:25 smithi086 ceph-mon[35163]: pgmap v1851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:25.817 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:25 smithi159 ceph-mon[36109]: pgmap v1851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:29:26.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2437 sec 2024-03-28T06:29:27.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2438 sec 2024-03-28T06:29:28.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:27 smithi086 ceph-mon[35163]: pgmap v1852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:28.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1767.811518 secs 2024-03-28T06:29:28.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:27 smithi159 ceph-mon[36109]: pgmap v1852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:28.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1767.811518 secs 2024-03-28T06:29:28.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:27 smithi055 ceph-mon[31863]: pgmap v1852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:28.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1767.811518 secs 2024-03-28T06:29:28.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2439 sec 2024-03-28T06:29:29.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2440 sec 2024-03-28T06:29:30.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:29 smithi086 ceph-mon[35163]: pgmap v1853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:30.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:29 smithi159 ceph-mon[36109]: pgmap v1853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:30.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:29 smithi055 ceph-mon[31863]: pgmap v1853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:30.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2441 sec 2024-03-28T06:29:31.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2442 sec 2024-03-28T06:29:32.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:31 smithi086 ceph-mon[35163]: pgmap v1854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:32.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:31 smithi159 ceph-mon[36109]: pgmap v1854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:32.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:31 smithi055 ceph-mon[31863]: pgmap v1854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:32.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2443 sec 2024-03-28T06:29:33.271 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1772.811640 secs 2024-03-28T06:29:33.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1772.811640 secs 2024-03-28T06:29:33.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1772.811640 secs 2024-03-28T06:29:33.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2444 sec 2024-03-28T06:29:34.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:33 smithi086 ceph-mon[35163]: pgmap v1855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:34.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:33 smithi159 ceph-mon[36109]: pgmap v1855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:34.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:33 smithi055 ceph-mon[31863]: pgmap v1855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:34.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2445 sec 2024-03-28T06:29:35.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2446 sec 2024-03-28T06:29:36.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:36 smithi086 ceph-mon[35163]: pgmap v1856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:36.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:36 smithi159 ceph-mon[36109]: pgmap v1856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:36.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:36 smithi055 ceph-mon[31863]: pgmap v1856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:36.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2447 sec 2024-03-28T06:29:37.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2448 sec 2024-03-28T06:29:38.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:38 smithi086 ceph-mon[35163]: pgmap v1857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:38.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1777.811717 secs 2024-03-28T06:29:38.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:38 smithi159 ceph-mon[36109]: pgmap v1857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:38.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1777.811717 secs 2024-03-28T06:29:38.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:38 smithi055 ceph-mon[31863]: pgmap v1857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:38.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1777.811717 secs 2024-03-28T06:29:38.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2449 sec 2024-03-28T06:29:39.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2450 sec 2024-03-28T06:29:40.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:40 smithi086 ceph-mon[35163]: pgmap v1858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:40.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:40 smithi159 ceph-mon[36109]: pgmap v1858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:40.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:40 smithi055 ceph-mon[31863]: pgmap v1858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:40.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2451 sec 2024-03-28T06:29:41.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2452 sec 2024-03-28T06:29:42.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:42 smithi086 ceph-mon[35163]: pgmap v1859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:42.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:42 smithi159 ceph-mon[36109]: pgmap v1859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:42.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:42 smithi055 ceph-mon[31863]: pgmap v1859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:42.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2453 sec 2024-03-28T06:29:43.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1782.811810 secs 2024-03-28T06:29:43.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1782.811810 secs 2024-03-28T06:29:43.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1782.811810 secs 2024-03-28T06:29:43.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2454 sec 2024-03-28T06:29:44.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:44 smithi086 ceph-mon[35163]: pgmap v1860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:44.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:44 smithi159 ceph-mon[36109]: pgmap v1860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:44.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:44 smithi055 ceph-mon[31863]: pgmap v1860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:44.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2455 sec 2024-03-28T06:29:45.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2456 sec 2024-03-28T06:29:46.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:46 smithi086 ceph-mon[35163]: pgmap v1861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:46.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:46 smithi159 ceph-mon[36109]: pgmap v1861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:46.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:46 smithi055 ceph-mon[31863]: pgmap v1861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:46.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2457 sec 2024-03-28T06:29:47.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2458 sec 2024-03-28T06:29:48.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:48 smithi086 ceph-mon[35163]: pgmap v1862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:48.315 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1787.811884 secs 2024-03-28T06:29:48.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:48 smithi159 ceph-mon[36109]: pgmap v1862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:48.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1787.811884 secs 2024-03-28T06:29:48.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:48 smithi055 ceph-mon[31863]: pgmap v1862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:48.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1787.811884 secs 2024-03-28T06:29:48.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2459 sec 2024-03-28T06:29:49.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2460 sec 2024-03-28T06:29:50.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:50 smithi055 ceph-mon[31863]: pgmap v1863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:50.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2461 sec 2024-03-28T06:29:50.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:50 smithi086 ceph-mon[35163]: pgmap v1863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:50.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:50 smithi159 ceph-mon[36109]: pgmap v1863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:51.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2462 sec 2024-03-28T06:29:52.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:52 smithi055 ceph-mon[31863]: pgmap v1864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:52.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2463 sec 2024-03-28T06:29:52.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:52 smithi086 ceph-mon[35163]: pgmap v1864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:52.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:52 smithi159 ceph-mon[36109]: pgmap v1864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:53.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1792.812012 secs 2024-03-28T06:29:53.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2464 sec 2024-03-28T06:29:53.469 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1792.812012 secs 2024-03-28T06:29:53.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1792.812012 secs 2024-03-28T06:29:54.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:54 smithi055 ceph-mon[31863]: pgmap v1865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:54.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2465 sec 2024-03-28T06:29:54.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:54 smithi086 ceph-mon[35163]: pgmap v1865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:54.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:54 smithi159 ceph-mon[36109]: pgmap v1865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:55.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2466 sec 2024-03-28T06:29:56.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:56 smithi055 ceph-mon[31863]: pgmap v1866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:56.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2467 sec 2024-03-28T06:29:56.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:56 smithi086 ceph-mon[35163]: pgmap v1866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:56.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:56 smithi159 ceph-mon[36109]: pgmap v1866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:29:57.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2468 sec 2024-03-28T06:29:58.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:58 smithi055 ceph-mon[31863]: pgmap v1867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:58.370 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:29:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1797.812132 secs 2024-03-28T06:29:58.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2469 sec 2024-03-28T06:29:58.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:58 smithi086 ceph-mon[35163]: pgmap v1867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:58.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:29:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1797.812132 secs 2024-03-28T06:29:58.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:58 smithi159 ceph-mon[36109]: pgmap v1867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:29:58.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:29:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1797.812132 secs 2024-03-28T06:29:59.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2470 sec 2024-03-28T06:30:00.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2471 sec 2024-03-28T06:30:00.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:00 smithi086 ceph-mon[35163]: pgmap v1868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:00.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:30:00.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:00 smithi159 ceph-mon[36109]: pgmap v1868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:00.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:30:00.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:00 smithi055 ceph-mon[31863]: pgmap v1868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:00.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:30:01.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2472 sec 2024-03-28T06:30:02.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2473 sec 2024-03-28T06:30:02.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:02 smithi086 ceph-mon[35163]: pgmap v1869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:02.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:02 smithi159 ceph-mon[36109]: pgmap v1869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:02.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:02 smithi055 ceph-mon[31863]: pgmap v1869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:03.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2474 sec 2024-03-28T06:30:03.467 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1802.812205 secs 2024-03-28T06:30:03.522 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1802.812205 secs 2024-03-28T06:30:03.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1802.812205 secs 2024-03-28T06:30:04.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2475 sec 2024-03-28T06:30:04.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:04 smithi086 ceph-mon[35163]: pgmap v1870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:04.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:04 smithi159 ceph-mon[36109]: pgmap v1870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:04.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:04 smithi055 ceph-mon[31863]: pgmap v1870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:05.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2476 sec 2024-03-28T06:30:06.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2477 sec 2024-03-28T06:30:06.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:06 smithi086 ceph-mon[35163]: pgmap v1871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:06.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:06 smithi159 ceph-mon[36109]: pgmap v1871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:06.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:06 smithi055 ceph-mon[31863]: pgmap v1871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:07.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2478 sec 2024-03-28T06:30:08.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2479 sec 2024-03-28T06:30:08.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:08 smithi086 ceph-mon[35163]: pgmap v1872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:08.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1807.812266 secs 2024-03-28T06:30:08.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:08 smithi159 ceph-mon[36109]: pgmap v1872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:08.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1807.812266 secs 2024-03-28T06:30:08.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:08 smithi055 ceph-mon[31863]: pgmap v1872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:08.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1807.812266 secs 2024-03-28T06:30:09.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2480 sec 2024-03-28T06:30:10.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2481 sec 2024-03-28T06:30:10.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:10 smithi086 ceph-mon[35163]: pgmap v1873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:10.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:10 smithi159 ceph-mon[36109]: pgmap v1873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:10.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:10 smithi055 ceph-mon[31863]: pgmap v1873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:11.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2482 sec 2024-03-28T06:30:12.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2483 sec 2024-03-28T06:30:12.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:12 smithi086 ceph-mon[35163]: pgmap v1874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:12.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:12 smithi159 ceph-mon[36109]: pgmap v1874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:12.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:12 smithi055 ceph-mon[31863]: pgmap v1874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:13.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2484 sec 2024-03-28T06:30:13.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1812.812378 secs 2024-03-28T06:30:13.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1812.812378 secs 2024-03-28T06:30:13.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1812.812378 secs 2024-03-28T06:30:14.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2485 sec 2024-03-28T06:30:14.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:14 smithi086 ceph-mon[35163]: pgmap v1875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:14.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:14 smithi159 ceph-mon[36109]: pgmap v1875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:14.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:14 smithi055 ceph-mon[31863]: pgmap v1875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:15.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2486 sec 2024-03-28T06:30:16.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2487 sec 2024-03-28T06:30:16.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:16 smithi086 ceph-mon[35163]: pgmap v1876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:16.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:30:16.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:16 smithi159 ceph-mon[36109]: pgmap v1876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:16.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:30:16.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:16 smithi055 ceph-mon[31863]: pgmap v1876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:16.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:30:17.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2488 sec 2024-03-28T06:30:17.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:30:17.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:30:17.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:30:17.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:30:17.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:30:17.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:30:17.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:30:17.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:30:17.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:30:18.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2489 sec 2024-03-28T06:30:18.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:18 smithi086 ceph-mon[35163]: pgmap v1877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:18 smithi086 ceph-mon[35163]: pgmap v1878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1817.812500 secs 2024-03-28T06:30:18.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:18 smithi159 ceph-mon[36109]: pgmap v1877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:18 smithi159 ceph-mon[36109]: pgmap v1878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1817.812500 secs 2024-03-28T06:30:18.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:18 smithi055 ceph-mon[31863]: pgmap v1877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:18 smithi055 ceph-mon[31863]: pgmap v1878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:18.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1817.812500 secs 2024-03-28T06:30:19.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2490 sec 2024-03-28T06:30:20.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2491 sec 2024-03-28T06:30:20.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:20 smithi086 ceph-mon[35163]: pgmap v1879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:20.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:20 smithi159 ceph-mon[36109]: pgmap v1879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:20.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:20 smithi055 ceph-mon[31863]: pgmap v1879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:21.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2492 sec 2024-03-28T06:30:22.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2493 sec 2024-03-28T06:30:22.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:22 smithi086 ceph-mon[35163]: pgmap v1880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:22.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:22 smithi159 ceph-mon[36109]: pgmap v1880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:22.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:22 smithi055 ceph-mon[31863]: pgmap v1880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:23.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2494 sec 2024-03-28T06:30:23.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1822.812653 secs 2024-03-28T06:30:23.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1822.812653 secs 2024-03-28T06:30:23.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1822.812653 secs 2024-03-28T06:30:24.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2495 sec 2024-03-28T06:30:24.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:24 smithi086 ceph-mon[35163]: pgmap v1881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:30:24.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:24 smithi159 ceph-mon[36109]: pgmap v1881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:30:24.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:24 smithi055 ceph-mon[31863]: pgmap v1881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:30:25.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2496 sec 2024-03-28T06:30:26.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2497 sec 2024-03-28T06:30:26.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:26 smithi086 ceph-mon[35163]: pgmap v1882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:26.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:26 smithi159 ceph-mon[36109]: pgmap v1882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:26.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:26 smithi055 ceph-mon[31863]: pgmap v1882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:27.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2498 sec 2024-03-28T06:30:28.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2499 sec 2024-03-28T06:30:28.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:28 smithi086 ceph-mon[35163]: pgmap v1883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:30:28.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1827.812730 secs 2024-03-28T06:30:28.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:28 smithi159 ceph-mon[36109]: pgmap v1883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:30:28.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1827.812730 secs 2024-03-28T06:30:28.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:28 smithi055 ceph-mon[31863]: pgmap v1883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:30:28.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1827.812730 secs 2024-03-28T06:30:29.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2500 sec 2024-03-28T06:30:30.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2501 sec 2024-03-28T06:30:30.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:30 smithi086 ceph-mon[35163]: pgmap v1884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:30.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:30 smithi159 ceph-mon[36109]: pgmap v1884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:30.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:30 smithi055 ceph-mon[31863]: pgmap v1884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:31.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2502 sec 2024-03-28T06:30:32.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2503 sec 2024-03-28T06:30:32.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:32 smithi086 ceph-mon[35163]: pgmap v1885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:32.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:32 smithi159 ceph-mon[36109]: pgmap v1885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:32.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:32 smithi055 ceph-mon[31863]: pgmap v1885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:33.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2504 sec 2024-03-28T06:30:33.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1832.812847 secs 2024-03-28T06:30:33.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1832.812847 secs 2024-03-28T06:30:33.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1832.812847 secs 2024-03-28T06:30:34.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2505 sec 2024-03-28T06:30:34.565 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:34 smithi086 ceph-mon[35163]: pgmap v1886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:34.567 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:34 smithi159 ceph-mon[36109]: pgmap v1886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:34.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:34 smithi055 ceph-mon[31863]: pgmap v1886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:35.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2506 sec 2024-03-28T06:30:36.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2507 sec 2024-03-28T06:30:36.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:36 smithi086 ceph-mon[35163]: pgmap v1887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:36.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:36 smithi159 ceph-mon[36109]: pgmap v1887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:36.620 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:36 smithi055 ceph-mon[31863]: pgmap v1887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:37.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2508 sec 2024-03-28T06:30:38.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2509 sec 2024-03-28T06:30:38.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:38 smithi086 ceph-mon[35163]: pgmap v1888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:38.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1837.812919 secs 2024-03-28T06:30:38.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:38 smithi159 ceph-mon[36109]: pgmap v1888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:38.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1837.812919 secs 2024-03-28T06:30:38.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:38 smithi055 ceph-mon[31863]: pgmap v1888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:38.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1837.812919 secs 2024-03-28T06:30:39.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2510 sec 2024-03-28T06:30:40.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2511 sec 2024-03-28T06:30:40.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:40 smithi086 ceph-mon[35163]: pgmap v1889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:40.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:40 smithi159 ceph-mon[36109]: pgmap v1889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:40.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:40 smithi055 ceph-mon[31863]: pgmap v1889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:41.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2512 sec 2024-03-28T06:30:42.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2513 sec 2024-03-28T06:30:42.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:42 smithi086 ceph-mon[35163]: pgmap v1890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:42.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:42 smithi159 ceph-mon[36109]: pgmap v1890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:42.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:42 smithi055 ceph-mon[31863]: pgmap v1890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:43.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2514 sec 2024-03-28T06:30:43.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1842.812983 secs 2024-03-28T06:30:43.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1842.812983 secs 2024-03-28T06:30:43.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1842.812983 secs 2024-03-28T06:30:44.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2515 sec 2024-03-28T06:30:44.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:44 smithi055 ceph-mon[31863]: pgmap v1891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:44.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:44 smithi086 ceph-mon[35163]: pgmap v1891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:44.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:44 smithi159 ceph-mon[36109]: pgmap v1891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:45.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2516 sec 2024-03-28T06:30:45.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:45 smithi086 ceph-mon[35163]: pgmap v1892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:45.621 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:45 smithi055 ceph-mon[31863]: pgmap v1892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:45.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:45 smithi159 ceph-mon[36109]: pgmap v1892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:46.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2517 sec 2024-03-28T06:30:47.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2518 sec 2024-03-28T06:30:48.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:47 smithi086 ceph-mon[35163]: pgmap v1893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:48.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:47 smithi159 ceph-mon[36109]: pgmap v1893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:48.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:47 smithi055 ceph-mon[31863]: pgmap v1893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:48.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2519 sec 2024-03-28T06:30:49.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1847.813068 secs 2024-03-28T06:30:49.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1847.813068 secs 2024-03-28T06:30:49.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1847.813068 secs 2024-03-28T06:30:49.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2520 sec 2024-03-28T06:30:50.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:49 smithi086 ceph-mon[35163]: pgmap v1894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:50.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:49 smithi159 ceph-mon[36109]: pgmap v1894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:50.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:49 smithi055 ceph-mon[31863]: pgmap v1894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:50.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2521 sec 2024-03-28T06:30:51.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2522 sec 2024-03-28T06:30:52.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:51 smithi086 ceph-mon[35163]: pgmap v1895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:52.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:51 smithi159 ceph-mon[36109]: pgmap v1895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:52.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:51 smithi055 ceph-mon[31863]: pgmap v1895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:30:52.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2523 sec 2024-03-28T06:30:53.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2524 sec 2024-03-28T06:30:54.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1852.813146 secs 2024-03-28T06:30:54.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:53 smithi086 ceph-mon[35163]: pgmap v1896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:54.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1852.813146 secs 2024-03-28T06:30:54.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:53 smithi159 ceph-mon[36109]: pgmap v1896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:54.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1852.813146 secs 2024-03-28T06:30:54.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:53 smithi055 ceph-mon[31863]: pgmap v1896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:30:54.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2525 sec 2024-03-28T06:30:55.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2526 sec 2024-03-28T06:30:56.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:55 smithi086 ceph-mon[35163]: pgmap v1897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:56.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:55 smithi159 ceph-mon[36109]: pgmap v1897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:56.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:55 smithi055 ceph-mon[31863]: pgmap v1897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:56.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2527 sec 2024-03-28T06:30:57.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2528 sec 2024-03-28T06:30:58.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:57 smithi086 ceph-mon[35163]: pgmap v1898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:58.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:57 smithi159 ceph-mon[36109]: pgmap v1898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:58.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:57 smithi055 ceph-mon[31863]: pgmap v1898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:30:58.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2529 sec 2024-03-28T06:30:59.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1857.813209 secs 2024-03-28T06:30:59.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1857.813209 secs 2024-03-28T06:30:59.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1857.813209 secs 2024-03-28T06:30:59.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2530 sec 2024-03-28T06:31:00.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:30:59 smithi086 ceph-mon[35163]: pgmap v1899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:00.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:30:59 smithi159 ceph-mon[36109]: pgmap v1899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:00.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:30:59 smithi055 ceph-mon[31863]: pgmap v1899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:00.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2531 sec 2024-03-28T06:31:01.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2532 sec 2024-03-28T06:31:02.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:01 smithi086 ceph-mon[35163]: pgmap v1900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:02.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:01 smithi159 ceph-mon[36109]: pgmap v1900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:02.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:01 smithi055 ceph-mon[31863]: pgmap v1900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:02.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2533 sec 2024-03-28T06:31:03.023 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1862.813263 secs 2024-03-28T06:31:03.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1862.813263 secs 2024-03-28T06:31:03.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1862.813263 secs 2024-03-28T06:31:03.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2534 sec 2024-03-28T06:31:04.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:03 smithi086 ceph-mon[35163]: pgmap v1901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:04.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:03 smithi159 ceph-mon[36109]: pgmap v1901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:04.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:03 smithi055 ceph-mon[31863]: pgmap v1901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:04.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2535 sec 2024-03-28T06:31:05.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2536 sec 2024-03-28T06:31:05.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:05 smithi159 ceph-mon[36109]: pgmap v1902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:06.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:05 smithi086 ceph-mon[35163]: pgmap v1902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:06.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:05 smithi055 ceph-mon[31863]: pgmap v1902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:06.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2537 sec 2024-03-28T06:31:07.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2538 sec 2024-03-28T06:31:08.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:07 smithi086 ceph-mon[35163]: pgmap v1903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:08.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1867.813326 secs 2024-03-28T06:31:08.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:07 smithi159 ceph-mon[36109]: pgmap v1903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:08.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1867.813326 secs 2024-03-28T06:31:08.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:07 smithi055 ceph-mon[31863]: pgmap v1903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:08.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1867.813326 secs 2024-03-28T06:31:08.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2539 sec 2024-03-28T06:31:09.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2540 sec 2024-03-28T06:31:10.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:09 smithi086 ceph-mon[35163]: pgmap v1904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:10.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:09 smithi159 ceph-mon[36109]: pgmap v1904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:10.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:09 smithi055 ceph-mon[31863]: pgmap v1904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:10.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2541 sec 2024-03-28T06:31:11.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2542 sec 2024-03-28T06:31:12.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:11 smithi086 ceph-mon[35163]: pgmap v1905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:12.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:11 smithi159 ceph-mon[36109]: pgmap v1905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:12.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:11 smithi055 ceph-mon[31863]: pgmap v1905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:12.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2543 sec 2024-03-28T06:31:13.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1872.813447 secs 2024-03-28T06:31:13.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1872.813447 secs 2024-03-28T06:31:13.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1872.813447 secs 2024-03-28T06:31:13.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2544 sec 2024-03-28T06:31:14.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:13 smithi055 ceph-mon[31863]: pgmap v1906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:14.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:13 smithi086 ceph-mon[35163]: pgmap v1906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:14.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:13 smithi159 ceph-mon[36109]: pgmap v1906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:14.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2545 sec 2024-03-28T06:31:15.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2546 sec 2024-03-28T06:31:16.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:15 smithi055 ceph-mon[31863]: pgmap v1907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:16.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:15 smithi086 ceph-mon[35163]: pgmap v1907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:16.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:15 smithi159 ceph-mon[36109]: pgmap v1907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:16.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2547 sec 2024-03-28T06:31:17.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2548 sec 2024-03-28T06:31:18.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:17 smithi055 ceph-mon[31863]: pgmap v1908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:18.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:31:18.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1877.813570 secs 2024-03-28T06:31:18.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:17 smithi086 ceph-mon[35163]: pgmap v1908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:18.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:31:18.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1877.813570 secs 2024-03-28T06:31:18.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:17 smithi159 ceph-mon[36109]: pgmap v1908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:18.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:31:18.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1877.813570 secs 2024-03-28T06:31:18.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2549 sec 2024-03-28T06:31:19.121 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:31:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:31:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:31:19.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:31:19.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:31:19.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:31:19.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:31:19.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:31:19.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:31:19.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2550 sec 2024-03-28T06:31:20.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:19 smithi086 ceph-mon[35163]: pgmap v1909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:20.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:19 smithi159 ceph-mon[36109]: pgmap v1909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:20.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:19 smithi055 ceph-mon[31863]: pgmap v1909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:20.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2551 sec 2024-03-28T06:31:21.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2552 sec 2024-03-28T06:31:22.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:21 smithi086 ceph-mon[35163]: pgmap v1910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:22.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:21 smithi159 ceph-mon[36109]: pgmap v1910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:22.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:21 smithi055 ceph-mon[31863]: pgmap v1910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:22.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2553 sec 2024-03-28T06:31:23.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1882.813689 secs 2024-03-28T06:31:23.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1882.813689 secs 2024-03-28T06:31:23.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1882.813689 secs 2024-03-28T06:31:23.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2554 sec 2024-03-28T06:31:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:23 smithi086 ceph-mon[35163]: pgmap v1911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:24.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:23 smithi159 ceph-mon[36109]: pgmap v1911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:24.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:23 smithi055 ceph-mon[31863]: pgmap v1911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:24.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2555 sec 2024-03-28T06:31:25.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2556 sec 2024-03-28T06:31:26.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:25 smithi086 ceph-mon[35163]: pgmap v1912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:26.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:25 smithi159 ceph-mon[36109]: pgmap v1912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:26.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:25 smithi055 ceph-mon[31863]: pgmap v1912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:26.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2557 sec 2024-03-28T06:31:27.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2558 sec 2024-03-28T06:31:28.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:27 smithi086 ceph-mon[35163]: pgmap v1913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1887.813767 secs 2024-03-28T06:31:28.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:27 smithi159 ceph-mon[36109]: pgmap v1913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:28.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1887.813767 secs 2024-03-28T06:31:28.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:27 smithi055 ceph-mon[31863]: pgmap v1913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:28.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1887.813767 secs 2024-03-28T06:31:28.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2559 sec 2024-03-28T06:31:29.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2560 sec 2024-03-28T06:31:30.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:29 smithi086 ceph-mon[35163]: pgmap v1914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:30.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:29 smithi159 ceph-mon[36109]: pgmap v1914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:30.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:29 smithi055 ceph-mon[31863]: pgmap v1914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:30.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2561 sec 2024-03-28T06:31:31.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2562 sec 2024-03-28T06:31:32.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:31 smithi086 ceph-mon[35163]: pgmap v1915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:32.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:31 smithi159 ceph-mon[36109]: pgmap v1915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:32.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:31 smithi055 ceph-mon[31863]: pgmap v1915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:32.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2563 sec 2024-03-28T06:31:33.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1892.813846 secs 2024-03-28T06:31:33.273 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1892.813846 secs 2024-03-28T06:31:33.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1892.813846 secs 2024-03-28T06:31:33.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2564 sec 2024-03-28T06:31:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:33 smithi086 ceph-mon[35163]: pgmap v1916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:34.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:33 smithi159 ceph-mon[36109]: pgmap v1916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:34.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:33 smithi055 ceph-mon[31863]: pgmap v1916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:34.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2565 sec 2024-03-28T06:31:35.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2566 sec 2024-03-28T06:31:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:35 smithi086 ceph-mon[35163]: pgmap v1917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:36.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:35 smithi159 ceph-mon[36109]: pgmap v1917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:36.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:35 smithi055 ceph-mon[31863]: pgmap v1917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:36.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2567 sec 2024-03-28T06:31:37.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2568 sec 2024-03-28T06:31:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:37 smithi086 ceph-mon[35163]: pgmap v1918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1897.813937 secs 2024-03-28T06:31:38.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:37 smithi159 ceph-mon[36109]: pgmap v1918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:38.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1897.813937 secs 2024-03-28T06:31:38.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:37 smithi055 ceph-mon[31863]: pgmap v1918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:38.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1897.813937 secs 2024-03-28T06:31:38.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2569 sec 2024-03-28T06:31:39.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2570 sec 2024-03-28T06:31:40.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:39 smithi086 ceph-mon[35163]: pgmap v1919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:40.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:39 smithi159 ceph-mon[36109]: pgmap v1919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:40.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:39 smithi055 ceph-mon[31863]: pgmap v1919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:40.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2571 sec 2024-03-28T06:31:41.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2572 sec 2024-03-28T06:31:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:41 smithi086 ceph-mon[35163]: pgmap v1920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:42.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:41 smithi159 ceph-mon[36109]: pgmap v1920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:42.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:41 smithi055 ceph-mon[31863]: pgmap v1920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:42.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2573 sec 2024-03-28T06:31:43.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1902.814012 secs 2024-03-28T06:31:43.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1902.814012 secs 2024-03-28T06:31:43.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1902.814012 secs 2024-03-28T06:31:43.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2574 sec 2024-03-28T06:31:44.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:43 smithi086 ceph-mon[35163]: pgmap v1921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:44.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:43 smithi159 ceph-mon[36109]: pgmap v1921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:44.358 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:43 smithi055 ceph-mon[31863]: pgmap v1921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:44.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2575 sec 2024-03-28T06:31:45.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2576 sec 2024-03-28T06:31:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:45 smithi086 ceph-mon[35163]: pgmap v1922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:46.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:45 smithi159 ceph-mon[36109]: pgmap v1922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:46.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:45 smithi055 ceph-mon[31863]: pgmap v1922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:46.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2577 sec 2024-03-28T06:31:47.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2578 sec 2024-03-28T06:31:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:48 smithi086 ceph-mon[35163]: pgmap v1923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1907.814084 secs 2024-03-28T06:31:48.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:48 smithi159 ceph-mon[36109]: pgmap v1923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:48.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1907.814084 secs 2024-03-28T06:31:48.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:48 smithi055 ceph-mon[31863]: pgmap v1923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1907.814084 secs 2024-03-28T06:31:48.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2579 sec 2024-03-28T06:31:49.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2580 sec 2024-03-28T06:31:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:50 smithi086 ceph-mon[35163]: pgmap v1924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:50.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:50 smithi159 ceph-mon[36109]: pgmap v1924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:50.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:50 smithi055 ceph-mon[31863]: pgmap v1924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:50.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2581 sec 2024-03-28T06:31:51.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2582 sec 2024-03-28T06:31:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:52 smithi086 ceph-mon[35163]: pgmap v1925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:52.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:52 smithi159 ceph-mon[36109]: pgmap v1925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:52.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:52 smithi055 ceph-mon[31863]: pgmap v1925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:31:52.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2583 sec 2024-03-28T06:31:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1912.814161 secs 2024-03-28T06:31:53.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1912.814161 secs 2024-03-28T06:31:53.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1912.814161 secs 2024-03-28T06:31:53.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2584 sec 2024-03-28T06:31:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:54 smithi086 ceph-mon[35163]: pgmap v1926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:54.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:54 smithi159 ceph-mon[36109]: pgmap v1926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:54.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:54 smithi055 ceph-mon[31863]: pgmap v1926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:31:54.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2585 sec 2024-03-28T06:31:55.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2586 sec 2024-03-28T06:31:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:56 smithi086 ceph-mon[35163]: pgmap v1927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:56.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:56 smithi159 ceph-mon[36109]: pgmap v1927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:56 smithi055 ceph-mon[31863]: pgmap v1927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:56.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2587 sec 2024-03-28T06:31:57.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2588 sec 2024-03-28T06:31:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:58 smithi086 ceph-mon[35163]: pgmap v1928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1917.814282 secs 2024-03-28T06:31:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:58 smithi159 ceph-mon[36109]: pgmap v1928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:58.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1917.814282 secs 2024-03-28T06:31:58.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:58 smithi055 ceph-mon[31863]: pgmap v1928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:31:58.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1917.814282 secs 2024-03-28T06:31:58.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2589 sec 2024-03-28T06:31:59.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2590 sec 2024-03-28T06:32:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:00 smithi086 ceph-mon[35163]: pgmap v1929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:00.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:00 smithi159 ceph-mon[36109]: pgmap v1929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:00.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:00 smithi055 ceph-mon[31863]: pgmap v1929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:00.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2591 sec 2024-03-28T06:32:01.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2592 sec 2024-03-28T06:32:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:02 smithi086 ceph-mon[35163]: pgmap v1930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:02.318 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:02 smithi159 ceph-mon[36109]: pgmap v1930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:02.371 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:02 smithi055 ceph-mon[31863]: pgmap v1930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:02.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2593 sec 2024-03-28T06:32:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1922.814346 secs 2024-03-28T06:32:03.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2594 sec 2024-03-28T06:32:03.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1922.814346 secs 2024-03-28T06:32:03.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1922.814346 secs 2024-03-28T06:32:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:04 smithi055 ceph-mon[31863]: pgmap v1931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:04.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2595 sec 2024-03-28T06:32:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:04 smithi086 ceph-mon[35163]: pgmap v1931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:04.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:04 smithi159 ceph-mon[36109]: pgmap v1931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:05.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2596 sec 2024-03-28T06:32:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:06 smithi055 ceph-mon[31863]: pgmap v1932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:06.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2597 sec 2024-03-28T06:32:06.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:06 smithi086 ceph-mon[35163]: pgmap v1932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:06.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:06 smithi159 ceph-mon[36109]: pgmap v1932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:07.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2598 sec 2024-03-28T06:32:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:08 smithi055 ceph-mon[31863]: pgmap v1933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1927.814408 secs 2024-03-28T06:32:08.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2599 sec 2024-03-28T06:32:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:08 smithi086 ceph-mon[35163]: pgmap v1933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1927.814408 secs 2024-03-28T06:32:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:08 smithi159 ceph-mon[36109]: pgmap v1933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1927.814408 secs 2024-03-28T06:32:09.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2600 sec 2024-03-28T06:32:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:10 smithi055 ceph-mon[31863]: pgmap v1934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:10.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2601 sec 2024-03-28T06:32:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:10 smithi086 ceph-mon[35163]: pgmap v1934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:10 smithi159 ceph-mon[36109]: pgmap v1934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:11.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2602 sec 2024-03-28T06:32:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:12 smithi055 ceph-mon[31863]: pgmap v1935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:12.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2603 sec 2024-03-28T06:32:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:12 smithi086 ceph-mon[35163]: pgmap v1935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:12 smithi159 ceph-mon[36109]: pgmap v1935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:32:13.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2604 sec 2024-03-28T06:32:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1932.814533 secs 2024-03-28T06:32:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1932.814533 secs 2024-03-28T06:32:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1932.814533 secs 2024-03-28T06:32:14.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2605 sec 2024-03-28T06:32:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:14 smithi086 ceph-mon[35163]: pgmap v1936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:14 smithi159 ceph-mon[36109]: pgmap v1936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:14 smithi055 ceph-mon[31863]: pgmap v1936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:15.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2606 sec 2024-03-28T06:32:16.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2607 sec 2024-03-28T06:32:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:16 smithi086 ceph-mon[35163]: pgmap v1937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:16 smithi159 ceph-mon[36109]: pgmap v1937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:16 smithi055 ceph-mon[31863]: pgmap v1937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:17.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2608 sec 2024-03-28T06:32:18.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2609 sec 2024-03-28T06:32:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:18 smithi086 ceph-mon[35163]: pgmap v1938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1937.814656 secs 2024-03-28T06:32:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:18 smithi159 ceph-mon[36109]: pgmap v1938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1937.814656 secs 2024-03-28T06:32:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:18 smithi055 ceph-mon[31863]: pgmap v1938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1937.814656 secs 2024-03-28T06:32:19.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2610 sec 2024-03-28T06:32:19.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:32:19.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:32:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:32:20.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2611 sec 2024-03-28T06:32:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:20 smithi086 ceph-mon[35163]: pgmap v1939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:32:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:32:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:32:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:20 smithi159 ceph-mon[36109]: pgmap v1939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:32:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:32:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:32:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:20 smithi055 ceph-mon[31863]: pgmap v1939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:32:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:32:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:32:21.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2612 sec 2024-03-28T06:32:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:21 smithi086 ceph-mon[35163]: pgmap v1940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:21 smithi086 ceph-mon[35163]: pgmap v1941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:32:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:21 smithi159 ceph-mon[36109]: pgmap v1940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:21 smithi159 ceph-mon[36109]: pgmap v1941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:32:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:21 smithi055 ceph-mon[31863]: pgmap v1940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:21 smithi055 ceph-mon[31863]: pgmap v1941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:32:22.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2613 sec 2024-03-28T06:32:23.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2614 sec 2024-03-28T06:32:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:23 smithi086 ceph-mon[35163]: pgmap v1942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1942.814721 secs 2024-03-28T06:32:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:23 smithi159 ceph-mon[36109]: pgmap v1942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1942.814721 secs 2024-03-28T06:32:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:23 smithi055 ceph-mon[31863]: pgmap v1942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1942.814721 secs 2024-03-28T06:32:24.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2615 sec 2024-03-28T06:32:25.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2616 sec 2024-03-28T06:32:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:25 smithi086 ceph-mon[35163]: pgmap v1943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:25 smithi159 ceph-mon[36109]: pgmap v1943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:25 smithi055 ceph-mon[31863]: pgmap v1943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:26.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2617 sec 2024-03-28T06:32:27.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2618 sec 2024-03-28T06:32:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:27 smithi086 ceph-mon[35163]: pgmap v1944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:27 smithi159 ceph-mon[36109]: pgmap v1944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:27 smithi055 ceph-mon[31863]: pgmap v1944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:28.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2619 sec 2024-03-28T06:32:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1947.814810 secs 2024-03-28T06:32:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1947.814810 secs 2024-03-28T06:32:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1947.814810 secs 2024-03-28T06:32:29.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2620 sec 2024-03-28T06:32:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:29 smithi086 ceph-mon[35163]: pgmap v1945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:29 smithi159 ceph-mon[36109]: pgmap v1945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:29 smithi055 ceph-mon[31863]: pgmap v1945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:30.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2621 sec 2024-03-28T06:32:31.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2622 sec 2024-03-28T06:32:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:31 smithi086 ceph-mon[35163]: pgmap v1946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:32:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:31 smithi159 ceph-mon[36109]: pgmap v1946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:32:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:31 smithi055 ceph-mon[31863]: pgmap v1946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:32:32.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2623 sec 2024-03-28T06:32:33.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2624 sec 2024-03-28T06:32:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:33 smithi086 ceph-mon[35163]: pgmap v1947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1952.814842 secs 2024-03-28T06:32:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:33 smithi159 ceph-mon[36109]: pgmap v1947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1952.814842 secs 2024-03-28T06:32:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:33 smithi055 ceph-mon[31863]: pgmap v1947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1952.814842 secs 2024-03-28T06:32:34.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2625 sec 2024-03-28T06:32:35.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2626 sec 2024-03-28T06:32:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:35 smithi086 ceph-mon[35163]: pgmap v1948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:35 smithi159 ceph-mon[36109]: pgmap v1948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:35 smithi055 ceph-mon[31863]: pgmap v1948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:36.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2627 sec 2024-03-28T06:32:37.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2628 sec 2024-03-28T06:32:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:37 smithi086 ceph-mon[35163]: pgmap v1949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:37 smithi159 ceph-mon[36109]: pgmap v1949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:37 smithi055 ceph-mon[31863]: pgmap v1949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:38.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2629 sec 2024-03-28T06:32:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1957.814924 secs 2024-03-28T06:32:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1957.814924 secs 2024-03-28T06:32:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1957.814924 secs 2024-03-28T06:32:39.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2630 sec 2024-03-28T06:32:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:39 smithi086 ceph-mon[35163]: pgmap v1950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:39 smithi159 ceph-mon[36109]: pgmap v1950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:39 smithi055 ceph-mon[31863]: pgmap v1950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:40.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2631 sec 2024-03-28T06:32:41.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2632 sec 2024-03-28T06:32:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:41 smithi086 ceph-mon[35163]: pgmap v1951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:41 smithi159 ceph-mon[36109]: pgmap v1951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:41 smithi055 ceph-mon[31863]: pgmap v1951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:42.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2633 sec 2024-03-28T06:32:43.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2634 sec 2024-03-28T06:32:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:43 smithi086 ceph-mon[35163]: pgmap v1952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1962.815049 secs 2024-03-28T06:32:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:43 smithi159 ceph-mon[36109]: pgmap v1952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1962.815049 secs 2024-03-28T06:32:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:43 smithi055 ceph-mon[31863]: pgmap v1952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1962.815049 secs 2024-03-28T06:32:44.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2635 sec 2024-03-28T06:32:45.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2636 sec 2024-03-28T06:32:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:45 smithi086 ceph-mon[35163]: pgmap v1953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:45 smithi159 ceph-mon[36109]: pgmap v1953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:45 smithi055 ceph-mon[31863]: pgmap v1953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:46.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2637 sec 2024-03-28T06:32:47.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2638 sec 2024-03-28T06:32:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:47 smithi086 ceph-mon[35163]: pgmap v1954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:47 smithi159 ceph-mon[36109]: pgmap v1954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:47 smithi055 ceph-mon[31863]: pgmap v1954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:48.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2639 sec 2024-03-28T06:32:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1967.815125 secs 2024-03-28T06:32:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1967.815125 secs 2024-03-28T06:32:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1967.815125 secs 2024-03-28T06:32:49.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2640 sec 2024-03-28T06:32:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:49 smithi086 ceph-mon[35163]: pgmap v1955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:49 smithi159 ceph-mon[36109]: pgmap v1955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:49 smithi055 ceph-mon[31863]: pgmap v1955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:50.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2641 sec 2024-03-28T06:32:51.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2642 sec 2024-03-28T06:32:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:51 smithi055 ceph-mon[31863]: pgmap v1956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:51 smithi086 ceph-mon[35163]: pgmap v1956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:51 smithi159 ceph-mon[36109]: pgmap v1956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:32:52.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2643 sec 2024-03-28T06:32:53.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2644 sec 2024-03-28T06:32:53.621 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:53 smithi159 ceph-mon[36109]: pgmap v1957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:53.621 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1972.815248 secs 2024-03-28T06:32:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:53 smithi055 ceph-mon[31863]: pgmap v1957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1972.815248 secs 2024-03-28T06:32:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:53 smithi086 ceph-mon[35163]: pgmap v1957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1972.815248 secs 2024-03-28T06:32:54.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2645 sec 2024-03-28T06:32:55.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2646 sec 2024-03-28T06:32:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:55 smithi055 ceph-mon[31863]: pgmap v1958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:55 smithi086 ceph-mon[35163]: pgmap v1958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:55 smithi159 ceph-mon[36109]: pgmap v1958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:56.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2647 sec 2024-03-28T06:32:57.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2648 sec 2024-03-28T06:32:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:57 smithi055 ceph-mon[31863]: pgmap v1959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:57 smithi086 ceph-mon[35163]: pgmap v1959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:57 smithi159 ceph-mon[36109]: pgmap v1959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:58.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2649 sec 2024-03-28T06:32:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1977.815331 secs 2024-03-28T06:32:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1977.815331 secs 2024-03-28T06:32:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1977.815331 secs 2024-03-28T06:32:59.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2650 sec 2024-03-28T06:32:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:32:59 smithi055 ceph-mon[31863]: pgmap v1960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:32:59 smithi086 ceph-mon[35163]: pgmap v1960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:32:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:32:59 smithi159 ceph-mon[36109]: pgmap v1960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:00.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2651 sec 2024-03-28T06:33:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:00 smithi086 ceph-mon[35163]: pgmap v1961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:00 smithi159 ceph-mon[36109]: pgmap v1961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:00 smithi055 ceph-mon[31863]: pgmap v1961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:01.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2652 sec 2024-03-28T06:33:02.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2653 sec 2024-03-28T06:33:03.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2654 sec 2024-03-28T06:33:03.521 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:03 smithi086 ceph-mon[35163]: pgmap v1962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:03.521 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1982.815454 secs 2024-03-28T06:33:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:03 smithi159 ceph-mon[36109]: pgmap v1962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1982.815454 secs 2024-03-28T06:33:03.576 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:03 smithi055 ceph-mon[31863]: pgmap v1962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:03.576 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1982.815454 secs 2024-03-28T06:33:04.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2655 sec 2024-03-28T06:33:05.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2656 sec 2024-03-28T06:33:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:05 smithi086 ceph-mon[35163]: pgmap v1963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:05 smithi159 ceph-mon[36109]: pgmap v1963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:05 smithi055 ceph-mon[31863]: pgmap v1963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:06.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2657 sec 2024-03-28T06:33:07.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2658 sec 2024-03-28T06:33:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:07 smithi086 ceph-mon[35163]: pgmap v1964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:07 smithi159 ceph-mon[36109]: pgmap v1964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:07 smithi055 ceph-mon[31863]: pgmap v1964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:08.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2659 sec 2024-03-28T06:33:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1987.815573 secs 2024-03-28T06:33:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1987.815573 secs 2024-03-28T06:33:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1987.815573 secs 2024-03-28T06:33:09.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2660 sec 2024-03-28T06:33:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:09 smithi086 ceph-mon[35163]: pgmap v1965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:09 smithi159 ceph-mon[36109]: pgmap v1965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:09 smithi055 ceph-mon[31863]: pgmap v1965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:10.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2661 sec 2024-03-28T06:33:11.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2662 sec 2024-03-28T06:33:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:11 smithi086 ceph-mon[35163]: pgmap v1966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:11 smithi159 ceph-mon[36109]: pgmap v1966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:11 smithi055 ceph-mon[31863]: pgmap v1966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:12.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2663 sec 2024-03-28T06:33:13.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2664 sec 2024-03-28T06:33:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:13 smithi086 ceph-mon[35163]: pgmap v1967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1992.815683 secs 2024-03-28T06:33:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:13 smithi159 ceph-mon[36109]: pgmap v1967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1992.815683 secs 2024-03-28T06:33:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:13 smithi055 ceph-mon[31863]: pgmap v1967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1992.815683 secs 2024-03-28T06:33:14.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2665 sec 2024-03-28T06:33:15.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2666 sec 2024-03-28T06:33:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:15 smithi086 ceph-mon[35163]: pgmap v1968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:15 smithi159 ceph-mon[36109]: pgmap v1968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:15 smithi055 ceph-mon[31863]: pgmap v1968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:16.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2667 sec 2024-03-28T06:33:17.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2668 sec 2024-03-28T06:33:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:17 smithi086 ceph-mon[35163]: pgmap v1969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:17 smithi159 ceph-mon[36109]: pgmap v1969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:17 smithi055 ceph-mon[31863]: pgmap v1969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:18.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2669 sec 2024-03-28T06:33:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 1997.815761 secs 2024-03-28T06:33:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 1997.815761 secs 2024-03-28T06:33:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 1997.815761 secs 2024-03-28T06:33:19.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2670 sec 2024-03-28T06:33:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:19 smithi086 ceph-mon[35163]: pgmap v1970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:19 smithi159 ceph-mon[36109]: pgmap v1970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:19 smithi055 ceph-mon[31863]: pgmap v1970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:20.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2671 sec 2024-03-28T06:33:21.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2672 sec 2024-03-28T06:33:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:21 smithi086 ceph-mon[35163]: pgmap v1971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:33:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:21 smithi159 ceph-mon[36109]: pgmap v1971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:33:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:21 smithi055 ceph-mon[31863]: pgmap v1971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:33:22.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2673 sec 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:33:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:33:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:33:23.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2674 sec 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: pgmap v1972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: pgmap v1973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2002.815861 secs 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: pgmap v1972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: pgmap v1973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2002.815861 secs 2024-03-28T06:33:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: pgmap v1972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: pgmap v1973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2002.815861 secs 2024-03-28T06:33:24.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2675 sec 2024-03-28T06:33:25.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2676 sec 2024-03-28T06:33:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:25 smithi086 ceph-mon[35163]: pgmap v1974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:25 smithi159 ceph-mon[36109]: pgmap v1974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:25 smithi055 ceph-mon[31863]: pgmap v1974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:26.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2677 sec 2024-03-28T06:33:27.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2678 sec 2024-03-28T06:33:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:27 smithi086 ceph-mon[35163]: pgmap v1975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:27 smithi159 ceph-mon[36109]: pgmap v1975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:27 smithi055 ceph-mon[31863]: pgmap v1975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:28.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2679 sec 2024-03-28T06:33:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2007.815976 secs 2024-03-28T06:33:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2007.815976 secs 2024-03-28T06:33:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2007.815976 secs 2024-03-28T06:33:29.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2680 sec 2024-03-28T06:33:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:29 smithi055 ceph-mon[31863]: pgmap v1976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:33:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:29 smithi086 ceph-mon[35163]: pgmap v1976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:33:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:29 smithi159 ceph-mon[36109]: pgmap v1976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:33:30.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2681 sec 2024-03-28T06:33:31.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2682 sec 2024-03-28T06:33:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:31 smithi055 ceph-mon[31863]: pgmap v1977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:31 smithi086 ceph-mon[35163]: pgmap v1977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:31 smithi159 ceph-mon[36109]: pgmap v1977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:32.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2683 sec 2024-03-28T06:33:33.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2684 sec 2024-03-28T06:33:33.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:33 smithi086 ceph-mon[35163]: pgmap v1978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:33:33.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2012.816059 secs 2024-03-28T06:33:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:33 smithi055 ceph-mon[31863]: pgmap v1978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:33:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2012.816059 secs 2024-03-28T06:33:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:33 smithi159 ceph-mon[36109]: pgmap v1978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:33:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2012.816059 secs 2024-03-28T06:33:34.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2685 sec 2024-03-28T06:33:35.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2686 sec 2024-03-28T06:33:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:35 smithi055 ceph-mon[31863]: pgmap v1979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:35 smithi086 ceph-mon[35163]: pgmap v1979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:35 smithi159 ceph-mon[36109]: pgmap v1979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:36.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2687 sec 2024-03-28T06:33:37.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2688 sec 2024-03-28T06:33:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:37 smithi055 ceph-mon[31863]: pgmap v1980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:37 smithi086 ceph-mon[35163]: pgmap v1980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:37 smithi159 ceph-mon[36109]: pgmap v1980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:38.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2689 sec 2024-03-28T06:33:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2017.816149 secs 2024-03-28T06:33:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:38 smithi086 ceph-mon[35163]: pgmap v1981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2017.816149 secs 2024-03-28T06:33:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:38 smithi159 ceph-mon[36109]: pgmap v1981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2017.816149 secs 2024-03-28T06:33:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:38 smithi055 ceph-mon[31863]: pgmap v1981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:33:39.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2690 sec 2024-03-28T06:33:40.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2691 sec 2024-03-28T06:33:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:40 smithi086 ceph-mon[35163]: pgmap v1982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:40 smithi159 ceph-mon[36109]: pgmap v1982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:40 smithi055 ceph-mon[31863]: pgmap v1982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:41.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2692 sec 2024-03-28T06:33:42.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2693 sec 2024-03-28T06:33:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:42 smithi086 ceph-mon[35163]: pgmap v1983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2022.816214 secs 2024-03-28T06:33:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:42 smithi159 ceph-mon[36109]: pgmap v1983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2022.816214 secs 2024-03-28T06:33:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:42 smithi055 ceph-mon[31863]: pgmap v1983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2022.816214 secs 2024-03-28T06:33:43.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2694 sec 2024-03-28T06:33:44.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2695 sec 2024-03-28T06:33:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:44 smithi086 ceph-mon[35163]: pgmap v1984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:44 smithi159 ceph-mon[36109]: pgmap v1984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:44 smithi055 ceph-mon[31863]: pgmap v1984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:45.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2696 sec 2024-03-28T06:33:46.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2697 sec 2024-03-28T06:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:46 smithi086 ceph-mon[35163]: pgmap v1985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:46 smithi159 ceph-mon[36109]: pgmap v1985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:46 smithi055 ceph-mon[31863]: pgmap v1985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:47.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2698 sec 2024-03-28T06:33:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2027.816336 secs 2024-03-28T06:33:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2027.816336 secs 2024-03-28T06:33:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2027.816336 secs 2024-03-28T06:33:48.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2699 sec 2024-03-28T06:33:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:48 smithi086 ceph-mon[35163]: pgmap v1986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:33:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:48 smithi159 ceph-mon[36109]: pgmap v1986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:33:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:48 smithi055 ceph-mon[31863]: pgmap v1986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:33:49.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2700 sec 2024-03-28T06:33:50.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2701 sec 2024-03-28T06:33:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:50 smithi086 ceph-mon[35163]: pgmap v1987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:50 smithi159 ceph-mon[36109]: pgmap v1987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:50 smithi055 ceph-mon[31863]: pgmap v1987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:51.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2702 sec 2024-03-28T06:33:52.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2703 sec 2024-03-28T06:33:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:52 smithi086 ceph-mon[35163]: pgmap v1988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2032.816453 secs 2024-03-28T06:33:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:52 smithi159 ceph-mon[36109]: pgmap v1988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2032.816453 secs 2024-03-28T06:33:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:52 smithi055 ceph-mon[31863]: pgmap v1988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2032.816453 secs 2024-03-28T06:33:53.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2704 sec 2024-03-28T06:33:54.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2705 sec 2024-03-28T06:33:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:54 smithi086 ceph-mon[35163]: pgmap v1989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:54 smithi159 ceph-mon[36109]: pgmap v1989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:54 smithi055 ceph-mon[31863]: pgmap v1989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:55.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2706 sec 2024-03-28T06:33:56.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2707 sec 2024-03-28T06:33:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:56 smithi086 ceph-mon[35163]: pgmap v1990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:56 smithi159 ceph-mon[36109]: pgmap v1990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:56 smithi055 ceph-mon[31863]: pgmap v1990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:33:57.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2708 sec 2024-03-28T06:33:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2037.816575 secs 2024-03-28T06:33:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2037.816575 secs 2024-03-28T06:33:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2037.816575 secs 2024-03-28T06:33:58.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2709 sec 2024-03-28T06:33:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:33:59 smithi086 ceph-mon[35163]: pgmap v1991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:33:59 smithi159 ceph-mon[36109]: pgmap v1991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:33:59 smithi055 ceph-mon[31863]: pgmap v1991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:33:59.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2710 sec 2024-03-28T06:34:00.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2711 sec 2024-03-28T06:34:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:01 smithi086 ceph-mon[35163]: pgmap v1992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:01 smithi159 ceph-mon[36109]: pgmap v1992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:01 smithi055 ceph-mon[31863]: pgmap v1992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:01.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2712 sec 2024-03-28T06:34:02.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2713 sec 2024-03-28T06:34:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:03 smithi086 ceph-mon[35163]: pgmap v1993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2042.816700 secs 2024-03-28T06:34:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:03 smithi159 ceph-mon[36109]: pgmap v1993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2042.816700 secs 2024-03-28T06:34:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:03 smithi055 ceph-mon[31863]: pgmap v1993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2042.816700 secs 2024-03-28T06:34:03.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2714 sec 2024-03-28T06:34:04.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2715 sec 2024-03-28T06:34:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:05 smithi086 ceph-mon[35163]: pgmap v1994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:05 smithi159 ceph-mon[36109]: pgmap v1994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:05 smithi055 ceph-mon[31863]: pgmap v1994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:05.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2716 sec 2024-03-28T06:34:06.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2717 sec 2024-03-28T06:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:07 smithi086 ceph-mon[35163]: pgmap v1995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:07 smithi159 ceph-mon[36109]: pgmap v1995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:07 smithi055 ceph-mon[31863]: pgmap v1995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:07.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2718 sec 2024-03-28T06:34:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2047.816822 secs 2024-03-28T06:34:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2047.816822 secs 2024-03-28T06:34:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2047.816822 secs 2024-03-28T06:34:08.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2719 sec 2024-03-28T06:34:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:09 smithi086 ceph-mon[35163]: pgmap v1996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:09 smithi159 ceph-mon[36109]: pgmap v1996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:09 smithi055 ceph-mon[31863]: pgmap v1996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:09.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2720 sec 2024-03-28T06:34:10.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2721 sec 2024-03-28T06:34:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:11 smithi086 ceph-mon[35163]: pgmap v1997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:11 smithi159 ceph-mon[36109]: pgmap v1997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:11 smithi055 ceph-mon[31863]: pgmap v1997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:11.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2722 sec 2024-03-28T06:34:12.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2723 sec 2024-03-28T06:34:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:13 smithi086 ceph-mon[35163]: pgmap v1998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2052.816917 secs 2024-03-28T06:34:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:13 smithi159 ceph-mon[36109]: pgmap v1998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2052.816917 secs 2024-03-28T06:34:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:13 smithi055 ceph-mon[31863]: pgmap v1998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2052.816917 secs 2024-03-28T06:34:13.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2724 sec 2024-03-28T06:34:14.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2725 sec 2024-03-28T06:34:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:15 smithi159 ceph-mon[36109]: pgmap v1999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:15 smithi055 ceph-mon[31863]: pgmap v1999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:15.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2726 sec 2024-03-28T06:34:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:15 smithi086 ceph-mon[35163]: pgmap v1999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:16.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2727 sec 2024-03-28T06:34:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:17 smithi055 ceph-mon[31863]: pgmap v2000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:17.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2728 sec 2024-03-28T06:34:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:17 smithi086 ceph-mon[35163]: pgmap v2000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:17 smithi159 ceph-mon[36109]: pgmap v2000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2057.816987 secs 2024-03-28T06:34:18.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2729 sec 2024-03-28T06:34:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2057.816987 secs 2024-03-28T06:34:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2057.816987 secs 2024-03-28T06:34:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:19 smithi055 ceph-mon[31863]: pgmap v2001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:19.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2730 sec 2024-03-28T06:34:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:19 smithi086 ceph-mon[35163]: pgmap v2001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:19 smithi159 ceph-mon[36109]: pgmap v2001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:20.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2731 sec 2024-03-28T06:34:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:21 smithi055 ceph-mon[31863]: pgmap v2002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:21.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2732 sec 2024-03-28T06:34:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:21 smithi086 ceph-mon[35163]: pgmap v2002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:21 smithi159 ceph-mon[36109]: pgmap v2002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:22.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2733 sec 2024-03-28T06:34:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:23 smithi055 ceph-mon[31863]: pgmap v2003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:34:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2062.817061 secs 2024-03-28T06:34:23.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:23 smithi159 ceph-mon[36109]: pgmap v2003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:23.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:34:23.374 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2062.817061 secs 2024-03-28T06:34:23.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2734 sec 2024-03-28T06:34:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:23 smithi086 ceph-mon[35163]: pgmap v2003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:34:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2062.817061 secs 2024-03-28T06:34:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2735 sec 2024-03-28T06:34:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:34:25.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2736 sec 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: pgmap v2004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:34:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:34:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:34:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:34:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: pgmap v2004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:34:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:34:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:34:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:34:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: pgmap v2004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:34:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:34:26.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2737 sec 2024-03-28T06:34:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:26 smithi086 ceph-mon[35163]: pgmap v2005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:34:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:26 smithi086 ceph-mon[35163]: pgmap v2006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:26 smithi159 ceph-mon[36109]: pgmap v2005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:34:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:26 smithi159 ceph-mon[36109]: pgmap v2006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:26 smithi055 ceph-mon[31863]: pgmap v2005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:34:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:26 smithi055 ceph-mon[31863]: pgmap v2006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:27.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2738 sec 2024-03-28T06:34:28.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2739 sec 2024-03-28T06:34:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:28 smithi086 ceph-mon[35163]: pgmap v2007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2067.817140 secs 2024-03-28T06:34:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:28 smithi159 ceph-mon[36109]: pgmap v2007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2067.817140 secs 2024-03-28T06:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:28 smithi055 ceph-mon[31863]: pgmap v2007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2067.817140 secs 2024-03-28T06:34:29.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2740 sec 2024-03-28T06:34:30.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2741 sec 2024-03-28T06:34:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:30 smithi086 ceph-mon[35163]: pgmap v2008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:30 smithi159 ceph-mon[36109]: pgmap v2008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:30 smithi055 ceph-mon[31863]: pgmap v2008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:31.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2742 sec 2024-03-28T06:34:32.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2743 sec 2024-03-28T06:34:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:32 smithi086 ceph-mon[35163]: pgmap v2009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:32 smithi159 ceph-mon[36109]: pgmap v2009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:32 smithi055 ceph-mon[31863]: pgmap v2009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:34:33.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2744 sec 2024-03-28T06:34:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2072.817259 secs 2024-03-28T06:34:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2072.817259 secs 2024-03-28T06:34:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2072.817259 secs 2024-03-28T06:34:34.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2745 sec 2024-03-28T06:34:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:34 smithi086 ceph-mon[35163]: pgmap v2010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:34 smithi159 ceph-mon[36109]: pgmap v2010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:34 smithi055 ceph-mon[31863]: pgmap v2010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:34:35.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2746 sec 2024-03-28T06:34:36.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2747 sec 2024-03-28T06:34:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:36 smithi086 ceph-mon[35163]: pgmap v2011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:34:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:36 smithi159 ceph-mon[36109]: pgmap v2011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:34:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:36 smithi055 ceph-mon[31863]: pgmap v2011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:34:37.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2748 sec 2024-03-28T06:34:38.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2749 sec 2024-03-28T06:34:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:38 smithi086 ceph-mon[35163]: pgmap v2012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2077.817382 secs 2024-03-28T06:34:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:38 smithi159 ceph-mon[36109]: pgmap v2012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2077.817382 secs 2024-03-28T06:34:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:38 smithi055 ceph-mon[31863]: pgmap v2012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2077.817382 secs 2024-03-28T06:34:39.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2750 sec 2024-03-28T06:34:40.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2751 sec 2024-03-28T06:34:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:40 smithi086 ceph-mon[35163]: pgmap v2013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:40 smithi159 ceph-mon[36109]: pgmap v2013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:40 smithi055 ceph-mon[31863]: pgmap v2013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:41.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2752 sec 2024-03-28T06:34:42.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2753 sec 2024-03-28T06:34:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:42 smithi086 ceph-mon[35163]: pgmap v2014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:42 smithi159 ceph-mon[36109]: pgmap v2014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:42 smithi055 ceph-mon[31863]: pgmap v2014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:43.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2754 sec 2024-03-28T06:34:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2082.817469 secs 2024-03-28T06:34:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2082.817469 secs 2024-03-28T06:34:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2082.817469 secs 2024-03-28T06:34:44.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2755 sec 2024-03-28T06:34:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:44 smithi055 ceph-mon[31863]: pgmap v2015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:44 smithi086 ceph-mon[35163]: pgmap v2015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:44 smithi159 ceph-mon[36109]: pgmap v2015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:45.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2756 sec 2024-03-28T06:34:46.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2757 sec 2024-03-28T06:34:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:46 smithi055 ceph-mon[31863]: pgmap v2016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:46 smithi086 ceph-mon[35163]: pgmap v2016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:46 smithi159 ceph-mon[36109]: pgmap v2016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:47.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2758 sec 2024-03-28T06:34:48.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2759 sec 2024-03-28T06:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:48 smithi055 ceph-mon[31863]: pgmap v2017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2087.817587 secs 2024-03-28T06:34:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:48 smithi086 ceph-mon[35163]: pgmap v2017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2087.817587 secs 2024-03-28T06:34:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:48 smithi159 ceph-mon[36109]: pgmap v2017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2087.817587 secs 2024-03-28T06:34:49.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2760 sec 2024-03-28T06:34:50.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2761 sec 2024-03-28T06:34:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:50 smithi055 ceph-mon[31863]: pgmap v2018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:50 smithi086 ceph-mon[35163]: pgmap v2018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:50 smithi159 ceph-mon[36109]: pgmap v2018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:51.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2762 sec 2024-03-28T06:34:52.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2763 sec 2024-03-28T06:34:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:52 smithi055 ceph-mon[31863]: pgmap v2019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:52 smithi086 ceph-mon[35163]: pgmap v2019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:52 smithi159 ceph-mon[36109]: pgmap v2019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:34:53.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2764 sec 2024-03-28T06:34:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2092.817662 secs 2024-03-28T06:34:53.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2092.817662 secs 2024-03-28T06:34:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2092.817662 secs 2024-03-28T06:34:54.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2765 sec 2024-03-28T06:34:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:54 smithi086 ceph-mon[35163]: pgmap v2020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:54 smithi159 ceph-mon[36109]: pgmap v2020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:54 smithi055 ceph-mon[31863]: pgmap v2020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:34:55.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2766 sec 2024-03-28T06:34:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:55 smithi086 ceph-mon[35163]: pgmap v2021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:55 smithi159 ceph-mon[36109]: pgmap v2021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:55 smithi055 ceph-mon[31863]: pgmap v2021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:56.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2767 sec 2024-03-28T06:34:57.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2768 sec 2024-03-28T06:34:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:57 smithi086 ceph-mon[35163]: pgmap v2022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:57 smithi159 ceph-mon[36109]: pgmap v2022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:57 smithi055 ceph-mon[31863]: pgmap v2022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:58.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2769 sec 2024-03-28T06:34:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2097.817732 secs 2024-03-28T06:34:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2097.817732 secs 2024-03-28T06:34:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2097.817732 secs 2024-03-28T06:34:59.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2770 sec 2024-03-28T06:34:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:34:59 smithi086 ceph-mon[35163]: pgmap v2023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:34:59 smithi159 ceph-mon[36109]: pgmap v2023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:34:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:34:59 smithi055 ceph-mon[31863]: pgmap v2023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:00.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2771 sec 2024-03-28T06:35:01.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2772 sec 2024-03-28T06:35:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:01 smithi086 ceph-mon[35163]: pgmap v2024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:01.837 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:01 smithi159 ceph-mon[36109]: pgmap v2024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:01 smithi055 ceph-mon[31863]: pgmap v2024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:02.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2773 sec 2024-03-28T06:35:03.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2774 sec 2024-03-28T06:35:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2102.817818 secs 2024-03-28T06:35:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:03 smithi086 ceph-mon[35163]: pgmap v2025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2102.817818 secs 2024-03-28T06:35:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:03 smithi159 ceph-mon[36109]: pgmap v2025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2102.817818 secs 2024-03-28T06:35:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:03 smithi055 ceph-mon[31863]: pgmap v2025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:04.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2775 sec 2024-03-28T06:35:05.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2776 sec 2024-03-28T06:35:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:05 smithi086 ceph-mon[35163]: pgmap v2026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:05 smithi159 ceph-mon[36109]: pgmap v2026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:05 smithi055 ceph-mon[31863]: pgmap v2026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:06.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2777 sec 2024-03-28T06:35:07.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2778 sec 2024-03-28T06:35:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:07 smithi086 ceph-mon[35163]: pgmap v2027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:07 smithi159 ceph-mon[36109]: pgmap v2027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:07 smithi055 ceph-mon[31863]: pgmap v2027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:08.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2779 sec 2024-03-28T06:35:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2107.817907 secs 2024-03-28T06:35:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2107.817907 secs 2024-03-28T06:35:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2107.817907 secs 2024-03-28T06:35:09.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2780 sec 2024-03-28T06:35:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:09 smithi086 ceph-mon[35163]: pgmap v2028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:09 smithi159 ceph-mon[36109]: pgmap v2028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:09 smithi055 ceph-mon[31863]: pgmap v2028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:10.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2781 sec 2024-03-28T06:35:11.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2782 sec 2024-03-28T06:35:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:11 smithi086 ceph-mon[35163]: pgmap v2029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:11 smithi159 ceph-mon[36109]: pgmap v2029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:11 smithi055 ceph-mon[31863]: pgmap v2029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:12.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2783 sec 2024-03-28T06:35:13.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2784 sec 2024-03-28T06:35:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2112.817996 secs 2024-03-28T06:35:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:13 smithi086 ceph-mon[35163]: pgmap v2030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2112.817996 secs 2024-03-28T06:35:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:13 smithi159 ceph-mon[36109]: pgmap v2030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2112.817996 secs 2024-03-28T06:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:13 smithi055 ceph-mon[31863]: pgmap v2030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:14.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2785 sec 2024-03-28T06:35:15.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2786 sec 2024-03-28T06:35:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:15 smithi086 ceph-mon[35163]: pgmap v2031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:15 smithi159 ceph-mon[36109]: pgmap v2031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:15 smithi055 ceph-mon[31863]: pgmap v2031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:16.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2787 sec 2024-03-28T06:35:17.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2788 sec 2024-03-28T06:35:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:17 smithi086 ceph-mon[35163]: pgmap v2032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:17 smithi159 ceph-mon[36109]: pgmap v2032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:17 smithi055 ceph-mon[31863]: pgmap v2032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:18.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2789 sec 2024-03-28T06:35:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2117.818104 secs 2024-03-28T06:35:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2117.818104 secs 2024-03-28T06:35:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2117.818104 secs 2024-03-28T06:35:19.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2790 sec 2024-03-28T06:35:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:19 smithi055 ceph-mon[31863]: pgmap v2033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:19 smithi086 ceph-mon[35163]: pgmap v2033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:19 smithi159 ceph-mon[36109]: pgmap v2033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:20.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2791 sec 2024-03-28T06:35:21.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2792 sec 2024-03-28T06:35:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:21 smithi055 ceph-mon[31863]: pgmap v2034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:21 smithi086 ceph-mon[35163]: pgmap v2034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:21 smithi159 ceph-mon[36109]: pgmap v2034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:35:22.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2793 sec 2024-03-28T06:35:23.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2794 sec 2024-03-28T06:35:23.874 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2122.818224 secs 2024-03-28T06:35:23.874 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:23 smithi159 ceph-mon[36109]: pgmap v2035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2122.818224 secs 2024-03-28T06:35:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:23 smithi055 ceph-mon[31863]: pgmap v2035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2122.818224 secs 2024-03-28T06:35:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:23 smithi086 ceph-mon[35163]: pgmap v2035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:24.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2795 sec 2024-03-28T06:35:25.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2796 sec 2024-03-28T06:35:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:25 smithi055 ceph-mon[31863]: pgmap v2036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:35:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:25 smithi086 ceph-mon[35163]: pgmap v2036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:35:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:25 smithi159 ceph-mon[36109]: pgmap v2036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:35:26.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2797 sec 2024-03-28T06:35:27.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2798 sec 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: pgmap v2037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: pgmap v2038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: pgmap v2039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2127.818303 secs 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: pgmap v2037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: pgmap v2038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: pgmap v2039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2127.818303 secs 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: pgmap v2037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: pgmap v2038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: pgmap v2039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:35:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2127.818303 secs 2024-03-28T06:35:28.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2799 sec 2024-03-28T06:35:29.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2800 sec 2024-03-28T06:35:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:30 smithi086 ceph-mon[35163]: pgmap v2040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:35:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:30 smithi159 ceph-mon[36109]: pgmap v2040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:35:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:30 smithi055 ceph-mon[31863]: pgmap v2040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:35:30.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2801 sec 2024-03-28T06:35:31.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2802 sec 2024-03-28T06:35:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:32 smithi055 ceph-mon[31863]: pgmap v2041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:32.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2803 sec 2024-03-28T06:35:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:32 smithi086 ceph-mon[35163]: pgmap v2041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:32 smithi159 ceph-mon[36109]: pgmap v2041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2132.818378 secs 2024-03-28T06:35:33.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2132.818378 secs 2024-03-28T06:35:33.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2804 sec 2024-03-28T06:35:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2132.818378 secs 2024-03-28T06:35:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:34 smithi055 ceph-mon[31863]: pgmap v2042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:34.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2805 sec 2024-03-28T06:35:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:34 smithi086 ceph-mon[35163]: pgmap v2042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:34 smithi159 ceph-mon[36109]: pgmap v2042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:35:35.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2806 sec 2024-03-28T06:35:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:36 smithi055 ceph-mon[31863]: pgmap v2043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:36.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2807 sec 2024-03-28T06:35:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:36 smithi086 ceph-mon[35163]: pgmap v2043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:36 smithi159 ceph-mon[36109]: pgmap v2043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:37.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2808 sec 2024-03-28T06:35:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:38 smithi055 ceph-mon[31863]: pgmap v2044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:35:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2137.818438 secs 2024-03-28T06:35:38.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2809 sec 2024-03-28T06:35:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:38 smithi086 ceph-mon[35163]: pgmap v2044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:35:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2137.818438 secs 2024-03-28T06:35:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:38 smithi159 ceph-mon[36109]: pgmap v2044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:35:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2137.818438 secs 2024-03-28T06:35:39.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2810 sec 2024-03-28T06:35:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:40 smithi055 ceph-mon[31863]: pgmap v2045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:40.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2811 sec 2024-03-28T06:35:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:40 smithi086 ceph-mon[35163]: pgmap v2045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:40 smithi159 ceph-mon[36109]: pgmap v2045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:41.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2812 sec 2024-03-28T06:35:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:42 smithi055 ceph-mon[31863]: pgmap v2046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:42.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2813 sec 2024-03-28T06:35:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:42 smithi086 ceph-mon[35163]: pgmap v2046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:42 smithi159 ceph-mon[36109]: pgmap v2046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2142.818562 secs 2024-03-28T06:35:43.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2814 sec 2024-03-28T06:35:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2142.818562 secs 2024-03-28T06:35:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2142.818562 secs 2024-03-28T06:35:44.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2815 sec 2024-03-28T06:35:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:44 smithi086 ceph-mon[35163]: pgmap v2047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:44 smithi159 ceph-mon[36109]: pgmap v2047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:44 smithi055 ceph-mon[31863]: pgmap v2047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:45.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2816 sec 2024-03-28T06:35:46.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2817 sec 2024-03-28T06:35:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:46 smithi086 ceph-mon[35163]: pgmap v2048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:46 smithi159 ceph-mon[36109]: pgmap v2048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:46 smithi055 ceph-mon[31863]: pgmap v2048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:47.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2818 sec 2024-03-28T06:35:48.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2819 sec 2024-03-28T06:35:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:48 smithi086 ceph-mon[35163]: pgmap v2049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2147.818621 secs 2024-03-28T06:35:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:48 smithi159 ceph-mon[36109]: pgmap v2049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2147.818621 secs 2024-03-28T06:35:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:48 smithi055 ceph-mon[31863]: pgmap v2049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2147.818621 secs 2024-03-28T06:35:49.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2820 sec 2024-03-28T06:35:50.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2821 sec 2024-03-28T06:35:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:50 smithi086 ceph-mon[35163]: pgmap v2050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:50 smithi159 ceph-mon[36109]: pgmap v2050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:50 smithi055 ceph-mon[31863]: pgmap v2050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:51.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2822 sec 2024-03-28T06:35:52.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2823 sec 2024-03-28T06:35:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:52 smithi086 ceph-mon[35163]: pgmap v2051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:52 smithi159 ceph-mon[36109]: pgmap v2051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:52 smithi055 ceph-mon[31863]: pgmap v2051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:53.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2152.818747 secs 2024-03-28T06:35:53.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2824 sec 2024-03-28T06:35:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2152.818747 secs 2024-03-28T06:35:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2152.818747 secs 2024-03-28T06:35:54.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2825 sec 2024-03-28T06:35:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:54 smithi086 ceph-mon[35163]: pgmap v2052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:54 smithi159 ceph-mon[36109]: pgmap v2052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:54 smithi055 ceph-mon[31863]: pgmap v2052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:55.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2826 sec 2024-03-28T06:35:56.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2827 sec 2024-03-28T06:35:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:56 smithi086 ceph-mon[35163]: pgmap v2053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:56.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:56 smithi159 ceph-mon[36109]: pgmap v2053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:56 smithi055 ceph-mon[31863]: pgmap v2053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:35:57.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2828 sec 2024-03-28T06:35:58.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2829 sec 2024-03-28T06:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:58 smithi086 ceph-mon[35163]: pgmap v2054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:35:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2157.818857 secs 2024-03-28T06:35:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:58 smithi159 ceph-mon[36109]: pgmap v2054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:35:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2157.818857 secs 2024-03-28T06:35:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:58 smithi055 ceph-mon[31863]: pgmap v2054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:35:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:35:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2157.818857 secs 2024-03-28T06:35:59.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2830 sec 2024-03-28T06:36:00.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2831 sec 2024-03-28T06:36:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:00 smithi086 ceph-mon[35163]: pgmap v2055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:00 smithi159 ceph-mon[36109]: pgmap v2055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:00 smithi055 ceph-mon[31863]: pgmap v2055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:01.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2832 sec 2024-03-28T06:36:02.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2833 sec 2024-03-28T06:36:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:02 smithi086 ceph-mon[35163]: pgmap v2056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:02 smithi159 ceph-mon[36109]: pgmap v2056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:02 smithi055 ceph-mon[31863]: pgmap v2056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:03.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2834 sec 2024-03-28T06:36:03.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2162.818975 secs 2024-03-28T06:36:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2162.818975 secs 2024-03-28T06:36:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2162.818975 secs 2024-03-28T06:36:04.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2835 sec 2024-03-28T06:36:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:04 smithi086 ceph-mon[35163]: pgmap v2057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:04 smithi159 ceph-mon[36109]: pgmap v2057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:04 smithi055 ceph-mon[31863]: pgmap v2057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:05.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2836 sec 2024-03-28T06:36:06.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2837 sec 2024-03-28T06:36:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:06 smithi086 ceph-mon[35163]: pgmap v2058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:06.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:06 smithi159 ceph-mon[36109]: pgmap v2058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:06.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:06 smithi055 ceph-mon[31863]: pgmap v2058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:07.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2838 sec 2024-03-28T06:36:08.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2839 sec 2024-03-28T06:36:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:08 smithi086 ceph-mon[35163]: pgmap v2059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2167.819052 secs 2024-03-28T06:36:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:08 smithi159 ceph-mon[36109]: pgmap v2059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2167.819052 secs 2024-03-28T06:36:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:08 smithi055 ceph-mon[31863]: pgmap v2059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2167.819052 secs 2024-03-28T06:36:09.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2840 sec 2024-03-28T06:36:10.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2841 sec 2024-03-28T06:36:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:10 smithi086 ceph-mon[35163]: pgmap v2060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:10 smithi159 ceph-mon[36109]: pgmap v2060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:10 smithi055 ceph-mon[31863]: pgmap v2060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:11.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2842 sec 2024-03-28T06:36:12.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2843 sec 2024-03-28T06:36:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:12 smithi086 ceph-mon[35163]: pgmap v2061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:12 smithi159 ceph-mon[36109]: pgmap v2061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:12 smithi055 ceph-mon[31863]: pgmap v2061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:13.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2844 sec 2024-03-28T06:36:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2172.819116 secs 2024-03-28T06:36:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2172.819116 secs 2024-03-28T06:36:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2172.819116 secs 2024-03-28T06:36:14.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2845 sec 2024-03-28T06:36:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:14 smithi086 ceph-mon[35163]: pgmap v2062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:14 smithi159 ceph-mon[36109]: pgmap v2062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:14 smithi055 ceph-mon[31863]: pgmap v2062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:15.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2846 sec 2024-03-28T06:36:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:15 smithi086 ceph-mon[35163]: pgmap v2063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:15 smithi159 ceph-mon[36109]: pgmap v2063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:15 smithi055 ceph-mon[31863]: pgmap v2063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:16.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2847 sec 2024-03-28T06:36:17.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2848 sec 2024-03-28T06:36:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:18 smithi055 ceph-mon[31863]: pgmap v2064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2177.819238 secs 2024-03-28T06:36:18.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2849 sec 2024-03-28T06:36:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:18 smithi086 ceph-mon[35163]: pgmap v2064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2177.819238 secs 2024-03-28T06:36:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:18 smithi159 ceph-mon[36109]: pgmap v2064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2177.819238 secs 2024-03-28T06:36:19.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2850 sec 2024-03-28T06:36:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:20 smithi055 ceph-mon[31863]: pgmap v2065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:20.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2851 sec 2024-03-28T06:36:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:20 smithi086 ceph-mon[35163]: pgmap v2065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:20 smithi159 ceph-mon[36109]: pgmap v2065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:21.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2852 sec 2024-03-28T06:36:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:22 smithi055 ceph-mon[31863]: pgmap v2066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:22.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2853 sec 2024-03-28T06:36:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:22 smithi086 ceph-mon[35163]: pgmap v2066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:22 smithi159 ceph-mon[36109]: pgmap v2066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2182.819360 secs 2024-03-28T06:36:23.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2182.819360 secs 2024-03-28T06:36:23.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2854 sec 2024-03-28T06:36:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2182.819360 secs 2024-03-28T06:36:24.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2855 sec 2024-03-28T06:36:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:24 smithi086 ceph-mon[35163]: pgmap v2067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:24 smithi159 ceph-mon[36109]: pgmap v2067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:24 smithi055 ceph-mon[31863]: pgmap v2067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:25.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2856 sec 2024-03-28T06:36:26.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2857 sec 2024-03-28T06:36:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:26 smithi086 ceph-mon[35163]: pgmap v2068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:26 smithi159 ceph-mon[36109]: pgmap v2068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:26 smithi055 ceph-mon[31863]: pgmap v2068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:27.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2858 sec 2024-03-28T06:36:28.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2859 sec 2024-03-28T06:36:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:28 smithi086 ceph-mon[35163]: pgmap v2069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2187.819481 secs 2024-03-28T06:36:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:36:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:28 smithi159 ceph-mon[36109]: pgmap v2069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2187.819481 secs 2024-03-28T06:36:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:36:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:28 smithi055 ceph-mon[31863]: pgmap v2069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2187.819481 secs 2024-03-28T06:36:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:36:29.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2860 sec 2024-03-28T06:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:30.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2861 sec 2024-03-28T06:36:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:30 smithi086 ceph-mon[35163]: pgmap v2070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:36:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:36:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:30 smithi159 ceph-mon[36109]: pgmap v2070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:36:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:36:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:30 smithi055 ceph-mon[31863]: pgmap v2070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:36:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:36:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:36:31.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2862 sec 2024-03-28T06:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:31 smithi086 ceph-mon[35163]: pgmap v2071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:31 smithi086 ceph-mon[35163]: pgmap v2072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:31 smithi159 ceph-mon[36109]: pgmap v2071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:31 smithi159 ceph-mon[36109]: pgmap v2072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:31.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:31 smithi055 ceph-mon[31863]: pgmap v2071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:31.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:31 smithi055 ceph-mon[31863]: pgmap v2072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:32.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2863 sec 2024-03-28T06:36:33.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2864 sec 2024-03-28T06:36:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:33 smithi159 ceph-mon[36109]: pgmap v2073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2192.819601 secs 2024-03-28T06:36:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:33 smithi055 ceph-mon[31863]: pgmap v2073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2192.819601 secs 2024-03-28T06:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:33 smithi086 ceph-mon[35163]: pgmap v2073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2192.819601 secs 2024-03-28T06:36:34.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2865 sec 2024-03-28T06:36:35.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2866 sec 2024-03-28T06:36:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:35 smithi055 ceph-mon[31863]: pgmap v2074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:36:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:35 smithi086 ceph-mon[35163]: pgmap v2074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:36:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:35 smithi159 ceph-mon[36109]: pgmap v2074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:36:36.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2867 sec 2024-03-28T06:36:37.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2868 sec 2024-03-28T06:36:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:37 smithi055 ceph-mon[31863]: pgmap v2075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:37 smithi086 ceph-mon[35163]: pgmap v2075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T06:36:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:37 smithi159 ceph-mon[36109]: pgmap v2075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T06:36:38.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2869 sec 2024-03-28T06:36:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2197.819730 secs 2024-03-28T06:36:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2197.819730 secs 2024-03-28T06:36:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2197.819730 secs 2024-03-28T06:36:39.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2870 sec 2024-03-28T06:36:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:39 smithi055 ceph-mon[31863]: pgmap v2076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:39 smithi086 ceph-mon[35163]: pgmap v2076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:39 smithi159 ceph-mon[36109]: pgmap v2076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:40.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2871 sec 2024-03-28T06:36:41.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2872 sec 2024-03-28T06:36:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:41 smithi055 ceph-mon[31863]: pgmap v2077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:41 smithi086 ceph-mon[35163]: pgmap v2077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:41.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:41 smithi159 ceph-mon[36109]: pgmap v2077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:36:42.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2873 sec 2024-03-28T06:36:43.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2874 sec 2024-03-28T06:36:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:43 smithi055 ceph-mon[31863]: pgmap v2078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2202.819813 secs 2024-03-28T06:36:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:43 smithi086 ceph-mon[35163]: pgmap v2078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2202.819813 secs 2024-03-28T06:36:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:43 smithi159 ceph-mon[36109]: pgmap v2078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2202.819813 secs 2024-03-28T06:36:44.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2875 sec 2024-03-28T06:36:45.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2876 sec 2024-03-28T06:36:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:45 smithi055 ceph-mon[31863]: pgmap v2079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:45 smithi086 ceph-mon[35163]: pgmap v2079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:45 smithi159 ceph-mon[36109]: pgmap v2079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:46.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2877 sec 2024-03-28T06:36:47.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2878 sec 2024-03-28T06:36:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:47 smithi086 ceph-mon[35163]: pgmap v2080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:47 smithi159 ceph-mon[36109]: pgmap v2080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:47 smithi055 ceph-mon[31863]: pgmap v2080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:48.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2879 sec 2024-03-28T06:36:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2207.819878 secs 2024-03-28T06:36:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2207.819878 secs 2024-03-28T06:36:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2207.819878 secs 2024-03-28T06:36:49.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2880 sec 2024-03-28T06:36:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:49 smithi086 ceph-mon[35163]: pgmap v2081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:36:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:49 smithi159 ceph-mon[36109]: pgmap v2081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:36:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:49 smithi055 ceph-mon[31863]: pgmap v2081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:36:50.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2881 sec 2024-03-28T06:36:51.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2882 sec 2024-03-28T06:36:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:51 smithi086 ceph-mon[35163]: pgmap v2082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:51.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:51 smithi159 ceph-mon[36109]: pgmap v2082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:51.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:51 smithi055 ceph-mon[31863]: pgmap v2082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:36:52.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2883 sec 2024-03-28T06:36:53.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2884 sec 2024-03-28T06:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:53 smithi086 ceph-mon[35163]: pgmap v2083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2212.819901 secs 2024-03-28T06:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:53 smithi159 ceph-mon[36109]: pgmap v2083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2212.819901 secs 2024-03-28T06:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:53 smithi055 ceph-mon[31863]: pgmap v2083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2212.819901 secs 2024-03-28T06:36:54.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2885 sec 2024-03-28T06:36:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:54 smithi086 ceph-mon[35163]: pgmap v2084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:54 smithi159 ceph-mon[36109]: pgmap v2084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:54 smithi055 ceph-mon[31863]: pgmap v2084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:36:55.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2886 sec 2024-03-28T06:36:56.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2887 sec 2024-03-28T06:36:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:56 smithi086 ceph-mon[35163]: pgmap v2085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:36:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:56 smithi159 ceph-mon[36109]: pgmap v2085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:36:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:56 smithi055 ceph-mon[31863]: pgmap v2085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:36:57.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2888 sec 2024-03-28T06:36:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2217.820020 secs 2024-03-28T06:36:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2217.820020 secs 2024-03-28T06:36:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2217.820020 secs 2024-03-28T06:36:58.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2889 sec 2024-03-28T06:36:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:36:58 smithi086 ceph-mon[35163]: pgmap v2086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:36:58 smithi159 ceph-mon[36109]: pgmap v2086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:36:58 smithi055 ceph-mon[31863]: pgmap v2086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:36:59.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2890 sec 2024-03-28T06:37:00.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2891 sec 2024-03-28T06:37:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:00 smithi086 ceph-mon[35163]: pgmap v2087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:00 smithi159 ceph-mon[36109]: pgmap v2087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:01.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:00 smithi055 ceph-mon[31863]: pgmap v2087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:01.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2892 sec 2024-03-28T06:37:02.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2893 sec 2024-03-28T06:37:03.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:02 smithi055 ceph-mon[31863]: pgmap v2088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:03.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2222.820141 secs 2024-03-28T06:37:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:02 smithi086 ceph-mon[35163]: pgmap v2088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2222.820141 secs 2024-03-28T06:37:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:02 smithi159 ceph-mon[36109]: pgmap v2088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2222.820141 secs 2024-03-28T06:37:03.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2894 sec 2024-03-28T06:37:04.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2895 sec 2024-03-28T06:37:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:04 smithi086 ceph-mon[35163]: pgmap v2089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:05.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:04 smithi159 ceph-mon[36109]: pgmap v2089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:05.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:04 smithi055 ceph-mon[31863]: pgmap v2089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:05.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2896 sec 2024-03-28T06:37:06.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2897 sec 2024-03-28T06:37:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:06 smithi086 ceph-mon[35163]: pgmap v2090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:06 smithi159 ceph-mon[36109]: pgmap v2090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:06 smithi055 ceph-mon[31863]: pgmap v2090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:07.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2898 sec 2024-03-28T06:37:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2227.820202 secs 2024-03-28T06:37:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2227.820202 secs 2024-03-28T06:37:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2227.820202 secs 2024-03-28T06:37:08.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2899 sec 2024-03-28T06:37:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:08 smithi086 ceph-mon[35163]: pgmap v2091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:08 smithi159 ceph-mon[36109]: pgmap v2091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:08 smithi055 ceph-mon[31863]: pgmap v2091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:09.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2900 sec 2024-03-28T06:37:10.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2901 sec 2024-03-28T06:37:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:10 smithi086 ceph-mon[35163]: pgmap v2092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:11.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:10 smithi159 ceph-mon[36109]: pgmap v2092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:11.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:10 smithi055 ceph-mon[31863]: pgmap v2092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:11.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2902 sec 2024-03-28T06:37:12.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2903 sec 2024-03-28T06:37:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:12 smithi086 ceph-mon[35163]: pgmap v2093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2232.820262 secs 2024-03-28T06:37:13.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:12 smithi159 ceph-mon[36109]: pgmap v2093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:13.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2232.820262 secs 2024-03-28T06:37:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:12 smithi055 ceph-mon[31863]: pgmap v2093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2232.820262 secs 2024-03-28T06:37:13.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2904 sec 2024-03-28T06:37:14.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2905 sec 2024-03-28T06:37:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:14 smithi086 ceph-mon[35163]: pgmap v2094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:15.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:14 smithi159 ceph-mon[36109]: pgmap v2094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:14 smithi055 ceph-mon[31863]: pgmap v2094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:15.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2906 sec 2024-03-28T06:37:16.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2907 sec 2024-03-28T06:37:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:16 smithi086 ceph-mon[35163]: pgmap v2095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:16 smithi159 ceph-mon[36109]: pgmap v2095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:16 smithi055 ceph-mon[31863]: pgmap v2095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:17.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2908 sec 2024-03-28T06:37:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2237.820324 secs 2024-03-28T06:37:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2237.820324 secs 2024-03-28T06:37:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2237.820324 secs 2024-03-28T06:37:18.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2909 sec 2024-03-28T06:37:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:19 smithi086 ceph-mon[35163]: pgmap v2096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:19 smithi159 ceph-mon[36109]: pgmap v2096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:19 smithi055 ceph-mon[31863]: pgmap v2096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:19.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2910 sec 2024-03-28T06:37:20.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2911 sec 2024-03-28T06:37:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:21 smithi086 ceph-mon[35163]: pgmap v2097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:21.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:21 smithi159 ceph-mon[36109]: pgmap v2097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:21 smithi055 ceph-mon[31863]: pgmap v2097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:21.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2912 sec 2024-03-28T06:37:22.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2913 sec 2024-03-28T06:37:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:23 smithi086 ceph-mon[35163]: pgmap v2098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2242.820389 secs 2024-03-28T06:37:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:23 smithi159 ceph-mon[36109]: pgmap v2098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2242.820389 secs 2024-03-28T06:37:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:23 smithi055 ceph-mon[31863]: pgmap v2098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2242.820389 secs 2024-03-28T06:37:23.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2914 sec 2024-03-28T06:37:24.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2915 sec 2024-03-28T06:37:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:25 smithi086 ceph-mon[35163]: pgmap v2099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:25 smithi159 ceph-mon[36109]: pgmap v2099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:25 smithi055 ceph-mon[31863]: pgmap v2099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:25.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2916 sec 2024-03-28T06:37:26.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2917 sec 2024-03-28T06:37:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:27 smithi086 ceph-mon[35163]: pgmap v2100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:27.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:27 smithi159 ceph-mon[36109]: pgmap v2100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:27 smithi055 ceph-mon[31863]: pgmap v2100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:27.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2918 sec 2024-03-28T06:37:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2247.820499 secs 2024-03-28T06:37:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2247.820499 secs 2024-03-28T06:37:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2247.820499 secs 2024-03-28T06:37:28.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2919 sec 2024-03-28T06:37:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:29 smithi086 ceph-mon[35163]: pgmap v2101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:29 smithi159 ceph-mon[36109]: pgmap v2101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:29 smithi055 ceph-mon[31863]: pgmap v2101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:29.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2920 sec 2024-03-28T06:37:30.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2921 sec 2024-03-28T06:37:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:31 smithi086 ceph-mon[35163]: pgmap v2102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:37:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:31 smithi159 ceph-mon[36109]: pgmap v2102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:37:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:31 smithi055 ceph-mon[31863]: pgmap v2102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:37:31.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2922 sec 2024-03-28T06:37:32.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2923 sec 2024-03-28T06:37:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:33.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2924 sec 2024-03-28T06:37:33.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:33 smithi055 ceph-mon[31863]: pgmap v2103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:33.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2252.820568 secs 2024-03-28T06:37:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:33 smithi086 ceph-mon[35163]: pgmap v2103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2252.820568 secs 2024-03-28T06:37:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:33 smithi159 ceph-mon[36109]: pgmap v2103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2252.820568 secs 2024-03-28T06:37:34.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2925 sec 2024-03-28T06:37:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2926 sec 2024-03-28T06:37:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:35 smithi055 ceph-mon[31863]: pgmap v2104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:35 smithi086 ceph-mon[35163]: pgmap v2104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:35 smithi159 ceph-mon[36109]: pgmap v2104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:36.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2927 sec 2024-03-28T06:37:37.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2928 sec 2024-03-28T06:37:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:37 smithi055 ceph-mon[31863]: pgmap v2105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:37:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:37:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:37 smithi086 ceph-mon[35163]: pgmap v2105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:37:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:37:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:37 smithi159 ceph-mon[36109]: pgmap v2105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:37:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:37:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:37:38.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2929 sec 2024-03-28T06:37:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:38 smithi055 ceph-mon[31863]: pgmap v2106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:37:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:38 smithi055 ceph-mon[31863]: pgmap v2107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:38.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2257.820644 secs 2024-03-28T06:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:38 smithi086 ceph-mon[35163]: pgmap v2106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:38 smithi086 ceph-mon[35163]: pgmap v2107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2257.820644 secs 2024-03-28T06:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:38 smithi159 ceph-mon[36109]: pgmap v2106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:38 smithi159 ceph-mon[36109]: pgmap v2107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2257.820644 secs 2024-03-28T06:37:39.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2930 sec 2024-03-28T06:37:40.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2931 sec 2024-03-28T06:37:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:40 smithi086 ceph-mon[35163]: pgmap v2108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:40 smithi159 ceph-mon[36109]: pgmap v2108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:40 smithi055 ceph-mon[31863]: pgmap v2108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:41.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2932 sec 2024-03-28T06:37:42.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2933 sec 2024-03-28T06:37:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:42 smithi086 ceph-mon[35163]: pgmap v2109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:42 smithi159 ceph-mon[36109]: pgmap v2109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:42.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:42 smithi055 ceph-mon[31863]: pgmap v2109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:37:43.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2934 sec 2024-03-28T06:37:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2262.820720 secs 2024-03-28T06:37:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2262.820720 secs 2024-03-28T06:37:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2262.820720 secs 2024-03-28T06:37:44.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2935 sec 2024-03-28T06:37:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:44 smithi086 ceph-mon[35163]: pgmap v2110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:44.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:44 smithi159 ceph-mon[36109]: pgmap v2110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:44 smithi055 ceph-mon[31863]: pgmap v2110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:45.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2936 sec 2024-03-28T06:37:46.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2937 sec 2024-03-28T06:37:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:46 smithi086 ceph-mon[35163]: pgmap v2111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:37:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:46 smithi159 ceph-mon[36109]: pgmap v2111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:37:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:46 smithi055 ceph-mon[31863]: pgmap v2111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:37:47.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2938 sec 2024-03-28T06:37:48.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2939 sec 2024-03-28T06:37:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:48 smithi086 ceph-mon[35163]: pgmap v2112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:37:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2267.820799 secs 2024-03-28T06:37:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:48 smithi159 ceph-mon[36109]: pgmap v2112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:37:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2267.820799 secs 2024-03-28T06:37:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:48 smithi055 ceph-mon[31863]: pgmap v2112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:37:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2267.820799 secs 2024-03-28T06:37:49.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2940 sec 2024-03-28T06:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:49 smithi086 ceph-mon[35163]: pgmap v2113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:49 smithi159 ceph-mon[36109]: pgmap v2113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:49 smithi055 ceph-mon[31863]: pgmap v2113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:50.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2941 sec 2024-03-28T06:37:51.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2942 sec 2024-03-28T06:37:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:51 smithi086 ceph-mon[35163]: pgmap v2114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:51.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:51 smithi159 ceph-mon[36109]: pgmap v2114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:51.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:51 smithi055 ceph-mon[31863]: pgmap v2114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:37:52.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2943 sec 2024-03-28T06:37:53.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2944 sec 2024-03-28T06:37:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2272.820862 secs 2024-03-28T06:37:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:53 smithi086 ceph-mon[35163]: pgmap v2115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2272.820862 secs 2024-03-28T06:37:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:53 smithi159 ceph-mon[36109]: pgmap v2115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2272.820862 secs 2024-03-28T06:37:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:53 smithi055 ceph-mon[31863]: pgmap v2115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:37:54.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2945 sec 2024-03-28T06:37:55.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2946 sec 2024-03-28T06:37:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:55 smithi086 ceph-mon[35163]: pgmap v2116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:55.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:55 smithi159 ceph-mon[36109]: pgmap v2116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:55 smithi055 ceph-mon[31863]: pgmap v2116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:56.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2947 sec 2024-03-28T06:37:57.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2948 sec 2024-03-28T06:37:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:57 smithi086 ceph-mon[35163]: pgmap v2117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:57 smithi159 ceph-mon[36109]: pgmap v2117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:57 smithi055 ceph-mon[31863]: pgmap v2117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:58.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2949 sec 2024-03-28T06:37:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2277.820924 secs 2024-03-28T06:37:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2277.820924 secs 2024-03-28T06:37:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2277.820924 secs 2024-03-28T06:37:59.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2950 sec 2024-03-28T06:37:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:37:59 smithi086 ceph-mon[35163]: pgmap v2118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:59.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:37:59 smithi159 ceph-mon[36109]: pgmap v2118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:37:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:37:59 smithi055 ceph-mon[31863]: pgmap v2118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:00.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2951 sec 2024-03-28T06:38:01.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2952 sec 2024-03-28T06:38:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:01 smithi086 ceph-mon[35163]: pgmap v2119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:01 smithi159 ceph-mon[36109]: pgmap v2119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:01 smithi055 ceph-mon[31863]: pgmap v2119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:02.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2953 sec 2024-03-28T06:38:03.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2954 sec 2024-03-28T06:38:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2282.820989 secs 2024-03-28T06:38:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:03 smithi086 ceph-mon[35163]: pgmap v2120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2282.820989 secs 2024-03-28T06:38:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:03 smithi159 ceph-mon[36109]: pgmap v2120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2282.820989 secs 2024-03-28T06:38:03.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:03 smithi055 ceph-mon[31863]: pgmap v2120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:04.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2955 sec 2024-03-28T06:38:05.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2956 sec 2024-03-28T06:38:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:05 smithi086 ceph-mon[35163]: pgmap v2121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:05 smithi159 ceph-mon[36109]: pgmap v2121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:05 smithi055 ceph-mon[31863]: pgmap v2121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:06.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2957 sec 2024-03-28T06:38:07.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2958 sec 2024-03-28T06:38:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:07 smithi086 ceph-mon[35163]: pgmap v2122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:07 smithi159 ceph-mon[36109]: pgmap v2122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:07 smithi055 ceph-mon[31863]: pgmap v2122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:08.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2959 sec 2024-03-28T06:38:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2287.821107 secs 2024-03-28T06:38:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2287.821107 secs 2024-03-28T06:38:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2287.821107 secs 2024-03-28T06:38:09.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2960 sec 2024-03-28T06:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:09 smithi086 ceph-mon[35163]: pgmap v2123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:09 smithi159 ceph-mon[36109]: pgmap v2123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:09.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:09 smithi055 ceph-mon[31863]: pgmap v2123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:10.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2961 sec 2024-03-28T06:38:11.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2962 sec 2024-03-28T06:38:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:11 smithi086 ceph-mon[35163]: pgmap v2124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:11.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:11 smithi159 ceph-mon[36109]: pgmap v2124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:11.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:11 smithi055 ceph-mon[31863]: pgmap v2124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:12.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2963 sec 2024-03-28T06:38:13.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2964 sec 2024-03-28T06:38:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2292.821153 secs 2024-03-28T06:38:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:13 smithi055 ceph-mon[31863]: pgmap v2125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2292.821153 secs 2024-03-28T06:38:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:13 smithi086 ceph-mon[35163]: pgmap v2125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2292.821153 secs 2024-03-28T06:38:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:13 smithi159 ceph-mon[36109]: pgmap v2125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:14.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2965 sec 2024-03-28T06:38:15.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2966 sec 2024-03-28T06:38:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:15 smithi086 ceph-mon[35163]: pgmap v2126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:16.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:15 smithi159 ceph-mon[36109]: pgmap v2126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:16.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:15 smithi055 ceph-mon[31863]: pgmap v2126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:16.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2967 sec 2024-03-28T06:38:17.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2968 sec 2024-03-28T06:38:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:17 smithi086 ceph-mon[35163]: pgmap v2127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:18.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:17 smithi159 ceph-mon[36109]: pgmap v2127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:18.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:17 smithi055 ceph-mon[31863]: pgmap v2127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:18.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2969 sec 2024-03-28T06:38:19.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2297.821181 secs 2024-03-28T06:38:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2297.821181 secs 2024-03-28T06:38:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2297.821181 secs 2024-03-28T06:38:19.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2970 sec 2024-03-28T06:38:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:19 smithi086 ceph-mon[35163]: pgmap v2128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:19 smithi159 ceph-mon[36109]: pgmap v2128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:20.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:19 smithi055 ceph-mon[31863]: pgmap v2128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:20.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2971 sec 2024-03-28T06:38:21.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2972 sec 2024-03-28T06:38:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:21 smithi086 ceph-mon[35163]: pgmap v2129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:22.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:21 smithi159 ceph-mon[36109]: pgmap v2129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:22.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:21 smithi055 ceph-mon[31863]: pgmap v2129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:22.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2973 sec 2024-03-28T06:38:23.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2974 sec 2024-03-28T06:38:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2302.821246 secs 2024-03-28T06:38:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:23 smithi086 ceph-mon[35163]: pgmap v2130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2302.821246 secs 2024-03-28T06:38:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:23 smithi159 ceph-mon[36109]: pgmap v2130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2302.821246 secs 2024-03-28T06:38:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:23 smithi055 ceph-mon[31863]: pgmap v2130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:24.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2975 sec 2024-03-28T06:38:25.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2976 sec 2024-03-28T06:38:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:25 smithi086 ceph-mon[35163]: pgmap v2131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:26.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:25 smithi159 ceph-mon[36109]: pgmap v2131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:26.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:25 smithi055 ceph-mon[31863]: pgmap v2131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:26.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2977 sec 2024-03-28T06:38:27.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2978 sec 2024-03-28T06:38:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:27 smithi086 ceph-mon[35163]: pgmap v2132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:27 smithi159 ceph-mon[36109]: pgmap v2132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:28.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:27 smithi055 ceph-mon[31863]: pgmap v2132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:28.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2979 sec 2024-03-28T06:38:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2307.821356 secs 2024-03-28T06:38:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2307.821356 secs 2024-03-28T06:38:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2307.821356 secs 2024-03-28T06:38:29.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2980 sec 2024-03-28T06:38:30.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:29 smithi055 ceph-mon[31863]: pgmap v2133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:29 smithi086 ceph-mon[35163]: pgmap v2133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:30.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:29 smithi159 ceph-mon[36109]: pgmap v2133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:30.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2981 sec 2024-03-28T06:38:31.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2982 sec 2024-03-28T06:38:32.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:31 smithi055 ceph-mon[31863]: pgmap v2134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:31 smithi086 ceph-mon[35163]: pgmap v2134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:32.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:31 smithi159 ceph-mon[36109]: pgmap v2134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:38:32.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2983 sec 2024-03-28T06:38:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2312.821443 secs 2024-03-28T06:38:33.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2312.821443 secs 2024-03-28T06:38:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2312.821443 secs 2024-03-28T06:38:33.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2984 sec 2024-03-28T06:38:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:33 smithi055 ceph-mon[31863]: pgmap v2135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:33 smithi086 ceph-mon[35163]: pgmap v2135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:33 smithi159 ceph-mon[36109]: pgmap v2135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:34.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2985 sec 2024-03-28T06:38:35.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2986 sec 2024-03-28T06:38:36.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:35 smithi055 ceph-mon[31863]: pgmap v2136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:35 smithi086 ceph-mon[35163]: pgmap v2136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:36.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:35 smithi159 ceph-mon[36109]: pgmap v2136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:36.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2987 sec 2024-03-28T06:38:37.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2988 sec 2024-03-28T06:38:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:37 smithi086 ceph-mon[35163]: pgmap v2137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:38:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2317.821510 secs 2024-03-28T06:38:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:37 smithi159 ceph-mon[36109]: pgmap v2137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:38:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2317.821510 secs 2024-03-28T06:38:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:37 smithi055 ceph-mon[31863]: pgmap v2137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:38:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2317.821510 secs 2024-03-28T06:38:38.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2989 sec 2024-03-28T06:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:38 smithi086 ceph-mon[35163]: pgmap v2138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:38 smithi086 ceph-mon[35163]: pgmap v2139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:38:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:38:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:38:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:38 smithi159 ceph-mon[36109]: pgmap v2138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:38 smithi159 ceph-mon[36109]: pgmap v2139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:38:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:38:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:38:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:38 smithi055 ceph-mon[31863]: pgmap v2138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:38 smithi055 ceph-mon[31863]: pgmap v2139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:38:39.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2990 sec 2024-03-28T06:38:40.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2991 sec 2024-03-28T06:38:41.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2992 sec 2024-03-28T06:38:41.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:41 smithi055 ceph-mon[31863]: pgmap v2140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:38:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:41 smithi086 ceph-mon[35163]: pgmap v2140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:38:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:41 smithi159 ceph-mon[36109]: pgmap v2140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:38:42.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2993 sec 2024-03-28T06:38:43.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2994 sec 2024-03-28T06:38:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:43 smithi086 ceph-mon[35163]: pgmap v2141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2322.821573 secs 2024-03-28T06:38:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:43 smithi159 ceph-mon[36109]: pgmap v2141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2322.821573 secs 2024-03-28T06:38:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:43 smithi055 ceph-mon[31863]: pgmap v2141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2322.821573 secs 2024-03-28T06:38:44.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2995 sec 2024-03-28T06:38:45.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2996 sec 2024-03-28T06:38:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:45 smithi086 ceph-mon[35163]: pgmap v2142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:45 smithi159 ceph-mon[36109]: pgmap v2142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:45 smithi055 ceph-mon[31863]: pgmap v2142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:46.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2997 sec 2024-03-28T06:38:47.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2998 sec 2024-03-28T06:38:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:47 smithi086 ceph-mon[35163]: pgmap v2143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:47.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:47 smithi159 ceph-mon[36109]: pgmap v2143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:47 smithi055 ceph-mon[31863]: pgmap v2143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:48.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 2999 sec 2024-03-28T06:38:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2327.821694 secs 2024-03-28T06:38:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2327.821694 secs 2024-03-28T06:38:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2327.821694 secs 2024-03-28T06:38:49.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3000 sec 2024-03-28T06:38:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:49 smithi086 ceph-mon[35163]: pgmap v2144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:38:49.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:49 smithi159 ceph-mon[36109]: pgmap v2144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:38:49.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:49 smithi055 ceph-mon[31863]: pgmap v2144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:38:50.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3001 sec 2024-03-28T06:38:51.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3002 sec 2024-03-28T06:38:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:51 smithi086 ceph-mon[35163]: pgmap v2145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:51.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:51 smithi159 ceph-mon[36109]: pgmap v2145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:51 smithi055 ceph-mon[31863]: pgmap v2145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:38:52.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3003 sec 2024-03-28T06:38:53.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3004 sec 2024-03-28T06:38:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:53 smithi086 ceph-mon[35163]: pgmap v2146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2332.821826 secs 2024-03-28T06:38:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:53 smithi159 ceph-mon[36109]: pgmap v2146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2332.821826 secs 2024-03-28T06:38:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:53 smithi055 ceph-mon[31863]: pgmap v2146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2332.821826 secs 2024-03-28T06:38:54.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3005 sec 2024-03-28T06:38:55.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3006 sec 2024-03-28T06:38:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:55 smithi086 ceph-mon[35163]: pgmap v2147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:55.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:55 smithi159 ceph-mon[36109]: pgmap v2147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:55.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:55 smithi055 ceph-mon[31863]: pgmap v2147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:38:56.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3007 sec 2024-03-28T06:38:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:56 smithi086 ceph-mon[35163]: pgmap v2148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:56.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:56 smithi159 ceph-mon[36109]: pgmap v2148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:56 smithi055 ceph-mon[31863]: pgmap v2148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:57.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3008 sec 2024-03-28T06:38:58.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2337.821885 secs 2024-03-28T06:38:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2337.821885 secs 2024-03-28T06:38:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2337.821885 secs 2024-03-28T06:38:58.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3009 sec 2024-03-28T06:38:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:38:58 smithi086 ceph-mon[35163]: pgmap v2149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:38:58 smithi159 ceph-mon[36109]: pgmap v2149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:38:58 smithi055 ceph-mon[31863]: pgmap v2149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:38:59.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3010 sec 2024-03-28T06:39:00.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3011 sec 2024-03-28T06:39:01.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3012 sec 2024-03-28T06:39:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:01 smithi086 ceph-mon[35163]: pgmap v2150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:01.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:01 smithi159 ceph-mon[36109]: pgmap v2150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:01.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:01 smithi055 ceph-mon[31863]: pgmap v2150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:02.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3013 sec 2024-03-28T06:39:03.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3014 sec 2024-03-28T06:39:03.678 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:03 smithi055 ceph-mon[31863]: pgmap v2151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:03.678 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2342.821968 secs 2024-03-28T06:39:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:03 smithi086 ceph-mon[35163]: pgmap v2151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2342.821968 secs 2024-03-28T06:39:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:03 smithi159 ceph-mon[36109]: pgmap v2151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2342.821968 secs 2024-03-28T06:39:04.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3015 sec 2024-03-28T06:39:05.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3016 sec 2024-03-28T06:39:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:05 smithi086 ceph-mon[35163]: pgmap v2152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:05.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:05 smithi159 ceph-mon[36109]: pgmap v2152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:05 smithi055 ceph-mon[31863]: pgmap v2152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:06.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3017 sec 2024-03-28T06:39:07.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3018 sec 2024-03-28T06:39:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:07 smithi086 ceph-mon[35163]: pgmap v2153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:07.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:07 smithi159 ceph-mon[36109]: pgmap v2153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:07.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:07 smithi055 ceph-mon[31863]: pgmap v2153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:39:08.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3019 sec 2024-03-28T06:39:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2347.822085 secs 2024-03-28T06:39:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2347.822085 secs 2024-03-28T06:39:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2347.822085 secs 2024-03-28T06:39:09.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3020 sec 2024-03-28T06:39:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:09 smithi086 ceph-mon[35163]: pgmap v2154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:09.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:09 smithi159 ceph-mon[36109]: pgmap v2154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:09.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:09 smithi055 ceph-mon[31863]: pgmap v2154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:10.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3021 sec 2024-03-28T06:39:11.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3022 sec 2024-03-28T06:39:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:11 smithi086 ceph-mon[35163]: pgmap v2155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:11.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:11 smithi159 ceph-mon[36109]: pgmap v2155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:11.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:11 smithi055 ceph-mon[31863]: pgmap v2155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:12.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3023 sec 2024-03-28T06:39:13.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3024 sec 2024-03-28T06:39:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:13 smithi086 ceph-mon[35163]: pgmap v2156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2352.822202 secs 2024-03-28T06:39:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:13 smithi159 ceph-mon[36109]: pgmap v2156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2352.822202 secs 2024-03-28T06:39:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:13 smithi055 ceph-mon[31863]: pgmap v2156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2352.822202 secs 2024-03-28T06:39:14.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3025 sec 2024-03-28T06:39:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:14 smithi086 ceph-mon[35163]: pgmap v2157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:14.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:14 smithi159 ceph-mon[36109]: pgmap v2157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:14.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:14 smithi055 ceph-mon[31863]: pgmap v2157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:15.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3026 sec 2024-03-28T06:39:16.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3027 sec 2024-03-28T06:39:17.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3028 sec 2024-03-28T06:39:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:17 smithi086 ceph-mon[35163]: pgmap v2158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:17.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:17 smithi159 ceph-mon[36109]: pgmap v2158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:17.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:17 smithi055 ceph-mon[31863]: pgmap v2158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:18.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3029 sec 2024-03-28T06:39:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2357.822271 secs 2024-03-28T06:39:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2357.822271 secs 2024-03-28T06:39:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2357.822271 secs 2024-03-28T06:39:19.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3030 sec 2024-03-28T06:39:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:19 smithi086 ceph-mon[35163]: pgmap v2159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:19.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:19 smithi159 ceph-mon[36109]: pgmap v2159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:19 smithi055 ceph-mon[31863]: pgmap v2159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:20.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3031 sec 2024-03-28T06:39:21.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3032 sec 2024-03-28T06:39:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:21 smithi086 ceph-mon[35163]: pgmap v2160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:21.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:21 smithi159 ceph-mon[36109]: pgmap v2160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:21.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:21 smithi055 ceph-mon[31863]: pgmap v2160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:22.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3033 sec 2024-03-28T06:39:23.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3034 sec 2024-03-28T06:39:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:23 smithi086 ceph-mon[35163]: pgmap v2161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2362.822358 secs 2024-03-28T06:39:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:23 smithi159 ceph-mon[36109]: pgmap v2161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2362.822358 secs 2024-03-28T06:39:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:23 smithi055 ceph-mon[31863]: pgmap v2161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2362.822358 secs 2024-03-28T06:39:24.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3035 sec 2024-03-28T06:39:25.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3036 sec 2024-03-28T06:39:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:25 smithi086 ceph-mon[35163]: pgmap v2162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:25 smithi159 ceph-mon[36109]: pgmap v2162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:25 smithi055 ceph-mon[31863]: pgmap v2162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:26.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3037 sec 2024-03-28T06:39:27.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3038 sec 2024-03-28T06:39:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:27 smithi086 ceph-mon[35163]: pgmap v2163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:27 smithi159 ceph-mon[36109]: pgmap v2163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:27.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:27 smithi055 ceph-mon[31863]: pgmap v2163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:28.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3039 sec 2024-03-28T06:39:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2367.822477 secs 2024-03-28T06:39:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2367.822477 secs 2024-03-28T06:39:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2367.822477 secs 2024-03-28T06:39:29.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3040 sec 2024-03-28T06:39:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:29 smithi086 ceph-mon[35163]: pgmap v2164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:29 smithi159 ceph-mon[36109]: pgmap v2164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:29 smithi055 ceph-mon[31863]: pgmap v2164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:30.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3041 sec 2024-03-28T06:39:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:30 smithi086 ceph-mon[35163]: pgmap v2165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:30.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:30 smithi159 ceph-mon[36109]: pgmap v2165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:30.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:30 smithi055 ceph-mon[31863]: pgmap v2165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:39:31.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3042 sec 2024-03-28T06:39:32.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3043 sec 2024-03-28T06:39:33.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3044 sec 2024-03-28T06:39:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:33 smithi086 ceph-mon[35163]: pgmap v2166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2372.822602 secs 2024-03-28T06:39:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:33 smithi159 ceph-mon[36109]: pgmap v2166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2372.822602 secs 2024-03-28T06:39:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:33 smithi055 ceph-mon[31863]: pgmap v2166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2372.822602 secs 2024-03-28T06:39:34.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3045 sec 2024-03-28T06:39:35.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3046 sec 2024-03-28T06:39:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:35 smithi086 ceph-mon[35163]: pgmap v2167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:35 smithi159 ceph-mon[36109]: pgmap v2167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:35.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:35 smithi055 ceph-mon[31863]: pgmap v2167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:36.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3047 sec 2024-03-28T06:39:37.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3048 sec 2024-03-28T06:39:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:37 smithi086 ceph-mon[35163]: pgmap v2168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:37 smithi159 ceph-mon[36109]: pgmap v2168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:37.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:37 smithi055 ceph-mon[31863]: pgmap v2168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:38.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3049 sec 2024-03-28T06:39:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2377.822721 secs 2024-03-28T06:39:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2377.822721 secs 2024-03-28T06:39:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2377.822721 secs 2024-03-28T06:39:39.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3050 sec 2024-03-28T06:39:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:39 smithi086 ceph-mon[35163]: pgmap v2169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:39:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:39 smithi159 ceph-mon[36109]: pgmap v2169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:39:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:39 smithi055 ceph-mon[31863]: pgmap v2169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:39:40.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3051 sec 2024-03-28T06:39:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:39:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:39:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:39:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:39:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:39:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:39:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:39:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:39:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:39:41.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3052 sec 2024-03-28T06:39:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:41 smithi086 ceph-mon[35163]: pgmap v2170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:41 smithi086 ceph-mon[35163]: pgmap v2171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:39:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:41 smithi159 ceph-mon[36109]: pgmap v2170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:41 smithi159 ceph-mon[36109]: pgmap v2171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:39:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:41 smithi055 ceph-mon[31863]: pgmap v2170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:39:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:41 smithi055 ceph-mon[31863]: pgmap v2171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:39:42.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3053 sec 2024-03-28T06:39:43.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3054 sec 2024-03-28T06:39:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:43 smithi086 ceph-mon[35163]: pgmap v2172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2382.822806 secs 2024-03-28T06:39:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:43 smithi159 ceph-mon[36109]: pgmap v2172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2382.822806 secs 2024-03-28T06:39:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:43 smithi055 ceph-mon[31863]: pgmap v2172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2382.822806 secs 2024-03-28T06:39:44.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3055 sec 2024-03-28T06:39:45.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3056 sec 2024-03-28T06:39:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:45 smithi086 ceph-mon[35163]: pgmap v2173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:45 smithi159 ceph-mon[36109]: pgmap v2173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:45 smithi055 ceph-mon[31863]: pgmap v2173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:46.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3057 sec 2024-03-28T06:39:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:46 smithi086 ceph-mon[35163]: pgmap v2174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:46.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:46 smithi159 ceph-mon[36109]: pgmap v2174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:46.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:46 smithi055 ceph-mon[31863]: pgmap v2174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:47.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3058 sec 2024-03-28T06:39:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2387.822923 secs 2024-03-28T06:39:48.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2387.822923 secs 2024-03-28T06:39:48.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2387.822923 secs 2024-03-28T06:39:48.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3059 sec 2024-03-28T06:39:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:48 smithi086 ceph-mon[35163]: pgmap v2175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:48 smithi159 ceph-mon[36109]: pgmap v2175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:48 smithi055 ceph-mon[31863]: pgmap v2175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:49.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3060 sec 2024-03-28T06:39:50.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3061 sec 2024-03-28T06:39:51.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3062 sec 2024-03-28T06:39:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:51 smithi086 ceph-mon[35163]: pgmap v2176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:51.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:51 smithi159 ceph-mon[36109]: pgmap v2176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:51.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:51 smithi055 ceph-mon[31863]: pgmap v2176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:39:52.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3063 sec 2024-03-28T06:39:53.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3064 sec 2024-03-28T06:39:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:53 smithi086 ceph-mon[35163]: pgmap v2177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2392.822995 secs 2024-03-28T06:39:53.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:53 smithi159 ceph-mon[36109]: pgmap v2177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:53.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2392.822995 secs 2024-03-28T06:39:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:53 smithi055 ceph-mon[31863]: pgmap v2177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2392.822995 secs 2024-03-28T06:39:54.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3065 sec 2024-03-28T06:39:55.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3066 sec 2024-03-28T06:39:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:55 smithi086 ceph-mon[35163]: pgmap v2178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:55.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:55 smithi159 ceph-mon[36109]: pgmap v2178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:55.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:55 smithi055 ceph-mon[31863]: pgmap v2178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:56.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3067 sec 2024-03-28T06:39:57.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3068 sec 2024-03-28T06:39:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:57 smithi086 ceph-mon[35163]: pgmap v2179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:57.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:57 smithi159 ceph-mon[36109]: pgmap v2179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:57.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:57 smithi055 ceph-mon[31863]: pgmap v2179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:58.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3069 sec 2024-03-28T06:39:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2397.823116 secs 2024-03-28T06:39:58.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2397.823116 secs 2024-03-28T06:39:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2397.823116 secs 2024-03-28T06:39:59.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3070 sec 2024-03-28T06:39:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:39:59 smithi086 ceph-mon[35163]: pgmap v2180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:59.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:39:59 smithi159 ceph-mon[36109]: pgmap v2180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:39:59.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:39:59 smithi055 ceph-mon[31863]: pgmap v2180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:00.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3071 sec 2024-03-28T06:40:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:40:00.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:40:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:40:01.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3072 sec 2024-03-28T06:40:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:01 smithi086 ceph-mon[35163]: pgmap v2181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:01.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:01 smithi159 ceph-mon[36109]: pgmap v2181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:01.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:01 smithi055 ceph-mon[31863]: pgmap v2181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:02.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3073 sec 2024-03-28T06:40:03.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3074 sec 2024-03-28T06:40:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:03 smithi086 ceph-mon[35163]: pgmap v2182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2402.823198 secs 2024-03-28T06:40:03.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:03 smithi159 ceph-mon[36109]: pgmap v2182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:03.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2402.823198 secs 2024-03-28T06:40:03.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:03 smithi055 ceph-mon[31863]: pgmap v2182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:03.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2402.823198 secs 2024-03-28T06:40:04.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3075 sec 2024-03-28T06:40:05.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3076 sec 2024-03-28T06:40:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:05 smithi086 ceph-mon[35163]: pgmap v2183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:05.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:05 smithi159 ceph-mon[36109]: pgmap v2183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:05.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:05 smithi055 ceph-mon[31863]: pgmap v2183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:06.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3077 sec 2024-03-28T06:40:07.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3078 sec 2024-03-28T06:40:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:07 smithi086 ceph-mon[35163]: pgmap v2184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:07.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:07 smithi159 ceph-mon[36109]: pgmap v2184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:07.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:07 smithi055 ceph-mon[31863]: pgmap v2184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:08.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3079 sec 2024-03-28T06:40:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2407.823264 secs 2024-03-28T06:40:08.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2407.823264 secs 2024-03-28T06:40:08.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2407.823264 secs 2024-03-28T06:40:09.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3080 sec 2024-03-28T06:40:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:09 smithi086 ceph-mon[35163]: pgmap v2185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:09 smithi159 ceph-mon[36109]: pgmap v2185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:09 smithi055 ceph-mon[31863]: pgmap v2185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:10.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3081 sec 2024-03-28T06:40:11.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3082 sec 2024-03-28T06:40:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:11 smithi086 ceph-mon[35163]: pgmap v2186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:11 smithi159 ceph-mon[36109]: pgmap v2186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:11.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:11 smithi055 ceph-mon[31863]: pgmap v2186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:12.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3083 sec 2024-03-28T06:40:13.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3084 sec 2024-03-28T06:40:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:13 smithi086 ceph-mon[35163]: pgmap v2187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2412.823387 secs 2024-03-28T06:40:13.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:13 smithi159 ceph-mon[36109]: pgmap v2187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:13.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2412.823387 secs 2024-03-28T06:40:13.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:13 smithi055 ceph-mon[31863]: pgmap v2187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:13.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2412.823387 secs 2024-03-28T06:40:14.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3085 sec 2024-03-28T06:40:15.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3086 sec 2024-03-28T06:40:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:15 smithi086 ceph-mon[35163]: pgmap v2188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:15.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:15 smithi159 ceph-mon[36109]: pgmap v2188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:15.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:15 smithi055 ceph-mon[31863]: pgmap v2188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:16.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3087 sec 2024-03-28T06:40:17.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3088 sec 2024-03-28T06:40:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:17 smithi086 ceph-mon[35163]: pgmap v2189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:17.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:17 smithi159 ceph-mon[36109]: pgmap v2189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:17.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:17 smithi055 ceph-mon[31863]: pgmap v2189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:18.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3089 sec 2024-03-28T06:40:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2417.823510 secs 2024-03-28T06:40:18.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2417.823510 secs 2024-03-28T06:40:18.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2417.823510 secs 2024-03-28T06:40:19.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3090 sec 2024-03-28T06:40:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:19 smithi086 ceph-mon[35163]: pgmap v2190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:19 smithi159 ceph-mon[36109]: pgmap v2190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:19 smithi055 ceph-mon[31863]: pgmap v2190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:20.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3091 sec 2024-03-28T06:40:21.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3092 sec 2024-03-28T06:40:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:21 smithi086 ceph-mon[35163]: pgmap v2191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:21.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:21 smithi159 ceph-mon[36109]: pgmap v2191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:21.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:21 smithi055 ceph-mon[31863]: pgmap v2191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:22.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3093 sec 2024-03-28T06:40:23.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3094 sec 2024-03-28T06:40:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:23 smithi086 ceph-mon[35163]: pgmap v2192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2422.823642 secs 2024-03-28T06:40:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:23 smithi159 ceph-mon[36109]: pgmap v2192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2422.823642 secs 2024-03-28T06:40:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:23 smithi055 ceph-mon[31863]: pgmap v2192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2422.823642 secs 2024-03-28T06:40:24.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3095 sec 2024-03-28T06:40:25.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3096 sec 2024-03-28T06:40:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:25 smithi086 ceph-mon[35163]: pgmap v2193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:25.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:25 smithi159 ceph-mon[36109]: pgmap v2193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:25.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:25 smithi055 ceph-mon[31863]: pgmap v2193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:26.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3097 sec 2024-03-28T06:40:27.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3098 sec 2024-03-28T06:40:27.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:27 smithi055 ceph-mon[31863]: pgmap v2194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:27 smithi086 ceph-mon[35163]: pgmap v2194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:27 smithi159 ceph-mon[36109]: pgmap v2194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:28.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3099 sec 2024-03-28T06:40:28.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2427.823760 secs 2024-03-28T06:40:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2427.823760 secs 2024-03-28T06:40:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2427.823760 secs 2024-03-28T06:40:29.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3100 sec 2024-03-28T06:40:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:29 smithi055 ceph-mon[31863]: pgmap v2195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:29 smithi086 ceph-mon[35163]: pgmap v2195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:29 smithi159 ceph-mon[36109]: pgmap v2195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:30.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3101 sec 2024-03-28T06:40:31.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3102 sec 2024-03-28T06:40:31.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:31 smithi055 ceph-mon[31863]: pgmap v2196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:31 smithi086 ceph-mon[35163]: pgmap v2196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:31.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:31 smithi159 ceph-mon[36109]: pgmap v2196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:32.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3103 sec 2024-03-28T06:40:33.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3104 sec 2024-03-28T06:40:33.623 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:33 smithi086 ceph-mon[35163]: pgmap v2197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:33.623 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2432.823830 secs 2024-03-28T06:40:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:33 smithi055 ceph-mon[31863]: pgmap v2197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2432.823830 secs 2024-03-28T06:40:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:33 smithi159 ceph-mon[36109]: pgmap v2197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2432.823830 secs 2024-03-28T06:40:34.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3105 sec 2024-03-28T06:40:35.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3106 sec 2024-03-28T06:40:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:35 smithi055 ceph-mon[31863]: pgmap v2198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:35 smithi086 ceph-mon[35163]: pgmap v2198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:35 smithi159 ceph-mon[36109]: pgmap v2198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:36.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3107 sec 2024-03-28T06:40:37.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3108 sec 2024-03-28T06:40:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:37 smithi055 ceph-mon[31863]: pgmap v2199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:37 smithi086 ceph-mon[35163]: pgmap v2199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:37 smithi159 ceph-mon[36109]: pgmap v2199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:38.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3109 sec 2024-03-28T06:40:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2437.823952 secs 2024-03-28T06:40:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2437.823952 secs 2024-03-28T06:40:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2437.823952 secs 2024-03-28T06:40:39.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3110 sec 2024-03-28T06:40:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:39 smithi086 ceph-mon[35163]: pgmap v2200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:39 smithi159 ceph-mon[36109]: pgmap v2200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:39 smithi055 ceph-mon[31863]: pgmap v2200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:40.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3111 sec 2024-03-28T06:40:41.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3112 sec 2024-03-28T06:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:41 smithi086 ceph-mon[35163]: pgmap v2201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:40:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:41 smithi159 ceph-mon[36109]: pgmap v2201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:40:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:41 smithi055 ceph-mon[31863]: pgmap v2201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:41.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:40:42.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3113 sec 2024-03-28T06:40:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:40:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:40:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:40:42.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:40:42.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:40:42.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:40:42.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:40:42.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:40:42.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:40:43.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3114 sec 2024-03-28T06:40:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:43 smithi086 ceph-mon[35163]: pgmap v2202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:43 smithi086 ceph-mon[35163]: pgmap v2203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2442.824072 secs 2024-03-28T06:40:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:43 smithi159 ceph-mon[36109]: pgmap v2202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:43 smithi159 ceph-mon[36109]: pgmap v2203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2442.824072 secs 2024-03-28T06:40:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:43 smithi055 ceph-mon[31863]: pgmap v2202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:43 smithi055 ceph-mon[31863]: pgmap v2203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2442.824072 secs 2024-03-28T06:40:44.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3115 sec 2024-03-28T06:40:45.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3116 sec 2024-03-28T06:40:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:45 smithi086 ceph-mon[35163]: pgmap v2204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:45 smithi159 ceph-mon[36109]: pgmap v2204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:45 smithi055 ceph-mon[31863]: pgmap v2204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:46.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3117 sec 2024-03-28T06:40:47.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3118 sec 2024-03-28T06:40:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:47 smithi086 ceph-mon[35163]: pgmap v2205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:47.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:47 smithi159 ceph-mon[36109]: pgmap v2205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:47 smithi055 ceph-mon[31863]: pgmap v2205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:48.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3119 sec 2024-03-28T06:40:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2447.824188 secs 2024-03-28T06:40:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2447.824188 secs 2024-03-28T06:40:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2447.824188 secs 2024-03-28T06:40:49.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3120 sec 2024-03-28T06:40:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:49 smithi086 ceph-mon[35163]: pgmap v2206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:40:49.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:49 smithi159 ceph-mon[36109]: pgmap v2206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:40:49.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:49 smithi055 ceph-mon[31863]: pgmap v2206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:40:50.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3121 sec 2024-03-28T06:40:51.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3122 sec 2024-03-28T06:40:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:51 smithi086 ceph-mon[35163]: pgmap v2207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:51.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:51 smithi159 ceph-mon[36109]: pgmap v2207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:51 smithi055 ceph-mon[31863]: pgmap v2207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:40:52.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3123 sec 2024-03-28T06:40:53.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3124 sec 2024-03-28T06:40:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:53 smithi086 ceph-mon[35163]: pgmap v2208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:40:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2452.824224 secs 2024-03-28T06:40:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:53 smithi159 ceph-mon[36109]: pgmap v2208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:40:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2452.824224 secs 2024-03-28T06:40:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:53 smithi055 ceph-mon[31863]: pgmap v2208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:40:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2452.824224 secs 2024-03-28T06:40:54.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3125 sec 2024-03-28T06:40:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:54 smithi086 ceph-mon[35163]: pgmap v2209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:54.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:54 smithi159 ceph-mon[36109]: pgmap v2209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:54.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:54 smithi055 ceph-mon[31863]: pgmap v2209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:55.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3126 sec 2024-03-28T06:40:56.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3127 sec 2024-03-28T06:40:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:56 smithi086 ceph-mon[35163]: pgmap v2210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:56 smithi159 ceph-mon[36109]: pgmap v2210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:56 smithi055 ceph-mon[31863]: pgmap v2210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:40:57.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3128 sec 2024-03-28T06:40:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2457.824344 secs 2024-03-28T06:40:58.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2457.824344 secs 2024-03-28T06:40:58.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2457.824344 secs 2024-03-28T06:40:58.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3129 sec 2024-03-28T06:40:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:40:58 smithi086 ceph-mon[35163]: pgmap v2211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:40:58 smithi159 ceph-mon[36109]: pgmap v2211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:40:58 smithi055 ceph-mon[31863]: pgmap v2211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:40:59.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3130 sec 2024-03-28T06:41:00.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3131 sec 2024-03-28T06:41:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:00 smithi086 ceph-mon[35163]: pgmap v2212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:01.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:00 smithi159 ceph-mon[36109]: pgmap v2212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:01.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:00 smithi055 ceph-mon[31863]: pgmap v2212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:01.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3132 sec 2024-03-28T06:41:02.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3133 sec 2024-03-28T06:41:03.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:03 smithi055 ceph-mon[31863]: pgmap v2213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:03.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2462.824429 secs 2024-03-28T06:41:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:03 smithi086 ceph-mon[35163]: pgmap v2213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2462.824429 secs 2024-03-28T06:41:03.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:03 smithi159 ceph-mon[36109]: pgmap v2213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:03.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2462.824429 secs 2024-03-28T06:41:03.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3134 sec 2024-03-28T06:41:04.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3135 sec 2024-03-28T06:41:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:05 smithi086 ceph-mon[35163]: pgmap v2214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:05.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:05 smithi159 ceph-mon[36109]: pgmap v2214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:05 smithi055 ceph-mon[31863]: pgmap v2214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:05.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3136 sec 2024-03-28T06:41:06.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3137 sec 2024-03-28T06:41:07.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:07 smithi086 ceph-mon[35163]: pgmap v2215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:07.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:07 smithi159 ceph-mon[36109]: pgmap v2215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:07 smithi055 ceph-mon[31863]: pgmap v2215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:07.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3138 sec 2024-03-28T06:41:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2467.824547 secs 2024-03-28T06:41:08.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2467.824547 secs 2024-03-28T06:41:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2467.824547 secs 2024-03-28T06:41:08.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3139 sec 2024-03-28T06:41:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:09 smithi086 ceph-mon[35163]: pgmap v2216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:09.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:09 smithi159 ceph-mon[36109]: pgmap v2216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:09.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:09 smithi055 ceph-mon[31863]: pgmap v2216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:09.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3140 sec 2024-03-28T06:41:10.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3141 sec 2024-03-28T06:41:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:11 smithi086 ceph-mon[35163]: pgmap v2217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:11.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:11 smithi159 ceph-mon[36109]: pgmap v2217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:11.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:11 smithi055 ceph-mon[31863]: pgmap v2217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:11.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3142 sec 2024-03-28T06:41:12.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3143 sec 2024-03-28T06:41:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:13 smithi086 ceph-mon[35163]: pgmap v2218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2472.824671 secs 2024-03-28T06:41:13.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:13 smithi159 ceph-mon[36109]: pgmap v2218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:13.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2472.824671 secs 2024-03-28T06:41:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:13 smithi055 ceph-mon[31863]: pgmap v2218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2472.824671 secs 2024-03-28T06:41:13.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3144 sec 2024-03-28T06:41:14.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3145 sec 2024-03-28T06:41:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:15 smithi086 ceph-mon[35163]: pgmap v2219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:15.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:15 smithi159 ceph-mon[36109]: pgmap v2219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:15.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:15 smithi055 ceph-mon[31863]: pgmap v2219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:15.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3146 sec 2024-03-28T06:41:16.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3147 sec 2024-03-28T06:41:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:17 smithi086 ceph-mon[35163]: pgmap v2220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:17.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:17 smithi159 ceph-mon[36109]: pgmap v2220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:17.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:17 smithi055 ceph-mon[31863]: pgmap v2220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:17.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3148 sec 2024-03-28T06:41:18.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2477.824735 secs 2024-03-28T06:41:18.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3149 sec 2024-03-28T06:41:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2477.824735 secs 2024-03-28T06:41:18.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2477.824735 secs 2024-03-28T06:41:19.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:19 smithi055 ceph-mon[31863]: pgmap v2221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:19.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3150 sec 2024-03-28T06:41:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:19 smithi086 ceph-mon[35163]: pgmap v2221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:19.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:19 smithi159 ceph-mon[36109]: pgmap v2221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:20.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3151 sec 2024-03-28T06:41:21.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:21 smithi055 ceph-mon[31863]: pgmap v2222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:21.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3152 sec 2024-03-28T06:41:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:21 smithi086 ceph-mon[35163]: pgmap v2222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:21.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:21 smithi159 ceph-mon[36109]: pgmap v2222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:22.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3153 sec 2024-03-28T06:41:23.376 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:23 smithi159 ceph-mon[36109]: pgmap v2223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:23.376 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2482.824809 secs 2024-03-28T06:41:23.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:23 smithi055 ceph-mon[31863]: pgmap v2223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:23.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2482.824809 secs 2024-03-28T06:41:23.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3154 sec 2024-03-28T06:41:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:23 smithi086 ceph-mon[35163]: pgmap v2223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2482.824809 secs 2024-03-28T06:41:24.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3155 sec 2024-03-28T06:41:25.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:25 smithi055 ceph-mon[31863]: pgmap v2224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:25.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3156 sec 2024-03-28T06:41:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:25 smithi086 ceph-mon[35163]: pgmap v2224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:25.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:25 smithi159 ceph-mon[36109]: pgmap v2224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:26.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3157 sec 2024-03-28T06:41:27.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:27 smithi055 ceph-mon[31863]: pgmap v2225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:27.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3158 sec 2024-03-28T06:41:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:27 smithi086 ceph-mon[35163]: pgmap v2225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:27.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:27 smithi159 ceph-mon[36109]: pgmap v2225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:28.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3159 sec 2024-03-28T06:41:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2487.824907 secs 2024-03-28T06:41:28.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2487.824907 secs 2024-03-28T06:41:28.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2487.824907 secs 2024-03-28T06:41:29.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3160 sec 2024-03-28T06:41:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:29 smithi086 ceph-mon[35163]: pgmap v2226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:29.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:29 smithi159 ceph-mon[36109]: pgmap v2226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:29.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:29 smithi055 ceph-mon[31863]: pgmap v2226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:30.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3161 sec 2024-03-28T06:41:31.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3162 sec 2024-03-28T06:41:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:31 smithi086 ceph-mon[35163]: pgmap v2227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:31.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:31 smithi159 ceph-mon[36109]: pgmap v2227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:31.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:31 smithi055 ceph-mon[31863]: pgmap v2227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:32.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3163 sec 2024-03-28T06:41:33.429 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:33 smithi055 ceph-mon[31863]: pgmap v2228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:33.429 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2492.825025 secs 2024-03-28T06:41:33.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3164 sec 2024-03-28T06:41:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:33 smithi086 ceph-mon[35163]: pgmap v2228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2492.825025 secs 2024-03-28T06:41:33.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:33 smithi159 ceph-mon[36109]: pgmap v2228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:33.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2492.825025 secs 2024-03-28T06:41:34.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3165 sec 2024-03-28T06:41:35.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3166 sec 2024-03-28T06:41:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:35 smithi086 ceph-mon[35163]: pgmap v2229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:35.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:35 smithi159 ceph-mon[36109]: pgmap v2229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:35 smithi055 ceph-mon[31863]: pgmap v2229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:36.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3167 sec 2024-03-28T06:41:37.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3168 sec 2024-03-28T06:41:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:37 smithi086 ceph-mon[35163]: pgmap v2230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:37.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:37 smithi159 ceph-mon[36109]: pgmap v2230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:37.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:37 smithi055 ceph-mon[31863]: pgmap v2230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:38.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3169 sec 2024-03-28T06:41:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2497.825087 secs 2024-03-28T06:41:38.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2497.825087 secs 2024-03-28T06:41:38.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2497.825087 secs 2024-03-28T06:41:39.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3170 sec 2024-03-28T06:41:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:39 smithi086 ceph-mon[35163]: pgmap v2231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:39.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:39 smithi159 ceph-mon[36109]: pgmap v2231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:39.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:39 smithi055 ceph-mon[31863]: pgmap v2231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:40.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3171 sec 2024-03-28T06:41:41.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3172 sec 2024-03-28T06:41:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:41 smithi086 ceph-mon[35163]: pgmap v2232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:41.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:41 smithi159 ceph-mon[36109]: pgmap v2232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:41.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:41 smithi055 ceph-mon[31863]: pgmap v2232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:41:42.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3173 sec 2024-03-28T06:41:43.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3174 sec 2024-03-28T06:41:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:43 smithi086 ceph-mon[35163]: pgmap v2233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:41:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2502.825158 secs 2024-03-28T06:41:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:43 smithi159 ceph-mon[36109]: pgmap v2233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:41:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2502.825158 secs 2024-03-28T06:41:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:43 smithi055 ceph-mon[31863]: pgmap v2233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:41:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2502.825158 secs 2024-03-28T06:41:44.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3175 sec 2024-03-28T06:41:45.518 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:45 smithi086 ceph-mon[35163]: pgmap v2234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:45.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3176 sec 2024-03-28T06:41:45.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:45 smithi159 ceph-mon[36109]: pgmap v2234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:45.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:45 smithi055 ceph-mon[31863]: pgmap v2234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:46.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3177 sec 2024-03-28T06:41:47.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3178 sec 2024-03-28T06:41:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:47 smithi086 ceph-mon[35163]: pgmap v2235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:47.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:47 smithi159 ceph-mon[36109]: pgmap v2235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:47.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:47 smithi055 ceph-mon[31863]: pgmap v2235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:48.514 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2507.825249 secs 2024-03-28T06:41:48.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3179 sec 2024-03-28T06:41:48.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2507.825249 secs 2024-03-28T06:41:48.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2507.825249 secs 2024-03-28T06:41:49.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3180 sec 2024-03-28T06:41:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:49 smithi086 ceph-mon[35163]: pgmap v2236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:49.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:49 smithi159 ceph-mon[36109]: pgmap v2236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:49.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:49.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:49.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:49 smithi055 ceph-mon[31863]: pgmap v2236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:49.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:49.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3181 sec 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: pgmap v2237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:41:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: pgmap v2238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:50.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:41:50.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:41:50.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: pgmap v2237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:41:50.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: pgmap v2238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:50.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:50.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:41:50.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:41:50.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: pgmap v2237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:41:50.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: pgmap v2238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:50.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:41:51.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3182 sec 2024-03-28T06:41:52.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3183 sec 2024-03-28T06:41:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:52 smithi086 ceph-mon[35163]: pgmap v2239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:52.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:52 smithi159 ceph-mon[36109]: pgmap v2239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:52.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:52 smithi055 ceph-mon[31863]: pgmap v2239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:53.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3184 sec 2024-03-28T06:41:53.724 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2512.825366 secs 2024-03-28T06:41:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2512.825366 secs 2024-03-28T06:41:53.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2512.825366 secs 2024-03-28T06:41:54.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3185 sec 2024-03-28T06:41:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:54 smithi086 ceph-mon[35163]: pgmap v2240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:54.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:54 smithi159 ceph-mon[36109]: pgmap v2240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:54.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:54 smithi055 ceph-mon[31863]: pgmap v2240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:41:55.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3186 sec 2024-03-28T06:41:56.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3187 sec 2024-03-28T06:41:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:56 smithi086 ceph-mon[35163]: pgmap v2241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:41:56.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:56 smithi159 ceph-mon[36109]: pgmap v2241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:41:56.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:56 smithi055 ceph-mon[31863]: pgmap v2241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:41:57.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3188 sec 2024-03-28T06:41:58.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3189 sec 2024-03-28T06:41:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:58 smithi086 ceph-mon[35163]: pgmap v2242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:41:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:41:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2517.825430 secs 2024-03-28T06:41:58.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:58 smithi159 ceph-mon[36109]: pgmap v2242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:41:58.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:41:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2517.825430 secs 2024-03-28T06:41:58.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:58 smithi055 ceph-mon[31863]: pgmap v2242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:41:58.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:41:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2517.825430 secs 2024-03-28T06:41:59.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3190 sec 2024-03-28T06:42:00.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3191 sec 2024-03-28T06:42:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:00 smithi086 ceph-mon[35163]: pgmap v2243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:00.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:00 smithi159 ceph-mon[36109]: pgmap v2243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:00.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:00 smithi055 ceph-mon[31863]: pgmap v2243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:01.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3192 sec 2024-03-28T06:42:02.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3193 sec 2024-03-28T06:42:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:02 smithi086 ceph-mon[35163]: pgmap v2244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:02.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:02 smithi159 ceph-mon[36109]: pgmap v2244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:02.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:02 smithi055 ceph-mon[31863]: pgmap v2244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:03.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3194 sec 2024-03-28T06:42:03.723 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2522.825550 secs 2024-03-28T06:42:03.778 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2522.825550 secs 2024-03-28T06:42:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2522.825550 secs 2024-03-28T06:42:04.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3195 sec 2024-03-28T06:42:04.749 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:04 smithi086 ceph-mon[35163]: pgmap v2245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:04.802 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:04 smithi055 ceph-mon[31863]: pgmap v2245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:04.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:04 smithi159 ceph-mon[36109]: pgmap v2245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:05.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3196 sec 2024-03-28T06:42:06.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3197 sec 2024-03-28T06:42:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:06 smithi086 ceph-mon[35163]: pgmap v2246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:06.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:06 smithi159 ceph-mon[36109]: pgmap v2246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:06.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:06 smithi055 ceph-mon[31863]: pgmap v2246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:07.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3198 sec 2024-03-28T06:42:08.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3199 sec 2024-03-28T06:42:08.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:08 smithi086 ceph-mon[35163]: pgmap v2247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:08.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2527.825668 secs 2024-03-28T06:42:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:08 smithi159 ceph-mon[36109]: pgmap v2247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2527.825668 secs 2024-03-28T06:42:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:08 smithi055 ceph-mon[31863]: pgmap v2247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2527.825668 secs 2024-03-28T06:42:09.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3200 sec 2024-03-28T06:42:10.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3201 sec 2024-03-28T06:42:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:10 smithi086 ceph-mon[35163]: pgmap v2248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:10.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:10 smithi159 ceph-mon[36109]: pgmap v2248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:10.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:10 smithi055 ceph-mon[31863]: pgmap v2248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:11.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3202 sec 2024-03-28T06:42:12.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3203 sec 2024-03-28T06:42:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:12 smithi086 ceph-mon[35163]: pgmap v2249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:12.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:12 smithi159 ceph-mon[36109]: pgmap v2249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:12.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:12 smithi055 ceph-mon[31863]: pgmap v2249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:13.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3204 sec 2024-03-28T06:42:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2532.825814 secs 2024-03-28T06:42:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2532.825814 secs 2024-03-28T06:42:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2532.825814 secs 2024-03-28T06:42:14.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3205 sec 2024-03-28T06:42:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:14 smithi086 ceph-mon[35163]: pgmap v2250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:14.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:14 smithi159 ceph-mon[36109]: pgmap v2250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:14.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:14 smithi055 ceph-mon[31863]: pgmap v2250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:15.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3206 sec 2024-03-28T06:42:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:15 smithi086 ceph-mon[35163]: pgmap v2251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:15.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:15 smithi159 ceph-mon[36109]: pgmap v2251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:15.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:15 smithi055 ceph-mon[31863]: pgmap v2251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:16.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3207 sec 2024-03-28T06:42:17.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3208 sec 2024-03-28T06:42:18.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3209 sec 2024-03-28T06:42:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:18 smithi086 ceph-mon[35163]: pgmap v2252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:42:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2537.825877 secs 2024-03-28T06:42:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:18 smithi159 ceph-mon[36109]: pgmap v2252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:42:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2537.825877 secs 2024-03-28T06:42:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:18 smithi055 ceph-mon[31863]: pgmap v2252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:42:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2537.825877 secs 2024-03-28T06:42:19.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3210 sec 2024-03-28T06:42:20.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3211 sec 2024-03-28T06:42:20.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:20 smithi086 ceph-mon[35163]: pgmap v2253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:20.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:20 smithi159 ceph-mon[36109]: pgmap v2253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:20.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:20 smithi055 ceph-mon[31863]: pgmap v2253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:21.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3212 sec 2024-03-28T06:42:22.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3213 sec 2024-03-28T06:42:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:22 smithi086 ceph-mon[35163]: pgmap v2254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:22.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:22 smithi159 ceph-mon[36109]: pgmap v2254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:22.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:22 smithi055 ceph-mon[31863]: pgmap v2254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:23.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3214 sec 2024-03-28T06:42:23.725 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2542.825944 secs 2024-03-28T06:42:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2542.825944 secs 2024-03-28T06:42:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2542.825944 secs 2024-03-28T06:42:24.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3215 sec 2024-03-28T06:42:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:24 smithi086 ceph-mon[35163]: pgmap v2255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:24.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:24 smithi159 ceph-mon[36109]: pgmap v2255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:24.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:24 smithi055 ceph-mon[31863]: pgmap v2255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:42:25.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3216 sec 2024-03-28T06:42:26.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3217 sec 2024-03-28T06:42:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:26 smithi086 ceph-mon[35163]: pgmap v2256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:26.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:26 smithi159 ceph-mon[36109]: pgmap v2256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:26.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:26 smithi055 ceph-mon[31863]: pgmap v2256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:27.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3218 sec 2024-03-28T06:42:28.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3219 sec 2024-03-28T06:42:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:28 smithi086 ceph-mon[35163]: pgmap v2257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2547.826064 secs 2024-03-28T06:42:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:28 smithi159 ceph-mon[36109]: pgmap v2257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2547.826064 secs 2024-03-28T06:42:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:28 smithi055 ceph-mon[31863]: pgmap v2257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2547.826064 secs 2024-03-28T06:42:29.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3220 sec 2024-03-28T06:42:30.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3221 sec 2024-03-28T06:42:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:30 smithi086 ceph-mon[35163]: pgmap v2258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:30.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:30 smithi159 ceph-mon[36109]: pgmap v2258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:30.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:30 smithi055 ceph-mon[31863]: pgmap v2258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:31.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3222 sec 2024-03-28T06:42:32.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3223 sec 2024-03-28T06:42:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:32 smithi086 ceph-mon[35163]: pgmap v2259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:32.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:32 smithi159 ceph-mon[36109]: pgmap v2259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:32.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:32 smithi055 ceph-mon[31863]: pgmap v2259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:33.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3224 sec 2024-03-28T06:42:33.778 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2552.826141 secs 2024-03-28T06:42:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2552.826141 secs 2024-03-28T06:42:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2552.826141 secs 2024-03-28T06:42:34.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3225 sec 2024-03-28T06:42:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:34 smithi086 ceph-mon[35163]: pgmap v2260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:34.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:34 smithi159 ceph-mon[36109]: pgmap v2260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:34.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:34 smithi055 ceph-mon[31863]: pgmap v2260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:35.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3226 sec 2024-03-28T06:42:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:35 smithi086 ceph-mon[35163]: pgmap v2261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:35.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:35 smithi159 ceph-mon[36109]: pgmap v2261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:35.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:35 smithi055 ceph-mon[31863]: pgmap v2261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:36.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3227 sec 2024-03-28T06:42:37.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3228 sec 2024-03-28T06:42:38.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3229 sec 2024-03-28T06:42:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:38 smithi086 ceph-mon[35163]: pgmap v2262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2557.826215 secs 2024-03-28T06:42:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:38 smithi159 ceph-mon[36109]: pgmap v2262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2557.826215 secs 2024-03-28T06:42:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:38 smithi055 ceph-mon[31863]: pgmap v2262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2557.826215 secs 2024-03-28T06:42:39.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3230 sec 2024-03-28T06:42:40.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3231 sec 2024-03-28T06:42:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:40 smithi086 ceph-mon[35163]: pgmap v2263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:40 smithi159 ceph-mon[36109]: pgmap v2263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:40 smithi055 ceph-mon[31863]: pgmap v2263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:41.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3232 sec 2024-03-28T06:42:42.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3233 sec 2024-03-28T06:42:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:42 smithi086 ceph-mon[35163]: pgmap v2264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:42.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:42 smithi159 ceph-mon[36109]: pgmap v2264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:42.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:42 smithi055 ceph-mon[31863]: pgmap v2264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:43.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3234 sec 2024-03-28T06:42:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2562.826335 secs 2024-03-28T06:42:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2562.826335 secs 2024-03-28T06:42:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2562.826335 secs 2024-03-28T06:42:44.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3235 sec 2024-03-28T06:42:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:44 smithi086 ceph-mon[35163]: pgmap v2265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:44 smithi159 ceph-mon[36109]: pgmap v2265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:44 smithi055 ceph-mon[31863]: pgmap v2265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:45.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3236 sec 2024-03-28T06:42:46.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3237 sec 2024-03-28T06:42:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:46 smithi086 ceph-mon[35163]: pgmap v2266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:46.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:46 smithi159 ceph-mon[36109]: pgmap v2266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:46.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:46 smithi055 ceph-mon[31863]: pgmap v2266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:47.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3238 sec 2024-03-28T06:42:48.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3239 sec 2024-03-28T06:42:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:48 smithi086 ceph-mon[35163]: pgmap v2267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2567.826412 secs 2024-03-28T06:42:48.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:48 smithi159 ceph-mon[36109]: pgmap v2267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:48.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2567.826412 secs 2024-03-28T06:42:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:48 smithi055 ceph-mon[31863]: pgmap v2267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:42:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2567.826412 secs 2024-03-28T06:42:49.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3240 sec 2024-03-28T06:42:50.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3241 sec 2024-03-28T06:42:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:50 smithi086 ceph-mon[35163]: pgmap v2268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:42:50.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:50 smithi159 ceph-mon[36109]: pgmap v2268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:50.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:42:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:50 smithi055 ceph-mon[31863]: pgmap v2268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:42:51.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3242 sec 2024-03-28T06:42:52.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3243 sec 2024-03-28T06:42:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:52 smithi086 ceph-mon[35163]: pgmap v2269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:52.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:52 smithi159 ceph-mon[36109]: pgmap v2269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:52.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:52 smithi055 ceph-mon[31863]: pgmap v2269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:53.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3244 sec 2024-03-28T06:42:53.637 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2572.826475 secs 2024-03-28T06:42:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2572.826475 secs 2024-03-28T06:42:53.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2572.826475 secs 2024-03-28T06:42:54.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3245 sec 2024-03-28T06:42:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:54 smithi086 ceph-mon[35163]: pgmap v2270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:54.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:54 smithi159 ceph-mon[36109]: pgmap v2270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:54.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:54 smithi055 ceph-mon[31863]: pgmap v2270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:42:55.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3246 sec 2024-03-28T06:42:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:55 smithi086 ceph-mon[35163]: pgmap v2271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:55.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:55 smithi159 ceph-mon[36109]: pgmap v2271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:55.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:55 smithi055 ceph-mon[31863]: pgmap v2271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:42:56.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3247 sec 2024-03-28T06:42:57.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3248 sec 2024-03-28T06:42:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: pgmap v2272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: pgmap v2273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:42:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: pgmap v2272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: pgmap v2273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:42:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: pgmap v2272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: pgmap v2273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:42:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:42:58.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3249 sec 2024-03-28T06:42:59.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2577.826592 secs 2024-03-28T06:42:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2577.826592 secs 2024-03-28T06:42:59.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2577.826592 secs 2024-03-28T06:42:59.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3250 sec 2024-03-28T06:43:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:42:59 smithi086 ceph-mon[35163]: pgmap v2274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:43:00.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:42:59 smithi159 ceph-mon[36109]: pgmap v2274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:43:00.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:42:59 smithi055 ceph-mon[31863]: pgmap v2274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T06:43:00.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3251 sec 2024-03-28T06:43:01.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3252 sec 2024-03-28T06:43:02.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:01 smithi086 ceph-mon[35163]: pgmap v2275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T06:43:02.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:01 smithi159 ceph-mon[36109]: pgmap v2275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T06:43:02.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:01 smithi055 ceph-mon[31863]: pgmap v2275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T06:43:02.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3253 sec 2024-03-28T06:43:03.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3254 sec 2024-03-28T06:43:04.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2582.826658 secs 2024-03-28T06:43:04.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:03 smithi086 ceph-mon[35163]: pgmap v2276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2582.826658 secs 2024-03-28T06:43:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:03 smithi159 ceph-mon[36109]: pgmap v2276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2582.826658 secs 2024-03-28T06:43:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:03 smithi055 ceph-mon[31863]: pgmap v2276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:04.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3255 sec 2024-03-28T06:43:05.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3256 sec 2024-03-28T06:43:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:05 smithi086 ceph-mon[35163]: pgmap v2277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:06.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:05 smithi159 ceph-mon[36109]: pgmap v2277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:06.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:05 smithi055 ceph-mon[31863]: pgmap v2277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:06.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3257 sec 2024-03-28T06:43:07.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3258 sec 2024-03-28T06:43:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:07 smithi086 ceph-mon[35163]: pgmap v2278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:07 smithi159 ceph-mon[36109]: pgmap v2278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:08.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:07 smithi055 ceph-mon[31863]: pgmap v2278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:08.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3259 sec 2024-03-28T06:43:09.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2587.826773 secs 2024-03-28T06:43:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2587.826773 secs 2024-03-28T06:43:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2587.826773 secs 2024-03-28T06:43:09.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3260 sec 2024-03-28T06:43:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:09 smithi086 ceph-mon[35163]: pgmap v2279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:10.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:09 smithi159 ceph-mon[36109]: pgmap v2279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:10.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:09 smithi055 ceph-mon[31863]: pgmap v2279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:10.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3261 sec 2024-03-28T06:43:11.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3262 sec 2024-03-28T06:43:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:11 smithi086 ceph-mon[35163]: pgmap v2280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:12.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:11 smithi159 ceph-mon[36109]: pgmap v2280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:12.130 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:11 smithi055 ceph-mon[31863]: pgmap v2280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:12.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3263 sec 2024-03-28T06:43:13.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3264 sec 2024-03-28T06:43:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2592.826847 secs 2024-03-28T06:43:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:13 smithi086 ceph-mon[35163]: pgmap v2281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2592.826847 secs 2024-03-28T06:43:14.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:13 smithi159 ceph-mon[36109]: pgmap v2281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2592.826847 secs 2024-03-28T06:43:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:13 smithi055 ceph-mon[31863]: pgmap v2281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:14.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3265 sec 2024-03-28T06:43:15.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3266 sec 2024-03-28T06:43:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:15 smithi086 ceph-mon[35163]: pgmap v2282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:16.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:15 smithi159 ceph-mon[36109]: pgmap v2282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:16.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:15 smithi055 ceph-mon[31863]: pgmap v2282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:16.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3267 sec 2024-03-28T06:43:17.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3268 sec 2024-03-28T06:43:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:17 smithi086 ceph-mon[35163]: pgmap v2283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:18.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:17 smithi159 ceph-mon[36109]: pgmap v2283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:18.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:17 smithi055 ceph-mon[31863]: pgmap v2283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:18.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3269 sec 2024-03-28T06:43:19.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2597.826928 secs 2024-03-28T06:43:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2597.826928 secs 2024-03-28T06:43:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2597.826928 secs 2024-03-28T06:43:19.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3270 sec 2024-03-28T06:43:20.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:19 smithi086 ceph-mon[35163]: pgmap v2284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:20.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:19 smithi159 ceph-mon[36109]: pgmap v2284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:20.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:19 smithi055 ceph-mon[31863]: pgmap v2284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:20.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3271 sec 2024-03-28T06:43:21.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3272 sec 2024-03-28T06:43:22.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:21 smithi086 ceph-mon[35163]: pgmap v2285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:22.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:21 smithi159 ceph-mon[36109]: pgmap v2285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:22.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:21 smithi055 ceph-mon[31863]: pgmap v2285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:22.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3273 sec 2024-03-28T06:43:23.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3274 sec 2024-03-28T06:43:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2602.827051 secs 2024-03-28T06:43:24.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:23 smithi086 ceph-mon[35163]: pgmap v2286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2602.827051 secs 2024-03-28T06:43:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:23 smithi159 ceph-mon[36109]: pgmap v2286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2602.827051 secs 2024-03-28T06:43:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:23 smithi055 ceph-mon[31863]: pgmap v2286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:24.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3275 sec 2024-03-28T06:43:25.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3276 sec 2024-03-28T06:43:26.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:25 smithi086 ceph-mon[35163]: pgmap v2287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:26.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:25 smithi159 ceph-mon[36109]: pgmap v2287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:26.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:25 smithi055 ceph-mon[31863]: pgmap v2287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:26.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3277 sec 2024-03-28T06:43:27.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3278 sec 2024-03-28T06:43:28.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:27 smithi055 ceph-mon[31863]: pgmap v2288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:27 smithi086 ceph-mon[35163]: pgmap v2288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:28.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:27 smithi159 ceph-mon[36109]: pgmap v2288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:28.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3279 sec 2024-03-28T06:43:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2607.827089 secs 2024-03-28T06:43:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2607.827089 secs 2024-03-28T06:43:29.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2607.827089 secs 2024-03-28T06:43:29.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3280 sec 2024-03-28T06:43:30.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:29 smithi055 ceph-mon[31863]: pgmap v2289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:29 smithi086 ceph-mon[35163]: pgmap v2289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:29 smithi159 ceph-mon[36109]: pgmap v2289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:30.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3281 sec 2024-03-28T06:43:31.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3282 sec 2024-03-28T06:43:32.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:31 smithi055 ceph-mon[31863]: pgmap v2290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:32.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:31 smithi086 ceph-mon[35163]: pgmap v2290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:32.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:31 smithi159 ceph-mon[36109]: pgmap v2290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:32.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3283 sec 2024-03-28T06:43:33.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3284 sec 2024-03-28T06:43:34.124 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2612.827165 secs 2024-03-28T06:43:34.124 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:33 smithi086 ceph-mon[35163]: pgmap v2291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:34.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2612.827165 secs 2024-03-28T06:43:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:33 smithi055 ceph-mon[31863]: pgmap v2291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:34.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2612.827165 secs 2024-03-28T06:43:34.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:33 smithi159 ceph-mon[36109]: pgmap v2291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:34.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3285 sec 2024-03-28T06:43:35.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3286 sec 2024-03-28T06:43:36.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:35 smithi055 ceph-mon[31863]: pgmap v2292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:35 smithi086 ceph-mon[35163]: pgmap v2292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:36.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:35 smithi159 ceph-mon[36109]: pgmap v2292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:36.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3287 sec 2024-03-28T06:43:37.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3288 sec 2024-03-28T06:43:38.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:37 smithi055 ceph-mon[31863]: pgmap v2293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:38.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2617.827286 secs 2024-03-28T06:43:38.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:37 smithi086 ceph-mon[35163]: pgmap v2293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:38.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2617.827286 secs 2024-03-28T06:43:38.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:37 smithi159 ceph-mon[36109]: pgmap v2293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:38.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2617.827286 secs 2024-03-28T06:43:38.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3289 sec 2024-03-28T06:43:39.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3290 sec 2024-03-28T06:43:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:39 smithi086 ceph-mon[35163]: pgmap v2294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:40.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:39 smithi159 ceph-mon[36109]: pgmap v2294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:40.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:39 smithi055 ceph-mon[31863]: pgmap v2294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:40.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3291 sec 2024-03-28T06:43:41.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3292 sec 2024-03-28T06:43:42.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:41 smithi086 ceph-mon[35163]: pgmap v2295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:42.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:41 smithi159 ceph-mon[36109]: pgmap v2295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:42.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:41 smithi055 ceph-mon[31863]: pgmap v2295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:43:42.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3293 sec 2024-03-28T06:43:43.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2622.827348 secs 2024-03-28T06:43:43.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2622.827348 secs 2024-03-28T06:43:43.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2622.827348 secs 2024-03-28T06:43:43.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3294 sec 2024-03-28T06:43:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:43 smithi086 ceph-mon[35163]: pgmap v2296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:43 smithi159 ceph-mon[36109]: pgmap v2296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:43 smithi055 ceph-mon[31863]: pgmap v2296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:43:44.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3295 sec 2024-03-28T06:43:45.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3296 sec 2024-03-28T06:43:46.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:45 smithi086 ceph-mon[35163]: pgmap v2297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:46.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:45 smithi159 ceph-mon[36109]: pgmap v2297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:46.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:45 smithi055 ceph-mon[31863]: pgmap v2297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:46.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3297 sec 2024-03-28T06:43:47.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3298 sec 2024-03-28T06:43:48.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:47 smithi086 ceph-mon[35163]: pgmap v2298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:48.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2627.827410 secs 2024-03-28T06:43:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:47 smithi159 ceph-mon[36109]: pgmap v2298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:48.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2627.827410 secs 2024-03-28T06:43:48.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:47 smithi055 ceph-mon[31863]: pgmap v2298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:48.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2627.827410 secs 2024-03-28T06:43:48.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3299 sec 2024-03-28T06:43:49.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3300 sec 2024-03-28T06:43:50.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:49 smithi086 ceph-mon[35163]: pgmap v2299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:49 smithi159 ceph-mon[36109]: pgmap v2299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:50.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:49 smithi055 ceph-mon[31863]: pgmap v2299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:50.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3301 sec 2024-03-28T06:43:51.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3302 sec 2024-03-28T06:43:52.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:51 smithi086 ceph-mon[35163]: pgmap v2300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:51 smithi159 ceph-mon[36109]: pgmap v2300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:52.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:51 smithi055 ceph-mon[31863]: pgmap v2300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:43:52.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3303 sec 2024-03-28T06:43:53.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2632.827475 secs 2024-03-28T06:43:53.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2632.827475 secs 2024-03-28T06:43:53.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2632.827475 secs 2024-03-28T06:43:53.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3304 sec 2024-03-28T06:43:54.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:53 smithi086 ceph-mon[35163]: pgmap v2301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:53 smithi159 ceph-mon[36109]: pgmap v2301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:54.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:53 smithi055 ceph-mon[31863]: pgmap v2301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:43:54.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3305 sec 2024-03-28T06:43:55.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3306 sec 2024-03-28T06:43:56.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:55 smithi086 ceph-mon[35163]: pgmap v2302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:56.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:55 smithi159 ceph-mon[36109]: pgmap v2302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:56.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:55 smithi055 ceph-mon[31863]: pgmap v2302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:56.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3307 sec 2024-03-28T06:43:57.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3308 sec 2024-03-28T06:43:58.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:57 smithi086 ceph-mon[35163]: pgmap v2303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:58.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:43:58.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2637.827574 secs 2024-03-28T06:43:58.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:57 smithi159 ceph-mon[36109]: pgmap v2303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:58.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:43:58.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2637.827574 secs 2024-03-28T06:43:58.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:57 smithi055 ceph-mon[31863]: pgmap v2303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:58.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:43:58.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2637.827574 secs 2024-03-28T06:43:58.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3309 sec 2024-03-28T06:43:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: pgmap v2304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: pgmap v2305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:43:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:43:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: pgmap v2304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: pgmap v2305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:43:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:43:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: pgmap v2304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: pgmap v2305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:43:59.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:43:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:43:59.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3310 sec 2024-03-28T06:44:00.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3311 sec 2024-03-28T06:44:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:00 smithi086 ceph-mon[35163]: pgmap v2306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:00.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:00 smithi159 ceph-mon[36109]: pgmap v2306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:00.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:00 smithi055 ceph-mon[31863]: pgmap v2306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:01.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3312 sec 2024-03-28T06:44:02.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3313 sec 2024-03-28T06:44:02.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:02 smithi086 ceph-mon[35163]: pgmap v2307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:02.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:02 smithi159 ceph-mon[36109]: pgmap v2307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:02.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:02 smithi055 ceph-mon[31863]: pgmap v2307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:03.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3314 sec 2024-03-28T06:44:03.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2642.827694 secs 2024-03-28T06:44:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2642.827694 secs 2024-03-28T06:44:03.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2642.827694 secs 2024-03-28T06:44:04.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3315 sec 2024-03-28T06:44:04.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:04 smithi055 ceph-mon[31863]: pgmap v2308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:04 smithi086 ceph-mon[35163]: pgmap v2308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:05.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:04 smithi159 ceph-mon[36109]: pgmap v2308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:05.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3316 sec 2024-03-28T06:44:06.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3317 sec 2024-03-28T06:44:06.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:06 smithi086 ceph-mon[35163]: pgmap v2309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:06.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:06 smithi159 ceph-mon[36109]: pgmap v2309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:06.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:06 smithi055 ceph-mon[31863]: pgmap v2309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:44:07.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3318 sec 2024-03-28T06:44:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2647.827774 secs 2024-03-28T06:44:08.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2647.827774 secs 2024-03-28T06:44:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2647.827774 secs 2024-03-28T06:44:08.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3319 sec 2024-03-28T06:44:09.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:08 smithi086 ceph-mon[35163]: pgmap v2310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:44:09.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:08 smithi159 ceph-mon[36109]: pgmap v2310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:44:09.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:08 smithi055 ceph-mon[31863]: pgmap v2310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:44:09.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3320 sec 2024-03-28T06:44:10.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3321 sec 2024-03-28T06:44:10.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:10 smithi086 ceph-mon[35163]: pgmap v2311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:10.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:10 smithi159 ceph-mon[36109]: pgmap v2311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:10.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:10 smithi055 ceph-mon[31863]: pgmap v2311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:11.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3322 sec 2024-03-28T06:44:12.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3323 sec 2024-03-28T06:44:12.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:12 smithi086 ceph-mon[35163]: pgmap v2312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:12.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:12 smithi159 ceph-mon[36109]: pgmap v2312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:12.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:12 smithi055 ceph-mon[31863]: pgmap v2312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:13.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3324 sec 2024-03-28T06:44:13.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2652.827890 secs 2024-03-28T06:44:13.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2652.827890 secs 2024-03-28T06:44:13.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2652.827890 secs 2024-03-28T06:44:14.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3325 sec 2024-03-28T06:44:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:14 smithi086 ceph-mon[35163]: pgmap v2313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:14.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:14 smithi159 ceph-mon[36109]: pgmap v2313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:14.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:14 smithi055 ceph-mon[31863]: pgmap v2313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:15.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3326 sec 2024-03-28T06:44:16.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3327 sec 2024-03-28T06:44:16.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:16 smithi086 ceph-mon[35163]: pgmap v2314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:16.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:16 smithi159 ceph-mon[36109]: pgmap v2314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:16.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:16 smithi055 ceph-mon[31863]: pgmap v2314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:17.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3328 sec 2024-03-28T06:44:18.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2657.828011 secs 2024-03-28T06:44:18.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2657.828011 secs 2024-03-28T06:44:18.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2657.828011 secs 2024-03-28T06:44:18.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3329 sec 2024-03-28T06:44:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:18 smithi086 ceph-mon[35163]: pgmap v2315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:19.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:18 smithi159 ceph-mon[36109]: pgmap v2315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:19.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:18 smithi055 ceph-mon[31863]: pgmap v2315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:19.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3330 sec 2024-03-28T06:44:20.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3331 sec 2024-03-28T06:44:20.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:20 smithi086 ceph-mon[35163]: pgmap v2316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:20.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:20 smithi159 ceph-mon[36109]: pgmap v2316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:20.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:20 smithi055 ceph-mon[31863]: pgmap v2316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:21.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3332 sec 2024-03-28T06:44:22.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3333 sec 2024-03-28T06:44:22.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:22 smithi086 ceph-mon[35163]: pgmap v2317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:22.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:22 smithi159 ceph-mon[36109]: pgmap v2317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:22.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:22 smithi055 ceph-mon[31863]: pgmap v2317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:23.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3334 sec 2024-03-28T06:44:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2662.828143 secs 2024-03-28T06:44:23.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2662.828143 secs 2024-03-28T06:44:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2662.828143 secs 2024-03-28T06:44:24.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3335 sec 2024-03-28T06:44:24.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:24 smithi159 ceph-mon[36109]: pgmap v2318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:24.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:24 smithi055 ceph-mon[31863]: pgmap v2318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:25.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:24 smithi086 ceph-mon[35163]: pgmap v2318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:25.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3336 sec 2024-03-28T06:44:26.583 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3337 sec 2024-03-28T06:44:26.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:26 smithi086 ceph-mon[35163]: pgmap v2319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:26.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:26 smithi159 ceph-mon[36109]: pgmap v2319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:26.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:26 smithi055 ceph-mon[31863]: pgmap v2319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:27.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3338 sec 2024-03-28T06:44:28.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2667.828223 secs 2024-03-28T06:44:28.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2667.828223 secs 2024-03-28T06:44:28.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2667.828223 secs 2024-03-28T06:44:28.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3339 sec 2024-03-28T06:44:29.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:28 smithi086 ceph-mon[35163]: pgmap v2320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:29.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:28 smithi159 ceph-mon[36109]: pgmap v2320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:29.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:28 smithi055 ceph-mon[31863]: pgmap v2320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:29.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3340 sec 2024-03-28T06:44:30.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3341 sec 2024-03-28T06:44:30.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:30 smithi086 ceph-mon[35163]: pgmap v2321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:30.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:30 smithi159 ceph-mon[36109]: pgmap v2321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:30.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:30 smithi055 ceph-mon[31863]: pgmap v2321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:31.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3342 sec 2024-03-28T06:44:32.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3343 sec 2024-03-28T06:44:32.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:32 smithi086 ceph-mon[35163]: pgmap v2322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:32.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:32 smithi159 ceph-mon[36109]: pgmap v2322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:32.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:32 smithi055 ceph-mon[31863]: pgmap v2322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:33.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3344 sec 2024-03-28T06:44:33.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2672.828299 secs 2024-03-28T06:44:33.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2672.828299 secs 2024-03-28T06:44:33.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2672.828299 secs 2024-03-28T06:44:34.584 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3345 sec 2024-03-28T06:44:34.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:34 smithi055 ceph-mon[31863]: pgmap v2323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:35.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:34 smithi086 ceph-mon[35163]: pgmap v2323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:35.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:34 smithi159 ceph-mon[36109]: pgmap v2323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:35.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3346 sec 2024-03-28T06:44:36.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3347 sec 2024-03-28T06:44:36.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:36 smithi086 ceph-mon[35163]: pgmap v2324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:36.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:36 smithi159 ceph-mon[36109]: pgmap v2324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:36.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:36 smithi055 ceph-mon[31863]: pgmap v2324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:37.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3348 sec 2024-03-28T06:44:38.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2677.828419 secs 2024-03-28T06:44:38.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2677.828419 secs 2024-03-28T06:44:38.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2677.828419 secs 2024-03-28T06:44:38.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3349 sec 2024-03-28T06:44:39.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:38 smithi086 ceph-mon[35163]: pgmap v2325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:39.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:38 smithi159 ceph-mon[36109]: pgmap v2325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:39.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:38 smithi055 ceph-mon[31863]: pgmap v2325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:39.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3350 sec 2024-03-28T06:44:40.585 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3351 sec 2024-03-28T06:44:40.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:40 smithi086 ceph-mon[35163]: pgmap v2326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:40.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:40 smithi159 ceph-mon[36109]: pgmap v2326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:40.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:40 smithi055 ceph-mon[31863]: pgmap v2326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:41.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3352 sec 2024-03-28T06:44:42.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3353 sec 2024-03-28T06:44:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:42 smithi086 ceph-mon[35163]: pgmap v2327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:42.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:42 smithi159 ceph-mon[36109]: pgmap v2327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:42.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:42 smithi055 ceph-mon[31863]: pgmap v2327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:43.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3354 sec 2024-03-28T06:44:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2682.828507 secs 2024-03-28T06:44:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2682.828507 secs 2024-03-28T06:44:43.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2682.828507 secs 2024-03-28T06:44:44.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3355 sec 2024-03-28T06:44:44.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:44 smithi055 ceph-mon[31863]: pgmap v2328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:45.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:44 smithi086 ceph-mon[35163]: pgmap v2328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:45.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:44 smithi159 ceph-mon[36109]: pgmap v2328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:45.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3356 sec 2024-03-28T06:44:46.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3357 sec 2024-03-28T06:44:46.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:46 smithi086 ceph-mon[35163]: pgmap v2329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:46.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:46 smithi159 ceph-mon[36109]: pgmap v2329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:46.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:46 smithi055 ceph-mon[31863]: pgmap v2329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:47.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3358 sec 2024-03-28T06:44:48.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2687.828582 secs 2024-03-28T06:44:48.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2687.828582 secs 2024-03-28T06:44:48.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2687.828582 secs 2024-03-28T06:44:48.586 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3359 sec 2024-03-28T06:44:49.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:48 smithi086 ceph-mon[35163]: pgmap v2330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:49.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:48 smithi159 ceph-mon[36109]: pgmap v2330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:49.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:48 smithi055 ceph-mon[31863]: pgmap v2330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:49.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3360 sec 2024-03-28T06:44:50.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3361 sec 2024-03-28T06:44:50.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:50 smithi086 ceph-mon[35163]: pgmap v2331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:50.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:50 smithi159 ceph-mon[36109]: pgmap v2331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:50.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:50 smithi055 ceph-mon[31863]: pgmap v2331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:44:51.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3362 sec 2024-03-28T06:44:52.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3363 sec 2024-03-28T06:44:52.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:52 smithi086 ceph-mon[35163]: pgmap v2332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:52.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:52 smithi159 ceph-mon[36109]: pgmap v2332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:52.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:52 smithi055 ceph-mon[31863]: pgmap v2332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:44:53.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3364 sec 2024-03-28T06:44:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2692.828648 secs 2024-03-28T06:44:53.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2692.828648 secs 2024-03-28T06:44:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2692.828648 secs 2024-03-28T06:44:54.587 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3365 sec 2024-03-28T06:44:54.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:54 smithi055 ceph-mon[31863]: pgmap v2333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:55.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:54 smithi086 ceph-mon[35163]: pgmap v2333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:55.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:54 smithi159 ceph-mon[36109]: pgmap v2333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:55.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3366 sec 2024-03-28T06:44:56.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3367 sec 2024-03-28T06:44:56.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:56 smithi086 ceph-mon[35163]: pgmap v2334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:56.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:56 smithi159 ceph-mon[36109]: pgmap v2334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:56.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:56 smithi055 ceph-mon[31863]: pgmap v2334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:57.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3368 sec 2024-03-28T06:44:58.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2697.828771 secs 2024-03-28T06:44:58.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2697.828771 secs 2024-03-28T06:44:58.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2697.828771 secs 2024-03-28T06:44:58.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3369 sec 2024-03-28T06:44:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:58 smithi086 ceph-mon[35163]: pgmap v2335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:44:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:44:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:58 smithi159 ceph-mon[36109]: pgmap v2335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:44:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:44:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:58 smithi055 ceph-mon[31863]: pgmap v2335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:44:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:44:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:44:59.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3370 sec 2024-03-28T06:45:00.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:45:00.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:45:00.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:45:00.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:45:00.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3371 sec 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:45:00.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:45:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:01 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:45:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:01 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:45:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:01 smithi086 ceph-mon[35163]: pgmap v2336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:01 smithi086 ceph-mon[35163]: pgmap v2337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:01.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:01 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:45:01.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:01 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:45:01.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:01 smithi159 ceph-mon[36109]: pgmap v2336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:01.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:01 smithi159 ceph-mon[36109]: pgmap v2337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:01.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3372 sec 2024-03-28T06:45:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:01 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:45:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:01 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:45:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:01 smithi055 ceph-mon[31863]: pgmap v2336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:01 smithi055 ceph-mon[31863]: pgmap v2337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:02.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3373 sec 2024-03-28T06:45:03.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:03 smithi086 ceph-mon[35163]: pgmap v2338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:03.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2702.828891 secs 2024-03-28T06:45:03.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:03 smithi159 ceph-mon[36109]: pgmap v2338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:03.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2702.828891 secs 2024-03-28T06:45:03.588 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3374 sec 2024-03-28T06:45:03.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:03 smithi055 ceph-mon[31863]: pgmap v2338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:03.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2702.828891 secs 2024-03-28T06:45:04.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3375 sec 2024-03-28T06:45:05.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:05 smithi086 ceph-mon[35163]: pgmap v2339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:05.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:05 smithi159 ceph-mon[36109]: pgmap v2339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:05.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3376 sec 2024-03-28T06:45:05.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:05 smithi055 ceph-mon[31863]: pgmap v2339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:06.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3377 sec 2024-03-28T06:45:07.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:07 smithi086 ceph-mon[35163]: pgmap v2340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:07 smithi159 ceph-mon[36109]: pgmap v2340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:07.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3378 sec 2024-03-28T06:45:07.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:07 smithi055 ceph-mon[31863]: pgmap v2340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2707.829005 secs 2024-03-28T06:45:08.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2707.829005 secs 2024-03-28T06:45:08.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3379 sec 2024-03-28T06:45:08.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2707.829005 secs 2024-03-28T06:45:09.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:09 smithi086 ceph-mon[35163]: pgmap v2341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:09.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:09 smithi159 ceph-mon[36109]: pgmap v2341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:09.589 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3380 sec 2024-03-28T06:45:09.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:09 smithi055 ceph-mon[31863]: pgmap v2341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:10.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3381 sec 2024-03-28T06:45:11.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:11 smithi086 ceph-mon[35163]: pgmap v2342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:45:11.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:11 smithi159 ceph-mon[36109]: pgmap v2342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:45:11.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3382 sec 2024-03-28T06:45:11.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:11 smithi055 ceph-mon[31863]: pgmap v2342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:45:12.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3383 sec 2024-03-28T06:45:13.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:13 smithi086 ceph-mon[35163]: pgmap v2343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:13.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2712.829070 secs 2024-03-28T06:45:13.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:13 smithi159 ceph-mon[36109]: pgmap v2343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:13.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2712.829070 secs 2024-03-28T06:45:13.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3384 sec 2024-03-28T06:45:13.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:13 smithi055 ceph-mon[31863]: pgmap v2343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:13.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2712.829070 secs 2024-03-28T06:45:14.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3385 sec 2024-03-28T06:45:15.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:15 smithi086 ceph-mon[35163]: pgmap v2344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:15.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:15 smithi159 ceph-mon[36109]: pgmap v2344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:15.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3386 sec 2024-03-28T06:45:15.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:15 smithi055 ceph-mon[31863]: pgmap v2344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:16.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3387 sec 2024-03-28T06:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:17 smithi086 ceph-mon[35163]: pgmap v2345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:17.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:17 smithi159 ceph-mon[36109]: pgmap v2345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:17.590 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3388 sec 2024-03-28T06:45:17.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:17 smithi055 ceph-mon[31863]: pgmap v2345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:18.591 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3389 sec 2024-03-28T06:45:18.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2717.829194 secs 2024-03-28T06:45:18.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2717.829194 secs 2024-03-28T06:45:18.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2717.829194 secs 2024-03-28T06:45:19.591 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3390 sec 2024-03-28T06:45:19.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:19 smithi055 ceph-mon[31863]: pgmap v2346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:19.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:19 smithi086 ceph-mon[35163]: pgmap v2346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:19.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:19 smithi159 ceph-mon[36109]: pgmap v2346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:20.591 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3391 sec 2024-03-28T06:45:21.591 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3392 sec 2024-03-28T06:45:21.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:21 smithi055 ceph-mon[31863]: pgmap v2347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:21.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:21 smithi086 ceph-mon[35163]: pgmap v2347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:21.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:21 smithi159 ceph-mon[36109]: pgmap v2347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:22.591 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3393 sec 2024-03-28T06:45:23.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3394 sec 2024-03-28T06:45:23.627 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:23 smithi159 ceph-mon[36109]: pgmap v2348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:23.627 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2722.829279 secs 2024-03-28T06:45:23.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:23 smithi055 ceph-mon[31863]: pgmap v2348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:23.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2722.829279 secs 2024-03-28T06:45:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:23 smithi086 ceph-mon[35163]: pgmap v2348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2722.829279 secs 2024-03-28T06:45:24.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3395 sec 2024-03-28T06:45:25.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3396 sec 2024-03-28T06:45:25.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:25 smithi055 ceph-mon[31863]: pgmap v2349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:25.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:25 smithi086 ceph-mon[35163]: pgmap v2349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:25.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:25 smithi159 ceph-mon[36109]: pgmap v2349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:26.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3397 sec 2024-03-28T06:45:27.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3398 sec 2024-03-28T06:45:27.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:27 smithi055 ceph-mon[31863]: pgmap v2350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:27.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:27 smithi086 ceph-mon[35163]: pgmap v2350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:27.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:27 smithi159 ceph-mon[36109]: pgmap v2350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:28.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3399 sec 2024-03-28T06:45:28.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2727.829404 secs 2024-03-28T06:45:28.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2727.829404 secs 2024-03-28T06:45:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2727.829404 secs 2024-03-28T06:45:29.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3400 sec 2024-03-28T06:45:29.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:29 smithi086 ceph-mon[35163]: pgmap v2351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:29.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:29 smithi159 ceph-mon[36109]: pgmap v2351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:29.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:29 smithi055 ceph-mon[31863]: pgmap v2351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:30.592 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3401 sec 2024-03-28T06:45:31.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3402 sec 2024-03-28T06:45:31.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:31 smithi086 ceph-mon[35163]: pgmap v2352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:31.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:31 smithi159 ceph-mon[36109]: pgmap v2352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:31.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:31 smithi055 ceph-mon[31863]: pgmap v2352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:32.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3403 sec 2024-03-28T06:45:33.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3404 sec 2024-03-28T06:45:33.680 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:33 smithi055 ceph-mon[31863]: pgmap v2353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:33.680 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2732.829523 secs 2024-03-28T06:45:33.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:33 smithi086 ceph-mon[35163]: pgmap v2353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:33.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2732.829523 secs 2024-03-28T06:45:33.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:33 smithi159 ceph-mon[36109]: pgmap v2353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:33.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2732.829523 secs 2024-03-28T06:45:34.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3405 sec 2024-03-28T06:45:35.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3406 sec 2024-03-28T06:45:35.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:35 smithi086 ceph-mon[35163]: pgmap v2354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:35.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:35 smithi159 ceph-mon[36109]: pgmap v2354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:35.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:35 smithi055 ceph-mon[31863]: pgmap v2354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:36.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3407 sec 2024-03-28T06:45:37.593 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3408 sec 2024-03-28T06:45:37.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:37 smithi086 ceph-mon[35163]: pgmap v2355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:37.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:37 smithi159 ceph-mon[36109]: pgmap v2355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:37.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:37 smithi055 ceph-mon[31863]: pgmap v2355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:38.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3409 sec 2024-03-28T06:45:38.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2737.829597 secs 2024-03-28T06:45:38.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2737.829597 secs 2024-03-28T06:45:38.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2737.829597 secs 2024-03-28T06:45:39.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3410 sec 2024-03-28T06:45:39.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:39 smithi086 ceph-mon[35163]: pgmap v2356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:39.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:39 smithi159 ceph-mon[36109]: pgmap v2356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:39.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:39 smithi055 ceph-mon[31863]: pgmap v2356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:40.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3411 sec 2024-03-28T06:45:41.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3412 sec 2024-03-28T06:45:41.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:41 smithi086 ceph-mon[35163]: pgmap v2357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:41.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:41 smithi159 ceph-mon[36109]: pgmap v2357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:41.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:41 smithi055 ceph-mon[31863]: pgmap v2357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:42.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3413 sec 2024-03-28T06:45:43.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3414 sec 2024-03-28T06:45:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:43 smithi086 ceph-mon[35163]: pgmap v2358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2742.829673 secs 2024-03-28T06:45:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:43 smithi159 ceph-mon[36109]: pgmap v2358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2742.829673 secs 2024-03-28T06:45:43.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:43 smithi055 ceph-mon[31863]: pgmap v2358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:43.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2742.829673 secs 2024-03-28T06:45:44.594 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3415 sec 2024-03-28T06:45:45.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3416 sec 2024-03-28T06:45:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:45 smithi086 ceph-mon[35163]: pgmap v2359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:45.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:45 smithi159 ceph-mon[36109]: pgmap v2359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:45 smithi055 ceph-mon[31863]: pgmap v2359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:46.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3417 sec 2024-03-28T06:45:47.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3418 sec 2024-03-28T06:45:47.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:47 smithi086 ceph-mon[35163]: pgmap v2360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:47.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:47 smithi159 ceph-mon[36109]: pgmap v2360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:47.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:47 smithi055 ceph-mon[31863]: pgmap v2360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:48.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3419 sec 2024-03-28T06:45:48.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2747.829827 secs 2024-03-28T06:45:48.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2747.829827 secs 2024-03-28T06:45:48.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2747.829827 secs 2024-03-28T06:45:49.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3420 sec 2024-03-28T06:45:49.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:49 smithi086 ceph-mon[35163]: pgmap v2361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:49.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:49 smithi159 ceph-mon[36109]: pgmap v2361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:49.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:49 smithi055 ceph-mon[31863]: pgmap v2361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:50.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3421 sec 2024-03-28T06:45:51.595 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3422 sec 2024-03-28T06:45:51.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:51 smithi086 ceph-mon[35163]: pgmap v2362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:51.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:51 smithi159 ceph-mon[36109]: pgmap v2362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:51.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:51 smithi055 ceph-mon[31863]: pgmap v2362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:45:52.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3423 sec 2024-03-28T06:45:53.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3424 sec 2024-03-28T06:45:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:53 smithi086 ceph-mon[35163]: pgmap v2363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2752.829900 secs 2024-03-28T06:45:53.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:53 smithi159 ceph-mon[36109]: pgmap v2363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:53.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2752.829900 secs 2024-03-28T06:45:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:53 smithi055 ceph-mon[31863]: pgmap v2363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:45:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2752.829900 secs 2024-03-28T06:45:54.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3425 sec 2024-03-28T06:45:55.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3426 sec 2024-03-28T06:45:55.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:55 smithi086 ceph-mon[35163]: pgmap v2364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:55.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:55 smithi159 ceph-mon[36109]: pgmap v2364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:55.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:55 smithi055 ceph-mon[31863]: pgmap v2364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:56.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3427 sec 2024-03-28T06:45:57.596 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3428 sec 2024-03-28T06:45:57.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:57 smithi086 ceph-mon[35163]: pgmap v2365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:57.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:57 smithi159 ceph-mon[36109]: pgmap v2365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:57.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:57 smithi055 ceph-mon[31863]: pgmap v2365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:58.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3429 sec 2024-03-28T06:45:58.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2757.829971 secs 2024-03-28T06:45:58.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2757.829971 secs 2024-03-28T06:45:58.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2757.829971 secs 2024-03-28T06:45:59.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3430 sec 2024-03-28T06:45:59.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:45:59 smithi086 ceph-mon[35163]: pgmap v2366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:59.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:45:59 smithi159 ceph-mon[36109]: pgmap v2366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:45:59.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:45:59 smithi055 ceph-mon[31863]: pgmap v2366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:00.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3431 sec 2024-03-28T06:46:00.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:00 smithi086 ceph-mon[35163]: pgmap v2367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:46:00.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:00 smithi159 ceph-mon[36109]: pgmap v2367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:46:00.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:00 smithi055 ceph-mon[31863]: pgmap v2367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:46:01.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3432 sec 2024-03-28T06:46:01.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:46:01.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:46:01.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:46:02.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3433 sec 2024-03-28T06:46:02.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:46:02.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:46:02.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:02 smithi086 ceph-mon[35163]: pgmap v2368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:02.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:02 smithi086 ceph-mon[35163]: pgmap v2369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:02.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:46:02.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:46:02.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:46:02.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:02 smithi159 ceph-mon[36109]: pgmap v2368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:02.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:02 smithi159 ceph-mon[36109]: pgmap v2369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:02.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:46:02.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:46:02.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:46:02.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:02 smithi055 ceph-mon[31863]: pgmap v2368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:02.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:02 smithi055 ceph-mon[31863]: pgmap v2369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:02.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:46:03.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3434 sec 2024-03-28T06:46:03.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2762.830042 secs 2024-03-28T06:46:03.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2762.830042 secs 2024-03-28T06:46:03.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2762.830042 secs 2024-03-28T06:46:04.597 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3435 sec 2024-03-28T06:46:04.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:04 smithi055 ceph-mon[31863]: pgmap v2370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:05.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:04 smithi086 ceph-mon[35163]: pgmap v2370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:05.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:04 smithi159 ceph-mon[36109]: pgmap v2370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:05.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3436 sec 2024-03-28T06:46:06.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3437 sec 2024-03-28T06:46:07.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:06 smithi086 ceph-mon[35163]: pgmap v2371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:07.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:06 smithi159 ceph-mon[36109]: pgmap v2371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:07.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:06 smithi055 ceph-mon[31863]: pgmap v2371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:07.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3438 sec 2024-03-28T06:46:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2767.830119 secs 2024-03-28T06:46:08.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2767.830119 secs 2024-03-28T06:46:08.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2767.830119 secs 2024-03-28T06:46:08.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3439 sec 2024-03-28T06:46:09.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:09 smithi086 ceph-mon[35163]: pgmap v2372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:09.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:09 smithi159 ceph-mon[36109]: pgmap v2372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:09.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:09 smithi055 ceph-mon[31863]: pgmap v2372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:09.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3440 sec 2024-03-28T06:46:10.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3441 sec 2024-03-28T06:46:11.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:11 smithi086 ceph-mon[35163]: pgmap v2373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:46:11.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:11 smithi159 ceph-mon[36109]: pgmap v2373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:46:11.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:11 smithi055 ceph-mon[31863]: pgmap v2373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:46:11.598 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3442 sec 2024-03-28T06:46:12.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3443 sec 2024-03-28T06:46:13.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:13 smithi086 ceph-mon[35163]: pgmap v2374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:46:13.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2772.830183 secs 2024-03-28T06:46:13.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:13 smithi159 ceph-mon[36109]: pgmap v2374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:46:13.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2772.830183 secs 2024-03-28T06:46:13.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:13 smithi055 ceph-mon[31863]: pgmap v2374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:46:13.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2772.830183 secs 2024-03-28T06:46:13.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3444 sec 2024-03-28T06:46:14.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3445 sec 2024-03-28T06:46:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:15 smithi086 ceph-mon[35163]: pgmap v2375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:15.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:15 smithi159 ceph-mon[36109]: pgmap v2375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:15.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:15 smithi055 ceph-mon[31863]: pgmap v2375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:15.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3446 sec 2024-03-28T06:46:16.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3447 sec 2024-03-28T06:46:17.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:17 smithi086 ceph-mon[35163]: pgmap v2376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:17.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:17 smithi159 ceph-mon[36109]: pgmap v2376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:17.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:17 smithi055 ceph-mon[31863]: pgmap v2376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:17.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3448 sec 2024-03-28T06:46:18.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2777.830266 secs 2024-03-28T06:46:18.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2777.830266 secs 2024-03-28T06:46:18.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2777.830266 secs 2024-03-28T06:46:18.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3449 sec 2024-03-28T06:46:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:19 smithi086 ceph-mon[35163]: pgmap v2377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:19.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:19 smithi159 ceph-mon[36109]: pgmap v2377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:19.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:19 smithi055 ceph-mon[31863]: pgmap v2377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:19.599 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3450 sec 2024-03-28T06:46:20.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3451 sec 2024-03-28T06:46:21.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:21 smithi086 ceph-mon[35163]: pgmap v2378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:21.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:21 smithi159 ceph-mon[36109]: pgmap v2378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:21.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:21 smithi055 ceph-mon[31863]: pgmap v2378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:21.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3452 sec 2024-03-28T06:46:22.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3453 sec 2024-03-28T06:46:23.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:23 smithi055 ceph-mon[31863]: pgmap v2379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:23.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2782.830341 secs 2024-03-28T06:46:23.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:23 smithi086 ceph-mon[35163]: pgmap v2379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:23.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2782.830341 secs 2024-03-28T06:46:23.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:23 smithi159 ceph-mon[36109]: pgmap v2379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:23.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2782.830341 secs 2024-03-28T06:46:23.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3454 sec 2024-03-28T06:46:24.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3455 sec 2024-03-28T06:46:25.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:25 smithi055 ceph-mon[31863]: pgmap v2380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:25.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:25 smithi086 ceph-mon[35163]: pgmap v2380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:25.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:25 smithi159 ceph-mon[36109]: pgmap v2380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:25.600 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3456 sec 2024-03-28T06:46:26.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3457 sec 2024-03-28T06:46:27.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:27 smithi055 ceph-mon[31863]: pgmap v2381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:27.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:27 smithi086 ceph-mon[35163]: pgmap v2381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:27.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:27 smithi159 ceph-mon[36109]: pgmap v2381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:27.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3458 sec 2024-03-28T06:46:28.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2787.830462 secs 2024-03-28T06:46:28.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2787.830462 secs 2024-03-28T06:46:28.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2787.830462 secs 2024-03-28T06:46:28.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3459 sec 2024-03-28T06:46:29.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:29 smithi055 ceph-mon[31863]: pgmap v2382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:29.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:29 smithi086 ceph-mon[35163]: pgmap v2382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:29.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:29 smithi159 ceph-mon[36109]: pgmap v2382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:29.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3460 sec 2024-03-28T06:46:30.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3461 sec 2024-03-28T06:46:31.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:31 smithi055 ceph-mon[31863]: pgmap v2383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:31.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:31 smithi086 ceph-mon[35163]: pgmap v2383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:31.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:31 smithi159 ceph-mon[36109]: pgmap v2383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:31.601 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3462 sec 2024-03-28T06:46:32.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3463 sec 2024-03-28T06:46:33.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:33 smithi055 ceph-mon[31863]: pgmap v2384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:33.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2792.830584 secs 2024-03-28T06:46:33.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:33 smithi086 ceph-mon[35163]: pgmap v2384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:33.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2792.830584 secs 2024-03-28T06:46:33.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:33 smithi159 ceph-mon[36109]: pgmap v2384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:33.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2792.830584 secs 2024-03-28T06:46:33.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3464 sec 2024-03-28T06:46:34.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3465 sec 2024-03-28T06:46:35.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:35 smithi055 ceph-mon[31863]: pgmap v2385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:35.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:35 smithi086 ceph-mon[35163]: pgmap v2385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:35.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:35 smithi159 ceph-mon[36109]: pgmap v2385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:35.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3466 sec 2024-03-28T06:46:36.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3467 sec 2024-03-28T06:46:37.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:37 smithi086 ceph-mon[35163]: pgmap v2386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:37.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:37 smithi159 ceph-mon[36109]: pgmap v2386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:37.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3468 sec 2024-03-28T06:46:37.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:37 smithi055 ceph-mon[31863]: pgmap v2386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:38.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2797.830652 secs 2024-03-28T06:46:38.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2797.830652 secs 2024-03-28T06:46:38.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3469 sec 2024-03-28T06:46:38.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2797.830652 secs 2024-03-28T06:46:39.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:39 smithi086 ceph-mon[35163]: pgmap v2387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:39.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:39 smithi159 ceph-mon[36109]: pgmap v2387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:39.602 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3470 sec 2024-03-28T06:46:39.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:39 smithi055 ceph-mon[31863]: pgmap v2387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:40.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3471 sec 2024-03-28T06:46:41.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:41 smithi086 ceph-mon[35163]: pgmap v2388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:41.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:41 smithi159 ceph-mon[36109]: pgmap v2388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:41.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3472 sec 2024-03-28T06:46:41.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:41 smithi055 ceph-mon[31863]: pgmap v2388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:42.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3473 sec 2024-03-28T06:46:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:43 smithi086 ceph-mon[35163]: pgmap v2389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2802.830724 secs 2024-03-28T06:46:43.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:43 smithi159 ceph-mon[36109]: pgmap v2389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:43.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2802.830724 secs 2024-03-28T06:46:43.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3474 sec 2024-03-28T06:46:43.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:43 smithi055 ceph-mon[31863]: pgmap v2389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:43.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2802.830724 secs 2024-03-28T06:46:44.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3475 sec 2024-03-28T06:46:45.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:45 smithi086 ceph-mon[35163]: pgmap v2390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:45.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:45 smithi159 ceph-mon[36109]: pgmap v2390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:45.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3476 sec 2024-03-28T06:46:45.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:45 smithi055 ceph-mon[31863]: pgmap v2390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:46.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3477 sec 2024-03-28T06:46:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:47 smithi086 ceph-mon[35163]: pgmap v2391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:47 smithi159 ceph-mon[36109]: pgmap v2391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:47.603 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3478 sec 2024-03-28T06:46:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:47 smithi055 ceph-mon[31863]: pgmap v2391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:48.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2807.830809 secs 2024-03-28T06:46:48.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2807.830809 secs 2024-03-28T06:46:48.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3479 sec 2024-03-28T06:46:48.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2807.830809 secs 2024-03-28T06:46:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:49 smithi086 ceph-mon[35163]: pgmap v2392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:49.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:49 smithi159 ceph-mon[36109]: pgmap v2392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:49.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3480 sec 2024-03-28T06:46:49.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:49 smithi055 ceph-mon[31863]: pgmap v2392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:50.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3481 sec 2024-03-28T06:46:51.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:51 smithi086 ceph-mon[35163]: pgmap v2393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:51.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:51 smithi159 ceph-mon[36109]: pgmap v2393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:51.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3482 sec 2024-03-28T06:46:51.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:51 smithi055 ceph-mon[31863]: pgmap v2393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:46:52.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3483 sec 2024-03-28T06:46:53.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:53 smithi086 ceph-mon[35163]: pgmap v2394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:53.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2812.830873 secs 2024-03-28T06:46:53.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:53 smithi159 ceph-mon[36109]: pgmap v2394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:53.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2812.830873 secs 2024-03-28T06:46:53.604 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3484 sec 2024-03-28T06:46:53.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:53 smithi055 ceph-mon[31863]: pgmap v2394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:53.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2812.830873 secs 2024-03-28T06:46:54.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3485 sec 2024-03-28T06:46:55.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:55 smithi086 ceph-mon[35163]: pgmap v2395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:55.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:55 smithi159 ceph-mon[36109]: pgmap v2395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:55.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3486 sec 2024-03-28T06:46:55.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:55 smithi055 ceph-mon[31863]: pgmap v2395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:56.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3487 sec 2024-03-28T06:46:57.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:57 smithi086 ceph-mon[35163]: pgmap v2396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:57.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:57 smithi159 ceph-mon[36109]: pgmap v2396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:57.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3488 sec 2024-03-28T06:46:57.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:57 smithi055 ceph-mon[31863]: pgmap v2396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:58.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2817.830935 secs 2024-03-28T06:46:58.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2817.830935 secs 2024-03-28T06:46:58.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3489 sec 2024-03-28T06:46:58.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2817.830935 secs 2024-03-28T06:46:59.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:46:59 smithi086 ceph-mon[35163]: pgmap v2397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:59.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:46:59 smithi159 ceph-mon[36109]: pgmap v2397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:46:59.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3490 sec 2024-03-28T06:46:59.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:46:59 smithi055 ceph-mon[31863]: pgmap v2397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:00.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3491 sec 2024-03-28T06:47:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:01 smithi086 ceph-mon[35163]: pgmap v2398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:01.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:01 smithi159 ceph-mon[36109]: pgmap v2398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:01.605 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3492 sec 2024-03-28T06:47:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:01 smithi055 ceph-mon[31863]: pgmap v2398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:02.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3493 sec 2024-03-28T06:47:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:03 smithi086 ceph-mon[35163]: pgmap v2399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:47:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2822.831053 secs 2024-03-28T06:47:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:03.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:03 smithi159 ceph-mon[36109]: pgmap v2399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:03.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:47:03.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2822.831053 secs 2024-03-28T06:47:03.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:03.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:03.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3494 sec 2024-03-28T06:47:03.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:03 smithi055 ceph-mon[31863]: pgmap v2399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:03.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:47:03.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2822.831053 secs 2024-03-28T06:47:03.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:03.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3495 sec 2024-03-28T06:47:04.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:04.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:05.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:05 smithi086 ceph-mon[35163]: pgmap v2400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:05.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:47:05.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:47:05.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:05.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:05 smithi159 ceph-mon[36109]: pgmap v2400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:05.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:47:05.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:47:05.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:05.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3496 sec 2024-03-28T06:47:05.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:05 smithi055 ceph-mon[31863]: pgmap v2400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:05.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:47:05.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:47:05.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:47:06.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3497 sec 2024-03-28T06:47:06.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:06 smithi055 ceph-mon[31863]: pgmap v2401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:47:06.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:06 smithi055 ceph-mon[31863]: pgmap v2402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:06.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:06 smithi086 ceph-mon[35163]: pgmap v2401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:47:06.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:06 smithi086 ceph-mon[35163]: pgmap v2402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:06.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:06 smithi159 ceph-mon[36109]: pgmap v2401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:47:06.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:06 smithi159 ceph-mon[36109]: pgmap v2402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:07.606 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3498 sec 2024-03-28T06:47:08.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3499 sec 2024-03-28T06:47:08.625 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:08 smithi086 ceph-mon[35163]: pgmap v2403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:08.625 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2827.831136 secs 2024-03-28T06:47:08.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:08 smithi055 ceph-mon[31863]: pgmap v2403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:08.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2827.831136 secs 2024-03-28T06:47:08.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:08 smithi159 ceph-mon[36109]: pgmap v2403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:08.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2827.831136 secs 2024-03-28T06:47:09.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3500 sec 2024-03-28T06:47:10.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3501 sec 2024-03-28T06:47:10.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:10 smithi055 ceph-mon[31863]: pgmap v2404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:10.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:10 smithi086 ceph-mon[35163]: pgmap v2404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:10.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:10 smithi159 ceph-mon[36109]: pgmap v2404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:11.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3502 sec 2024-03-28T06:47:12.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3503 sec 2024-03-28T06:47:12.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:12 smithi055 ceph-mon[31863]: pgmap v2405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:12.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:12 smithi086 ceph-mon[35163]: pgmap v2405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:12.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:12 smithi159 ceph-mon[36109]: pgmap v2405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:47:13.607 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3504 sec 2024-03-28T06:47:13.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2832.831221 secs 2024-03-28T06:47:13.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2832.831221 secs 2024-03-28T06:47:13.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2832.831221 secs 2024-03-28T06:47:14.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3505 sec 2024-03-28T06:47:14.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:14 smithi055 ceph-mon[31863]: pgmap v2406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:14.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:14 smithi086 ceph-mon[35163]: pgmap v2406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:14.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:14 smithi159 ceph-mon[36109]: pgmap v2406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:15.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3506 sec 2024-03-28T06:47:16.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3507 sec 2024-03-28T06:47:16.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:16 smithi086 ceph-mon[35163]: pgmap v2407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:47:16.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:16 smithi159 ceph-mon[36109]: pgmap v2407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:47:16.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:16 smithi055 ceph-mon[31863]: pgmap v2407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:47:17.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3508 sec 2024-03-28T06:47:18.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3509 sec 2024-03-28T06:47:18.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:18 smithi086 ceph-mon[35163]: pgmap v2408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:18.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2837.831242 secs 2024-03-28T06:47:18.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:18 smithi159 ceph-mon[36109]: pgmap v2408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:18.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2837.831242 secs 2024-03-28T06:47:18.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:18 smithi055 ceph-mon[31863]: pgmap v2408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:18.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2837.831242 secs 2024-03-28T06:47:19.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3510 sec 2024-03-28T06:47:20.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3511 sec 2024-03-28T06:47:20.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:20 smithi086 ceph-mon[35163]: pgmap v2409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:20.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:20 smithi159 ceph-mon[36109]: pgmap v2409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:20.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:20 smithi055 ceph-mon[31863]: pgmap v2409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:21.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3512 sec 2024-03-28T06:47:22.608 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3513 sec 2024-03-28T06:47:22.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:22 smithi086 ceph-mon[35163]: pgmap v2410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:22.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:22 smithi159 ceph-mon[36109]: pgmap v2410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:22.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:22 smithi055 ceph-mon[31863]: pgmap v2410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:23.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3514 sec 2024-03-28T06:47:23.726 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2842.831305 secs 2024-03-28T06:47:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2842.831305 secs 2024-03-28T06:47:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2842.831305 secs 2024-03-28T06:47:24.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3515 sec 2024-03-28T06:47:24.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:24 smithi086 ceph-mon[35163]: pgmap v2411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:24.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:24 smithi159 ceph-mon[36109]: pgmap v2411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:24.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:24 smithi055 ceph-mon[31863]: pgmap v2411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:25.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3516 sec 2024-03-28T06:47:26.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3517 sec 2024-03-28T06:47:26.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:26 smithi086 ceph-mon[35163]: pgmap v2412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:26.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:26 smithi159 ceph-mon[36109]: pgmap v2412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:26.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:26 smithi055 ceph-mon[31863]: pgmap v2412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:27.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3518 sec 2024-03-28T06:47:28.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3519 sec 2024-03-28T06:47:28.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:28 smithi086 ceph-mon[35163]: pgmap v2413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:28.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2847.831380 secs 2024-03-28T06:47:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:28 smithi159 ceph-mon[36109]: pgmap v2413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2847.831380 secs 2024-03-28T06:47:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:28 smithi055 ceph-mon[31863]: pgmap v2413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2847.831380 secs 2024-03-28T06:47:29.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3520 sec 2024-03-28T06:47:30.609 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3521 sec 2024-03-28T06:47:30.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:30 smithi086 ceph-mon[35163]: pgmap v2414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:30.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:30 smithi159 ceph-mon[36109]: pgmap v2414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:30.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:30 smithi055 ceph-mon[31863]: pgmap v2414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:31.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3522 sec 2024-03-28T06:47:32.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3523 sec 2024-03-28T06:47:32.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:32 smithi086 ceph-mon[35163]: pgmap v2415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:32.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:32 smithi159 ceph-mon[36109]: pgmap v2415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:32.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:32 smithi055 ceph-mon[31863]: pgmap v2415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:33.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3524 sec 2024-03-28T06:47:33.779 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2852.831462 secs 2024-03-28T06:47:33.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2852.831462 secs 2024-03-28T06:47:33.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2852.831462 secs 2024-03-28T06:47:34.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3525 sec 2024-03-28T06:47:34.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:34 smithi086 ceph-mon[35163]: pgmap v2416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:34.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:34 smithi159 ceph-mon[36109]: pgmap v2416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:34.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:34 smithi055 ceph-mon[31863]: pgmap v2416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:35.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3526 sec 2024-03-28T06:47:36.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3527 sec 2024-03-28T06:47:36.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:36 smithi086 ceph-mon[35163]: pgmap v2417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:36.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:36 smithi159 ceph-mon[36109]: pgmap v2417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:36.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:36 smithi055 ceph-mon[31863]: pgmap v2417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:37.610 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3528 sec 2024-03-28T06:47:38.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3529 sec 2024-03-28T06:47:38.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:38 smithi086 ceph-mon[35163]: pgmap v2418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:38.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2857.831572 secs 2024-03-28T06:47:38.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:38 smithi159 ceph-mon[36109]: pgmap v2418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:38.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2857.831572 secs 2024-03-28T06:47:38.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:38 smithi055 ceph-mon[31863]: pgmap v2418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:38.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2857.831572 secs 2024-03-28T06:47:39.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3530 sec 2024-03-28T06:47:40.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3531 sec 2024-03-28T06:47:40.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:40 smithi086 ceph-mon[35163]: pgmap v2419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:40.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:40 smithi159 ceph-mon[36109]: pgmap v2419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:40.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:40 smithi055 ceph-mon[31863]: pgmap v2419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:41.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3532 sec 2024-03-28T06:47:42.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3533 sec 2024-03-28T06:47:42.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:42 smithi086 ceph-mon[35163]: pgmap v2420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:42.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:42 smithi159 ceph-mon[36109]: pgmap v2420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:42.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:42 smithi055 ceph-mon[31863]: pgmap v2420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:43.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3534 sec 2024-03-28T06:47:43.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2862.831693 secs 2024-03-28T06:47:43.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2862.831693 secs 2024-03-28T06:47:43.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2862.831693 secs 2024-03-28T06:47:44.611 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3535 sec 2024-03-28T06:47:44.826 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:44 smithi086 ceph-mon[35163]: pgmap v2421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:44.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:44 smithi159 ceph-mon[36109]: pgmap v2421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:44.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:44 smithi055 ceph-mon[31863]: pgmap v2421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:45.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3536 sec 2024-03-28T06:47:46.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3537 sec 2024-03-28T06:47:46.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:46 smithi086 ceph-mon[35163]: pgmap v2422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:46.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:46 smithi159 ceph-mon[36109]: pgmap v2422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:46.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:46 smithi055 ceph-mon[31863]: pgmap v2422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:47.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3538 sec 2024-03-28T06:47:48.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3539 sec 2024-03-28T06:47:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:48 smithi086 ceph-mon[35163]: pgmap v2423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2867.831830 secs 2024-03-28T06:47:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:48 smithi159 ceph-mon[36109]: pgmap v2423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2867.831830 secs 2024-03-28T06:47:48.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:48 smithi055 ceph-mon[31863]: pgmap v2423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:48.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2867.831830 secs 2024-03-28T06:47:49.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3540 sec 2024-03-28T06:47:50.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3541 sec 2024-03-28T06:47:50.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:50 smithi086 ceph-mon[35163]: pgmap v2424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:50.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:50 smithi159 ceph-mon[36109]: pgmap v2424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:50.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:50 smithi055 ceph-mon[31863]: pgmap v2424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:51.612 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3542 sec 2024-03-28T06:47:52.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3543 sec 2024-03-28T06:47:52.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:52 smithi086 ceph-mon[35163]: pgmap v2425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:52.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:52 smithi159 ceph-mon[36109]: pgmap v2425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:52.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:52 smithi055 ceph-mon[31863]: pgmap v2425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:47:53.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3544 sec 2024-03-28T06:47:53.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2872.831914 secs 2024-03-28T06:47:53.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2872.831914 secs 2024-03-28T06:47:53.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2872.831914 secs 2024-03-28T06:47:54.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3545 sec 2024-03-28T06:47:54.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:54 smithi086 ceph-mon[35163]: pgmap v2426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:54.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:54 smithi159 ceph-mon[36109]: pgmap v2426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:54.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:54 smithi055 ceph-mon[31863]: pgmap v2426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:47:55.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3546 sec 2024-03-28T06:47:55.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:55 smithi055 ceph-mon[31863]: pgmap v2427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:56.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:55 smithi086 ceph-mon[35163]: pgmap v2427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:56.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:55 smithi159 ceph-mon[36109]: pgmap v2427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:56.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3547 sec 2024-03-28T06:47:57.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3548 sec 2024-03-28T06:47:58.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:57 smithi086 ceph-mon[35163]: pgmap v2428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:58.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:57 smithi159 ceph-mon[36109]: pgmap v2428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:58.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:57 smithi055 ceph-mon[31863]: pgmap v2428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:47:58.613 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3549 sec 2024-03-28T06:47:59.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2877.831993 secs 2024-03-28T06:47:59.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2877.831993 secs 2024-03-28T06:47:59.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2877.831993 secs 2024-03-28T06:47:59.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3550 sec 2024-03-28T06:48:00.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:47:59 smithi086 ceph-mon[35163]: pgmap v2429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:00.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:47:59 smithi159 ceph-mon[36109]: pgmap v2429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:00.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:47:59 smithi055 ceph-mon[31863]: pgmap v2429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:00.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3551 sec 2024-03-28T06:48:01.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3552 sec 2024-03-28T06:48:02.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:01 smithi086 ceph-mon[35163]: pgmap v2430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:02.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:01 smithi159 ceph-mon[36109]: pgmap v2430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:02.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:01 smithi055 ceph-mon[31863]: pgmap v2430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:02.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3553 sec 2024-03-28T06:48:03.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3554 sec 2024-03-28T06:48:04.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:03 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 2882.832055 secs 2024-03-28T06:48:04.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:03 smithi086 ceph-mon[35163]: slow request 2882.832055 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:48:04.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:03 smithi086 ceph-mon[35163]: pgmap v2431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:04.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:03 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 2882.832055 secs 2024-03-28T06:48:04.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:03 smithi159 ceph-mon[36109]: slow request 2882.832055 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:48:04.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:03 smithi159 ceph-mon[36109]: pgmap v2431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:04.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:03 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 2882.832055 secs 2024-03-28T06:48:04.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:03 smithi055 ceph-mon[31863]: slow request 2882.832055 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T06:48:04.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:03 smithi055 ceph-mon[31863]: pgmap v2431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:04.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3555 sec 2024-03-28T06:48:05.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3556 sec 2024-03-28T06:48:06.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:05 smithi086 ceph-mon[35163]: pgmap v2432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:06.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:48:06.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:05 smithi159 ceph-mon[36109]: pgmap v2432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:06.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:48:06.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:05 smithi055 ceph-mon[31863]: pgmap v2432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:06.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:48:06.614 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3557 sec 2024-03-28T06:48:07.239 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.239 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:07.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3558 sec 2024-03-28T06:48:08.254 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:07 smithi086 ceph-mon[35163]: pgmap v2433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:08.254 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2887.832135 secs 2024-03-28T06:48:08.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:07 smithi159 ceph-mon[36109]: pgmap v2433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:08.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2887.832135 secs 2024-03-28T06:48:08.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:07 smithi055 ceph-mon[31863]: pgmap v2433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:08.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2887.832135 secs 2024-03-28T06:48:08.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3559 sec 2024-03-28T06:48:09.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:09.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3560 sec 2024-03-28T06:48:10.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:10 smithi086 ceph-mon[35163]: pgmap v2434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:10.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:10 smithi055 ceph-mon[31863]: pgmap v2434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:10.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:10 smithi159 ceph-mon[36109]: pgmap v2434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:10.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3561 sec 2024-03-28T06:48:11.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3562 sec 2024-03-28T06:48:12.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: pgmap v2435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:12.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:48:12.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:48:12.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: pgmap v2436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:48:12.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: pgmap v2437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:12.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: pgmap v2435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: pgmap v2436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: pgmap v2437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:12.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: pgmap v2435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: pgmap v2436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: pgmap v2437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:48:12.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3563 sec 2024-03-28T06:48:13.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2892.832158 secs 2024-03-28T06:48:13.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2892.832158 secs 2024-03-28T06:48:13.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2892.832158 secs 2024-03-28T06:48:13.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3564 sec 2024-03-28T06:48:14.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:14 smithi055 ceph-mon[31863]: pgmap v2438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:14.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:14 smithi086 ceph-mon[35163]: pgmap v2438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:14.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:14 smithi159 ceph-mon[36109]: pgmap v2438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:48:14.615 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3565 sec 2024-03-28T06:48:15.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3566 sec 2024-03-28T06:48:16.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:16 smithi086 ceph-mon[35163]: pgmap v2439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:16.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:16 smithi159 ceph-mon[36109]: pgmap v2439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:16.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3567 sec 2024-03-28T06:48:16.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:16 smithi055 ceph-mon[31863]: pgmap v2439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:17.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3568 sec 2024-03-28T06:48:18.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:18 smithi086 ceph-mon[35163]: pgmap v2440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:18.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2897.832214 secs 2024-03-28T06:48:18.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:18 smithi159 ceph-mon[36109]: pgmap v2440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:18.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2897.832214 secs 2024-03-28T06:48:18.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3569 sec 2024-03-28T06:48:18.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:18 smithi055 ceph-mon[31863]: pgmap v2440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:48:18.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2897.832214 secs 2024-03-28T06:48:19.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3570 sec 2024-03-28T06:48:20.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:20 smithi086 ceph-mon[35163]: pgmap v2441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:48:20.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:20 smithi159 ceph-mon[36109]: pgmap v2441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:48:20.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3571 sec 2024-03-28T06:48:20.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:20 smithi055 ceph-mon[31863]: pgmap v2441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T06:48:21.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3572 sec 2024-03-28T06:48:22.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:22 smithi086 ceph-mon[35163]: pgmap v2442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:48:22.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:22 smithi159 ceph-mon[36109]: pgmap v2442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:48:22.616 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3573 sec 2024-03-28T06:48:22.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:22 smithi055 ceph-mon[31863]: pgmap v2442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:48:23.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2902.832339 secs 2024-03-28T06:48:23.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2902.832339 secs 2024-03-28T06:48:23.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3574 sec 2024-03-28T06:48:23.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2902.832339 secs 2024-03-28T06:48:24.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:24 smithi086 ceph-mon[35163]: pgmap v2443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:24.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:24 smithi159 ceph-mon[36109]: pgmap v2443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:24.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3575 sec 2024-03-28T06:48:24.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:24 smithi055 ceph-mon[31863]: pgmap v2443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:25.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3576 sec 2024-03-28T06:48:26.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:26 smithi086 ceph-mon[35163]: pgmap v2444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:26.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:26 smithi159 ceph-mon[36109]: pgmap v2444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:26.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3577 sec 2024-03-28T06:48:26.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:26 smithi055 ceph-mon[31863]: pgmap v2444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:27.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3578 sec 2024-03-28T06:48:28.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:28 smithi086 ceph-mon[35163]: pgmap v2445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:28.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2907.832455 secs 2024-03-28T06:48:28.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:28 smithi159 ceph-mon[36109]: pgmap v2445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:28.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2907.832455 secs 2024-03-28T06:48:28.617 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3579 sec 2024-03-28T06:48:28.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:28 smithi055 ceph-mon[31863]: pgmap v2445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:28.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2907.832455 secs 2024-03-28T06:48:29.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3580 sec 2024-03-28T06:48:30.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:30 smithi086 ceph-mon[35163]: pgmap v2446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:30.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:30 smithi159 ceph-mon[36109]: pgmap v2446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:30.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3581 sec 2024-03-28T06:48:30.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:30 smithi055 ceph-mon[31863]: pgmap v2446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:31.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3582 sec 2024-03-28T06:48:32.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:32 smithi086 ceph-mon[35163]: pgmap v2447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:32.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:32 smithi159 ceph-mon[36109]: pgmap v2447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:32.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3583 sec 2024-03-28T06:48:32.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:32 smithi055 ceph-mon[31863]: pgmap v2447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:33.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2912.832566 secs 2024-03-28T06:48:33.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2912.832566 secs 2024-03-28T06:48:33.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3584 sec 2024-03-28T06:48:33.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2912.832566 secs 2024-03-28T06:48:34.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:34 smithi086 ceph-mon[35163]: pgmap v2448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:34.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:34 smithi159 ceph-mon[36109]: pgmap v2448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:34.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3585 sec 2024-03-28T06:48:34.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:34 smithi055 ceph-mon[31863]: pgmap v2448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:35.618 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3586 sec 2024-03-28T06:48:36.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3587 sec 2024-03-28T06:48:36.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:36 smithi055 ceph-mon[31863]: pgmap v2449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:36.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:36 smithi086 ceph-mon[35163]: pgmap v2449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:36.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:36 smithi159 ceph-mon[36109]: pgmap v2449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:37.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3588 sec 2024-03-28T06:48:38.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3589 sec 2024-03-28T06:48:38.625 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:38 smithi086 ceph-mon[35163]: pgmap v2450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:38.626 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2917.832682 secs 2024-03-28T06:48:38.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:38 smithi055 ceph-mon[31863]: pgmap v2450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:38.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2917.832682 secs 2024-03-28T06:48:38.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:38 smithi159 ceph-mon[36109]: pgmap v2450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:38.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2917.832682 secs 2024-03-28T06:48:39.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3590 sec 2024-03-28T06:48:40.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3591 sec 2024-03-28T06:48:40.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:40 smithi055 ceph-mon[31863]: pgmap v2451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:40.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:40 smithi086 ceph-mon[35163]: pgmap v2451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:40.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:40 smithi159 ceph-mon[36109]: pgmap v2451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:41.619 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3592 sec 2024-03-28T06:48:42.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3593 sec 2024-03-28T06:48:42.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:42 smithi055 ceph-mon[31863]: pgmap v2452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:42.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:42 smithi086 ceph-mon[35163]: pgmap v2452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:42.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:42 smithi159 ceph-mon[36109]: pgmap v2452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:43.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3594 sec 2024-03-28T06:48:43.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2922.832759 secs 2024-03-28T06:48:43.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2922.832759 secs 2024-03-28T06:48:43.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2922.832759 secs 2024-03-28T06:48:44.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3595 sec 2024-03-28T06:48:44.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:44 smithi055 ceph-mon[31863]: pgmap v2453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:44.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:44 smithi086 ceph-mon[35163]: pgmap v2453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:44.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:44 smithi159 ceph-mon[36109]: pgmap v2453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:45.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3596 sec 2024-03-28T06:48:46.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3597 sec 2024-03-28T06:48:46.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:46 smithi055 ceph-mon[31863]: pgmap v2454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:46.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:46 smithi086 ceph-mon[35163]: pgmap v2454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:46.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:46 smithi159 ceph-mon[36109]: pgmap v2454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:47.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3598 sec 2024-03-28T06:48:48.620 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3599 sec 2024-03-28T06:48:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:48 smithi086 ceph-mon[35163]: pgmap v2455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2927.832859 secs 2024-03-28T06:48:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:48 smithi159 ceph-mon[36109]: pgmap v2455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2927.832859 secs 2024-03-28T06:48:48.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:48 smithi055 ceph-mon[31863]: pgmap v2455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:48.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2927.832859 secs 2024-03-28T06:48:49.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3600 sec 2024-03-28T06:48:50.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3601 sec 2024-03-28T06:48:50.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:50 smithi086 ceph-mon[35163]: pgmap v2456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:50.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:50 smithi159 ceph-mon[36109]: pgmap v2456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:50.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:50 smithi055 ceph-mon[31863]: pgmap v2456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:51.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3602 sec 2024-03-28T06:48:52.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3603 sec 2024-03-28T06:48:52.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:52 smithi086 ceph-mon[35163]: pgmap v2457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:52.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:52 smithi159 ceph-mon[36109]: pgmap v2457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:52.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:52 smithi055 ceph-mon[31863]: pgmap v2457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:53.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3604 sec 2024-03-28T06:48:53.727 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2932.832923 secs 2024-03-28T06:48:53.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2932.832923 secs 2024-03-28T06:48:53.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2932.832923 secs 2024-03-28T06:48:54.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3605 sec 2024-03-28T06:48:54.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:54 smithi086 ceph-mon[35163]: pgmap v2458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:54.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:54 smithi159 ceph-mon[36109]: pgmap v2458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:54.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:54 smithi055 ceph-mon[31863]: pgmap v2458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:55.621 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3606 sec 2024-03-28T06:48:56.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3607 sec 2024-03-28T06:48:56.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:56 smithi086 ceph-mon[35163]: pgmap v2459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:56.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:56 smithi159 ceph-mon[36109]: pgmap v2459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:56.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:56 smithi055 ceph-mon[31863]: pgmap v2459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:48:57.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3608 sec 2024-03-28T06:48:58.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3609 sec 2024-03-28T06:48:58.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:58 smithi086 ceph-mon[35163]: pgmap v2460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:58.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:48:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2937.833007 secs 2024-03-28T06:48:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:58 smithi159 ceph-mon[36109]: pgmap v2460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:48:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2937.833007 secs 2024-03-28T06:48:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:58 smithi055 ceph-mon[31863]: pgmap v2460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:48:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:48:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2937.833007 secs 2024-03-28T06:48:59.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3610 sec 2024-03-28T06:49:00.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3611 sec 2024-03-28T06:49:00.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:00 smithi086 ceph-mon[35163]: pgmap v2461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:00.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:00 smithi159 ceph-mon[36109]: pgmap v2461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:00.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:00 smithi055 ceph-mon[31863]: pgmap v2461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:01.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3612 sec 2024-03-28T06:49:02.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3613 sec 2024-03-28T06:49:02.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:02 smithi086 ceph-mon[35163]: pgmap v2462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:02.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:02 smithi159 ceph-mon[36109]: pgmap v2462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:02.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:02 smithi055 ceph-mon[31863]: pgmap v2462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:03.622 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3614 sec 2024-03-28T06:49:03.780 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2942.833089 secs 2024-03-28T06:49:03.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2942.833089 secs 2024-03-28T06:49:03.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2942.833089 secs 2024-03-28T06:49:04.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3615 sec 2024-03-28T06:49:04.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:04 smithi086 ceph-mon[35163]: pgmap v2463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:04.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:04 smithi159 ceph-mon[36109]: pgmap v2463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:04.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:04 smithi055 ceph-mon[31863]: pgmap v2463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:05.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3616 sec 2024-03-28T06:49:06.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3617 sec 2024-03-28T06:49:06.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:06 smithi086 ceph-mon[35163]: pgmap v2464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:06.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:06 smithi159 ceph-mon[36109]: pgmap v2464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:06.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:06 smithi055 ceph-mon[31863]: pgmap v2464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:07.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3618 sec 2024-03-28T06:49:08.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3619 sec 2024-03-28T06:49:08.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:08 smithi086 ceph-mon[35163]: pgmap v2465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:08.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2947.833160 secs 2024-03-28T06:49:08.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:08 smithi159 ceph-mon[36109]: pgmap v2465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:08.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2947.833160 secs 2024-03-28T06:49:08.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:08 smithi055 ceph-mon[31863]: pgmap v2465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:08.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2947.833160 secs 2024-03-28T06:49:09.623 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3620 sec 2024-03-28T06:49:10.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3621 sec 2024-03-28T06:49:10.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:10 smithi086 ceph-mon[35163]: pgmap v2466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:10.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:10 smithi159 ceph-mon[36109]: pgmap v2466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:10.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:10 smithi055 ceph-mon[31863]: pgmap v2466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:11.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3622 sec 2024-03-28T06:49:12.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3623 sec 2024-03-28T06:49:12.826 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:12 smithi086 ceph-mon[35163]: pgmap v2467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:12.826 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:49:12.827 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:12 smithi159 ceph-mon[36109]: pgmap v2467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:12.827 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:49:12.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:12 smithi055 ceph-mon[31863]: pgmap v2467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:12.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:49:13.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3624 sec 2024-03-28T06:49:13.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2952.833234 secs 2024-03-28T06:49:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:49:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:49:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:49:13.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2952.833234 secs 2024-03-28T06:49:13.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:49:13.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:49:13.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:49:13.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2952.833234 secs 2024-03-28T06:49:13.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:49:13.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:49:13.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:49:14.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3625 sec 2024-03-28T06:49:14.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:14 smithi086 ceph-mon[35163]: pgmap v2468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:14.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:14 smithi086 ceph-mon[35163]: pgmap v2469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:14.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:14 smithi159 ceph-mon[36109]: pgmap v2468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:14.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:14 smithi159 ceph-mon[36109]: pgmap v2469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:14.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:14 smithi055 ceph-mon[31863]: pgmap v2468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:14.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:14 smithi055 ceph-mon[31863]: pgmap v2469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:15.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3626 sec 2024-03-28T06:49:16.624 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3627 sec 2024-03-28T06:49:16.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:16 smithi086 ceph-mon[35163]: pgmap v2470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:16.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:16 smithi159 ceph-mon[36109]: pgmap v2470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:16.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:16 smithi055 ceph-mon[31863]: pgmap v2470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:17.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3628 sec 2024-03-28T06:49:18.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3629 sec 2024-03-28T06:49:18.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:18 smithi086 ceph-mon[35163]: pgmap v2471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:18.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2957.833308 secs 2024-03-28T06:49:18.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:18 smithi159 ceph-mon[36109]: pgmap v2471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:18.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2957.833308 secs 2024-03-28T06:49:18.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:18 smithi055 ceph-mon[31863]: pgmap v2471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:18.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2957.833308 secs 2024-03-28T06:49:19.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3630 sec 2024-03-28T06:49:20.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3631 sec 2024-03-28T06:49:20.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:20 smithi086 ceph-mon[35163]: pgmap v2472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:20.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:20 smithi159 ceph-mon[36109]: pgmap v2472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:20.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:20 smithi055 ceph-mon[31863]: pgmap v2472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:21.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3632 sec 2024-03-28T06:49:22.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3633 sec 2024-03-28T06:49:22.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:22 smithi086 ceph-mon[35163]: pgmap v2473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:22.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:22 smithi159 ceph-mon[36109]: pgmap v2473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:22.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:22 smithi055 ceph-mon[31863]: pgmap v2473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:23.625 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3634 sec 2024-03-28T06:49:23.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2962.833380 secs 2024-03-28T06:49:23.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2962.833380 secs 2024-03-28T06:49:23.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2962.833380 secs 2024-03-28T06:49:24.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3636 sec 2024-03-28T06:49:24.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:24 smithi086 ceph-mon[35163]: pgmap v2474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:49:24.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:24 smithi159 ceph-mon[36109]: pgmap v2474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:49:24.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:24 smithi055 ceph-mon[31863]: pgmap v2474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:49:25.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3637 sec 2024-03-28T06:49:26.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3638 sec 2024-03-28T06:49:26.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:26 smithi086 ceph-mon[35163]: pgmap v2475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:26 smithi159 ceph-mon[36109]: pgmap v2475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:26.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:26 smithi055 ceph-mon[31863]: pgmap v2475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:27.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3639 sec 2024-03-28T06:49:28.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3640 sec 2024-03-28T06:49:28.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:28 smithi086 ceph-mon[35163]: pgmap v2476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:28.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2967.833460 secs 2024-03-28T06:49:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:28 smithi159 ceph-mon[36109]: pgmap v2476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2967.833460 secs 2024-03-28T06:49:28.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:28 smithi055 ceph-mon[31863]: pgmap v2476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:49:28.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2967.833460 secs 2024-03-28T06:49:29.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3641 sec 2024-03-28T06:49:29.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:29 smithi055 ceph-mon[31863]: pgmap v2477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:30.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:29 smithi086 ceph-mon[35163]: pgmap v2477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:30.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:29 smithi159 ceph-mon[36109]: pgmap v2477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:30.626 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3642 sec 2024-03-28T06:49:31.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3643 sec 2024-03-28T06:49:32.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:31 smithi086 ceph-mon[35163]: pgmap v2478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:32.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:31 smithi159 ceph-mon[36109]: pgmap v2478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:32.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:31 smithi055 ceph-mon[31863]: pgmap v2478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:32.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3644 sec 2024-03-28T06:49:33.280 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2972.833544 secs 2024-03-28T06:49:33.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2972.833544 secs 2024-03-28T06:49:33.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2972.833544 secs 2024-03-28T06:49:33.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3645 sec 2024-03-28T06:49:34.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:33 smithi086 ceph-mon[35163]: pgmap v2479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:34.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:33 smithi159 ceph-mon[36109]: pgmap v2479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:34.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:33 smithi055 ceph-mon[31863]: pgmap v2479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:34.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3646 sec 2024-03-28T06:49:35.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3647 sec 2024-03-28T06:49:36.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:35 smithi086 ceph-mon[35163]: pgmap v2480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:36.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:35 smithi159 ceph-mon[36109]: pgmap v2480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:36.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:35 smithi055 ceph-mon[31863]: pgmap v2480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:36.627 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3648 sec 2024-03-28T06:49:37.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3649 sec 2024-03-28T06:49:38.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:37 smithi086 ceph-mon[35163]: pgmap v2481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:38.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2977.833661 secs 2024-03-28T06:49:38.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:37 smithi159 ceph-mon[36109]: pgmap v2481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:38.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2977.833661 secs 2024-03-28T06:49:38.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:37 smithi055 ceph-mon[31863]: pgmap v2481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:38.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2977.833661 secs 2024-03-28T06:49:38.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3650 sec 2024-03-28T06:49:39.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3651 sec 2024-03-28T06:49:40.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:39 smithi086 ceph-mon[35163]: pgmap v2482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:40.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:39 smithi159 ceph-mon[36109]: pgmap v2482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:40.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:39 smithi055 ceph-mon[31863]: pgmap v2482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:40.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3652 sec 2024-03-28T06:49:41.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3653 sec 2024-03-28T06:49:42.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:42 smithi086 ceph-mon[35163]: pgmap v2483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:42.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:42 smithi159 ceph-mon[36109]: pgmap v2483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:42.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:42 smithi055 ceph-mon[31863]: pgmap v2483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:42.628 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3654 sec 2024-03-28T06:49:43.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2982.833724 secs 2024-03-28T06:49:43.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2982.833724 secs 2024-03-28T06:49:43.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2982.833724 secs 2024-03-28T06:49:43.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3655 sec 2024-03-28T06:49:44.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:44 smithi086 ceph-mon[35163]: pgmap v2484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:44.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:44 smithi159 ceph-mon[36109]: pgmap v2484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:44.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:44 smithi055 ceph-mon[31863]: pgmap v2484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:44.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3656 sec 2024-03-28T06:49:45.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3657 sec 2024-03-28T06:49:46.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:46 smithi086 ceph-mon[35163]: pgmap v2485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:46.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:46 smithi159 ceph-mon[36109]: pgmap v2485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:46.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:46 smithi055 ceph-mon[31863]: pgmap v2485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:49:46.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3658 sec 2024-03-28T06:49:47.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3659 sec 2024-03-28T06:49:48.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:48 smithi086 ceph-mon[35163]: pgmap v2486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:48.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2987.833844 secs 2024-03-28T06:49:48.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:48 smithi159 ceph-mon[36109]: pgmap v2486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:48.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2987.833844 secs 2024-03-28T06:49:48.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:48 smithi055 ceph-mon[31863]: pgmap v2486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:48.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2987.833844 secs 2024-03-28T06:49:48.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3660 sec 2024-03-28T06:49:49.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3661 sec 2024-03-28T06:49:50.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:50 smithi086 ceph-mon[35163]: pgmap v2487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:50.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:50 smithi159 ceph-mon[36109]: pgmap v2487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:50.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:50 smithi055 ceph-mon[31863]: pgmap v2487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:49:50.629 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3662 sec 2024-03-28T06:49:51.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3663 sec 2024-03-28T06:49:52.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:52 smithi086 ceph-mon[35163]: pgmap v2488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:52.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:52 smithi159 ceph-mon[36109]: pgmap v2488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:52.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:52 smithi055 ceph-mon[31863]: pgmap v2488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:52.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3664 sec 2024-03-28T06:49:53.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2992.833868 secs 2024-03-28T06:49:53.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2992.833868 secs 2024-03-28T06:49:53.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2992.833868 secs 2024-03-28T06:49:53.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3665 sec 2024-03-28T06:49:54.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:54 smithi086 ceph-mon[35163]: pgmap v2489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:54.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:54 smithi159 ceph-mon[36109]: pgmap v2489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:54.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:54 smithi055 ceph-mon[31863]: pgmap v2489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:54.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3666 sec 2024-03-28T06:49:55.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3667 sec 2024-03-28T06:49:56.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:56 smithi159 ceph-mon[36109]: pgmap v2490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:56.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:56 smithi055 ceph-mon[31863]: pgmap v2490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:56.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:56 smithi086 ceph-mon[35163]: pgmap v2490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:49:56.630 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3668 sec 2024-03-28T06:49:57.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3669 sec 2024-03-28T06:49:58.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:58 smithi055 ceph-mon[31863]: pgmap v2491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:58.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:49:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 2997.833938 secs 2024-03-28T06:49:58.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:58 smithi086 ceph-mon[35163]: pgmap v2491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:58.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:49:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 2997.833938 secs 2024-03-28T06:49:58.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:58 smithi159 ceph-mon[36109]: pgmap v2491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:49:58.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:49:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 2997.833938 secs 2024-03-28T06:49:58.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3670 sec 2024-03-28T06:49:59.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3671 sec 2024-03-28T06:50:00.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:00 smithi055 ceph-mon[31863]: pgmap v2492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:00.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:50:00.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:00 smithi086 ceph-mon[35163]: pgmap v2492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:00.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:50:00.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:00 smithi159 ceph-mon[36109]: pgmap v2492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:00.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T06:50:00.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3672 sec 2024-03-28T06:50:01.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3673 sec 2024-03-28T06:50:02.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:02 smithi055 ceph-mon[31863]: pgmap v2493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:02.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:02 smithi086 ceph-mon[35163]: pgmap v2493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:02.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:02 smithi159 ceph-mon[36109]: pgmap v2493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:02.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3674 sec 2024-03-28T06:50:03.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3002.834025 secs 2024-03-28T06:50:03.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3002.834025 secs 2024-03-28T06:50:03.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3002.834025 secs 2024-03-28T06:50:03.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3675 sec 2024-03-28T06:50:04.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:04 smithi055 ceph-mon[31863]: pgmap v2494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:04.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:04 smithi086 ceph-mon[35163]: pgmap v2494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:04.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:04 smithi159 ceph-mon[36109]: pgmap v2494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:04.631 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3676 sec 2024-03-28T06:50:05.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3677 sec 2024-03-28T06:50:06.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:06 smithi055 ceph-mon[31863]: pgmap v2495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:06.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:06 smithi086 ceph-mon[35163]: pgmap v2495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:06.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:06 smithi159 ceph-mon[36109]: pgmap v2495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:06.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3678 sec 2024-03-28T06:50:07.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3679 sec 2024-03-28T06:50:08.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:08 smithi055 ceph-mon[31863]: pgmap v2496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:08.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3007.834086 secs 2024-03-28T06:50:08.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:08 smithi086 ceph-mon[35163]: pgmap v2496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:08.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3007.834086 secs 2024-03-28T06:50:08.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:08 smithi159 ceph-mon[36109]: pgmap v2496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:08.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3007.834086 secs 2024-03-28T06:50:08.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3680 sec 2024-03-28T06:50:09.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3681 sec 2024-03-28T06:50:10.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:10 smithi086 ceph-mon[35163]: pgmap v2497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:10.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:10 smithi159 ceph-mon[36109]: pgmap v2497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:10.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:10 smithi055 ceph-mon[31863]: pgmap v2497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:10.632 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3682 sec 2024-03-28T06:50:11.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3683 sec 2024-03-28T06:50:12.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:12 smithi086 ceph-mon[35163]: pgmap v2498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:12.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:12 smithi159 ceph-mon[36109]: pgmap v2498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:12.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:12 smithi055 ceph-mon[31863]: pgmap v2498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:12.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3684 sec 2024-03-28T06:50:13.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3012.834150 secs 2024-03-28T06:50:13.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3012.834150 secs 2024-03-28T06:50:13.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3012.834150 secs 2024-03-28T06:50:13.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3685 sec 2024-03-28T06:50:14.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:14 smithi086 ceph-mon[35163]: pgmap v2499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:14.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:50:14.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:14 smithi159 ceph-mon[36109]: pgmap v2499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:14.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:50:14.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:14 smithi055 ceph-mon[31863]: pgmap v2499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:14.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:50:14.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3686 sec 2024-03-28T06:50:15.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:50:15.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:50:15.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:50:15.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:50:15.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:50:15.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:50:15.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:50:15.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:50:15.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:50:15.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3687 sec 2024-03-28T06:50:16.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:16 smithi086 ceph-mon[35163]: pgmap v2500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:16.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:16 smithi086 ceph-mon[35163]: pgmap v2501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:16.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:16 smithi159 ceph-mon[36109]: pgmap v2500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:16.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:16 smithi159 ceph-mon[36109]: pgmap v2501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:16.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:16 smithi055 ceph-mon[31863]: pgmap v2500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:16.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:16 smithi055 ceph-mon[31863]: pgmap v2501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:16.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3688 sec 2024-03-28T06:50:17.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3689 sec 2024-03-28T06:50:18.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:18 smithi086 ceph-mon[35163]: pgmap v2502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:18.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3017.834236 secs 2024-03-28T06:50:18.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:18 smithi159 ceph-mon[36109]: pgmap v2502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:18.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3017.834236 secs 2024-03-28T06:50:18.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:18 smithi055 ceph-mon[31863]: pgmap v2502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:18.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3017.834236 secs 2024-03-28T06:50:18.633 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3690 sec 2024-03-28T06:50:19.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3691 sec 2024-03-28T06:50:20.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:20 smithi086 ceph-mon[35163]: pgmap v2503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:20.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:20 smithi159 ceph-mon[36109]: pgmap v2503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:20.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:20 smithi055 ceph-mon[31863]: pgmap v2503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:50:20.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3692 sec 2024-03-28T06:50:21.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3693 sec 2024-03-28T06:50:22.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:22 smithi086 ceph-mon[35163]: pgmap v2504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:22.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:22 smithi159 ceph-mon[36109]: pgmap v2504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:22.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:22 smithi055 ceph-mon[31863]: pgmap v2504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:22.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3694 sec 2024-03-28T06:50:23.478 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3022.834357 secs 2024-03-28T06:50:23.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3022.834357 secs 2024-03-28T06:50:23.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3022.834357 secs 2024-03-28T06:50:23.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3695 sec 2024-03-28T06:50:24.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:24 smithi086 ceph-mon[35163]: pgmap v2505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:50:24.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:24 smithi159 ceph-mon[36109]: pgmap v2505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:50:24.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:24 smithi055 ceph-mon[31863]: pgmap v2505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:50:24.634 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3696 sec 2024-03-28T06:50:25.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3697 sec 2024-03-28T06:50:26.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:26 smithi086 ceph-mon[35163]: pgmap v2506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:26.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:26 smithi159 ceph-mon[36109]: pgmap v2506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:26.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:26 smithi055 ceph-mon[31863]: pgmap v2506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:50:26.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3698 sec 2024-03-28T06:50:27.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3699 sec 2024-03-28T06:50:28.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:28 smithi086 ceph-mon[35163]: pgmap v2507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:28.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3027.834417 secs 2024-03-28T06:50:28.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:28 smithi159 ceph-mon[36109]: pgmap v2507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:28.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3027.834417 secs 2024-03-28T06:50:28.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:28 smithi055 ceph-mon[31863]: pgmap v2507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:28.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3027.834417 secs 2024-03-28T06:50:28.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3700 sec 2024-03-28T06:50:29.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3701 sec 2024-03-28T06:50:30.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:30 smithi086 ceph-mon[35163]: pgmap v2508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:30.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:30 smithi159 ceph-mon[36109]: pgmap v2508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:30.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:30 smithi055 ceph-mon[31863]: pgmap v2508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:30.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3702 sec 2024-03-28T06:50:31.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3703 sec 2024-03-28T06:50:32.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:32 smithi086 ceph-mon[35163]: pgmap v2509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:32.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:32 smithi159 ceph-mon[36109]: pgmap v2509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:32.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:32 smithi055 ceph-mon[31863]: pgmap v2509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:32.635 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3704 sec 2024-03-28T06:50:33.530 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3032.834488 secs 2024-03-28T06:50:33.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3032.834488 secs 2024-03-28T06:50:33.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3032.834488 secs 2024-03-28T06:50:33.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3705 sec 2024-03-28T06:50:34.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:34 smithi086 ceph-mon[35163]: pgmap v2510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:34.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:34 smithi159 ceph-mon[36109]: pgmap v2510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:34.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:34 smithi055 ceph-mon[31863]: pgmap v2510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:34.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3706 sec 2024-03-28T06:50:35.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3707 sec 2024-03-28T06:50:36.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:36 smithi086 ceph-mon[35163]: pgmap v2511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:36.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:36 smithi159 ceph-mon[36109]: pgmap v2511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:36.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:36 smithi055 ceph-mon[31863]: pgmap v2511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:36.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3708 sec 2024-03-28T06:50:37.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3709 sec 2024-03-28T06:50:38.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:38 smithi086 ceph-mon[35163]: pgmap v2512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:38.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3037.834606 secs 2024-03-28T06:50:38.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:38 smithi159 ceph-mon[36109]: pgmap v2512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:38.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3037.834606 secs 2024-03-28T06:50:38.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:38 smithi055 ceph-mon[31863]: pgmap v2512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:38.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3037.834606 secs 2024-03-28T06:50:38.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3710 sec 2024-03-28T06:50:39.636 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3711 sec 2024-03-28T06:50:40.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:40 smithi086 ceph-mon[35163]: pgmap v2513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:40.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:40 smithi159 ceph-mon[36109]: pgmap v2513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:40.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:40 smithi055 ceph-mon[31863]: pgmap v2513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:40.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3712 sec 2024-03-28T06:50:41.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3713 sec 2024-03-28T06:50:42.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:42 smithi086 ceph-mon[35163]: pgmap v2514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:42.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:42 smithi159 ceph-mon[36109]: pgmap v2514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:42.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:42 smithi055 ceph-mon[31863]: pgmap v2514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:42.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3714 sec 2024-03-28T06:50:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3042.834702 secs 2024-03-28T06:50:43.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3042.834702 secs 2024-03-28T06:50:43.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3042.834702 secs 2024-03-28T06:50:43.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3715 sec 2024-03-28T06:50:44.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:44 smithi086 ceph-mon[35163]: pgmap v2515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:44.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:44 smithi159 ceph-mon[36109]: pgmap v2515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:44.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:44 smithi055 ceph-mon[31863]: pgmap v2515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:44.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3716 sec 2024-03-28T06:50:45.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3717 sec 2024-03-28T06:50:46.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:46 smithi086 ceph-mon[35163]: pgmap v2516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:46.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:46 smithi159 ceph-mon[36109]: pgmap v2516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:46.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:46 smithi055 ceph-mon[31863]: pgmap v2516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:46.637 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3718 sec 2024-03-28T06:50:47.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3719 sec 2024-03-28T06:50:48.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:48 smithi055 ceph-mon[31863]: pgmap v2517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:48.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3047.834769 secs 2024-03-28T06:50:48.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3720 sec 2024-03-28T06:50:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:48 smithi086 ceph-mon[35163]: pgmap v2517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:48.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3047.834769 secs 2024-03-28T06:50:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:48 smithi159 ceph-mon[36109]: pgmap v2517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:48.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3047.834769 secs 2024-03-28T06:50:49.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3721 sec 2024-03-28T06:50:50.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:50 smithi055 ceph-mon[31863]: pgmap v2518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:50.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3722 sec 2024-03-28T06:50:50.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:50 smithi086 ceph-mon[35163]: pgmap v2518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:50.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:50 smithi159 ceph-mon[36109]: pgmap v2518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:51.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3723 sec 2024-03-28T06:50:52.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:52 smithi055 ceph-mon[31863]: pgmap v2519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:52.638 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3724 sec 2024-03-28T06:50:52.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:52 smithi086 ceph-mon[35163]: pgmap v2519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:52.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:52 smithi159 ceph-mon[36109]: pgmap v2519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:50:53.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3052.834817 secs 2024-03-28T06:50:53.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3725 sec 2024-03-28T06:50:53.727 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3052.834817 secs 2024-03-28T06:50:53.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3052.834817 secs 2024-03-28T06:50:54.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:54 smithi055 ceph-mon[31863]: pgmap v2520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:54.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3726 sec 2024-03-28T06:50:54.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:54 smithi086 ceph-mon[35163]: pgmap v2520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:54.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:54 smithi159 ceph-mon[36109]: pgmap v2520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:50:55.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3727 sec 2024-03-28T06:50:56.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:56 smithi055 ceph-mon[31863]: pgmap v2521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:56.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3728 sec 2024-03-28T06:50:56.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:56 smithi086 ceph-mon[35163]: pgmap v2521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:56.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:56 smithi159 ceph-mon[36109]: pgmap v2521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:57.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3729 sec 2024-03-28T06:50:58.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3730 sec 2024-03-28T06:50:58.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:58 smithi086 ceph-mon[35163]: pgmap v2522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:58.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:50:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3057.834890 secs 2024-03-28T06:50:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:58 smithi159 ceph-mon[36109]: pgmap v2522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:50:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3057.834890 secs 2024-03-28T06:50:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:58 smithi055 ceph-mon[31863]: pgmap v2522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:50:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:50:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3057.834890 secs 2024-03-28T06:50:59.639 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3731 sec 2024-03-28T06:51:00.640 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3732 sec 2024-03-28T06:51:00.825 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:00 smithi086 ceph-mon[35163]: pgmap v2523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:00.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:00 smithi159 ceph-mon[36109]: pgmap v2523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:00.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:00 smithi055 ceph-mon[31863]: pgmap v2523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:01.640 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3733 sec 2024-03-28T06:51:02.640 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3734 sec 2024-03-28T06:51:02.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:02 smithi086 ceph-mon[35163]: pgmap v2524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:02.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:02 smithi159 ceph-mon[36109]: pgmap v2524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:02.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:02 smithi055 ceph-mon[31863]: pgmap v2524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:03.640 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3735 sec 2024-03-28T06:51:03.780 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3062.834963 secs 2024-03-28T06:51:03.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3062.834963 secs 2024-03-28T06:51:03.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3062.834963 secs 2024-03-28T06:51:04.640 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3736 sec 2024-03-28T06:51:04.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:04 smithi086 ceph-mon[35163]: pgmap v2525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:04.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:04 smithi159 ceph-mon[36109]: pgmap v2525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:04.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:04 smithi055 ceph-mon[31863]: pgmap v2525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:05.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3737 sec 2024-03-28T06:51:06.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3738 sec 2024-03-28T06:51:06.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:06 smithi086 ceph-mon[35163]: pgmap v2526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:06.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:06 smithi159 ceph-mon[36109]: pgmap v2526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:06.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:06 smithi055 ceph-mon[31863]: pgmap v2526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:07.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3739 sec 2024-03-28T06:51:08.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3740 sec 2024-03-28T06:51:08.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:08 smithi086 ceph-mon[35163]: pgmap v2527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:08.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3067.835029 secs 2024-03-28T06:51:08.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:08 smithi159 ceph-mon[36109]: pgmap v2527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:08.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3067.835029 secs 2024-03-28T06:51:08.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:08 smithi055 ceph-mon[31863]: pgmap v2527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:08.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3067.835029 secs 2024-03-28T06:51:09.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3741 sec 2024-03-28T06:51:10.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3742 sec 2024-03-28T06:51:10.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:10 smithi086 ceph-mon[35163]: pgmap v2528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:10.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:10 smithi159 ceph-mon[36109]: pgmap v2528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:10.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:10 smithi055 ceph-mon[31863]: pgmap v2528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:11.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3743 sec 2024-03-28T06:51:12.641 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3744 sec 2024-03-28T06:51:12.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:12 smithi086 ceph-mon[35163]: pgmap v2529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:12.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:12 smithi159 ceph-mon[36109]: pgmap v2529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:12.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:12 smithi055 ceph-mon[31863]: pgmap v2529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:13.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3745 sec 2024-03-28T06:51:13.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3072.835107 secs 2024-03-28T06:51:13.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3072.835107 secs 2024-03-28T06:51:13.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3072.835107 secs 2024-03-28T06:51:14.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3746 sec 2024-03-28T06:51:14.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:14 smithi086 ceph-mon[35163]: pgmap v2530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:14.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:14 smithi159 ceph-mon[36109]: pgmap v2530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:14.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:14 smithi055 ceph-mon[31863]: pgmap v2530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:15.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3747 sec 2024-03-28T06:51:15.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:51:15.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:51:15.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:51:16.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3748 sec 2024-03-28T06:51:16.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:16 smithi086 ceph-mon[35163]: pgmap v2531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:16.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:51:16.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:51:16.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:51:16.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:16 smithi159 ceph-mon[36109]: pgmap v2531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:16.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:51:16.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:51:16.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:51:16.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:16 smithi055 ceph-mon[31863]: pgmap v2531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:16.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:51:16.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:51:16.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:51:17.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3749 sec 2024-03-28T06:51:17.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:17 smithi086 ceph-mon[35163]: pgmap v2532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:17.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:17 smithi086 ceph-mon[35163]: pgmap v2533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:17.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:17 smithi159 ceph-mon[36109]: pgmap v2532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:17.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:17 smithi159 ceph-mon[36109]: pgmap v2533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:17.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:17 smithi055 ceph-mon[31863]: pgmap v2532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:17.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:17 smithi055 ceph-mon[31863]: pgmap v2533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:18.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3750 sec 2024-03-28T06:51:18.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3077.835167 secs 2024-03-28T06:51:18.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3077.835167 secs 2024-03-28T06:51:18.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3077.835167 secs 2024-03-28T06:51:19.642 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3751 sec 2024-03-28T06:51:19.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:19 smithi086 ceph-mon[35163]: pgmap v2534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:19.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:19 smithi159 ceph-mon[36109]: pgmap v2534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:19.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:19 smithi055 ceph-mon[31863]: pgmap v2534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:20.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3752 sec 2024-03-28T06:51:21.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3753 sec 2024-03-28T06:51:21.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:21 smithi086 ceph-mon[35163]: pgmap v2535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:21.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:21 smithi159 ceph-mon[36109]: pgmap v2535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:21.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:21 smithi055 ceph-mon[31863]: pgmap v2535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:22.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3754 sec 2024-03-28T06:51:23.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3755 sec 2024-03-28T06:51:23.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3082.835248 secs 2024-03-28T06:51:23.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:23 smithi086 ceph-mon[35163]: pgmap v2536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:23.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3082.835248 secs 2024-03-28T06:51:23.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:23 smithi159 ceph-mon[36109]: pgmap v2536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3082.835248 secs 2024-03-28T06:51:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:23 smithi055 ceph-mon[31863]: pgmap v2536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:24.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3756 sec 2024-03-28T06:51:25.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3757 sec 2024-03-28T06:51:25.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:25 smithi086 ceph-mon[35163]: pgmap v2537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:25.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:25 smithi159 ceph-mon[36109]: pgmap v2537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:25.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:25 smithi055 ceph-mon[31863]: pgmap v2537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:51:26.643 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3758 sec 2024-03-28T06:51:27.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3759 sec 2024-03-28T06:51:27.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:27 smithi086 ceph-mon[35163]: pgmap v2538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:51:27.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:27 smithi159 ceph-mon[36109]: pgmap v2538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:51:27.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:27 smithi055 ceph-mon[31863]: pgmap v2538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:51:28.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3760 sec 2024-03-28T06:51:28.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3087.835324 secs 2024-03-28T06:51:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3087.835324 secs 2024-03-28T06:51:28.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3087.835324 secs 2024-03-28T06:51:29.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3761 sec 2024-03-28T06:51:29.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:29 smithi086 ceph-mon[35163]: pgmap v2539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:29.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:29 smithi159 ceph-mon[36109]: pgmap v2539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:29.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:29 smithi055 ceph-mon[31863]: pgmap v2539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:30.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3762 sec 2024-03-28T06:51:31.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3763 sec 2024-03-28T06:51:31.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:31 smithi086 ceph-mon[35163]: pgmap v2540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:31.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:31 smithi159 ceph-mon[36109]: pgmap v2540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:31.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:31 smithi055 ceph-mon[31863]: pgmap v2540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:32.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3764 sec 2024-03-28T06:51:33.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3765 sec 2024-03-28T06:51:33.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3092.835396 secs 2024-03-28T06:51:33.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:33 smithi086 ceph-mon[35163]: pgmap v2541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3092.835396 secs 2024-03-28T06:51:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:33 smithi159 ceph-mon[36109]: pgmap v2541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:33.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3092.835396 secs 2024-03-28T06:51:33.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:33 smithi055 ceph-mon[31863]: pgmap v2541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:34.644 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3766 sec 2024-03-28T06:51:35.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3767 sec 2024-03-28T06:51:35.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:35 smithi055 ceph-mon[31863]: pgmap v2542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:36.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:35 smithi086 ceph-mon[35163]: pgmap v2542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:36.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:35 smithi159 ceph-mon[36109]: pgmap v2542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:36.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3768 sec 2024-03-28T06:51:37.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3769 sec 2024-03-28T06:51:37.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:37 smithi055 ceph-mon[31863]: pgmap v2543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:38.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:37 smithi086 ceph-mon[35163]: pgmap v2543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:38.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:37 smithi159 ceph-mon[36109]: pgmap v2543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:38.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3770 sec 2024-03-28T06:51:38.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3097.835467 secs 2024-03-28T06:51:38.975 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3097.835467 secs 2024-03-28T06:51:39.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3097.835467 secs 2024-03-28T06:51:39.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3771 sec 2024-03-28T06:51:39.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:39 smithi055 ceph-mon[31863]: pgmap v2544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:40.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:39 smithi086 ceph-mon[35163]: pgmap v2544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:40.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:39 smithi159 ceph-mon[36109]: pgmap v2544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:40.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3772 sec 2024-03-28T06:51:40.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:40 smithi055 ceph-mon[31863]: pgmap v2545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:41.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:40 smithi086 ceph-mon[35163]: pgmap v2545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:41.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:40 smithi159 ceph-mon[36109]: pgmap v2545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:41.645 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3773 sec 2024-03-28T06:51:42.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3774 sec 2024-03-28T06:51:43.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3775 sec 2024-03-28T06:51:43.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3102.835528 secs 2024-03-28T06:51:43.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:43 smithi086 ceph-mon[35163]: pgmap v2546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3102.835528 secs 2024-03-28T06:51:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:43 smithi159 ceph-mon[36109]: pgmap v2546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:43.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3102.835528 secs 2024-03-28T06:51:43.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:43 smithi055 ceph-mon[31863]: pgmap v2546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:44.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3776 sec 2024-03-28T06:51:45.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3777 sec 2024-03-28T06:51:45.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:45 smithi086 ceph-mon[35163]: pgmap v2547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:45.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:45 smithi159 ceph-mon[36109]: pgmap v2547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:45.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:45 smithi055 ceph-mon[31863]: pgmap v2547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:46.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3778 sec 2024-03-28T06:51:47.646 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3779 sec 2024-03-28T06:51:47.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:47 smithi086 ceph-mon[35163]: pgmap v2548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:47.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:47 smithi159 ceph-mon[36109]: pgmap v2548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:47.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:47 smithi055 ceph-mon[31863]: pgmap v2548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:48.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3780 sec 2024-03-28T06:51:48.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3107.835600 secs 2024-03-28T06:51:48.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3107.835600 secs 2024-03-28T06:51:48.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3107.835600 secs 2024-03-28T06:51:49.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3781 sec 2024-03-28T06:51:49.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:49 smithi086 ceph-mon[35163]: pgmap v2549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:49.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:49 smithi159 ceph-mon[36109]: pgmap v2549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:49.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:49 smithi055 ceph-mon[31863]: pgmap v2549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:50.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3782 sec 2024-03-28T06:51:51.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3783 sec 2024-03-28T06:51:51.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:51 smithi086 ceph-mon[35163]: pgmap v2550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:51.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:51 smithi159 ceph-mon[36109]: pgmap v2550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:51.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:51 smithi055 ceph-mon[31863]: pgmap v2550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:51:52.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3784 sec 2024-03-28T06:51:53.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3785 sec 2024-03-28T06:51:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3112.835671 secs 2024-03-28T06:51:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:53 smithi086 ceph-mon[35163]: pgmap v2551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3112.835671 secs 2024-03-28T06:51:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:53 smithi159 ceph-mon[36109]: pgmap v2551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3112.835671 secs 2024-03-28T06:51:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:53 smithi055 ceph-mon[31863]: pgmap v2551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:51:54.647 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3786 sec 2024-03-28T06:51:55.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3787 sec 2024-03-28T06:51:55.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:55 smithi086 ceph-mon[35163]: pgmap v2552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:55.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:55 smithi159 ceph-mon[36109]: pgmap v2552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:55.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:55 smithi055 ceph-mon[31863]: pgmap v2552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:56.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3788 sec 2024-03-28T06:51:57.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3789 sec 2024-03-28T06:51:57.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:57 smithi055 ceph-mon[31863]: pgmap v2553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:58.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:57 smithi086 ceph-mon[35163]: pgmap v2553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:58.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:57 smithi159 ceph-mon[36109]: pgmap v2553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:51:58.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3790 sec 2024-03-28T06:51:58.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3117.835732 secs 2024-03-28T06:51:59.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3117.835732 secs 2024-03-28T06:51:59.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3117.835732 secs 2024-03-28T06:51:59.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3791 sec 2024-03-28T06:51:59.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:51:59 smithi055 ceph-mon[31863]: pgmap v2554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:00.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:51:59 smithi086 ceph-mon[35163]: pgmap v2554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:00.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:51:59 smithi159 ceph-mon[36109]: pgmap v2554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:00.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3792 sec 2024-03-28T06:52:01.648 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3793 sec 2024-03-28T06:52:01.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:01 smithi055 ceph-mon[31863]: pgmap v2555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:02.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:01 smithi086 ceph-mon[35163]: pgmap v2555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:02.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:01 smithi159 ceph-mon[36109]: pgmap v2555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:02.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3794 sec 2024-03-28T06:52:02.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:02 smithi055 ceph-mon[31863]: pgmap v2556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:03.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:02 smithi086 ceph-mon[35163]: pgmap v2556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:03.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:02 smithi159 ceph-mon[36109]: pgmap v2556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:03.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3795 sec 2024-03-28T06:52:03.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3122.835754 secs 2024-03-28T06:52:04.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3122.835754 secs 2024-03-28T06:52:04.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3122.835754 secs 2024-03-28T06:52:04.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3796 sec 2024-03-28T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:04 smithi055 ceph-mon[31863]: pgmap v2557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:05.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:04 smithi086 ceph-mon[35163]: pgmap v2557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:05.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:04 smithi159 ceph-mon[36109]: pgmap v2557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:05.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3797 sec 2024-03-28T06:52:06.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3798 sec 2024-03-28T06:52:07.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3799 sec 2024-03-28T06:52:07.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:07 smithi086 ceph-mon[35163]: pgmap v2558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:07.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:07 smithi159 ceph-mon[36109]: pgmap v2558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:07.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:07 smithi055 ceph-mon[31863]: pgmap v2558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:08.649 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3800 sec 2024-03-28T06:52:08.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3127.835843 secs 2024-03-28T06:52:08.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3127.835843 secs 2024-03-28T06:52:08.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3127.835843 secs 2024-03-28T06:52:09.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3801 sec 2024-03-28T06:52:09.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:09 smithi086 ceph-mon[35163]: pgmap v2559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:09.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:09 smithi159 ceph-mon[36109]: pgmap v2559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:09.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:09 smithi055 ceph-mon[31863]: pgmap v2559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:10.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3802 sec 2024-03-28T06:52:11.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3803 sec 2024-03-28T06:52:11.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:11 smithi086 ceph-mon[35163]: pgmap v2560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:11.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:11 smithi159 ceph-mon[36109]: pgmap v2560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:11.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:11 smithi055 ceph-mon[31863]: pgmap v2560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:52:12.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3804 sec 2024-03-28T06:52:13.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3805 sec 2024-03-28T06:52:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3132.835961 secs 2024-03-28T06:52:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:13 smithi086 ceph-mon[35163]: pgmap v2561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3132.835961 secs 2024-03-28T06:52:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:13 smithi159 ceph-mon[36109]: pgmap v2561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3132.835961 secs 2024-03-28T06:52:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:13 smithi055 ceph-mon[31863]: pgmap v2561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:14.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3806 sec 2024-03-28T06:52:15.650 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3807 sec 2024-03-28T06:52:15.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:15 smithi055 ceph-mon[31863]: pgmap v2562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:16.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:15 smithi086 ceph-mon[35163]: pgmap v2562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:16.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:15 smithi159 ceph-mon[36109]: pgmap v2562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:16.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3808 sec 2024-03-28T06:52:17.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3809 sec 2024-03-28T06:52:17.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:17 smithi055 ceph-mon[31863]: pgmap v2563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:17.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:52:18.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:17 smithi086 ceph-mon[35163]: pgmap v2563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:18.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:52:18.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:17 smithi159 ceph-mon[36109]: pgmap v2563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:18.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:52:18.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3810 sec 2024-03-28T06:52:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3137.836056 secs 2024-03-28T06:52:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:52:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:52:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:52:19.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3137.836056 secs 2024-03-28T06:52:19.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:52:19.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:52:19.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:52:19.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3137.836056 secs 2024-03-28T06:52:19.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:52:19.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:52:19.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:52:19.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3811 sec 2024-03-28T06:52:19.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:19 smithi055 ceph-mon[31863]: pgmap v2564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:19.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:19 smithi055 ceph-mon[31863]: pgmap v2565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:20.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:19 smithi086 ceph-mon[35163]: pgmap v2564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:20.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:19 smithi086 ceph-mon[35163]: pgmap v2565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:20.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:19 smithi159 ceph-mon[36109]: pgmap v2564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:20.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:19 smithi159 ceph-mon[36109]: pgmap v2565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:20.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3812 sec 2024-03-28T06:52:21.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3813 sec 2024-03-28T06:52:21.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:21 smithi055 ceph-mon[31863]: pgmap v2566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:52:22.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:21 smithi086 ceph-mon[35163]: pgmap v2566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:52:22.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:21 smithi159 ceph-mon[36109]: pgmap v2566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T06:52:22.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3814 sec 2024-03-28T06:52:23.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:22 smithi086 ceph-mon[35163]: pgmap v2567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:23.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:22 smithi159 ceph-mon[36109]: pgmap v2567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:23.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:22 smithi055 ceph-mon[31863]: pgmap v2567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:23.651 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3815 sec 2024-03-28T06:52:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3142.836189 secs 2024-03-28T06:52:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3142.836189 secs 2024-03-28T06:52:24.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3142.836189 secs 2024-03-28T06:52:24.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3816 sec 2024-03-28T06:52:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:24 smithi086 ceph-mon[35163]: pgmap v2568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:24 smithi159 ceph-mon[36109]: pgmap v2568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:25.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:24 smithi055 ceph-mon[31863]: pgmap v2568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:25.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3817 sec 2024-03-28T06:52:26.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3818 sec 2024-03-28T06:52:27.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:27 smithi086 ceph-mon[35163]: pgmap v2569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:27.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:27 smithi159 ceph-mon[36109]: pgmap v2569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:27.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:27 smithi055 ceph-mon[31863]: pgmap v2569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:27.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3819 sec 2024-03-28T06:52:28.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3147.836310 secs 2024-03-28T06:52:28.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3147.836310 secs 2024-03-28T06:52:28.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3147.836310 secs 2024-03-28T06:52:28.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3820 sec 2024-03-28T06:52:29.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:29 smithi086 ceph-mon[35163]: pgmap v2570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:52:29.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:29 smithi159 ceph-mon[36109]: pgmap v2570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:52:29.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:29 smithi055 ceph-mon[31863]: pgmap v2570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:52:29.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3821 sec 2024-03-28T06:52:30.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3822 sec 2024-03-28T06:52:31.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:31 smithi086 ceph-mon[35163]: pgmap v2571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:31.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:31 smithi159 ceph-mon[36109]: pgmap v2571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:31.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:31 smithi055 ceph-mon[31863]: pgmap v2571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:31.652 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3823 sec 2024-03-28T06:52:32.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3824 sec 2024-03-28T06:52:33.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:33 smithi055 ceph-mon[31863]: pgmap v2572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:33.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3152.836439 secs 2024-03-28T06:52:33.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3825 sec 2024-03-28T06:52:33.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:33 smithi086 ceph-mon[35163]: pgmap v2572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:33.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3152.836439 secs 2024-03-28T06:52:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:33 smithi159 ceph-mon[36109]: pgmap v2572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3152.836439 secs 2024-03-28T06:52:34.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3826 sec 2024-03-28T06:52:35.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:35 smithi055 ceph-mon[31863]: pgmap v2573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:35.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3827 sec 2024-03-28T06:52:35.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:35 smithi086 ceph-mon[35163]: pgmap v2573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:35.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:35 smithi159 ceph-mon[36109]: pgmap v2573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:36.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3828 sec 2024-03-28T06:52:37.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:37 smithi055 ceph-mon[31863]: pgmap v2574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:37.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3829 sec 2024-03-28T06:52:37.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:37 smithi086 ceph-mon[35163]: pgmap v2574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:37.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:37 smithi159 ceph-mon[36109]: pgmap v2574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:38.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3157.836568 secs 2024-03-28T06:52:38.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3830 sec 2024-03-28T06:52:38.726 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3157.836568 secs 2024-03-28T06:52:38.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3157.836568 secs 2024-03-28T06:52:39.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:39 smithi055 ceph-mon[31863]: pgmap v2575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:39.653 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3831 sec 2024-03-28T06:52:39.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:39 smithi086 ceph-mon[35163]: pgmap v2575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:39.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:39 smithi159 ceph-mon[36109]: pgmap v2575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:40.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3832 sec 2024-03-28T06:52:41.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:41 smithi055 ceph-mon[31863]: pgmap v2576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:41.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3833 sec 2024-03-28T06:52:41.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:41 smithi086 ceph-mon[35163]: pgmap v2576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:41.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:41 smithi159 ceph-mon[36109]: pgmap v2576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:42.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3834 sec 2024-03-28T06:52:43.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:43 smithi055 ceph-mon[31863]: pgmap v2577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:43.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3162.836689 secs 2024-03-28T06:52:43.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3835 sec 2024-03-28T06:52:43.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:43 smithi086 ceph-mon[35163]: pgmap v2577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:43.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3162.836689 secs 2024-03-28T06:52:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:43 smithi159 ceph-mon[36109]: pgmap v2577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3162.836689 secs 2024-03-28T06:52:44.654 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3836 sec 2024-03-28T06:52:45.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3837 sec 2024-03-28T06:52:45.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:45 smithi086 ceph-mon[35163]: pgmap v2578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:45.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:45 smithi159 ceph-mon[36109]: pgmap v2578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:45.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:45 smithi055 ceph-mon[31863]: pgmap v2578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:46.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3838 sec 2024-03-28T06:52:47.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3839 sec 2024-03-28T06:52:47.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:47 smithi086 ceph-mon[35163]: pgmap v2579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:47.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:47 smithi159 ceph-mon[36109]: pgmap v2579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:47.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:47 smithi055 ceph-mon[31863]: pgmap v2579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:48.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3840 sec 2024-03-28T06:52:48.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3167.836817 secs 2024-03-28T06:52:48.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3167.836817 secs 2024-03-28T06:52:48.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3167.836817 secs 2024-03-28T06:52:49.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3841 sec 2024-03-28T06:52:49.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:49 smithi086 ceph-mon[35163]: pgmap v2580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:49.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:49 smithi159 ceph-mon[36109]: pgmap v2580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:49.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:49 smithi055 ceph-mon[31863]: pgmap v2580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:50.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3842 sec 2024-03-28T06:52:51.655 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3843 sec 2024-03-28T06:52:51.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:51 smithi086 ceph-mon[35163]: pgmap v2581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:51.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:51 smithi159 ceph-mon[36109]: pgmap v2581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:51.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:51 smithi055 ceph-mon[31863]: pgmap v2581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:52:52.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3844 sec 2024-03-28T06:52:53.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3845 sec 2024-03-28T06:52:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:53 smithi086 ceph-mon[35163]: pgmap v2582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3172.836878 secs 2024-03-28T06:52:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:53 smithi159 ceph-mon[36109]: pgmap v2582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3172.836878 secs 2024-03-28T06:52:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:53 smithi055 ceph-mon[31863]: pgmap v2582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3172.836878 secs 2024-03-28T06:52:54.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3846 sec 2024-03-28T06:52:55.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3847 sec 2024-03-28T06:52:55.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:55 smithi086 ceph-mon[35163]: pgmap v2583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:55.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:55 smithi159 ceph-mon[36109]: pgmap v2583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:55.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:55 smithi055 ceph-mon[31863]: pgmap v2583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:56.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3848 sec 2024-03-28T06:52:57.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3849 sec 2024-03-28T06:52:57.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:57 smithi086 ceph-mon[35163]: pgmap v2584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:57.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:57 smithi159 ceph-mon[36109]: pgmap v2584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:57.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:57 smithi055 ceph-mon[31863]: pgmap v2584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:58.656 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3850 sec 2024-03-28T06:52:58.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3177.836925 secs 2024-03-28T06:52:58.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3177.836925 secs 2024-03-28T06:52:58.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3177.836925 secs 2024-03-28T06:52:59.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3851 sec 2024-03-28T06:52:59.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:52:59 smithi086 ceph-mon[35163]: pgmap v2585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:59.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:52:59 smithi159 ceph-mon[36109]: pgmap v2585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:52:59.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:52:59 smithi055 ceph-mon[31863]: pgmap v2585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:00.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3852 sec 2024-03-28T06:53:01.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3853 sec 2024-03-28T06:53:01.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:01 smithi086 ceph-mon[35163]: pgmap v2586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:01.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:01 smithi159 ceph-mon[36109]: pgmap v2586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:01.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:01 smithi055 ceph-mon[31863]: pgmap v2586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:02.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3854 sec 2024-03-28T06:53:03.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3855 sec 2024-03-28T06:53:03.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:03 smithi086 ceph-mon[35163]: pgmap v2587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:03.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3182.837009 secs 2024-03-28T06:53:03.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:03 smithi159 ceph-mon[36109]: pgmap v2587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:03.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3182.837009 secs 2024-03-28T06:53:03.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:03 smithi055 ceph-mon[31863]: pgmap v2587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:03.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3182.837009 secs 2024-03-28T06:53:04.657 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3856 sec 2024-03-28T06:53:05.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3857 sec 2024-03-28T06:53:05.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:05 smithi086 ceph-mon[35163]: pgmap v2588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:05.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:05 smithi159 ceph-mon[36109]: pgmap v2588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:05.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:05 smithi055 ceph-mon[31863]: pgmap v2588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:06.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3858 sec 2024-03-28T06:53:07.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3859 sec 2024-03-28T06:53:07.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:07 smithi086 ceph-mon[35163]: pgmap v2589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:07.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:07 smithi159 ceph-mon[36109]: pgmap v2589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:07.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:07 smithi055 ceph-mon[31863]: pgmap v2589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:08.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3860 sec 2024-03-28T06:53:08.726 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3187.837092 secs 2024-03-28T06:53:08.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3187.837092 secs 2024-03-28T06:53:08.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3187.837092 secs 2024-03-28T06:53:09.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3861 sec 2024-03-28T06:53:09.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:09 smithi086 ceph-mon[35163]: pgmap v2590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:09.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:09 smithi159 ceph-mon[36109]: pgmap v2590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:09.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:09 smithi055 ceph-mon[31863]: pgmap v2590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:10.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3862 sec 2024-03-28T06:53:11.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3863 sec 2024-03-28T06:53:11.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:11 smithi086 ceph-mon[35163]: pgmap v2591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:11.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:11 smithi159 ceph-mon[36109]: pgmap v2591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:11.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:11 smithi055 ceph-mon[31863]: pgmap v2591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:12.658 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3864 sec 2024-03-28T06:53:13.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3865 sec 2024-03-28T06:53:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:13 smithi086 ceph-mon[35163]: pgmap v2592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3192.837230 secs 2024-03-28T06:53:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:13 smithi159 ceph-mon[36109]: pgmap v2592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3192.837230 secs 2024-03-28T06:53:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:13 smithi055 ceph-mon[31863]: pgmap v2592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3192.837230 secs 2024-03-28T06:53:14.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3866 sec 2024-03-28T06:53:15.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3867 sec 2024-03-28T06:53:15.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:15 smithi086 ceph-mon[35163]: pgmap v2593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:15.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:15 smithi159 ceph-mon[36109]: pgmap v2593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:15.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:15 smithi055 ceph-mon[31863]: pgmap v2593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:16.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3868 sec 2024-03-28T06:53:17.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3869 sec 2024-03-28T06:53:17.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:17 smithi086 ceph-mon[35163]: pgmap v2594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:17.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:17 smithi159 ceph-mon[36109]: pgmap v2594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:17.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:17 smithi055 ceph-mon[31863]: pgmap v2594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:18.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3870 sec 2024-03-28T06:53:18.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3197.837346 secs 2024-03-28T06:53:18.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3197.837346 secs 2024-03-28T06:53:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3197.837346 secs 2024-03-28T06:53:19.659 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3871 sec 2024-03-28T06:53:19.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:19 smithi086 ceph-mon[35163]: pgmap v2595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:19.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:53:19.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:19 smithi159 ceph-mon[36109]: pgmap v2595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:19.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:53:19.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:19 smithi055 ceph-mon[31863]: pgmap v2595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:19.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:53:20.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3872 sec 2024-03-28T06:53:20.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:53:20.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:53:20.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:53:20.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:53:20.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:53:20.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:53:20.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:53:20.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:53:20.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:53:21.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3873 sec 2024-03-28T06:53:21.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:21 smithi086 ceph-mon[35163]: pgmap v2596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:21.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:21 smithi086 ceph-mon[35163]: pgmap v2597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:21.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:21 smithi159 ceph-mon[36109]: pgmap v2596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:21.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:21 smithi159 ceph-mon[36109]: pgmap v2597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:21.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:21 smithi055 ceph-mon[31863]: pgmap v2596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:21.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:21 smithi055 ceph-mon[31863]: pgmap v2597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:22.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3874 sec 2024-03-28T06:53:23.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3875 sec 2024-03-28T06:53:23.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:23 smithi086 ceph-mon[35163]: pgmap v2598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:23.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3202.837426 secs 2024-03-28T06:53:23.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:23 smithi159 ceph-mon[36109]: pgmap v2598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:23.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3202.837426 secs 2024-03-28T06:53:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:23 smithi055 ceph-mon[31863]: pgmap v2598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:23.918 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3202.837426 secs 2024-03-28T06:53:24.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3876 sec 2024-03-28T06:53:25.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3877 sec 2024-03-28T06:53:25.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:25 smithi086 ceph-mon[35163]: pgmap v2599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:25.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:25 smithi159 ceph-mon[36109]: pgmap v2599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:25.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:25 smithi055 ceph-mon[31863]: pgmap v2599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:26.660 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3878 sec 2024-03-28T06:53:27.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3879 sec 2024-03-28T06:53:27.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:27 smithi055 ceph-mon[31863]: pgmap v2600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:28.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:27 smithi086 ceph-mon[35163]: pgmap v2600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:28.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:27 smithi159 ceph-mon[36109]: pgmap v2600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:28.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3880 sec 2024-03-28T06:53:28.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3207.837525 secs 2024-03-28T06:53:29.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3207.837525 secs 2024-03-28T06:53:29.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3207.837525 secs 2024-03-28T06:53:29.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3881 sec 2024-03-28T06:53:29.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:29 smithi055 ceph-mon[31863]: pgmap v2601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:30.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:29 smithi086 ceph-mon[35163]: pgmap v2601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:30.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:29 smithi159 ceph-mon[36109]: pgmap v2601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:53:30.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3882 sec 2024-03-28T06:53:31.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3883 sec 2024-03-28T06:53:31.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:31 smithi055 ceph-mon[31863]: pgmap v2602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:53:32.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:31 smithi086 ceph-mon[35163]: pgmap v2602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:53:32.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:31 smithi159 ceph-mon[36109]: pgmap v2602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:53:32.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3884 sec 2024-03-28T06:53:33.661 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3885 sec 2024-03-28T06:53:33.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:33 smithi055 ceph-mon[31863]: pgmap v2603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:33.880 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3212.837640 secs 2024-03-28T06:53:34.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:33 smithi086 ceph-mon[35163]: pgmap v2603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:34.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3212.837640 secs 2024-03-28T06:53:34.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:33 smithi159 ceph-mon[36109]: pgmap v2603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:34.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3212.837640 secs 2024-03-28T06:53:34.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3886 sec 2024-03-28T06:53:35.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3887 sec 2024-03-28T06:53:35.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:35 smithi055 ceph-mon[31863]: pgmap v2604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:36.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:35 smithi086 ceph-mon[35163]: pgmap v2604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:36.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:35 smithi159 ceph-mon[36109]: pgmap v2604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:36.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3888 sec 2024-03-28T06:53:37.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:36 smithi086 ceph-mon[35163]: pgmap v2605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:37.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:36 smithi159 ceph-mon[36109]: pgmap v2605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:37.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:36 smithi055 ceph-mon[31863]: pgmap v2605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:37.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3889 sec 2024-03-28T06:53:38.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3217.837808 secs 2024-03-28T06:53:38.326 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3217.837808 secs 2024-03-28T06:53:38.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3217.837808 secs 2024-03-28T06:53:38.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3890 sec 2024-03-28T06:53:39.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:39 smithi086 ceph-mon[35163]: pgmap v2606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:39.326 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:39 smithi159 ceph-mon[36109]: pgmap v2606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:39.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:39 smithi055 ceph-mon[31863]: pgmap v2606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:39.662 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3891 sec 2024-03-28T06:53:40.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3892 sec 2024-03-28T06:53:41.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:41 smithi055 ceph-mon[31863]: pgmap v2607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:41.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:41 smithi086 ceph-mon[35163]: pgmap v2607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:41.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:41 smithi159 ceph-mon[36109]: pgmap v2607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:41.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3893 sec 2024-03-28T06:53:42.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3894 sec 2024-03-28T06:53:43.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:43 smithi055 ceph-mon[31863]: pgmap v2608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:43.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3222.837850 secs 2024-03-28T06:53:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:43 smithi086 ceph-mon[35163]: pgmap v2608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3222.837850 secs 2024-03-28T06:53:43.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:43 smithi159 ceph-mon[36109]: pgmap v2608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:43.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3222.837850 secs 2024-03-28T06:53:43.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3895 sec 2024-03-28T06:53:44.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3896 sec 2024-03-28T06:53:45.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:45 smithi055 ceph-mon[31863]: pgmap v2609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:45.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:45 smithi086 ceph-mon[35163]: pgmap v2609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:45.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:45 smithi159 ceph-mon[36109]: pgmap v2609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:45.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3897 sec 2024-03-28T06:53:46.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3898 sec 2024-03-28T06:53:47.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:47 smithi055 ceph-mon[31863]: pgmap v2610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:47.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:47 smithi086 ceph-mon[35163]: pgmap v2610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:47.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:47 smithi159 ceph-mon[36109]: pgmap v2610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:47.663 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3899 sec 2024-03-28T06:53:48.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3227.837984 secs 2024-03-28T06:53:48.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3227.837984 secs 2024-03-28T06:53:48.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3227.837984 secs 2024-03-28T06:53:48.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3900 sec 2024-03-28T06:53:49.379 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:49 smithi055 ceph-mon[31863]: pgmap v2611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:49.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:49 smithi086 ceph-mon[35163]: pgmap v2611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:49.578 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:49 smithi159 ceph-mon[36109]: pgmap v2611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:49.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3901 sec 2024-03-28T06:53:50.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3902 sec 2024-03-28T06:53:51.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:51 smithi086 ceph-mon[35163]: pgmap v2612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:51.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:51 smithi159 ceph-mon[36109]: pgmap v2612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:51.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:51 smithi055 ceph-mon[31863]: pgmap v2612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:53:51.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3903 sec 2024-03-28T06:53:52.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3904 sec 2024-03-28T06:53:53.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:53 smithi086 ceph-mon[35163]: pgmap v2613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:53.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3232.838057 secs 2024-03-28T06:53:53.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:53 smithi159 ceph-mon[36109]: pgmap v2613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:53.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3232.838057 secs 2024-03-28T06:53:53.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:53 smithi055 ceph-mon[31863]: pgmap v2613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:53.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3232.838057 secs 2024-03-28T06:53:53.664 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3905 sec 2024-03-28T06:53:54.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3906 sec 2024-03-28T06:53:55.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:55 smithi086 ceph-mon[35163]: pgmap v2614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:55.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:55 smithi159 ceph-mon[36109]: pgmap v2614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:55.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:55 smithi055 ceph-mon[31863]: pgmap v2614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:55.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3907 sec 2024-03-28T06:53:56.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3908 sec 2024-03-28T06:53:57.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:57 smithi086 ceph-mon[35163]: pgmap v2615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:57.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:57 smithi159 ceph-mon[36109]: pgmap v2615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:57.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:57 smithi055 ceph-mon[31863]: pgmap v2615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:57.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3909 sec 2024-03-28T06:53:58.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3237.838171 secs 2024-03-28T06:53:58.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3237.838171 secs 2024-03-28T06:53:58.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3237.838171 secs 2024-03-28T06:53:58.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3910 sec 2024-03-28T06:53:59.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:53:59 smithi086 ceph-mon[35163]: pgmap v2616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:59.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:53:59 smithi159 ceph-mon[36109]: pgmap v2616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:59.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:53:59 smithi055 ceph-mon[31863]: pgmap v2616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:53:59.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3911 sec 2024-03-28T06:54:00.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3912 sec 2024-03-28T06:54:01.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:01 smithi086 ceph-mon[35163]: pgmap v2617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:01.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:01 smithi159 ceph-mon[36109]: pgmap v2617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:01.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:01 smithi055 ceph-mon[31863]: pgmap v2617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:01.665 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3913 sec 2024-03-28T06:54:02.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3914 sec 2024-03-28T06:54:03.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:03 smithi086 ceph-mon[35163]: pgmap v2618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:03.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3242.838293 secs 2024-03-28T06:54:03.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:03 smithi159 ceph-mon[36109]: pgmap v2618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:03.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3242.838293 secs 2024-03-28T06:54:03.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:03 smithi055 ceph-mon[31863]: pgmap v2618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:03.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3242.838293 secs 2024-03-28T06:54:03.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3915 sec 2024-03-28T06:54:04.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3916 sec 2024-03-28T06:54:05.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:05 smithi086 ceph-mon[35163]: pgmap v2619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:05.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:05 smithi159 ceph-mon[36109]: pgmap v2619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:05.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:05 smithi055 ceph-mon[31863]: pgmap v2619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:05.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3917 sec 2024-03-28T06:54:06.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3918 sec 2024-03-28T06:54:07.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:07 smithi086 ceph-mon[35163]: pgmap v2620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:07.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:07 smithi159 ceph-mon[36109]: pgmap v2620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:07.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:07 smithi055 ceph-mon[31863]: pgmap v2620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:07.666 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3919 sec 2024-03-28T06:54:08.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3247.838356 secs 2024-03-28T06:54:08.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3247.838356 secs 2024-03-28T06:54:08.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3247.838356 secs 2024-03-28T06:54:08.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3920 sec 2024-03-28T06:54:09.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:09 smithi086 ceph-mon[35163]: pgmap v2621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:09.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:09 smithi159 ceph-mon[36109]: pgmap v2621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:09.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:09 smithi055 ceph-mon[31863]: pgmap v2621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:09.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3921 sec 2024-03-28T06:54:10.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3922 sec 2024-03-28T06:54:11.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:11 smithi086 ceph-mon[35163]: pgmap v2622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:11.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:11 smithi159 ceph-mon[36109]: pgmap v2622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:11.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:11 smithi055 ceph-mon[31863]: pgmap v2622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:11.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3923 sec 2024-03-28T06:54:12.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3924 sec 2024-03-28T06:54:13.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:13 smithi086 ceph-mon[35163]: pgmap v2623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:13.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3252.838399 secs 2024-03-28T06:54:13.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:13 smithi159 ceph-mon[36109]: pgmap v2623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:13.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3252.838399 secs 2024-03-28T06:54:13.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:13 smithi055 ceph-mon[31863]: pgmap v2623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:13.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3252.838399 secs 2024-03-28T06:54:13.667 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3925 sec 2024-03-28T06:54:14.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3926 sec 2024-03-28T06:54:15.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:15 smithi086 ceph-mon[35163]: pgmap v2624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:15.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:15 smithi159 ceph-mon[36109]: pgmap v2624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:15.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:15 smithi055 ceph-mon[31863]: pgmap v2624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:15.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3927 sec 2024-03-28T06:54:16.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3928 sec 2024-03-28T06:54:17.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:17 smithi086 ceph-mon[35163]: pgmap v2625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:17.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:17 smithi159 ceph-mon[36109]: pgmap v2625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:17.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:17 smithi055 ceph-mon[31863]: pgmap v2625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:17.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3929 sec 2024-03-28T06:54:18.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3257.838420 secs 2024-03-28T06:54:18.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3257.838420 secs 2024-03-28T06:54:18.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3257.838420 secs 2024-03-28T06:54:18.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3930 sec 2024-03-28T06:54:19.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:19 smithi086 ceph-mon[35163]: pgmap v2626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:19.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:19 smithi159 ceph-mon[36109]: pgmap v2626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:19.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:19 smithi055 ceph-mon[31863]: pgmap v2626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:19.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3931 sec 2024-03-28T06:54:20.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3932 sec 2024-03-28T06:54:21.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:21 smithi086 ceph-mon[35163]: pgmap v2627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:21.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:54:21.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:21 smithi159 ceph-mon[36109]: pgmap v2627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:21.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:54:21.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:21 smithi055 ceph-mon[31863]: pgmap v2627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:21.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:54:21.668 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3933 sec 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:54:22.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:54:22.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:54:22.578 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:54:22.578 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:54:22.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:54:22.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3934 sec 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: pgmap v2628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: pgmap v2629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:23.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3262.838494 secs 2024-03-28T06:54:23.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:54:23.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:54:23.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:54:23.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:54:23.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: pgmap v2628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:23.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: pgmap v2629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:23.577 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3262.838494 secs 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: pgmap v2628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: pgmap v2629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:23.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3262.838494 secs 2024-03-28T06:54:23.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3935 sec 2024-03-28T06:54:24.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3936 sec 2024-03-28T06:54:25.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:25 smithi086 ceph-mon[35163]: pgmap v2630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:25.576 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:25 smithi159 ceph-mon[36109]: pgmap v2630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:25.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:25 smithi055 ceph-mon[31863]: pgmap v2630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:25.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3937 sec 2024-03-28T06:54:26.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3938 sec 2024-03-28T06:54:27.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:27 smithi055 ceph-mon[31863]: pgmap v2631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:27.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3939 sec 2024-03-28T06:54:27.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:27 smithi086 ceph-mon[35163]: pgmap v2631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:27.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:27 smithi159 ceph-mon[36109]: pgmap v2631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:28.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3267.838616 secs 2024-03-28T06:54:28.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3940 sec 2024-03-28T06:54:28.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3267.838616 secs 2024-03-28T06:54:28.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3267.838616 secs 2024-03-28T06:54:29.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:29 smithi055 ceph-mon[31863]: pgmap v2632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:29.669 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3941 sec 2024-03-28T06:54:29.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:29 smithi086 ceph-mon[35163]: pgmap v2632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:29.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:29 smithi159 ceph-mon[36109]: pgmap v2632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:30.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3942 sec 2024-03-28T06:54:31.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:31 smithi055 ceph-mon[31863]: pgmap v2633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:31.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3943 sec 2024-03-28T06:54:31.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:31 smithi086 ceph-mon[35163]: pgmap v2633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:31.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:31 smithi159 ceph-mon[36109]: pgmap v2633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:54:32.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3944 sec 2024-03-28T06:54:33.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:33 smithi055 ceph-mon[31863]: pgmap v2634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:54:33.630 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3272.838676 secs 2024-03-28T06:54:33.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3945 sec 2024-03-28T06:54:33.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:33 smithi086 ceph-mon[35163]: pgmap v2634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:54:33.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3272.838676 secs 2024-03-28T06:54:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:33 smithi159 ceph-mon[36109]: pgmap v2634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:54:33.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3272.838676 secs 2024-03-28T06:54:34.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3946 sec 2024-03-28T06:54:35.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:35 smithi055 ceph-mon[31863]: pgmap v2635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:35.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3947 sec 2024-03-28T06:54:35.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:35 smithi086 ceph-mon[35163]: pgmap v2635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:35.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:35 smithi159 ceph-mon[36109]: pgmap v2635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:36.670 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3948 sec 2024-03-28T06:54:37.629 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:37 smithi055 ceph-mon[31863]: pgmap v2636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:37.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3949 sec 2024-03-28T06:54:37.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:37 smithi086 ceph-mon[35163]: pgmap v2636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:37.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:37 smithi159 ceph-mon[36109]: pgmap v2636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:38.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3950 sec 2024-03-28T06:54:38.725 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3277.838816 secs 2024-03-28T06:54:38.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3277.838816 secs 2024-03-28T06:54:38.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3277.838816 secs 2024-03-28T06:54:39.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3951 sec 2024-03-28T06:54:39.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:39 smithi086 ceph-mon[35163]: pgmap v2637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:39.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:39 smithi159 ceph-mon[36109]: pgmap v2637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:39.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:39 smithi055 ceph-mon[31863]: pgmap v2637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:40.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3952 sec 2024-03-28T06:54:41.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3953 sec 2024-03-28T06:54:41.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:41 smithi086 ceph-mon[35163]: pgmap v2638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:41.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:41 smithi159 ceph-mon[36109]: pgmap v2638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:41.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:41 smithi055 ceph-mon[31863]: pgmap v2638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:42.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3954 sec 2024-03-28T06:54:43.671 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3955 sec 2024-03-28T06:54:43.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:43 smithi086 ceph-mon[35163]: pgmap v2639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:43.825 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3282.838907 secs 2024-03-28T06:54:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:43 smithi159 ceph-mon[36109]: pgmap v2639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:43.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3282.838907 secs 2024-03-28T06:54:43.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:43 smithi055 ceph-mon[31863]: pgmap v2639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:43.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3282.838907 secs 2024-03-28T06:54:44.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3956 sec 2024-03-28T06:54:45.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3957 sec 2024-03-28T06:54:45.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:45 smithi086 ceph-mon[35163]: pgmap v2640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:45.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:45 smithi159 ceph-mon[36109]: pgmap v2640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:45.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:45 smithi055 ceph-mon[31863]: pgmap v2640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:46.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3958 sec 2024-03-28T06:54:47.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3959 sec 2024-03-28T06:54:47.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:47 smithi086 ceph-mon[35163]: pgmap v2641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:47.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:47 smithi159 ceph-mon[36109]: pgmap v2641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:47.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:47 smithi055 ceph-mon[31863]: pgmap v2641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:48.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3960 sec 2024-03-28T06:54:48.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3287.838970 secs 2024-03-28T06:54:48.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3287.838970 secs 2024-03-28T06:54:48.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3287.838970 secs 2024-03-28T06:54:49.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3961 sec 2024-03-28T06:54:49.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:49 smithi086 ceph-mon[35163]: pgmap v2642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:49.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:49 smithi159 ceph-mon[36109]: pgmap v2642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:49.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:49 smithi055 ceph-mon[31863]: pgmap v2642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:50.672 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3962 sec 2024-03-28T06:54:51.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3963 sec 2024-03-28T06:54:51.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:51 smithi086 ceph-mon[35163]: pgmap v2643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:51.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:51 smithi159 ceph-mon[36109]: pgmap v2643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:51.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:51 smithi055 ceph-mon[31863]: pgmap v2643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:54:52.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3964 sec 2024-03-28T06:54:53.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3965 sec 2024-03-28T06:54:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:53 smithi086 ceph-mon[35163]: pgmap v2644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:53.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3292.839032 secs 2024-03-28T06:54:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:53 smithi159 ceph-mon[36109]: pgmap v2644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:53.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3292.839032 secs 2024-03-28T06:54:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:53 smithi055 ceph-mon[31863]: pgmap v2644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3292.839032 secs 2024-03-28T06:54:54.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3966 sec 2024-03-28T06:54:55.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3967 sec 2024-03-28T06:54:55.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:55 smithi086 ceph-mon[35163]: pgmap v2645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:55.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:55 smithi159 ceph-mon[36109]: pgmap v2645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:55.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:55 smithi055 ceph-mon[31863]: pgmap v2645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:56.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3968 sec 2024-03-28T06:54:57.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3969 sec 2024-03-28T06:54:57.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:57 smithi086 ceph-mon[35163]: pgmap v2646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:57.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:57 smithi159 ceph-mon[36109]: pgmap v2646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:57.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:57 smithi055 ceph-mon[31863]: pgmap v2646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:58.673 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3970 sec 2024-03-28T06:54:58.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3297.839089 secs 2024-03-28T06:54:58.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3297.839089 secs 2024-03-28T06:54:58.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3297.839089 secs 2024-03-28T06:54:59.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3971 sec 2024-03-28T06:54:59.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:54:59 smithi086 ceph-mon[35163]: pgmap v2647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:59.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:54:59 smithi159 ceph-mon[36109]: pgmap v2647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:54:59.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:54:59 smithi055 ceph-mon[31863]: pgmap v2647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:00.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3972 sec 2024-03-28T06:55:01.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3973 sec 2024-03-28T06:55:01.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:01 smithi086 ceph-mon[35163]: pgmap v2648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:01.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:01 smithi159 ceph-mon[36109]: pgmap v2648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:01.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:01 smithi055 ceph-mon[31863]: pgmap v2648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:02.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3974 sec 2024-03-28T06:55:03.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3975 sec 2024-03-28T06:55:03.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:03 smithi086 ceph-mon[35163]: pgmap v2649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:03.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3302.839163 secs 2024-03-28T06:55:03.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:03 smithi159 ceph-mon[36109]: pgmap v2649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:03.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3302.839163 secs 2024-03-28T06:55:03.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:03 smithi055 ceph-mon[31863]: pgmap v2649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:03.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3302.839163 secs 2024-03-28T06:55:04.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3976 sec 2024-03-28T06:55:05.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3977 sec 2024-03-28T06:55:05.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:05 smithi086 ceph-mon[35163]: pgmap v2650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:05.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:05 smithi159 ceph-mon[36109]: pgmap v2650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:05.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:05 smithi055 ceph-mon[31863]: pgmap v2650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:06.674 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3978 sec 2024-03-28T06:55:07.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3979 sec 2024-03-28T06:55:07.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:07 smithi086 ceph-mon[35163]: pgmap v2651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:07.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:07 smithi159 ceph-mon[36109]: pgmap v2651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:07.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:07 smithi055 ceph-mon[31863]: pgmap v2651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:08.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3980 sec 2024-03-28T06:55:08.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3307.839225 secs 2024-03-28T06:55:08.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3307.839225 secs 2024-03-28T06:55:08.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3307.839225 secs 2024-03-28T06:55:09.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3981 sec 2024-03-28T06:55:09.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:09 smithi086 ceph-mon[35163]: pgmap v2652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:09.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:09 smithi159 ceph-mon[36109]: pgmap v2652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:09.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:09 smithi055 ceph-mon[31863]: pgmap v2652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:10.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3982 sec 2024-03-28T06:55:11.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3983 sec 2024-03-28T06:55:11.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:11 smithi086 ceph-mon[35163]: pgmap v2653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:55:11.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:11 smithi159 ceph-mon[36109]: pgmap v2653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:55:11.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:11 smithi055 ceph-mon[31863]: pgmap v2653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:55:12.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3984 sec 2024-03-28T06:55:13.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3985 sec 2024-03-28T06:55:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:13 smithi086 ceph-mon[35163]: pgmap v2654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:13.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3312.839345 secs 2024-03-28T06:55:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:13 smithi159 ceph-mon[36109]: pgmap v2654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:13.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3312.839345 secs 2024-03-28T06:55:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:13 smithi055 ceph-mon[31863]: pgmap v2654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:55:13.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3312.839345 secs 2024-03-28T06:55:14.675 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3986 sec 2024-03-28T06:55:15.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3987 sec 2024-03-28T06:55:15.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:15 smithi086 ceph-mon[35163]: pgmap v2655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:15.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:15 smithi159 ceph-mon[36109]: pgmap v2655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:15.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:15 smithi055 ceph-mon[31863]: pgmap v2655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:16.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3988 sec 2024-03-28T06:55:17.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3989 sec 2024-03-28T06:55:17.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:17 smithi086 ceph-mon[35163]: pgmap v2656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:17.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:17 smithi159 ceph-mon[36109]: pgmap v2656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:17.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:17 smithi055 ceph-mon[31863]: pgmap v2656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:18.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3990 sec 2024-03-28T06:55:18.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3317.839461 secs 2024-03-28T06:55:18.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3317.839461 secs 2024-03-28T06:55:18.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3317.839461 secs 2024-03-28T06:55:19.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3991 sec 2024-03-28T06:55:19.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:19 smithi055 ceph-mon[31863]: pgmap v2657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:20.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:19 smithi086 ceph-mon[35163]: pgmap v2657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:20.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:19 smithi159 ceph-mon[36109]: pgmap v2657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:20.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3992 sec 2024-03-28T06:55:21.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3993 sec 2024-03-28T06:55:21.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:21 smithi055 ceph-mon[31863]: pgmap v2658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:22.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:21 smithi086 ceph-mon[35163]: pgmap v2658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:22.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:21 smithi159 ceph-mon[36109]: pgmap v2658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:22.676 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3994 sec 2024-03-28T06:55:22.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:55:23.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:55:23.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:55:23.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3995 sec 2024-03-28T06:55:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: pgmap v2659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3322.839530 secs 2024-03-28T06:55:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.880 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: pgmap v2659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3322.839530 secs 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:23.978 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: pgmap v2659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3322.839530 secs 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:24.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T06:55:24.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3996 sec 2024-03-28T06:55:24.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:24 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:55:24.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:24 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:55:24.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:55:24.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:55:24.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:55:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:24 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:55:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:24 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:55:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:55:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:55:25.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:55:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:24 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T06:55:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:24 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T06:55:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:55:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:55:25.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:55:25.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3997 sec 2024-03-28T06:55:25.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:25 smithi055 ceph-mon[31863]: pgmap v2660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:26.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:25 smithi086 ceph-mon[35163]: pgmap v2660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:26.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:25 smithi159 ceph-mon[36109]: pgmap v2660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:26.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3998 sec 2024-03-28T06:55:27.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 3999 sec 2024-03-28T06:55:27.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:27 smithi055 ceph-mon[31863]: pgmap v2661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:28.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:27 smithi086 ceph-mon[35163]: pgmap v2661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:28.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:27 smithi159 ceph-mon[36109]: pgmap v2661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:28.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4000 sec 2024-03-28T06:55:29.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3327.839650 secs 2024-03-28T06:55:29.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3327.839650 secs 2024-03-28T06:55:29.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3327.839650 secs 2024-03-28T06:55:29.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4001 sec 2024-03-28T06:55:30.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:29 smithi086 ceph-mon[35163]: pgmap v2662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:30.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:29 smithi159 ceph-mon[36109]: pgmap v2662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:30.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:29 smithi055 ceph-mon[31863]: pgmap v2662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:30.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4002 sec 2024-03-28T06:55:31.677 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4003 sec 2024-03-28T06:55:32.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:31 smithi086 ceph-mon[35163]: pgmap v2663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:32.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:31 smithi159 ceph-mon[36109]: pgmap v2663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:32.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:31 smithi055 ceph-mon[31863]: pgmap v2663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:32.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4004 sec 2024-03-28T06:55:33.030 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:32 smithi055 ceph-mon[31863]: pgmap v2664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:33.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:32 smithi086 ceph-mon[35163]: pgmap v2664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:33.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:32 smithi159 ceph-mon[36109]: pgmap v2664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:33.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4005 sec 2024-03-28T06:55:34.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3332.839731 secs 2024-03-28T06:55:34.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3332.839731 secs 2024-03-28T06:55:34.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3332.839731 secs 2024-03-28T06:55:34.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4006 sec 2024-03-28T06:55:35.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:34 smithi086 ceph-mon[35163]: pgmap v2665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:35.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:34 smithi159 ceph-mon[36109]: pgmap v2665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:35.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:34 smithi055 ceph-mon[31863]: pgmap v2665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:35.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4007 sec 2024-03-28T06:55:36.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4008 sec 2024-03-28T06:55:37.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:36 smithi086 ceph-mon[35163]: pgmap v2666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:37.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:36 smithi159 ceph-mon[36109]: pgmap v2666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:37.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:36 smithi055 ceph-mon[31863]: pgmap v2666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:37.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4009 sec 2024-03-28T06:55:38.678 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4010 sec 2024-03-28T06:55:39.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3337.839819 secs 2024-03-28T06:55:39.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:38 smithi086 ceph-mon[35163]: pgmap v2667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:39.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3337.839819 secs 2024-03-28T06:55:39.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:38 smithi159 ceph-mon[36109]: pgmap v2667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:39.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3337.839819 secs 2024-03-28T06:55:39.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:38 smithi055 ceph-mon[31863]: pgmap v2667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:39.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4011 sec 2024-03-28T06:55:40.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4012 sec 2024-03-28T06:55:41.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:40 smithi086 ceph-mon[35163]: pgmap v2668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:41.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:40 smithi159 ceph-mon[36109]: pgmap v2668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:41.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:40 smithi055 ceph-mon[31863]: pgmap v2668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:41.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4013 sec 2024-03-28T06:55:42.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4014 sec 2024-03-28T06:55:43.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:42 smithi086 ceph-mon[35163]: pgmap v2669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:43.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:42 smithi159 ceph-mon[36109]: pgmap v2669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:43.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:42 smithi055 ceph-mon[31863]: pgmap v2669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:43.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4015 sec 2024-03-28T06:55:44.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3342.839882 secs 2024-03-28T06:55:44.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3342.839882 secs 2024-03-28T06:55:44.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3342.839882 secs 2024-03-28T06:55:44.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4016 sec 2024-03-28T06:55:45.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:44 smithi086 ceph-mon[35163]: pgmap v2670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:45.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:44 smithi159 ceph-mon[36109]: pgmap v2670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:45.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:44 smithi055 ceph-mon[31863]: pgmap v2670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:45.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4017 sec 2024-03-28T06:55:46.679 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4018 sec 2024-03-28T06:55:47.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:46 smithi086 ceph-mon[35163]: pgmap v2671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:47.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:46 smithi159 ceph-mon[36109]: pgmap v2671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:47.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:46 smithi055 ceph-mon[31863]: pgmap v2671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:47.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4019 sec 2024-03-28T06:55:48.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4020 sec 2024-03-28T06:55:49.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3347.840001 secs 2024-03-28T06:55:49.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:48 smithi086 ceph-mon[35163]: pgmap v2672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:49.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3347.840001 secs 2024-03-28T06:55:49.076 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:48 smithi159 ceph-mon[36109]: pgmap v2672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:49.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3347.840001 secs 2024-03-28T06:55:49.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:48 smithi055 ceph-mon[31863]: pgmap v2672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:49.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4021 sec 2024-03-28T06:55:50.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4022 sec 2024-03-28T06:55:51.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:50 smithi086 ceph-mon[35163]: pgmap v2673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:51.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:50 smithi159 ceph-mon[36109]: pgmap v2673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:51.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:50 smithi055 ceph-mon[31863]: pgmap v2673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:51.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4023 sec 2024-03-28T06:55:52.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4024 sec 2024-03-28T06:55:53.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:52 smithi086 ceph-mon[35163]: pgmap v2674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:53.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:52 smithi159 ceph-mon[36109]: pgmap v2674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:53.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:52 smithi055 ceph-mon[31863]: pgmap v2674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:53.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4025 sec 2024-03-28T06:55:54.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3352.840068 secs 2024-03-28T06:55:54.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3352.840068 secs 2024-03-28T06:55:54.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3352.840068 secs 2024-03-28T06:55:54.680 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4026 sec 2024-03-28T06:55:55.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:54 smithi086 ceph-mon[35163]: pgmap v2675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:55.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:54 smithi159 ceph-mon[36109]: pgmap v2675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:55.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:54 smithi055 ceph-mon[31863]: pgmap v2675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:55:55.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4027 sec 2024-03-28T06:55:56.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4028 sec 2024-03-28T06:55:57.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:56 smithi055 ceph-mon[31863]: pgmap v2676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:57.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:56 smithi086 ceph-mon[35163]: pgmap v2676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:57.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:56 smithi159 ceph-mon[36109]: pgmap v2676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:55:57.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4029 sec 2024-03-28T06:55:58.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4030 sec 2024-03-28T06:55:59.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3357.840127 secs 2024-03-28T06:55:59.129 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:55:58 smithi055 ceph-mon[31863]: pgmap v2677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:59.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3357.840127 secs 2024-03-28T06:55:59.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:55:58 smithi086 ceph-mon[35163]: pgmap v2677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:59.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3357.840127 secs 2024-03-28T06:55:59.326 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:55:58 smithi159 ceph-mon[36109]: pgmap v2677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:55:59.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4031 sec 2024-03-28T06:56:00.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4032 sec 2024-03-28T06:56:01.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:00 smithi055 ceph-mon[31863]: pgmap v2678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:01.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:00 smithi086 ceph-mon[35163]: pgmap v2678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:01.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:00 smithi159 ceph-mon[36109]: pgmap v2678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:01.681 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4033 sec 2024-03-28T06:56:02.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4034 sec 2024-03-28T06:56:03.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:02 smithi055 ceph-mon[31863]: pgmap v2679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:03.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:02 smithi086 ceph-mon[35163]: pgmap v2679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:03.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:02 smithi159 ceph-mon[36109]: pgmap v2679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:03.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4035 sec 2024-03-28T06:56:04.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3362.840207 secs 2024-03-28T06:56:04.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3362.840207 secs 2024-03-28T06:56:04.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3362.840207 secs 2024-03-28T06:56:04.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4036 sec 2024-03-28T06:56:05.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:04 smithi055 ceph-mon[31863]: pgmap v2680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:05.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:04 smithi086 ceph-mon[35163]: pgmap v2680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:05.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:04 smithi159 ceph-mon[36109]: pgmap v2680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:05.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4037 sec 2024-03-28T06:56:06.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4038 sec 2024-03-28T06:56:07.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:06 smithi055 ceph-mon[31863]: pgmap v2681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:07.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:06 smithi086 ceph-mon[35163]: pgmap v2681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:07.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:06 smithi159 ceph-mon[36109]: pgmap v2681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:07.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4039 sec 2024-03-28T06:56:08.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4040 sec 2024-03-28T06:56:09.126 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3367.840267 secs 2024-03-28T06:56:09.126 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:08 smithi086 ceph-mon[35163]: pgmap v2682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:09.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3367.840267 secs 2024-03-28T06:56:09.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:08 smithi055 ceph-mon[31863]: pgmap v2682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:09.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3367.840267 secs 2024-03-28T06:56:09.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:08 smithi159 ceph-mon[36109]: pgmap v2682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:09.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4041 sec 2024-03-28T06:56:10.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4042 sec 2024-03-28T06:56:11.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:10 smithi086 ceph-mon[35163]: pgmap v2683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:11.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:10 smithi159 ceph-mon[36109]: pgmap v2683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:11.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:10 smithi055 ceph-mon[31863]: pgmap v2683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:11.682 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4043 sec 2024-03-28T06:56:12.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4044 sec 2024-03-28T06:56:13.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:12 smithi086 ceph-mon[35163]: pgmap v2684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:13.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:12 smithi159 ceph-mon[36109]: pgmap v2684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:13.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:12 smithi055 ceph-mon[31863]: pgmap v2684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:13.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4045 sec 2024-03-28T06:56:14.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3372.840333 secs 2024-03-28T06:56:14.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3372.840333 secs 2024-03-28T06:56:14.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3372.840333 secs 2024-03-28T06:56:14.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4046 sec 2024-03-28T06:56:15.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:14 smithi086 ceph-mon[35163]: pgmap v2685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:15.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:14 smithi159 ceph-mon[36109]: pgmap v2685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:15.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:14 smithi055 ceph-mon[31863]: pgmap v2685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:15.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4047 sec 2024-03-28T06:56:16.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4048 sec 2024-03-28T06:56:17.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4049 sec 2024-03-28T06:56:17.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:17 smithi086 ceph-mon[35163]: pgmap v2686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:17.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:17 smithi159 ceph-mon[36109]: pgmap v2686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:17.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:17 smithi055 ceph-mon[31863]: pgmap v2686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:18.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4050 sec 2024-03-28T06:56:18.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3377.840399 secs 2024-03-28T06:56:18.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3377.840399 secs 2024-03-28T06:56:18.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3377.840399 secs 2024-03-28T06:56:19.683 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4051 sec 2024-03-28T06:56:19.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:19 smithi086 ceph-mon[35163]: pgmap v2687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:19.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:19 smithi159 ceph-mon[36109]: pgmap v2687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:19.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:19 smithi055 ceph-mon[31863]: pgmap v2687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:20.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4052 sec 2024-03-28T06:56:21.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4053 sec 2024-03-28T06:56:21.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:21 smithi086 ceph-mon[35163]: pgmap v2688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:21.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:21 smithi159 ceph-mon[36109]: pgmap v2688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:21.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:21 smithi055 ceph-mon[31863]: pgmap v2688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:22.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4054 sec 2024-03-28T06:56:23.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4055 sec 2024-03-28T06:56:23.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:23 smithi086 ceph-mon[35163]: pgmap v2689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:23.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3382.840522 secs 2024-03-28T06:56:23.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:23 smithi159 ceph-mon[36109]: pgmap v2689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:23.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3382.840522 secs 2024-03-28T06:56:23.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:23 smithi055 ceph-mon[31863]: pgmap v2689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:23.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3382.840522 secs 2024-03-28T06:56:24.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:56:24.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4056 sec 2024-03-28T06:56:24.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:56:24.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:56:25.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4057 sec 2024-03-28T06:56:25.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:25 smithi086 ceph-mon[35163]: pgmap v2690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:25.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:25 smithi159 ceph-mon[36109]: pgmap v2690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:25.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:25 smithi055 ceph-mon[31863]: pgmap v2690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:26.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4058 sec 2024-03-28T06:56:26.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:56:26.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:56:26.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:26 smithi086 ceph-mon[35163]: pgmap v2691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:26.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:26 smithi086 ceph-mon[35163]: pgmap v2692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:26.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:56:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:56:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:56:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:26 smithi159 ceph-mon[36109]: pgmap v2691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:26 smithi159 ceph-mon[36109]: pgmap v2692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:26.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:56:26.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:56:26.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:56:26.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:26 smithi055 ceph-mon[31863]: pgmap v2691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:26.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:26 smithi055 ceph-mon[31863]: pgmap v2692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:26.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:56:27.684 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4059 sec 2024-03-28T06:56:28.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4060 sec 2024-03-28T06:56:28.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3387.840640 secs 2024-03-28T06:56:28.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:28 smithi086 ceph-mon[35163]: pgmap v2693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3387.840640 secs 2024-03-28T06:56:28.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:28 smithi159 ceph-mon[36109]: pgmap v2693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:28.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3387.840640 secs 2024-03-28T06:56:28.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:28 smithi055 ceph-mon[31863]: pgmap v2693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:29.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4061 sec 2024-03-28T06:56:30.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4062 sec 2024-03-28T06:56:30.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:30 smithi086 ceph-mon[35163]: pgmap v2694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:30.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:30 smithi159 ceph-mon[36109]: pgmap v2694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:30.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:30 smithi055 ceph-mon[31863]: pgmap v2694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:31.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4063 sec 2024-03-28T06:56:32.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4064 sec 2024-03-28T06:56:32.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:32 smithi086 ceph-mon[35163]: pgmap v2695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:32.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:32 smithi159 ceph-mon[36109]: pgmap v2695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:32.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:32 smithi055 ceph-mon[31863]: pgmap v2695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:33.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4065 sec 2024-03-28T06:56:33.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3392.840755 secs 2024-03-28T06:56:34.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3392.840755 secs 2024-03-28T06:56:34.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3392.840755 secs 2024-03-28T06:56:34.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4066 sec 2024-03-28T06:56:34.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:34 smithi055 ceph-mon[31863]: pgmap v2696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:35.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:34 smithi086 ceph-mon[35163]: pgmap v2696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:35.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:34 smithi159 ceph-mon[36109]: pgmap v2696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T06:56:35.685 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4067 sec 2024-03-28T06:56:36.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4068 sec 2024-03-28T06:56:36.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:36 smithi055 ceph-mon[31863]: pgmap v2697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:56:37.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:36 smithi086 ceph-mon[35163]: pgmap v2697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:56:37.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:36 smithi159 ceph-mon[36109]: pgmap v2697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:56:37.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4069 sec 2024-03-28T06:56:38.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4070 sec 2024-03-28T06:56:38.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3397.840872 secs 2024-03-28T06:56:38.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:38 smithi055 ceph-mon[31863]: pgmap v2698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:39.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3397.840872 secs 2024-03-28T06:56:39.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:38 smithi086 ceph-mon[35163]: pgmap v2698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:39.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3397.840872 secs 2024-03-28T06:56:39.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:38 smithi159 ceph-mon[36109]: pgmap v2698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:39.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4071 sec 2024-03-28T06:56:40.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4072 sec 2024-03-28T06:56:40.876 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:40 smithi086 ceph-mon[35163]: pgmap v2699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:40.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:40 smithi055 ceph-mon[31863]: pgmap v2699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:41.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:40 smithi159 ceph-mon[36109]: pgmap v2699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:41.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4073 sec 2024-03-28T06:56:42.686 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4074 sec 2024-03-28T06:56:42.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:42 smithi055 ceph-mon[31863]: pgmap v2700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:43.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:42 smithi086 ceph-mon[35163]: pgmap v2700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:43.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:42 smithi159 ceph-mon[36109]: pgmap v2700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:43.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4075 sec 2024-03-28T06:56:44.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3402.840961 secs 2024-03-28T06:56:44.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3402.840961 secs 2024-03-28T06:56:44.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3402.840961 secs 2024-03-28T06:56:44.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4076 sec 2024-03-28T06:56:45.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:44 smithi086 ceph-mon[35163]: pgmap v2701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:45.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:44 smithi159 ceph-mon[36109]: pgmap v2701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:45.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:44 smithi055 ceph-mon[31863]: pgmap v2701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:45.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4077 sec 2024-03-28T06:56:46.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4078 sec 2024-03-28T06:56:47.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:46 smithi086 ceph-mon[35163]: pgmap v2702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:47.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:46 smithi159 ceph-mon[36109]: pgmap v2702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:47.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:46 smithi055 ceph-mon[31863]: pgmap v2702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:47.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4079 sec 2024-03-28T06:56:48.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4080 sec 2024-03-28T06:56:49.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3407.841078 secs 2024-03-28T06:56:49.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:48 smithi086 ceph-mon[35163]: pgmap v2703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:49.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3407.841078 secs 2024-03-28T06:56:49.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:48 smithi159 ceph-mon[36109]: pgmap v2703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:49.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3407.841078 secs 2024-03-28T06:56:49.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:48 smithi055 ceph-mon[31863]: pgmap v2703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:49.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4081 sec 2024-03-28T06:56:50.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4082 sec 2024-03-28T06:56:51.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:50 smithi086 ceph-mon[35163]: pgmap v2704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:51.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:50 smithi159 ceph-mon[36109]: pgmap v2704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:51.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:50 smithi055 ceph-mon[31863]: pgmap v2704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:51.687 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4083 sec 2024-03-28T06:56:52.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4084 sec 2024-03-28T06:56:53.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:52 smithi086 ceph-mon[35163]: pgmap v2705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:53.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:52 smithi159 ceph-mon[36109]: pgmap v2705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:53.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:52 smithi055 ceph-mon[31863]: pgmap v2705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:53.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4085 sec 2024-03-28T06:56:53.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3412.841144 secs 2024-03-28T06:56:54.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3412.841144 secs 2024-03-28T06:56:54.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3412.841144 secs 2024-03-28T06:56:54.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4086 sec 2024-03-28T06:56:55.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:54 smithi086 ceph-mon[35163]: pgmap v2706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:55.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:54 smithi159 ceph-mon[36109]: pgmap v2706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:55.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:54 smithi055 ceph-mon[31863]: pgmap v2706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:56:55.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4087 sec 2024-03-28T06:56:56.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:55 smithi086 ceph-mon[35163]: pgmap v2707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:56.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:55 smithi159 ceph-mon[36109]: pgmap v2707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:56.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:55 smithi055 ceph-mon[31863]: pgmap v2707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:56:56.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4088 sec 2024-03-28T06:56:57.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4089 sec 2024-03-28T06:56:58.688 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4090 sec 2024-03-28T06:56:58.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3417.841217 secs 2024-03-28T06:56:58.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:56:58 smithi086 ceph-mon[35163]: pgmap v2708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3417.841217 secs 2024-03-28T06:56:58.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:56:58 smithi159 ceph-mon[36109]: pgmap v2708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3417.841217 secs 2024-03-28T06:56:58.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:56:58 smithi055 ceph-mon[31863]: pgmap v2708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:56:59.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4091 sec 2024-03-28T06:57:00.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4092 sec 2024-03-28T06:57:00.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:00 smithi086 ceph-mon[35163]: pgmap v2709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:00.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:00 smithi159 ceph-mon[36109]: pgmap v2709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:00.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:00 smithi055 ceph-mon[31863]: pgmap v2709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:01.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4093 sec 2024-03-28T06:57:02.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4094 sec 2024-03-28T06:57:02.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:02 smithi055 ceph-mon[31863]: pgmap v2710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:03.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:02 smithi086 ceph-mon[35163]: pgmap v2710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:03.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:02 smithi159 ceph-mon[36109]: pgmap v2710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:03.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4095 sec 2024-03-28T06:57:03.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3422.841341 secs 2024-03-28T06:57:04.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3422.841341 secs 2024-03-28T06:57:04.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3422.841341 secs 2024-03-28T06:57:04.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4096 sec 2024-03-28T06:57:04.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:04 smithi055 ceph-mon[31863]: pgmap v2711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:05.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:04 smithi086 ceph-mon[35163]: pgmap v2711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:05.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:04 smithi159 ceph-mon[36109]: pgmap v2711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:05.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4097 sec 2024-03-28T06:57:06.689 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4098 sec 2024-03-28T06:57:06.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:06 smithi055 ceph-mon[31863]: pgmap v2712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:07.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:06 smithi086 ceph-mon[35163]: pgmap v2712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:07.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:06 smithi159 ceph-mon[36109]: pgmap v2712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:07.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4099 sec 2024-03-28T06:57:08.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4100 sec 2024-03-28T06:57:08.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3427.841416 secs 2024-03-28T06:57:08.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:08 smithi055 ceph-mon[31863]: pgmap v2713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:57:09.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3427.841416 secs 2024-03-28T06:57:09.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:08 smithi086 ceph-mon[35163]: pgmap v2713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:57:09.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3427.841416 secs 2024-03-28T06:57:09.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:08 smithi159 ceph-mon[36109]: pgmap v2713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T06:57:09.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4101 sec 2024-03-28T06:57:10.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4102 sec 2024-03-28T06:57:10.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:10 smithi086 ceph-mon[35163]: pgmap v2714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:10.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:10 smithi055 ceph-mon[31863]: pgmap v2714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:11.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:10 smithi159 ceph-mon[36109]: pgmap v2714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:11.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4103 sec 2024-03-28T06:57:12.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4104 sec 2024-03-28T06:57:12.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:12 smithi055 ceph-mon[31863]: pgmap v2715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:13.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:12 smithi086 ceph-mon[35163]: pgmap v2715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:13.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:12 smithi159 ceph-mon[36109]: pgmap v2715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:13.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4105 sec 2024-03-28T06:57:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3432.841538 secs 2024-03-28T06:57:14.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3432.841538 secs 2024-03-28T06:57:14.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3432.841538 secs 2024-03-28T06:57:14.690 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4106 sec 2024-03-28T06:57:15.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:14 smithi086 ceph-mon[35163]: pgmap v2716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:15.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:14 smithi159 ceph-mon[36109]: pgmap v2716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:15.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:14 smithi055 ceph-mon[31863]: pgmap v2716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:15.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4107 sec 2024-03-28T06:57:16.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4108 sec 2024-03-28T06:57:17.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:16 smithi086 ceph-mon[35163]: pgmap v2717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:17.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:16 smithi159 ceph-mon[36109]: pgmap v2717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:17.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:16 smithi055 ceph-mon[31863]: pgmap v2717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:17.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4109 sec 2024-03-28T06:57:18.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4110 sec 2024-03-28T06:57:19.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3437.841658 secs 2024-03-28T06:57:19.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:18 smithi086 ceph-mon[35163]: pgmap v2718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:19.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3437.841658 secs 2024-03-28T06:57:19.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:18 smithi159 ceph-mon[36109]: pgmap v2718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:19.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3437.841658 secs 2024-03-28T06:57:19.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:18 smithi055 ceph-mon[31863]: pgmap v2718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:19.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4111 sec 2024-03-28T06:57:20.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4112 sec 2024-03-28T06:57:21.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:20 smithi086 ceph-mon[35163]: pgmap v2719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:21.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:20 smithi159 ceph-mon[36109]: pgmap v2719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:21.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:20 smithi055 ceph-mon[31863]: pgmap v2719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:21.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4113 sec 2024-03-28T06:57:22.691 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4114 sec 2024-03-28T06:57:23.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:22 smithi086 ceph-mon[35163]: pgmap v2720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:23.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:22 smithi159 ceph-mon[36109]: pgmap v2720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:23.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:22 smithi055 ceph-mon[31863]: pgmap v2720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:23.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4115 sec 2024-03-28T06:57:23.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3442.841805 secs 2024-03-28T06:57:24.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3442.841805 secs 2024-03-28T06:57:24.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3442.841805 secs 2024-03-28T06:57:24.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4116 sec 2024-03-28T06:57:25.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:24 smithi086 ceph-mon[35163]: pgmap v2721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:25.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:24 smithi159 ceph-mon[36109]: pgmap v2721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:25.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:24 smithi055 ceph-mon[31863]: pgmap v2721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:25.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4117 sec 2024-03-28T06:57:26.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:25 smithi086 ceph-mon[35163]: pgmap v2722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:26.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:25 smithi159 ceph-mon[36109]: pgmap v2722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:26.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:25 smithi055 ceph-mon[31863]: pgmap v2722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:57:26.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4118 sec 2024-03-28T06:57:27.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:57:27.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:57:27.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:57:27.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4119 sec 2024-03-28T06:57:28.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:27 smithi086 ceph-mon[35163]: pgmap v2723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:28.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:27 smithi159 ceph-mon[36109]: pgmap v2723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:28.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:28.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:27 smithi055 ceph-mon[31863]: pgmap v2723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:28.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4120 sec 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3447.841851 secs 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: pgmap v2724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: pgmap v2725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3447.841851 secs 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: pgmap v2724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: pgmap v2725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.325 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3447.841851 secs 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: pgmap v2724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: pgmap v2725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:29.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:57:29.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4121 sec 2024-03-28T06:57:30.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4122 sec 2024-03-28T06:57:31.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:31 smithi086 ceph-mon[35163]: pgmap v2726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:31.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:31 smithi159 ceph-mon[36109]: pgmap v2726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:31.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:31 smithi055 ceph-mon[31863]: pgmap v2726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:31.692 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4123 sec 2024-03-28T06:57:32.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4124 sec 2024-03-28T06:57:33.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:33 smithi055 ceph-mon[31863]: pgmap v2727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:33.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3452.841974 secs 2024-03-28T06:57:33.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4125 sec 2024-03-28T06:57:33.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:33 smithi086 ceph-mon[35163]: pgmap v2727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:33.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3452.841974 secs 2024-03-28T06:57:33.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:33 smithi159 ceph-mon[36109]: pgmap v2727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:33.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3452.841974 secs 2024-03-28T06:57:34.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4126 sec 2024-03-28T06:57:35.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:35 smithi055 ceph-mon[31863]: pgmap v2728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:57:35.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4127 sec 2024-03-28T06:57:35.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:35 smithi086 ceph-mon[35163]: pgmap v2728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:57:35.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:35 smithi159 ceph-mon[36109]: pgmap v2728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T06:57:36.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4128 sec 2024-03-28T06:57:37.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:37 smithi055 ceph-mon[31863]: pgmap v2729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:37.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4129 sec 2024-03-28T06:57:37.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:37 smithi086 ceph-mon[35163]: pgmap v2729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:37.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:37 smithi159 ceph-mon[36109]: pgmap v2729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T06:57:38.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3457.842003 secs 2024-03-28T06:57:38.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4130 sec 2024-03-28T06:57:38.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3457.842003 secs 2024-03-28T06:57:38.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3457.842003 secs 2024-03-28T06:57:39.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:39 smithi055 ceph-mon[31863]: pgmap v2730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:39.693 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4131 sec 2024-03-28T06:57:39.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:39 smithi086 ceph-mon[35163]: pgmap v2730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:39.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:39 smithi159 ceph-mon[36109]: pgmap v2730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:57:40.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4132 sec 2024-03-28T06:57:41.625 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:41 smithi086 ceph-mon[35163]: pgmap v2731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:41.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:41 smithi055 ceph-mon[31863]: pgmap v2731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:41.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4133 sec 2024-03-28T06:57:41.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:41 smithi159 ceph-mon[36109]: pgmap v2731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:42.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4134 sec 2024-03-28T06:57:43.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:43 smithi055 ceph-mon[31863]: pgmap v2732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:43.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3462.842124 secs 2024-03-28T06:57:43.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4135 sec 2024-03-28T06:57:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:43 smithi086 ceph-mon[35163]: pgmap v2732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3462.842124 secs 2024-03-28T06:57:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:43 smithi159 ceph-mon[36109]: pgmap v2732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3462.842124 secs 2024-03-28T06:57:44.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4136 sec 2024-03-28T06:57:45.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4137 sec 2024-03-28T06:57:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:45 smithi086 ceph-mon[35163]: pgmap v2733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:45.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:45 smithi159 ceph-mon[36109]: pgmap v2733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:45 smithi055 ceph-mon[31863]: pgmap v2733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:46.694 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4138 sec 2024-03-28T06:57:47.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4139 sec 2024-03-28T06:57:47.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:47 smithi086 ceph-mon[35163]: pgmap v2734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:47.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:47 smithi159 ceph-mon[36109]: pgmap v2734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:47.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:47 smithi055 ceph-mon[31863]: pgmap v2734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:48.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4140 sec 2024-03-28T06:57:48.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3467.842209 secs 2024-03-28T06:57:48.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3467.842209 secs 2024-03-28T06:57:48.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3467.842209 secs 2024-03-28T06:57:49.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4141 sec 2024-03-28T06:57:49.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:49 smithi086 ceph-mon[35163]: pgmap v2735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:49.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:49 smithi159 ceph-mon[36109]: pgmap v2735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:49.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:49 smithi055 ceph-mon[31863]: pgmap v2735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:50.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4142 sec 2024-03-28T06:57:51.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4143 sec 2024-03-28T06:57:51.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:51 smithi086 ceph-mon[35163]: pgmap v2736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:51.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:51 smithi159 ceph-mon[36109]: pgmap v2736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:51.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:51 smithi055 ceph-mon[31863]: pgmap v2736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:57:52.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4144 sec 2024-03-28T06:57:53.695 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4145 sec 2024-03-28T06:57:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:53 smithi086 ceph-mon[35163]: pgmap v2737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:53.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3472.842332 secs 2024-03-28T06:57:53.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:53 smithi159 ceph-mon[36109]: pgmap v2737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:53.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3472.842332 secs 2024-03-28T06:57:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:53 smithi055 ceph-mon[31863]: pgmap v2737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3472.842332 secs 2024-03-28T06:57:54.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4146 sec 2024-03-28T06:57:55.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4147 sec 2024-03-28T06:57:55.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:55 smithi086 ceph-mon[35163]: pgmap v2738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:55.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:55 smithi159 ceph-mon[36109]: pgmap v2738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:55.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:55 smithi055 ceph-mon[31863]: pgmap v2738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:56.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4148 sec 2024-03-28T06:57:57.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4149 sec 2024-03-28T06:57:57.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:57 smithi086 ceph-mon[35163]: pgmap v2739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:57.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:57 smithi159 ceph-mon[36109]: pgmap v2739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:57.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:57 smithi055 ceph-mon[31863]: pgmap v2739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:58.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4150 sec 2024-03-28T06:57:58.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3477.842411 secs 2024-03-28T06:57:58.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3477.842411 secs 2024-03-28T06:57:58.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3477.842411 secs 2024-03-28T06:57:59.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4151 sec 2024-03-28T06:57:59.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:57:59 smithi086 ceph-mon[35163]: pgmap v2740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:59.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:57:59 smithi159 ceph-mon[36109]: pgmap v2740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:57:59.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:57:59 smithi055 ceph-mon[31863]: pgmap v2740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:00.696 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4152 sec 2024-03-28T06:58:01.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4153 sec 2024-03-28T06:58:01.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:01 smithi086 ceph-mon[35163]: pgmap v2741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:01.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:01 smithi159 ceph-mon[36109]: pgmap v2741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:01.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:01 smithi055 ceph-mon[31863]: pgmap v2741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:02.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4154 sec 2024-03-28T06:58:03.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4155 sec 2024-03-28T06:58:03.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:03 smithi086 ceph-mon[35163]: pgmap v2742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:03.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3482.842491 secs 2024-03-28T06:58:03.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:03 smithi159 ceph-mon[36109]: pgmap v2742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:03.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3482.842491 secs 2024-03-28T06:58:03.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:03 smithi055 ceph-mon[31863]: pgmap v2742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:03.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3482.842491 secs 2024-03-28T06:58:04.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4156 sec 2024-03-28T06:58:05.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4157 sec 2024-03-28T06:58:05.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:05 smithi086 ceph-mon[35163]: pgmap v2743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:05.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:05 smithi159 ceph-mon[36109]: pgmap v2743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:05.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:05 smithi055 ceph-mon[31863]: pgmap v2743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:06.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4158 sec 2024-03-28T06:58:07.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4159 sec 2024-03-28T06:58:07.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:07 smithi086 ceph-mon[35163]: pgmap v2744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:07.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:07 smithi159 ceph-mon[36109]: pgmap v2744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:07.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:07 smithi055 ceph-mon[31863]: pgmap v2744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:08.697 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4160 sec 2024-03-28T06:58:08.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3487.842606 secs 2024-03-28T06:58:08.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3487.842606 secs 2024-03-28T06:58:08.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3487.842606 secs 2024-03-28T06:58:09.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4161 sec 2024-03-28T06:58:09.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:09 smithi086 ceph-mon[35163]: pgmap v2745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:09.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:09 smithi159 ceph-mon[36109]: pgmap v2745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:09.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:09 smithi055 ceph-mon[31863]: pgmap v2745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:10.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4162 sec 2024-03-28T06:58:11.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4163 sec 2024-03-28T06:58:11.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:11 smithi086 ceph-mon[35163]: pgmap v2746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:11.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:11 smithi159 ceph-mon[36109]: pgmap v2746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:11.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:11 smithi055 ceph-mon[31863]: pgmap v2746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:12.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4164 sec 2024-03-28T06:58:13.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4165 sec 2024-03-28T06:58:13.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:13 smithi086 ceph-mon[35163]: pgmap v2747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:13.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3492.842725 secs 2024-03-28T06:58:13.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:13 smithi159 ceph-mon[36109]: pgmap v2747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:13.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3492.842725 secs 2024-03-28T06:58:13.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:13 smithi055 ceph-mon[31863]: pgmap v2747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:13.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3492.842725 secs 2024-03-28T06:58:14.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4166 sec 2024-03-28T06:58:15.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4167 sec 2024-03-28T06:58:15.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:15 smithi086 ceph-mon[35163]: pgmap v2748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:15.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:15 smithi159 ceph-mon[36109]: pgmap v2748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:15.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:15 smithi055 ceph-mon[31863]: pgmap v2748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:16.698 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4168 sec 2024-03-28T06:58:17.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4169 sec 2024-03-28T06:58:17.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:17 smithi086 ceph-mon[35163]: pgmap v2749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:17.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:17 smithi159 ceph-mon[36109]: pgmap v2749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:17.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:17 smithi055 ceph-mon[31863]: pgmap v2749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:18.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4170 sec 2024-03-28T06:58:18.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3497.842841 secs 2024-03-28T06:58:18.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3497.842841 secs 2024-03-28T06:58:18.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3497.842841 secs 2024-03-28T06:58:19.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4171 sec 2024-03-28T06:58:19.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:19 smithi086 ceph-mon[35163]: pgmap v2750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:19.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:19 smithi159 ceph-mon[36109]: pgmap v2750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:19.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:19 smithi055 ceph-mon[31863]: pgmap v2750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:20.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4172 sec 2024-03-28T06:58:21.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4173 sec 2024-03-28T06:58:21.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:21 smithi086 ceph-mon[35163]: pgmap v2751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:21.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:21 smithi159 ceph-mon[36109]: pgmap v2751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:21.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:21 smithi055 ceph-mon[31863]: pgmap v2751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:22.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4174 sec 2024-03-28T06:58:23.699 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4175 sec 2024-03-28T06:58:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:23 smithi086 ceph-mon[35163]: pgmap v2752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3502.842915 secs 2024-03-28T06:58:23.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:23 smithi159 ceph-mon[36109]: pgmap v2752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:23.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3502.842915 secs 2024-03-28T06:58:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:23 smithi055 ceph-mon[31863]: pgmap v2752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3502.842915 secs 2024-03-28T06:58:24.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4176 sec 2024-03-28T06:58:25.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4177 sec 2024-03-28T06:58:25.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:25 smithi086 ceph-mon[35163]: pgmap v2753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:25.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:25 smithi159 ceph-mon[36109]: pgmap v2753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:25.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:25 smithi055 ceph-mon[31863]: pgmap v2753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:26.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4178 sec 2024-03-28T06:58:27.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4179 sec 2024-03-28T06:58:27.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:27 smithi086 ceph-mon[35163]: pgmap v2754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:27.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:27 smithi159 ceph-mon[36109]: pgmap v2754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:27.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:27 smithi055 ceph-mon[31863]: pgmap v2754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:28.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4180 sec 2024-03-28T06:58:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3507.842985 secs 2024-03-28T06:58:29.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3507.842985 secs 2024-03-28T06:58:29.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3507.842985 secs 2024-03-28T06:58:29.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4181 sec 2024-03-28T06:58:29.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:29 smithi055 ceph-mon[31863]: pgmap v2755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:29.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:58:29.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:29.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:29.942 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:29 smithi086 ceph-mon[35163]: pgmap v2755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:29.942 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:58:29.942 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:29.942 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:30.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:29 smithi159 ceph-mon[36109]: pgmap v2755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:30.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:58:30.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:30.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:30.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4182 sec 2024-03-28T06:58:31.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4183 sec 2024-03-28T06:58:31.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:31 smithi055 ceph-mon[31863]: pgmap v2756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:32.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:31 smithi086 ceph-mon[35163]: pgmap v2756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:32.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:31 smithi159 ceph-mon[36109]: pgmap v2756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:32.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4184 sec 2024-03-28T06:58:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:33.700 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4185 sec 2024-03-28T06:58:34.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: pgmap v2757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:34.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3512.843057 secs 2024-03-28T06:58:34.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: pgmap v2757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3512.843057 secs 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: pgmap v2757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3512.843057 secs 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:34.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4186 sec 2024-03-28T06:58:35.029 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:34 smithi055 ceph-mon[31863]: pgmap v2758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:35.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:34 smithi086 ceph-mon[35163]: pgmap v2758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:35.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:34 smithi159 ceph-mon[36109]: pgmap v2758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:35.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4187 sec 2024-03-28T06:58:36.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:58:36.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:58:36.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:35 smithi055 ceph-mon[31863]: pgmap v2759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:58:36.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:35 smithi055 ceph-mon[31863]: pgmap v2760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:36.057 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:36.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:58:36.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:58:36.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:35 smithi086 ceph-mon[35163]: pgmap v2759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:58:36.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:35 smithi086 ceph-mon[35163]: pgmap v2760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:36.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:36.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:58:36.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:58:36.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:35 smithi159 ceph-mon[36109]: pgmap v2759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T06:58:36.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:35 smithi159 ceph-mon[36109]: pgmap v2760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:36.075 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:58:36.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4188 sec 2024-03-28T06:58:37.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4189 sec 2024-03-28T06:58:38.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:37 smithi086 ceph-mon[35163]: pgmap v2761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:38.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:37 smithi159 ceph-mon[36109]: pgmap v2761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:38.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:37 smithi055 ceph-mon[31863]: pgmap v2761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:38.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4190 sec 2024-03-28T06:58:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3517.843178 secs 2024-03-28T06:58:39.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3517.843178 secs 2024-03-28T06:58:39.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3517.843178 secs 2024-03-28T06:58:39.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4191 sec 2024-03-28T06:58:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:39 smithi086 ceph-mon[35163]: pgmap v2762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:40.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:39 smithi159 ceph-mon[36109]: pgmap v2762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:40.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:39 smithi055 ceph-mon[31863]: pgmap v2762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:40.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4192 sec 2024-03-28T06:58:41.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4193 sec 2024-03-28T06:58:42.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:41 smithi086 ceph-mon[35163]: pgmap v2763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:42.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:41 smithi159 ceph-mon[36109]: pgmap v2763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:42.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:41 smithi055 ceph-mon[31863]: pgmap v2763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T06:58:42.701 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4194 sec 2024-03-28T06:58:43.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4195 sec 2024-03-28T06:58:44.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3522.843253 secs 2024-03-28T06:58:44.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:43 smithi086 ceph-mon[35163]: pgmap v2764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:44.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3522.843253 secs 2024-03-28T06:58:44.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:43 smithi159 ceph-mon[36109]: pgmap v2764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:44.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3522.843253 secs 2024-03-28T06:58:44.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:43 smithi055 ceph-mon[31863]: pgmap v2764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T06:58:44.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4196 sec 2024-03-28T06:58:45.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4197 sec 2024-03-28T06:58:46.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:45 smithi086 ceph-mon[35163]: pgmap v2765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:58:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:45 smithi159 ceph-mon[36109]: pgmap v2765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:58:46.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:45 smithi055 ceph-mon[31863]: pgmap v2765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:58:46.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4198 sec 2024-03-28T06:58:47.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4199 sec 2024-03-28T06:58:48.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:47 smithi086 ceph-mon[35163]: pgmap v2766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:48.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:47 smithi159 ceph-mon[36109]: pgmap v2766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:48.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:47 smithi055 ceph-mon[31863]: pgmap v2766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:48.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4200 sec 2024-03-28T06:58:49.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3527.843332 secs 2024-03-28T06:58:49.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3527.843332 secs 2024-03-28T06:58:49.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3527.843332 secs 2024-03-28T06:58:49.702 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4201 sec 2024-03-28T06:58:50.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:49 smithi086 ceph-mon[35163]: pgmap v2767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:50.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:49 smithi159 ceph-mon[36109]: pgmap v2767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:50.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:49 smithi055 ceph-mon[31863]: pgmap v2767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:50.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4202 sec 2024-03-28T06:58:51.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4203 sec 2024-03-28T06:58:52.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:51 smithi086 ceph-mon[35163]: pgmap v2768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:58:52.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:51 smithi159 ceph-mon[36109]: pgmap v2768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:58:52.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:51 smithi055 ceph-mon[31863]: pgmap v2768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:58:52.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4204 sec 2024-03-28T06:58:53.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4205 sec 2024-03-28T06:58:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3532.843454 secs 2024-03-28T06:58:53.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:53 smithi086 ceph-mon[35163]: pgmap v2769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:54.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3532.843454 secs 2024-03-28T06:58:54.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:53 smithi159 ceph-mon[36109]: pgmap v2769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:54.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3532.843454 secs 2024-03-28T06:58:54.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:53 smithi055 ceph-mon[31863]: pgmap v2769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:58:54.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4206 sec 2024-03-28T06:58:55.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4207 sec 2024-03-28T06:58:56.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:55 smithi086 ceph-mon[35163]: pgmap v2770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:56.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:55 smithi159 ceph-mon[36109]: pgmap v2770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:56.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:55 smithi055 ceph-mon[31863]: pgmap v2770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:56.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4208 sec 2024-03-28T06:58:57.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4209 sec 2024-03-28T06:58:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:57 smithi086 ceph-mon[35163]: pgmap v2771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:58.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:57 smithi159 ceph-mon[36109]: pgmap v2771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:58.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:57 smithi055 ceph-mon[31863]: pgmap v2771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:58:58.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4210 sec 2024-03-28T06:58:59.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3537.843575 secs 2024-03-28T06:58:59.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3537.843575 secs 2024-03-28T06:58:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3537.843575 secs 2024-03-28T06:58:59.703 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4211 sec 2024-03-28T06:59:00.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:58:59 smithi055 ceph-mon[31863]: pgmap v2772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:00.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:58:59 smithi086 ceph-mon[35163]: pgmap v2772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:00.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:58:59 smithi159 ceph-mon[36109]: pgmap v2772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:00.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4212 sec 2024-03-28T06:59:01.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4213 sec 2024-03-28T06:59:02.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:01 smithi055 ceph-mon[31863]: pgmap v2773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:02.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:01 smithi086 ceph-mon[35163]: pgmap v2773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:02.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:01 smithi159 ceph-mon[36109]: pgmap v2773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:02.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4214 sec 2024-03-28T06:59:03.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4215 sec 2024-03-28T06:59:04.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3542.843698 secs 2024-03-28T06:59:04.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:03 smithi055 ceph-mon[31863]: pgmap v2774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:04.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3542.843698 secs 2024-03-28T06:59:04.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:03 smithi086 ceph-mon[35163]: pgmap v2774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:04.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3542.843698 secs 2024-03-28T06:59:04.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:03 smithi159 ceph-mon[36109]: pgmap v2774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:04.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4216 sec 2024-03-28T06:59:05.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4217 sec 2024-03-28T06:59:06.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:05 smithi055 ceph-mon[31863]: pgmap v2775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:06.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:05 smithi086 ceph-mon[35163]: pgmap v2775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:06.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:05 smithi159 ceph-mon[36109]: pgmap v2775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:06.704 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4218 sec 2024-03-28T06:59:07.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4219 sec 2024-03-28T06:59:08.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:07 smithi055 ceph-mon[31863]: pgmap v2776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:07 smithi086 ceph-mon[35163]: pgmap v2776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:08.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:07 smithi159 ceph-mon[36109]: pgmap v2776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:08.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4220 sec 2024-03-28T06:59:09.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3547.843819 secs 2024-03-28T06:59:09.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3547.843819 secs 2024-03-28T06:59:09.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3547.843819 secs 2024-03-28T06:59:09.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4221 sec 2024-03-28T06:59:10.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:09 smithi086 ceph-mon[35163]: pgmap v2777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:10.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:09 smithi159 ceph-mon[36109]: pgmap v2777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:10.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:09 smithi055 ceph-mon[31863]: pgmap v2777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:10.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4222 sec 2024-03-28T06:59:11.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4223 sec 2024-03-28T06:59:12.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4224 sec 2024-03-28T06:59:12.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:12 smithi086 ceph-mon[35163]: pgmap v2778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:12.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:12 smithi159 ceph-mon[36109]: pgmap v2778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:12.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:12 smithi055 ceph-mon[31863]: pgmap v2778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:13.705 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4225 sec 2024-03-28T06:59:13.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3552.843940 secs 2024-03-28T06:59:13.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3552.843940 secs 2024-03-28T06:59:13.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3552.843940 secs 2024-03-28T06:59:14.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4226 sec 2024-03-28T06:59:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:14 smithi086 ceph-mon[35163]: pgmap v2779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:14.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:14 smithi159 ceph-mon[36109]: pgmap v2779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:14.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:14 smithi055 ceph-mon[31863]: pgmap v2779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:15.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4227 sec 2024-03-28T06:59:16.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4228 sec 2024-03-28T06:59:16.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:16 smithi086 ceph-mon[35163]: pgmap v2780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:16.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:16 smithi159 ceph-mon[36109]: pgmap v2780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:16.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:16 smithi055 ceph-mon[31863]: pgmap v2780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:17.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4229 sec 2024-03-28T06:59:18.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4230 sec 2024-03-28T06:59:18.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:18 smithi055 ceph-mon[31863]: pgmap v2781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:18.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3557.844053 secs 2024-03-28T06:59:19.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:18 smithi086 ceph-mon[35163]: pgmap v2781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:19.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3557.844053 secs 2024-03-28T06:59:19.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:18 smithi159 ceph-mon[36109]: pgmap v2781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:19.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3557.844053 secs 2024-03-28T06:59:19.706 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4231 sec 2024-03-28T06:59:20.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4232 sec 2024-03-28T06:59:20.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:20 smithi055 ceph-mon[31863]: pgmap v2782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:21.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:20 smithi086 ceph-mon[35163]: pgmap v2782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:21.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:20 smithi159 ceph-mon[36109]: pgmap v2782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:21.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4233 sec 2024-03-28T06:59:22.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4234 sec 2024-03-28T06:59:22.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:22 smithi055 ceph-mon[31863]: pgmap v2783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:23.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:22 smithi086 ceph-mon[35163]: pgmap v2783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:23.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:22 smithi159 ceph-mon[36109]: pgmap v2783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:23.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4235 sec 2024-03-28T06:59:23.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3562.844170 secs 2024-03-28T06:59:23.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3562.844170 secs 2024-03-28T06:59:24.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3562.844170 secs 2024-03-28T06:59:24.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4236 sec 2024-03-28T06:59:24.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:24 smithi055 ceph-mon[31863]: pgmap v2784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:25.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:24 smithi086 ceph-mon[35163]: pgmap v2784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:25.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:24 smithi159 ceph-mon[36109]: pgmap v2784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:25.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4237 sec 2024-03-28T06:59:26.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4238 sec 2024-03-28T06:59:26.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:26 smithi055 ceph-mon[31863]: pgmap v2785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:27.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:26 smithi086 ceph-mon[35163]: pgmap v2785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:27.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:26 smithi159 ceph-mon[36109]: pgmap v2785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:27.707 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4239 sec 2024-03-28T06:59:28.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4240 sec 2024-03-28T06:59:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:28 smithi055 ceph-mon[31863]: pgmap v2786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:28.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3567.844287 secs 2024-03-28T06:59:29.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:28 smithi086 ceph-mon[35163]: pgmap v2786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:29.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3567.844287 secs 2024-03-28T06:59:29.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:28 smithi159 ceph-mon[36109]: pgmap v2786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:29.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3567.844287 secs 2024-03-28T06:59:29.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4241 sec 2024-03-28T06:59:30.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4242 sec 2024-03-28T06:59:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:30 smithi086 ceph-mon[35163]: pgmap v2787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:31.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:30 smithi159 ceph-mon[36109]: pgmap v2787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:31.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:30 smithi055 ceph-mon[31863]: pgmap v2787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:31.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4243 sec 2024-03-28T06:59:32.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4244 sec 2024-03-28T06:59:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:32 smithi086 ceph-mon[35163]: pgmap v2788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:33.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:32 smithi159 ceph-mon[36109]: pgmap v2788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:33.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:32 smithi055 ceph-mon[31863]: pgmap v2788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:33.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4245 sec 2024-03-28T06:59:34.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3572.844370 secs 2024-03-28T06:59:34.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3572.844370 secs 2024-03-28T06:59:34.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3572.844370 secs 2024-03-28T06:59:34.708 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4246 sec 2024-03-28T06:59:35.029 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:34 smithi055 ceph-mon[31863]: pgmap v2789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:35.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:34 smithi086 ceph-mon[35163]: pgmap v2789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:35.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:34 smithi159 ceph-mon[36109]: pgmap v2789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:35.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4247 sec 2024-03-28T06:59:36.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:59:36.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:59:36.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T06:59:36.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4248 sec 2024-03-28T06:59:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:36 smithi086 ceph-mon[35163]: pgmap v2790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:59:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:59:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:59:37.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:36 smithi159 ceph-mon[36109]: pgmap v2790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:37.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:59:37.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:59:37.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:59:37.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:36 smithi055 ceph-mon[31863]: pgmap v2790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:37.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T06:59:37.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T06:59:37.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T06:59:37.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4249 sec 2024-03-28T06:59:38.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:37 smithi086 ceph-mon[35163]: pgmap v2791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:37 smithi086 ceph-mon[35163]: pgmap v2792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:37 smithi159 ceph-mon[36109]: pgmap v2791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:37 smithi159 ceph-mon[36109]: pgmap v2792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:37 smithi055 ceph-mon[31863]: pgmap v2791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:37 smithi055 ceph-mon[31863]: pgmap v2792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:38.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4250 sec 2024-03-28T06:59:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3577.844451 secs 2024-03-28T06:59:39.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3577.844451 secs 2024-03-28T06:59:39.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3577.844451 secs 2024-03-28T06:59:39.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4251 sec 2024-03-28T06:59:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:39 smithi086 ceph-mon[35163]: pgmap v2793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:40.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:39 smithi159 ceph-mon[36109]: pgmap v2793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:40.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:39 smithi055 ceph-mon[31863]: pgmap v2793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:40.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4252 sec 2024-03-28T06:59:41.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:40 smithi086 ceph-mon[35163]: pgmap v2794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:41.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:40 smithi159 ceph-mon[36109]: pgmap v2794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:41.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:40 smithi055 ceph-mon[31863]: pgmap v2794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:41.709 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4253 sec 2024-03-28T06:59:42.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4254 sec 2024-03-28T06:59:43.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4255 sec 2024-03-28T06:59:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3582.844542 secs 2024-03-28T06:59:43.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:43 smithi086 ceph-mon[35163]: pgmap v2795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3582.844542 secs 2024-03-28T06:59:43.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:43 smithi159 ceph-mon[36109]: pgmap v2795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:43.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3582.844542 secs 2024-03-28T06:59:43.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:43 smithi055 ceph-mon[31863]: pgmap v2795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:44.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4256 sec 2024-03-28T06:59:45.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4257 sec 2024-03-28T06:59:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:45 smithi086 ceph-mon[35163]: pgmap v2796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:45.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:45 smithi159 ceph-mon[36109]: pgmap v2796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:45.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:45 smithi055 ceph-mon[31863]: pgmap v2796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:46.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4258 sec 2024-03-28T06:59:47.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4259 sec 2024-03-28T06:59:47.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:47 smithi086 ceph-mon[35163]: pgmap v2797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:59:47.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:47 smithi159 ceph-mon[36109]: pgmap v2797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:59:47.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:47 smithi055 ceph-mon[31863]: pgmap v2797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T06:59:48.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4260 sec 2024-03-28T06:59:48.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3587.844559 secs 2024-03-28T06:59:48.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3587.844559 secs 2024-03-28T06:59:49.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3587.844559 secs 2024-03-28T06:59:49.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4261 sec 2024-03-28T06:59:49.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:49 smithi055 ceph-mon[31863]: pgmap v2798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:50.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:49 smithi086 ceph-mon[35163]: pgmap v2798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:50.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:49 smithi159 ceph-mon[36109]: pgmap v2798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:50.710 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4262 sec 2024-03-28T06:59:51.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4263 sec 2024-03-28T06:59:51.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:51 smithi055 ceph-mon[31863]: pgmap v2799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:51 smithi086 ceph-mon[35163]: pgmap v2799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:52.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:51 smithi159 ceph-mon[36109]: pgmap v2799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T06:59:52.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4264 sec 2024-03-28T06:59:53.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4265 sec 2024-03-28T06:59:53.876 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3592.844632 secs 2024-03-28T06:59:53.877 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:53 smithi159 ceph-mon[36109]: pgmap v2800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3592.844632 secs 2024-03-28T06:59:53.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:53 smithi055 ceph-mon[31863]: pgmap v2800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:54.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3592.844632 secs 2024-03-28T06:59:54.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:53 smithi086 ceph-mon[35163]: pgmap v2800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T06:59:54.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4266 sec 2024-03-28T06:59:55.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4267 sec 2024-03-28T06:59:55.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:55 smithi055 ceph-mon[31863]: pgmap v2801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:55 smithi086 ceph-mon[35163]: pgmap v2801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:56.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:55 smithi159 ceph-mon[36109]: pgmap v2801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:56.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4268 sec 2024-03-28T06:59:57.711 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4269 sec 2024-03-28T06:59:57.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:57 smithi055 ceph-mon[31863]: pgmap v2802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:58.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:57 smithi086 ceph-mon[35163]: pgmap v2802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:58.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:57 smithi159 ceph-mon[36109]: pgmap v2802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T06:59:58.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4270 sec 2024-03-28T06:59:58.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3597.844751 secs 2024-03-28T06:59:59.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3597.844751 secs 2024-03-28T06:59:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3597.844751 secs 2024-03-28T06:59:59.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4271 sec 2024-03-28T06:59:59.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 06:59:59 smithi055 ceph-mon[31863]: pgmap v2803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:00.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 06:59:59 smithi086 ceph-mon[35163]: pgmap v2803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:00.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 06:59:59 smithi159 ceph-mon[36109]: pgmap v2803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:00.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4272 sec 2024-03-28T07:00:01.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:00:01.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:00:01.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:00:01.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4273 sec 2024-03-28T07:00:02.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:01 smithi086 ceph-mon[35163]: pgmap v2804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:02.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:01 smithi159 ceph-mon[36109]: pgmap v2804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:01 smithi055 ceph-mon[31863]: pgmap v2804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:02.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4274 sec 2024-03-28T07:00:03.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4275 sec 2024-03-28T07:00:04.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3602.844813 secs 2024-03-28T07:00:04.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:03 smithi086 ceph-mon[35163]: pgmap v2805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:04.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3602.844813 secs 2024-03-28T07:00:04.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:03 smithi159 ceph-mon[36109]: pgmap v2805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:04.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3602.844813 secs 2024-03-28T07:00:04.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:03 smithi055 ceph-mon[31863]: pgmap v2805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:04.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4276 sec 2024-03-28T07:00:05.712 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4277 sec 2024-03-28T07:00:05.930 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:05 smithi055 ceph-mon[31863]: pgmap v2806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:05 smithi086 ceph-mon[35163]: pgmap v2806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:06.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:05 smithi159 ceph-mon[36109]: pgmap v2806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:06.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4278 sec 2024-03-28T07:00:07.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4279 sec 2024-03-28T07:00:08.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:07 smithi086 ceph-mon[35163]: pgmap v2807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:07 smithi159 ceph-mon[36109]: pgmap v2807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:08.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:07 smithi055 ceph-mon[31863]: pgmap v2807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:08.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4280 sec 2024-03-28T07:00:09.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3607.844876 secs 2024-03-28T07:00:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3607.844876 secs 2024-03-28T07:00:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3607.844876 secs 2024-03-28T07:00:09.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4281 sec 2024-03-28T07:00:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:09 smithi086 ceph-mon[35163]: pgmap v2808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:10.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:09 smithi159 ceph-mon[36109]: pgmap v2808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:10.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:09 smithi055 ceph-mon[31863]: pgmap v2808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:10.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4282 sec 2024-03-28T07:00:11.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4283 sec 2024-03-28T07:00:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:11 smithi086 ceph-mon[35163]: pgmap v2809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:12.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:11 smithi159 ceph-mon[36109]: pgmap v2809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:12.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:11 smithi055 ceph-mon[31863]: pgmap v2809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:12.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4284 sec 2024-03-28T07:00:13.713 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4285 sec 2024-03-28T07:00:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3612.844944 secs 2024-03-28T07:00:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:13 smithi086 ceph-mon[35163]: pgmap v2810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:14.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3612.844944 secs 2024-03-28T07:00:14.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:13 smithi159 ceph-mon[36109]: pgmap v2810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3612.844944 secs 2024-03-28T07:00:14.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:13 smithi055 ceph-mon[31863]: pgmap v2810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:14.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4286 sec 2024-03-28T07:00:15.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4287 sec 2024-03-28T07:00:16.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:15 smithi086 ceph-mon[35163]: pgmap v2811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:16.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:15 smithi159 ceph-mon[36109]: pgmap v2811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:16.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:15 smithi055 ceph-mon[31863]: pgmap v2811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:16.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4288 sec 2024-03-28T07:00:17.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4289 sec 2024-03-28T07:00:18.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:17 smithi086 ceph-mon[35163]: pgmap v2812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:18.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:17 smithi159 ceph-mon[36109]: pgmap v2812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:18.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:17 smithi055 ceph-mon[31863]: pgmap v2812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:18.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4290 sec 2024-03-28T07:00:19.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3617.845004 secs 2024-03-28T07:00:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3617.845004 secs 2024-03-28T07:00:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3617.845004 secs 2024-03-28T07:00:19.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4291 sec 2024-03-28T07:00:20.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:19 smithi086 ceph-mon[35163]: pgmap v2813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:20.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:19 smithi159 ceph-mon[36109]: pgmap v2813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:20.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:19 smithi055 ceph-mon[31863]: pgmap v2813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:20.714 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4292 sec 2024-03-28T07:00:21.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:20 smithi086 ceph-mon[35163]: pgmap v2814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:21.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:20 smithi159 ceph-mon[36109]: pgmap v2814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:21.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:20 smithi055 ceph-mon[31863]: pgmap v2814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:21.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4293 sec 2024-03-28T07:00:22.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4294 sec 2024-03-28T07:00:23.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4295 sec 2024-03-28T07:00:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3622.845097 secs 2024-03-28T07:00:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:23 smithi086 ceph-mon[35163]: pgmap v2815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3622.845097 secs 2024-03-28T07:00:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:23 smithi159 ceph-mon[36109]: pgmap v2815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3622.845097 secs 2024-03-28T07:00:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:23 smithi055 ceph-mon[31863]: pgmap v2815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:24.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4296 sec 2024-03-28T07:00:25.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4297 sec 2024-03-28T07:00:25.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:25 smithi055 ceph-mon[31863]: pgmap v2816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:25 smithi086 ceph-mon[35163]: pgmap v2816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:26.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:25 smithi159 ceph-mon[36109]: pgmap v2816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:26.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4298 sec 2024-03-28T07:00:27.715 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4299 sec 2024-03-28T07:00:27.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:27 smithi055 ceph-mon[31863]: pgmap v2817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:28.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:27 smithi086 ceph-mon[35163]: pgmap v2817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:28.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:27 smithi159 ceph-mon[36109]: pgmap v2817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:28.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4300 sec 2024-03-28T07:00:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3627.845176 secs 2024-03-28T07:00:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3627.845176 secs 2024-03-28T07:00:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3627.845176 secs 2024-03-28T07:00:29.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4301 sec 2024-03-28T07:00:29.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:29 smithi055 ceph-mon[31863]: pgmap v2818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:29 smithi086 ceph-mon[35163]: pgmap v2818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:30.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:29 smithi159 ceph-mon[36109]: pgmap v2818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:30.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4302 sec 2024-03-28T07:00:31.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4303 sec 2024-03-28T07:00:31.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:31 smithi055 ceph-mon[31863]: pgmap v2819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:31 smithi086 ceph-mon[35163]: pgmap v2819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:32.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:31 smithi159 ceph-mon[36109]: pgmap v2819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:00:32.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4304 sec 2024-03-28T07:00:33.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4305 sec 2024-03-28T07:00:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3632.845265 secs 2024-03-28T07:00:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:33 smithi055 ceph-mon[31863]: pgmap v2820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:34.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3632.845265 secs 2024-03-28T07:00:34.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:33 smithi086 ceph-mon[35163]: pgmap v2820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3632.845265 secs 2024-03-28T07:00:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:33 smithi159 ceph-mon[36109]: pgmap v2820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:00:34.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4306 sec 2024-03-28T07:00:35.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4307 sec 2024-03-28T07:00:35.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:35 smithi055 ceph-mon[31863]: pgmap v2821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:35 smithi086 ceph-mon[35163]: pgmap v2821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:36.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:35 smithi159 ceph-mon[36109]: pgmap v2821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:36.716 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4308 sec 2024-03-28T07:00:37.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4309 sec 2024-03-28T07:00:38.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:37 smithi086 ceph-mon[35163]: pgmap v2822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:38.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:00:38.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:37 smithi159 ceph-mon[36109]: pgmap v2822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:38.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:00:38.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:37 smithi055 ceph-mon[31863]: pgmap v2822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:38.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:00:38.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4310 sec 2024-03-28T07:00:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3637.845332 secs 2024-03-28T07:00:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:00:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:00:39.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:00:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3637.845332 secs 2024-03-28T07:00:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:00:39.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:00:39.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:00:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3637.845332 secs 2024-03-28T07:00:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:00:39.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:00:39.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:00:39.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4311 sec 2024-03-28T07:00:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:39 smithi086 ceph-mon[35163]: pgmap v2823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:39 smithi086 ceph-mon[35163]: pgmap v2824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:39 smithi159 ceph-mon[36109]: pgmap v2823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:39 smithi159 ceph-mon[36109]: pgmap v2824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:39 smithi055 ceph-mon[31863]: pgmap v2823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:39 smithi055 ceph-mon[31863]: pgmap v2824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:40.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4312 sec 2024-03-28T07:00:41.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4313 sec 2024-03-28T07:00:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:41 smithi086 ceph-mon[35163]: pgmap v2825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:00:42.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:41 smithi159 ceph-mon[36109]: pgmap v2825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:00:42.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:41 smithi055 ceph-mon[31863]: pgmap v2825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:00:42.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4314 sec 2024-03-28T07:00:43.717 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4315 sec 2024-03-28T07:00:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:43 smithi086 ceph-mon[35163]: pgmap v2826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3642.845411 secs 2024-03-28T07:00:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:43 smithi159 ceph-mon[36109]: pgmap v2826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:44.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3642.845411 secs 2024-03-28T07:00:44.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:43 smithi055 ceph-mon[31863]: pgmap v2826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:44.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3642.845411 secs 2024-03-28T07:00:44.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4316 sec 2024-03-28T07:00:45.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4317 sec 2024-03-28T07:00:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:45 smithi086 ceph-mon[35163]: pgmap v2827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:45 smithi159 ceph-mon[36109]: pgmap v2827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:46.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:45 smithi055 ceph-mon[31863]: pgmap v2827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:46.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4318 sec 2024-03-28T07:00:47.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4319 sec 2024-03-28T07:00:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:47 smithi086 ceph-mon[35163]: pgmap v2828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:00:48.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:47 smithi159 ceph-mon[36109]: pgmap v2828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:00:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:47 smithi055 ceph-mon[31863]: pgmap v2828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:00:48.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4320 sec 2024-03-28T07:00:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3647.845471 secs 2024-03-28T07:00:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3647.845471 secs 2024-03-28T07:00:49.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3647.845471 secs 2024-03-28T07:00:49.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4321 sec 2024-03-28T07:00:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:49 smithi086 ceph-mon[35163]: pgmap v2829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:00:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:49 smithi159 ceph-mon[36109]: pgmap v2829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:00:50.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:49 smithi055 ceph-mon[31863]: pgmap v2829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:00:50.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4322 sec 2024-03-28T07:00:51.718 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4323 sec 2024-03-28T07:00:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:51 smithi086 ceph-mon[35163]: pgmap v2830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:00:52.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:51 smithi159 ceph-mon[36109]: pgmap v2830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:00:52.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:51 smithi055 ceph-mon[31863]: pgmap v2830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:00:52.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4324 sec 2024-03-28T07:00:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:52 smithi086 ceph-mon[35163]: pgmap v2831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:53.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:52 smithi159 ceph-mon[36109]: pgmap v2831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:53.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:52 smithi055 ceph-mon[31863]: pgmap v2831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:53.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4325 sec 2024-03-28T07:00:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3652.845586 secs 2024-03-28T07:00:54.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3652.845586 secs 2024-03-28T07:00:54.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3652.845586 secs 2024-03-28T07:00:54.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4326 sec 2024-03-28T07:00:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:54 smithi086 ceph-mon[35163]: pgmap v2832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:55.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:54 smithi159 ceph-mon[36109]: pgmap v2832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:55.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:54 smithi055 ceph-mon[31863]: pgmap v2832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:55.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4327 sec 2024-03-28T07:00:56.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4328 sec 2024-03-28T07:00:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:57 smithi086 ceph-mon[35163]: pgmap v2833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:57.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:57 smithi159 ceph-mon[36109]: pgmap v2833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:57.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:57 smithi055 ceph-mon[31863]: pgmap v2833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:00:57.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4329 sec 2024-03-28T07:00:58.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3657.845706 secs 2024-03-28T07:00:58.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4330 sec 2024-03-28T07:00:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3657.845706 secs 2024-03-28T07:00:58.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3657.845706 secs 2024-03-28T07:00:59.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:00:59 smithi055 ceph-mon[31863]: pgmap v2834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:59.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4331 sec 2024-03-28T07:00:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:00:59 smithi086 ceph-mon[35163]: pgmap v2834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:00:59.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:00:59 smithi159 ceph-mon[36109]: pgmap v2834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:00.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4332 sec 2024-03-28T07:01:01.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:01 smithi055 ceph-mon[31863]: pgmap v2835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:01.719 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4333 sec 2024-03-28T07:01:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:01 smithi086 ceph-mon[35163]: pgmap v2835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:01.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:01 smithi159 ceph-mon[36109]: pgmap v2835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:02.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4334 sec 2024-03-28T07:01:03.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:03 smithi055 ceph-mon[31863]: pgmap v2836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:03.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3662.845773 secs 2024-03-28T07:01:03.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4335 sec 2024-03-28T07:01:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:03 smithi086 ceph-mon[35163]: pgmap v2836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3662.845773 secs 2024-03-28T07:01:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:03 smithi159 ceph-mon[36109]: pgmap v2836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3662.845773 secs 2024-03-28T07:01:04.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4336 sec 2024-03-28T07:01:05.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:05 smithi055 ceph-mon[31863]: pgmap v2837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:05.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4337 sec 2024-03-28T07:01:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:05 smithi086 ceph-mon[35163]: pgmap v2837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:05.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:05 smithi159 ceph-mon[36109]: pgmap v2837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:06.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4338 sec 2024-03-28T07:01:07.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:07 smithi055 ceph-mon[31863]: pgmap v2838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:07.720 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4339 sec 2024-03-28T07:01:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:07 smithi086 ceph-mon[35163]: pgmap v2838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:07.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:07 smithi159 ceph-mon[36109]: pgmap v2838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:08.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4340 sec 2024-03-28T07:01:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3667.845837 secs 2024-03-28T07:01:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3667.845837 secs 2024-03-28T07:01:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3667.845837 secs 2024-03-28T07:01:09.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4341 sec 2024-03-28T07:01:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:09 smithi086 ceph-mon[35163]: pgmap v2839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:09.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:09 smithi159 ceph-mon[36109]: pgmap v2839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:09.878 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:09 smithi055 ceph-mon[31863]: pgmap v2839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:10.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4342 sec 2024-03-28T07:01:11.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4343 sec 2024-03-28T07:01:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:11 smithi086 ceph-mon[35163]: pgmap v2840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:11.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:11 smithi159 ceph-mon[36109]: pgmap v2840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:11.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:11 smithi055 ceph-mon[31863]: pgmap v2840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:12.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4344 sec 2024-03-28T07:01:13.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4345 sec 2024-03-28T07:01:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:13 smithi086 ceph-mon[35163]: pgmap v2841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3672.845902 secs 2024-03-28T07:01:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:13 smithi159 ceph-mon[36109]: pgmap v2841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3672.845902 secs 2024-03-28T07:01:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:13 smithi055 ceph-mon[31863]: pgmap v2841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3672.845902 secs 2024-03-28T07:01:14.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4346 sec 2024-03-28T07:01:15.721 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4347 sec 2024-03-28T07:01:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:15 smithi086 ceph-mon[35163]: pgmap v2842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:15.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:15 smithi159 ceph-mon[36109]: pgmap v2842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:15.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:15 smithi055 ceph-mon[31863]: pgmap v2842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:16.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4348 sec 2024-03-28T07:01:17.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4349 sec 2024-03-28T07:01:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:17 smithi086 ceph-mon[35163]: pgmap v2843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:17.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:17 smithi159 ceph-mon[36109]: pgmap v2843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:17.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:17 smithi055 ceph-mon[31863]: pgmap v2843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:18.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4350 sec 2024-03-28T07:01:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3677.845975 secs 2024-03-28T07:01:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3677.845975 secs 2024-03-28T07:01:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3677.845975 secs 2024-03-28T07:01:19.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4351 sec 2024-03-28T07:01:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:19 smithi086 ceph-mon[35163]: pgmap v2844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:19.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:19 smithi159 ceph-mon[36109]: pgmap v2844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:19.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:19 smithi055 ceph-mon[31863]: pgmap v2844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:20.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4352 sec 2024-03-28T07:01:21.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4353 sec 2024-03-28T07:01:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:21 smithi086 ceph-mon[35163]: pgmap v2845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:21.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:21 smithi159 ceph-mon[36109]: pgmap v2845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:21.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:21 smithi055 ceph-mon[31863]: pgmap v2845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:22.722 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4354 sec 2024-03-28T07:01:23.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4355 sec 2024-03-28T07:01:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:23 smithi086 ceph-mon[35163]: pgmap v2846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3682.846048 secs 2024-03-28T07:01:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:23 smithi159 ceph-mon[36109]: pgmap v2846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3682.846048 secs 2024-03-28T07:01:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:23 smithi055 ceph-mon[31863]: pgmap v2846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3682.846048 secs 2024-03-28T07:01:24.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4356 sec 2024-03-28T07:01:25.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4357 sec 2024-03-28T07:01:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:25 smithi086 ceph-mon[35163]: pgmap v2847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:25.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:25 smithi159 ceph-mon[36109]: pgmap v2847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:25.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:25 smithi055 ceph-mon[31863]: pgmap v2847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:26.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4358 sec 2024-03-28T07:01:27.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4359 sec 2024-03-28T07:01:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:27 smithi086 ceph-mon[35163]: pgmap v2848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:27.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:27 smithi159 ceph-mon[36109]: pgmap v2848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:27.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:27 smithi055 ceph-mon[31863]: pgmap v2848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:28.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4360 sec 2024-03-28T07:01:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3687.846140 secs 2024-03-28T07:01:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3687.846140 secs 2024-03-28T07:01:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3687.846140 secs 2024-03-28T07:01:29.723 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4361 sec 2024-03-28T07:01:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:29 smithi086 ceph-mon[35163]: pgmap v2849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:29.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:29 smithi159 ceph-mon[36109]: pgmap v2849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:29.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:29 smithi055 ceph-mon[31863]: pgmap v2849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:30.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4362 sec 2024-03-28T07:01:31.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4363 sec 2024-03-28T07:01:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:31 smithi086 ceph-mon[35163]: pgmap v2850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:31.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:31 smithi159 ceph-mon[36109]: pgmap v2850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:31.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:31 smithi055 ceph-mon[31863]: pgmap v2850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:32.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4364 sec 2024-03-28T07:01:33.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4365 sec 2024-03-28T07:01:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:33 smithi086 ceph-mon[35163]: pgmap v2851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3692.846264 secs 2024-03-28T07:01:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:33 smithi159 ceph-mon[36109]: pgmap v2851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3692.846264 secs 2024-03-28T07:01:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:33 smithi055 ceph-mon[31863]: pgmap v2851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3692.846264 secs 2024-03-28T07:01:34.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4366 sec 2024-03-28T07:01:35.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4367 sec 2024-03-28T07:01:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:35 smithi086 ceph-mon[35163]: pgmap v2852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:35.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:35 smithi159 ceph-mon[36109]: pgmap v2852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:35.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:35 smithi055 ceph-mon[31863]: pgmap v2852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:36.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4368 sec 2024-03-28T07:01:37.724 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4369 sec 2024-03-28T07:01:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:37 smithi086 ceph-mon[35163]: pgmap v2853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:37.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:37 smithi159 ceph-mon[36109]: pgmap v2853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:37.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:37 smithi055 ceph-mon[31863]: pgmap v2853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:38.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4370 sec 2024-03-28T07:01:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3697.846382 secs 2024-03-28T07:01:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3697.846382 secs 2024-03-28T07:01:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3697.846382 secs 2024-03-28T07:01:39.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4371 sec 2024-03-28T07:01:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:39 smithi086 ceph-mon[35163]: pgmap v2854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:01:39.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:39 smithi159 ceph-mon[36109]: pgmap v2854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:39.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:01:39.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:39 smithi055 ceph-mon[31863]: pgmap v2854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:39.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:01:40.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4372 sec 2024-03-28T07:01:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:01:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:01:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:01:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:01:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:01:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:01:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:01:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:01:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:01:41.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4373 sec 2024-03-28T07:01:41.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:41 smithi055 ceph-mon[31863]: pgmap v2855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:41.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:41 smithi055 ceph-mon[31863]: pgmap v2856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:41 smithi086 ceph-mon[35163]: pgmap v2855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:41 smithi086 ceph-mon[35163]: pgmap v2856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:42.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:41 smithi159 ceph-mon[36109]: pgmap v2855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:01:42.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:41 smithi159 ceph-mon[36109]: pgmap v2856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:42.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4374 sec 2024-03-28T07:01:43.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4375 sec 2024-03-28T07:01:43.874 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:43 smithi086 ceph-mon[35163]: pgmap v2857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:43.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3702.846444 secs 2024-03-28T07:01:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:43 smithi055 ceph-mon[31863]: pgmap v2857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3702.846444 secs 2024-03-28T07:01:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:43 smithi159 ceph-mon[36109]: pgmap v2857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3702.846444 secs 2024-03-28T07:01:44.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4376 sec 2024-03-28T07:01:45.725 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4377 sec 2024-03-28T07:01:45.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:45 smithi055 ceph-mon[31863]: pgmap v2858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:45 smithi086 ceph-mon[35163]: pgmap v2858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:45 smithi159 ceph-mon[36109]: pgmap v2858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:46.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4378 sec 2024-03-28T07:01:47.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4379 sec 2024-03-28T07:01:47.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:47 smithi055 ceph-mon[31863]: pgmap v2859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:47 smithi086 ceph-mon[35163]: pgmap v2859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:48.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:47 smithi159 ceph-mon[36109]: pgmap v2859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:48.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4380 sec 2024-03-28T07:01:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3707.846506 secs 2024-03-28T07:01:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3707.846506 secs 2024-03-28T07:01:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3707.846506 secs 2024-03-28T07:01:49.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4381 sec 2024-03-28T07:01:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:49 smithi086 ceph-mon[35163]: pgmap v2860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:49 smithi159 ceph-mon[36109]: pgmap v2860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:50.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:49 smithi055 ceph-mon[31863]: pgmap v2860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:50.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4382 sec 2024-03-28T07:01:51.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4383 sec 2024-03-28T07:01:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:51 smithi086 ceph-mon[35163]: pgmap v2861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:01:52.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:51 smithi159 ceph-mon[36109]: pgmap v2861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:01:52.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:51 smithi055 ceph-mon[31863]: pgmap v2861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:01:52.726 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4384 sec 2024-03-28T07:01:53.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4385 sec 2024-03-28T07:01:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:53 smithi086 ceph-mon[35163]: pgmap v2862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3712.846629 secs 2024-03-28T07:01:54.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:53 smithi159 ceph-mon[36109]: pgmap v2862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:54.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3712.846629 secs 2024-03-28T07:01:54.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:53 smithi055 ceph-mon[31863]: pgmap v2862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:54.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3712.846629 secs 2024-03-28T07:01:54.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4386 sec 2024-03-28T07:01:55.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4387 sec 2024-03-28T07:01:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:55 smithi086 ceph-mon[35163]: pgmap v2863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:56.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:55 smithi159 ceph-mon[36109]: pgmap v2863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:56.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:55 smithi055 ceph-mon[31863]: pgmap v2863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:56.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4388 sec 2024-03-28T07:01:57.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4389 sec 2024-03-28T07:01:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:57 smithi086 ceph-mon[35163]: pgmap v2864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:58.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:57 smithi159 ceph-mon[36109]: pgmap v2864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:58.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:57 smithi055 ceph-mon[31863]: pgmap v2864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:01:58.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4390 sec 2024-03-28T07:01:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3717.846712 secs 2024-03-28T07:01:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3717.846712 secs 2024-03-28T07:01:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3717.846712 secs 2024-03-28T07:01:59.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4391 sec 2024-03-28T07:02:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:01:59 smithi086 ceph-mon[35163]: pgmap v2865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:00.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:01:59 smithi159 ceph-mon[36109]: pgmap v2865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:00.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:01:59 smithi055 ceph-mon[31863]: pgmap v2865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:00.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4392 sec 2024-03-28T07:02:01.727 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4393 sec 2024-03-28T07:02:02.015 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:01 smithi159 ceph-mon[36109]: pgmap v2866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:01 smithi086 ceph-mon[35163]: pgmap v2866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:02.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:01 smithi055 ceph-mon[31863]: pgmap v2866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:02.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4394 sec 2024-03-28T07:02:03.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4395 sec 2024-03-28T07:02:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:03 smithi086 ceph-mon[35163]: pgmap v2867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3722.846828 secs 2024-03-28T07:02:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:03 smithi159 ceph-mon[36109]: pgmap v2867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3722.846828 secs 2024-03-28T07:02:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:03 smithi055 ceph-mon[31863]: pgmap v2867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3722.846828 secs 2024-03-28T07:02:04.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4396 sec 2024-03-28T07:02:05.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4397 sec 2024-03-28T07:02:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:05 smithi086 ceph-mon[35163]: pgmap v2868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:06.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:05 smithi159 ceph-mon[36109]: pgmap v2868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:06.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:05 smithi055 ceph-mon[31863]: pgmap v2868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:06.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4398 sec 2024-03-28T07:02:07.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4399 sec 2024-03-28T07:02:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:07 smithi086 ceph-mon[35163]: pgmap v2869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:07 smithi159 ceph-mon[36109]: pgmap v2869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:08.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:07 smithi055 ceph-mon[31863]: pgmap v2869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:08.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4400 sec 2024-03-28T07:02:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3727.846910 secs 2024-03-28T07:02:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3727.846910 secs 2024-03-28T07:02:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3727.846910 secs 2024-03-28T07:02:09.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4401 sec 2024-03-28T07:02:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:09 smithi086 ceph-mon[35163]: pgmap v2870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:10.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:09 smithi159 ceph-mon[36109]: pgmap v2870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:10.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:09 smithi055 ceph-mon[31863]: pgmap v2870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:10.728 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4402 sec 2024-03-28T07:02:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:10 smithi086 ceph-mon[35163]: pgmap v2871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:11.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:10 smithi159 ceph-mon[36109]: pgmap v2871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:11.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:10 smithi055 ceph-mon[31863]: pgmap v2871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:11.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4403 sec 2024-03-28T07:02:12.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4404 sec 2024-03-28T07:02:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:13 smithi055 ceph-mon[31863]: pgmap v2872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3732.846986 secs 2024-03-28T07:02:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:13 smithi086 ceph-mon[35163]: pgmap v2872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3732.846986 secs 2024-03-28T07:02:13.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:13 smithi159 ceph-mon[36109]: pgmap v2872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:13.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3732.846986 secs 2024-03-28T07:02:13.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4405 sec 2024-03-28T07:02:14.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4406 sec 2024-03-28T07:02:15.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:15 smithi055 ceph-mon[31863]: pgmap v2873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:15 smithi086 ceph-mon[35163]: pgmap v2873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:15.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:15 smithi159 ceph-mon[36109]: pgmap v2873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:15.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4407 sec 2024-03-28T07:02:16.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4408 sec 2024-03-28T07:02:17.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:17 smithi055 ceph-mon[31863]: pgmap v2874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:17 smithi086 ceph-mon[35163]: pgmap v2874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:17.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:17 smithi159 ceph-mon[36109]: pgmap v2874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:17.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4409 sec 2024-03-28T07:02:18.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3737.847107 secs 2024-03-28T07:02:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3737.847107 secs 2024-03-28T07:02:18.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3737.847107 secs 2024-03-28T07:02:18.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4410 sec 2024-03-28T07:02:19.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:19 smithi055 ceph-mon[31863]: pgmap v2875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:19 smithi086 ceph-mon[35163]: pgmap v2875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:19.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:19 smithi159 ceph-mon[36109]: pgmap v2875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:19.729 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4411 sec 2024-03-28T07:02:20.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4412 sec 2024-03-28T07:02:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:21 smithi086 ceph-mon[35163]: pgmap v2876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:21.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:21 smithi159 ceph-mon[36109]: pgmap v2876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:21.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:21 smithi055 ceph-mon[31863]: pgmap v2876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:21.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4413 sec 2024-03-28T07:02:22.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4414 sec 2024-03-28T07:02:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:23 smithi086 ceph-mon[35163]: pgmap v2877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3742.847170 secs 2024-03-28T07:02:23.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:23 smithi159 ceph-mon[36109]: pgmap v2877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:23.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3742.847170 secs 2024-03-28T07:02:23.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:23 smithi055 ceph-mon[31863]: pgmap v2877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:23.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3742.847170 secs 2024-03-28T07:02:23.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4415 sec 2024-03-28T07:02:24.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4416 sec 2024-03-28T07:02:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:25 smithi086 ceph-mon[35163]: pgmap v2878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:25.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:25 smithi159 ceph-mon[36109]: pgmap v2878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:25.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:25 smithi055 ceph-mon[31863]: pgmap v2878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:25.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4417 sec 2024-03-28T07:02:26.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4418 sec 2024-03-28T07:02:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:27 smithi086 ceph-mon[35163]: pgmap v2879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:27.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:27 smithi159 ceph-mon[36109]: pgmap v2879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:27.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:27 smithi055 ceph-mon[31863]: pgmap v2879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:27.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4419 sec 2024-03-28T07:02:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3747.847330 secs 2024-03-28T07:02:28.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3747.847330 secs 2024-03-28T07:02:28.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3747.847330 secs 2024-03-28T07:02:28.730 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4420 sec 2024-03-28T07:02:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:29 smithi086 ceph-mon[35163]: pgmap v2880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:29.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:29 smithi159 ceph-mon[36109]: pgmap v2880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:29.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:29 smithi055 ceph-mon[31863]: pgmap v2880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:29.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4421 sec 2024-03-28T07:02:30.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4422 sec 2024-03-28T07:02:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:31 smithi086 ceph-mon[35163]: pgmap v2881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:31.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:31 smithi159 ceph-mon[36109]: pgmap v2881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:31.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:31 smithi055 ceph-mon[31863]: pgmap v2881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:31.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4423 sec 2024-03-28T07:02:32.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4424 sec 2024-03-28T07:02:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:33 smithi086 ceph-mon[35163]: pgmap v2882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3752.847441 secs 2024-03-28T07:02:33.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:33 smithi159 ceph-mon[36109]: pgmap v2882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:33.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3752.847441 secs 2024-03-28T07:02:33.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:33 smithi055 ceph-mon[31863]: pgmap v2882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:33.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3752.847441 secs 2024-03-28T07:02:33.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4425 sec 2024-03-28T07:02:34.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4426 sec 2024-03-28T07:02:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:35 smithi086 ceph-mon[35163]: pgmap v2883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:35.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:35 smithi159 ceph-mon[36109]: pgmap v2883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:35 smithi055 ceph-mon[31863]: pgmap v2883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:35.731 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4427 sec 2024-03-28T07:02:36.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4428 sec 2024-03-28T07:02:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:37 smithi086 ceph-mon[35163]: pgmap v2884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:37.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:37 smithi159 ceph-mon[36109]: pgmap v2884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:37.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:37 smithi055 ceph-mon[31863]: pgmap v2884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:37.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4429 sec 2024-03-28T07:02:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3757.847560 secs 2024-03-28T07:02:38.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3757.847560 secs 2024-03-28T07:02:38.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3757.847560 secs 2024-03-28T07:02:38.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4430 sec 2024-03-28T07:02:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:39 smithi086 ceph-mon[35163]: pgmap v2885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:39.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:39 smithi159 ceph-mon[36109]: pgmap v2885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:39.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:39 smithi055 ceph-mon[31863]: pgmap v2885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:39.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4431 sec 2024-03-28T07:02:40.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4432 sec 2024-03-28T07:02:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:41 smithi086 ceph-mon[35163]: pgmap v2886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:02:41.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:41 smithi159 ceph-mon[36109]: pgmap v2886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:41.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:02:41.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:41 smithi055 ceph-mon[31863]: pgmap v2886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:41.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:02:41.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4433 sec 2024-03-28T07:02:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:02:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:02:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:02:42.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:02:42.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:02:42.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:02:42.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:02:42.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:02:42.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:02:42.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4434 sec 2024-03-28T07:02:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:43 smithi086 ceph-mon[35163]: pgmap v2887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:43 smithi086 ceph-mon[35163]: pgmap v2888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3762.847627 secs 2024-03-28T07:02:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:43 smithi159 ceph-mon[36109]: pgmap v2887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:43 smithi159 ceph-mon[36109]: pgmap v2888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:43.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3762.847627 secs 2024-03-28T07:02:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:43 smithi055 ceph-mon[31863]: pgmap v2887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:43 smithi055 ceph-mon[31863]: pgmap v2888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:43.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3762.847627 secs 2024-03-28T07:02:43.732 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4435 sec 2024-03-28T07:02:44.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4436 sec 2024-03-28T07:02:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:45 smithi086 ceph-mon[35163]: pgmap v2889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:45.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:45 smithi159 ceph-mon[36109]: pgmap v2889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:45.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:45 smithi055 ceph-mon[31863]: pgmap v2889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:45.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4437 sec 2024-03-28T07:02:46.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4438 sec 2024-03-28T07:02:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:47 smithi086 ceph-mon[35163]: pgmap v2890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:47.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:47 smithi159 ceph-mon[36109]: pgmap v2890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:47.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:47 smithi055 ceph-mon[31863]: pgmap v2890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:47.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4439 sec 2024-03-28T07:02:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3767.847689 secs 2024-03-28T07:02:48.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3767.847689 secs 2024-03-28T07:02:48.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3767.847689 secs 2024-03-28T07:02:48.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4440 sec 2024-03-28T07:02:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:49 smithi086 ceph-mon[35163]: pgmap v2891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:02:49.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:49 smithi159 ceph-mon[36109]: pgmap v2891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:02:49.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:49 smithi055 ceph-mon[31863]: pgmap v2891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:02:49.733 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4441 sec 2024-03-28T07:02:50.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4442 sec 2024-03-28T07:02:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:51 smithi086 ceph-mon[35163]: pgmap v2892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:51.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:51 smithi159 ceph-mon[36109]: pgmap v2892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:51.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:51 smithi055 ceph-mon[31863]: pgmap v2892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:02:51.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4443 sec 2024-03-28T07:02:52.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4444 sec 2024-03-28T07:02:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:53 smithi086 ceph-mon[35163]: pgmap v2893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:02:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3772.847801 secs 2024-03-28T07:02:53.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:53 smithi159 ceph-mon[36109]: pgmap v2893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:02:53.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3772.847801 secs 2024-03-28T07:02:53.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:53 smithi055 ceph-mon[31863]: pgmap v2893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:02:53.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3772.847801 secs 2024-03-28T07:02:53.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4445 sec 2024-03-28T07:02:54.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4446 sec 2024-03-28T07:02:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:55 smithi086 ceph-mon[35163]: pgmap v2894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:55.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:55 smithi159 ceph-mon[36109]: pgmap v2894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:55.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:55 smithi055 ceph-mon[31863]: pgmap v2894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:55.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4447 sec 2024-03-28T07:02:56.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4448 sec 2024-03-28T07:02:57.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:57 smithi055 ceph-mon[31863]: pgmap v2895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:57.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4449 sec 2024-03-28T07:02:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:57 smithi086 ceph-mon[35163]: pgmap v2895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:57.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:57 smithi159 ceph-mon[36109]: pgmap v2895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:02:58.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3777.847864 secs 2024-03-28T07:02:58.734 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4450 sec 2024-03-28T07:02:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3777.847864 secs 2024-03-28T07:02:58.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3777.847864 secs 2024-03-28T07:02:59.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:02:59 smithi055 ceph-mon[31863]: pgmap v2896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:59.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4451 sec 2024-03-28T07:02:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:02:59 smithi086 ceph-mon[35163]: pgmap v2896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:02:59.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:02:59 smithi159 ceph-mon[36109]: pgmap v2896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:00.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4452 sec 2024-03-28T07:03:01.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:01 smithi055 ceph-mon[31863]: pgmap v2897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:01.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4453 sec 2024-03-28T07:03:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:01 smithi086 ceph-mon[35163]: pgmap v2897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:01.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:01 smithi159 ceph-mon[36109]: pgmap v2897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:02.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4454 sec 2024-03-28T07:03:03.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:03 smithi055 ceph-mon[31863]: pgmap v2898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:03.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3782.847977 secs 2024-03-28T07:03:03.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4455 sec 2024-03-28T07:03:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:03 smithi086 ceph-mon[35163]: pgmap v2898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3782.847977 secs 2024-03-28T07:03:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:03 smithi159 ceph-mon[36109]: pgmap v2898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3782.847977 secs 2024-03-28T07:03:04.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4456 sec 2024-03-28T07:03:05.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:05 smithi055 ceph-mon[31863]: pgmap v2899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:05.735 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4457 sec 2024-03-28T07:03:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:05 smithi086 ceph-mon[35163]: pgmap v2899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:05.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:05 smithi159 ceph-mon[36109]: pgmap v2899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:06.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4458 sec 2024-03-28T07:03:07.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:07 smithi055 ceph-mon[31863]: pgmap v2900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:07.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4459 sec 2024-03-28T07:03:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:07 smithi086 ceph-mon[35163]: pgmap v2900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:07.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:07 smithi159 ceph-mon[36109]: pgmap v2900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:08.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4460 sec 2024-03-28T07:03:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3787.848063 secs 2024-03-28T07:03:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3787.848063 secs 2024-03-28T07:03:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3787.848063 secs 2024-03-28T07:03:09.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4461 sec 2024-03-28T07:03:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:09 smithi086 ceph-mon[35163]: pgmap v2901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:09.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:09 smithi159 ceph-mon[36109]: pgmap v2901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:09.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:09 smithi055 ceph-mon[31863]: pgmap v2901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:10.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4462 sec 2024-03-28T07:03:11.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4463 sec 2024-03-28T07:03:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:11 smithi086 ceph-mon[35163]: pgmap v2902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:11.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:11 smithi159 ceph-mon[36109]: pgmap v2902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:11.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:11 smithi055 ceph-mon[31863]: pgmap v2902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:12.736 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4464 sec 2024-03-28T07:03:13.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4465 sec 2024-03-28T07:03:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:13 smithi086 ceph-mon[35163]: pgmap v2903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3792.848151 secs 2024-03-28T07:03:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:13 smithi159 ceph-mon[36109]: pgmap v2903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3792.848151 secs 2024-03-28T07:03:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:13 smithi055 ceph-mon[31863]: pgmap v2903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3792.848151 secs 2024-03-28T07:03:14.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4466 sec 2024-03-28T07:03:15.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4467 sec 2024-03-28T07:03:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:15 smithi086 ceph-mon[35163]: pgmap v2904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:15.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:15 smithi159 ceph-mon[36109]: pgmap v2904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:15.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:15 smithi055 ceph-mon[31863]: pgmap v2904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:16.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4468 sec 2024-03-28T07:03:17.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4469 sec 2024-03-28T07:03:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:17 smithi086 ceph-mon[35163]: pgmap v2905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:17.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:17 smithi159 ceph-mon[36109]: pgmap v2905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:17.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:17 smithi055 ceph-mon[31863]: pgmap v2905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:18.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4470 sec 2024-03-28T07:03:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3797.848274 secs 2024-03-28T07:03:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3797.848274 secs 2024-03-28T07:03:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3797.848274 secs 2024-03-28T07:03:19.737 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4471 sec 2024-03-28T07:03:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:19 smithi086 ceph-mon[35163]: pgmap v2906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:19.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:19 smithi159 ceph-mon[36109]: pgmap v2906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:19.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:19 smithi055 ceph-mon[31863]: pgmap v2906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:20.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4472 sec 2024-03-28T07:03:21.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4473 sec 2024-03-28T07:03:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:21 smithi086 ceph-mon[35163]: pgmap v2907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:21.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:21 smithi159 ceph-mon[36109]: pgmap v2907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:21.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:21 smithi055 ceph-mon[31863]: pgmap v2907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:22.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4474 sec 2024-03-28T07:03:23.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4475 sec 2024-03-28T07:03:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:23 smithi086 ceph-mon[35163]: pgmap v2908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3802.848352 secs 2024-03-28T07:03:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:23 smithi159 ceph-mon[36109]: pgmap v2908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3802.848352 secs 2024-03-28T07:03:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:23 smithi055 ceph-mon[31863]: pgmap v2908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3802.848352 secs 2024-03-28T07:03:24.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4476 sec 2024-03-28T07:03:25.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4477 sec 2024-03-28T07:03:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:25 smithi086 ceph-mon[35163]: pgmap v2909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:25.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:25 smithi159 ceph-mon[36109]: pgmap v2909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:25.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:25 smithi055 ceph-mon[31863]: pgmap v2909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:26.738 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4478 sec 2024-03-28T07:03:27.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4479 sec 2024-03-28T07:03:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:27 smithi086 ceph-mon[35163]: pgmap v2910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:27.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:27 smithi159 ceph-mon[36109]: pgmap v2910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:27.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:27 smithi055 ceph-mon[31863]: pgmap v2910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:28.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4480 sec 2024-03-28T07:03:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3807.848472 secs 2024-03-28T07:03:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3807.848472 secs 2024-03-28T07:03:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3807.848472 secs 2024-03-28T07:03:29.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4481 sec 2024-03-28T07:03:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:29 smithi086 ceph-mon[35163]: pgmap v2911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:29.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:29 smithi159 ceph-mon[36109]: pgmap v2911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:29 smithi055 ceph-mon[31863]: pgmap v2911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:30.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4482 sec 2024-03-28T07:03:31.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4483 sec 2024-03-28T07:03:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:31 smithi086 ceph-mon[35163]: pgmap v2912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:31.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:31 smithi159 ceph-mon[36109]: pgmap v2912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:31.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:31 smithi055 ceph-mon[31863]: pgmap v2912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:32.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4484 sec 2024-03-28T07:03:33.739 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4485 sec 2024-03-28T07:03:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:33 smithi086 ceph-mon[35163]: pgmap v2913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3812.848537 secs 2024-03-28T07:03:33.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:33 smithi159 ceph-mon[36109]: pgmap v2913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:33.825 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3812.848537 secs 2024-03-28T07:03:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:33 smithi055 ceph-mon[31863]: pgmap v2913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3812.848537 secs 2024-03-28T07:03:34.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4486 sec 2024-03-28T07:03:35.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4487 sec 2024-03-28T07:03:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:35 smithi086 ceph-mon[35163]: pgmap v2914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:35.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:35 smithi159 ceph-mon[36109]: pgmap v2914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:35.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:35 smithi055 ceph-mon[31863]: pgmap v2914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:36.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4488 sec 2024-03-28T07:03:37.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4489 sec 2024-03-28T07:03:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:37 smithi086 ceph-mon[35163]: pgmap v2915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:37.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:37 smithi159 ceph-mon[36109]: pgmap v2915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:37.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:37 smithi055 ceph-mon[31863]: pgmap v2915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:38.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4490 sec 2024-03-28T07:03:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3817.848599 secs 2024-03-28T07:03:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3817.848599 secs 2024-03-28T07:03:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3817.848599 secs 2024-03-28T07:03:39.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4491 sec 2024-03-28T07:03:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:39 smithi086 ceph-mon[35163]: pgmap v2916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:39.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:39 smithi159 ceph-mon[36109]: pgmap v2916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:39.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:39 smithi055 ceph-mon[31863]: pgmap v2916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:40.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4492 sec 2024-03-28T07:03:41.740 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4493 sec 2024-03-28T07:03:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:41 smithi086 ceph-mon[35163]: pgmap v2917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:41 smithi159 ceph-mon[36109]: pgmap v2917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:41.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:41 smithi055 ceph-mon[31863]: pgmap v2917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:42.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4494 sec 2024-03-28T07:03:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:03:42.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:03:42.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:03:43.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4495 sec 2024-03-28T07:03:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:43 smithi086 ceph-mon[35163]: pgmap v2918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3822.848699 secs 2024-03-28T07:03:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:43 smithi159 ceph-mon[36109]: pgmap v2918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3822.848699 secs 2024-03-28T07:03:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:43 smithi055 ceph-mon[31863]: pgmap v2918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3822.848699 secs 2024-03-28T07:03:44.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4496 sec 2024-03-28T07:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:44 smithi086 ceph-mon[35163]: pgmap v2919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:44 smithi086 ceph-mon[35163]: pgmap v2920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:03:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:03:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:03:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:44 smithi159 ceph-mon[36109]: pgmap v2919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:44 smithi159 ceph-mon[36109]: pgmap v2920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:03:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:03:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:03:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:44 smithi055 ceph-mon[31863]: pgmap v2919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:03:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:44 smithi055 ceph-mon[31863]: pgmap v2920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:44.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:03:45.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4497 sec 2024-03-28T07:03:46.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4498 sec 2024-03-28T07:03:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:46 smithi086 ceph-mon[35163]: pgmap v2921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:47.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:46 smithi159 ceph-mon[36109]: pgmap v2921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:46 smithi055 ceph-mon[31863]: pgmap v2921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:47.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4499 sec 2024-03-28T07:03:48.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4500 sec 2024-03-28T07:03:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3827.848821 secs 2024-03-28T07:03:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:48 smithi086 ceph-mon[35163]: pgmap v2922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:03:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3827.848821 secs 2024-03-28T07:03:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:48 smithi159 ceph-mon[36109]: pgmap v2922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:03:49.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3827.848821 secs 2024-03-28T07:03:49.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:48 smithi055 ceph-mon[31863]: pgmap v2922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:03:49.741 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4501 sec 2024-03-28T07:03:50.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4502 sec 2024-03-28T07:03:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:50 smithi086 ceph-mon[35163]: pgmap v2923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:51.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:50 smithi159 ceph-mon[36109]: pgmap v2923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:50 smithi055 ceph-mon[31863]: pgmap v2923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:51.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4503 sec 2024-03-28T07:03:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:51 smithi086 ceph-mon[35163]: pgmap v2924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:52.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:51 smithi159 ceph-mon[36109]: pgmap v2924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:52.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:51 smithi055 ceph-mon[31863]: pgmap v2924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:03:52.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4504 sec 2024-03-28T07:03:53.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3832.848887 secs 2024-03-28T07:03:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3832.848887 secs 2024-03-28T07:03:53.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3832.848887 secs 2024-03-28T07:03:53.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4505 sec 2024-03-28T07:03:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:54 smithi055 ceph-mon[31863]: pgmap v2925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:54 smithi086 ceph-mon[35163]: pgmap v2925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:54.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:54 smithi159 ceph-mon[36109]: pgmap v2925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:03:54.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4506 sec 2024-03-28T07:03:55.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4507 sec 2024-03-28T07:03:56.742 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4508 sec 2024-03-28T07:03:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:56 smithi086 ceph-mon[35163]: pgmap v2926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:03:57.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:56 smithi159 ceph-mon[36109]: pgmap v2926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:03:57.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:56 smithi055 ceph-mon[31863]: pgmap v2926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:03:57.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4509 sec 2024-03-28T07:03:58.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4510 sec 2024-03-28T07:03:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3837.849010 secs 2024-03-28T07:03:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:03:58 smithi086 ceph-mon[35163]: pgmap v2927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3837.849010 secs 2024-03-28T07:03:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:03:58 smithi159 ceph-mon[36109]: pgmap v2927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3837.849010 secs 2024-03-28T07:03:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:03:58 smithi055 ceph-mon[31863]: pgmap v2927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:03:59.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4511 sec 2024-03-28T07:04:00.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4512 sec 2024-03-28T07:04:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:00 smithi086 ceph-mon[35163]: pgmap v2928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:00 smithi159 ceph-mon[36109]: pgmap v2928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:01.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:00 smithi055 ceph-mon[31863]: pgmap v2928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:01.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4513 sec 2024-03-28T07:04:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:01 smithi086 ceph-mon[35163]: pgmap v2929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:02.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:01 smithi159 ceph-mon[36109]: pgmap v2929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:02.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:01 smithi055 ceph-mon[31863]: pgmap v2929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:02.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4514 sec 2024-03-28T07:04:03.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3842.849133 secs 2024-03-28T07:04:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3842.849133 secs 2024-03-28T07:04:03.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3842.849133 secs 2024-03-28T07:04:03.743 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4515 sec 2024-03-28T07:04:04.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:04 smithi055 ceph-mon[31863]: pgmap v2930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:04 smithi086 ceph-mon[35163]: pgmap v2930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:04.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:04 smithi159 ceph-mon[36109]: pgmap v2930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:04.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4516 sec 2024-03-28T07:04:05.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4517 sec 2024-03-28T07:04:06.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4518 sec 2024-03-28T07:04:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:06 smithi086 ceph-mon[35163]: pgmap v2931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:07.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:06 smithi159 ceph-mon[36109]: pgmap v2931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:07.079 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:06 smithi055 ceph-mon[31863]: pgmap v2931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:07.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4519 sec 2024-03-28T07:04:08.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4520 sec 2024-03-28T07:04:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3847.849254 secs 2024-03-28T07:04:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:08 smithi086 ceph-mon[35163]: pgmap v2932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3847.849254 secs 2024-03-28T07:04:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:08 smithi159 ceph-mon[36109]: pgmap v2932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3847.849254 secs 2024-03-28T07:04:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:08 smithi055 ceph-mon[31863]: pgmap v2932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:09.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4521 sec 2024-03-28T07:04:10.744 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4522 sec 2024-03-28T07:04:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:10 smithi086 ceph-mon[35163]: pgmap v2933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:11.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:10 smithi159 ceph-mon[36109]: pgmap v2933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:11.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:10 smithi055 ceph-mon[31863]: pgmap v2933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:11.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4523 sec 2024-03-28T07:04:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:11 smithi086 ceph-mon[35163]: pgmap v2934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:12.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:11 smithi159 ceph-mon[36109]: pgmap v2934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:11 smithi055 ceph-mon[31863]: pgmap v2934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:12.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4524 sec 2024-03-28T07:04:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3852.849375 secs 2024-03-28T07:04:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3852.849375 secs 2024-03-28T07:04:13.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3852.849375 secs 2024-03-28T07:04:13.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4525 sec 2024-03-28T07:04:14.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:14 smithi055 ceph-mon[31863]: pgmap v2935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:14 smithi086 ceph-mon[35163]: pgmap v2935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:14.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:14 smithi159 ceph-mon[36109]: pgmap v2935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:14.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4526 sec 2024-03-28T07:04:15.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4527 sec 2024-03-28T07:04:16.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4528 sec 2024-03-28T07:04:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:16 smithi086 ceph-mon[35163]: pgmap v2936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:17.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:16 smithi159 ceph-mon[36109]: pgmap v2936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:16 smithi055 ceph-mon[31863]: pgmap v2936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:17.745 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4529 sec 2024-03-28T07:04:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:17 smithi086 ceph-mon[35163]: pgmap v2937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:17 smithi159 ceph-mon[36109]: pgmap v2937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:18.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:17 smithi055 ceph-mon[31863]: pgmap v2937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:18.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4530 sec 2024-03-28T07:04:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3857.849458 secs 2024-03-28T07:04:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3857.849458 secs 2024-03-28T07:04:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3857.849458 secs 2024-03-28T07:04:19.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4531 sec 2024-03-28T07:04:20.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:19 smithi055 ceph-mon[31863]: pgmap v2938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:19 smithi086 ceph-mon[35163]: pgmap v2938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:20.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:19 smithi159 ceph-mon[36109]: pgmap v2938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:20.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4532 sec 2024-03-28T07:04:21.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4533 sec 2024-03-28T07:04:22.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4534 sec 2024-03-28T07:04:23.026 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:22 smithi159 ceph-mon[36109]: pgmap v2939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:22 smithi086 ceph-mon[35163]: pgmap v2939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:22 smithi055 ceph-mon[31863]: pgmap v2939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:23.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4535 sec 2024-03-28T07:04:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3862.849522 secs 2024-03-28T07:04:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3862.849522 secs 2024-03-28T07:04:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3862.849522 secs 2024-03-28T07:04:24.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4536 sec 2024-03-28T07:04:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:24 smithi086 ceph-mon[35163]: pgmap v2940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:24 smithi159 ceph-mon[36109]: pgmap v2940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:24 smithi055 ceph-mon[31863]: pgmap v2940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:25.746 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4537 sec 2024-03-28T07:04:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:25 smithi086 ceph-mon[35163]: pgmap v2941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:26.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:25 smithi159 ceph-mon[36109]: pgmap v2941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:26.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:25 smithi055 ceph-mon[31863]: pgmap v2941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:26.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4538 sec 2024-03-28T07:04:27.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4539 sec 2024-03-28T07:04:28.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4540 sec 2024-03-28T07:04:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3867.849583 secs 2024-03-28T07:04:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:28 smithi086 ceph-mon[35163]: pgmap v2942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3867.849583 secs 2024-03-28T07:04:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:28 smithi159 ceph-mon[36109]: pgmap v2942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3867.849583 secs 2024-03-28T07:04:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:28 smithi055 ceph-mon[31863]: pgmap v2942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:29.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4541 sec 2024-03-28T07:04:30.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4542 sec 2024-03-28T07:04:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:30 smithi086 ceph-mon[35163]: pgmap v2943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:31.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:30 smithi159 ceph-mon[36109]: pgmap v2943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:30 smithi055 ceph-mon[31863]: pgmap v2943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:31.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4543 sec 2024-03-28T07:04:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:31 smithi086 ceph-mon[35163]: pgmap v2944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:32.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:31 smithi159 ceph-mon[36109]: pgmap v2944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:32.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:31 smithi055 ceph-mon[31863]: pgmap v2944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:32.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4544 sec 2024-03-28T07:04:33.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3872.849702 secs 2024-03-28T07:04:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3872.849702 secs 2024-03-28T07:04:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3872.849702 secs 2024-03-28T07:04:33.747 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4545 sec 2024-03-28T07:04:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:34 smithi055 ceph-mon[31863]: pgmap v2945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:34 smithi086 ceph-mon[35163]: pgmap v2945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:34.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:34 smithi159 ceph-mon[36109]: pgmap v2945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:34.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4546 sec 2024-03-28T07:04:35.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4547 sec 2024-03-28T07:04:36.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4548 sec 2024-03-28T07:04:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:36 smithi086 ceph-mon[35163]: pgmap v2946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:36 smithi159 ceph-mon[36109]: pgmap v2946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:37.079 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:36 smithi055 ceph-mon[31863]: pgmap v2946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:37.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4549 sec 2024-03-28T07:04:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:37 smithi086 ceph-mon[35163]: pgmap v2947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:04:38.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:37 smithi159 ceph-mon[36109]: pgmap v2947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:04:38.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:37 smithi055 ceph-mon[31863]: pgmap v2947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:04:38.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4550 sec 2024-03-28T07:04:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3877.849822 secs 2024-03-28T07:04:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3877.849822 secs 2024-03-28T07:04:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3877.849822 secs 2024-03-28T07:04:39.748 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4551 sec 2024-03-28T07:04:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:39 smithi086 ceph-mon[35163]: pgmap v2948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:40.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:39 smithi159 ceph-mon[36109]: pgmap v2948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:40.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:39 smithi055 ceph-mon[31863]: pgmap v2948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:40.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4552 sec 2024-03-28T07:04:41.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4553 sec 2024-03-28T07:04:42.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4554 sec 2024-03-28T07:04:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:42 smithi086 ceph-mon[35163]: pgmap v2949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:43.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:42 smithi159 ceph-mon[36109]: pgmap v2949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:42 smithi055 ceph-mon[31863]: pgmap v2949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:43.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4555 sec 2024-03-28T07:04:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3882.849910 secs 2024-03-28T07:04:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:43 smithi086 ceph-mon[35163]: pgmap v2950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3882.849910 secs 2024-03-28T07:04:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:43 smithi159 ceph-mon[36109]: pgmap v2950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3882.849910 secs 2024-03-28T07:04:44.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:43 smithi055 ceph-mon[31863]: pgmap v2950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:44.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4556 sec 2024-03-28T07:04:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:04:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:04:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:04:45.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4557 sec 2024-03-28T07:04:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:45 smithi086 ceph-mon[35163]: pgmap v2951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:45 smithi159 ceph-mon[36109]: pgmap v2951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:46.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:45 smithi055 ceph-mon[31863]: pgmap v2951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:04:46.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4558 sec 2024-03-28T07:04:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: pgmap v2952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: pgmap v2953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:04:47.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:04:47.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:04:47.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:04:47.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: pgmap v2952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:04:47.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: pgmap v2953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:47.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.627 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: pgmap v2952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: pgmap v2953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:47.628 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:04:47.749 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4559 sec 2024-03-28T07:04:48.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4560 sec 2024-03-28T07:04:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3887.850001 secs 2024-03-28T07:04:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3887.850001 secs 2024-03-28T07:04:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3887.850001 secs 2024-03-28T07:04:49.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4561 sec 2024-03-28T07:04:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:49 smithi086 ceph-mon[35163]: pgmap v2954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:49.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:49 smithi159 ceph-mon[36109]: pgmap v2954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:49.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:49 smithi055 ceph-mon[31863]: pgmap v2954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:50.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4562 sec 2024-03-28T07:04:51.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4563 sec 2024-03-28T07:04:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:51 smithi086 ceph-mon[35163]: pgmap v2955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:51.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:51 smithi159 ceph-mon[36109]: pgmap v2955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:51 smithi055 ceph-mon[31863]: pgmap v2955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:04:52.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4564 sec 2024-03-28T07:04:53.750 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4565 sec 2024-03-28T07:04:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:53 smithi086 ceph-mon[35163]: pgmap v2956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3892.850125 secs 2024-03-28T07:04:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:53 smithi159 ceph-mon[36109]: pgmap v2956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3892.850125 secs 2024-03-28T07:04:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:53 smithi055 ceph-mon[31863]: pgmap v2956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:04:53.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3892.850125 secs 2024-03-28T07:04:54.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4566 sec 2024-03-28T07:04:55.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4567 sec 2024-03-28T07:04:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:55 smithi086 ceph-mon[35163]: pgmap v2957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:04:55.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:55 smithi159 ceph-mon[36109]: pgmap v2957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:04:55.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:55 smithi055 ceph-mon[31863]: pgmap v2957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:04:56.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4568 sec 2024-03-28T07:04:57.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4569 sec 2024-03-28T07:04:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:57 smithi086 ceph-mon[35163]: pgmap v2958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:57.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:57 smithi159 ceph-mon[36109]: pgmap v2958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:57 smithi055 ceph-mon[31863]: pgmap v2958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:04:58.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4570 sec 2024-03-28T07:04:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3897.850219 secs 2024-03-28T07:04:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3897.850219 secs 2024-03-28T07:04:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3897.850219 secs 2024-03-28T07:04:59.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4571 sec 2024-03-28T07:04:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:04:59 smithi086 ceph-mon[35163]: pgmap v2959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:59.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:04:59 smithi159 ceph-mon[36109]: pgmap v2959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:04:59.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:04:59 smithi055 ceph-mon[31863]: pgmap v2959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:00.751 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4572 sec 2024-03-28T07:05:01.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4573 sec 2024-03-28T07:05:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:01 smithi086 ceph-mon[35163]: pgmap v2960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:01.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:01 smithi159 ceph-mon[36109]: pgmap v2960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:01.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:01 smithi055 ceph-mon[31863]: pgmap v2960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:02.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4574 sec 2024-03-28T07:05:03.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4575 sec 2024-03-28T07:05:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:03 smithi086 ceph-mon[35163]: pgmap v2961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3902.850300 secs 2024-03-28T07:05:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:03 smithi159 ceph-mon[36109]: pgmap v2961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3902.850300 secs 2024-03-28T07:05:03.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:03 smithi055 ceph-mon[31863]: pgmap v2961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:03.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3902.850300 secs 2024-03-28T07:05:04.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4576 sec 2024-03-28T07:05:05.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4577 sec 2024-03-28T07:05:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:05 smithi086 ceph-mon[35163]: pgmap v2962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:05.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:05 smithi159 ceph-mon[36109]: pgmap v2962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:05 smithi055 ceph-mon[31863]: pgmap v2962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:06.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4578 sec 2024-03-28T07:05:07.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4579 sec 2024-03-28T07:05:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:07 smithi086 ceph-mon[35163]: pgmap v2963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:07.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:07 smithi159 ceph-mon[36109]: pgmap v2963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:07.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:07 smithi055 ceph-mon[31863]: pgmap v2963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:08.752 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4580 sec 2024-03-28T07:05:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3907.850355 secs 2024-03-28T07:05:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3907.850355 secs 2024-03-28T07:05:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3907.850355 secs 2024-03-28T07:05:09.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4581 sec 2024-03-28T07:05:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:09 smithi086 ceph-mon[35163]: pgmap v2964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:09.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:09 smithi159 ceph-mon[36109]: pgmap v2964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:09.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:09 smithi055 ceph-mon[31863]: pgmap v2964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:10.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4582 sec 2024-03-28T07:05:11.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4583 sec 2024-03-28T07:05:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:11 smithi086 ceph-mon[35163]: pgmap v2965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:11.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:11 smithi159 ceph-mon[36109]: pgmap v2965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:11.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:11 smithi055 ceph-mon[31863]: pgmap v2965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:12.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4584 sec 2024-03-28T07:05:13.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4585 sec 2024-03-28T07:05:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:13 smithi086 ceph-mon[35163]: pgmap v2966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3912.850479 secs 2024-03-28T07:05:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:13 smithi159 ceph-mon[36109]: pgmap v2966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:13.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3912.850479 secs 2024-03-28T07:05:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:13 smithi055 ceph-mon[31863]: pgmap v2966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3912.850479 secs 2024-03-28T07:05:14.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4586 sec 2024-03-28T07:05:15.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4587 sec 2024-03-28T07:05:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:15 smithi086 ceph-mon[35163]: pgmap v2967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:15.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:15 smithi159 ceph-mon[36109]: pgmap v2967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:15.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:15 smithi055 ceph-mon[31863]: pgmap v2967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:16.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4588 sec 2024-03-28T07:05:17.753 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4589 sec 2024-03-28T07:05:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:17 smithi086 ceph-mon[35163]: pgmap v2968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:17 smithi159 ceph-mon[36109]: pgmap v2968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:18.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:17 smithi055 ceph-mon[31863]: pgmap v2968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:18.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4590 sec 2024-03-28T07:05:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3917.850556 secs 2024-03-28T07:05:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3917.850556 secs 2024-03-28T07:05:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3917.850556 secs 2024-03-28T07:05:19.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4591 sec 2024-03-28T07:05:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:19 smithi086 ceph-mon[35163]: pgmap v2969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:19 smithi159 ceph-mon[36109]: pgmap v2969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:20.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:19 smithi055 ceph-mon[31863]: pgmap v2969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:20.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4592 sec 2024-03-28T07:05:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:20 smithi086 ceph-mon[35163]: pgmap v2970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:21.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:20 smithi159 ceph-mon[36109]: pgmap v2970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:20 smithi055 ceph-mon[31863]: pgmap v2970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:21.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4593 sec 2024-03-28T07:05:22.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4594 sec 2024-03-28T07:05:23.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4595 sec 2024-03-28T07:05:23.776 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:23 smithi159 ceph-mon[36109]: pgmap v2971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:23.777 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3922.850620 secs 2024-03-28T07:05:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:23 smithi086 ceph-mon[35163]: pgmap v2971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3922.850620 secs 2024-03-28T07:05:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:23 smithi055 ceph-mon[31863]: pgmap v2971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3922.850620 secs 2024-03-28T07:05:24.754 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4596 sec 2024-03-28T07:05:25.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4597 sec 2024-03-28T07:05:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:25 smithi086 ceph-mon[35163]: pgmap v2972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:25 smithi159 ceph-mon[36109]: pgmap v2972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:25 smithi055 ceph-mon[31863]: pgmap v2972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:26.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4598 sec 2024-03-28T07:05:27.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4599 sec 2024-03-28T07:05:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:27 smithi086 ceph-mon[35163]: pgmap v2973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:27 smithi159 ceph-mon[36109]: pgmap v2973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:27.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:27 smithi055 ceph-mon[31863]: pgmap v2973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:28.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4600 sec 2024-03-28T07:05:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3927.850705 secs 2024-03-28T07:05:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3927.850705 secs 2024-03-28T07:05:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3927.850705 secs 2024-03-28T07:05:29.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4601 sec 2024-03-28T07:05:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:29 smithi086 ceph-mon[35163]: pgmap v2974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:29 smithi159 ceph-mon[36109]: pgmap v2974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:29 smithi055 ceph-mon[31863]: pgmap v2974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:30.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4602 sec 2024-03-28T07:05:31.755 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4603 sec 2024-03-28T07:05:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:31 smithi086 ceph-mon[35163]: pgmap v2975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:31.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:31 smithi159 ceph-mon[36109]: pgmap v2975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:31.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:31 smithi055 ceph-mon[31863]: pgmap v2975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:32.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4604 sec 2024-03-28T07:05:33.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4605 sec 2024-03-28T07:05:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:33 smithi086 ceph-mon[35163]: pgmap v2976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3932.850831 secs 2024-03-28T07:05:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:33 smithi159 ceph-mon[36109]: pgmap v2976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3932.850831 secs 2024-03-28T07:05:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:33 smithi055 ceph-mon[31863]: pgmap v2976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3932.850831 secs 2024-03-28T07:05:34.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4606 sec 2024-03-28T07:05:35.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4607 sec 2024-03-28T07:05:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:35 smithi086 ceph-mon[35163]: pgmap v2977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:35 smithi159 ceph-mon[36109]: pgmap v2977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:35.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:35 smithi055 ceph-mon[31863]: pgmap v2977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:36.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4608 sec 2024-03-28T07:05:37.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4609 sec 2024-03-28T07:05:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:37 smithi086 ceph-mon[35163]: pgmap v2978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:37 smithi159 ceph-mon[36109]: pgmap v2978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:37.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:37 smithi055 ceph-mon[31863]: pgmap v2978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:38.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4610 sec 2024-03-28T07:05:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3937.850885 secs 2024-03-28T07:05:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3937.850885 secs 2024-03-28T07:05:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3937.850885 secs 2024-03-28T07:05:39.756 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4611 sec 2024-03-28T07:05:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:39 smithi086 ceph-mon[35163]: pgmap v2979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:39 smithi159 ceph-mon[36109]: pgmap v2979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:39 smithi055 ceph-mon[31863]: pgmap v2979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:40.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4612 sec 2024-03-28T07:05:41.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4613 sec 2024-03-28T07:05:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:41 smithi086 ceph-mon[35163]: pgmap v2980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:41 smithi159 ceph-mon[36109]: pgmap v2980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:41 smithi055 ceph-mon[31863]: pgmap v2980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:05:42.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4614 sec 2024-03-28T07:05:43.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4615 sec 2024-03-28T07:05:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:43 smithi086 ceph-mon[35163]: pgmap v2981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3942.851008 secs 2024-03-28T07:05:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:43 smithi159 ceph-mon[36109]: pgmap v2981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3942.851008 secs 2024-03-28T07:05:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:43 smithi055 ceph-mon[31863]: pgmap v2981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:05:43.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3942.851008 secs 2024-03-28T07:05:44.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4616 sec 2024-03-28T07:05:45.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4617 sec 2024-03-28T07:05:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:45 smithi159 ceph-mon[36109]: pgmap v2982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:45 smithi055 ceph-mon[31863]: pgmap v2982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:45 smithi086 ceph-mon[35163]: pgmap v2982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:46.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4618 sec 2024-03-28T07:05:47.757 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4619 sec 2024-03-28T07:05:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:47 smithi055 ceph-mon[31863]: pgmap v2983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:05:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:47 smithi086 ceph-mon[35163]: pgmap v2983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:05:48.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:47 smithi159 ceph-mon[36109]: pgmap v2983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:48.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:05:48.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4620 sec 2024-03-28T07:05:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3947.851094 secs 2024-03-28T07:05:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3947.851094 secs 2024-03-28T07:05:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3947.851094 secs 2024-03-28T07:05:49.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4621 sec 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: pgmap v2984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:49.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:05:49.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:05:49.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: pgmap v2984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:05:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:05:50.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: pgmap v2984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:05:50.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:05:50.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:05:50.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4622 sec 2024-03-28T07:05:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:50 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:05:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:50 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:05:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:50 smithi055 ceph-mon[31863]: pgmap v2985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:05:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:50 smithi055 ceph-mon[31863]: pgmap v2986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:05:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:50 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:05:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:50 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:05:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:50 smithi086 ceph-mon[35163]: pgmap v2985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:05:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:50 smithi086 ceph-mon[35163]: pgmap v2986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:05:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:50 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:05:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:50 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:05:51.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:50 smithi159 ceph-mon[36109]: pgmap v2985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:05:51.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:50 smithi159 ceph-mon[36109]: pgmap v2986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:05:51.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4623 sec 2024-03-28T07:05:52.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4624 sec 2024-03-28T07:05:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:52 smithi086 ceph-mon[35163]: pgmap v2987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:52 smithi159 ceph-mon[36109]: pgmap v2987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:52 smithi055 ceph-mon[31863]: pgmap v2987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:53.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4625 sec 2024-03-28T07:05:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3952.851210 secs 2024-03-28T07:05:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:53 smithi086 ceph-mon[35163]: pgmap v2988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3952.851210 secs 2024-03-28T07:05:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:53 smithi159 ceph-mon[36109]: pgmap v2988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3952.851210 secs 2024-03-28T07:05:54.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:53 smithi055 ceph-mon[31863]: pgmap v2988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:05:54.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4626 sec 2024-03-28T07:05:55.758 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4627 sec 2024-03-28T07:05:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:56 smithi086 ceph-mon[35163]: pgmap v2989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:56 smithi159 ceph-mon[36109]: pgmap v2989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:56.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:56 smithi055 ceph-mon[31863]: pgmap v2989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:56.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4628 sec 2024-03-28T07:05:57.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4629 sec 2024-03-28T07:05:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:58 smithi086 ceph-mon[35163]: pgmap v2990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:58 smithi159 ceph-mon[36109]: pgmap v2990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:58 smithi055 ceph-mon[31863]: pgmap v2990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:05:58.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4630 sec 2024-03-28T07:05:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:05:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3957.851314 secs 2024-03-28T07:05:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:05:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3957.851314 secs 2024-03-28T07:05:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:05:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3957.851314 secs 2024-03-28T07:05:59.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4631 sec 2024-03-28T07:06:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:00 smithi086 ceph-mon[35163]: pgmap v2991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:00 smithi159 ceph-mon[36109]: pgmap v2991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:00 smithi055 ceph-mon[31863]: pgmap v2991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:00.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4632 sec 2024-03-28T07:06:01.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4633 sec 2024-03-28T07:06:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:02 smithi086 ceph-mon[35163]: pgmap v2992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:02.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:02 smithi159 ceph-mon[36109]: pgmap v2992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:02.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:02 smithi055 ceph-mon[31863]: pgmap v2992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:02.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4634 sec 2024-03-28T07:06:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3962.851440 secs 2024-03-28T07:06:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3962.851440 secs 2024-03-28T07:06:03.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3962.851440 secs 2024-03-28T07:06:03.759 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4635 sec 2024-03-28T07:06:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:04 smithi055 ceph-mon[31863]: pgmap v2993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:04 smithi086 ceph-mon[35163]: pgmap v2993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:04.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:04 smithi159 ceph-mon[36109]: pgmap v2993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:04.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4636 sec 2024-03-28T07:06:05.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4637 sec 2024-03-28T07:06:06.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:06 smithi055 ceph-mon[31863]: pgmap v2994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:06 smithi086 ceph-mon[35163]: pgmap v2994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:06.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:06 smithi159 ceph-mon[36109]: pgmap v2994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:06.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4638 sec 2024-03-28T07:06:07.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4639 sec 2024-03-28T07:06:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:08 smithi055 ceph-mon[31863]: pgmap v2995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3967.851558 secs 2024-03-28T07:06:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:08 smithi086 ceph-mon[35163]: pgmap v2995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3967.851558 secs 2024-03-28T07:06:08.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:08 smithi159 ceph-mon[36109]: pgmap v2995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:08.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3967.851558 secs 2024-03-28T07:06:08.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4640 sec 2024-03-28T07:06:09.760 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4641 sec 2024-03-28T07:06:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:10 smithi055 ceph-mon[31863]: pgmap v2996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:10 smithi086 ceph-mon[35163]: pgmap v2996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:10 smithi159 ceph-mon[36109]: pgmap v2996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:10.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4642 sec 2024-03-28T07:06:11.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4643 sec 2024-03-28T07:06:12.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:12 smithi055 ceph-mon[31863]: pgmap v2997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:12 smithi086 ceph-mon[35163]: pgmap v2997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:12.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:12 smithi159 ceph-mon[36109]: pgmap v2997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:12.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4644 sec 2024-03-28T07:06:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3972.851681 secs 2024-03-28T07:06:13.472 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3972.851681 secs 2024-03-28T07:06:13.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3972.851681 secs 2024-03-28T07:06:13.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4645 sec 2024-03-28T07:06:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:14 smithi086 ceph-mon[35163]: pgmap v2998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:14.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:14 smithi159 ceph-mon[36109]: pgmap v2998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:14.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:14 smithi055 ceph-mon[31863]: pgmap v2998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:14.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4646 sec 2024-03-28T07:06:15.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4647 sec 2024-03-28T07:06:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:16 smithi086 ceph-mon[35163]: pgmap v2999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:16.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:16 smithi159 ceph-mon[36109]: pgmap v2999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:16.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:16 smithi055 ceph-mon[31863]: pgmap v2999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:16.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4648 sec 2024-03-28T07:06:17.761 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4649 sec 2024-03-28T07:06:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:18 smithi086 ceph-mon[35163]: pgmap v3000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3977.851802 secs 2024-03-28T07:06:18.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:18 smithi159 ceph-mon[36109]: pgmap v3000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:18.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3977.851802 secs 2024-03-28T07:06:18.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:18 smithi055 ceph-mon[31863]: pgmap v3000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:18.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3977.851802 secs 2024-03-28T07:06:18.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4650 sec 2024-03-28T07:06:19.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4651 sec 2024-03-28T07:06:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:20 smithi086 ceph-mon[35163]: pgmap v3001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:20.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:20 smithi159 ceph-mon[36109]: pgmap v3001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:20.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:20 smithi055 ceph-mon[31863]: pgmap v3001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:20.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4652 sec 2024-03-28T07:06:21.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4653 sec 2024-03-28T07:06:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:22 smithi086 ceph-mon[35163]: pgmap v3002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:22.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:22 smithi159 ceph-mon[36109]: pgmap v3002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:22.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:22 smithi055 ceph-mon[31863]: pgmap v3002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:22.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4654 sec 2024-03-28T07:06:23.474 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3982.851879 secs 2024-03-28T07:06:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3982.851879 secs 2024-03-28T07:06:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3982.851879 secs 2024-03-28T07:06:23.762 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4655 sec 2024-03-28T07:06:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:24 smithi086 ceph-mon[35163]: pgmap v3003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:24 smithi159 ceph-mon[36109]: pgmap v3003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:24.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:24 smithi055 ceph-mon[31863]: pgmap v3003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:24.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4656 sec 2024-03-28T07:06:25.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4657 sec 2024-03-28T07:06:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:26 smithi086 ceph-mon[35163]: pgmap v3004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:26.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:26 smithi159 ceph-mon[36109]: pgmap v3004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:26.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:26 smithi055 ceph-mon[31863]: pgmap v3004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:26.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4658 sec 2024-03-28T07:06:27.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4659 sec 2024-03-28T07:06:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:28 smithi086 ceph-mon[35163]: pgmap v3005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3987.851963 secs 2024-03-28T07:06:28.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:28 smithi159 ceph-mon[36109]: pgmap v3005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:28.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3987.851963 secs 2024-03-28T07:06:28.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:28 smithi055 ceph-mon[31863]: pgmap v3005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:28.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3987.851963 secs 2024-03-28T07:06:28.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4660 sec 2024-03-28T07:06:29.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4661 sec 2024-03-28T07:06:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:30 smithi086 ceph-mon[35163]: pgmap v3006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:30 smithi159 ceph-mon[36109]: pgmap v3006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:30 smithi055 ceph-mon[31863]: pgmap v3006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:30.763 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4662 sec 2024-03-28T07:06:31.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4663 sec 2024-03-28T07:06:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:32 smithi086 ceph-mon[35163]: pgmap v3007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:32.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:32 smithi159 ceph-mon[36109]: pgmap v3007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:32.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:32 smithi055 ceph-mon[31863]: pgmap v3007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:32.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4664 sec 2024-03-28T07:06:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3992.852083 secs 2024-03-28T07:06:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3992.852083 secs 2024-03-28T07:06:33.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3992.852083 secs 2024-03-28T07:06:33.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4665 sec 2024-03-28T07:06:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:34 smithi086 ceph-mon[35163]: pgmap v3008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:34.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:34 smithi159 ceph-mon[36109]: pgmap v3008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:34 smithi055 ceph-mon[31863]: pgmap v3008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:34.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4666 sec 2024-03-28T07:06:35.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4667 sec 2024-03-28T07:06:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:36 smithi086 ceph-mon[35163]: pgmap v3009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:06:36.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:36 smithi159 ceph-mon[36109]: pgmap v3009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:06:36.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:36 smithi055 ceph-mon[31863]: pgmap v3009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:06:36.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4668 sec 2024-03-28T07:06:37.764 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4669 sec 2024-03-28T07:06:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:38 smithi086 ceph-mon[35163]: pgmap v3010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 3997.852200 secs 2024-03-28T07:06:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:38 smithi159 ceph-mon[36109]: pgmap v3010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 3997.852200 secs 2024-03-28T07:06:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:38 smithi055 ceph-mon[31863]: pgmap v3010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:38.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 3997.852200 secs 2024-03-28T07:06:38.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4670 sec 2024-03-28T07:06:39.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4671 sec 2024-03-28T07:06:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:40 smithi086 ceph-mon[35163]: pgmap v3011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:40.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:40 smithi159 ceph-mon[36109]: pgmap v3011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:40.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:40 smithi055 ceph-mon[31863]: pgmap v3011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:40.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4672 sec 2024-03-28T07:06:41.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4673 sec 2024-03-28T07:06:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:42 smithi086 ceph-mon[35163]: pgmap v3012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:42.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:42 smithi159 ceph-mon[36109]: pgmap v3012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:42.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:42 smithi055 ceph-mon[31863]: pgmap v3012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:42.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4674 sec 2024-03-28T07:06:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4002.852284 secs 2024-03-28T07:06:43.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4002.852284 secs 2024-03-28T07:06:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4002.852284 secs 2024-03-28T07:06:43.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4675 sec 2024-03-28T07:06:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:44 smithi086 ceph-mon[35163]: pgmap v3013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:44.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:44 smithi159 ceph-mon[36109]: pgmap v3013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:44.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:44 smithi055 ceph-mon[31863]: pgmap v3013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:44.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4676 sec 2024-03-28T07:06:45.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4677 sec 2024-03-28T07:06:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:46 smithi086 ceph-mon[35163]: pgmap v3014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:46.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:46 smithi159 ceph-mon[36109]: pgmap v3014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:46.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:46 smithi055 ceph-mon[31863]: pgmap v3014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:06:46.765 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4678 sec 2024-03-28T07:06:47.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4679 sec 2024-03-28T07:06:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:48 smithi086 ceph-mon[35163]: pgmap v3015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4007.852407 secs 2024-03-28T07:06:48.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:48 smithi159 ceph-mon[36109]: pgmap v3015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:48.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4007.852407 secs 2024-03-28T07:06:48.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:48 smithi055 ceph-mon[31863]: pgmap v3015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:48.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4007.852407 secs 2024-03-28T07:06:48.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4680 sec 2024-03-28T07:06:49.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4681 sec 2024-03-28T07:06:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:50 smithi086 ceph-mon[35163]: pgmap v3016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:06:50.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:50 smithi159 ceph-mon[36109]: pgmap v3016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:50.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:06:50.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:50 smithi055 ceph-mon[31863]: pgmap v3016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:06:50.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:06:50.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4682 sec 2024-03-28T07:06:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:06:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:06:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:06:51.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:06:51.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:06:51.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:06:51.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:06:51.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:06:51.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:06:51.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4683 sec 2024-03-28T07:06:52.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:52 smithi055 ceph-mon[31863]: pgmap v3017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:06:52.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:52 smithi055 ceph-mon[31863]: pgmap v3018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:52.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4684 sec 2024-03-28T07:06:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:52 smithi086 ceph-mon[35163]: pgmap v3017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:06:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:52 smithi086 ceph-mon[35163]: pgmap v3018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:52.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:52 smithi159 ceph-mon[36109]: pgmap v3017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:06:52.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:52 smithi159 ceph-mon[36109]: pgmap v3018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:06:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4012.852526 secs 2024-03-28T07:06:53.724 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4012.852526 secs 2024-03-28T07:06:53.766 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4685 sec 2024-03-28T07:06:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4012.852526 secs 2024-03-28T07:06:54.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:54 smithi055 ceph-mon[31863]: pgmap v3019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:06:54.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4686 sec 2024-03-28T07:06:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:54 smithi086 ceph-mon[35163]: pgmap v3019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:06:54.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:54 smithi159 ceph-mon[36109]: pgmap v3019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:06:55.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4687 sec 2024-03-28T07:06:56.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:56 smithi055 ceph-mon[31863]: pgmap v3020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:56.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4688 sec 2024-03-28T07:06:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:56 smithi086 ceph-mon[35163]: pgmap v3020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:56.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:56 smithi159 ceph-mon[36109]: pgmap v3020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:57.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4689 sec 2024-03-28T07:06:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:58 smithi055 ceph-mon[31863]: pgmap v3021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:58.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:06:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4017.852604 secs 2024-03-28T07:06:58.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4690 sec 2024-03-28T07:06:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:58 smithi086 ceph-mon[35163]: pgmap v3021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:06:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4017.852604 secs 2024-03-28T07:06:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:58 smithi159 ceph-mon[36109]: pgmap v3021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:06:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:06:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4017.852604 secs 2024-03-28T07:06:59.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4691 sec 2024-03-28T07:07:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:00 smithi055 ceph-mon[31863]: pgmap v3022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:07:00.767 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4692 sec 2024-03-28T07:07:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:00 smithi086 ceph-mon[35163]: pgmap v3022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:07:00.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:00 smithi159 ceph-mon[36109]: pgmap v3022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:07:01.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4693 sec 2024-03-28T07:07:02.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4694 sec 2024-03-28T07:07:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:02 smithi086 ceph-mon[35163]: pgmap v3023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:07:02.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:02 smithi159 ceph-mon[36109]: pgmap v3023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:07:02.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:02 smithi055 ceph-mon[31863]: pgmap v3023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:07:03.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4695 sec 2024-03-28T07:07:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4022.852678 secs 2024-03-28T07:07:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4022.852678 secs 2024-03-28T07:07:03.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4022.852678 secs 2024-03-28T07:07:04.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4696 sec 2024-03-28T07:07:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:04 smithi086 ceph-mon[35163]: pgmap v3024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:04.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:04 smithi159 ceph-mon[36109]: pgmap v3024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:04.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:04 smithi055 ceph-mon[31863]: pgmap v3024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:05.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4697 sec 2024-03-28T07:07:06.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4698 sec 2024-03-28T07:07:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:06 smithi086 ceph-mon[35163]: pgmap v3025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:06.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:06 smithi159 ceph-mon[36109]: pgmap v3025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:06.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:06 smithi055 ceph-mon[31863]: pgmap v3025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:07.768 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4699 sec 2024-03-28T07:07:08.678 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:08 smithi055 ceph-mon[31863]: pgmap v3026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:08.678 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4027.852824 secs 2024-03-28T07:07:08.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4700 sec 2024-03-28T07:07:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:08 smithi086 ceph-mon[35163]: pgmap v3026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4027.852824 secs 2024-03-28T07:07:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:08 smithi159 ceph-mon[36109]: pgmap v3026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4027.852824 secs 2024-03-28T07:07:09.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4701 sec 2024-03-28T07:07:10.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4702 sec 2024-03-28T07:07:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:10 smithi086 ceph-mon[35163]: pgmap v3027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:10.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:10 smithi159 ceph-mon[36109]: pgmap v3027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:10.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:10 smithi055 ceph-mon[31863]: pgmap v3027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:11.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4703 sec 2024-03-28T07:07:12.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4704 sec 2024-03-28T07:07:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:12 smithi086 ceph-mon[35163]: pgmap v3028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:12.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:12 smithi159 ceph-mon[36109]: pgmap v3028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:12.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:12 smithi055 ceph-mon[31863]: pgmap v3028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:13.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4032.852944 secs 2024-03-28T07:07:13.769 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4705 sec 2024-03-28T07:07:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4032.852944 secs 2024-03-28T07:07:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4032.852944 secs 2024-03-28T07:07:14.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4706 sec 2024-03-28T07:07:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:14 smithi086 ceph-mon[35163]: pgmap v3029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:14.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:14 smithi159 ceph-mon[36109]: pgmap v3029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:14.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:14 smithi055 ceph-mon[31863]: pgmap v3029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:15.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4707 sec 2024-03-28T07:07:16.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4708 sec 2024-03-28T07:07:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:16 smithi086 ceph-mon[35163]: pgmap v3030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:16.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:16 smithi159 ceph-mon[36109]: pgmap v3030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:16.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:16 smithi055 ceph-mon[31863]: pgmap v3030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:17.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4709 sec 2024-03-28T07:07:18.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4710 sec 2024-03-28T07:07:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:18 smithi086 ceph-mon[35163]: pgmap v3031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4037.853065 secs 2024-03-28T07:07:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:18 smithi159 ceph-mon[36109]: pgmap v3031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4037.853065 secs 2024-03-28T07:07:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:18 smithi055 ceph-mon[31863]: pgmap v3031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4037.853065 secs 2024-03-28T07:07:19.770 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4711 sec 2024-03-28T07:07:20.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4712 sec 2024-03-28T07:07:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:20 smithi086 ceph-mon[35163]: pgmap v3032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:20.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:20 smithi159 ceph-mon[36109]: pgmap v3032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:20.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:20 smithi055 ceph-mon[31863]: pgmap v3032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:21.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4713 sec 2024-03-28T07:07:22.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4714 sec 2024-03-28T07:07:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:22 smithi086 ceph-mon[35163]: pgmap v3033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:22.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:22 smithi159 ceph-mon[36109]: pgmap v3033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:22.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:22 smithi055 ceph-mon[31863]: pgmap v3033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:23.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4715 sec 2024-03-28T07:07:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4042.853146 secs 2024-03-28T07:07:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4042.853146 secs 2024-03-28T07:07:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4042.853146 secs 2024-03-28T07:07:24.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4716 sec 2024-03-28T07:07:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:24 smithi086 ceph-mon[35163]: pgmap v3034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:24.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:24 smithi159 ceph-mon[36109]: pgmap v3034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:24.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:24 smithi055 ceph-mon[31863]: pgmap v3034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:25.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4717 sec 2024-03-28T07:07:26.771 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4718 sec 2024-03-28T07:07:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:26 smithi086 ceph-mon[35163]: pgmap v3035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:26.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:26 smithi159 ceph-mon[36109]: pgmap v3035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:26.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:26 smithi055 ceph-mon[31863]: pgmap v3035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:27.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4719 sec 2024-03-28T07:07:28.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4720 sec 2024-03-28T07:07:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:28 smithi086 ceph-mon[35163]: pgmap v3036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4047.853260 secs 2024-03-28T07:07:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:28 smithi159 ceph-mon[36109]: pgmap v3036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4047.853260 secs 2024-03-28T07:07:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:28 smithi055 ceph-mon[31863]: pgmap v3036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4047.853260 secs 2024-03-28T07:07:29.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4721 sec 2024-03-28T07:07:30.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4722 sec 2024-03-28T07:07:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:30 smithi086 ceph-mon[35163]: pgmap v3037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:30.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:30 smithi159 ceph-mon[36109]: pgmap v3037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:30.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:30 smithi055 ceph-mon[31863]: pgmap v3037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:31.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4723 sec 2024-03-28T07:07:32.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4724 sec 2024-03-28T07:07:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:32 smithi086 ceph-mon[35163]: pgmap v3038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:32.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:32 smithi159 ceph-mon[36109]: pgmap v3038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:32.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:32 smithi055 ceph-mon[31863]: pgmap v3038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:33.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4725 sec 2024-03-28T07:07:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4052.853281 secs 2024-03-28T07:07:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4052.853281 secs 2024-03-28T07:07:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4052.853281 secs 2024-03-28T07:07:34.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4726 sec 2024-03-28T07:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:34 smithi086 ceph-mon[35163]: pgmap v3039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:34 smithi159 ceph-mon[36109]: pgmap v3039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:34 smithi055 ceph-mon[31863]: pgmap v3039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:35.772 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4727 sec 2024-03-28T07:07:36.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4728 sec 2024-03-28T07:07:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:36 smithi086 ceph-mon[35163]: pgmap v3040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:36.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:36 smithi159 ceph-mon[36109]: pgmap v3040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:36.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:36 smithi055 ceph-mon[31863]: pgmap v3040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:37.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4729 sec 2024-03-28T07:07:38.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4730 sec 2024-03-28T07:07:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:38 smithi086 ceph-mon[35163]: pgmap v3041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4057.853402 secs 2024-03-28T07:07:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:38 smithi159 ceph-mon[36109]: pgmap v3041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4057.853402 secs 2024-03-28T07:07:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:38 smithi055 ceph-mon[31863]: pgmap v3041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4057.853402 secs 2024-03-28T07:07:39.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4731 sec 2024-03-28T07:07:40.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4732 sec 2024-03-28T07:07:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:40 smithi086 ceph-mon[35163]: pgmap v3042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:40 smithi159 ceph-mon[36109]: pgmap v3042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:40 smithi055 ceph-mon[31863]: pgmap v3042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:41.773 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4733 sec 2024-03-28T07:07:42.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4734 sec 2024-03-28T07:07:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:42 smithi086 ceph-mon[35163]: pgmap v3043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:42.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:42 smithi159 ceph-mon[36109]: pgmap v3043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:42.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:42 smithi055 ceph-mon[31863]: pgmap v3043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:07:43.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4735 sec 2024-03-28T07:07:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4062.853524 secs 2024-03-28T07:07:44.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4062.853524 secs 2024-03-28T07:07:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4062.853524 secs 2024-03-28T07:07:44.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4736 sec 2024-03-28T07:07:44.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:44 smithi055 ceph-mon[31863]: pgmap v3044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:44 smithi086 ceph-mon[35163]: pgmap v3044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:44 smithi159 ceph-mon[36109]: pgmap v3044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:45.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4737 sec 2024-03-28T07:07:46.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4738 sec 2024-03-28T07:07:46.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:46 smithi055 ceph-mon[31863]: pgmap v3045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:46 smithi086 ceph-mon[35163]: pgmap v3045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:46 smithi159 ceph-mon[36109]: pgmap v3045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:47.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4739 sec 2024-03-28T07:07:48.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4740 sec 2024-03-28T07:07:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:48 smithi055 ceph-mon[31863]: pgmap v3046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4067.853581 secs 2024-03-28T07:07:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:48 smithi086 ceph-mon[35163]: pgmap v3046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4067.853581 secs 2024-03-28T07:07:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:48 smithi159 ceph-mon[36109]: pgmap v3046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4067.853581 secs 2024-03-28T07:07:49.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4741 sec 2024-03-28T07:07:50.774 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4742 sec 2024-03-28T07:07:50.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:50 smithi055 ceph-mon[31863]: pgmap v3047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:50 smithi086 ceph-mon[35163]: pgmap v3047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:50 smithi159 ceph-mon[36109]: pgmap v3047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:51.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4743 sec 2024-03-28T07:07:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:07:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:07:52.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:07:52.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4744 sec 2024-03-28T07:07:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:52 smithi086 ceph-mon[35163]: pgmap v3048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:52 smithi159 ceph-mon[36109]: pgmap v3048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:52 smithi055 ceph-mon[31863]: pgmap v3048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:07:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:53.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4745 sec 2024-03-28T07:07:53.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4072.853660 secs 2024-03-28T07:07:53.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:07:53.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:07:53.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4072.853660 secs 2024-03-28T07:07:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:07:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:07:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4072.853660 secs 2024-03-28T07:07:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:07:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:07:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:07:54.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4746 sec 2024-03-28T07:07:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:54 smithi086 ceph-mon[35163]: pgmap v3049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:54 smithi086 ceph-mon[35163]: pgmap v3050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:54 smithi086 ceph-mon[35163]: pgmap v3051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:54 smithi159 ceph-mon[36109]: pgmap v3049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:54 smithi159 ceph-mon[36109]: pgmap v3050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:54 smithi159 ceph-mon[36109]: pgmap v3051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:54 smithi055 ceph-mon[31863]: pgmap v3049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:54 smithi055 ceph-mon[31863]: pgmap v3050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:54 smithi055 ceph-mon[31863]: pgmap v3051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:07:55.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4747 sec 2024-03-28T07:07:56.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4748 sec 2024-03-28T07:07:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:56 smithi086 ceph-mon[35163]: pgmap v3052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:07:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:56 smithi159 ceph-mon[36109]: pgmap v3052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:07:57.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:56 smithi055 ceph-mon[31863]: pgmap v3052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:07:57.775 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4749 sec 2024-03-28T07:07:58.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4750 sec 2024-03-28T07:07:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4077.853720 secs 2024-03-28T07:07:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:07:58 smithi086 ceph-mon[35163]: pgmap v3053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4077.853720 secs 2024-03-28T07:07:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:07:58 smithi159 ceph-mon[36109]: pgmap v3053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4077.853720 secs 2024-03-28T07:07:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:07:58 smithi055 ceph-mon[31863]: pgmap v3053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:07:59.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4751 sec 2024-03-28T07:08:00.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4752 sec 2024-03-28T07:08:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:00 smithi086 ceph-mon[35163]: pgmap v3054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:00 smithi159 ceph-mon[36109]: pgmap v3054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:00 smithi055 ceph-mon[31863]: pgmap v3054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:01.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4753 sec 2024-03-28T07:08:02.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4754 sec 2024-03-28T07:08:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:02 smithi086 ceph-mon[35163]: pgmap v3055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:08:03.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:02 smithi159 ceph-mon[36109]: pgmap v3055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:08:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:02 smithi055 ceph-mon[31863]: pgmap v3055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:08:03.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4755 sec 2024-03-28T07:08:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4082.853796 secs 2024-03-28T07:08:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4082.853796 secs 2024-03-28T07:08:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4082.853796 secs 2024-03-28T07:08:04.776 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4756 sec 2024-03-28T07:08:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:04 smithi086 ceph-mon[35163]: pgmap v3056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:08:05.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:04 smithi159 ceph-mon[36109]: pgmap v3056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:08:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:04 smithi055 ceph-mon[31863]: pgmap v3056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:08:05.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4757 sec 2024-03-28T07:08:06.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4758 sec 2024-03-28T07:08:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:06 smithi086 ceph-mon[35163]: pgmap v3057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:06 smithi159 ceph-mon[36109]: pgmap v3057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:06 smithi055 ceph-mon[31863]: pgmap v3057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:07.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4759 sec 2024-03-28T07:08:08.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4760 sec 2024-03-28T07:08:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4087.853886 secs 2024-03-28T07:08:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:08 smithi086 ceph-mon[35163]: pgmap v3058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4087.853886 secs 2024-03-28T07:08:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:08 smithi159 ceph-mon[36109]: pgmap v3058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4087.853886 secs 2024-03-28T07:08:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:08 smithi055 ceph-mon[31863]: pgmap v3058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:09.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4761 sec 2024-03-28T07:08:10.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4762 sec 2024-03-28T07:08:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:10 smithi086 ceph-mon[35163]: pgmap v3059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:10 smithi159 ceph-mon[36109]: pgmap v3059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:10 smithi055 ceph-mon[31863]: pgmap v3059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:11.777 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4763 sec 2024-03-28T07:08:12.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4764 sec 2024-03-28T07:08:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:12 smithi086 ceph-mon[35163]: pgmap v3060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:12 smithi159 ceph-mon[36109]: pgmap v3060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:12 smithi055 ceph-mon[31863]: pgmap v3060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:13.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4765 sec 2024-03-28T07:08:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4092.853963 secs 2024-03-28T07:08:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4092.853963 secs 2024-03-28T07:08:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4092.853963 secs 2024-03-28T07:08:14.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4766 sec 2024-03-28T07:08:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:14 smithi086 ceph-mon[35163]: pgmap v3061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:14 smithi159 ceph-mon[36109]: pgmap v3061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:14 smithi055 ceph-mon[31863]: pgmap v3061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:15.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4767 sec 2024-03-28T07:08:16.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4768 sec 2024-03-28T07:08:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:16 smithi086 ceph-mon[35163]: pgmap v3062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:17.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:16 smithi159 ceph-mon[36109]: pgmap v3062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:16 smithi055 ceph-mon[31863]: pgmap v3062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:17.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4769 sec 2024-03-28T07:08:18.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4770 sec 2024-03-28T07:08:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4097.854024 secs 2024-03-28T07:08:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:18 smithi086 ceph-mon[35163]: pgmap v3063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4097.854024 secs 2024-03-28T07:08:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:18 smithi159 ceph-mon[36109]: pgmap v3063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4097.854024 secs 2024-03-28T07:08:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:18 smithi055 ceph-mon[31863]: pgmap v3063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:19.778 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4771 sec 2024-03-28T07:08:20.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4772 sec 2024-03-28T07:08:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:20 smithi086 ceph-mon[35163]: pgmap v3064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:21.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:20 smithi159 ceph-mon[36109]: pgmap v3064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:20 smithi055 ceph-mon[31863]: pgmap v3064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:21.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4773 sec 2024-03-28T07:08:22.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4774 sec 2024-03-28T07:08:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:22 smithi086 ceph-mon[35163]: pgmap v3065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:22 smithi159 ceph-mon[36109]: pgmap v3065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:22 smithi055 ceph-mon[31863]: pgmap v3065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:23.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4775 sec 2024-03-28T07:08:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4102.854091 secs 2024-03-28T07:08:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4102.854091 secs 2024-03-28T07:08:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4102.854091 secs 2024-03-28T07:08:24.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4776 sec 2024-03-28T07:08:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:24 smithi086 ceph-mon[35163]: pgmap v3066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:24 smithi159 ceph-mon[36109]: pgmap v3066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:24 smithi055 ceph-mon[31863]: pgmap v3066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:25.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4777 sec 2024-03-28T07:08:26.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4778 sec 2024-03-28T07:08:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:26 smithi086 ceph-mon[35163]: pgmap v3067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:26 smithi159 ceph-mon[36109]: pgmap v3067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:26 smithi055 ceph-mon[31863]: pgmap v3067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:27.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4779 sec 2024-03-28T07:08:28.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:27 smithi055 ceph-mon[31863]: pgmap v3068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:27 smithi086 ceph-mon[35163]: pgmap v3068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:28.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:27 smithi159 ceph-mon[36109]: pgmap v3068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:28.779 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4780 sec 2024-03-28T07:08:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4107.854166 secs 2024-03-28T07:08:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4107.854166 secs 2024-03-28T07:08:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4107.854166 secs 2024-03-28T07:08:29.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4781 sec 2024-03-28T07:08:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:29 smithi086 ceph-mon[35163]: pgmap v3069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:30.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:29 smithi159 ceph-mon[36109]: pgmap v3069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:30.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:29 smithi055 ceph-mon[31863]: pgmap v3069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:30.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4782 sec 2024-03-28T07:08:31.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4783 sec 2024-03-28T07:08:32.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4784 sec 2024-03-28T07:08:32.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:32 smithi055 ceph-mon[31863]: pgmap v3070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:32 smithi086 ceph-mon[35163]: pgmap v3070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:32 smithi159 ceph-mon[36109]: pgmap v3070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:33.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4785 sec 2024-03-28T07:08:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4112.854252 secs 2024-03-28T07:08:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4112.854252 secs 2024-03-28T07:08:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4112.854252 secs 2024-03-28T07:08:34.780 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4786 sec 2024-03-28T07:08:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:34 smithi055 ceph-mon[31863]: pgmap v3071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:34 smithi086 ceph-mon[35163]: pgmap v3071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:34 smithi159 ceph-mon[36109]: pgmap v3071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:35.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4787 sec 2024-03-28T07:08:36.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4788 sec 2024-03-28T07:08:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:36 smithi086 ceph-mon[35163]: pgmap v3072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:36 smithi159 ceph-mon[36109]: pgmap v3072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:36 smithi055 ceph-mon[31863]: pgmap v3072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:37.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4789 sec 2024-03-28T07:08:38.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4790 sec 2024-03-28T07:08:38.928 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4117.854325 secs 2024-03-28T07:08:38.928 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:38 smithi055 ceph-mon[31863]: pgmap v3073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4117.854325 secs 2024-03-28T07:08:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:38 smithi086 ceph-mon[35163]: pgmap v3073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4117.854325 secs 2024-03-28T07:08:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:38 smithi159 ceph-mon[36109]: pgmap v3073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:39.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4791 sec 2024-03-28T07:08:40.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4792 sec 2024-03-28T07:08:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:40 smithi086 ceph-mon[35163]: pgmap v3074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:41.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:40 smithi159 ceph-mon[36109]: pgmap v3074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:40 smithi055 ceph-mon[31863]: pgmap v3074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:41.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4793 sec 2024-03-28T07:08:42.781 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4794 sec 2024-03-28T07:08:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:42 smithi086 ceph-mon[35163]: pgmap v3075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:43.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:42 smithi159 ceph-mon[36109]: pgmap v3075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:42 smithi055 ceph-mon[31863]: pgmap v3075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:43.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4795 sec 2024-03-28T07:08:43.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4122.854412 secs 2024-03-28T07:08:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4122.854412 secs 2024-03-28T07:08:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4122.854412 secs 2024-03-28T07:08:44.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4796 sec 2024-03-28T07:08:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:44 smithi086 ceph-mon[35163]: pgmap v3076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:44 smithi159 ceph-mon[36109]: pgmap v3076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:44 smithi055 ceph-mon[31863]: pgmap v3076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:45.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4797 sec 2024-03-28T07:08:46.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4798 sec 2024-03-28T07:08:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:46 smithi086 ceph-mon[35163]: pgmap v3077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:46 smithi159 ceph-mon[36109]: pgmap v3077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:46 smithi055 ceph-mon[31863]: pgmap v3077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:47.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4799 sec 2024-03-28T07:08:48.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4800 sec 2024-03-28T07:08:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4127.854488 secs 2024-03-28T07:08:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:48 smithi086 ceph-mon[35163]: pgmap v3078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4127.854488 secs 2024-03-28T07:08:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:48 smithi159 ceph-mon[36109]: pgmap v3078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4127.854488 secs 2024-03-28T07:08:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:48 smithi055 ceph-mon[31863]: pgmap v3078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:49.782 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4801 sec 2024-03-28T07:08:50.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4802 sec 2024-03-28T07:08:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:50 smithi086 ceph-mon[35163]: pgmap v3079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:50 smithi159 ceph-mon[36109]: pgmap v3079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:50 smithi055 ceph-mon[31863]: pgmap v3079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:51.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4803 sec 2024-03-28T07:08:52.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4804 sec 2024-03-28T07:08:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:52 smithi086 ceph-mon[35163]: pgmap v3080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:52 smithi159 ceph-mon[36109]: pgmap v3080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:52 smithi055 ceph-mon[31863]: pgmap v3080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:53.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4805 sec 2024-03-28T07:08:53.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4132.854609 secs 2024-03-28T07:08:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4132.854609 secs 2024-03-28T07:08:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4132.854609 secs 2024-03-28T07:08:54.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4806 sec 2024-03-28T07:08:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:54 smithi086 ceph-mon[35163]: pgmap v3081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:08:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:54 smithi159 ceph-mon[36109]: pgmap v3081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:08:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:54 smithi055 ceph-mon[31863]: pgmap v3081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:08:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:08:55.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4807 sec 2024-03-28T07:08:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:55 smithi055 ceph-mon[31863]: pgmap v3082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:56.162 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.162 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.162 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:55 smithi159 ceph-mon[36109]: pgmap v3082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:55 smithi086 ceph-mon[35163]: pgmap v3082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:08:56.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4808 sec 2024-03-28T07:08:57.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4809 sec 2024-03-28T07:08:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:57 smithi086 ceph-mon[35163]: pgmap v3083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:57 smithi159 ceph-mon[36109]: pgmap v3083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:57 smithi055 ceph-mon[31863]: pgmap v3083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:08:58.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4810 sec 2024-03-28T07:08:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4137.854683 secs 2024-03-28T07:08:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4137.854683 secs 2024-03-28T07:08:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4137.854683 secs 2024-03-28T07:08:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:08:59.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4811 sec 2024-03-28T07:09:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:59 smithi086 ceph-mon[35163]: pgmap v3084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:09:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:09:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:08:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:09:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:59 smithi159 ceph-mon[36109]: pgmap v3084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:09:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:09:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:08:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:09:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:59 smithi055 ceph-mon[31863]: pgmap v3084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:09:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:09:00.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:08:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:09:00.783 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4812 sec 2024-03-28T07:09:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:00 smithi086 ceph-mon[35163]: pgmap v3085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:09:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:00 smithi086 ceph-mon[35163]: pgmap v3086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:00 smithi159 ceph-mon[36109]: pgmap v3085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:09:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:00 smithi159 ceph-mon[36109]: pgmap v3086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:00 smithi055 ceph-mon[31863]: pgmap v3085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:09:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:00 smithi055 ceph-mon[31863]: pgmap v3086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:01.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4813 sec 2024-03-28T07:09:02.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4814 sec 2024-03-28T07:09:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:02 smithi086 ceph-mon[35163]: pgmap v3087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:02 smithi159 ceph-mon[36109]: pgmap v3087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:02 smithi055 ceph-mon[31863]: pgmap v3087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:09:03.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4815 sec 2024-03-28T07:09:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4142.854805 secs 2024-03-28T07:09:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4142.854805 secs 2024-03-28T07:09:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4142.854805 secs 2024-03-28T07:09:04.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4816 sec 2024-03-28T07:09:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:04 smithi086 ceph-mon[35163]: pgmap v3088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:09:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:04 smithi159 ceph-mon[36109]: pgmap v3088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:09:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:04 smithi055 ceph-mon[31863]: pgmap v3088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:09:05.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4817 sec 2024-03-28T07:09:06.784 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4818 sec 2024-03-28T07:09:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:07 smithi086 ceph-mon[35163]: pgmap v3089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:07 smithi159 ceph-mon[36109]: pgmap v3089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:07 smithi055 ceph-mon[31863]: pgmap v3089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:07.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4819 sec 2024-03-28T07:09:08.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4820 sec 2024-03-28T07:09:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4147.854918 secs 2024-03-28T07:09:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:09 smithi086 ceph-mon[35163]: pgmap v3090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4147.854918 secs 2024-03-28T07:09:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:09 smithi159 ceph-mon[36109]: pgmap v3090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4147.854918 secs 2024-03-28T07:09:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:09 smithi055 ceph-mon[31863]: pgmap v3090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:09:09.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4821 sec 2024-03-28T07:09:10.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4822 sec 2024-03-28T07:09:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:11 smithi086 ceph-mon[35163]: pgmap v3091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:09:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:11 smithi159 ceph-mon[36109]: pgmap v3091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:09:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:11 smithi055 ceph-mon[31863]: pgmap v3091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:09:11.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4823 sec 2024-03-28T07:09:12.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4824 sec 2024-03-28T07:09:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:13 smithi086 ceph-mon[35163]: pgmap v3092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:13 smithi159 ceph-mon[36109]: pgmap v3092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:13 smithi055 ceph-mon[31863]: pgmap v3092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:13.785 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4825 sec 2024-03-28T07:09:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4152.855035 secs 2024-03-28T07:09:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4152.855035 secs 2024-03-28T07:09:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4152.855035 secs 2024-03-28T07:09:14.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4826 sec 2024-03-28T07:09:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:15 smithi086 ceph-mon[35163]: pgmap v3093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:15 smithi159 ceph-mon[36109]: pgmap v3093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:15 smithi055 ceph-mon[31863]: pgmap v3093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:15.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4827 sec 2024-03-28T07:09:16.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4828 sec 2024-03-28T07:09:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:17 smithi086 ceph-mon[35163]: pgmap v3094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:17 smithi159 ceph-mon[36109]: pgmap v3094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:17 smithi055 ceph-mon[31863]: pgmap v3094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:17.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4829 sec 2024-03-28T07:09:18.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4830 sec 2024-03-28T07:09:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4157.855098 secs 2024-03-28T07:09:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:19 smithi086 ceph-mon[35163]: pgmap v3095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4157.855098 secs 2024-03-28T07:09:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:19 smithi159 ceph-mon[36109]: pgmap v3095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4157.855098 secs 2024-03-28T07:09:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:19 smithi055 ceph-mon[31863]: pgmap v3095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:19.786 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4831 sec 2024-03-28T07:09:20.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4832 sec 2024-03-28T07:09:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:21 smithi086 ceph-mon[35163]: pgmap v3096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:21 smithi159 ceph-mon[36109]: pgmap v3096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:21 smithi055 ceph-mon[31863]: pgmap v3096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:21.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4833 sec 2024-03-28T07:09:22.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4834 sec 2024-03-28T07:09:23.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:23 smithi055 ceph-mon[31863]: pgmap v3097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:23.491 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:23 smithi159 ceph-mon[36109]: pgmap v3097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:23 smithi086 ceph-mon[35163]: pgmap v3097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:23.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4835 sec 2024-03-28T07:09:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4162.855214 secs 2024-03-28T07:09:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4162.855214 secs 2024-03-28T07:09:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4162.855214 secs 2024-03-28T07:09:24.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4836 sec 2024-03-28T07:09:25.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:25 smithi055 ceph-mon[31863]: pgmap v3098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:25 smithi086 ceph-mon[35163]: pgmap v3098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:25.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:25 smithi159 ceph-mon[36109]: pgmap v3098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:25.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4837 sec 2024-03-28T07:09:26.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4838 sec 2024-03-28T07:09:27.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:27 smithi055 ceph-mon[31863]: pgmap v3099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:27 smithi086 ceph-mon[35163]: pgmap v3099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:27.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:27 smithi159 ceph-mon[36109]: pgmap v3099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:27.787 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4839 sec 2024-03-28T07:09:28.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4167.855295 secs 2024-03-28T07:09:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4167.855295 secs 2024-03-28T07:09:28.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4167.855295 secs 2024-03-28T07:09:28.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4840 sec 2024-03-28T07:09:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:29 smithi055 ceph-mon[31863]: pgmap v3100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:29 smithi086 ceph-mon[35163]: pgmap v3100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:29.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:29 smithi159 ceph-mon[36109]: pgmap v3100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:29.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4841 sec 2024-03-28T07:09:30.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4842 sec 2024-03-28T07:09:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:31 smithi086 ceph-mon[35163]: pgmap v3101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:31.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:31 smithi159 ceph-mon[36109]: pgmap v3101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:31.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:31 smithi055 ceph-mon[31863]: pgmap v3101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:31.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4843 sec 2024-03-28T07:09:32.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4844 sec 2024-03-28T07:09:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:33 smithi086 ceph-mon[35163]: pgmap v3102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4172.855421 secs 2024-03-28T07:09:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:33 smithi159 ceph-mon[36109]: pgmap v3102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4172.855421 secs 2024-03-28T07:09:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:33 smithi055 ceph-mon[31863]: pgmap v3102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4172.855421 secs 2024-03-28T07:09:33.788 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4845 sec 2024-03-28T07:09:34.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4846 sec 2024-03-28T07:09:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:35 smithi086 ceph-mon[35163]: pgmap v3103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:35 smithi159 ceph-mon[36109]: pgmap v3103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:35 smithi055 ceph-mon[31863]: pgmap v3103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:35.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4847 sec 2024-03-28T07:09:36.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4848 sec 2024-03-28T07:09:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:37 smithi086 ceph-mon[35163]: pgmap v3104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:37.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:37 smithi159 ceph-mon[36109]: pgmap v3104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:37 smithi055 ceph-mon[31863]: pgmap v3104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:37.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4849 sec 2024-03-28T07:09:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4177.855533 secs 2024-03-28T07:09:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4177.855533 secs 2024-03-28T07:09:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4177.855533 secs 2024-03-28T07:09:38.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4850 sec 2024-03-28T07:09:39.527 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:39 smithi055 ceph-mon[31863]: pgmap v3105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:39 smithi086 ceph-mon[35163]: pgmap v3105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:39 smithi159 ceph-mon[36109]: pgmap v3105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:39.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4851 sec 2024-03-28T07:09:40.789 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4852 sec 2024-03-28T07:09:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:41 smithi086 ceph-mon[35163]: pgmap v3106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:41.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:41 smithi159 ceph-mon[36109]: pgmap v3106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:41.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:41 smithi055 ceph-mon[31863]: pgmap v3106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:41.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4853 sec 2024-03-28T07:09:42.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4854 sec 2024-03-28T07:09:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:43 smithi086 ceph-mon[35163]: pgmap v3107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4182.855673 secs 2024-03-28T07:09:43.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:43 smithi159 ceph-mon[36109]: pgmap v3107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:43.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4182.855673 secs 2024-03-28T07:09:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:43 smithi055 ceph-mon[31863]: pgmap v3107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4182.855673 secs 2024-03-28T07:09:43.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4855 sec 2024-03-28T07:09:44.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4856 sec 2024-03-28T07:09:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:45 smithi086 ceph-mon[35163]: pgmap v3108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:45.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:45 smithi159 ceph-mon[36109]: pgmap v3108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:45.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:45 smithi055 ceph-mon[31863]: pgmap v3108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:45.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4857 sec 2024-03-28T07:09:46.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4858 sec 2024-03-28T07:09:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:47 smithi086 ceph-mon[35163]: pgmap v3109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:47.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:47 smithi159 ceph-mon[36109]: pgmap v3109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:47.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:47 smithi055 ceph-mon[31863]: pgmap v3109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:47.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4859 sec 2024-03-28T07:09:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4187.855747 secs 2024-03-28T07:09:48.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4187.855747 secs 2024-03-28T07:09:48.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4187.855747 secs 2024-03-28T07:09:48.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4860 sec 2024-03-28T07:09:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:49 smithi086 ceph-mon[35163]: pgmap v3110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:49.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:49 smithi159 ceph-mon[36109]: pgmap v3110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:49.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:49 smithi055 ceph-mon[31863]: pgmap v3110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:49.790 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4861 sec 2024-03-28T07:09:50.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4862 sec 2024-03-28T07:09:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:51 smithi086 ceph-mon[35163]: pgmap v3111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:51.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:51 smithi159 ceph-mon[36109]: pgmap v3111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:51.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:51 smithi055 ceph-mon[31863]: pgmap v3111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:09:51.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4863 sec 2024-03-28T07:09:52.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4864 sec 2024-03-28T07:09:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:53 smithi086 ceph-mon[35163]: pgmap v3112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4192.855880 secs 2024-03-28T07:09:53.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:53 smithi159 ceph-mon[36109]: pgmap v3112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:53.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4192.855880 secs 2024-03-28T07:09:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:53 smithi055 ceph-mon[31863]: pgmap v3112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4192.855880 secs 2024-03-28T07:09:53.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4865 sec 2024-03-28T07:09:54.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4866 sec 2024-03-28T07:09:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:55 smithi086 ceph-mon[35163]: pgmap v3113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:55.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:55 smithi159 ceph-mon[36109]: pgmap v3113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:55.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:55 smithi055 ceph-mon[31863]: pgmap v3113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:55.791 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4867 sec 2024-03-28T07:09:56.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4868 sec 2024-03-28T07:09:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:57 smithi086 ceph-mon[35163]: pgmap v3114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:57.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:57 smithi159 ceph-mon[36109]: pgmap v3114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:57.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:57 smithi055 ceph-mon[31863]: pgmap v3114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:57.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4869 sec 2024-03-28T07:09:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4197.855943 secs 2024-03-28T07:09:58.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4197.855943 secs 2024-03-28T07:09:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4197.855943 secs 2024-03-28T07:09:58.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4870 sec 2024-03-28T07:09:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:09:59 smithi086 ceph-mon[35163]: pgmap v3115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:59.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:09:59 smithi159 ceph-mon[36109]: pgmap v3115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:59.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:09:59 smithi055 ceph-mon[31863]: pgmap v3115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:09:59.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4871 sec 2024-03-28T07:10:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:10:00.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:10:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:10:00.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4872 sec 2024-03-28T07:10:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:01 smithi086 ceph-mon[35163]: pgmap v3116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:10:01.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:01 smithi159 ceph-mon[36109]: pgmap v3116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:01.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:10:01.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:01 smithi055 ceph-mon[31863]: pgmap v3116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:01.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:10:01.792 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4873 sec 2024-03-28T07:10:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:02 smithi086 ceph-mon[35163]: pgmap v3117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:02 smithi086 ceph-mon[35163]: pgmap v3118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:10:02.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:10:02.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:10:02.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:02 smithi159 ceph-mon[36109]: pgmap v3117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:02.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:02 smithi159 ceph-mon[36109]: pgmap v3118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:02.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:10:02.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:10:02.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:10:02.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:02 smithi055 ceph-mon[31863]: pgmap v3117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:02.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:02 smithi055 ceph-mon[31863]: pgmap v3118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:02.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:10:02.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4874 sec 2024-03-28T07:10:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4202.856008 secs 2024-03-28T07:10:03.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4202.856008 secs 2024-03-28T07:10:03.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4202.856008 secs 2024-03-28T07:10:03.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4875 sec 2024-03-28T07:10:04.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:04 smithi055 ceph-mon[31863]: pgmap v3119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:04.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4876 sec 2024-03-28T07:10:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:04 smithi086 ceph-mon[35163]: pgmap v3119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:04.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:04 smithi159 ceph-mon[36109]: pgmap v3119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:05.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4877 sec 2024-03-28T07:10:06.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4878 sec 2024-03-28T07:10:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:06 smithi086 ceph-mon[35163]: pgmap v3120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:06 smithi159 ceph-mon[36109]: pgmap v3120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:06 smithi055 ceph-mon[31863]: pgmap v3120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:07.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4879 sec 2024-03-28T07:10:08.793 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4880 sec 2024-03-28T07:10:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4207.856138 secs 2024-03-28T07:10:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:08 smithi086 ceph-mon[35163]: pgmap v3121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:10:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4207.856138 secs 2024-03-28T07:10:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:08 smithi159 ceph-mon[36109]: pgmap v3121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:10:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4207.856138 secs 2024-03-28T07:10:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:08 smithi055 ceph-mon[31863]: pgmap v3121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:10:09.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4881 sec 2024-03-28T07:10:10.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4882 sec 2024-03-28T07:10:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:10 smithi086 ceph-mon[35163]: pgmap v3122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:10 smithi159 ceph-mon[36109]: pgmap v3122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:10 smithi055 ceph-mon[31863]: pgmap v3122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:11.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4883 sec 2024-03-28T07:10:12.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4884 sec 2024-03-28T07:10:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:12 smithi086 ceph-mon[35163]: pgmap v3123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:10:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:12 smithi159 ceph-mon[36109]: pgmap v3123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:10:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:12 smithi055 ceph-mon[31863]: pgmap v3123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:10:13.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4885 sec 2024-03-28T07:10:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4212.856263 secs 2024-03-28T07:10:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4212.856263 secs 2024-03-28T07:10:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4212.856263 secs 2024-03-28T07:10:14.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4886 sec 2024-03-28T07:10:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:14 smithi055 ceph-mon[31863]: pgmap v3124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:14 smithi086 ceph-mon[35163]: pgmap v3124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:14 smithi159 ceph-mon[36109]: pgmap v3124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:15.794 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4887 sec 2024-03-28T07:10:16.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4888 sec 2024-03-28T07:10:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:16 smithi055 ceph-mon[31863]: pgmap v3125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:16 smithi086 ceph-mon[35163]: pgmap v3125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:16 smithi159 ceph-mon[36109]: pgmap v3125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:17.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4889 sec 2024-03-28T07:10:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:17 smithi086 ceph-mon[35163]: pgmap v3126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:18.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:17 smithi159 ceph-mon[36109]: pgmap v3126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:18.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:17 smithi055 ceph-mon[31863]: pgmap v3126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:18.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4890 sec 2024-03-28T07:10:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4217.856380 secs 2024-03-28T07:10:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4217.856380 secs 2024-03-28T07:10:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4217.856380 secs 2024-03-28T07:10:19.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4891 sec 2024-03-28T07:10:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:19 smithi086 ceph-mon[35163]: pgmap v3127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:20.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:19 smithi159 ceph-mon[36109]: pgmap v3127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:20.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:19 smithi055 ceph-mon[31863]: pgmap v3127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:20.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4892 sec 2024-03-28T07:10:21.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4893 sec 2024-03-28T07:10:22.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4894 sec 2024-03-28T07:10:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:22 smithi086 ceph-mon[35163]: pgmap v3128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:22 smithi159 ceph-mon[36109]: pgmap v3128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:22 smithi055 ceph-mon[31863]: pgmap v3128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:23.795 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4895 sec 2024-03-28T07:10:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4222.856506 secs 2024-03-28T07:10:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4222.856506 secs 2024-03-28T07:10:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4222.856506 secs 2024-03-28T07:10:24.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4896 sec 2024-03-28T07:10:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:24 smithi086 ceph-mon[35163]: pgmap v3129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:24 smithi159 ceph-mon[36109]: pgmap v3129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:24 smithi055 ceph-mon[31863]: pgmap v3129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:25.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4897 sec 2024-03-28T07:10:26.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4898 sec 2024-03-28T07:10:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:26 smithi086 ceph-mon[35163]: pgmap v3130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:26 smithi159 ceph-mon[36109]: pgmap v3130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:26 smithi055 ceph-mon[31863]: pgmap v3130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:27.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4899 sec 2024-03-28T07:10:28.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4900 sec 2024-03-28T07:10:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4227.856623 secs 2024-03-28T07:10:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:28 smithi055 ceph-mon[31863]: pgmap v3131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:10:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4227.856623 secs 2024-03-28T07:10:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:28 smithi086 ceph-mon[35163]: pgmap v3131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:10:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4227.856623 secs 2024-03-28T07:10:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:28 smithi159 ceph-mon[36109]: pgmap v3131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:10:29.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4901 sec 2024-03-28T07:10:30.796 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4902 sec 2024-03-28T07:10:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:30 smithi055 ceph-mon[31863]: pgmap v3132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:30 smithi086 ceph-mon[35163]: pgmap v3132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:31.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:30 smithi159 ceph-mon[36109]: pgmap v3132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:31.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4903 sec 2024-03-28T07:10:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:31 smithi086 ceph-mon[35163]: pgmap v3133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:32.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:31 smithi159 ceph-mon[36109]: pgmap v3133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:32.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:31 smithi055 ceph-mon[31863]: pgmap v3133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:32.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4904 sec 2024-03-28T07:10:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4232.856747 secs 2024-03-28T07:10:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4232.856747 secs 2024-03-28T07:10:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4232.856747 secs 2024-03-28T07:10:33.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4905 sec 2024-03-28T07:10:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:34 smithi086 ceph-mon[35163]: pgmap v3134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:34.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:34 smithi159 ceph-mon[36109]: pgmap v3134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:34 smithi055 ceph-mon[31863]: pgmap v3134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:34.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4906 sec 2024-03-28T07:10:35.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4907 sec 2024-03-28T07:10:36.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4908 sec 2024-03-28T07:10:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:36 smithi086 ceph-mon[35163]: pgmap v3135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:36 smithi159 ceph-mon[36109]: pgmap v3135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:36 smithi055 ceph-mon[31863]: pgmap v3135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:10:37.797 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4909 sec 2024-03-28T07:10:38.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4910 sec 2024-03-28T07:10:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4237.856864 secs 2024-03-28T07:10:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:38 smithi086 ceph-mon[35163]: pgmap v3136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4237.856864 secs 2024-03-28T07:10:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:38 smithi159 ceph-mon[36109]: pgmap v3136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4237.856864 secs 2024-03-28T07:10:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:38 smithi055 ceph-mon[31863]: pgmap v3136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:39.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4911 sec 2024-03-28T07:10:40.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4912 sec 2024-03-28T07:10:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:40 smithi055 ceph-mon[31863]: pgmap v3137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:40 smithi086 ceph-mon[35163]: pgmap v3137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:41.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:40 smithi159 ceph-mon[36109]: pgmap v3137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:41.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4913 sec 2024-03-28T07:10:42.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4914 sec 2024-03-28T07:10:43.123 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:42 smithi086 ceph-mon[35163]: pgmap v3138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:42 smithi055 ceph-mon[31863]: pgmap v3138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:42 smithi159 ceph-mon[36109]: pgmap v3138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:43.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4915 sec 2024-03-28T07:10:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4242.856939 secs 2024-03-28T07:10:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4242.856939 secs 2024-03-28T07:10:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4242.856939 secs 2024-03-28T07:10:44.798 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4916 sec 2024-03-28T07:10:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:44 smithi055 ceph-mon[31863]: pgmap v3139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:44 smithi086 ceph-mon[35163]: pgmap v3139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:44 smithi159 ceph-mon[36109]: pgmap v3139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:45.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4917 sec 2024-03-28T07:10:46.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:45 smithi055 ceph-mon[31863]: pgmap v3140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:45 smithi086 ceph-mon[35163]: pgmap v3140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:46.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:45 smithi159 ceph-mon[36109]: pgmap v3140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:46.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4918 sec 2024-03-28T07:10:47.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4919 sec 2024-03-28T07:10:48.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4920 sec 2024-03-28T07:10:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4247.857000 secs 2024-03-28T07:10:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:48 smithi086 ceph-mon[35163]: pgmap v3141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4247.857000 secs 2024-03-28T07:10:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:48 smithi159 ceph-mon[36109]: pgmap v3141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4247.857000 secs 2024-03-28T07:10:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:48 smithi055 ceph-mon[31863]: pgmap v3141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:49.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4921 sec 2024-03-28T07:10:50.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4922 sec 2024-03-28T07:10:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:50 smithi086 ceph-mon[35163]: pgmap v3142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:50 smithi159 ceph-mon[36109]: pgmap v3142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:50 smithi055 ceph-mon[31863]: pgmap v3142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:51.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4923 sec 2024-03-28T07:10:52.799 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4924 sec 2024-03-28T07:10:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:52 smithi055 ceph-mon[31863]: pgmap v3143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:52 smithi086 ceph-mon[35163]: pgmap v3143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:52 smithi159 ceph-mon[36109]: pgmap v3143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:53.800 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4925 sec 2024-03-28T07:10:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4252.857088 secs 2024-03-28T07:10:54.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4252.857088 secs 2024-03-28T07:10:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4252.857088 secs 2024-03-28T07:10:54.800 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4926 sec 2024-03-28T07:10:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:54 smithi055 ceph-mon[31863]: pgmap v3144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:54 smithi086 ceph-mon[35163]: pgmap v3144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:54 smithi159 ceph-mon[36109]: pgmap v3144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:55.800 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4927 sec 2024-03-28T07:10:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:55 smithi055 ceph-mon[31863]: pgmap v3145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:55 smithi086 ceph-mon[35163]: pgmap v3145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:55 smithi159 ceph-mon[36109]: pgmap v3145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:10:56.800 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4928 sec 2024-03-28T07:10:57.800 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4929 sec 2024-03-28T07:10:58.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4930 sec 2024-03-28T07:10:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4257.857148 secs 2024-03-28T07:10:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:10:58 smithi086 ceph-mon[35163]: pgmap v3146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4257.857148 secs 2024-03-28T07:10:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:10:58 smithi159 ceph-mon[36109]: pgmap v3146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4257.857148 secs 2024-03-28T07:10:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:10:58 smithi055 ceph-mon[31863]: pgmap v3146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:10:59.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4931 sec 2024-03-28T07:11:00.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4932 sec 2024-03-28T07:11:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:00 smithi055 ceph-mon[31863]: pgmap v3147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:00 smithi086 ceph-mon[35163]: pgmap v3147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:00 smithi159 ceph-mon[36109]: pgmap v3147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:01.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4933 sec 2024-03-28T07:11:02.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4934 sec 2024-03-28T07:11:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:02 smithi055 ceph-mon[31863]: pgmap v3148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:11:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:02 smithi086 ceph-mon[35163]: pgmap v3148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:11:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:02 smithi159 ceph-mon[36109]: pgmap v3148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:11:03.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4935 sec 2024-03-28T07:11:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4262.857223 secs 2024-03-28T07:11:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:11:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:11:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:11:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4262.857223 secs 2024-03-28T07:11:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:11:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:11:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:11:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4262.857223 secs 2024-03-28T07:11:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:11:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:11:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:11:04.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4936 sec 2024-03-28T07:11:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:04 smithi055 ceph-mon[31863]: pgmap v3149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:04 smithi055 ceph-mon[31863]: pgmap v3150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:04 smithi086 ceph-mon[35163]: pgmap v3149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:04 smithi086 ceph-mon[35163]: pgmap v3150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:04 smithi159 ceph-mon[36109]: pgmap v3149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:04 smithi159 ceph-mon[36109]: pgmap v3150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:05.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4937 sec 2024-03-28T07:11:06.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:05 smithi055 ceph-mon[31863]: pgmap v3151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:05 smithi086 ceph-mon[35163]: pgmap v3151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:06.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:05 smithi159 ceph-mon[36109]: pgmap v3151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:06.801 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4938 sec 2024-03-28T07:11:07.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4939 sec 2024-03-28T07:11:08.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4940 sec 2024-03-28T07:11:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4267.857344 secs 2024-03-28T07:11:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:08 smithi086 ceph-mon[35163]: pgmap v3152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4267.857344 secs 2024-03-28T07:11:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:08 smithi159 ceph-mon[36109]: pgmap v3152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4267.857344 secs 2024-03-28T07:11:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:08 smithi055 ceph-mon[31863]: pgmap v3152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:09.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4941 sec 2024-03-28T07:11:10.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4942 sec 2024-03-28T07:11:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:10 smithi086 ceph-mon[35163]: pgmap v3153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:10.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:10 smithi159 ceph-mon[36109]: pgmap v3153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:10.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:10 smithi055 ceph-mon[31863]: pgmap v3153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:11.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4943 sec 2024-03-28T07:11:12.802 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4944 sec 2024-03-28T07:11:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:12 smithi086 ceph-mon[35163]: pgmap v3154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:12.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:12 smithi159 ceph-mon[36109]: pgmap v3154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:12.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:12 smithi055 ceph-mon[31863]: pgmap v3154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:13.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4945 sec 2024-03-28T07:11:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4272.857403 secs 2024-03-28T07:11:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4272.857403 secs 2024-03-28T07:11:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4272.857403 secs 2024-03-28T07:11:14.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4946 sec 2024-03-28T07:11:14.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:14 smithi055 ceph-mon[31863]: pgmap v3155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:11:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:14 smithi086 ceph-mon[35163]: pgmap v3155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:11:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:14 smithi159 ceph-mon[36109]: pgmap v3155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:11:15.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4947 sec 2024-03-28T07:11:16.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4948 sec 2024-03-28T07:11:16.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:16 smithi055 ceph-mon[31863]: pgmap v3156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:16 smithi086 ceph-mon[35163]: pgmap v3156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:17.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:16 smithi159 ceph-mon[36109]: pgmap v3156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:17.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4949 sec 2024-03-28T07:11:18.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4950 sec 2024-03-28T07:11:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4277.857520 secs 2024-03-28T07:11:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:18 smithi055 ceph-mon[31863]: pgmap v3157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:11:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4277.857520 secs 2024-03-28T07:11:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:18 smithi086 ceph-mon[35163]: pgmap v3157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:11:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4277.857520 secs 2024-03-28T07:11:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:18 smithi159 ceph-mon[36109]: pgmap v3157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:11:19.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4951 sec 2024-03-28T07:11:20.803 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4952 sec 2024-03-28T07:11:20.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:20 smithi055 ceph-mon[31863]: pgmap v3158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:20 smithi086 ceph-mon[35163]: pgmap v3158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:21.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:20 smithi159 ceph-mon[36109]: pgmap v3158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:21.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4953 sec 2024-03-28T07:11:22.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4954 sec 2024-03-28T07:11:22.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:22 smithi055 ceph-mon[31863]: pgmap v3159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:22 smithi086 ceph-mon[35163]: pgmap v3159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:22 smithi159 ceph-mon[36109]: pgmap v3159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:23.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4955 sec 2024-03-28T07:11:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4282.857612 secs 2024-03-28T07:11:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4282.857612 secs 2024-03-28T07:11:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4282.857612 secs 2024-03-28T07:11:24.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4956 sec 2024-03-28T07:11:24.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:24 smithi159 ceph-mon[36109]: pgmap v3160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:24 smithi086 ceph-mon[35163]: pgmap v3160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:24 smithi055 ceph-mon[31863]: pgmap v3160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:11:25.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4957 sec 2024-03-28T07:11:26.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4958 sec 2024-03-28T07:11:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:26 smithi086 ceph-mon[35163]: pgmap v3161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:26 smithi159 ceph-mon[36109]: pgmap v3161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:26 smithi055 ceph-mon[31863]: pgmap v3161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:27.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4959 sec 2024-03-28T07:11:28.804 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4960 sec 2024-03-28T07:11:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4287.857631 secs 2024-03-28T07:11:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:28 smithi086 ceph-mon[35163]: pgmap v3162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4287.857631 secs 2024-03-28T07:11:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:28 smithi159 ceph-mon[36109]: pgmap v3162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4287.857631 secs 2024-03-28T07:11:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:28 smithi055 ceph-mon[31863]: pgmap v3162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:29.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4961 sec 2024-03-28T07:11:30.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4962 sec 2024-03-28T07:11:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:30 smithi086 ceph-mon[35163]: pgmap v3163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:31.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:30 smithi159 ceph-mon[36109]: pgmap v3163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:30 smithi055 ceph-mon[31863]: pgmap v3163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:31.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4963 sec 2024-03-28T07:11:32.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4964 sec 2024-03-28T07:11:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:32 smithi086 ceph-mon[35163]: pgmap v3164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:32 smithi159 ceph-mon[36109]: pgmap v3164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:32 smithi055 ceph-mon[31863]: pgmap v3164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:33.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4965 sec 2024-03-28T07:11:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4292.857698 secs 2024-03-28T07:11:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4292.857698 secs 2024-03-28T07:11:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4292.857698 secs 2024-03-28T07:11:34.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4966 sec 2024-03-28T07:11:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:34 smithi086 ceph-mon[35163]: pgmap v3165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:34 smithi159 ceph-mon[36109]: pgmap v3165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:34 smithi055 ceph-mon[31863]: pgmap v3165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:35.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4967 sec 2024-03-28T07:11:36.805 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4968 sec 2024-03-28T07:11:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:36 smithi086 ceph-mon[35163]: pgmap v3166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:36 smithi159 ceph-mon[36109]: pgmap v3166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:36 smithi055 ceph-mon[31863]: pgmap v3166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:37.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4969 sec 2024-03-28T07:11:38.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4970 sec 2024-03-28T07:11:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4297.857760 secs 2024-03-28T07:11:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:38 smithi086 ceph-mon[35163]: pgmap v3167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4297.857760 secs 2024-03-28T07:11:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:38 smithi159 ceph-mon[36109]: pgmap v3167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4297.857760 secs 2024-03-28T07:11:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:38 smithi055 ceph-mon[31863]: pgmap v3167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:39.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4971 sec 2024-03-28T07:11:40.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4972 sec 2024-03-28T07:11:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:40 smithi086 ceph-mon[35163]: pgmap v3168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:41.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:40 smithi159 ceph-mon[36109]: pgmap v3168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:40 smithi055 ceph-mon[31863]: pgmap v3168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:41.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4973 sec 2024-03-28T07:11:42.806 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4974 sec 2024-03-28T07:11:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:42 smithi086 ceph-mon[35163]: pgmap v3169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:43.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:42 smithi159 ceph-mon[36109]: pgmap v3169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:42 smithi055 ceph-mon[31863]: pgmap v3169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:43.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4975 sec 2024-03-28T07:11:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4302.857797 secs 2024-03-28T07:11:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4302.857797 secs 2024-03-28T07:11:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4302.857797 secs 2024-03-28T07:11:44.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4976 sec 2024-03-28T07:11:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:44 smithi086 ceph-mon[35163]: pgmap v3170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:44 smithi159 ceph-mon[36109]: pgmap v3170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:44 smithi055 ceph-mon[31863]: pgmap v3170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:45.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4977 sec 2024-03-28T07:11:46.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4978 sec 2024-03-28T07:11:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:46 smithi086 ceph-mon[35163]: pgmap v3171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:46 smithi159 ceph-mon[36109]: pgmap v3171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:46 smithi055 ceph-mon[31863]: pgmap v3171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:47.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4979 sec 2024-03-28T07:11:48.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4980 sec 2024-03-28T07:11:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4307.857860 secs 2024-03-28T07:11:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:48 smithi086 ceph-mon[35163]: pgmap v3172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4307.857860 secs 2024-03-28T07:11:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:48 smithi159 ceph-mon[36109]: pgmap v3172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4307.857860 secs 2024-03-28T07:11:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:48 smithi055 ceph-mon[31863]: pgmap v3172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:49.807 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4981 sec 2024-03-28T07:11:50.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4982 sec 2024-03-28T07:11:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:50 smithi086 ceph-mon[35163]: pgmap v3173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:50 smithi159 ceph-mon[36109]: pgmap v3173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:50 smithi055 ceph-mon[31863]: pgmap v3173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:51.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4983 sec 2024-03-28T07:11:52.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4984 sec 2024-03-28T07:11:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:52 smithi086 ceph-mon[35163]: pgmap v3174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:52 smithi159 ceph-mon[36109]: pgmap v3174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:52 smithi055 ceph-mon[31863]: pgmap v3174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:53.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4985 sec 2024-03-28T07:11:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4312.857924 secs 2024-03-28T07:11:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4312.857924 secs 2024-03-28T07:11:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4312.857924 secs 2024-03-28T07:11:54.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4986 sec 2024-03-28T07:11:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:54 smithi086 ceph-mon[35163]: pgmap v3175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:54 smithi159 ceph-mon[36109]: pgmap v3175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:54 smithi055 ceph-mon[31863]: pgmap v3175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:11:55.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4987 sec 2024-03-28T07:11:56.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4988 sec 2024-03-28T07:11:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:56 smithi086 ceph-mon[35163]: pgmap v3176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:56 smithi159 ceph-mon[36109]: pgmap v3176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:57.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:56 smithi055 ceph-mon[31863]: pgmap v3176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:11:57.808 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4989 sec 2024-03-28T07:11:58.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4990 sec 2024-03-28T07:11:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4317.857986 secs 2024-03-28T07:11:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:11:58 smithi086 ceph-mon[35163]: pgmap v3177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4317.857986 secs 2024-03-28T07:11:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:11:58 smithi159 ceph-mon[36109]: pgmap v3177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4317.857986 secs 2024-03-28T07:11:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:11:58 smithi055 ceph-mon[31863]: pgmap v3177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:11:59.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4991 sec 2024-03-28T07:12:00.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4992 sec 2024-03-28T07:12:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:00 smithi086 ceph-mon[35163]: pgmap v3178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:00 smithi159 ceph-mon[36109]: pgmap v3178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:00 smithi055 ceph-mon[31863]: pgmap v3178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:01.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4993 sec 2024-03-28T07:12:02.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4994 sec 2024-03-28T07:12:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:02 smithi055 ceph-mon[31863]: pgmap v3179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:02 smithi086 ceph-mon[35163]: pgmap v3179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:02 smithi159 ceph-mon[36109]: pgmap v3179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:03.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4995 sec 2024-03-28T07:12:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4322.858051 secs 2024-03-28T07:12:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4322.858051 secs 2024-03-28T07:12:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4322.858051 secs 2024-03-28T07:12:04.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4996 sec 2024-03-28T07:12:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:04 smithi055 ceph-mon[31863]: pgmap v3180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:12:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:04 smithi086 ceph-mon[35163]: pgmap v3180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:12:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:04 smithi159 ceph-mon[36109]: pgmap v3180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:12:05.809 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4997 sec 2024-03-28T07:12:06.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4998 sec 2024-03-28T07:12:07.123 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:06 smithi086 ceph-mon[35163]: pgmap v3181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:06 smithi055 ceph-mon[31863]: pgmap v3181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:06 smithi159 ceph-mon[36109]: pgmap v3181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:07.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 4999 sec 2024-03-28T07:12:08.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5000 sec 2024-03-28T07:12:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4327.858124 secs 2024-03-28T07:12:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:08 smithi055 ceph-mon[31863]: pgmap v3182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4327.858124 secs 2024-03-28T07:12:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:08 smithi086 ceph-mon[35163]: pgmap v3182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4327.858124 secs 2024-03-28T07:12:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:08 smithi159 ceph-mon[36109]: pgmap v3182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:09.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5001 sec 2024-03-28T07:12:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:09 smithi086 ceph-mon[35163]: pgmap v3183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:10.317 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:09 smithi055 ceph-mon[31863]: pgmap v3183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:10.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:09 smithi159 ceph-mon[36109]: pgmap v3183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:10.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5002 sec 2024-03-28T07:12:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: pgmap v3184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: pgmap v3185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:12:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: pgmap v3184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: pgmap v3185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:12:11.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: pgmap v3184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: pgmap v3185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:12:11.583 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:12:11.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5003 sec 2024-03-28T07:12:12.810 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5004 sec 2024-03-28T07:12:13.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5005 sec 2024-03-28T07:12:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:13 smithi086 ceph-mon[35163]: pgmap v3186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4332.858209 secs 2024-03-28T07:12:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:13 smithi159 ceph-mon[36109]: pgmap v3186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4332.858209 secs 2024-03-28T07:12:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:13 smithi055 ceph-mon[31863]: pgmap v3186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4332.858209 secs 2024-03-28T07:12:14.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5006 sec 2024-03-28T07:12:15.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5007 sec 2024-03-28T07:12:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:15 smithi086 ceph-mon[35163]: pgmap v3187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:15.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:15 smithi159 ceph-mon[36109]: pgmap v3187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:15.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:15 smithi055 ceph-mon[31863]: pgmap v3187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:16.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5008 sec 2024-03-28T07:12:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:17 smithi086 ceph-mon[35163]: pgmap v3188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:17 smithi159 ceph-mon[36109]: pgmap v3188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:17 smithi055 ceph-mon[31863]: pgmap v3188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:17.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5009 sec 2024-03-28T07:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4337.858292 secs 2024-03-28T07:12:18.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4337.858292 secs 2024-03-28T07:12:18.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4337.858292 secs 2024-03-28T07:12:18.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5010 sec 2024-03-28T07:12:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:19 smithi086 ceph-mon[35163]: pgmap v3189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:19 smithi159 ceph-mon[36109]: pgmap v3189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:19 smithi055 ceph-mon[31863]: pgmap v3189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:12:19.811 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5011 sec 2024-03-28T07:12:20.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5012 sec 2024-03-28T07:12:21.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5013 sec 2024-03-28T07:12:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:21 smithi086 ceph-mon[35163]: pgmap v3190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:12:21.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:21 smithi159 ceph-mon[36109]: pgmap v3190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:12:21.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:21 smithi055 ceph-mon[31863]: pgmap v3190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:12:22.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5014 sec 2024-03-28T07:12:23.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5015 sec 2024-03-28T07:12:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:23 smithi086 ceph-mon[35163]: pgmap v3191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4342.858415 secs 2024-03-28T07:12:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:23 smithi159 ceph-mon[36109]: pgmap v3191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4342.858415 secs 2024-03-28T07:12:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:23 smithi055 ceph-mon[31863]: pgmap v3191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4342.858415 secs 2024-03-28T07:12:24.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5016 sec 2024-03-28T07:12:25.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5017 sec 2024-03-28T07:12:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:25 smithi086 ceph-mon[35163]: pgmap v3192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:25 smithi159 ceph-mon[36109]: pgmap v3192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:25 smithi055 ceph-mon[31863]: pgmap v3192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:26.812 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5018 sec 2024-03-28T07:12:27.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5019 sec 2024-03-28T07:12:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:27 smithi086 ceph-mon[35163]: pgmap v3193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:27 smithi159 ceph-mon[36109]: pgmap v3193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:27.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:27 smithi055 ceph-mon[31863]: pgmap v3193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:28.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5020 sec 2024-03-28T07:12:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4347.858535 secs 2024-03-28T07:12:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4347.858535 secs 2024-03-28T07:12:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4347.858535 secs 2024-03-28T07:12:29.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5021 sec 2024-03-28T07:12:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:29 smithi086 ceph-mon[35163]: pgmap v3194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:29 smithi159 ceph-mon[36109]: pgmap v3194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:29 smithi055 ceph-mon[31863]: pgmap v3194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:30.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5022 sec 2024-03-28T07:12:31.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5023 sec 2024-03-28T07:12:31.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:31 smithi055 ceph-mon[31863]: pgmap v3195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:31 smithi086 ceph-mon[35163]: pgmap v3195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:32.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:31 smithi159 ceph-mon[36109]: pgmap v3195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:32.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5024 sec 2024-03-28T07:12:33.813 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5025 sec 2024-03-28T07:12:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4352.858659 secs 2024-03-28T07:12:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:33 smithi055 ceph-mon[31863]: pgmap v3196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4352.858659 secs 2024-03-28T07:12:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:33 smithi086 ceph-mon[35163]: pgmap v3196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4352.858659 secs 2024-03-28T07:12:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:33 smithi159 ceph-mon[36109]: pgmap v3196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:34.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5026 sec 2024-03-28T07:12:35.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5027 sec 2024-03-28T07:12:35.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:35 smithi055 ceph-mon[31863]: pgmap v3197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:35 smithi086 ceph-mon[35163]: pgmap v3197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:35 smithi159 ceph-mon[36109]: pgmap v3197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:36.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5028 sec 2024-03-28T07:12:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:37 smithi086 ceph-mon[35163]: pgmap v3198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:37.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:37 smithi159 ceph-mon[36109]: pgmap v3198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:37.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:37 smithi055 ceph-mon[31863]: pgmap v3198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:37.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5029 sec 2024-03-28T07:12:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4357.858790 secs 2024-03-28T07:12:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4357.858790 secs 2024-03-28T07:12:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4357.858790 secs 2024-03-28T07:12:38.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5030 sec 2024-03-28T07:12:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:39 smithi086 ceph-mon[35163]: pgmap v3199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:39 smithi159 ceph-mon[36109]: pgmap v3199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:39.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:39 smithi055 ceph-mon[31863]: pgmap v3199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:39.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5031 sec 2024-03-28T07:12:40.814 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5032 sec 2024-03-28T07:12:41.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5033 sec 2024-03-28T07:12:41.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:41 smithi086 ceph-mon[35163]: pgmap v3200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:41.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:41 smithi159 ceph-mon[36109]: pgmap v3200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:41 smithi055 ceph-mon[31863]: pgmap v3200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:42.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5034 sec 2024-03-28T07:12:43.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5035 sec 2024-03-28T07:12:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4362.858841 secs 2024-03-28T07:12:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:43 smithi086 ceph-mon[35163]: pgmap v3201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4362.858841 secs 2024-03-28T07:12:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:43 smithi159 ceph-mon[36109]: pgmap v3201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4362.858841 secs 2024-03-28T07:12:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:43 smithi055 ceph-mon[31863]: pgmap v3201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:44.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5036 sec 2024-03-28T07:12:45.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5037 sec 2024-03-28T07:12:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:45 smithi086 ceph-mon[35163]: pgmap v3202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:45 smithi159 ceph-mon[36109]: pgmap v3202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:45 smithi055 ceph-mon[31863]: pgmap v3202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:46.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5038 sec 2024-03-28T07:12:47.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5039 sec 2024-03-28T07:12:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:47 smithi086 ceph-mon[35163]: pgmap v3203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:47.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:47 smithi159 ceph-mon[36109]: pgmap v3203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:47 smithi055 ceph-mon[31863]: pgmap v3203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:48.815 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5040 sec 2024-03-28T07:12:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4367.858902 secs 2024-03-28T07:12:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4367.858902 secs 2024-03-28T07:12:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4367.858902 secs 2024-03-28T07:12:49.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5041 sec 2024-03-28T07:12:49.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:49 smithi159 ceph-mon[36109]: pgmap v3204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:49.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:49 smithi055 ceph-mon[31863]: pgmap v3204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:49 smithi086 ceph-mon[35163]: pgmap v3204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:50.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5042 sec 2024-03-28T07:12:51.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5043 sec 2024-03-28T07:12:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:51 smithi055 ceph-mon[31863]: pgmap v3205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:51 smithi086 ceph-mon[35163]: pgmap v3205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:52.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:51 smithi159 ceph-mon[36109]: pgmap v3205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:12:52.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5044 sec 2024-03-28T07:12:53.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5045 sec 2024-03-28T07:12:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4372.859022 secs 2024-03-28T07:12:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:53 smithi055 ceph-mon[31863]: pgmap v3206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4372.859022 secs 2024-03-28T07:12:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:53 smithi086 ceph-mon[35163]: pgmap v3206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4372.859022 secs 2024-03-28T07:12:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:53 smithi159 ceph-mon[36109]: pgmap v3206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:12:54.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5046 sec 2024-03-28T07:12:55.816 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5047 sec 2024-03-28T07:12:55.875 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:55 smithi159 ceph-mon[36109]: pgmap v3207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:55.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:55 smithi055 ceph-mon[31863]: pgmap v3207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:55 smithi086 ceph-mon[35163]: pgmap v3207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:56.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5048 sec 2024-03-28T07:12:57.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5049 sec 2024-03-28T07:12:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:57 smithi055 ceph-mon[31863]: pgmap v3208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:57 smithi086 ceph-mon[35163]: pgmap v3208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:58.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:57 smithi159 ceph-mon[36109]: pgmap v3208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:12:58.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5050 sec 2024-03-28T07:12:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4377.859139 secs 2024-03-28T07:12:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4377.859139 secs 2024-03-28T07:12:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4377.859139 secs 2024-03-28T07:12:59.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5051 sec 2024-03-28T07:12:59.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:12:59 smithi055 ceph-mon[31863]: pgmap v3209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:12:59 smithi086 ceph-mon[35163]: pgmap v3209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:00.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:12:59 smithi159 ceph-mon[36109]: pgmap v3209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:00.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5052 sec 2024-03-28T07:13:01.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5053 sec 2024-03-28T07:13:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:01 smithi086 ceph-mon[35163]: pgmap v3210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:02.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:01 smithi159 ceph-mon[36109]: pgmap v3210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:02.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:01 smithi055 ceph-mon[31863]: pgmap v3210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:02.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5054 sec 2024-03-28T07:13:03.817 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5055 sec 2024-03-28T07:13:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4382.859222 secs 2024-03-28T07:13:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:03 smithi086 ceph-mon[35163]: pgmap v3211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4382.859222 secs 2024-03-28T07:13:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:03 smithi159 ceph-mon[36109]: pgmap v3211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4382.859222 secs 2024-03-28T07:13:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:03 smithi055 ceph-mon[31863]: pgmap v3211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:04.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5056 sec 2024-03-28T07:13:05.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5057 sec 2024-03-28T07:13:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:05 smithi086 ceph-mon[35163]: pgmap v3212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:06.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:05 smithi159 ceph-mon[36109]: pgmap v3212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:06.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:05 smithi055 ceph-mon[31863]: pgmap v3212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:06.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5058 sec 2024-03-28T07:13:07.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5059 sec 2024-03-28T07:13:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:07 smithi086 ceph-mon[35163]: pgmap v3213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:08.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:07 smithi159 ceph-mon[36109]: pgmap v3213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:08.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:07 smithi055 ceph-mon[31863]: pgmap v3213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:08.818 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5060 sec 2024-03-28T07:13:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4387.859305 secs 2024-03-28T07:13:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4387.859305 secs 2024-03-28T07:13:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4387.859305 secs 2024-03-28T07:13:09.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5061 sec 2024-03-28T07:13:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:09 smithi086 ceph-mon[35163]: pgmap v3214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:10.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:09 smithi159 ceph-mon[36109]: pgmap v3214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:10.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:09 smithi055 ceph-mon[31863]: pgmap v3214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:10.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5062 sec 2024-03-28T07:13:11.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5063 sec 2024-03-28T07:13:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:11 smithi086 ceph-mon[35163]: pgmap v3215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:13:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:11 smithi159 ceph-mon[36109]: pgmap v3215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:13:12.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:11 smithi055 ceph-mon[31863]: pgmap v3215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:13:12.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:13:12.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5064 sec 2024-03-28T07:13:13.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5065 sec 2024-03-28T07:13:13.964 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4392.859373 secs 2024-03-28T07:13:13.964 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:13 smithi159 ceph-mon[36109]: pgmap v3216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4392.859373 secs 2024-03-28T07:13:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:13 smithi086 ceph-mon[35163]: pgmap v3216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4392.859373 secs 2024-03-28T07:13:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:13 smithi055 ceph-mon[31863]: pgmap v3216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:14.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5066 sec 2024-03-28T07:13:15.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5067 sec 2024-03-28T07:13:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:15 smithi086 ceph-mon[35163]: pgmap v3217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:16.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:15 smithi159 ceph-mon[36109]: pgmap v3217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:16.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:15 smithi055 ceph-mon[31863]: pgmap v3217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:16.819 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5068 sec 2024-03-28T07:13:17.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5069 sec 2024-03-28T07:13:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:17 smithi086 ceph-mon[35163]: pgmap v3218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:17 smithi159 ceph-mon[36109]: pgmap v3218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:18.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:17 smithi055 ceph-mon[31863]: pgmap v3218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:18.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5070 sec 2024-03-28T07:13:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4397.859435 secs 2024-03-28T07:13:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:13:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:13:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: pgmap v3219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: pgmap v3220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4397.859435 secs 2024-03-28T07:13:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:13:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:13:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: pgmap v3219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: pgmap v3220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4397.859435 secs 2024-03-28T07:13:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:13:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:13:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: pgmap v3219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: pgmap v3220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:13:19.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5071 sec 2024-03-28T07:13:20.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5072 sec 2024-03-28T07:13:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:20 smithi055 ceph-mon[31863]: pgmap v3221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:13:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:20 smithi086 ceph-mon[35163]: pgmap v3221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:13:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:20 smithi159 ceph-mon[36109]: pgmap v3221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:13:21.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5073 sec 2024-03-28T07:13:22.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5074 sec 2024-03-28T07:13:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:22 smithi055 ceph-mon[31863]: pgmap v3222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:22 smithi086 ceph-mon[35163]: pgmap v3222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:23.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:22 smithi159 ceph-mon[36109]: pgmap v3222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:23.820 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5075 sec 2024-03-28T07:13:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4402.859555 secs 2024-03-28T07:13:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4402.859555 secs 2024-03-28T07:13:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4402.859555 secs 2024-03-28T07:13:24.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5076 sec 2024-03-28T07:13:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:24 smithi055 ceph-mon[31863]: pgmap v3223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:25.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:24 smithi159 ceph-mon[36109]: pgmap v3223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:24 smithi086 ceph-mon[35163]: pgmap v3223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:25.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5077 sec 2024-03-28T07:13:26.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5078 sec 2024-03-28T07:13:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:26 smithi055 ceph-mon[31863]: pgmap v3224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:26 smithi086 ceph-mon[35163]: pgmap v3224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:27.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:26 smithi159 ceph-mon[36109]: pgmap v3224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:13:27.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5079 sec 2024-03-28T07:13:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:27 smithi159 ceph-mon[36109]: pgmap v3225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:13:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:27 smithi086 ceph-mon[35163]: pgmap v3225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:13:28.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:27 smithi055 ceph-mon[31863]: pgmap v3225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:13:28.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5080 sec 2024-03-28T07:13:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4407.859677 secs 2024-03-28T07:13:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4407.859677 secs 2024-03-28T07:13:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4407.859677 secs 2024-03-28T07:13:29.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5081 sec 2024-03-28T07:13:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:29 smithi086 ceph-mon[35163]: pgmap v3226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:30.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:29 smithi159 ceph-mon[36109]: pgmap v3226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:30.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:29 smithi055 ceph-mon[31863]: pgmap v3226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:30.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5082 sec 2024-03-28T07:13:31.821 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5083 sec 2024-03-28T07:13:32.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5084 sec 2024-03-28T07:13:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:32 smithi055 ceph-mon[31863]: pgmap v3227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:32 smithi086 ceph-mon[35163]: pgmap v3227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:32 smithi159 ceph-mon[36109]: pgmap v3227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:33.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5085 sec 2024-03-28T07:13:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4412.859824 secs 2024-03-28T07:13:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4412.859824 secs 2024-03-28T07:13:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4412.859824 secs 2024-03-28T07:13:34.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5086 sec 2024-03-28T07:13:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:34 smithi055 ceph-mon[31863]: pgmap v3228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:34 smithi086 ceph-mon[35163]: pgmap v3228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:35.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:34 smithi159 ceph-mon[36109]: pgmap v3228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:35.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5087 sec 2024-03-28T07:13:36.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5088 sec 2024-03-28T07:13:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:36 smithi055 ceph-mon[31863]: pgmap v3229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:37.250 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:36 smithi159 ceph-mon[36109]: pgmap v3229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:36 smithi086 ceph-mon[35163]: pgmap v3229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:37.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5089 sec 2024-03-28T07:13:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:37 smithi086 ceph-mon[35163]: pgmap v3230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:37 smithi159 ceph-mon[36109]: pgmap v3230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:38.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:37 smithi055 ceph-mon[31863]: pgmap v3230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:38.822 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5090 sec 2024-03-28T07:13:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4417.859906 secs 2024-03-28T07:13:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4417.859906 secs 2024-03-28T07:13:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4417.859906 secs 2024-03-28T07:13:39.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5091 sec 2024-03-28T07:13:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:39 smithi086 ceph-mon[35163]: pgmap v3231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:40.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:39 smithi159 ceph-mon[36109]: pgmap v3231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:40.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:39 smithi055 ceph-mon[31863]: pgmap v3231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:40.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5092 sec 2024-03-28T07:13:41.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5093 sec 2024-03-28T07:13:42.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5094 sec 2024-03-28T07:13:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:42 smithi055 ceph-mon[31863]: pgmap v3232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:42 smithi086 ceph-mon[35163]: pgmap v3232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:42 smithi159 ceph-mon[36109]: pgmap v3232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:43.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5095 sec 2024-03-28T07:13:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4422.859971 secs 2024-03-28T07:13:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4422.859971 secs 2024-03-28T07:13:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4422.859971 secs 2024-03-28T07:13:44.823 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5096 sec 2024-03-28T07:13:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:44 smithi055 ceph-mon[31863]: pgmap v3233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:44 smithi086 ceph-mon[35163]: pgmap v3233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:44 smithi159 ceph-mon[36109]: pgmap v3233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:45.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5097 sec 2024-03-28T07:13:46.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5098 sec 2024-03-28T07:13:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:46 smithi055 ceph-mon[31863]: pgmap v3234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:46 smithi086 ceph-mon[35163]: pgmap v3234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:46 smithi159 ceph-mon[36109]: pgmap v3234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:47.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5099 sec 2024-03-28T07:13:48.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5100 sec 2024-03-28T07:13:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4427.860053 secs 2024-03-28T07:13:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:48 smithi055 ceph-mon[31863]: pgmap v3235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4427.860053 secs 2024-03-28T07:13:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:48 smithi086 ceph-mon[35163]: pgmap v3235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4427.860053 secs 2024-03-28T07:13:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:48 smithi159 ceph-mon[36109]: pgmap v3235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:49.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5101 sec 2024-03-28T07:13:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:49 smithi086 ceph-mon[35163]: pgmap v3236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:50.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:49 smithi159 ceph-mon[36109]: pgmap v3236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:50.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:49 smithi055 ceph-mon[31863]: pgmap v3236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:13:50.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5102 sec 2024-03-28T07:13:51.824 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5103 sec 2024-03-28T07:13:52.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5104 sec 2024-03-28T07:13:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:52 smithi055 ceph-mon[31863]: pgmap v3237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:52 smithi086 ceph-mon[35163]: pgmap v3237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:52 smithi159 ceph-mon[36109]: pgmap v3237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:53.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5105 sec 2024-03-28T07:13:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4432.860139 secs 2024-03-28T07:13:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4432.860139 secs 2024-03-28T07:13:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4432.860139 secs 2024-03-28T07:13:54.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5106 sec 2024-03-28T07:13:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:54 smithi055 ceph-mon[31863]: pgmap v3238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:55.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:54 smithi159 ceph-mon[36109]: pgmap v3238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:54 smithi086 ceph-mon[35163]: pgmap v3238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:55.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5107 sec 2024-03-28T07:13:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:55 smithi086 ceph-mon[35163]: pgmap v3239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:55 smithi159 ceph-mon[36109]: pgmap v3239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:56.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:55 smithi055 ceph-mon[31863]: pgmap v3239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:56.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5108 sec 2024-03-28T07:13:57.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5109 sec 2024-03-28T07:13:58.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5110 sec 2024-03-28T07:13:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4437.860270 secs 2024-03-28T07:13:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:13:58 smithi055 ceph-mon[31863]: pgmap v3240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4437.860270 secs 2024-03-28T07:13:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:13:58 smithi086 ceph-mon[35163]: pgmap v3240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4437.860270 secs 2024-03-28T07:13:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:13:58 smithi159 ceph-mon[36109]: pgmap v3240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:13:59.825 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5111 sec 2024-03-28T07:14:00.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5112 sec 2024-03-28T07:14:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:00 smithi055 ceph-mon[31863]: pgmap v3241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:00 smithi086 ceph-mon[35163]: pgmap v3241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:00 smithi159 ceph-mon[36109]: pgmap v3241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:01.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5113 sec 2024-03-28T07:14:02.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5114 sec 2024-03-28T07:14:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:02 smithi086 ceph-mon[35163]: pgmap v3242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:02 smithi159 ceph-mon[36109]: pgmap v3242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:02 smithi055 ceph-mon[31863]: pgmap v3242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:03.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5115 sec 2024-03-28T07:14:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4442.860352 secs 2024-03-28T07:14:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4442.860352 secs 2024-03-28T07:14:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4442.860352 secs 2024-03-28T07:14:04.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5116 sec 2024-03-28T07:14:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:04 smithi086 ceph-mon[35163]: pgmap v3243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:04 smithi159 ceph-mon[36109]: pgmap v3243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:04 smithi055 ceph-mon[31863]: pgmap v3243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:05.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5117 sec 2024-03-28T07:14:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:05 smithi086 ceph-mon[35163]: pgmap v3244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:06.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:05 smithi159 ceph-mon[36109]: pgmap v3244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:06.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:05 smithi055 ceph-mon[31863]: pgmap v3244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:06.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5118 sec 2024-03-28T07:14:07.826 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5119 sec 2024-03-28T07:14:08.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5120 sec 2024-03-28T07:14:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4447.860471 secs 2024-03-28T07:14:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:08 smithi055 ceph-mon[31863]: pgmap v3245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4447.860471 secs 2024-03-28T07:14:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:08 smithi086 ceph-mon[35163]: pgmap v3245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4447.860471 secs 2024-03-28T07:14:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:08 smithi159 ceph-mon[36109]: pgmap v3245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:09.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5121 sec 2024-03-28T07:14:10.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5122 sec 2024-03-28T07:14:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:10 smithi055 ceph-mon[31863]: pgmap v3246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:10 smithi086 ceph-mon[35163]: pgmap v3246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:10 smithi159 ceph-mon[36109]: pgmap v3246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:11.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5123 sec 2024-03-28T07:14:12.827 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5124 sec 2024-03-28T07:14:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:12 smithi086 ceph-mon[35163]: pgmap v3247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:12 smithi159 ceph-mon[36109]: pgmap v3247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:12 smithi055 ceph-mon[31863]: pgmap v3247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:13.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5125 sec 2024-03-28T07:14:14.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4452.860536 secs 2024-03-28T07:14:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4452.860536 secs 2024-03-28T07:14:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4452.860536 secs 2024-03-28T07:14:14.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5126 sec 2024-03-28T07:14:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:14 smithi086 ceph-mon[35163]: pgmap v3248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:14 smithi159 ceph-mon[36109]: pgmap v3248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:14 smithi055 ceph-mon[31863]: pgmap v3248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:15.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5127 sec 2024-03-28T07:14:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:15 smithi086 ceph-mon[35163]: pgmap v3249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:16.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:15 smithi159 ceph-mon[36109]: pgmap v3249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:16.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:15 smithi055 ceph-mon[31863]: pgmap v3249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:16.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5128 sec 2024-03-28T07:14:17.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5129 sec 2024-03-28T07:14:18.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5130 sec 2024-03-28T07:14:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4457.860654 secs 2024-03-28T07:14:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:18 smithi055 ceph-mon[31863]: pgmap v3250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:14:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4457.860654 secs 2024-03-28T07:14:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:18 smithi086 ceph-mon[35163]: pgmap v3250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:14:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4457.860654 secs 2024-03-28T07:14:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:18 smithi159 ceph-mon[36109]: pgmap v3250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:14:19.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5131 sec 2024-03-28T07:14:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:14:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:14:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:14:20.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:14:20.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:14:20.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:14:20.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:14:20.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:14:20.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:14:20.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5132 sec 2024-03-28T07:14:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:20 smithi086 ceph-mon[35163]: pgmap v3251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:20 smithi086 ceph-mon[35163]: pgmap v3252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:20 smithi159 ceph-mon[36109]: pgmap v3251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:20 smithi159 ceph-mon[36109]: pgmap v3252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:20 smithi055 ceph-mon[31863]: pgmap v3251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:20 smithi055 ceph-mon[31863]: pgmap v3252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:21.828 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5133 sec 2024-03-28T07:14:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:21 smithi086 ceph-mon[35163]: pgmap v3253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:22.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:21 smithi159 ceph-mon[36109]: pgmap v3253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:22.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:21 smithi055 ceph-mon[31863]: pgmap v3253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:22.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5134 sec 2024-03-28T07:14:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4462.860736 secs 2024-03-28T07:14:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4462.860736 secs 2024-03-28T07:14:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4462.860736 secs 2024-03-28T07:14:23.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5135 sec 2024-03-28T07:14:24.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:24 smithi086 ceph-mon[35163]: pgmap v3254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:24.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:24 smithi159 ceph-mon[36109]: pgmap v3254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:24.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:24 smithi055 ceph-mon[31863]: pgmap v3254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:14:24.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5136 sec 2024-03-28T07:14:25.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5137 sec 2024-03-28T07:14:26.829 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5138 sec 2024-03-28T07:14:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:26 smithi086 ceph-mon[35163]: pgmap v3255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:26 smithi159 ceph-mon[36109]: pgmap v3255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:26 smithi055 ceph-mon[31863]: pgmap v3255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:27.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5139 sec 2024-03-28T07:14:28.746 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4467.860863 secs 2024-03-28T07:14:28.746 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:28 smithi159 ceph-mon[36109]: pgmap v3256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:14:28.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5140 sec 2024-03-28T07:14:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4467.860863 secs 2024-03-28T07:14:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:28 smithi086 ceph-mon[35163]: pgmap v3256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:14:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4467.860863 secs 2024-03-28T07:14:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:28 smithi055 ceph-mon[31863]: pgmap v3256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:14:29.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5141 sec 2024-03-28T07:14:30.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5142 sec 2024-03-28T07:14:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:30 smithi086 ceph-mon[35163]: pgmap v3257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:31.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:30 smithi159 ceph-mon[36109]: pgmap v3257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:30 smithi055 ceph-mon[31863]: pgmap v3257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:14:31.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5143 sec 2024-03-28T07:14:32.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5144 sec 2024-03-28T07:14:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:32 smithi086 ceph-mon[35163]: pgmap v3258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:32 smithi159 ceph-mon[36109]: pgmap v3258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:32 smithi055 ceph-mon[31863]: pgmap v3258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:33.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5145 sec 2024-03-28T07:14:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4472.860987 secs 2024-03-28T07:14:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4472.860987 secs 2024-03-28T07:14:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4472.860987 secs 2024-03-28T07:14:34.830 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5146 sec 2024-03-28T07:14:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:34 smithi086 ceph-mon[35163]: pgmap v3259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:34 smithi159 ceph-mon[36109]: pgmap v3259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:34 smithi055 ceph-mon[31863]: pgmap v3259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:35.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5147 sec 2024-03-28T07:14:36.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5148 sec 2024-03-28T07:14:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:36 smithi086 ceph-mon[35163]: pgmap v3260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:36 smithi159 ceph-mon[36109]: pgmap v3260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:36 smithi055 ceph-mon[31863]: pgmap v3260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:37.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5149 sec 2024-03-28T07:14:38.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5150 sec 2024-03-28T07:14:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4477.861896 secs 2024-03-28T07:14:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:38 smithi086 ceph-mon[35163]: pgmap v3261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4477.861896 secs 2024-03-28T07:14:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:38 smithi159 ceph-mon[36109]: pgmap v3261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4477.861896 secs 2024-03-28T07:14:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:38 smithi055 ceph-mon[31863]: pgmap v3261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:39.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5151 sec 2024-03-28T07:14:40.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5152 sec 2024-03-28T07:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:40 smithi086 ceph-mon[35163]: pgmap v3262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:41.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:40 smithi159 ceph-mon[36109]: pgmap v3262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:40 smithi055 ceph-mon[31863]: pgmap v3262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:41.831 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5153 sec 2024-03-28T07:14:42.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5154 sec 2024-03-28T07:14:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:42 smithi086 ceph-mon[35163]: pgmap v3263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:43.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:42 smithi159 ceph-mon[36109]: pgmap v3263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:42 smithi055 ceph-mon[31863]: pgmap v3263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:43.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5155 sec 2024-03-28T07:14:44.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4482.861956 secs 2024-03-28T07:14:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4482.861956 secs 2024-03-28T07:14:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4482.861956 secs 2024-03-28T07:14:44.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5156 sec 2024-03-28T07:14:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:44 smithi086 ceph-mon[35163]: pgmap v3264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:44 smithi159 ceph-mon[36109]: pgmap v3264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:44 smithi055 ceph-mon[31863]: pgmap v3264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:45.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5157 sec 2024-03-28T07:14:46.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5158 sec 2024-03-28T07:14:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:46 smithi086 ceph-mon[35163]: pgmap v3265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:46 smithi159 ceph-mon[36109]: pgmap v3265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:46 smithi055 ceph-mon[31863]: pgmap v3265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:47.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5159 sec 2024-03-28T07:14:48.832 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5160 sec 2024-03-28T07:14:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4487.862016 secs 2024-03-28T07:14:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:48 smithi086 ceph-mon[35163]: pgmap v3266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4487.862016 secs 2024-03-28T07:14:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:48 smithi159 ceph-mon[36109]: pgmap v3266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4487.862016 secs 2024-03-28T07:14:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:48 smithi055 ceph-mon[31863]: pgmap v3266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:49.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5161 sec 2024-03-28T07:14:50.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5162 sec 2024-03-28T07:14:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:50 smithi086 ceph-mon[35163]: pgmap v3267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:50 smithi159 ceph-mon[36109]: pgmap v3267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:50 smithi055 ceph-mon[31863]: pgmap v3267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:51.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5163 sec 2024-03-28T07:14:52.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5164 sec 2024-03-28T07:14:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:52 smithi086 ceph-mon[35163]: pgmap v3268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:52 smithi159 ceph-mon[36109]: pgmap v3268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:52 smithi055 ceph-mon[31863]: pgmap v3268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:53.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5165 sec 2024-03-28T07:14:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4492.862079 secs 2024-03-28T07:14:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4492.862079 secs 2024-03-28T07:14:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4492.862079 secs 2024-03-28T07:14:54.833 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5166 sec 2024-03-28T07:14:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:54 smithi086 ceph-mon[35163]: pgmap v3269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:54 smithi159 ceph-mon[36109]: pgmap v3269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:54 smithi055 ceph-mon[31863]: pgmap v3269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:14:55.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5167 sec 2024-03-28T07:14:56.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5168 sec 2024-03-28T07:14:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:56 smithi086 ceph-mon[35163]: pgmap v3270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:56 smithi159 ceph-mon[36109]: pgmap v3270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:57.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:56 smithi055 ceph-mon[31863]: pgmap v3270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:14:57.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5169 sec 2024-03-28T07:14:58.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5170 sec 2024-03-28T07:14:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4497.862138 secs 2024-03-28T07:14:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:14:58 smithi086 ceph-mon[35163]: pgmap v3271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4497.862138 secs 2024-03-28T07:14:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:14:58 smithi159 ceph-mon[36109]: pgmap v3271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4497.862138 secs 2024-03-28T07:14:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:14:58 smithi055 ceph-mon[31863]: pgmap v3271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:14:59.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5171 sec 2024-03-28T07:15:00.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5172 sec 2024-03-28T07:15:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:00 smithi086 ceph-mon[35163]: pgmap v3272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:00 smithi159 ceph-mon[36109]: pgmap v3272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:00 smithi055 ceph-mon[31863]: pgmap v3272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:01.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5173 sec 2024-03-28T07:15:02.834 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5174 sec 2024-03-28T07:15:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:02 smithi086 ceph-mon[35163]: pgmap v3273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:03.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:02 smithi159 ceph-mon[36109]: pgmap v3273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:02 smithi055 ceph-mon[31863]: pgmap v3273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:03.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5175 sec 2024-03-28T07:15:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4502.862249 secs 2024-03-28T07:15:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4502.862249 secs 2024-03-28T07:15:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4502.862249 secs 2024-03-28T07:15:04.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5176 sec 2024-03-28T07:15:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:04 smithi055 ceph-mon[31863]: pgmap v3274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:04 smithi086 ceph-mon[35163]: pgmap v3274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:04 smithi159 ceph-mon[36109]: pgmap v3274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:05.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5177 sec 2024-03-28T07:15:06.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5178 sec 2024-03-28T07:15:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:06 smithi055 ceph-mon[31863]: pgmap v3275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:06 smithi086 ceph-mon[35163]: pgmap v3275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:06 smithi159 ceph-mon[36109]: pgmap v3275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:07.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5179 sec 2024-03-28T07:15:08.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5180 sec 2024-03-28T07:15:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4507.862319 secs 2024-03-28T07:15:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:08 smithi055 ceph-mon[31863]: pgmap v3276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4507.862319 secs 2024-03-28T07:15:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:08 smithi086 ceph-mon[35163]: pgmap v3276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4507.862319 secs 2024-03-28T07:15:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:08 smithi159 ceph-mon[36109]: pgmap v3276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:09.835 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5181 sec 2024-03-28T07:15:10.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5182 sec 2024-03-28T07:15:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:10 smithi055 ceph-mon[31863]: pgmap v3277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:10 smithi086 ceph-mon[35163]: pgmap v3277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:10 smithi159 ceph-mon[36109]: pgmap v3277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:11.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5183 sec 2024-03-28T07:15:12.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5184 sec 2024-03-28T07:15:13.123 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:12 smithi086 ceph-mon[35163]: pgmap v3278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:12 smithi055 ceph-mon[31863]: pgmap v3278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:12 smithi159 ceph-mon[36109]: pgmap v3278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:13.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5185 sec 2024-03-28T07:15:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4512.862416 secs 2024-03-28T07:15:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4512.862416 secs 2024-03-28T07:15:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4512.862416 secs 2024-03-28T07:15:14.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5186 sec 2024-03-28T07:15:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:14 smithi086 ceph-mon[35163]: pgmap v3279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:14 smithi159 ceph-mon[36109]: pgmap v3279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:14 smithi055 ceph-mon[31863]: pgmap v3279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:15.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5187 sec 2024-03-28T07:15:16.836 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5188 sec 2024-03-28T07:15:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:16 smithi086 ceph-mon[35163]: pgmap v3280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:16 smithi159 ceph-mon[36109]: pgmap v3280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:16 smithi055 ceph-mon[31863]: pgmap v3280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:17.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5189 sec 2024-03-28T07:15:18.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5190 sec 2024-03-28T07:15:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4517.862540 secs 2024-03-28T07:15:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:18 smithi086 ceph-mon[35163]: pgmap v3281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4517.862540 secs 2024-03-28T07:15:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:18 smithi159 ceph-mon[36109]: pgmap v3281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4517.862540 secs 2024-03-28T07:15:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:18 smithi055 ceph-mon[31863]: pgmap v3281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:19.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5191 sec 2024-03-28T07:15:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:19 smithi086 ceph-mon[35163]: pgmap v3282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:20.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:19 smithi159 ceph-mon[36109]: pgmap v3282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:20.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:19 smithi055 ceph-mon[31863]: pgmap v3282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:20.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5192 sec 2024-03-28T07:15:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:15:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:15:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:15:21.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5193 sec 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:15:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:15:22.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:15:22.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: pgmap v3283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:22.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: pgmap v3284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:22.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: pgmap v3283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: pgmap v3284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:22.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:15:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:15:22.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:15:22.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: pgmap v3283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:22.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: pgmap v3284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:22.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:15:22.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5194 sec 2024-03-28T07:15:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4522.862661 secs 2024-03-28T07:15:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4522.862661 secs 2024-03-28T07:15:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4522.862661 secs 2024-03-28T07:15:23.837 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5195 sec 2024-03-28T07:15:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:24 smithi086 ceph-mon[35163]: pgmap v3285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:24 smithi159 ceph-mon[36109]: pgmap v3285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:24.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:24 smithi055 ceph-mon[31863]: pgmap v3285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:24.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5196 sec 2024-03-28T07:15:25.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5197 sec 2024-03-28T07:15:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:26 smithi086 ceph-mon[35163]: pgmap v3286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:26.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:26 smithi159 ceph-mon[36109]: pgmap v3286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:26.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5198 sec 2024-03-28T07:15:26.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:26 smithi055 ceph-mon[31863]: pgmap v3286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:27.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5199 sec 2024-03-28T07:15:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:28 smithi086 ceph-mon[35163]: pgmap v3287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4527.862804 secs 2024-03-28T07:15:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:28 smithi159 ceph-mon[36109]: pgmap v3287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4527.862804 secs 2024-03-28T07:15:28.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5200 sec 2024-03-28T07:15:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:28 smithi055 ceph-mon[31863]: pgmap v3287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4527.862804 secs 2024-03-28T07:15:29.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5201 sec 2024-03-28T07:15:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:30 smithi086 ceph-mon[35163]: pgmap v3288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:30.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:30 smithi159 ceph-mon[36109]: pgmap v3288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:30.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5202 sec 2024-03-28T07:15:30.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:30 smithi055 ceph-mon[31863]: pgmap v3288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:15:31.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5203 sec 2024-03-28T07:15:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:32 smithi086 ceph-mon[35163]: pgmap v3289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:15:32.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:32 smithi159 ceph-mon[36109]: pgmap v3289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:15:32.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5204 sec 2024-03-28T07:15:32.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:32 smithi055 ceph-mon[31863]: pgmap v3289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:15:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4532.862880 secs 2024-03-28T07:15:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4532.862880 secs 2024-03-28T07:15:33.838 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5205 sec 2024-03-28T07:15:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4532.862880 secs 2024-03-28T07:15:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:34 smithi086 ceph-mon[35163]: pgmap v3290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:34 smithi159 ceph-mon[36109]: pgmap v3290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:34.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5206 sec 2024-03-28T07:15:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:34 smithi055 ceph-mon[31863]: pgmap v3290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:35.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5207 sec 2024-03-28T07:15:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:36 smithi086 ceph-mon[35163]: pgmap v3291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:36.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:36 smithi159 ceph-mon[36109]: pgmap v3291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:36.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5208 sec 2024-03-28T07:15:36.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:36 smithi055 ceph-mon[31863]: pgmap v3291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:37.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5209 sec 2024-03-28T07:15:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:38 smithi086 ceph-mon[35163]: pgmap v3292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4537.862996 secs 2024-03-28T07:15:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:38 smithi159 ceph-mon[36109]: pgmap v3292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4537.862996 secs 2024-03-28T07:15:38.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5210 sec 2024-03-28T07:15:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:38 smithi055 ceph-mon[31863]: pgmap v3292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4537.862996 secs 2024-03-28T07:15:39.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5211 sec 2024-03-28T07:15:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:40 smithi086 ceph-mon[35163]: pgmap v3293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:40 smithi159 ceph-mon[36109]: pgmap v3293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:40.839 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5212 sec 2024-03-28T07:15:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:40 smithi055 ceph-mon[31863]: pgmap v3293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:41.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5213 sec 2024-03-28T07:15:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:42 smithi086 ceph-mon[35163]: pgmap v3294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:42.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:42 smithi159 ceph-mon[36109]: pgmap v3294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:42.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5214 sec 2024-03-28T07:15:42.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:42 smithi055 ceph-mon[31863]: pgmap v3294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4542.863088 secs 2024-03-28T07:15:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4542.863088 secs 2024-03-28T07:15:43.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5215 sec 2024-03-28T07:15:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4542.863088 secs 2024-03-28T07:15:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:44 smithi086 ceph-mon[35163]: pgmap v3295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:44.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:44 smithi159 ceph-mon[36109]: pgmap v3295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:44.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5216 sec 2024-03-28T07:15:44.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:44 smithi055 ceph-mon[31863]: pgmap v3295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:45.840 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5217 sec 2024-03-28T07:15:46.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5218 sec 2024-03-28T07:15:46.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:46 smithi055 ceph-mon[31863]: pgmap v3296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:46 smithi086 ceph-mon[35163]: pgmap v3296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:46 smithi159 ceph-mon[36109]: pgmap v3296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:47.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5219 sec 2024-03-28T07:15:48.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5220 sec 2024-03-28T07:15:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:48 smithi055 ceph-mon[31863]: pgmap v3297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4547.863184 secs 2024-03-28T07:15:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:48 smithi086 ceph-mon[35163]: pgmap v3297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4547.863184 secs 2024-03-28T07:15:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:48 smithi159 ceph-mon[36109]: pgmap v3297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4547.863184 secs 2024-03-28T07:15:49.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5221 sec 2024-03-28T07:15:50.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5222 sec 2024-03-28T07:15:50.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:50 smithi055 ceph-mon[31863]: pgmap v3298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:50 smithi086 ceph-mon[35163]: pgmap v3298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:50 smithi159 ceph-mon[36109]: pgmap v3298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:51.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5223 sec 2024-03-28T07:15:52.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5224 sec 2024-03-28T07:15:52.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:52 smithi055 ceph-mon[31863]: pgmap v3299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:52 smithi086 ceph-mon[35163]: pgmap v3299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:52 smithi159 ceph-mon[36109]: pgmap v3299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:53.841 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5225 sec 2024-03-28T07:15:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4552.863271 secs 2024-03-28T07:15:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4552.863271 secs 2024-03-28T07:15:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4552.863271 secs 2024-03-28T07:15:54.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5226 sec 2024-03-28T07:15:54.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:54 smithi055 ceph-mon[31863]: pgmap v3300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:54 smithi086 ceph-mon[35163]: pgmap v3300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:54 smithi159 ceph-mon[36109]: pgmap v3300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:15:55.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5227 sec 2024-03-28T07:15:56.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5228 sec 2024-03-28T07:15:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:56 smithi055 ceph-mon[31863]: pgmap v3301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:56 smithi086 ceph-mon[35163]: pgmap v3301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:56 smithi159 ceph-mon[36109]: pgmap v3301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:15:57.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5229 sec 2024-03-28T07:15:58.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5230 sec 2024-03-28T07:15:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:58 smithi055 ceph-mon[31863]: pgmap v3302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:15:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4557.863346 secs 2024-03-28T07:15:58.875 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:58 smithi159 ceph-mon[36109]: pgmap v3302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:58.875 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:15:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4557.863346 secs 2024-03-28T07:15:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:58 smithi086 ceph-mon[35163]: pgmap v3302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:15:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:15:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4557.863346 secs 2024-03-28T07:15:59.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5231 sec 2024-03-28T07:16:00.842 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5232 sec 2024-03-28T07:16:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:00 smithi086 ceph-mon[35163]: pgmap v3303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:00 smithi159 ceph-mon[36109]: pgmap v3303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:00 smithi055 ceph-mon[31863]: pgmap v3303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:01.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5233 sec 2024-03-28T07:16:02.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5234 sec 2024-03-28T07:16:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:02 smithi086 ceph-mon[35163]: pgmap v3304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:03.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:02 smithi159 ceph-mon[36109]: pgmap v3304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:02 smithi055 ceph-mon[31863]: pgmap v3304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:03.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5235 sec 2024-03-28T07:16:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4562.863446 secs 2024-03-28T07:16:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4562.863446 secs 2024-03-28T07:16:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4562.863446 secs 2024-03-28T07:16:04.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5236 sec 2024-03-28T07:16:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:04 smithi086 ceph-mon[35163]: pgmap v3305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:05.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:04 smithi159 ceph-mon[36109]: pgmap v3305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:04 smithi055 ceph-mon[31863]: pgmap v3305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:05.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5237 sec 2024-03-28T07:16:06.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5238 sec 2024-03-28T07:16:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:06 smithi086 ceph-mon[35163]: pgmap v3306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:06 smithi159 ceph-mon[36109]: pgmap v3306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:06 smithi055 ceph-mon[31863]: pgmap v3306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:07.843 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5239 sec 2024-03-28T07:16:08.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5240 sec 2024-03-28T07:16:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:08 smithi086 ceph-mon[35163]: pgmap v3307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4567.863567 secs 2024-03-28T07:16:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:08 smithi159 ceph-mon[36109]: pgmap v3307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4567.863567 secs 2024-03-28T07:16:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:08 smithi055 ceph-mon[31863]: pgmap v3307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4567.863567 secs 2024-03-28T07:16:09.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5241 sec 2024-03-28T07:16:10.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5242 sec 2024-03-28T07:16:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:10 smithi086 ceph-mon[35163]: pgmap v3308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:10 smithi159 ceph-mon[36109]: pgmap v3308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:10 smithi055 ceph-mon[31863]: pgmap v3308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:11.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5243 sec 2024-03-28T07:16:12.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5244 sec 2024-03-28T07:16:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:12 smithi086 ceph-mon[35163]: pgmap v3309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:12 smithi159 ceph-mon[36109]: pgmap v3309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:12 smithi055 ceph-mon[31863]: pgmap v3309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:13.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5245 sec 2024-03-28T07:16:13.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4572.863630 secs 2024-03-28T07:16:14.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4572.863630 secs 2024-03-28T07:16:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4572.863630 secs 2024-03-28T07:16:14.844 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5246 sec 2024-03-28T07:16:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:14 smithi086 ceph-mon[35163]: pgmap v3310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:14 smithi159 ceph-mon[36109]: pgmap v3310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:14 smithi055 ceph-mon[31863]: pgmap v3310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:15.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5247 sec 2024-03-28T07:16:16.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5248 sec 2024-03-28T07:16:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:16 smithi086 ceph-mon[35163]: pgmap v3311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:17.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:16 smithi159 ceph-mon[36109]: pgmap v3311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:16 smithi055 ceph-mon[31863]: pgmap v3311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:17.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5249 sec 2024-03-28T07:16:18.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5250 sec 2024-03-28T07:16:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:18 smithi086 ceph-mon[35163]: pgmap v3312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:16:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4577.863707 secs 2024-03-28T07:16:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:18 smithi159 ceph-mon[36109]: pgmap v3312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:16:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4577.863707 secs 2024-03-28T07:16:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:18 smithi055 ceph-mon[31863]: pgmap v3312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:16:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4577.863707 secs 2024-03-28T07:16:19.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5251 sec 2024-03-28T07:16:20.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5252 sec 2024-03-28T07:16:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:20 smithi086 ceph-mon[35163]: pgmap v3313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:21.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:20 smithi159 ceph-mon[36109]: pgmap v3313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:20 smithi055 ceph-mon[31863]: pgmap v3313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:21.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5253 sec 2024-03-28T07:16:22.845 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5254 sec 2024-03-28T07:16:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:22 smithi086 ceph-mon[35163]: pgmap v3314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:16:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:22 smithi159 ceph-mon[36109]: pgmap v3314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:16:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:22 smithi055 ceph-mon[31863]: pgmap v3314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:16:23.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5255 sec 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4582.863786 secs 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:16:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:16:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4582.863786 secs 2024-03-28T07:16:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:16:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:16:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4582.863786 secs 2024-03-28T07:16:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:16:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:16:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:16:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:16:24.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5256 sec 2024-03-28T07:16:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:24 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:16:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:24 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:16:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:24 smithi086 ceph-mon[35163]: pgmap v3315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:24 smithi086 ceph-mon[35163]: pgmap v3316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:24 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:16:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:24 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:16:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:24 smithi159 ceph-mon[36109]: pgmap v3315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:24 smithi159 ceph-mon[36109]: pgmap v3316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:24 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:16:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:24 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:16:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:24 smithi055 ceph-mon[31863]: pgmap v3315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:24 smithi055 ceph-mon[31863]: pgmap v3316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:25.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5257 sec 2024-03-28T07:16:26.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5258 sec 2024-03-28T07:16:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:26 smithi086 ceph-mon[35163]: pgmap v3317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:26 smithi159 ceph-mon[36109]: pgmap v3317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:26 smithi055 ceph-mon[31863]: pgmap v3317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:27.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5259 sec 2024-03-28T07:16:28.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5260 sec 2024-03-28T07:16:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:28 smithi086 ceph-mon[35163]: pgmap v3318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4587.863896 secs 2024-03-28T07:16:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:28 smithi159 ceph-mon[36109]: pgmap v3318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4587.863896 secs 2024-03-28T07:16:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:28 smithi055 ceph-mon[31863]: pgmap v3318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4587.863896 secs 2024-03-28T07:16:29.846 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5261 sec 2024-03-28T07:16:30.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5262 sec 2024-03-28T07:16:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:30 smithi086 ceph-mon[35163]: pgmap v3319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:31.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:30 smithi159 ceph-mon[36109]: pgmap v3319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:30 smithi055 ceph-mon[31863]: pgmap v3319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:31.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5263 sec 2024-03-28T07:16:32.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5264 sec 2024-03-28T07:16:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:32 smithi086 ceph-mon[35163]: pgmap v3320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:32 smithi159 ceph-mon[36109]: pgmap v3320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:32 smithi055 ceph-mon[31863]: pgmap v3320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:16:33.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5265 sec 2024-03-28T07:16:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4592.864029 secs 2024-03-28T07:16:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4592.864029 secs 2024-03-28T07:16:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4592.864029 secs 2024-03-28T07:16:34.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5266 sec 2024-03-28T07:16:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:34 smithi086 ceph-mon[35163]: pgmap v3321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:35.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:34 smithi159 ceph-mon[36109]: pgmap v3321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:34 smithi055 ceph-mon[31863]: pgmap v3321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:16:35.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5267 sec 2024-03-28T07:16:36.847 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5268 sec 2024-03-28T07:16:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:36 smithi086 ceph-mon[35163]: pgmap v3322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:36 smithi159 ceph-mon[36109]: pgmap v3322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:36 smithi055 ceph-mon[31863]: pgmap v3322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:37.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5269 sec 2024-03-28T07:16:38.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5270 sec 2024-03-28T07:16:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:38 smithi055 ceph-mon[31863]: pgmap v3323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4597.864113 secs 2024-03-28T07:16:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:38 smithi086 ceph-mon[35163]: pgmap v3323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4597.864113 secs 2024-03-28T07:16:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:38 smithi159 ceph-mon[36109]: pgmap v3323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4597.864113 secs 2024-03-28T07:16:39.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5271 sec 2024-03-28T07:16:40.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5272 sec 2024-03-28T07:16:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:40 smithi055 ceph-mon[31863]: pgmap v3324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:40 smithi086 ceph-mon[35163]: pgmap v3324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:41.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:40 smithi159 ceph-mon[36109]: pgmap v3324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:41.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5273 sec 2024-03-28T07:16:42.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5274 sec 2024-03-28T07:16:43.122 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:42 smithi086 ceph-mon[35163]: pgmap v3325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:42 smithi055 ceph-mon[31863]: pgmap v3325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:42 smithi159 ceph-mon[36109]: pgmap v3325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:43.848 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5275 sec 2024-03-28T07:16:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4602.864240 secs 2024-03-28T07:16:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4602.864240 secs 2024-03-28T07:16:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4602.864240 secs 2024-03-28T07:16:44.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5276 sec 2024-03-28T07:16:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:44 smithi055 ceph-mon[31863]: pgmap v3326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:44 smithi086 ceph-mon[35163]: pgmap v3326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:44 smithi159 ceph-mon[36109]: pgmap v3326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:45.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5277 sec 2024-03-28T07:16:46.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5278 sec 2024-03-28T07:16:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:46 smithi055 ceph-mon[31863]: pgmap v3327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:46 smithi086 ceph-mon[35163]: pgmap v3327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:46 smithi159 ceph-mon[36109]: pgmap v3327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:47.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5279 sec 2024-03-28T07:16:48.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5280 sec 2024-03-28T07:16:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:48 smithi086 ceph-mon[35163]: pgmap v3328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4607.864360 secs 2024-03-28T07:16:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:48 smithi159 ceph-mon[36109]: pgmap v3328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4607.864360 secs 2024-03-28T07:16:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:48 smithi055 ceph-mon[31863]: pgmap v3328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4607.864360 secs 2024-03-28T07:16:49.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5281 sec 2024-03-28T07:16:50.849 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5282 sec 2024-03-28T07:16:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:50 smithi086 ceph-mon[35163]: pgmap v3329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:50 smithi159 ceph-mon[36109]: pgmap v3329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:51.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:50 smithi055 ceph-mon[31863]: pgmap v3329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:51.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5283 sec 2024-03-28T07:16:52.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5284 sec 2024-03-28T07:16:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:52 smithi086 ceph-mon[35163]: pgmap v3330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:52 smithi159 ceph-mon[36109]: pgmap v3330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:52 smithi055 ceph-mon[31863]: pgmap v3330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:53.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5285 sec 2024-03-28T07:16:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4612.864484 secs 2024-03-28T07:16:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4612.864484 secs 2024-03-28T07:16:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4612.864484 secs 2024-03-28T07:16:54.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5286 sec 2024-03-28T07:16:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:54 smithi086 ceph-mon[35163]: pgmap v3331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:54 smithi159 ceph-mon[36109]: pgmap v3331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:55.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:54 smithi055 ceph-mon[31863]: pgmap v3331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:16:55.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5287 sec 2024-03-28T07:16:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:55 smithi086 ceph-mon[35163]: pgmap v3332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:55 smithi159 ceph-mon[36109]: pgmap v3332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:56.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:55 smithi055 ceph-mon[31863]: pgmap v3332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:16:56.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5288 sec 2024-03-28T07:16:57.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5289 sec 2024-03-28T07:16:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:58 smithi055 ceph-mon[31863]: pgmap v3333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:16:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4617.864603 secs 2024-03-28T07:16:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:58 smithi086 ceph-mon[35163]: pgmap v3333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:16:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4617.864603 secs 2024-03-28T07:16:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:58 smithi159 ceph-mon[36109]: pgmap v3333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:16:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:16:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4617.864603 secs 2024-03-28T07:16:58.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5290 sec 2024-03-28T07:16:59.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5291 sec 2024-03-28T07:17:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:00 smithi055 ceph-mon[31863]: pgmap v3334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:00 smithi086 ceph-mon[35163]: pgmap v3334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:00.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:00 smithi159 ceph-mon[36109]: pgmap v3334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:00.850 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5292 sec 2024-03-28T07:17:01.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5293 sec 2024-03-28T07:17:02.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:02 smithi055 ceph-mon[31863]: pgmap v3335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:02 smithi086 ceph-mon[35163]: pgmap v3335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:02.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:02 smithi159 ceph-mon[36109]: pgmap v3335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:02.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5294 sec 2024-03-28T07:17:03.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4622.864727 secs 2024-03-28T07:17:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4622.864727 secs 2024-03-28T07:17:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4622.864727 secs 2024-03-28T07:17:03.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5295 sec 2024-03-28T07:17:04.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:04 smithi055 ceph-mon[31863]: pgmap v3336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:04 smithi086 ceph-mon[35163]: pgmap v3336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:04.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:04 smithi159 ceph-mon[36109]: pgmap v3336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:04.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5296 sec 2024-03-28T07:17:05.852 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5297 sec 2024-03-28T07:17:06.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:06 smithi055 ceph-mon[31863]: pgmap v3337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:06 smithi086 ceph-mon[35163]: pgmap v3337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:06.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:06 smithi159 ceph-mon[36109]: pgmap v3337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:06.851 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5298 sec 2024-03-28T07:17:07.852 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5299 sec 2024-03-28T07:17:08.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:08 smithi055 ceph-mon[31863]: pgmap v3338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:08.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4627.864855 secs 2024-03-28T07:17:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:08 smithi086 ceph-mon[35163]: pgmap v3338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4627.864855 secs 2024-03-28T07:17:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:08 smithi159 ceph-mon[36109]: pgmap v3338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:08.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4627.864855 secs 2024-03-28T07:17:08.852 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5300 sec 2024-03-28T07:17:09.852 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5301 sec 2024-03-28T07:17:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:10 smithi086 ceph-mon[35163]: pgmap v3339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:10.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:10 smithi159 ceph-mon[36109]: pgmap v3339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:10.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5302 sec 2024-03-28T07:17:10.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:10 smithi055 ceph-mon[31863]: pgmap v3339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:11.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5303 sec 2024-03-28T07:17:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:12 smithi086 ceph-mon[35163]: pgmap v3340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:12.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:12 smithi159 ceph-mon[36109]: pgmap v3340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:12.852 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5304 sec 2024-03-28T07:17:12.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:12 smithi055 ceph-mon[31863]: pgmap v3340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:13.722 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4632.864905 secs 2024-03-28T07:17:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4632.864905 secs 2024-03-28T07:17:13.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5305 sec 2024-03-28T07:17:13.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4632.864905 secs 2024-03-28T07:17:14.777 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:14 smithi055 ceph-mon[31863]: pgmap v3341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:14 smithi086 ceph-mon[35163]: pgmap v3341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:14.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:14 smithi159 ceph-mon[36109]: pgmap v3341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:14.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5306 sec 2024-03-28T07:17:15.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5307 sec 2024-03-28T07:17:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:16 smithi086 ceph-mon[35163]: pgmap v3342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:16.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:16 smithi159 ceph-mon[36109]: pgmap v3342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:16.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5308 sec 2024-03-28T07:17:16.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:16 smithi055 ceph-mon[31863]: pgmap v3342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:17:17.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5309 sec 2024-03-28T07:17:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:18 smithi086 ceph-mon[35163]: pgmap v3343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4637.864985 secs 2024-03-28T07:17:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:18 smithi159 ceph-mon[36109]: pgmap v3343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4637.864985 secs 2024-03-28T07:17:18.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5310 sec 2024-03-28T07:17:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:18 smithi055 ceph-mon[31863]: pgmap v3343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:18.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4637.864985 secs 2024-03-28T07:17:19.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5311 sec 2024-03-28T07:17:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:20 smithi086 ceph-mon[35163]: pgmap v3344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:20.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:20 smithi159 ceph-mon[36109]: pgmap v3344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:20.853 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5312 sec 2024-03-28T07:17:20.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:20 smithi055 ceph-mon[31863]: pgmap v3344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:21.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5313 sec 2024-03-28T07:17:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:22 smithi086 ceph-mon[35163]: pgmap v3345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:22.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:22 smithi159 ceph-mon[36109]: pgmap v3345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:22.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5314 sec 2024-03-28T07:17:22.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:22 smithi055 ceph-mon[31863]: pgmap v3345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4642.865069 secs 2024-03-28T07:17:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4642.865069 secs 2024-03-28T07:17:23.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5315 sec 2024-03-28T07:17:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4642.865069 secs 2024-03-28T07:17:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:24 smithi086 ceph-mon[35163]: pgmap v3346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:17:24.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:24 smithi159 ceph-mon[36109]: pgmap v3346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:24.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:17:24.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5316 sec 2024-03-28T07:17:24.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:24 smithi055 ceph-mon[31863]: pgmap v3346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:24.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:17:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:17:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:17:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:17:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:17:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:17:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:17:25.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5317 sec 2024-03-28T07:17:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:17:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:17:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:17:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:26 smithi086 ceph-mon[35163]: pgmap v3347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:26 smithi086 ceph-mon[35163]: pgmap v3348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:17:26.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:26 smithi159 ceph-mon[36109]: pgmap v3347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:26.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:26 smithi159 ceph-mon[36109]: pgmap v3348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:17:26.854 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5318 sec 2024-03-28T07:17:26.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:26 smithi055 ceph-mon[31863]: pgmap v3347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:26.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:26 smithi055 ceph-mon[31863]: pgmap v3348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:17:27.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5319 sec 2024-03-28T07:17:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:28 smithi086 ceph-mon[35163]: pgmap v3349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4647.865157 secs 2024-03-28T07:17:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:28 smithi159 ceph-mon[36109]: pgmap v3349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4647.865157 secs 2024-03-28T07:17:28.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5320 sec 2024-03-28T07:17:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:28 smithi055 ceph-mon[31863]: pgmap v3349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4647.865157 secs 2024-03-28T07:17:29.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5321 sec 2024-03-28T07:17:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:30 smithi086 ceph-mon[35163]: pgmap v3350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:30.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:30 smithi159 ceph-mon[36109]: pgmap v3350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:30.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5322 sec 2024-03-28T07:17:30.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:30 smithi055 ceph-mon[31863]: pgmap v3350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:31.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5323 sec 2024-03-28T07:17:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:32 smithi086 ceph-mon[35163]: pgmap v3351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:32.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:32 smithi159 ceph-mon[36109]: pgmap v3351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:32.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5324 sec 2024-03-28T07:17:32.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:32 smithi055 ceph-mon[31863]: pgmap v3351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4652.865234 secs 2024-03-28T07:17:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4652.865234 secs 2024-03-28T07:17:33.855 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5325 sec 2024-03-28T07:17:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4652.865234 secs 2024-03-28T07:17:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:34 smithi086 ceph-mon[35163]: pgmap v3352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:34 smithi159 ceph-mon[36109]: pgmap v3352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:34.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5326 sec 2024-03-28T07:17:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:34 smithi055 ceph-mon[31863]: pgmap v3352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:35.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5327 sec 2024-03-28T07:17:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:36 smithi086 ceph-mon[35163]: pgmap v3353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:17:36.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:36 smithi159 ceph-mon[36109]: pgmap v3353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:17:36.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5328 sec 2024-03-28T07:17:36.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:36 smithi055 ceph-mon[31863]: pgmap v3353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:17:37.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5329 sec 2024-03-28T07:17:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:38 smithi086 ceph-mon[35163]: pgmap v3354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4657.865354 secs 2024-03-28T07:17:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:38 smithi159 ceph-mon[36109]: pgmap v3354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4657.865354 secs 2024-03-28T07:17:38.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5330 sec 2024-03-28T07:17:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:38 smithi055 ceph-mon[31863]: pgmap v3354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4657.865354 secs 2024-03-28T07:17:39.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5331 sec 2024-03-28T07:17:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:40 smithi086 ceph-mon[35163]: pgmap v3355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:40 smithi159 ceph-mon[36109]: pgmap v3355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:40.856 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5332 sec 2024-03-28T07:17:40.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:40 smithi055 ceph-mon[31863]: pgmap v3355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:17:41.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5333 sec 2024-03-28T07:17:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:42 smithi086 ceph-mon[35163]: pgmap v3356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:42.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:42 smithi159 ceph-mon[36109]: pgmap v3356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:42.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5334 sec 2024-03-28T07:17:42.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:42 smithi055 ceph-mon[31863]: pgmap v3356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4662.865420 secs 2024-03-28T07:17:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4662.865420 secs 2024-03-28T07:17:43.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5335 sec 2024-03-28T07:17:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4662.865420 secs 2024-03-28T07:17:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:44 smithi086 ceph-mon[35163]: pgmap v3357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:44.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:44 smithi159 ceph-mon[36109]: pgmap v3357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:44.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5336 sec 2024-03-28T07:17:44.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:44 smithi055 ceph-mon[31863]: pgmap v3357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:45.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5337 sec 2024-03-28T07:17:46.857 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5338 sec 2024-03-28T07:17:46.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:46 smithi055 ceph-mon[31863]: pgmap v3358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:46 smithi086 ceph-mon[35163]: pgmap v3358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:46 smithi159 ceph-mon[36109]: pgmap v3358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:47.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5339 sec 2024-03-28T07:17:48.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5340 sec 2024-03-28T07:17:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:48 smithi055 ceph-mon[31863]: pgmap v3359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4667.865541 secs 2024-03-28T07:17:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:48 smithi086 ceph-mon[35163]: pgmap v3359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4667.865541 secs 2024-03-28T07:17:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:48 smithi159 ceph-mon[36109]: pgmap v3359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4667.865541 secs 2024-03-28T07:17:49.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5341 sec 2024-03-28T07:17:50.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5342 sec 2024-03-28T07:17:50.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:50 smithi055 ceph-mon[31863]: pgmap v3360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:50 smithi086 ceph-mon[35163]: pgmap v3360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:51.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:50 smithi159 ceph-mon[36109]: pgmap v3360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:51.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5343 sec 2024-03-28T07:17:52.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5344 sec 2024-03-28T07:17:52.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:52 smithi055 ceph-mon[31863]: pgmap v3361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:52 smithi086 ceph-mon[35163]: pgmap v3361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:52 smithi159 ceph-mon[36109]: pgmap v3361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:53.858 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5345 sec 2024-03-28T07:17:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4672.865666 secs 2024-03-28T07:17:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4672.865666 secs 2024-03-28T07:17:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4672.865666 secs 2024-03-28T07:17:54.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5346 sec 2024-03-28T07:17:54.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:54 smithi055 ceph-mon[31863]: pgmap v3362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:54 smithi086 ceph-mon[35163]: pgmap v3362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:54 smithi159 ceph-mon[36109]: pgmap v3362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:55.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5347 sec 2024-03-28T07:17:56.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5348 sec 2024-03-28T07:17:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:56 smithi055 ceph-mon[31863]: pgmap v3363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:56 smithi086 ceph-mon[35163]: pgmap v3363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:56 smithi159 ceph-mon[36109]: pgmap v3363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:17:57.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5349 sec 2024-03-28T07:17:58.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5350 sec 2024-03-28T07:17:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:58 smithi055 ceph-mon[31863]: pgmap v3364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:17:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4677.865818 secs 2024-03-28T07:17:58.875 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:58 smithi159 ceph-mon[36109]: pgmap v3364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:58.875 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:17:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4677.865818 secs 2024-03-28T07:17:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:58 smithi086 ceph-mon[35163]: pgmap v3364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:17:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:17:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4677.865818 secs 2024-03-28T07:17:59.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5351 sec 2024-03-28T07:18:00.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5352 sec 2024-03-28T07:18:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:00 smithi086 ceph-mon[35163]: pgmap v3365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:00 smithi159 ceph-mon[36109]: pgmap v3365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:00 smithi055 ceph-mon[31863]: pgmap v3365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:01.859 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5353 sec 2024-03-28T07:18:02.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5354 sec 2024-03-28T07:18:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:02 smithi086 ceph-mon[35163]: pgmap v3366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:03.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:02 smithi159 ceph-mon[36109]: pgmap v3366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:02 smithi055 ceph-mon[31863]: pgmap v3366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:03.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5355 sec 2024-03-28T07:18:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4682.865940 secs 2024-03-28T07:18:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4682.865940 secs 2024-03-28T07:18:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4682.865940 secs 2024-03-28T07:18:04.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5356 sec 2024-03-28T07:18:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:04 smithi086 ceph-mon[35163]: pgmap v3367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:05.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:04 smithi159 ceph-mon[36109]: pgmap v3367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:04 smithi055 ceph-mon[31863]: pgmap v3367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:05.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5357 sec 2024-03-28T07:18:06.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5358 sec 2024-03-28T07:18:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:06 smithi086 ceph-mon[35163]: pgmap v3368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:06 smithi159 ceph-mon[36109]: pgmap v3368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:06 smithi055 ceph-mon[31863]: pgmap v3368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:07.860 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5359 sec 2024-03-28T07:18:08.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5360 sec 2024-03-28T07:18:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:08 smithi086 ceph-mon[35163]: pgmap v3369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4687.866002 secs 2024-03-28T07:18:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:08 smithi159 ceph-mon[36109]: pgmap v3369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4687.866002 secs 2024-03-28T07:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:08 smithi055 ceph-mon[31863]: pgmap v3369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4687.866002 secs 2024-03-28T07:18:09.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5361 sec 2024-03-28T07:18:10.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5362 sec 2024-03-28T07:18:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:10 smithi086 ceph-mon[35163]: pgmap v3370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:10 smithi159 ceph-mon[36109]: pgmap v3370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:10 smithi055 ceph-mon[31863]: pgmap v3370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:11.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5363 sec 2024-03-28T07:18:12.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5364 sec 2024-03-28T07:18:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:12 smithi086 ceph-mon[35163]: pgmap v3371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:12 smithi159 ceph-mon[36109]: pgmap v3371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:12 smithi055 ceph-mon[31863]: pgmap v3371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:13.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5365 sec 2024-03-28T07:18:13.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4692.866079 secs 2024-03-28T07:18:14.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4692.866079 secs 2024-03-28T07:18:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4692.866079 secs 2024-03-28T07:18:14.861 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5366 sec 2024-03-28T07:18:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:14 smithi086 ceph-mon[35163]: pgmap v3372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:14 smithi159 ceph-mon[36109]: pgmap v3372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:14 smithi055 ceph-mon[31863]: pgmap v3372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:15.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5367 sec 2024-03-28T07:18:16.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5368 sec 2024-03-28T07:18:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:16 smithi086 ceph-mon[35163]: pgmap v3373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:17.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:16 smithi159 ceph-mon[36109]: pgmap v3373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:16 smithi055 ceph-mon[31863]: pgmap v3373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:17.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5369 sec 2024-03-28T07:18:18.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5370 sec 2024-03-28T07:18:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:18 smithi086 ceph-mon[35163]: pgmap v3374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4697.866168 secs 2024-03-28T07:18:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:18 smithi159 ceph-mon[36109]: pgmap v3374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4697.866168 secs 2024-03-28T07:18:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:18 smithi055 ceph-mon[31863]: pgmap v3374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4697.866168 secs 2024-03-28T07:18:19.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5371 sec 2024-03-28T07:18:20.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5372 sec 2024-03-28T07:18:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:20 smithi086 ceph-mon[35163]: pgmap v3375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:21.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:20 smithi159 ceph-mon[36109]: pgmap v3375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:20 smithi055 ceph-mon[31863]: pgmap v3375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:21.862 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5373 sec 2024-03-28T07:18:22.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5374 sec 2024-03-28T07:18:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:22 smithi086 ceph-mon[35163]: pgmap v3376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:23.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:22 smithi159 ceph-mon[36109]: pgmap v3376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:22 smithi055 ceph-mon[31863]: pgmap v3376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:23.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5375 sec 2024-03-28T07:18:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4702.866260 secs 2024-03-28T07:18:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4702.866260 secs 2024-03-28T07:18:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4702.866260 secs 2024-03-28T07:18:24.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5376 sec 2024-03-28T07:18:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:24 smithi086 ceph-mon[35163]: pgmap v3377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:24 smithi159 ceph-mon[36109]: pgmap v3377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:24 smithi055 ceph-mon[31863]: pgmap v3377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:25.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5377 sec 2024-03-28T07:18:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:18:26.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:18:26.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:18:26.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5378 sec 2024-03-28T07:18:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:26 smithi086 ceph-mon[35163]: pgmap v3378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:26 smithi159 ceph-mon[36109]: pgmap v3378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:27.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:26 smithi055 ceph-mon[31863]: pgmap v3378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:27.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5379 sec 2024-03-28T07:18:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:18:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:18:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:18:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:18:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:28.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:18:28.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:18:28.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:18:28.863 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5380 sec 2024-03-28T07:18:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:28 smithi086 ceph-mon[35163]: pgmap v3379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4707.866346 secs 2024-03-28T07:18:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:28 smithi086 ceph-mon[35163]: pgmap v3380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:18:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:28 smithi086 ceph-mon[35163]: pgmap v3381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:28 smithi159 ceph-mon[36109]: pgmap v3379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4707.866346 secs 2024-03-28T07:18:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:28 smithi159 ceph-mon[36109]: pgmap v3380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:18:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:28 smithi159 ceph-mon[36109]: pgmap v3381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:28 smithi055 ceph-mon[31863]: pgmap v3379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4707.866346 secs 2024-03-28T07:18:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:28 smithi055 ceph-mon[31863]: pgmap v3380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:18:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:28 smithi055 ceph-mon[31863]: pgmap v3381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:29.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5381 sec 2024-03-28T07:18:30.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5382 sec 2024-03-28T07:18:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:30 smithi086 ceph-mon[35163]: pgmap v3382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:31.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:30 smithi159 ceph-mon[36109]: pgmap v3382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:30 smithi055 ceph-mon[31863]: pgmap v3382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:31.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5383 sec 2024-03-28T07:18:32.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5384 sec 2024-03-28T07:18:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:32 smithi086 ceph-mon[35163]: pgmap v3383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:32 smithi159 ceph-mon[36109]: pgmap v3383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:32 smithi055 ceph-mon[31863]: pgmap v3383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:33.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5385 sec 2024-03-28T07:18:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4712.866465 secs 2024-03-28T07:18:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4712.866465 secs 2024-03-28T07:18:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4712.866465 secs 2024-03-28T07:18:34.864 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5386 sec 2024-03-28T07:18:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:34 smithi086 ceph-mon[35163]: pgmap v3384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:34 smithi159 ceph-mon[36109]: pgmap v3384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:35.128 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:34 smithi055 ceph-mon[31863]: pgmap v3384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:35.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5387 sec 2024-03-28T07:18:36.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5388 sec 2024-03-28T07:18:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:36 smithi086 ceph-mon[35163]: pgmap v3385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:36 smithi159 ceph-mon[36109]: pgmap v3385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:36 smithi055 ceph-mon[31863]: pgmap v3385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:18:37.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5389 sec 2024-03-28T07:18:38.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5390 sec 2024-03-28T07:18:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4717.866583 secs 2024-03-28T07:18:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:38 smithi159 ceph-mon[36109]: pgmap v3386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:18:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4717.866583 secs 2024-03-28T07:18:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:38 smithi055 ceph-mon[31863]: pgmap v3386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:18:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4717.866583 secs 2024-03-28T07:18:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:38 smithi086 ceph-mon[35163]: pgmap v3386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:18:39.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5391 sec 2024-03-28T07:18:40.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5392 sec 2024-03-28T07:18:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:40 smithi055 ceph-mon[31863]: pgmap v3387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:40 smithi086 ceph-mon[35163]: pgmap v3387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:41.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:40 smithi159 ceph-mon[36109]: pgmap v3387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:41.865 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5393 sec 2024-03-28T07:18:42.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5394 sec 2024-03-28T07:18:43.123 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:42 smithi086 ceph-mon[35163]: pgmap v3388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:42 smithi055 ceph-mon[31863]: pgmap v3388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:42 smithi159 ceph-mon[36109]: pgmap v3388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:43.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5395 sec 2024-03-28T07:18:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4722.866629 secs 2024-03-28T07:18:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4722.866629 secs 2024-03-28T07:18:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4722.866629 secs 2024-03-28T07:18:44.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5396 sec 2024-03-28T07:18:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:44 smithi055 ceph-mon[31863]: pgmap v3389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:44 smithi086 ceph-mon[35163]: pgmap v3389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:44 smithi159 ceph-mon[36109]: pgmap v3389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:45.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5397 sec 2024-03-28T07:18:46.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5398 sec 2024-03-28T07:18:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:46 smithi055 ceph-mon[31863]: pgmap v3390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:46 smithi086 ceph-mon[35163]: pgmap v3390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:46 smithi159 ceph-mon[36109]: pgmap v3390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:47.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5399 sec 2024-03-28T07:18:48.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5400 sec 2024-03-28T07:18:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4727.866747 secs 2024-03-28T07:18:49.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:48 smithi055 ceph-mon[31863]: pgmap v3391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4727.866747 secs 2024-03-28T07:18:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:48 smithi086 ceph-mon[35163]: pgmap v3391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4727.866747 secs 2024-03-28T07:18:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:48 smithi159 ceph-mon[36109]: pgmap v3391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:49.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5401 sec 2024-03-28T07:18:50.866 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5402 sec 2024-03-28T07:18:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:50 smithi086 ceph-mon[35163]: pgmap v3392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:50 smithi159 ceph-mon[36109]: pgmap v3392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:51.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:50 smithi055 ceph-mon[31863]: pgmap v3392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:51.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5403 sec 2024-03-28T07:18:52.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5404 sec 2024-03-28T07:18:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:52 smithi086 ceph-mon[35163]: pgmap v3393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:52 smithi159 ceph-mon[36109]: pgmap v3393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:52 smithi055 ceph-mon[31863]: pgmap v3393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:53.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5405 sec 2024-03-28T07:18:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4732.866869 secs 2024-03-28T07:18:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4732.866869 secs 2024-03-28T07:18:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4732.866869 secs 2024-03-28T07:18:54.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5406 sec 2024-03-28T07:18:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:54 smithi086 ceph-mon[35163]: pgmap v3394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:54 smithi159 ceph-mon[36109]: pgmap v3394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:55.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:54 smithi055 ceph-mon[31863]: pgmap v3394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:18:55.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5407 sec 2024-03-28T07:18:56.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5408 sec 2024-03-28T07:18:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:56 smithi086 ceph-mon[35163]: pgmap v3395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:57.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:56 smithi159 ceph-mon[36109]: pgmap v3395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:56 smithi055 ceph-mon[31863]: pgmap v3395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:18:57.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5409 sec 2024-03-28T07:18:58.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5410 sec 2024-03-28T07:18:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4737.866986 secs 2024-03-28T07:18:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:18:58 smithi086 ceph-mon[35163]: pgmap v3396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4737.866986 secs 2024-03-28T07:18:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:18:58 smithi159 ceph-mon[36109]: pgmap v3396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4737.866986 secs 2024-03-28T07:18:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:18:58 smithi055 ceph-mon[31863]: pgmap v3396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:18:59.867 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5411 sec 2024-03-28T07:19:00.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5412 sec 2024-03-28T07:19:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:00 smithi086 ceph-mon[35163]: pgmap v3397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:00 smithi159 ceph-mon[36109]: pgmap v3397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:00 smithi055 ceph-mon[31863]: pgmap v3397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:01.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5413 sec 2024-03-28T07:19:02.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5414 sec 2024-03-28T07:19:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:02 smithi086 ceph-mon[35163]: pgmap v3398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:02 smithi159 ceph-mon[36109]: pgmap v3398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:02 smithi055 ceph-mon[31863]: pgmap v3398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:03.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5415 sec 2024-03-28T07:19:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4742.867053 secs 2024-03-28T07:19:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4742.867053 secs 2024-03-28T07:19:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4742.867053 secs 2024-03-28T07:19:04.868 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5416 sec 2024-03-28T07:19:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:04 smithi086 ceph-mon[35163]: pgmap v3399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:04 smithi159 ceph-mon[36109]: pgmap v3399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:04 smithi055 ceph-mon[31863]: pgmap v3399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:05.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5417 sec 2024-03-28T07:19:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:05 smithi086 ceph-mon[35163]: pgmap v3400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:06.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:05 smithi159 ceph-mon[36109]: pgmap v3400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:06.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:05 smithi055 ceph-mon[31863]: pgmap v3400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:06.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5418 sec 2024-03-28T07:19:07.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5419 sec 2024-03-28T07:19:08.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5420 sec 2024-03-28T07:19:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4747.867117 secs 2024-03-28T07:19:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:08 smithi086 ceph-mon[35163]: pgmap v3401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4747.867117 secs 2024-03-28T07:19:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:08 smithi159 ceph-mon[36109]: pgmap v3401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4747.867117 secs 2024-03-28T07:19:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:08 smithi055 ceph-mon[31863]: pgmap v3401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:09.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5421 sec 2024-03-28T07:19:10.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5422 sec 2024-03-28T07:19:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:10 smithi086 ceph-mon[35163]: pgmap v3402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:10 smithi159 ceph-mon[36109]: pgmap v3402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:10 smithi055 ceph-mon[31863]: pgmap v3402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:11.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5423 sec 2024-03-28T07:19:12.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5424 sec 2024-03-28T07:19:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:12 smithi086 ceph-mon[35163]: pgmap v3403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:12 smithi159 ceph-mon[36109]: pgmap v3403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:12 smithi055 ceph-mon[31863]: pgmap v3403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:13.869 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5425 sec 2024-03-28T07:19:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4752.867183 secs 2024-03-28T07:19:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4752.867183 secs 2024-03-28T07:19:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4752.867183 secs 2024-03-28T07:19:14.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5426 sec 2024-03-28T07:19:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:14 smithi086 ceph-mon[35163]: pgmap v3404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:14 smithi159 ceph-mon[36109]: pgmap v3404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:14 smithi055 ceph-mon[31863]: pgmap v3404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:15.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5427 sec 2024-03-28T07:19:16.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5428 sec 2024-03-28T07:19:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:16 smithi086 ceph-mon[35163]: pgmap v3405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:17.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:16 smithi159 ceph-mon[36109]: pgmap v3405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:16 smithi055 ceph-mon[31863]: pgmap v3405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:17.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5429 sec 2024-03-28T07:19:18.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5430 sec 2024-03-28T07:19:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4757.867302 secs 2024-03-28T07:19:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:18 smithi086 ceph-mon[35163]: pgmap v3406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4757.867302 secs 2024-03-28T07:19:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:18 smithi159 ceph-mon[36109]: pgmap v3406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4757.867302 secs 2024-03-28T07:19:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:18 smithi055 ceph-mon[31863]: pgmap v3406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:19.870 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5431 sec 2024-03-28T07:19:20.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5432 sec 2024-03-28T07:19:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:20 smithi055 ceph-mon[31863]: pgmap v3407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:20 smithi086 ceph-mon[35163]: pgmap v3407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:20 smithi159 ceph-mon[36109]: pgmap v3407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:21.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5433 sec 2024-03-28T07:19:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:22 smithi086 ceph-mon[35163]: pgmap v3408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:22.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:22 smithi159 ceph-mon[36109]: pgmap v3408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:22.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:22 smithi055 ceph-mon[31863]: pgmap v3408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:22.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5434 sec 2024-03-28T07:19:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4762.867424 secs 2024-03-28T07:19:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4762.867424 secs 2024-03-28T07:19:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4762.867424 secs 2024-03-28T07:19:23.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5435 sec 2024-03-28T07:19:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:24 smithi086 ceph-mon[35163]: pgmap v3409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:24 smithi159 ceph-mon[36109]: pgmap v3409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:24.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:24 smithi055 ceph-mon[31863]: pgmap v3409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:24.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5436 sec 2024-03-28T07:19:25.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5437 sec 2024-03-28T07:19:26.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5438 sec 2024-03-28T07:19:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:26 smithi086 ceph-mon[35163]: pgmap v3410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:26 smithi159 ceph-mon[36109]: pgmap v3410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:26 smithi055 ceph-mon[31863]: pgmap v3410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:27.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5439 sec 2024-03-28T07:19:28.871 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5440 sec 2024-03-28T07:19:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4767.867486 secs 2024-03-28T07:19:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:28 smithi086 ceph-mon[35163]: pgmap v3411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:19:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4767.867486 secs 2024-03-28T07:19:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:28 smithi159 ceph-mon[36109]: pgmap v3411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:19:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4767.867486 secs 2024-03-28T07:19:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:28 smithi055 ceph-mon[31863]: pgmap v3411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:19:29.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5441 sec 2024-03-28T07:19:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:30 smithi086 ceph-mon[35163]: pgmap v3412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:30 smithi159 ceph-mon[36109]: pgmap v3412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:30.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:30.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:30 smithi055 ceph-mon[31863]: pgmap v3412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:30.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5442 sec 2024-03-28T07:19:31.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5443 sec 2024-03-28T07:19:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:32 smithi086 ceph-mon[35163]: pgmap v3413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:32.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:32 smithi159 ceph-mon[36109]: pgmap v3413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:32.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:32.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:32 smithi055 ceph-mon[31863]: pgmap v3413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:32.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5444 sec 2024-03-28T07:19:33.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5445 sec 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4772.867558 secs 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:33 smithi086 ceph-mon[35163]: pgmap v3414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4772.867558 secs 2024-03-28T07:19:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:33 smithi159 ceph-mon[36109]: pgmap v3414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4772.867558 secs 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:33 smithi055 ceph-mon[31863]: pgmap v3414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:34.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5446 sec 2024-03-28T07:19:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:19:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:19:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:35 smithi086 ceph-mon[35163]: pgmap v3415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:19:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:35 smithi086 ceph-mon[35163]: pgmap v3416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:19:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:19:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:19:35.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:35 smithi159 ceph-mon[36109]: pgmap v3415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:19:35.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:35 smithi159 ceph-mon[36109]: pgmap v3416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:19:35.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:19:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:19:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:35 smithi055 ceph-mon[31863]: pgmap v3415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:19:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:35 smithi055 ceph-mon[31863]: pgmap v3416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:19:35.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:19:35.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5447 sec 2024-03-28T07:19:36.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5448 sec 2024-03-28T07:19:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:37 smithi086 ceph-mon[35163]: pgmap v3417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:37.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:37 smithi159 ceph-mon[36109]: pgmap v3417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:37.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:37 smithi055 ceph-mon[31863]: pgmap v3417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:37.872 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5449 sec 2024-03-28T07:19:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4777.867679 secs 2024-03-28T07:19:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4777.867679 secs 2024-03-28T07:19:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4777.867679 secs 2024-03-28T07:19:38.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5450 sec 2024-03-28T07:19:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:39 smithi086 ceph-mon[35163]: pgmap v3418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:39 smithi159 ceph-mon[36109]: pgmap v3418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:39.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:39 smithi055 ceph-mon[31863]: pgmap v3418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:39.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5451 sec 2024-03-28T07:19:40.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5452 sec 2024-03-28T07:19:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:41 smithi086 ceph-mon[35163]: pgmap v3419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:41.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:41 smithi159 ceph-mon[36109]: pgmap v3419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:41.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5453 sec 2024-03-28T07:19:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:41 smithi055 ceph-mon[31863]: pgmap v3419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:19:42.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5454 sec 2024-03-28T07:19:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:43 smithi086 ceph-mon[35163]: pgmap v3420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4782.867763 secs 2024-03-28T07:19:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:43 smithi159 ceph-mon[36109]: pgmap v3420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:43.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4782.867763 secs 2024-03-28T07:19:43.873 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5455 sec 2024-03-28T07:19:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:43 smithi055 ceph-mon[31863]: pgmap v3420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4782.867763 secs 2024-03-28T07:19:44.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5456 sec 2024-03-28T07:19:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:45 smithi086 ceph-mon[35163]: pgmap v3421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:19:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:45 smithi159 ceph-mon[36109]: pgmap v3421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:19:45.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5457 sec 2024-03-28T07:19:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:45 smithi055 ceph-mon[31863]: pgmap v3421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:19:46.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5458 sec 2024-03-28T07:19:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:47 smithi086 ceph-mon[35163]: pgmap v3422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:47.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:47 smithi159 ceph-mon[36109]: pgmap v3422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:47.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5459 sec 2024-03-28T07:19:47.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:47 smithi055 ceph-mon[31863]: pgmap v3422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4787.867846 secs 2024-03-28T07:19:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4787.867846 secs 2024-03-28T07:19:48.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5460 sec 2024-03-28T07:19:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4787.867846 secs 2024-03-28T07:19:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:49 smithi086 ceph-mon[35163]: pgmap v3423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:49.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:49 smithi159 ceph-mon[36109]: pgmap v3423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:49.874 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5461 sec 2024-03-28T07:19:49.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:49 smithi055 ceph-mon[31863]: pgmap v3423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:50.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5462 sec 2024-03-28T07:19:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:51 smithi086 ceph-mon[35163]: pgmap v3424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:51.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:51 smithi159 ceph-mon[36109]: pgmap v3424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:51.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5463 sec 2024-03-28T07:19:51.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:51 smithi055 ceph-mon[31863]: pgmap v3424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:19:52.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5464 sec 2024-03-28T07:19:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:53 smithi086 ceph-mon[35163]: pgmap v3425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4792.867967 secs 2024-03-28T07:19:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:53 smithi159 ceph-mon[36109]: pgmap v3425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4792.867967 secs 2024-03-28T07:19:53.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5465 sec 2024-03-28T07:19:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:53 smithi055 ceph-mon[31863]: pgmap v3425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:19:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4792.867967 secs 2024-03-28T07:19:54.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5466 sec 2024-03-28T07:19:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:55 smithi086 ceph-mon[35163]: pgmap v3426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:55.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:55 smithi159 ceph-mon[36109]: pgmap v3426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:55.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:55 smithi055 ceph-mon[31863]: pgmap v3426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:55.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5467 sec 2024-03-28T07:19:56.875 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5468 sec 2024-03-28T07:19:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:57 smithi086 ceph-mon[35163]: pgmap v3427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:57.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:57 smithi159 ceph-mon[36109]: pgmap v3427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:57 smithi055 ceph-mon[31863]: pgmap v3427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:57.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5469 sec 2024-03-28T07:19:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4797.868027 secs 2024-03-28T07:19:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4797.868027 secs 2024-03-28T07:19:58.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4797.868027 secs 2024-03-28T07:19:58.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5470 sec 2024-03-28T07:19:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:19:59 smithi086 ceph-mon[35163]: pgmap v3428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:59.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:19:59 smithi159 ceph-mon[36109]: pgmap v3428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:59.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:19:59 smithi055 ceph-mon[31863]: pgmap v3428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:19:59.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5471 sec 2024-03-28T07:20:00.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:20:00.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5472 sec 2024-03-28T07:20:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:20:01.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:20:01.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:01 smithi055 ceph-mon[31863]: pgmap v3429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:01.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5473 sec 2024-03-28T07:20:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:01 smithi086 ceph-mon[35163]: pgmap v3429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:02.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:01 smithi159 ceph-mon[36109]: pgmap v3429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:02.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5474 sec 2024-03-28T07:20:03.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:03 smithi055 ceph-mon[31863]: pgmap v3430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:03.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4802.868106 secs 2024-03-28T07:20:03.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5475 sec 2024-03-28T07:20:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:03 smithi086 ceph-mon[35163]: pgmap v3430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4802.868106 secs 2024-03-28T07:20:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:03 smithi159 ceph-mon[36109]: pgmap v3430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:04.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4802.868106 secs 2024-03-28T07:20:04.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5476 sec 2024-03-28T07:20:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:05 smithi055 ceph-mon[31863]: pgmap v3431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:05.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5477 sec 2024-03-28T07:20:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:05 smithi086 ceph-mon[35163]: pgmap v3431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:06.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:05 smithi159 ceph-mon[36109]: pgmap v3431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:06.877 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5478 sec 2024-03-28T07:20:07.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:07 smithi055 ceph-mon[31863]: pgmap v3432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:07.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5479 sec 2024-03-28T07:20:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:07 smithi086 ceph-mon[35163]: pgmap v3432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:08.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:07 smithi159 ceph-mon[36109]: pgmap v3432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4807.868169 secs 2024-03-28T07:20:08.876 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5480 sec 2024-03-28T07:20:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4807.868169 secs 2024-03-28T07:20:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4807.868169 secs 2024-03-28T07:20:09.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:09 smithi055 ceph-mon[31863]: pgmap v3433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:09.877 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5481 sec 2024-03-28T07:20:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:09 smithi086 ceph-mon[35163]: pgmap v3433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:10.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:09 smithi159 ceph-mon[36109]: pgmap v3433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:10.877 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5482 sec 2024-03-28T07:20:11.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:11 smithi055 ceph-mon[31863]: pgmap v3434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:11.877 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5483 sec 2024-03-28T07:20:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:11 smithi086 ceph-mon[35163]: pgmap v3434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:11 smithi159 ceph-mon[36109]: pgmap v3434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:12.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5484 sec 2024-03-28T07:20:13.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5485 sec 2024-03-28T07:20:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:13 smithi086 ceph-mon[35163]: pgmap v3435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4812.868249 secs 2024-03-28T07:20:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:13 smithi159 ceph-mon[36109]: pgmap v3435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4812.868249 secs 2024-03-28T07:20:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:13 smithi055 ceph-mon[31863]: pgmap v3435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4812.868249 secs 2024-03-28T07:20:14.877 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5486 sec 2024-03-28T07:20:15.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:15 smithi086 ceph-mon[35163]: pgmap v3436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:15.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5487 sec 2024-03-28T07:20:15.928 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:15 smithi055 ceph-mon[31863]: pgmap v3436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:16.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:15 smithi159 ceph-mon[36109]: pgmap v3436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:16.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5488 sec 2024-03-28T07:20:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:17 smithi086 ceph-mon[35163]: pgmap v3437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:17.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:17 smithi159 ceph-mon[36109]: pgmap v3437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:17.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:17 smithi055 ceph-mon[31863]: pgmap v3437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:17.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5489 sec 2024-03-28T07:20:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4817.868312 secs 2024-03-28T07:20:18.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4817.868312 secs 2024-03-28T07:20:18.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4817.868312 secs 2024-03-28T07:20:18.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5490 sec 2024-03-28T07:20:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:19 smithi086 ceph-mon[35163]: pgmap v3438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:19 smithi159 ceph-mon[36109]: pgmap v3438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:19 smithi055 ceph-mon[31863]: pgmap v3438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:19.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5491 sec 2024-03-28T07:20:20.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5492 sec 2024-03-28T07:20:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:21 smithi086 ceph-mon[35163]: pgmap v3439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:21.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:21 smithi159 ceph-mon[36109]: pgmap v3439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:21.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:21 smithi055 ceph-mon[31863]: pgmap v3439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:21.878 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5493 sec 2024-03-28T07:20:22.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5494 sec 2024-03-28T07:20:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:23 smithi086 ceph-mon[35163]: pgmap v3440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4822.868375 secs 2024-03-28T07:20:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:23 smithi159 ceph-mon[36109]: pgmap v3440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4822.868375 secs 2024-03-28T07:20:23.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:23 smithi055 ceph-mon[31863]: pgmap v3440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4822.868375 secs 2024-03-28T07:20:23.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5495 sec 2024-03-28T07:20:24.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5496 sec 2024-03-28T07:20:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:25 smithi086 ceph-mon[35163]: pgmap v3441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:25 smithi159 ceph-mon[36109]: pgmap v3441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:25.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:25 smithi055 ceph-mon[31863]: pgmap v3441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:25.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5497 sec 2024-03-28T07:20:26.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5498 sec 2024-03-28T07:20:27.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:27 smithi159 ceph-mon[36109]: pgmap v3442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:27 smithi086 ceph-mon[35163]: pgmap v3442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:27.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:27 smithi055 ceph-mon[31863]: pgmap v3442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:27.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5499 sec 2024-03-28T07:20:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4827.868494 secs 2024-03-28T07:20:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4827.868494 secs 2024-03-28T07:20:28.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4827.868494 secs 2024-03-28T07:20:28.879 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5500 sec 2024-03-28T07:20:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:29 smithi086 ceph-mon[35163]: pgmap v3443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:29 smithi159 ceph-mon[36109]: pgmap v3443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:29 smithi055 ceph-mon[31863]: pgmap v3443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:29.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5501 sec 2024-03-28T07:20:30.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5502 sec 2024-03-28T07:20:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:31 smithi086 ceph-mon[35163]: pgmap v3444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:31.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:31 smithi159 ceph-mon[36109]: pgmap v3444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:31.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:31 smithi055 ceph-mon[31863]: pgmap v3444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:20:31.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5503 sec 2024-03-28T07:20:32.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5504 sec 2024-03-28T07:20:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:33 smithi086 ceph-mon[35163]: pgmap v3445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4832.868571 secs 2024-03-28T07:20:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:33 smithi159 ceph-mon[36109]: pgmap v3445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4832.868571 secs 2024-03-28T07:20:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:33 smithi055 ceph-mon[31863]: pgmap v3445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4832.868571 secs 2024-03-28T07:20:33.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5505 sec 2024-03-28T07:20:34.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5506 sec 2024-03-28T07:20:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:35 smithi086 ceph-mon[35163]: pgmap v3446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:20:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:35 smithi159 ceph-mon[36109]: pgmap v3446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:35.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:20:35.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:35 smithi055 ceph-mon[31863]: pgmap v3446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:35.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:20:35.880 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5507 sec 2024-03-28T07:20:36.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:20:36.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:20:36.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:20:36.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5508 sec 2024-03-28T07:20:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:20:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:20:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:20:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:20:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:20:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:20:37.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:37 smithi055 ceph-mon[31863]: pgmap v3447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:37.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:37 smithi055 ceph-mon[31863]: pgmap v3448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:37.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5509 sec 2024-03-28T07:20:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:37 smithi086 ceph-mon[35163]: pgmap v3447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:37 smithi086 ceph-mon[35163]: pgmap v3448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:38.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:37 smithi159 ceph-mon[36109]: pgmap v3447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:38.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:37 smithi159 ceph-mon[36109]: pgmap v3448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4837.868698 secs 2024-03-28T07:20:38.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5510 sec 2024-03-28T07:20:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4837.868698 secs 2024-03-28T07:20:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4837.868698 secs 2024-03-28T07:20:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:39 smithi055 ceph-mon[31863]: pgmap v3449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:39.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5511 sec 2024-03-28T07:20:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:39 smithi086 ceph-mon[35163]: pgmap v3449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:40.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:39 smithi159 ceph-mon[36109]: pgmap v3449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:40.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5512 sec 2024-03-28T07:20:41.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:41 smithi055 ceph-mon[31863]: pgmap v3450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:20:41.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5513 sec 2024-03-28T07:20:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:41 smithi086 ceph-mon[35163]: pgmap v3450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:20:42.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:41 smithi159 ceph-mon[36109]: pgmap v3450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:20:42.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5514 sec 2024-03-28T07:20:43.873 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:43 smithi086 ceph-mon[35163]: pgmap v3451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:43.873 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4842.868762 secs 2024-03-28T07:20:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:43 smithi055 ceph-mon[31863]: pgmap v3451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4842.868762 secs 2024-03-28T07:20:43.881 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5515 sec 2024-03-28T07:20:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:43 smithi159 ceph-mon[36109]: pgmap v3451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4842.868762 secs 2024-03-28T07:20:44.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5516 sec 2024-03-28T07:20:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:45 smithi055 ceph-mon[31863]: pgmap v3452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:45.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5517 sec 2024-03-28T07:20:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:45 smithi086 ceph-mon[35163]: pgmap v3452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:46.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:45 smithi159 ceph-mon[36109]: pgmap v3452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:46.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5518 sec 2024-03-28T07:20:47.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5519 sec 2024-03-28T07:20:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:47 smithi086 ceph-mon[35163]: pgmap v3453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:20:48.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:47 smithi159 ceph-mon[36109]: pgmap v3453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:20:48.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:47 smithi055 ceph-mon[31863]: pgmap v3453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:20:48.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5520 sec 2024-03-28T07:20:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4847.868812 secs 2024-03-28T07:20:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4847.868812 secs 2024-03-28T07:20:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4847.868812 secs 2024-03-28T07:20:49.882 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5521 sec 2024-03-28T07:20:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:49 smithi086 ceph-mon[35163]: pgmap v3454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:50.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:49 smithi159 ceph-mon[36109]: pgmap v3454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:50.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:49 smithi055 ceph-mon[31863]: pgmap v3454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:50.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5522 sec 2024-03-28T07:20:51.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5523 sec 2024-03-28T07:20:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:51 smithi086 ceph-mon[35163]: pgmap v3455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:52.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:51 smithi159 ceph-mon[36109]: pgmap v3455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:52.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:51 smithi055 ceph-mon[31863]: pgmap v3455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:20:52.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5524 sec 2024-03-28T07:20:53.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5525 sec 2024-03-28T07:20:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:53 smithi086 ceph-mon[35163]: pgmap v3456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4852.868876 secs 2024-03-28T07:20:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:53 smithi159 ceph-mon[36109]: pgmap v3456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4852.868876 secs 2024-03-28T07:20:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:53 smithi055 ceph-mon[31863]: pgmap v3456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4852.868876 secs 2024-03-28T07:20:54.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5526 sec 2024-03-28T07:20:55.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5527 sec 2024-03-28T07:20:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:55 smithi086 ceph-mon[35163]: pgmap v3457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:56.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:55 smithi159 ceph-mon[36109]: pgmap v3457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:56.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:55 smithi055 ceph-mon[31863]: pgmap v3457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:56.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5528 sec 2024-03-28T07:20:57.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:57 smithi055 ceph-mon[31863]: pgmap v3458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:57.883 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5529 sec 2024-03-28T07:20:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:57 smithi086 ceph-mon[35163]: pgmap v3458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:58.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:57 smithi159 ceph-mon[36109]: pgmap v3458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:20:58.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5530 sec 2024-03-28T07:20:59.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4857.868937 secs 2024-03-28T07:20:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4857.868937 secs 2024-03-28T07:20:59.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4857.868937 secs 2024-03-28T07:20:59.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5531 sec 2024-03-28T07:21:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:20:59 smithi086 ceph-mon[35163]: pgmap v3459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:00.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:20:59 smithi159 ceph-mon[36109]: pgmap v3459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:00.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:20:59 smithi055 ceph-mon[31863]: pgmap v3459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:00.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5532 sec 2024-03-28T07:21:01.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5533 sec 2024-03-28T07:21:02.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:01 smithi086 ceph-mon[35163]: pgmap v3460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:02.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:01 smithi159 ceph-mon[36109]: pgmap v3460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:02.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:01 smithi055 ceph-mon[31863]: pgmap v3460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:02.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5534 sec 2024-03-28T07:21:03.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:03 smithi159 ceph-mon[36109]: pgmap v3461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:03.824 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4862.869062 secs 2024-03-28T07:21:03.884 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5535 sec 2024-03-28T07:21:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:03 smithi086 ceph-mon[35163]: pgmap v3461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4862.869062 secs 2024-03-28T07:21:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:03 smithi055 ceph-mon[31863]: pgmap v3461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4862.869062 secs 2024-03-28T07:21:04.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5536 sec 2024-03-28T07:21:05.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5537 sec 2024-03-28T07:21:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:05 smithi086 ceph-mon[35163]: pgmap v3462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:06.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:05 smithi159 ceph-mon[36109]: pgmap v3462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:06.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:05 smithi055 ceph-mon[31863]: pgmap v3462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:06.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5538 sec 2024-03-28T07:21:07.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5539 sec 2024-03-28T07:21:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:07 smithi086 ceph-mon[35163]: pgmap v3463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:08.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:07 smithi159 ceph-mon[36109]: pgmap v3463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:08.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:07 smithi055 ceph-mon[31863]: pgmap v3463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:08.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5540 sec 2024-03-28T07:21:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4867.869123 secs 2024-03-28T07:21:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4867.869123 secs 2024-03-28T07:21:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4867.869123 secs 2024-03-28T07:21:09.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5541 sec 2024-03-28T07:21:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:09 smithi086 ceph-mon[35163]: pgmap v3464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:10.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:09 smithi159 ceph-mon[36109]: pgmap v3464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:10.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:09 smithi055 ceph-mon[31863]: pgmap v3464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:10.885 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5542 sec 2024-03-28T07:21:11.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5543 sec 2024-03-28T07:21:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:11 smithi086 ceph-mon[35163]: pgmap v3465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:11 smithi159 ceph-mon[36109]: pgmap v3465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:12.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:11 smithi055 ceph-mon[31863]: pgmap v3465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:12.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5544 sec 2024-03-28T07:21:13.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5545 sec 2024-03-28T07:21:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:13 smithi086 ceph-mon[35163]: pgmap v3466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4872.869189 secs 2024-03-28T07:21:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:13 smithi159 ceph-mon[36109]: pgmap v3466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4872.869189 secs 2024-03-28T07:21:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:13 smithi055 ceph-mon[31863]: pgmap v3466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4872.869189 secs 2024-03-28T07:21:14.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5546 sec 2024-03-28T07:21:15.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5547 sec 2024-03-28T07:21:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:15 smithi086 ceph-mon[35163]: pgmap v3467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:16.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:15 smithi159 ceph-mon[36109]: pgmap v3467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:16.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:15 smithi055 ceph-mon[31863]: pgmap v3467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:16.886 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5548 sec 2024-03-28T07:21:17.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5549 sec 2024-03-28T07:21:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:17 smithi086 ceph-mon[35163]: pgmap v3468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:18.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:17 smithi159 ceph-mon[36109]: pgmap v3468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:18.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:17 smithi055 ceph-mon[31863]: pgmap v3468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:18.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5550 sec 2024-03-28T07:21:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4877.869265 secs 2024-03-28T07:21:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4877.869265 secs 2024-03-28T07:21:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4877.869265 secs 2024-03-28T07:21:19.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5551 sec 2024-03-28T07:21:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:19 smithi086 ceph-mon[35163]: pgmap v3469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:19 smithi159 ceph-mon[36109]: pgmap v3469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:20.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:19 smithi055 ceph-mon[31863]: pgmap v3469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:20.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5552 sec 2024-03-28T07:21:21.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5553 sec 2024-03-28T07:21:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:21 smithi086 ceph-mon[35163]: pgmap v3470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:22.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:21 smithi159 ceph-mon[36109]: pgmap v3470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:22.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:21 smithi055 ceph-mon[31863]: pgmap v3470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:22.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5554 sec 2024-03-28T07:21:23.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5555 sec 2024-03-28T07:21:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:23 smithi086 ceph-mon[35163]: pgmap v3471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4882.869387 secs 2024-03-28T07:21:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:23 smithi159 ceph-mon[36109]: pgmap v3471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4882.869387 secs 2024-03-28T07:21:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:23 smithi055 ceph-mon[31863]: pgmap v3471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4882.869387 secs 2024-03-28T07:21:24.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5556 sec 2024-03-28T07:21:25.887 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5557 sec 2024-03-28T07:21:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:25 smithi086 ceph-mon[35163]: pgmap v3472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:26.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:25 smithi159 ceph-mon[36109]: pgmap v3472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:26.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:25 smithi055 ceph-mon[31863]: pgmap v3472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:26.888 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5558 sec 2024-03-28T07:21:27.888 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5559 sec 2024-03-28T07:21:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:27 smithi086 ceph-mon[35163]: pgmap v3473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:28.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:27 smithi159 ceph-mon[36109]: pgmap v3473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:28.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:27 smithi055 ceph-mon[31863]: pgmap v3473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:28.888 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5560 sec 2024-03-28T07:21:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4887.869507 secs 2024-03-28T07:21:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4887.869507 secs 2024-03-28T07:21:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4887.869507 secs 2024-03-28T07:21:29.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5561 sec 2024-03-28T07:21:30.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:29 smithi055 ceph-mon[31863]: pgmap v3474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:29 smithi086 ceph-mon[35163]: pgmap v3474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:30.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:29 smithi159 ceph-mon[36109]: pgmap v3474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:30.888 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5562 sec 2024-03-28T07:21:31.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5563 sec 2024-03-28T07:21:32.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:31 smithi159 ceph-mon[36109]: pgmap v3475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:32.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:31 smithi055 ceph-mon[31863]: pgmap v3475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:31 smithi086 ceph-mon[35163]: pgmap v3475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:32.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5564 sec 2024-03-28T07:21:33.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5565 sec 2024-03-28T07:21:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:33 smithi055 ceph-mon[31863]: pgmap v3476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4892.869573 secs 2024-03-28T07:21:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:33 smithi086 ceph-mon[35163]: pgmap v3476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4892.869573 secs 2024-03-28T07:21:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:33 smithi159 ceph-mon[36109]: pgmap v3476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4892.869573 secs 2024-03-28T07:21:34.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5566 sec 2024-03-28T07:21:35.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5567 sec 2024-03-28T07:21:36.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:35 smithi055 ceph-mon[31863]: pgmap v3477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:35 smithi086 ceph-mon[35163]: pgmap v3477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:36.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:35 smithi159 ceph-mon[36109]: pgmap v3477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:36.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5568 sec 2024-03-28T07:21:37.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:21:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:21:37.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:21:37.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5569 sec 2024-03-28T07:21:38.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:37 smithi055 ceph-mon[31863]: pgmap v3478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:37 smithi086 ceph-mon[35163]: pgmap v3478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:37 smithi159 ceph-mon[36109]: pgmap v3478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:38.889 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5570 sec 2024-03-28T07:21:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4897.869642 secs 2024-03-28T07:21:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:21:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:21:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:21:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4897.869642 secs 2024-03-28T07:21:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:21:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:21:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:21:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4897.869642 secs 2024-03-28T07:21:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:21:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:21:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:21:39.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5571 sec 2024-03-28T07:21:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:39 smithi086 ceph-mon[35163]: pgmap v3479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:39 smithi086 ceph-mon[35163]: pgmap v3480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:40.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:39 smithi159 ceph-mon[36109]: pgmap v3479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:40.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:39 smithi159 ceph-mon[36109]: pgmap v3480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:40.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:39 smithi055 ceph-mon[31863]: pgmap v3479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:21:40.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:39 smithi055 ceph-mon[31863]: pgmap v3480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:40.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5572 sec 2024-03-28T07:21:41.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5573 sec 2024-03-28T07:21:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:41 smithi086 ceph-mon[35163]: pgmap v3481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:42.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:41 smithi159 ceph-mon[36109]: pgmap v3481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:42.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:41 smithi055 ceph-mon[31863]: pgmap v3481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:42.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5574 sec 2024-03-28T07:21:43.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5575 sec 2024-03-28T07:21:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:43 smithi086 ceph-mon[35163]: pgmap v3482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4902.869763 secs 2024-03-28T07:21:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:43 smithi159 ceph-mon[36109]: pgmap v3482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4902.869763 secs 2024-03-28T07:21:44.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:43 smithi055 ceph-mon[31863]: pgmap v3482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4902.869763 secs 2024-03-28T07:21:44.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5576 sec 2024-03-28T07:21:45.890 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5577 sec 2024-03-28T07:21:46.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:45 smithi055 ceph-mon[31863]: pgmap v3483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:45 smithi086 ceph-mon[35163]: pgmap v3483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:46.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:45 smithi159 ceph-mon[36109]: pgmap v3483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:46.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5578 sec 2024-03-28T07:21:47.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5579 sec 2024-03-28T07:21:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:47 smithi086 ceph-mon[35163]: pgmap v3484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:48.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:47 smithi159 ceph-mon[36109]: pgmap v3484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:48.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:47 smithi055 ceph-mon[31863]: pgmap v3484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:48.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5580 sec 2024-03-28T07:21:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4907.869877 secs 2024-03-28T07:21:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4907.869877 secs 2024-03-28T07:21:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4907.869877 secs 2024-03-28T07:21:49.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5581 sec 2024-03-28T07:21:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:49 smithi086 ceph-mon[35163]: pgmap v3485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:21:50.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:49 smithi159 ceph-mon[36109]: pgmap v3485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:21:50.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:49 smithi055 ceph-mon[31863]: pgmap v3485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:21:50.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5582 sec 2024-03-28T07:21:51.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5583 sec 2024-03-28T07:21:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:51 smithi086 ceph-mon[35163]: pgmap v3486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:52.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:51 smithi159 ceph-mon[36109]: pgmap v3486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:52.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:51 smithi055 ceph-mon[31863]: pgmap v3486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:21:52.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5584 sec 2024-03-28T07:21:53.891 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5585 sec 2024-03-28T07:21:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:53 smithi086 ceph-mon[35163]: pgmap v3487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4912.869942 secs 2024-03-28T07:21:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:53 smithi159 ceph-mon[36109]: pgmap v3487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4912.869942 secs 2024-03-28T07:21:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:53 smithi055 ceph-mon[31863]: pgmap v3487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4912.869942 secs 2024-03-28T07:21:54.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5586 sec 2024-03-28T07:21:55.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5587 sec 2024-03-28T07:21:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:55 smithi086 ceph-mon[35163]: pgmap v3488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:55 smithi159 ceph-mon[36109]: pgmap v3488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:56.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:55 smithi055 ceph-mon[31863]: pgmap v3488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:56.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5588 sec 2024-03-28T07:21:57.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5589 sec 2024-03-28T07:21:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:57 smithi086 ceph-mon[35163]: pgmap v3489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:58.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:57 smithi159 ceph-mon[36109]: pgmap v3489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:57 smithi055 ceph-mon[31863]: pgmap v3489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:21:58.892 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5590 sec 2024-03-28T07:21:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4917.870003 secs 2024-03-28T07:21:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4917.870003 secs 2024-03-28T07:21:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4917.870003 secs 2024-03-28T07:21:59.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5591 sec 2024-03-28T07:22:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:21:59 smithi086 ceph-mon[35163]: pgmap v3490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:21:59 smithi159 ceph-mon[36109]: pgmap v3490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:21:59 smithi055 ceph-mon[31863]: pgmap v3490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:00.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5592 sec 2024-03-28T07:22:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:01 smithi086 ceph-mon[35163]: pgmap v3491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:22:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:01 smithi159 ceph-mon[36109]: pgmap v3491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:22:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:01 smithi055 ceph-mon[31863]: pgmap v3491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:22:01.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5593 sec 2024-03-28T07:22:02.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5594 sec 2024-03-28T07:22:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:03 smithi086 ceph-mon[35163]: pgmap v3492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:03 smithi159 ceph-mon[36109]: pgmap v3492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:03 smithi055 ceph-mon[31863]: pgmap v3492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:03.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5595 sec 2024-03-28T07:22:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4922.870127 secs 2024-03-28T07:22:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4922.870127 secs 2024-03-28T07:22:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4922.870127 secs 2024-03-28T07:22:04.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5596 sec 2024-03-28T07:22:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:05 smithi086 ceph-mon[35163]: pgmap v3493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:05 smithi159 ceph-mon[36109]: pgmap v3493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:05 smithi055 ceph-mon[31863]: pgmap v3493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:05.893 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5597 sec 2024-03-28T07:22:06.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5598 sec 2024-03-28T07:22:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:07 smithi086 ceph-mon[35163]: pgmap v3494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:07.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:07 smithi159 ceph-mon[36109]: pgmap v3494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:07 smithi055 ceph-mon[31863]: pgmap v3494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:07.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5599 sec 2024-03-28T07:22:08.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5600 sec 2024-03-28T07:22:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4927.870247 secs 2024-03-28T07:22:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:09 smithi086 ceph-mon[35163]: pgmap v3495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4927.870247 secs 2024-03-28T07:22:09.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:09 smithi159 ceph-mon[36109]: pgmap v3495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4927.870247 secs 2024-03-28T07:22:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:09 smithi055 ceph-mon[31863]: pgmap v3495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:09.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5601 sec 2024-03-28T07:22:10.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5602 sec 2024-03-28T07:22:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:11 smithi055 ceph-mon[31863]: pgmap v3496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:11 smithi086 ceph-mon[35163]: pgmap v3496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:11 smithi159 ceph-mon[36109]: pgmap v3496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:11.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5603 sec 2024-03-28T07:22:12.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5604 sec 2024-03-28T07:22:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:13 smithi055 ceph-mon[31863]: pgmap v3497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:13 smithi086 ceph-mon[35163]: pgmap v3497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:13.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:13 smithi159 ceph-mon[36109]: pgmap v3497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:13.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5605 sec 2024-03-28T07:22:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4932.870369 secs 2024-03-28T07:22:14.472 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4932.870369 secs 2024-03-28T07:22:14.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4932.870369 secs 2024-03-28T07:22:14.894 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5606 sec 2024-03-28T07:22:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:15 smithi055 ceph-mon[31863]: pgmap v3498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:15 smithi086 ceph-mon[35163]: pgmap v3498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:15.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:15 smithi159 ceph-mon[36109]: pgmap v3498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:15.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5607 sec 2024-03-28T07:22:16.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5608 sec 2024-03-28T07:22:17.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:17 smithi055 ceph-mon[31863]: pgmap v3499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:17 smithi086 ceph-mon[35163]: pgmap v3499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:17.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:17 smithi159 ceph-mon[36109]: pgmap v3499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:17.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5609 sec 2024-03-28T07:22:18.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4937.870484 secs 2024-03-28T07:22:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4937.870484 secs 2024-03-28T07:22:18.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4937.870484 secs 2024-03-28T07:22:18.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5610 sec 2024-03-28T07:22:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:19 smithi086 ceph-mon[35163]: pgmap v3500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:19.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:19 smithi159 ceph-mon[36109]: pgmap v3500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:19 smithi055 ceph-mon[31863]: pgmap v3500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:19.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5611 sec 2024-03-28T07:22:20.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5612 sec 2024-03-28T07:22:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:21 smithi086 ceph-mon[35163]: pgmap v3501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:21.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:21 smithi159 ceph-mon[36109]: pgmap v3501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:21.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:21 smithi055 ceph-mon[31863]: pgmap v3501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:21.895 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5613 sec 2024-03-28T07:22:22.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5614 sec 2024-03-28T07:22:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:23 smithi086 ceph-mon[35163]: pgmap v3502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4942.870573 secs 2024-03-28T07:22:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:23 smithi159 ceph-mon[36109]: pgmap v3502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:23.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4942.870573 secs 2024-03-28T07:22:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:23 smithi055 ceph-mon[31863]: pgmap v3502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4942.870573 secs 2024-03-28T07:22:23.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5615 sec 2024-03-28T07:22:24.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5616 sec 2024-03-28T07:22:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:25 smithi086 ceph-mon[35163]: pgmap v3503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:25.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:25 smithi159 ceph-mon[36109]: pgmap v3503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:25.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:25 smithi055 ceph-mon[31863]: pgmap v3503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:25.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5617 sec 2024-03-28T07:22:26.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5618 sec 2024-03-28T07:22:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:27 smithi086 ceph-mon[35163]: pgmap v3504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:27 smithi159 ceph-mon[36109]: pgmap v3504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:27.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:27 smithi055 ceph-mon[31863]: pgmap v3504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:27.896 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5619 sec 2024-03-28T07:22:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4947.870692 secs 2024-03-28T07:22:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4947.870692 secs 2024-03-28T07:22:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4947.870692 secs 2024-03-28T07:22:28.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5620 sec 2024-03-28T07:22:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:29 smithi086 ceph-mon[35163]: pgmap v3505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:29.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:29 smithi159 ceph-mon[36109]: pgmap v3505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:29 smithi055 ceph-mon[31863]: pgmap v3505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:29.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5621 sec 2024-03-28T07:22:30.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5622 sec 2024-03-28T07:22:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:31 smithi086 ceph-mon[35163]: pgmap v3506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:31.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:31 smithi159 ceph-mon[36109]: pgmap v3506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:31.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:31 smithi055 ceph-mon[31863]: pgmap v3506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:31.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5623 sec 2024-03-28T07:22:32.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5624 sec 2024-03-28T07:22:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:33 smithi086 ceph-mon[35163]: pgmap v3507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4952.870816 secs 2024-03-28T07:22:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:33 smithi159 ceph-mon[36109]: pgmap v3507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4952.870816 secs 2024-03-28T07:22:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:33 smithi055 ceph-mon[31863]: pgmap v3507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:33.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4952.870816 secs 2024-03-28T07:22:33.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5625 sec 2024-03-28T07:22:34.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5626 sec 2024-03-28T07:22:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:35 smithi086 ceph-mon[35163]: pgmap v3508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:35.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:35 smithi159 ceph-mon[36109]: pgmap v3508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:35.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:35 smithi055 ceph-mon[31863]: pgmap v3508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:35.897 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5627 sec 2024-03-28T07:22:36.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5628 sec 2024-03-28T07:22:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:37 smithi086 ceph-mon[35163]: pgmap v3509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:37.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:37 smithi159 ceph-mon[36109]: pgmap v3509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:37.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:37 smithi055 ceph-mon[31863]: pgmap v3509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:37.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5629 sec 2024-03-28T07:22:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4957.870935 secs 2024-03-28T07:22:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4957.870935 secs 2024-03-28T07:22:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4957.870935 secs 2024-03-28T07:22:38.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5630 sec 2024-03-28T07:22:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:39 smithi086 ceph-mon[35163]: pgmap v3510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:22:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:39 smithi159 ceph-mon[36109]: pgmap v3510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:39.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:22:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:39 smithi055 ceph-mon[31863]: pgmap v3510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:22:39.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5631 sec 2024-03-28T07:22:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:22:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:22:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:40 smithi086 ceph-mon[35163]: pgmap v3511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:40 smithi086 ceph-mon[35163]: pgmap v3512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:22:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:22:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:22:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:40 smithi159 ceph-mon[36109]: pgmap v3511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:40 smithi159 ceph-mon[36109]: pgmap v3512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:40.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:22:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:22:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:22:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:40 smithi055 ceph-mon[31863]: pgmap v3511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:22:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:40 smithi055 ceph-mon[31863]: pgmap v3512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:22:40.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5632 sec 2024-03-28T07:22:41.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5633 sec 2024-03-28T07:22:42.898 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5634 sec 2024-03-28T07:22:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:42 smithi086 ceph-mon[35163]: pgmap v3513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:42 smithi159 ceph-mon[36109]: pgmap v3513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:43.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:42 smithi055 ceph-mon[31863]: pgmap v3513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:43.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5635 sec 2024-03-28T07:22:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4962.871027 secs 2024-03-28T07:22:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4962.871027 secs 2024-03-28T07:22:44.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4962.871027 secs 2024-03-28T07:22:44.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5636 sec 2024-03-28T07:22:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:44 smithi086 ceph-mon[35163]: pgmap v3514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:45.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:44 smithi159 ceph-mon[36109]: pgmap v3514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:45.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:44 smithi055 ceph-mon[31863]: pgmap v3514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:45.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5637 sec 2024-03-28T07:22:46.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5638 sec 2024-03-28T07:22:47.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:46 smithi055 ceph-mon[31863]: pgmap v3515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:46 smithi086 ceph-mon[35163]: pgmap v3515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:46 smithi159 ceph-mon[36109]: pgmap v3515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:47.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5639 sec 2024-03-28T07:22:48.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5640 sec 2024-03-28T07:22:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4967.871118 secs 2024-03-28T07:22:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:48 smithi086 ceph-mon[35163]: pgmap v3516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4967.871118 secs 2024-03-28T07:22:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:48 smithi159 ceph-mon[36109]: pgmap v3516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4967.871118 secs 2024-03-28T07:22:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:48 smithi055 ceph-mon[31863]: pgmap v3516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:22:49.899 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5641 sec 2024-03-28T07:22:50.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5642 sec 2024-03-28T07:22:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:50 smithi086 ceph-mon[35163]: pgmap v3517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:22:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:50 smithi159 ceph-mon[36109]: pgmap v3517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:22:51.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:50 smithi055 ceph-mon[31863]: pgmap v3517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:22:51.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5643 sec 2024-03-28T07:22:52.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5644 sec 2024-03-28T07:22:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:52 smithi086 ceph-mon[35163]: pgmap v3518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:52 smithi159 ceph-mon[36109]: pgmap v3518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:52 smithi055 ceph-mon[31863]: pgmap v3518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:53.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5645 sec 2024-03-28T07:22:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4972.871184 secs 2024-03-28T07:22:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4972.871184 secs 2024-03-28T07:22:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4972.871184 secs 2024-03-28T07:22:54.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5646 sec 2024-03-28T07:22:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:54 smithi086 ceph-mon[35163]: pgmap v3519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:55.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:54 smithi159 ceph-mon[36109]: pgmap v3519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:55.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:54 smithi055 ceph-mon[31863]: pgmap v3519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:55.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5647 sec 2024-03-28T07:22:56.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5648 sec 2024-03-28T07:22:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:56 smithi086 ceph-mon[35163]: pgmap v3520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:57.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:56 smithi159 ceph-mon[36109]: pgmap v3520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:56 smithi055 ceph-mon[31863]: pgmap v3520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:57.900 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5649 sec 2024-03-28T07:22:58.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5650 sec 2024-03-28T07:22:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4977.871256 secs 2024-03-28T07:22:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:22:58 smithi086 ceph-mon[35163]: pgmap v3521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4977.871256 secs 2024-03-28T07:22:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:22:58 smithi159 ceph-mon[36109]: pgmap v3521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4977.871256 secs 2024-03-28T07:22:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:22:58 smithi055 ceph-mon[31863]: pgmap v3521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:22:59.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5651 sec 2024-03-28T07:23:00.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5652 sec 2024-03-28T07:23:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:00 smithi086 ceph-mon[35163]: pgmap v3522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:00 smithi159 ceph-mon[36109]: pgmap v3522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:00 smithi055 ceph-mon[31863]: pgmap v3522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:01.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5653 sec 2024-03-28T07:23:02.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5654 sec 2024-03-28T07:23:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:02 smithi086 ceph-mon[35163]: pgmap v3523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:02 smithi159 ceph-mon[36109]: pgmap v3523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:02 smithi055 ceph-mon[31863]: pgmap v3523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:03.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5655 sec 2024-03-28T07:23:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4982.871372 secs 2024-03-28T07:23:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4982.871372 secs 2024-03-28T07:23:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4982.871372 secs 2024-03-28T07:23:04.901 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5656 sec 2024-03-28T07:23:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:04 smithi086 ceph-mon[35163]: pgmap v3524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:04 smithi159 ceph-mon[36109]: pgmap v3524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:04 smithi055 ceph-mon[31863]: pgmap v3524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:05.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5657 sec 2024-03-28T07:23:06.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5658 sec 2024-03-28T07:23:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:06 smithi086 ceph-mon[35163]: pgmap v3525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:06 smithi159 ceph-mon[36109]: pgmap v3525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:06 smithi055 ceph-mon[31863]: pgmap v3525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:07.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5659 sec 2024-03-28T07:23:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:08 smithi086 ceph-mon[35163]: pgmap v3526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:08.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:08 smithi159 ceph-mon[36109]: pgmap v3526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:08.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:08 smithi055 ceph-mon[31863]: pgmap v3526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:08.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5660 sec 2024-03-28T07:23:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4987.871491 secs 2024-03-28T07:23:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4987.871491 secs 2024-03-28T07:23:09.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4987.871491 secs 2024-03-28T07:23:09.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5661 sec 2024-03-28T07:23:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:10 smithi086 ceph-mon[35163]: pgmap v3527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:10.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:10 smithi159 ceph-mon[36109]: pgmap v3527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:10 smithi055 ceph-mon[31863]: pgmap v3527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:10.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5662 sec 2024-03-28T07:23:11.902 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5663 sec 2024-03-28T07:23:12.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5664 sec 2024-03-28T07:23:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:12 smithi086 ceph-mon[35163]: pgmap v3528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:13.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:12 smithi159 ceph-mon[36109]: pgmap v3528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:12 smithi055 ceph-mon[31863]: pgmap v3528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:13.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5665 sec 2024-03-28T07:23:14.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4992.871615 secs 2024-03-28T07:23:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4992.871615 secs 2024-03-28T07:23:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4992.871615 secs 2024-03-28T07:23:14.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5666 sec 2024-03-28T07:23:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:14 smithi086 ceph-mon[35163]: pgmap v3529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:14 smithi159 ceph-mon[36109]: pgmap v3529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:14 smithi055 ceph-mon[31863]: pgmap v3529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:15.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5667 sec 2024-03-28T07:23:16.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5668 sec 2024-03-28T07:23:17.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:16 smithi055 ceph-mon[31863]: pgmap v3530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:16 smithi086 ceph-mon[35163]: pgmap v3530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:16 smithi159 ceph-mon[36109]: pgmap v3530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:17.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5669 sec 2024-03-28T07:23:18.903 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5670 sec 2024-03-28T07:23:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 4997.871697 secs 2024-03-28T07:23:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:18 smithi086 ceph-mon[35163]: pgmap v3531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 4997.871697 secs 2024-03-28T07:23:19.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:18 smithi159 ceph-mon[36109]: pgmap v3531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:19.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 4997.871697 secs 2024-03-28T07:23:19.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:18 smithi055 ceph-mon[31863]: pgmap v3531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:19.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5671 sec 2024-03-28T07:23:20.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5672 sec 2024-03-28T07:23:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:20 smithi086 ceph-mon[35163]: pgmap v3532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:20 smithi159 ceph-mon[36109]: pgmap v3532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:21.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:20 smithi055 ceph-mon[31863]: pgmap v3532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:21.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5673 sec 2024-03-28T07:23:22.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5674 sec 2024-03-28T07:23:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:22 smithi086 ceph-mon[35163]: pgmap v3533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:23.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:22 smithi159 ceph-mon[36109]: pgmap v3533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:23.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:22 smithi055 ceph-mon[31863]: pgmap v3533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:23.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5675 sec 2024-03-28T07:23:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5002.871829 secs 2024-03-28T07:23:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5002.871829 secs 2024-03-28T07:23:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5002.871829 secs 2024-03-28T07:23:24.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5676 sec 2024-03-28T07:23:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:24 smithi086 ceph-mon[35163]: pgmap v3534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:25.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:24 smithi159 ceph-mon[36109]: pgmap v3534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:25.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:24 smithi055 ceph-mon[31863]: pgmap v3534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:25.904 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5677 sec 2024-03-28T07:23:26.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5678 sec 2024-03-28T07:23:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:26 smithi086 ceph-mon[35163]: pgmap v3535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:27.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:26 smithi159 ceph-mon[36109]: pgmap v3535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:27.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:26 smithi055 ceph-mon[31863]: pgmap v3535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:27.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5679 sec 2024-03-28T07:23:28.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5680 sec 2024-03-28T07:23:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5007.871918 secs 2024-03-28T07:23:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:28 smithi086 ceph-mon[35163]: pgmap v3536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5007.871918 secs 2024-03-28T07:23:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:28 smithi159 ceph-mon[36109]: pgmap v3536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:29.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5007.871918 secs 2024-03-28T07:23:29.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:28 smithi055 ceph-mon[31863]: pgmap v3536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:29.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5681 sec 2024-03-28T07:23:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:30 smithi086 ceph-mon[35163]: pgmap v3537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:30.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:30 smithi159 ceph-mon[36109]: pgmap v3537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:30.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:30 smithi055 ceph-mon[31863]: pgmap v3537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:30.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5682 sec 2024-03-28T07:23:31.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5683 sec 2024-03-28T07:23:32.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5684 sec 2024-03-28T07:23:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:32 smithi086 ceph-mon[35163]: pgmap v3538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:32 smithi159 ceph-mon[36109]: pgmap v3538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:33.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:32 smithi055 ceph-mon[31863]: pgmap v3538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:33.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5685 sec 2024-03-28T07:23:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5012.872036 secs 2024-03-28T07:23:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5012.872036 secs 2024-03-28T07:23:34.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5012.872036 secs 2024-03-28T07:23:34.905 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5686 sec 2024-03-28T07:23:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:34 smithi086 ceph-mon[35163]: pgmap v3539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:35.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:34 smithi159 ceph-mon[36109]: pgmap v3539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:35.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:34 smithi055 ceph-mon[31863]: pgmap v3539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:35.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5687 sec 2024-03-28T07:23:36.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5688 sec 2024-03-28T07:23:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:36 smithi086 ceph-mon[35163]: pgmap v3540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:37.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:36 smithi159 ceph-mon[36109]: pgmap v3540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:37.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:36 smithi055 ceph-mon[31863]: pgmap v3540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:37.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5689 sec 2024-03-28T07:23:38.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5690 sec 2024-03-28T07:23:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5017.872125 secs 2024-03-28T07:23:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:38 smithi086 ceph-mon[35163]: pgmap v3541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5017.872125 secs 2024-03-28T07:23:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:38 smithi159 ceph-mon[36109]: pgmap v3541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5017.872125 secs 2024-03-28T07:23:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:38 smithi055 ceph-mon[31863]: pgmap v3541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:39.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5691 sec 2024-03-28T07:23:40.906 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5692 sec 2024-03-28T07:23:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:40 smithi086 ceph-mon[35163]: pgmap v3542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:23:41.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:40 smithi159 ceph-mon[36109]: pgmap v3542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:41.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:23:41.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:40 smithi055 ceph-mon[31863]: pgmap v3542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:41.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:23:41.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5693 sec 2024-03-28T07:23:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:23:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:23:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:23:42.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:23:42.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:23:42.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:23:42.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:23:42.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:23:42.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:23:42.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5694 sec 2024-03-28T07:23:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:42 smithi086 ceph-mon[35163]: pgmap v3543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:42 smithi086 ceph-mon[35163]: pgmap v3544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:42 smithi159 ceph-mon[36109]: pgmap v3543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:42 smithi159 ceph-mon[36109]: pgmap v3544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:42 smithi055 ceph-mon[31863]: pgmap v3543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:42 smithi055 ceph-mon[31863]: pgmap v3544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:43.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5695 sec 2024-03-28T07:23:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5022.872246 secs 2024-03-28T07:23:44.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5022.872246 secs 2024-03-28T07:23:44.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5022.872246 secs 2024-03-28T07:23:44.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5696 sec 2024-03-28T07:23:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:44 smithi086 ceph-mon[35163]: pgmap v3545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:44 smithi159 ceph-mon[36109]: pgmap v3545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:45.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:44 smithi055 ceph-mon[31863]: pgmap v3545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:45.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5697 sec 2024-03-28T07:23:46.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5698 sec 2024-03-28T07:23:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:46 smithi086 ceph-mon[35163]: pgmap v3546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:46 smithi159 ceph-mon[36109]: pgmap v3546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:46 smithi055 ceph-mon[31863]: pgmap v3546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:47.907 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5699 sec 2024-03-28T07:23:48.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5700 sec 2024-03-28T07:23:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5027.872369 secs 2024-03-28T07:23:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:49 smithi086 ceph-mon[35163]: pgmap v3547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:23:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5027.872369 secs 2024-03-28T07:23:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:49 smithi159 ceph-mon[36109]: pgmap v3547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:23:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5027.872369 secs 2024-03-28T07:23:49.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:49 smithi055 ceph-mon[31863]: pgmap v3547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:23:49.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5701 sec 2024-03-28T07:23:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:50 smithi086 ceph-mon[35163]: pgmap v3548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:50 smithi159 ceph-mon[36109]: pgmap v3548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:50.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:50 smithi055 ceph-mon[31863]: pgmap v3548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:50.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5702 sec 2024-03-28T07:23:51.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5703 sec 2024-03-28T07:23:52.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5704 sec 2024-03-28T07:23:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:52 smithi086 ceph-mon[35163]: pgmap v3549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:23:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:52 smithi159 ceph-mon[36109]: pgmap v3549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:23:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:52 smithi055 ceph-mon[31863]: pgmap v3549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:23:53.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5705 sec 2024-03-28T07:23:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5032.872391 secs 2024-03-28T07:23:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5032.872391 secs 2024-03-28T07:23:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5032.872391 secs 2024-03-28T07:23:54.908 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5706 sec 2024-03-28T07:23:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:54 smithi086 ceph-mon[35163]: pgmap v3550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:55.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:54 smithi159 ceph-mon[36109]: pgmap v3550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:54 smithi055 ceph-mon[31863]: pgmap v3550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:23:55.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5707 sec 2024-03-28T07:23:56.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5708 sec 2024-03-28T07:23:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:56 smithi086 ceph-mon[35163]: pgmap v3551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:57.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:56 smithi159 ceph-mon[36109]: pgmap v3551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:57.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:56 smithi055 ceph-mon[31863]: pgmap v3551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:23:57.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5709 sec 2024-03-28T07:23:58.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5710 sec 2024-03-28T07:23:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5037.872508 secs 2024-03-28T07:23:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:23:58 smithi086 ceph-mon[35163]: pgmap v3552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5037.872508 secs 2024-03-28T07:23:59.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:23:58 smithi159 ceph-mon[36109]: pgmap v3552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5037.872508 secs 2024-03-28T07:23:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:23:58 smithi055 ceph-mon[31863]: pgmap v3552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:23:59.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5711 sec 2024-03-28T07:24:00.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5712 sec 2024-03-28T07:24:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:00 smithi086 ceph-mon[35163]: pgmap v3553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:01.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:00 smithi159 ceph-mon[36109]: pgmap v3553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:01.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:00 smithi055 ceph-mon[31863]: pgmap v3553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:01.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5713 sec 2024-03-28T07:24:02.909 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5714 sec 2024-03-28T07:24:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:02 smithi086 ceph-mon[35163]: pgmap v3554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:03.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:02 smithi159 ceph-mon[36109]: pgmap v3554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:02 smithi055 ceph-mon[31863]: pgmap v3554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:03.910 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5715 sec 2024-03-28T07:24:03.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5042.872631 secs 2024-03-28T07:24:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5042.872631 secs 2024-03-28T07:24:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5042.872631 secs 2024-03-28T07:24:04.910 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5716 sec 2024-03-28T07:24:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:04 smithi086 ceph-mon[35163]: pgmap v3555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:05.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:04 smithi159 ceph-mon[36109]: pgmap v3555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:05.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:04 smithi055 ceph-mon[31863]: pgmap v3555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:05.910 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5717 sec 2024-03-28T07:24:06.910 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5718 sec 2024-03-28T07:24:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:06 smithi086 ceph-mon[35163]: pgmap v3556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:07.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:06 smithi159 ceph-mon[36109]: pgmap v3556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:07.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:06 smithi055 ceph-mon[31863]: pgmap v3556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:07.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5719 sec 2024-03-28T07:24:08.910 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5720 sec 2024-03-28T07:24:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5047.872742 secs 2024-03-28T07:24:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:08 smithi086 ceph-mon[35163]: pgmap v3557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5047.872742 secs 2024-03-28T07:24:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:08 smithi159 ceph-mon[36109]: pgmap v3557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5047.872742 secs 2024-03-28T07:24:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:08 smithi055 ceph-mon[31863]: pgmap v3557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:09.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5721 sec 2024-03-28T07:24:10.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5722 sec 2024-03-28T07:24:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:10 smithi086 ceph-mon[35163]: pgmap v3558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:10 smithi159 ceph-mon[36109]: pgmap v3558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:10 smithi055 ceph-mon[31863]: pgmap v3558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:11.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5723 sec 2024-03-28T07:24:12.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5724 sec 2024-03-28T07:24:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:12 smithi086 ceph-mon[35163]: pgmap v3559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:13.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:12 smithi159 ceph-mon[36109]: pgmap v3559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:13.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:12 smithi055 ceph-mon[31863]: pgmap v3559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:13.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5725 sec 2024-03-28T07:24:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5052.872873 secs 2024-03-28T07:24:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5052.872873 secs 2024-03-28T07:24:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5052.872873 secs 2024-03-28T07:24:14.911 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5726 sec 2024-03-28T07:24:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:14 smithi086 ceph-mon[35163]: pgmap v3560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:14 smithi159 ceph-mon[36109]: pgmap v3560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:14 smithi055 ceph-mon[31863]: pgmap v3560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:15.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5727 sec 2024-03-28T07:24:16.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5728 sec 2024-03-28T07:24:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:16 smithi086 ceph-mon[35163]: pgmap v3561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:17.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:16 smithi159 ceph-mon[36109]: pgmap v3561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:17.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:16 smithi055 ceph-mon[31863]: pgmap v3561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:17.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5729 sec 2024-03-28T07:24:18.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5730 sec 2024-03-28T07:24:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5057.872960 secs 2024-03-28T07:24:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:18 smithi086 ceph-mon[35163]: pgmap v3562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5057.872960 secs 2024-03-28T07:24:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:18 smithi159 ceph-mon[36109]: pgmap v3562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5057.872960 secs 2024-03-28T07:24:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:18 smithi055 ceph-mon[31863]: pgmap v3562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:19.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5731 sec 2024-03-28T07:24:20.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5732 sec 2024-03-28T07:24:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:20 smithi086 ceph-mon[35163]: pgmap v3563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:21.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:20 smithi159 ceph-mon[36109]: pgmap v3563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:21.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:20 smithi055 ceph-mon[31863]: pgmap v3563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:21.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5733 sec 2024-03-28T07:24:22.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5734 sec 2024-03-28T07:24:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:22 smithi086 ceph-mon[35163]: pgmap v3564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:23.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:22 smithi159 ceph-mon[36109]: pgmap v3564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:23.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:22 smithi055 ceph-mon[31863]: pgmap v3564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:23.912 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5735 sec 2024-03-28T07:24:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5062.873053 secs 2024-03-28T07:24:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5062.873053 secs 2024-03-28T07:24:24.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5062.873053 secs 2024-03-28T07:24:24.913 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5736 sec 2024-03-28T07:24:25.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:24 smithi159 ceph-mon[36109]: pgmap v3565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:24 smithi055 ceph-mon[31863]: pgmap v3565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:25.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:24 smithi086 ceph-mon[35163]: pgmap v3565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:25.913 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5737 sec 2024-03-28T07:24:26.913 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5738 sec 2024-03-28T07:24:27.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:26 smithi055 ceph-mon[31863]: pgmap v3566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:26 smithi086 ceph-mon[35163]: pgmap v3566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:27.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:26 smithi159 ceph-mon[36109]: pgmap v3566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:27.913 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5739 sec 2024-03-28T07:24:28.913 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5740 sec 2024-03-28T07:24:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5067.873185 secs 2024-03-28T07:24:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:28 smithi055 ceph-mon[31863]: pgmap v3567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5067.873185 secs 2024-03-28T07:24:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:28 smithi086 ceph-mon[35163]: pgmap v3567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5067.873185 secs 2024-03-28T07:24:29.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:28 smithi159 ceph-mon[36109]: pgmap v3567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:29.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5741 sec 2024-03-28T07:24:30.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5742 sec 2024-03-28T07:24:31.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:30 smithi055 ceph-mon[31863]: pgmap v3568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:30 smithi086 ceph-mon[35163]: pgmap v3568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:31.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:30 smithi159 ceph-mon[36109]: pgmap v3568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:31.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5743 sec 2024-03-28T07:24:32.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5744 sec 2024-03-28T07:24:33.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:32 smithi055 ceph-mon[31863]: pgmap v3569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:33.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:32 smithi159 ceph-mon[36109]: pgmap v3569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:32 smithi086 ceph-mon[35163]: pgmap v3569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:33.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5745 sec 2024-03-28T07:24:34.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5072.873308 secs 2024-03-28T07:24:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5072.873308 secs 2024-03-28T07:24:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5072.873308 secs 2024-03-28T07:24:34.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5746 sec 2024-03-28T07:24:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:34 smithi055 ceph-mon[31863]: pgmap v3570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:34 smithi086 ceph-mon[35163]: pgmap v3570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:35.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:34 smithi159 ceph-mon[36109]: pgmap v3570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:35.914 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5747 sec 2024-03-28T07:24:36.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5748 sec 2024-03-28T07:24:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:36 smithi086 ceph-mon[35163]: pgmap v3571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:37.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:36 smithi159 ceph-mon[36109]: pgmap v3571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:37.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:36 smithi055 ceph-mon[31863]: pgmap v3571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:24:37.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5749 sec 2024-03-28T07:24:38.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5750 sec 2024-03-28T07:24:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5077.873418 secs 2024-03-28T07:24:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:38 smithi086 ceph-mon[35163]: pgmap v3572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:39.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5077.873418 secs 2024-03-28T07:24:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:38 smithi159 ceph-mon[36109]: pgmap v3572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5077.873418 secs 2024-03-28T07:24:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:38 smithi055 ceph-mon[31863]: pgmap v3572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:24:39.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5751 sec 2024-03-28T07:24:40.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5752 sec 2024-03-28T07:24:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:40 smithi086 ceph-mon[35163]: pgmap v3573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:41.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:40 smithi159 ceph-mon[36109]: pgmap v3573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:41.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:40 smithi055 ceph-mon[31863]: pgmap v3573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:41.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5753 sec 2024-03-28T07:24:42.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5754 sec 2024-03-28T07:24:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:42 smithi086 ceph-mon[35163]: pgmap v3574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:24:43.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:42 smithi159 ceph-mon[36109]: pgmap v3574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:43.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:24:43.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:42 smithi055 ceph-mon[31863]: pgmap v3574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:43.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:24:43.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5755 sec 2024-03-28T07:24:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5082.873524 secs 2024-03-28T07:24:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:24:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:24:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:24:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5082.873524 secs 2024-03-28T07:24:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:24:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:24:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:24:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5082.873524 secs 2024-03-28T07:24:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:24:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:24:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:24:44.915 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5756 sec 2024-03-28T07:24:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:44 smithi086 ceph-mon[35163]: pgmap v3575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:44 smithi086 ceph-mon[35163]: pgmap v3576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:44 smithi159 ceph-mon[36109]: pgmap v3575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:44 smithi159 ceph-mon[36109]: pgmap v3576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:44 smithi055 ceph-mon[31863]: pgmap v3575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:44 smithi055 ceph-mon[31863]: pgmap v3576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:45.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5757 sec 2024-03-28T07:24:46.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5758 sec 2024-03-28T07:24:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:46 smithi086 ceph-mon[35163]: pgmap v3577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:46 smithi159 ceph-mon[36109]: pgmap v3577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:47.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:46 smithi055 ceph-mon[31863]: pgmap v3577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:47.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5759 sec 2024-03-28T07:24:48.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5760 sec 2024-03-28T07:24:49.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:48 smithi055 ceph-mon[31863]: pgmap v3578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:49.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5087.873654 secs 2024-03-28T07:24:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:48 smithi086 ceph-mon[35163]: pgmap v3578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5087.873654 secs 2024-03-28T07:24:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:48 smithi159 ceph-mon[36109]: pgmap v3578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5087.873654 secs 2024-03-28T07:24:49.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5761 sec 2024-03-28T07:24:50.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5762 sec 2024-03-28T07:24:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:50 smithi086 ceph-mon[35163]: pgmap v3579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:50 smithi159 ceph-mon[36109]: pgmap v3579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:51.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:50 smithi055 ceph-mon[31863]: pgmap v3579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:51.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5763 sec 2024-03-28T07:24:52.916 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5764 sec 2024-03-28T07:24:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:52 smithi086 ceph-mon[35163]: pgmap v3580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:52 smithi159 ceph-mon[36109]: pgmap v3580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:52 smithi055 ceph-mon[31863]: pgmap v3580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:24:53.917 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5765 sec 2024-03-28T07:24:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5092.873769 secs 2024-03-28T07:24:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5092.873769 secs 2024-03-28T07:24:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5092.873769 secs 2024-03-28T07:24:54.917 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5766 sec 2024-03-28T07:24:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:54 smithi086 ceph-mon[35163]: pgmap v3581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:24:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:54 smithi159 ceph-mon[36109]: pgmap v3581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:24:55.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:54 smithi055 ceph-mon[31863]: pgmap v3581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:24:55.917 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5767 sec 2024-03-28T07:24:56.917 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5768 sec 2024-03-28T07:24:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:56 smithi086 ceph-mon[35163]: pgmap v3582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:24:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:56 smithi159 ceph-mon[36109]: pgmap v3582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:24:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:56 smithi055 ceph-mon[31863]: pgmap v3582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:24:57.917 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5769 sec 2024-03-28T07:24:58.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5770 sec 2024-03-28T07:24:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:58 smithi086 ceph-mon[35163]: pgmap v3583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:24:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:24:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5097.873865 secs 2024-03-28T07:24:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:58 smithi159 ceph-mon[36109]: pgmap v3583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:24:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:24:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5097.873865 secs 2024-03-28T07:24:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:58 smithi055 ceph-mon[31863]: pgmap v3583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:24:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:24:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5097.873865 secs 2024-03-28T07:24:59.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5771 sec 2024-03-28T07:25:00.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5772 sec 2024-03-28T07:25:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:00 smithi086 ceph-mon[35163]: pgmap v3584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:01.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:00 smithi159 ceph-mon[36109]: pgmap v3584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:01.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:00 smithi055 ceph-mon[31863]: pgmap v3584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:01.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5773 sec 2024-03-28T07:25:02.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5774 sec 2024-03-28T07:25:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:02 smithi086 ceph-mon[35163]: pgmap v3585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:03.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:02 smithi159 ceph-mon[36109]: pgmap v3585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:02 smithi055 ceph-mon[31863]: pgmap v3585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:03.918 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5775 sec 2024-03-28T07:25:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5102.873919 secs 2024-03-28T07:25:04.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5102.873919 secs 2024-03-28T07:25:04.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5102.873919 secs 2024-03-28T07:25:04.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5776 sec 2024-03-28T07:25:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:05 smithi086 ceph-mon[35163]: pgmap v3586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:05.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:05 smithi159 ceph-mon[36109]: pgmap v3586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:05.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:05 smithi055 ceph-mon[31863]: pgmap v3586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:05.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5777 sec 2024-03-28T07:25:06.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5778 sec 2024-03-28T07:25:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:07 smithi086 ceph-mon[35163]: pgmap v3587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:07.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:07 smithi159 ceph-mon[36109]: pgmap v3587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:07 smithi055 ceph-mon[31863]: pgmap v3587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:07.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5779 sec 2024-03-28T07:25:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:08 smithi086 ceph-mon[35163]: pgmap v3588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:08.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:08 smithi159 ceph-mon[36109]: pgmap v3588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:08 smithi055 ceph-mon[31863]: pgmap v3588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:08.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5780 sec 2024-03-28T07:25:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5107.874034 secs 2024-03-28T07:25:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5107.874034 secs 2024-03-28T07:25:09.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5107.874034 secs 2024-03-28T07:25:09.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5781 sec 2024-03-28T07:25:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:10 smithi086 ceph-mon[35163]: pgmap v3589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:10.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:10 smithi159 ceph-mon[36109]: pgmap v3589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:10.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:10 smithi055 ceph-mon[31863]: pgmap v3589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:10.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5782 sec 2024-03-28T07:25:11.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5783 sec 2024-03-28T07:25:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:12 smithi086 ceph-mon[35163]: pgmap v3590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:12.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:12 smithi159 ceph-mon[36109]: pgmap v3590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:12.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:12 smithi055 ceph-mon[31863]: pgmap v3590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:12.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5784 sec 2024-03-28T07:25:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5112.874150 secs 2024-03-28T07:25:13.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5112.874150 secs 2024-03-28T07:25:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5112.874150 secs 2024-03-28T07:25:13.919 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5785 sec 2024-03-28T07:25:14.722 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:14 smithi086 ceph-mon[35163]: pgmap v3591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:14.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:14 smithi159 ceph-mon[36109]: pgmap v3591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:14.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:14 smithi055 ceph-mon[31863]: pgmap v3591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:14.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5786 sec 2024-03-28T07:25:15.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5787 sec 2024-03-28T07:25:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:16 smithi086 ceph-mon[35163]: pgmap v3592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:16.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:16 smithi159 ceph-mon[36109]: pgmap v3592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:16.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:16 smithi055 ceph-mon[31863]: pgmap v3592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:16.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5788 sec 2024-03-28T07:25:17.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5789 sec 2024-03-28T07:25:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:18 smithi086 ceph-mon[35163]: pgmap v3593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5117.874226 secs 2024-03-28T07:25:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:18 smithi159 ceph-mon[36109]: pgmap v3593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:18.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5117.874226 secs 2024-03-28T07:25:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:18 smithi055 ceph-mon[31863]: pgmap v3593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5117.874226 secs 2024-03-28T07:25:18.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5790 sec 2024-03-28T07:25:19.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5791 sec 2024-03-28T07:25:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:20 smithi086 ceph-mon[35163]: pgmap v3594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:20.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:20 smithi159 ceph-mon[36109]: pgmap v3594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:20.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:20 smithi055 ceph-mon[31863]: pgmap v3594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:20.920 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5792 sec 2024-03-28T07:25:21.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5793 sec 2024-03-28T07:25:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:22 smithi086 ceph-mon[35163]: pgmap v3595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:22.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:22 smithi159 ceph-mon[36109]: pgmap v3595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:22.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:22 smithi055 ceph-mon[31863]: pgmap v3595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:22.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5794 sec 2024-03-28T07:25:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5122.874292 secs 2024-03-28T07:25:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5122.874292 secs 2024-03-28T07:25:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5122.874292 secs 2024-03-28T07:25:23.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5795 sec 2024-03-28T07:25:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:24 smithi086 ceph-mon[35163]: pgmap v3596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:24.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:24 smithi159 ceph-mon[36109]: pgmap v3596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:24.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:24 smithi055 ceph-mon[31863]: pgmap v3596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:24.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5796 sec 2024-03-28T07:25:25.921 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5797 sec 2024-03-28T07:25:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:26 smithi086 ceph-mon[35163]: pgmap v3597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:26.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:26 smithi159 ceph-mon[36109]: pgmap v3597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:26.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:26 smithi055 ceph-mon[31863]: pgmap v3597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:26.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5798 sec 2024-03-28T07:25:27.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5799 sec 2024-03-28T07:25:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:28 smithi086 ceph-mon[35163]: pgmap v3598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5127.874407 secs 2024-03-28T07:25:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:28 smithi159 ceph-mon[36109]: pgmap v3598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:28.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5127.874407 secs 2024-03-28T07:25:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:28 smithi055 ceph-mon[31863]: pgmap v3598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:28.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5127.874407 secs 2024-03-28T07:25:28.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5800 sec 2024-03-28T07:25:29.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5801 sec 2024-03-28T07:25:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:30 smithi086 ceph-mon[35163]: pgmap v3599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:30.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:30 smithi159 ceph-mon[36109]: pgmap v3599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:30.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:30 smithi055 ceph-mon[31863]: pgmap v3599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:30.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5802 sec 2024-03-28T07:25:31.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5803 sec 2024-03-28T07:25:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:32 smithi086 ceph-mon[35163]: pgmap v3600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:32.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:32 smithi159 ceph-mon[36109]: pgmap v3600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:32.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:32 smithi055 ceph-mon[31863]: pgmap v3600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:32.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5804 sec 2024-03-28T07:25:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5132.874485 secs 2024-03-28T07:25:33.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5132.874485 secs 2024-03-28T07:25:33.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5132.874485 secs 2024-03-28T07:25:33.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5805 sec 2024-03-28T07:25:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:34 smithi086 ceph-mon[35163]: pgmap v3601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:34 smithi159 ceph-mon[36109]: pgmap v3601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:34 smithi055 ceph-mon[31863]: pgmap v3601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:34.922 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5806 sec 2024-03-28T07:25:35.923 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5807 sec 2024-03-28T07:25:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:36 smithi086 ceph-mon[35163]: pgmap v3602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:36.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:36 smithi159 ceph-mon[36109]: pgmap v3602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:36.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:36 smithi055 ceph-mon[31863]: pgmap v3602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:25:36.923 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5808 sec 2024-03-28T07:25:37.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5809 sec 2024-03-28T07:25:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:38 smithi086 ceph-mon[35163]: pgmap v3603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5137.874599 secs 2024-03-28T07:25:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:38 smithi159 ceph-mon[36109]: pgmap v3603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:38.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5137.874599 secs 2024-03-28T07:25:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:38 smithi055 ceph-mon[31863]: pgmap v3603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:38.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5137.874599 secs 2024-03-28T07:25:38.923 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5810 sec 2024-03-28T07:25:39.923 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5811 sec 2024-03-28T07:25:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:40 smithi086 ceph-mon[35163]: pgmap v3604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:40.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:40 smithi159 ceph-mon[36109]: pgmap v3604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:40.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:40 smithi055 ceph-mon[31863]: pgmap v3604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:40.923 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5812 sec 2024-03-28T07:25:41.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5813 sec 2024-03-28T07:25:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:42 smithi086 ceph-mon[35163]: pgmap v3605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:42.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:42 smithi159 ceph-mon[36109]: pgmap v3605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:42.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:42 smithi055 ceph-mon[31863]: pgmap v3605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:42.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5814 sec 2024-03-28T07:25:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5142.874720 secs 2024-03-28T07:25:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5142.874720 secs 2024-03-28T07:25:43.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5142.874720 secs 2024-03-28T07:25:43.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5815 sec 2024-03-28T07:25:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:44 smithi086 ceph-mon[35163]: pgmap v3606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:25:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:44 smithi159 ceph-mon[36109]: pgmap v3606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:44.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:25:44.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:44 smithi055 ceph-mon[31863]: pgmap v3606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:44.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:25:44.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5816 sec 2024-03-28T07:25:45.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:25:45.877 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:25:45.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5817 sec 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:25:46.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:25:46.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:25:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:25:46.074 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:25:46.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:46 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:25:46.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:46 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:25:46.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:46 smithi055 ceph-mon[31863]: pgmap v3607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:46.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:46 smithi055 ceph-mon[31863]: pgmap v3608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:25:46.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5818 sec 2024-03-28T07:25:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:46 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:25:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:46 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:25:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:46 smithi086 ceph-mon[35163]: pgmap v3607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:46 smithi086 ceph-mon[35163]: pgmap v3608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:25:47.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:46 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:25:47.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:46 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:25:47.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:46 smithi159 ceph-mon[36109]: pgmap v3607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:25:47.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:46 smithi159 ceph-mon[36109]: pgmap v3608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:25:47.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5819 sec 2024-03-28T07:25:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:48 smithi055 ceph-mon[31863]: pgmap v3609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:48.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5147.874802 secs 2024-03-28T07:25:48.924 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5820 sec 2024-03-28T07:25:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:48 smithi086 ceph-mon[35163]: pgmap v3609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5147.874802 secs 2024-03-28T07:25:49.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:48 smithi159 ceph-mon[36109]: pgmap v3609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5147.874802 secs 2024-03-28T07:25:49.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5821 sec 2024-03-28T07:25:50.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:50 smithi055 ceph-mon[31863]: pgmap v3610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:50.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5822 sec 2024-03-28T07:25:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:50 smithi086 ceph-mon[35163]: pgmap v3610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:51.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:50 smithi159 ceph-mon[36109]: pgmap v3610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:51.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5823 sec 2024-03-28T07:25:52.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:52 smithi055 ceph-mon[31863]: pgmap v3611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:52.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5824 sec 2024-03-28T07:25:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:52 smithi086 ceph-mon[35163]: pgmap v3611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:52 smithi159 ceph-mon[36109]: pgmap v3611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:53.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5152.874855 secs 2024-03-28T07:25:53.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5825 sec 2024-03-28T07:25:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5152.874855 secs 2024-03-28T07:25:54.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5152.874855 secs 2024-03-28T07:25:54.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:54 smithi055 ceph-mon[31863]: pgmap v3612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:54.925 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5826 sec 2024-03-28T07:25:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:54 smithi086 ceph-mon[35163]: pgmap v3612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:55.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:54 smithi159 ceph-mon[36109]: pgmap v3612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:25:55.926 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5827 sec 2024-03-28T07:25:56.926 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5828 sec 2024-03-28T07:25:57.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:56 smithi086 ceph-mon[35163]: pgmap v3613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:56 smithi159 ceph-mon[36109]: pgmap v3613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:57.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:56 smithi055 ceph-mon[31863]: pgmap v3613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:25:57.926 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5829 sec 2024-03-28T07:25:58.926 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5830 sec 2024-03-28T07:25:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:58 smithi086 ceph-mon[35163]: pgmap v3614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:25:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5157.874972 secs 2024-03-28T07:25:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:58 smithi159 ceph-mon[36109]: pgmap v3614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:59.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:25:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5157.874972 secs 2024-03-28T07:25:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:58 smithi055 ceph-mon[31863]: pgmap v3614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:25:59.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:25:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5157.874972 secs 2024-03-28T07:25:59.926 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5831 sec 2024-03-28T07:26:00.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5832 sec 2024-03-28T07:26:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:00 smithi086 ceph-mon[35163]: pgmap v3615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:01.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:00 smithi159 ceph-mon[36109]: pgmap v3615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:01.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:00 smithi055 ceph-mon[31863]: pgmap v3615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:01.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5833 sec 2024-03-28T07:26:02.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5834 sec 2024-03-28T07:26:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:02 smithi086 ceph-mon[35163]: pgmap v3616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:03.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:02 smithi159 ceph-mon[36109]: pgmap v3616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:03.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:02 smithi055 ceph-mon[31863]: pgmap v3616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:03.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5835 sec 2024-03-28T07:26:03.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5162.875096 secs 2024-03-28T07:26:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5162.875096 secs 2024-03-28T07:26:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5162.875096 secs 2024-03-28T07:26:04.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5836 sec 2024-03-28T07:26:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:04 smithi086 ceph-mon[35163]: pgmap v3617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:05.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:04 smithi159 ceph-mon[36109]: pgmap v3617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:05.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:04 smithi055 ceph-mon[31863]: pgmap v3617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:05.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5837 sec 2024-03-28T07:26:06.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5838 sec 2024-03-28T07:26:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:06 smithi086 ceph-mon[35163]: pgmap v3618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:07.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:06 smithi159 ceph-mon[36109]: pgmap v3618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:07.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:06 smithi055 ceph-mon[31863]: pgmap v3618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:07.927 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5839 sec 2024-03-28T07:26:08.928 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5840 sec 2024-03-28T07:26:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:08 smithi086 ceph-mon[35163]: pgmap v3619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5167.875214 secs 2024-03-28T07:26:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:08 smithi159 ceph-mon[36109]: pgmap v3619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5167.875214 secs 2024-03-28T07:26:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:08 smithi055 ceph-mon[31863]: pgmap v3619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5167.875214 secs 2024-03-28T07:26:09.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5841 sec 2024-03-28T07:26:10.928 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5842 sec 2024-03-28T07:26:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:10 smithi086 ceph-mon[35163]: pgmap v3620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:11.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:10 smithi159 ceph-mon[36109]: pgmap v3620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:11.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:10 smithi055 ceph-mon[31863]: pgmap v3620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:11.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5843 sec 2024-03-28T07:26:12.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5844 sec 2024-03-28T07:26:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:12 smithi086 ceph-mon[35163]: pgmap v3621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:13.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:12 smithi159 ceph-mon[36109]: pgmap v3621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:13.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:12 smithi055 ceph-mon[31863]: pgmap v3621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:13.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5845 sec 2024-03-28T07:26:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5172.875336 secs 2024-03-28T07:26:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5172.875336 secs 2024-03-28T07:26:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5172.875336 secs 2024-03-28T07:26:14.928 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5846 sec 2024-03-28T07:26:14.972 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:14 smithi086 ceph-mon[35163]: pgmap v3622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:15.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:14 smithi159 ceph-mon[36109]: pgmap v3622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:14 smithi055 ceph-mon[31863]: pgmap v3622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:15.928 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5847 sec 2024-03-28T07:26:16.928 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5848 sec 2024-03-28T07:26:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:16 smithi086 ceph-mon[35163]: pgmap v3623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:17.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:16 smithi159 ceph-mon[36109]: pgmap v3623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:17.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:16 smithi055 ceph-mon[31863]: pgmap v3623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:17.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5849 sec 2024-03-28T07:26:18.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5850 sec 2024-03-28T07:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:18 smithi086 ceph-mon[35163]: pgmap v3624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5177.875399 secs 2024-03-28T07:26:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:18 smithi159 ceph-mon[36109]: pgmap v3624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5177.875399 secs 2024-03-28T07:26:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:18 smithi055 ceph-mon[31863]: pgmap v3624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5177.875399 secs 2024-03-28T07:26:19.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5851 sec 2024-03-28T07:26:20.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5852 sec 2024-03-28T07:26:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:20 smithi086 ceph-mon[35163]: pgmap v3625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:21.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:20 smithi159 ceph-mon[36109]: pgmap v3625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:21.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:20 smithi055 ceph-mon[31863]: pgmap v3625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:21.929 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5853 sec 2024-03-28T07:26:22.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5854 sec 2024-03-28T07:26:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:22 smithi086 ceph-mon[35163]: pgmap v3626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:23.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:22 smithi159 ceph-mon[36109]: pgmap v3626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:23.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:22 smithi055 ceph-mon[31863]: pgmap v3626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:23.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5855 sec 2024-03-28T07:26:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5182.875475 secs 2024-03-28T07:26:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5182.875475 secs 2024-03-28T07:26:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5182.875475 secs 2024-03-28T07:26:24.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5856 sec 2024-03-28T07:26:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:24 smithi086 ceph-mon[35163]: pgmap v3627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:25.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:24 smithi159 ceph-mon[36109]: pgmap v3627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:25.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:24 smithi055 ceph-mon[31863]: pgmap v3627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:25.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5857 sec 2024-03-28T07:26:26.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5858 sec 2024-03-28T07:26:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:26 smithi086 ceph-mon[35163]: pgmap v3628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:27.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:26 smithi159 ceph-mon[36109]: pgmap v3628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:27.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:26 smithi055 ceph-mon[31863]: pgmap v3628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:27.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5859 sec 2024-03-28T07:26:28.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5860 sec 2024-03-28T07:26:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:28 smithi086 ceph-mon[35163]: pgmap v3629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5187.875593 secs 2024-03-28T07:26:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:28 smithi159 ceph-mon[36109]: pgmap v3629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5187.875593 secs 2024-03-28T07:26:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:28 smithi055 ceph-mon[31863]: pgmap v3629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5187.875593 secs 2024-03-28T07:26:29.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5861 sec 2024-03-28T07:26:30.930 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5862 sec 2024-03-28T07:26:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:30 smithi086 ceph-mon[35163]: pgmap v3630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:31.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:30 smithi159 ceph-mon[36109]: pgmap v3630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:31.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:30 smithi055 ceph-mon[31863]: pgmap v3630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:31.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5863 sec 2024-03-28T07:26:32.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5864 sec 2024-03-28T07:26:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:32 smithi086 ceph-mon[35163]: pgmap v3631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:33.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:32 smithi159 ceph-mon[36109]: pgmap v3631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:32 smithi055 ceph-mon[31863]: pgmap v3631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:33.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5865 sec 2024-03-28T07:26:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5192.875719 secs 2024-03-28T07:26:34.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5192.875719 secs 2024-03-28T07:26:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5192.875719 secs 2024-03-28T07:26:34.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5866 sec 2024-03-28T07:26:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:34 smithi086 ceph-mon[35163]: pgmap v3632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:35.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:34 smithi159 ceph-mon[36109]: pgmap v3632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:35.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:34 smithi055 ceph-mon[31863]: pgmap v3632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:35.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5867 sec 2024-03-28T07:26:36.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5868 sec 2024-03-28T07:26:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:36 smithi086 ceph-mon[35163]: pgmap v3633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:37.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:36 smithi159 ceph-mon[36109]: pgmap v3633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:36 smithi055 ceph-mon[31863]: pgmap v3633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:37.931 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5869 sec 2024-03-28T07:26:38.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5870 sec 2024-03-28T07:26:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:38 smithi086 ceph-mon[35163]: pgmap v3634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5197.875849 secs 2024-03-28T07:26:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:38 smithi159 ceph-mon[36109]: pgmap v3634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5197.875849 secs 2024-03-28T07:26:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:38 smithi055 ceph-mon[31863]: pgmap v3634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5197.875849 secs 2024-03-28T07:26:39.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5871 sec 2024-03-28T07:26:40.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5872 sec 2024-03-28T07:26:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:40 smithi086 ceph-mon[35163]: pgmap v3635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:41.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:40 smithi159 ceph-mon[36109]: pgmap v3635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:40 smithi055 ceph-mon[31863]: pgmap v3635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:41.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5873 sec 2024-03-28T07:26:42.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5874 sec 2024-03-28T07:26:43.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:42 smithi055 ceph-mon[31863]: pgmap v3636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:42 smithi086 ceph-mon[35163]: pgmap v3636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:43.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:42 smithi159 ceph-mon[36109]: pgmap v3636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:43.932 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5875 sec 2024-03-28T07:26:44.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5202.875937 secs 2024-03-28T07:26:44.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5202.875937 secs 2024-03-28T07:26:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5202.875937 secs 2024-03-28T07:26:44.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5876 sec 2024-03-28T07:26:45.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:44 smithi055 ceph-mon[31863]: pgmap v3637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:44 smithi086 ceph-mon[35163]: pgmap v3637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:45.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:44 smithi159 ceph-mon[36109]: pgmap v3637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:45.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5877 sec 2024-03-28T07:26:46.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:26:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:26:46.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:26:46.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5878 sec 2024-03-28T07:26:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:46 smithi055 ceph-mon[31863]: pgmap v3638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:46 smithi086 ceph-mon[35163]: pgmap v3638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:46 smithi159 ceph-mon[36109]: pgmap v3638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:26:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:26:47.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5879 sec 2024-03-28T07:26:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:26:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:26:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:26:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:26:48.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: pgmap v3639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:48.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: pgmap v3640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:48.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: pgmap v3639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: pgmap v3640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:26:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:26:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:26:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:26:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:26:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: pgmap v3639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:26:48.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: pgmap v3640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:48.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:26:48.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5880 sec 2024-03-28T07:26:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5207.876017 secs 2024-03-28T07:26:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5207.876017 secs 2024-03-28T07:26:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5207.876017 secs 2024-03-28T07:26:49.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5881 sec 2024-03-28T07:26:50.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:49 smithi055 ceph-mon[31863]: pgmap v3641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:49 smithi086 ceph-mon[35163]: pgmap v3641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:49 smithi159 ceph-mon[36109]: pgmap v3641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:50.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5882 sec 2024-03-28T07:26:51.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5883 sec 2024-03-28T07:26:52.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:51 smithi086 ceph-mon[35163]: pgmap v3642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:51 smithi159 ceph-mon[36109]: pgmap v3642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:52.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:51 smithi055 ceph-mon[31863]: pgmap v3642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:52.933 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5884 sec 2024-03-28T07:26:53.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5885 sec 2024-03-28T07:26:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5212.876137 secs 2024-03-28T07:26:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:53 smithi086 ceph-mon[35163]: pgmap v3643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5212.876137 secs 2024-03-28T07:26:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:53 smithi159 ceph-mon[36109]: pgmap v3643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5212.876137 secs 2024-03-28T07:26:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:53 smithi055 ceph-mon[31863]: pgmap v3643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:54.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5886 sec 2024-03-28T07:26:55.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5887 sec 2024-03-28T07:26:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:55 smithi086 ceph-mon[35163]: pgmap v3644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:56.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:55 smithi159 ceph-mon[36109]: pgmap v3644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:56.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:55 smithi055 ceph-mon[31863]: pgmap v3644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:26:56.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5888 sec 2024-03-28T07:26:57.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5889 sec 2024-03-28T07:26:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:57 smithi086 ceph-mon[35163]: pgmap v3645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:26:58.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:57 smithi159 ceph-mon[36109]: pgmap v3645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:26:58.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:57 smithi055 ceph-mon[31863]: pgmap v3645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:26:58.934 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5890 sec 2024-03-28T07:26:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5217.876210 secs 2024-03-28T07:26:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5217.876210 secs 2024-03-28T07:26:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5217.876210 secs 2024-03-28T07:26:59.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5891 sec 2024-03-28T07:27:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:26:59 smithi086 ceph-mon[35163]: pgmap v3646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:00.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:26:59 smithi159 ceph-mon[36109]: pgmap v3646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:26:59 smithi055 ceph-mon[31863]: pgmap v3646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:00.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5892 sec 2024-03-28T07:27:01.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5893 sec 2024-03-28T07:27:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:01 smithi086 ceph-mon[35163]: pgmap v3647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:02.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:01 smithi159 ceph-mon[36109]: pgmap v3647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:02.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:01 smithi055 ceph-mon[31863]: pgmap v3647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:02.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5894 sec 2024-03-28T07:27:03.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5895 sec 2024-03-28T07:27:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5222.876292 secs 2024-03-28T07:27:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:04 smithi086 ceph-mon[35163]: pgmap v3648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:04.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5222.876292 secs 2024-03-28T07:27:04.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:04 smithi159 ceph-mon[36109]: pgmap v3648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:04.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5222.876292 secs 2024-03-28T07:27:04.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:04 smithi055 ceph-mon[31863]: pgmap v3648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:04.935 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5896 sec 2024-03-28T07:27:05.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5897 sec 2024-03-28T07:27:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:06 smithi086 ceph-mon[35163]: pgmap v3649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:06.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:06 smithi159 ceph-mon[36109]: pgmap v3649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:06.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:06 smithi055 ceph-mon[31863]: pgmap v3649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:06.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5898 sec 2024-03-28T07:27:07.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5899 sec 2024-03-28T07:27:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:08 smithi086 ceph-mon[35163]: pgmap v3650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:08.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:08 smithi159 ceph-mon[36109]: pgmap v3650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:08.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:08 smithi055 ceph-mon[31863]: pgmap v3650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:08.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5900 sec 2024-03-28T07:27:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5227.876411 secs 2024-03-28T07:27:09.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5227.876411 secs 2024-03-28T07:27:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5227.876411 secs 2024-03-28T07:27:09.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5901 sec 2024-03-28T07:27:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:10 smithi086 ceph-mon[35163]: pgmap v3651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:10.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:10 smithi159 ceph-mon[36109]: pgmap v3651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:10.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:10 smithi055 ceph-mon[31863]: pgmap v3651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:10.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5902 sec 2024-03-28T07:27:11.936 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5903 sec 2024-03-28T07:27:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:12 smithi086 ceph-mon[35163]: pgmap v3652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:12.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:12 smithi159 ceph-mon[36109]: pgmap v3652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:12.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:12 smithi055 ceph-mon[31863]: pgmap v3652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:12.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5904 sec 2024-03-28T07:27:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:13 smithi086 ceph-mon[35163]: pgmap v3653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:13.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:13 smithi159 ceph-mon[36109]: pgmap v3653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:13.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:13 smithi055 ceph-mon[31863]: pgmap v3653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:13.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5905 sec 2024-03-28T07:27:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5232.876530 secs 2024-03-28T07:27:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5232.876530 secs 2024-03-28T07:27:14.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5232.876530 secs 2024-03-28T07:27:14.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5906 sec 2024-03-28T07:27:15.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:15 smithi159 ceph-mon[36109]: pgmap v3654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:15 smithi055 ceph-mon[31863]: pgmap v3654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:15 smithi086 ceph-mon[35163]: pgmap v3654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:15.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5907 sec 2024-03-28T07:27:16.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5908 sec 2024-03-28T07:27:17.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5909 sec 2024-03-28T07:27:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:17 smithi086 ceph-mon[35163]: pgmap v3655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:18.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:17 smithi159 ceph-mon[36109]: pgmap v3655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:18.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:17 smithi055 ceph-mon[31863]: pgmap v3655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:18.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5910 sec 2024-03-28T07:27:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5237.876648 secs 2024-03-28T07:27:19.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5237.876648 secs 2024-03-28T07:27:19.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5237.876648 secs 2024-03-28T07:27:19.937 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5911 sec 2024-03-28T07:27:20.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:19 smithi055 ceph-mon[31863]: pgmap v3656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:19 smithi086 ceph-mon[35163]: pgmap v3656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:20.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:19 smithi159 ceph-mon[36109]: pgmap v3656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:20.938 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5912 sec 2024-03-28T07:27:21.938 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5913 sec 2024-03-28T07:27:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:21 smithi086 ceph-mon[35163]: pgmap v3657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:22.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:21 smithi159 ceph-mon[36109]: pgmap v3657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:22.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:21 smithi055 ceph-mon[31863]: pgmap v3657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:22.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5914 sec 2024-03-28T07:27:23.938 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5915 sec 2024-03-28T07:27:24.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5242.876770 secs 2024-03-28T07:27:24.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:23 smithi086 ceph-mon[35163]: pgmap v3658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:24.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5242.876770 secs 2024-03-28T07:27:24.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:23 smithi159 ceph-mon[36109]: pgmap v3658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:24.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5242.876770 secs 2024-03-28T07:27:24.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:23 smithi055 ceph-mon[31863]: pgmap v3658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:24.938 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5916 sec 2024-03-28T07:27:25.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5917 sec 2024-03-28T07:27:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:25 smithi086 ceph-mon[35163]: pgmap v3659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:26.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:25 smithi159 ceph-mon[36109]: pgmap v3659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:26.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:25 smithi055 ceph-mon[31863]: pgmap v3659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:26.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5918 sec 2024-03-28T07:27:27.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5919 sec 2024-03-28T07:27:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:28 smithi086 ceph-mon[35163]: pgmap v3660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:28.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:28 smithi159 ceph-mon[36109]: pgmap v3660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:28.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:28 smithi055 ceph-mon[31863]: pgmap v3660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:28.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5920 sec 2024-03-28T07:27:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5247.876890 secs 2024-03-28T07:27:29.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5247.876890 secs 2024-03-28T07:27:29.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5247.876890 secs 2024-03-28T07:27:29.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5921 sec 2024-03-28T07:27:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:30 smithi086 ceph-mon[35163]: pgmap v3661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:30 smithi159 ceph-mon[36109]: pgmap v3661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:30.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:30 smithi055 ceph-mon[31863]: pgmap v3661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:30.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5922 sec 2024-03-28T07:27:31.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5923 sec 2024-03-28T07:27:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:32 smithi086 ceph-mon[35163]: pgmap v3662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:32.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:32 smithi159 ceph-mon[36109]: pgmap v3662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:32.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:32 smithi055 ceph-mon[31863]: pgmap v3662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:32.939 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5924 sec 2024-03-28T07:27:33.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5925 sec 2024-03-28T07:27:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5252.876972 secs 2024-03-28T07:27:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:34 smithi086 ceph-mon[35163]: pgmap v3663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5252.876972 secs 2024-03-28T07:27:34.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:34 smithi159 ceph-mon[36109]: pgmap v3663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5252.876972 secs 2024-03-28T07:27:34.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:34 smithi055 ceph-mon[31863]: pgmap v3663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:34.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5926 sec 2024-03-28T07:27:35.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5927 sec 2024-03-28T07:27:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:36 smithi086 ceph-mon[35163]: pgmap v3664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:27:36.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:36 smithi159 ceph-mon[36109]: pgmap v3664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:27:36.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:36 smithi055 ceph-mon[31863]: pgmap v3664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:27:36.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5928 sec 2024-03-28T07:27:37.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:37 smithi055 ceph-mon[31863]: pgmap v3665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:37 smithi086 ceph-mon[35163]: pgmap v3665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:37.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:37 smithi159 ceph-mon[36109]: pgmap v3665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:37.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5929 sec 2024-03-28T07:27:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5257.877083 secs 2024-03-28T07:27:38.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5257.877083 secs 2024-03-28T07:27:38.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5257.877083 secs 2024-03-28T07:27:38.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5930 sec 2024-03-28T07:27:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:39 smithi086 ceph-mon[35163]: pgmap v3666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:39.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:39 smithi159 ceph-mon[36109]: pgmap v3666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:39.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:39 smithi055 ceph-mon[31863]: pgmap v3666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:39.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5931 sec 2024-03-28T07:27:40.940 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5932 sec 2024-03-28T07:27:41.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5933 sec 2024-03-28T07:27:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:41 smithi086 ceph-mon[35163]: pgmap v3667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:42.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:41 smithi159 ceph-mon[36109]: pgmap v3667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:42.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:41 smithi055 ceph-mon[31863]: pgmap v3667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:42.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5934 sec 2024-03-28T07:27:43.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5935 sec 2024-03-28T07:27:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5262.877206 secs 2024-03-28T07:27:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:43 smithi086 ceph-mon[35163]: pgmap v3668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5262.877206 secs 2024-03-28T07:27:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:43 smithi159 ceph-mon[36109]: pgmap v3668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5262.877206 secs 2024-03-28T07:27:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:43 smithi055 ceph-mon[31863]: pgmap v3668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:44.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5936 sec 2024-03-28T07:27:45.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5937 sec 2024-03-28T07:27:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:45 smithi086 ceph-mon[35163]: pgmap v3669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:46.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:45 smithi159 ceph-mon[36109]: pgmap v3669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:46.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:45 smithi055 ceph-mon[31863]: pgmap v3669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:27:46.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5938 sec 2024-03-28T07:27:47.941 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5939 sec 2024-03-28T07:27:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:47 smithi086 ceph-mon[35163]: pgmap v3670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:27:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:47 smithi159 ceph-mon[36109]: pgmap v3670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:27:48.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:47 smithi055 ceph-mon[31863]: pgmap v3670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:48.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:27:48.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5940 sec 2024-03-28T07:27:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5267.877270 secs 2024-03-28T07:27:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:27:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:27:49.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:27:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5267.877270 secs 2024-03-28T07:27:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:27:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:27:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:27:49.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5267.877270 secs 2024-03-28T07:27:49.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:27:49.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:27:49.378 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:27:49.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5941 sec 2024-03-28T07:27:50.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:50 smithi055 ceph-mon[31863]: pgmap v3671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:50.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:50 smithi055 ceph-mon[31863]: pgmap v3672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:50 smithi086 ceph-mon[35163]: pgmap v3671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:50 smithi086 ceph-mon[35163]: pgmap v3672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:50 smithi159 ceph-mon[36109]: pgmap v3671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:27:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:50 smithi159 ceph-mon[36109]: pgmap v3672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:50.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5942 sec 2024-03-28T07:27:51.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5943 sec 2024-03-28T07:27:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:52 smithi086 ceph-mon[35163]: pgmap v3673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:27:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:52 smithi159 ceph-mon[36109]: pgmap v3673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:27:52.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:52 smithi055 ceph-mon[31863]: pgmap v3673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:27:52.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5944 sec 2024-03-28T07:27:53.942 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5945 sec 2024-03-28T07:27:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5272.877430 secs 2024-03-28T07:27:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:54 smithi086 ceph-mon[35163]: pgmap v3674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:27:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5272.877430 secs 2024-03-28T07:27:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:54 smithi159 ceph-mon[36109]: pgmap v3674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:27:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5272.877430 secs 2024-03-28T07:27:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:54 smithi055 ceph-mon[31863]: pgmap v3674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:27:54.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5946 sec 2024-03-28T07:27:55.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5947 sec 2024-03-28T07:27:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:56 smithi086 ceph-mon[35163]: pgmap v3675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:56.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:56 smithi159 ceph-mon[36109]: pgmap v3675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:56.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:56 smithi055 ceph-mon[31863]: pgmap v3675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:56.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5948 sec 2024-03-28T07:27:57.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5949 sec 2024-03-28T07:27:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:58 smithi086 ceph-mon[35163]: pgmap v3676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:58.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:58 smithi159 ceph-mon[36109]: pgmap v3676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:58.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:58 smithi055 ceph-mon[31863]: pgmap v3676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:27:58.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5950 sec 2024-03-28T07:27:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:27:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5277.877549 secs 2024-03-28T07:27:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:27:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5277.877549 secs 2024-03-28T07:27:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:27:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5277.877549 secs 2024-03-28T07:27:59.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5951 sec 2024-03-28T07:28:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:00 smithi086 ceph-mon[35163]: pgmap v3677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:28:00.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:00 smithi159 ceph-mon[36109]: pgmap v3677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:28:00.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:00 smithi055 ceph-mon[31863]: pgmap v3677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:28:00.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5952 sec 2024-03-28T07:28:01.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:01 smithi055 ceph-mon[31863]: pgmap v3678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:01 smithi086 ceph-mon[35163]: pgmap v3678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:01.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:01 smithi159 ceph-mon[36109]: pgmap v3678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:01.943 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5953 sec 2024-03-28T07:28:02.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5954 sec 2024-03-28T07:28:03.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5955 sec 2024-03-28T07:28:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5282.877667 secs 2024-03-28T07:28:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:03 smithi086 ceph-mon[35163]: pgmap v3679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5282.877667 secs 2024-03-28T07:28:04.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:03 smithi159 ceph-mon[36109]: pgmap v3679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5282.877667 secs 2024-03-28T07:28:04.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:03 smithi055 ceph-mon[31863]: pgmap v3679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:04.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5956 sec 2024-03-28T07:28:05.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5957 sec 2024-03-28T07:28:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:05 smithi086 ceph-mon[35163]: pgmap v3680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:06.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:05 smithi159 ceph-mon[36109]: pgmap v3680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:06.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:05 smithi055 ceph-mon[31863]: pgmap v3680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:06.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5958 sec 2024-03-28T07:28:07.944 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5959 sec 2024-03-28T07:28:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:07 smithi086 ceph-mon[35163]: pgmap v3681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:08.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:07 smithi159 ceph-mon[36109]: pgmap v3681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:08.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:07 smithi055 ceph-mon[31863]: pgmap v3681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:08.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5960 sec 2024-03-28T07:28:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5287.877825 secs 2024-03-28T07:28:09.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5287.877825 secs 2024-03-28T07:28:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5287.877825 secs 2024-03-28T07:28:09.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5961 sec 2024-03-28T07:28:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:09 smithi086 ceph-mon[35163]: pgmap v3682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:10.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:09 smithi159 ceph-mon[36109]: pgmap v3682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:10.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:09 smithi055 ceph-mon[31863]: pgmap v3682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:10.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5962 sec 2024-03-28T07:28:11.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5963 sec 2024-03-28T07:28:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:11 smithi086 ceph-mon[35163]: pgmap v3683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:12.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:11 smithi159 ceph-mon[36109]: pgmap v3683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:12.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:11 smithi055 ceph-mon[31863]: pgmap v3683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:12.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5964 sec 2024-03-28T07:28:13.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5965 sec 2024-03-28T07:28:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5292.877891 secs 2024-03-28T07:28:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:13 smithi086 ceph-mon[35163]: pgmap v3684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5292.877891 secs 2024-03-28T07:28:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:13 smithi159 ceph-mon[36109]: pgmap v3684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5292.877891 secs 2024-03-28T07:28:14.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:13 smithi055 ceph-mon[31863]: pgmap v3684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:14.945 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5966 sec 2024-03-28T07:28:15.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5967 sec 2024-03-28T07:28:16.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:15 smithi055 ceph-mon[31863]: pgmap v3685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:15 smithi086 ceph-mon[35163]: pgmap v3685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:16.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:15 smithi159 ceph-mon[36109]: pgmap v3685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:16.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5968 sec 2024-03-28T07:28:17.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:17 smithi055 ceph-mon[31863]: pgmap v3686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:17.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5969 sec 2024-03-28T07:28:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:17 smithi086 ceph-mon[35163]: pgmap v3686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:18.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:17 smithi159 ceph-mon[36109]: pgmap v3686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5297.877982 secs 2024-03-28T07:28:18.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5970 sec 2024-03-28T07:28:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5297.877982 secs 2024-03-28T07:28:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5297.877982 secs 2024-03-28T07:28:19.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:19 smithi055 ceph-mon[31863]: pgmap v3687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:19.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5971 sec 2024-03-28T07:28:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:19 smithi086 ceph-mon[35163]: pgmap v3687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:20.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:19 smithi159 ceph-mon[36109]: pgmap v3687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:20.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5972 sec 2024-03-28T07:28:21.946 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5973 sec 2024-03-28T07:28:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:21 smithi086 ceph-mon[35163]: pgmap v3688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:22.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:21 smithi159 ceph-mon[36109]: pgmap v3688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:22.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:21 smithi055 ceph-mon[31863]: pgmap v3688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:22.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5974 sec 2024-03-28T07:28:23.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5975 sec 2024-03-28T07:28:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5302.878069 secs 2024-03-28T07:28:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:23 smithi086 ceph-mon[35163]: pgmap v3689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5302.878069 secs 2024-03-28T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:23 smithi159 ceph-mon[36109]: pgmap v3689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5302.878069 secs 2024-03-28T07:28:24.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:23 smithi055 ceph-mon[31863]: pgmap v3689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:24.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5976 sec 2024-03-28T07:28:25.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5977 sec 2024-03-28T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:25 smithi086 ceph-mon[35163]: pgmap v3690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:26.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:25 smithi159 ceph-mon[36109]: pgmap v3690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:26.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:25 smithi055 ceph-mon[31863]: pgmap v3690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:26.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5978 sec 2024-03-28T07:28:27.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5979 sec 2024-03-28T07:28:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:27 smithi086 ceph-mon[35163]: pgmap v3691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:28.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:27 smithi159 ceph-mon[36109]: pgmap v3691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:28.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:27 smithi055 ceph-mon[31863]: pgmap v3691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:28.947 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5980 sec 2024-03-28T07:28:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5307.878157 secs 2024-03-28T07:28:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5307.878157 secs 2024-03-28T07:28:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5307.878157 secs 2024-03-28T07:28:29.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5981 sec 2024-03-28T07:28:30.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:29 smithi055 ceph-mon[31863]: pgmap v3692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:29 smithi086 ceph-mon[35163]: pgmap v3692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:30.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:29 smithi159 ceph-mon[36109]: pgmap v3692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:30.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5982 sec 2024-03-28T07:28:31.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5983 sec 2024-03-28T07:28:32.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:31 smithi055 ceph-mon[31863]: pgmap v3693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:31 smithi086 ceph-mon[35163]: pgmap v3693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:32.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:31 smithi159 ceph-mon[36109]: pgmap v3693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:32.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5984 sec 2024-03-28T07:28:33.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5985 sec 2024-03-28T07:28:34.126 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5312.878180 secs 2024-03-28T07:28:34.139 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:33 smithi159 ceph-mon[36109]: pgmap v3694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:34.140 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5312.878180 secs 2024-03-28T07:28:34.140 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:33 smithi055 ceph-mon[31863]: pgmap v3694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5312.878180 secs 2024-03-28T07:28:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:33 smithi086 ceph-mon[35163]: pgmap v3694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:34.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5986 sec 2024-03-28T07:28:35.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5987 sec 2024-03-28T07:28:36.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:35 smithi055 ceph-mon[31863]: pgmap v3695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:35 smithi086 ceph-mon[35163]: pgmap v3695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:36.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:35 smithi159 ceph-mon[36109]: pgmap v3695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:36.948 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5988 sec 2024-03-28T07:28:37.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5989 sec 2024-03-28T07:28:38.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:37 smithi055 ceph-mon[31863]: pgmap v3696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:37 smithi086 ceph-mon[35163]: pgmap v3696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:38.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:37 smithi159 ceph-mon[36109]: pgmap v3696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:38.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5990 sec 2024-03-28T07:28:39.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5317.878298 secs 2024-03-28T07:28:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5317.878298 secs 2024-03-28T07:28:39.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5317.878298 secs 2024-03-28T07:28:39.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5991 sec 2024-03-28T07:28:40.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:39 smithi055 ceph-mon[31863]: pgmap v3697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:39 smithi086 ceph-mon[35163]: pgmap v3697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:40.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:39 smithi159 ceph-mon[36109]: pgmap v3697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:40.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5992 sec 2024-03-28T07:28:41.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5993 sec 2024-03-28T07:28:42.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:41 smithi055 ceph-mon[31863]: pgmap v3698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:41 smithi086 ceph-mon[35163]: pgmap v3698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:42.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:41 smithi159 ceph-mon[36109]: pgmap v3698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:42.949 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5994 sec 2024-03-28T07:28:43.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5995 sec 2024-03-28T07:28:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5322.878384 secs 2024-03-28T07:28:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:43 smithi086 ceph-mon[35163]: pgmap v3699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5322.878384 secs 2024-03-28T07:28:44.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:43 smithi159 ceph-mon[36109]: pgmap v3699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5322.878384 secs 2024-03-28T07:28:44.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:43 smithi055 ceph-mon[31863]: pgmap v3699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:44.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5996 sec 2024-03-28T07:28:45.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5997 sec 2024-03-28T07:28:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:45 smithi086 ceph-mon[35163]: pgmap v3700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:46.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:45 smithi159 ceph-mon[36109]: pgmap v3700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:46.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:45 smithi055 ceph-mon[31863]: pgmap v3700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:46.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5998 sec 2024-03-28T07:28:47.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 5999 sec 2024-03-28T07:28:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:47 smithi086 ceph-mon[35163]: pgmap v3701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:48.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:47 smithi159 ceph-mon[36109]: pgmap v3701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:48.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:47 smithi055 ceph-mon[31863]: pgmap v3701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:48.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6000 sec 2024-03-28T07:28:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5327.878444 secs 2024-03-28T07:28:49.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5327.878444 secs 2024-03-28T07:28:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5327.878444 secs 2024-03-28T07:28:49.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6001 sec 2024-03-28T07:28:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:49 smithi086 ceph-mon[35163]: pgmap v3702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:28:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:49 smithi159 ceph-mon[36109]: pgmap v3702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:50.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:28:50.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:49 smithi055 ceph-mon[31863]: pgmap v3702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:28:50.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:28:50.950 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6002 sec 2024-03-28T07:28:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:51.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6003 sec 2024-03-28T07:28:52.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:52 smithi055 ceph-mon[31863]: pgmap v3703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:52.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:28:52.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:28:52.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:52 smithi086 ceph-mon[35163]: pgmap v3703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:28:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:28:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:52 smithi159 ceph-mon[36109]: pgmap v3703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:28:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:28:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:28:52.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:28:52.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6004 sec 2024-03-28T07:28:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:53 smithi086 ceph-mon[35163]: pgmap v3704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:28:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:53 smithi086 ceph-mon[35163]: pgmap v3705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:53.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:53 smithi159 ceph-mon[36109]: pgmap v3704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:28:53.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:53 smithi159 ceph-mon[36109]: pgmap v3705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:53.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:53 smithi055 ceph-mon[31863]: pgmap v3704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T07:28:53.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:53 smithi055 ceph-mon[31863]: pgmap v3705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:53.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6005 sec 2024-03-28T07:28:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5332.878568 secs 2024-03-28T07:28:54.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5332.878568 secs 2024-03-28T07:28:54.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5332.878568 secs 2024-03-28T07:28:54.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6006 sec 2024-03-28T07:28:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:55 smithi086 ceph-mon[35163]: pgmap v3706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:55.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:55 smithi159 ceph-mon[36109]: pgmap v3706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:55.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:55 smithi055 ceph-mon[31863]: pgmap v3706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:55.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6007 sec 2024-03-28T07:28:56.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6008 sec 2024-03-28T07:28:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:57 smithi086 ceph-mon[35163]: pgmap v3707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:57 smithi159 ceph-mon[36109]: pgmap v3707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:57 smithi055 ceph-mon[31863]: pgmap v3707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:28:57.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6009 sec 2024-03-28T07:28:58.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6010 sec 2024-03-28T07:28:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5337.878627 secs 2024-03-28T07:28:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:28:59 smithi086 ceph-mon[35163]: pgmap v3708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5337.878627 secs 2024-03-28T07:28:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:28:59 smithi159 ceph-mon[36109]: pgmap v3708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5337.878627 secs 2024-03-28T07:28:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:28:59 smithi055 ceph-mon[31863]: pgmap v3708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:28:59.951 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6011 sec 2024-03-28T07:29:00.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6012 sec 2024-03-28T07:29:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:01 smithi086 ceph-mon[35163]: pgmap v3709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:29:01.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:01 smithi159 ceph-mon[36109]: pgmap v3709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:29:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:01 smithi055 ceph-mon[31863]: pgmap v3709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T07:29:01.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6013 sec 2024-03-28T07:29:02.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6014 sec 2024-03-28T07:29:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:03 smithi086 ceph-mon[35163]: pgmap v3710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:29:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:03 smithi159 ceph-mon[36109]: pgmap v3710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:29:03.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:03 smithi055 ceph-mon[31863]: pgmap v3710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:29:03.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6015 sec 2024-03-28T07:29:04.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5342.878691 secs 2024-03-28T07:29:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5342.878691 secs 2024-03-28T07:29:04.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5342.878691 secs 2024-03-28T07:29:04.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6016 sec 2024-03-28T07:29:05.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:05 smithi055 ceph-mon[31863]: pgmap v3711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:05 smithi086 ceph-mon[35163]: pgmap v3711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:05.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:05 smithi159 ceph-mon[36109]: pgmap v3711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:05.952 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6017 sec 2024-03-28T07:29:06.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:06 smithi055 ceph-mon[31863]: pgmap v3712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:06 smithi086 ceph-mon[35163]: pgmap v3712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:06.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:06 smithi159 ceph-mon[36109]: pgmap v3712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:06.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6018 sec 2024-03-28T07:29:07.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6019 sec 2024-03-28T07:29:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5347.878770 secs 2024-03-28T07:29:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:08 smithi086 ceph-mon[35163]: pgmap v3713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5347.878770 secs 2024-03-28T07:29:08.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:08 smithi159 ceph-mon[36109]: pgmap v3713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5347.878770 secs 2024-03-28T07:29:08.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:08 smithi055 ceph-mon[31863]: pgmap v3713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:08.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6020 sec 2024-03-28T07:29:09.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6021 sec 2024-03-28T07:29:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:10 smithi086 ceph-mon[35163]: pgmap v3714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:10.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:10 smithi159 ceph-mon[36109]: pgmap v3714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:10.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:10 smithi055 ceph-mon[31863]: pgmap v3714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:10.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6022 sec 2024-03-28T07:29:11.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6023 sec 2024-03-28T07:29:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:12 smithi086 ceph-mon[35163]: pgmap v3715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:12.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:12 smithi159 ceph-mon[36109]: pgmap v3715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:12.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:12 smithi055 ceph-mon[31863]: pgmap v3715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:12.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6024 sec 2024-03-28T07:29:13.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5352.878846 secs 2024-03-28T07:29:13.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6025 sec 2024-03-28T07:29:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5352.878846 secs 2024-03-28T07:29:14.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5352.878846 secs 2024-03-28T07:29:14.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:14 smithi055 ceph-mon[31863]: pgmap v3716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:14.953 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6026 sec 2024-03-28T07:29:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:14 smithi086 ceph-mon[35163]: pgmap v3716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:14 smithi159 ceph-mon[36109]: pgmap v3716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:15.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6027 sec 2024-03-28T07:29:16.873 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:16 smithi086 ceph-mon[35163]: pgmap v3717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:16.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:16 smithi055 ceph-mon[31863]: pgmap v3717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:16.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6028 sec 2024-03-28T07:29:17.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:16 smithi159 ceph-mon[36109]: pgmap v3717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:17.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6029 sec 2024-03-28T07:29:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5357.878965 secs 2024-03-28T07:29:18.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:18 smithi055 ceph-mon[31863]: pgmap v3718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:18.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6030 sec 2024-03-28T07:29:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5357.878965 secs 2024-03-28T07:29:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:18 smithi086 ceph-mon[35163]: pgmap v3718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5357.878965 secs 2024-03-28T07:29:19.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:18 smithi159 ceph-mon[36109]: pgmap v3718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:19.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6031 sec 2024-03-28T07:29:20.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:20 smithi055 ceph-mon[31863]: pgmap v3719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:20.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6032 sec 2024-03-28T07:29:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:20 smithi086 ceph-mon[35163]: pgmap v3719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:21.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:20 smithi159 ceph-mon[36109]: pgmap v3719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:21.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6033 sec 2024-03-28T07:29:22.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:22 smithi055 ceph-mon[31863]: pgmap v3720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:22.954 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6034 sec 2024-03-28T07:29:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:22 smithi086 ceph-mon[35163]: pgmap v3720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:23.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:22 smithi159 ceph-mon[36109]: pgmap v3720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:23.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5362.879088 secs 2024-03-28T07:29:23.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6035 sec 2024-03-28T07:29:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5362.879088 secs 2024-03-28T07:29:24.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5362.879088 secs 2024-03-28T07:29:24.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:24 smithi055 ceph-mon[31863]: pgmap v3721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:24.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6036 sec 2024-03-28T07:29:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:24 smithi086 ceph-mon[35163]: pgmap v3721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:25.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:24 smithi159 ceph-mon[36109]: pgmap v3721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:25.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6037 sec 2024-03-28T07:29:26.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6038 sec 2024-03-28T07:29:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:26 smithi086 ceph-mon[35163]: pgmap v3722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:27.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:26 smithi159 ceph-mon[36109]: pgmap v3722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:27.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:26 smithi055 ceph-mon[31863]: pgmap v3722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:27.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6039 sec 2024-03-28T07:29:28.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6040 sec 2024-03-28T07:29:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5367.879207 secs 2024-03-28T07:29:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:28 smithi086 ceph-mon[35163]: pgmap v3723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5367.879207 secs 2024-03-28T07:29:29.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:28 smithi159 ceph-mon[36109]: pgmap v3723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5367.879207 secs 2024-03-28T07:29:29.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:28 smithi055 ceph-mon[31863]: pgmap v3723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:29.955 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6041 sec 2024-03-28T07:29:30.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6042 sec 2024-03-28T07:29:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:30 smithi086 ceph-mon[35163]: pgmap v3724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:31.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:30 smithi159 ceph-mon[36109]: pgmap v3724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:30 smithi055 ceph-mon[31863]: pgmap v3724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:31.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6043 sec 2024-03-28T07:29:32.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6044 sec 2024-03-28T07:29:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:32 smithi086 ceph-mon[35163]: pgmap v3725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:33.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:32 smithi159 ceph-mon[36109]: pgmap v3725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:32 smithi055 ceph-mon[31863]: pgmap v3725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:33.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6045 sec 2024-03-28T07:29:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5372.879329 secs 2024-03-28T07:29:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5372.879329 secs 2024-03-28T07:29:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5372.879329 secs 2024-03-28T07:29:34.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6046 sec 2024-03-28T07:29:34.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:34 smithi159 ceph-mon[36109]: pgmap v3726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:34 smithi086 ceph-mon[35163]: pgmap v3726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:34 smithi055 ceph-mon[31863]: pgmap v3726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:35.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6047 sec 2024-03-28T07:29:36.956 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6048 sec 2024-03-28T07:29:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:36 smithi086 ceph-mon[35163]: pgmap v3727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:37.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:36 smithi159 ceph-mon[36109]: pgmap v3727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:36 smithi055 ceph-mon[31863]: pgmap v3727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:37.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6049 sec 2024-03-28T07:29:38.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6050 sec 2024-03-28T07:29:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5377.879407 secs 2024-03-28T07:29:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:38 smithi086 ceph-mon[35163]: pgmap v3728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5377.879407 secs 2024-03-28T07:29:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:38 smithi159 ceph-mon[36109]: pgmap v3728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5377.879407 secs 2024-03-28T07:29:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:38 smithi055 ceph-mon[31863]: pgmap v3728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:39.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6051 sec 2024-03-28T07:29:40.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6052 sec 2024-03-28T07:29:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:40 smithi086 ceph-mon[35163]: pgmap v3729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:41.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:40 smithi159 ceph-mon[36109]: pgmap v3729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:40 smithi055 ceph-mon[31863]: pgmap v3729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:41.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6053 sec 2024-03-28T07:29:42.957 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6054 sec 2024-03-28T07:29:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:42 smithi086 ceph-mon[35163]: pgmap v3730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:43.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:42 smithi159 ceph-mon[36109]: pgmap v3730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:43.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:42 smithi055 ceph-mon[31863]: pgmap v3730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:43.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6055 sec 2024-03-28T07:29:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5382.879526 secs 2024-03-28T07:29:44.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5382.879526 secs 2024-03-28T07:29:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5382.879526 secs 2024-03-28T07:29:44.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6056 sec 2024-03-28T07:29:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:44 smithi086 ceph-mon[35163]: pgmap v3731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:44 smithi159 ceph-mon[36109]: pgmap v3731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:44 smithi055 ceph-mon[31863]: pgmap v3731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:45.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6057 sec 2024-03-28T07:29:46.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6058 sec 2024-03-28T07:29:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:46 smithi086 ceph-mon[35163]: pgmap v3732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:47.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:46 smithi159 ceph-mon[36109]: pgmap v3732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:46 smithi055 ceph-mon[31863]: pgmap v3732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:47.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6059 sec 2024-03-28T07:29:48.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6060 sec 2024-03-28T07:29:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5387.879586 secs 2024-03-28T07:29:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:48 smithi086 ceph-mon[35163]: pgmap v3733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5387.879586 secs 2024-03-28T07:29:49.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:48 smithi159 ceph-mon[36109]: pgmap v3733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5387.879586 secs 2024-03-28T07:29:49.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:48 smithi055 ceph-mon[31863]: pgmap v3733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:49.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6061 sec 2024-03-28T07:29:50.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6062 sec 2024-03-28T07:29:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:50 smithi086 ceph-mon[35163]: pgmap v3734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:51.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:50 smithi159 ceph-mon[36109]: pgmap v3734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:50 smithi055 ceph-mon[31863]: pgmap v3734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:51.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6063 sec 2024-03-28T07:29:52.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6064 sec 2024-03-28T07:29:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:52 smithi086 ceph-mon[35163]: pgmap v3735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:29:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:52 smithi159 ceph-mon[36109]: pgmap v3735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:29:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:52 smithi055 ceph-mon[31863]: pgmap v3735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:53.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:29:53.958 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6065 sec 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5392.879711 secs 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5392.879711 secs 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5392.879711 secs 2024-03-28T07:29:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:54.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6066 sec 2024-03-28T07:29:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:54 smithi055 ceph-mon[31863]: pgmap v3736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:54 smithi086 ceph-mon[35163]: pgmap v3736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:54 smithi159 ceph-mon[36109]: pgmap v3736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:29:55.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6067 sec 2024-03-28T07:29:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:56.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6068 sec 2024-03-28T07:29:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:56 smithi086 ceph-mon[35163]: pgmap v3737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:56 smithi159 ceph-mon[36109]: pgmap v3737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:56 smithi055 ceph-mon[31863]: pgmap v3737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:29:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:57.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6069 sec 2024-03-28T07:29:58.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6070 sec 2024-03-28T07:29:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5397.879772 secs 2024-03-28T07:29:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: pgmap v3738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:29:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:29:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: pgmap v3739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:29:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: pgmap v3740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:29:59.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:29:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5397.879772 secs 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: pgmap v3738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: pgmap v3739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:29:59.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: pgmap v3740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:29:59.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:29:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5397.879772 secs 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: pgmap v3738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: pgmap v3739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:29:59.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: pgmap v3740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:29:59.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:29:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:29:59.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6071 sec 2024-03-28T07:30:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:30:00.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:30:00.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:30:00.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6072 sec 2024-03-28T07:30:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:01 smithi086 ceph-mon[35163]: pgmap v3741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:01.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:01 smithi159 ceph-mon[36109]: pgmap v3741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:01 smithi055 ceph-mon[31863]: pgmap v3741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:01.959 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6073 sec 2024-03-28T07:30:02.960 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6074 sec 2024-03-28T07:30:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:03 smithi086 ceph-mon[35163]: pgmap v3742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:03 smithi159 ceph-mon[36109]: pgmap v3742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:03 smithi055 ceph-mon[31863]: pgmap v3742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:30:03.960 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6075 sec 2024-03-28T07:30:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5402.879895 secs 2024-03-28T07:30:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5402.879895 secs 2024-03-28T07:30:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5402.879895 secs 2024-03-28T07:30:04.960 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6076 sec 2024-03-28T07:30:05.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:05 smithi055 ceph-mon[31863]: pgmap v3743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:30:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:05 smithi086 ceph-mon[35163]: pgmap v3743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:30:05.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:05 smithi159 ceph-mon[36109]: pgmap v3743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:30:05.960 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6077 sec 2024-03-28T07:30:06.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6078 sec 2024-03-28T07:30:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:07 smithi055 ceph-mon[31863]: pgmap v3744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:30:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:07 smithi086 ceph-mon[35163]: pgmap v3744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:30:07.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:07 smithi159 ceph-mon[36109]: pgmap v3744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:30:07.960 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6079 sec 2024-03-28T07:30:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:08 smithi086 ceph-mon[35163]: pgmap v3745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:30:08.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:08 smithi159 ceph-mon[36109]: pgmap v3745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:30:08.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:08 smithi055 ceph-mon[31863]: pgmap v3745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:30:08.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6080 sec 2024-03-28T07:30:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5407.880015 secs 2024-03-28T07:30:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5407.880015 secs 2024-03-28T07:30:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5407.880015 secs 2024-03-28T07:30:09.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6081 sec 2024-03-28T07:30:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:10 smithi086 ceph-mon[35163]: pgmap v3746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:10 smithi159 ceph-mon[36109]: pgmap v3746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:10.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:10 smithi055 ceph-mon[31863]: pgmap v3746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:10.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6082 sec 2024-03-28T07:30:11.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6083 sec 2024-03-28T07:30:12.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6084 sec 2024-03-28T07:30:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:12 smithi086 ceph-mon[35163]: pgmap v3747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:13.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:12 smithi159 ceph-mon[36109]: pgmap v3747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:12 smithi055 ceph-mon[31863]: pgmap v3747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:13.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6085 sec 2024-03-28T07:30:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5412.880099 secs 2024-03-28T07:30:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5412.880099 secs 2024-03-28T07:30:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5412.880099 secs 2024-03-28T07:30:14.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6086 sec 2024-03-28T07:30:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:14 smithi086 ceph-mon[35163]: pgmap v3748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:15.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:14 smithi159 ceph-mon[36109]: pgmap v3748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:15.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:14 smithi055 ceph-mon[31863]: pgmap v3748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:15.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6087 sec 2024-03-28T07:30:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:16 smithi086 ceph-mon[35163]: pgmap v3749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:16.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:16 smithi159 ceph-mon[36109]: pgmap v3749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:16.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:16 smithi055 ceph-mon[31863]: pgmap v3749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:16.961 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6088 sec 2024-03-28T07:30:17.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6089 sec 2024-03-28T07:30:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:18 smithi086 ceph-mon[35163]: pgmap v3750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:18.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:18 smithi159 ceph-mon[36109]: pgmap v3750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:18.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:18 smithi055 ceph-mon[31863]: pgmap v3750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:18.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6090 sec 2024-03-28T07:30:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5417.880177 secs 2024-03-28T07:30:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5417.880177 secs 2024-03-28T07:30:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5417.880177 secs 2024-03-28T07:30:19.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6091 sec 2024-03-28T07:30:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:20 smithi086 ceph-mon[35163]: pgmap v3751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:20.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:20 smithi159 ceph-mon[36109]: pgmap v3751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:20.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:20 smithi055 ceph-mon[31863]: pgmap v3751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:20.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6092 sec 2024-03-28T07:30:21.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6093 sec 2024-03-28T07:30:22.428 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:22 smithi055 ceph-mon[31863]: pgmap v3752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:22 smithi086 ceph-mon[35163]: pgmap v3752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:22.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:22 smithi159 ceph-mon[36109]: pgmap v3752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:22.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6094 sec 2024-03-28T07:30:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5422.880252 secs 2024-03-28T07:30:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5422.880252 secs 2024-03-28T07:30:23.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5422.880252 secs 2024-03-28T07:30:23.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6095 sec 2024-03-28T07:30:24.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:24 smithi055 ceph-mon[31863]: pgmap v3753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:24 smithi086 ceph-mon[35163]: pgmap v3753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:24.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:24 smithi159 ceph-mon[36109]: pgmap v3753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:24.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6096 sec 2024-03-28T07:30:25.962 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6097 sec 2024-03-28T07:30:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:26 smithi086 ceph-mon[35163]: pgmap v3754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:26.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:26 smithi159 ceph-mon[36109]: pgmap v3754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:26.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:26 smithi055 ceph-mon[31863]: pgmap v3754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:26.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6098 sec 2024-03-28T07:30:27.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6099 sec 2024-03-28T07:30:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:28 smithi086 ceph-mon[35163]: pgmap v3755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:28.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:28 smithi159 ceph-mon[36109]: pgmap v3755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:28.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:28 smithi055 ceph-mon[31863]: pgmap v3755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:28.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6100 sec 2024-03-28T07:30:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5427.880367 secs 2024-03-28T07:30:29.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5427.880367 secs 2024-03-28T07:30:29.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5427.880367 secs 2024-03-28T07:30:29.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6101 sec 2024-03-28T07:30:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:30 smithi086 ceph-mon[35163]: pgmap v3756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:30 smithi159 ceph-mon[36109]: pgmap v3756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:30 smithi055 ceph-mon[31863]: pgmap v3756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:30.963 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6102 sec 2024-03-28T07:30:31.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6103 sec 2024-03-28T07:30:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:32 smithi086 ceph-mon[35163]: pgmap v3757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:32.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:32 smithi159 ceph-mon[36109]: pgmap v3757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:32.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:32 smithi055 ceph-mon[31863]: pgmap v3757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:32.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6104 sec 2024-03-28T07:30:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5432.880430 secs 2024-03-28T07:30:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5432.880430 secs 2024-03-28T07:30:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5432.880430 secs 2024-03-28T07:30:33.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6105 sec 2024-03-28T07:30:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:34 smithi055 ceph-mon[31863]: pgmap v3758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:34 smithi086 ceph-mon[35163]: pgmap v3758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:34 smithi159 ceph-mon[36109]: pgmap v3758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:34.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6106 sec 2024-03-28T07:30:35.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6107 sec 2024-03-28T07:30:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:36 smithi086 ceph-mon[35163]: pgmap v3759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:36.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:36 smithi159 ceph-mon[36109]: pgmap v3759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:36.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:36 smithi055 ceph-mon[31863]: pgmap v3759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:36.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6108 sec 2024-03-28T07:30:37.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6109 sec 2024-03-28T07:30:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:38 smithi086 ceph-mon[35163]: pgmap v3760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:38.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:38 smithi159 ceph-mon[36109]: pgmap v3760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:38.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:38 smithi055 ceph-mon[31863]: pgmap v3760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:38.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6110 sec 2024-03-28T07:30:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5437.880490 secs 2024-03-28T07:30:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5437.880490 secs 2024-03-28T07:30:39.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5437.880490 secs 2024-03-28T07:30:39.964 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6111 sec 2024-03-28T07:30:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:40 smithi086 ceph-mon[35163]: pgmap v3761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:40.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:40 smithi159 ceph-mon[36109]: pgmap v3761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:40.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:40 smithi055 ceph-mon[31863]: pgmap v3761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:40.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6112 sec 2024-03-28T07:30:41.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6113 sec 2024-03-28T07:30:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:42 smithi086 ceph-mon[35163]: pgmap v3762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:42.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:42 smithi159 ceph-mon[36109]: pgmap v3762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:42.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:42 smithi055 ceph-mon[31863]: pgmap v3762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:42.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6114 sec 2024-03-28T07:30:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5442.880565 secs 2024-03-28T07:30:43.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5442.880565 secs 2024-03-28T07:30:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5442.880565 secs 2024-03-28T07:30:43.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6115 sec 2024-03-28T07:30:44.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:44 smithi055 ceph-mon[31863]: pgmap v3763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:44 smithi086 ceph-mon[35163]: pgmap v3763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:44.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:44 smithi159 ceph-mon[36109]: pgmap v3763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:44.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6116 sec 2024-03-28T07:30:45.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6117 sec 2024-03-28T07:30:46.512 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:46 smithi159 ceph-mon[36109]: pgmap v3764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:46 smithi086 ceph-mon[35163]: pgmap v3764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:46.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:46 smithi055 ceph-mon[31863]: pgmap v3764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:46.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6118 sec 2024-03-28T07:30:47.965 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6119 sec 2024-03-28T07:30:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:48 smithi086 ceph-mon[35163]: pgmap v3765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:48.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:48 smithi159 ceph-mon[36109]: pgmap v3765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:48.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:48 smithi055 ceph-mon[31863]: pgmap v3765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:48.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6120 sec 2024-03-28T07:30:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5447.880687 secs 2024-03-28T07:30:49.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5447.880687 secs 2024-03-28T07:30:49.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5447.880687 secs 2024-03-28T07:30:49.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6121 sec 2024-03-28T07:30:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:50 smithi086 ceph-mon[35163]: pgmap v3766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:50.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:50 smithi159 ceph-mon[36109]: pgmap v3766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:50.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:50 smithi055 ceph-mon[31863]: pgmap v3766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:30:50.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6122 sec 2024-03-28T07:30:51.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6123 sec 2024-03-28T07:30:52.428 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:52 smithi055 ceph-mon[31863]: pgmap v3767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:52 smithi086 ceph-mon[35163]: pgmap v3767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:52.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:52 smithi159 ceph-mon[36109]: pgmap v3767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:52.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6124 sec 2024-03-28T07:30:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5452.880814 secs 2024-03-28T07:30:53.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5452.880814 secs 2024-03-28T07:30:53.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5452.880814 secs 2024-03-28T07:30:53.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6125 sec 2024-03-28T07:30:54.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:54 smithi055 ceph-mon[31863]: pgmap v3768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:54 smithi086 ceph-mon[35163]: pgmap v3768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:54.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:54 smithi159 ceph-mon[36109]: pgmap v3768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:54.966 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6126 sec 2024-03-28T07:30:55.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6127 sec 2024-03-28T07:30:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:56 smithi086 ceph-mon[35163]: pgmap v3769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:56.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:56 smithi159 ceph-mon[36109]: pgmap v3769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:56.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:56 smithi055 ceph-mon[31863]: pgmap v3769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:56.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6128 sec 2024-03-28T07:30:57.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6129 sec 2024-03-28T07:30:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:58 smithi086 ceph-mon[35163]: pgmap v3770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:58.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:58 smithi159 ceph-mon[36109]: pgmap v3770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:58 smithi055 ceph-mon[31863]: pgmap v3770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:30:58.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6130 sec 2024-03-28T07:30:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5457.880931 secs 2024-03-28T07:30:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:30:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:30:59.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5457.880931 secs 2024-03-28T07:30:59.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:30:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:30:59.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5457.880931 secs 2024-03-28T07:30:59.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:30:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:30:59.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6131 sec 2024-03-28T07:31:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:31:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:31:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:00 smithi086 ceph-mon[35163]: pgmap v3771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:00 smithi086 ceph-mon[35163]: pgmap v3772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:31:00.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:31:00.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:31:00.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:00 smithi159 ceph-mon[36109]: pgmap v3771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:00.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:00 smithi159 ceph-mon[36109]: pgmap v3772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:00.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:31:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:31:00.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:31:00.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:00 smithi055 ceph-mon[31863]: pgmap v3771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:00.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:00 smithi055 ceph-mon[31863]: pgmap v3772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:00.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:31:00.967 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6132 sec 2024-03-28T07:31:01.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6133 sec 2024-03-28T07:31:02.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6134 sec 2024-03-28T07:31:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:02 smithi086 ceph-mon[35163]: pgmap v3773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:02 smithi159 ceph-mon[36109]: pgmap v3773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:02 smithi055 ceph-mon[31863]: pgmap v3773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:03.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6135 sec 2024-03-28T07:31:04.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5462.881023 secs 2024-03-28T07:31:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5462.881023 secs 2024-03-28T07:31:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5462.881023 secs 2024-03-28T07:31:04.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6136 sec 2024-03-28T07:31:05.177 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:04 smithi055 ceph-mon[31863]: pgmap v3774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:04 smithi086 ceph-mon[35163]: pgmap v3774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:04 smithi159 ceph-mon[36109]: pgmap v3774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:05.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6137 sec 2024-03-28T07:31:06.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6138 sec 2024-03-28T07:31:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:06 smithi086 ceph-mon[35163]: pgmap v3775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:06 smithi159 ceph-mon[36109]: pgmap v3775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:06 smithi055 ceph-mon[31863]: pgmap v3775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:31:07.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6139 sec 2024-03-28T07:31:08.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6140 sec 2024-03-28T07:31:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5467.881140 secs 2024-03-28T07:31:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:08 smithi086 ceph-mon[35163]: pgmap v3776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:31:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5467.881140 secs 2024-03-28T07:31:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:08 smithi159 ceph-mon[36109]: pgmap v3776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:31:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5467.881140 secs 2024-03-28T07:31:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:08 smithi055 ceph-mon[31863]: pgmap v3776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:31:09.968 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6141 sec 2024-03-28T07:31:10.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6142 sec 2024-03-28T07:31:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:10 smithi086 ceph-mon[35163]: pgmap v3777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:31:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:10 smithi159 ceph-mon[36109]: pgmap v3777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:31:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:10 smithi055 ceph-mon[31863]: pgmap v3777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:31:11.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6143 sec 2024-03-28T07:31:12.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6144 sec 2024-03-28T07:31:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:12 smithi086 ceph-mon[35163]: pgmap v3778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:12 smithi159 ceph-mon[36109]: pgmap v3778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:12 smithi055 ceph-mon[31863]: pgmap v3778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:13.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6145 sec 2024-03-28T07:31:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5472.881228 secs 2024-03-28T07:31:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5472.881228 secs 2024-03-28T07:31:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5472.881228 secs 2024-03-28T07:31:14.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6146 sec 2024-03-28T07:31:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:14 smithi086 ceph-mon[35163]: pgmap v3779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:14 smithi159 ceph-mon[36109]: pgmap v3779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:14 smithi055 ceph-mon[31863]: pgmap v3779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:15.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6147 sec 2024-03-28T07:31:16.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6148 sec 2024-03-28T07:31:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:16 smithi086 ceph-mon[35163]: pgmap v3780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:16 smithi159 ceph-mon[36109]: pgmap v3780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:16 smithi055 ceph-mon[31863]: pgmap v3780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:17.969 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6149 sec 2024-03-28T07:31:18.970 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6150 sec 2024-03-28T07:31:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5477.881354 secs 2024-03-28T07:31:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:18 smithi086 ceph-mon[35163]: pgmap v3781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5477.881354 secs 2024-03-28T07:31:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:18 smithi159 ceph-mon[36109]: pgmap v3781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5477.881354 secs 2024-03-28T07:31:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:18 smithi055 ceph-mon[31863]: pgmap v3781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:19.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6151 sec 2024-03-28T07:31:20.970 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6152 sec 2024-03-28T07:31:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:20 smithi086 ceph-mon[35163]: pgmap v3782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:21.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:20 smithi159 ceph-mon[36109]: pgmap v3782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:20 smithi055 ceph-mon[31863]: pgmap v3782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:21.970 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6153 sec 2024-03-28T07:31:22.970 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6154 sec 2024-03-28T07:31:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:23 smithi086 ceph-mon[35163]: pgmap v3783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:23.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:23 smithi159 ceph-mon[36109]: pgmap v3783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:23.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:23 smithi055 ceph-mon[31863]: pgmap v3783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:23.970 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6155 sec 2024-03-28T07:31:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5482.881475 secs 2024-03-28T07:31:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5482.881475 secs 2024-03-28T07:31:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5482.881475 secs 2024-03-28T07:31:24.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6156 sec 2024-03-28T07:31:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:25 smithi086 ceph-mon[35163]: pgmap v3784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:25.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:25 smithi159 ceph-mon[36109]: pgmap v3784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:25.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:25 smithi055 ceph-mon[31863]: pgmap v3784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:25.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6157 sec 2024-03-28T07:31:26.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6158 sec 2024-03-28T07:31:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:27 smithi086 ceph-mon[35163]: pgmap v3785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:27.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:27 smithi159 ceph-mon[36109]: pgmap v3785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:27.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:27 smithi055 ceph-mon[31863]: pgmap v3785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:27.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6159 sec 2024-03-28T07:31:28.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6160 sec 2024-03-28T07:31:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5487.881595 secs 2024-03-28T07:31:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:29 smithi086 ceph-mon[35163]: pgmap v3786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5487.881595 secs 2024-03-28T07:31:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:29 smithi159 ceph-mon[36109]: pgmap v3786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5487.881595 secs 2024-03-28T07:31:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:29 smithi055 ceph-mon[31863]: pgmap v3786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:29.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6161 sec 2024-03-28T07:31:30.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6162 sec 2024-03-28T07:31:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:31 smithi086 ceph-mon[35163]: pgmap v3787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:31.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:31 smithi159 ceph-mon[36109]: pgmap v3787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:31.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:31 smithi055 ceph-mon[31863]: pgmap v3787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:31.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6163 sec 2024-03-28T07:31:32.971 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6164 sec 2024-03-28T07:31:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:33 smithi086 ceph-mon[35163]: pgmap v3788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:33 smithi159 ceph-mon[36109]: pgmap v3788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:33 smithi055 ceph-mon[31863]: pgmap v3788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:33.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6165 sec 2024-03-28T07:31:34.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5492.881703 secs 2024-03-28T07:31:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5492.881703 secs 2024-03-28T07:31:34.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5492.881703 secs 2024-03-28T07:31:34.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6166 sec 2024-03-28T07:31:35.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:35 smithi055 ceph-mon[31863]: pgmap v3789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:35 smithi086 ceph-mon[35163]: pgmap v3789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:35 smithi159 ceph-mon[36109]: pgmap v3789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:35.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6167 sec 2024-03-28T07:31:36.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6168 sec 2024-03-28T07:31:37.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:37 smithi055 ceph-mon[31863]: pgmap v3790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:37 smithi086 ceph-mon[35163]: pgmap v3790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:37.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:37 smithi159 ceph-mon[36109]: pgmap v3790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:37.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6169 sec 2024-03-28T07:31:38.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6170 sec 2024-03-28T07:31:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5497.881762 secs 2024-03-28T07:31:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:39 smithi055 ceph-mon[31863]: pgmap v3791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5497.881762 secs 2024-03-28T07:31:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:39 smithi086 ceph-mon[35163]: pgmap v3791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5497.881762 secs 2024-03-28T07:31:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:39 smithi159 ceph-mon[36109]: pgmap v3791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:39.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6171 sec 2024-03-28T07:31:40.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6172 sec 2024-03-28T07:31:41.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:41 smithi055 ceph-mon[31863]: pgmap v3792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:41 smithi086 ceph-mon[35163]: pgmap v3792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:41.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:41 smithi159 ceph-mon[36109]: pgmap v3792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:41.972 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6173 sec 2024-03-28T07:31:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:42 smithi086 ceph-mon[35163]: pgmap v3793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:42.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:42 smithi159 ceph-mon[36109]: pgmap v3793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:42.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:42 smithi055 ceph-mon[31863]: pgmap v3793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:42.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6174 sec 2024-03-28T07:31:43.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5502.881870 secs 2024-03-28T07:31:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5502.881870 secs 2024-03-28T07:31:43.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5502.881870 secs 2024-03-28T07:31:43.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6175 sec 2024-03-28T07:31:44.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:44 smithi055 ceph-mon[31863]: pgmap v3794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:44 smithi086 ceph-mon[35163]: pgmap v3794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:44.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:44 smithi159 ceph-mon[36109]: pgmap v3794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:44.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6176 sec 2024-03-28T07:31:45.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6177 sec 2024-03-28T07:31:46.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6178 sec 2024-03-28T07:31:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:46 smithi086 ceph-mon[35163]: pgmap v3795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:46 smithi159 ceph-mon[36109]: pgmap v3795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:46 smithi055 ceph-mon[31863]: pgmap v3795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:47.973 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6179 sec 2024-03-28T07:31:48.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6180 sec 2024-03-28T07:31:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5507.881987 secs 2024-03-28T07:31:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:48 smithi086 ceph-mon[35163]: pgmap v3796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5507.881987 secs 2024-03-28T07:31:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:48 smithi159 ceph-mon[36109]: pgmap v3796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5507.881987 secs 2024-03-28T07:31:49.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:48 smithi055 ceph-mon[31863]: pgmap v3796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:49.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6181 sec 2024-03-28T07:31:50.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6182 sec 2024-03-28T07:31:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:50 smithi086 ceph-mon[35163]: pgmap v3797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:50 smithi159 ceph-mon[36109]: pgmap v3797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:51.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:50 smithi055 ceph-mon[31863]: pgmap v3797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:31:51.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6183 sec 2024-03-28T07:31:52.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6184 sec 2024-03-28T07:31:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:52 smithi086 ceph-mon[35163]: pgmap v3798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:52 smithi159 ceph-mon[36109]: pgmap v3798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:52 smithi055 ceph-mon[31863]: pgmap v3798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:53.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6185 sec 2024-03-28T07:31:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5512.882110 secs 2024-03-28T07:31:54.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5512.882110 secs 2024-03-28T07:31:54.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5512.882110 secs 2024-03-28T07:31:54.974 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6186 sec 2024-03-28T07:31:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:54 smithi086 ceph-mon[35163]: pgmap v3799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:55.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:54 smithi159 ceph-mon[36109]: pgmap v3799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:55.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:54 smithi055 ceph-mon[31863]: pgmap v3799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:55.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6187 sec 2024-03-28T07:31:56.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6188 sec 2024-03-28T07:31:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:56 smithi086 ceph-mon[35163]: pgmap v3800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:57.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:56 smithi159 ceph-mon[36109]: pgmap v3800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:56 smithi055 ceph-mon[31863]: pgmap v3800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:57.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6189 sec 2024-03-28T07:31:58.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6190 sec 2024-03-28T07:31:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5517.882192 secs 2024-03-28T07:31:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:31:58 smithi086 ceph-mon[35163]: pgmap v3801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5517.882192 secs 2024-03-28T07:31:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:31:58 smithi159 ceph-mon[36109]: pgmap v3801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5517.882192 secs 2024-03-28T07:31:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:31:58 smithi055 ceph-mon[31863]: pgmap v3801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:31:59.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6191 sec 2024-03-28T07:32:00.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6192 sec 2024-03-28T07:32:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:00 smithi086 ceph-mon[35163]: pgmap v3802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:32:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:00 smithi159 ceph-mon[36109]: pgmap v3802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:01.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:32:01.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:00 smithi055 ceph-mon[31863]: pgmap v3802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:01.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:32:01.975 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6193 sec 2024-03-28T07:32:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:32:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:32:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:32:02.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:32:02.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:32:02.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:32:02.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:32:02.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:32:02.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:32:02.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6194 sec 2024-03-28T07:32:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:02 smithi086 ceph-mon[35163]: pgmap v3803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:02 smithi086 ceph-mon[35163]: pgmap v3804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:02 smithi159 ceph-mon[36109]: pgmap v3803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:02 smithi159 ceph-mon[36109]: pgmap v3804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:02 smithi055 ceph-mon[31863]: pgmap v3803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:02 smithi055 ceph-mon[31863]: pgmap v3804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:03.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6195 sec 2024-03-28T07:32:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5522.882316 secs 2024-03-28T07:32:04.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5522.882316 secs 2024-03-28T07:32:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5522.882316 secs 2024-03-28T07:32:04.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6196 sec 2024-03-28T07:32:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:05 smithi086 ceph-mon[35163]: pgmap v3805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:05 smithi159 ceph-mon[36109]: pgmap v3805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:05 smithi055 ceph-mon[31863]: pgmap v3805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:05.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6197 sec 2024-03-28T07:32:06.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6198 sec 2024-03-28T07:32:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:07 smithi086 ceph-mon[35163]: pgmap v3806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:07 smithi159 ceph-mon[36109]: pgmap v3806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:07 smithi055 ceph-mon[31863]: pgmap v3806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:07.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6199 sec 2024-03-28T07:32:08.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6200 sec 2024-03-28T07:32:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5527.882437 secs 2024-03-28T07:32:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:09 smithi086 ceph-mon[35163]: pgmap v3807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:32:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5527.882437 secs 2024-03-28T07:32:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:09 smithi159 ceph-mon[36109]: pgmap v3807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:32:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5527.882437 secs 2024-03-28T07:32:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:09 smithi055 ceph-mon[31863]: pgmap v3807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:32:09.976 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6201 sec 2024-03-28T07:32:10.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6202 sec 2024-03-28T07:32:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:11 smithi086 ceph-mon[35163]: pgmap v3808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:11 smithi159 ceph-mon[36109]: pgmap v3808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:11 smithi055 ceph-mon[31863]: pgmap v3808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:32:11.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6203 sec 2024-03-28T07:32:12.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6204 sec 2024-03-28T07:32:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:13 smithi086 ceph-mon[35163]: pgmap v3809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:13 smithi159 ceph-mon[36109]: pgmap v3809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:13 smithi055 ceph-mon[31863]: pgmap v3809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:13.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6205 sec 2024-03-28T07:32:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5532.882556 secs 2024-03-28T07:32:14.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5532.882556 secs 2024-03-28T07:32:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5532.882556 secs 2024-03-28T07:32:14.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6206 sec 2024-03-28T07:32:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:15 smithi086 ceph-mon[35163]: pgmap v3810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:15 smithi159 ceph-mon[36109]: pgmap v3810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:15.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:15 smithi055 ceph-mon[31863]: pgmap v3810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:15.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6207 sec 2024-03-28T07:32:16.977 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6208 sec 2024-03-28T07:32:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:17 smithi055 ceph-mon[31863]: pgmap v3811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:17 smithi086 ceph-mon[35163]: pgmap v3811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:17.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:17 smithi159 ceph-mon[36109]: pgmap v3811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:17.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6209 sec 2024-03-28T07:32:18.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6210 sec 2024-03-28T07:32:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5537.882632 secs 2024-03-28T07:32:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:19 smithi055 ceph-mon[31863]: pgmap v3812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5537.882632 secs 2024-03-28T07:32:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:19 smithi086 ceph-mon[35163]: pgmap v3812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5537.882632 secs 2024-03-28T07:32:19.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:19 smithi159 ceph-mon[36109]: pgmap v3812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:19.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6211 sec 2024-03-28T07:32:20.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6212 sec 2024-03-28T07:32:21.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:21 smithi055 ceph-mon[31863]: pgmap v3813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:21 smithi086 ceph-mon[35163]: pgmap v3813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:21.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:21 smithi159 ceph-mon[36109]: pgmap v3813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:21.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6213 sec 2024-03-28T07:32:22.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6214 sec 2024-03-28T07:32:23.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:23 smithi055 ceph-mon[31863]: pgmap v3814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:23 smithi086 ceph-mon[35163]: pgmap v3814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:23.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:23 smithi159 ceph-mon[36109]: pgmap v3814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:23.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6215 sec 2024-03-28T07:32:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5542.882672 secs 2024-03-28T07:32:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5542.882672 secs 2024-03-28T07:32:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5542.882672 secs 2024-03-28T07:32:24.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6216 sec 2024-03-28T07:32:25.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:25 smithi055 ceph-mon[31863]: pgmap v3815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:25 smithi086 ceph-mon[35163]: pgmap v3815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:25.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:25 smithi159 ceph-mon[36109]: pgmap v3815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:25.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6217 sec 2024-03-28T07:32:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:26 smithi086 ceph-mon[35163]: pgmap v3816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:26.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:26 smithi159 ceph-mon[36109]: pgmap v3816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:26.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:26 smithi055 ceph-mon[31863]: pgmap v3816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:26.978 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6218 sec 2024-03-28T07:32:27.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6219 sec 2024-03-28T07:32:28.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6220 sec 2024-03-28T07:32:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5547.882745 secs 2024-03-28T07:32:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:28 smithi086 ceph-mon[35163]: pgmap v3817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:32:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5547.882745 secs 2024-03-28T07:32:29.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:28 smithi159 ceph-mon[36109]: pgmap v3817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:32:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5547.882745 secs 2024-03-28T07:32:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:28 smithi055 ceph-mon[31863]: pgmap v3817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:32:29.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6221 sec 2024-03-28T07:32:30.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6222 sec 2024-03-28T07:32:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:30 smithi086 ceph-mon[35163]: pgmap v3818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:31.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:30 smithi159 ceph-mon[36109]: pgmap v3818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:31.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:30 smithi055 ceph-mon[31863]: pgmap v3818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:32:31.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6223 sec 2024-03-28T07:32:32.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6224 sec 2024-03-28T07:32:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:32 smithi086 ceph-mon[35163]: pgmap v3819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:32 smithi159 ceph-mon[36109]: pgmap v3819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:32 smithi055 ceph-mon[31863]: pgmap v3819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:33.979 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6225 sec 2024-03-28T07:32:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5552.882866 secs 2024-03-28T07:32:34.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5552.882866 secs 2024-03-28T07:32:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5552.882866 secs 2024-03-28T07:32:34.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6226 sec 2024-03-28T07:32:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:34 smithi086 ceph-mon[35163]: pgmap v3820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:34 smithi159 ceph-mon[36109]: pgmap v3820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:35.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:34 smithi055 ceph-mon[31863]: pgmap v3820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:35.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6227 sec 2024-03-28T07:32:36.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6228 sec 2024-03-28T07:32:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:36 smithi086 ceph-mon[35163]: pgmap v3821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:37.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:36 smithi159 ceph-mon[36109]: pgmap v3821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:37.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:36 smithi055 ceph-mon[31863]: pgmap v3821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:37.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6229 sec 2024-03-28T07:32:38.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6230 sec 2024-03-28T07:32:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5557.882982 secs 2024-03-28T07:32:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:38 smithi086 ceph-mon[35163]: pgmap v3822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5557.882982 secs 2024-03-28T07:32:39.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:38 smithi159 ceph-mon[36109]: pgmap v3822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5557.882982 secs 2024-03-28T07:32:39.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:38 smithi055 ceph-mon[31863]: pgmap v3822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:39.980 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6231 sec 2024-03-28T07:32:40.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6232 sec 2024-03-28T07:32:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:40 smithi086 ceph-mon[35163]: pgmap v3823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:41.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:40 smithi159 ceph-mon[36109]: pgmap v3823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:41.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:40 smithi055 ceph-mon[31863]: pgmap v3823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:41.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6233 sec 2024-03-28T07:32:42.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6234 sec 2024-03-28T07:32:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:42 smithi086 ceph-mon[35163]: pgmap v3824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:43.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:42 smithi159 ceph-mon[36109]: pgmap v3824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:43.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:42 smithi055 ceph-mon[31863]: pgmap v3824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:43.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6235 sec 2024-03-28T07:32:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5562.883048 secs 2024-03-28T07:32:44.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5562.883048 secs 2024-03-28T07:32:44.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5562.883048 secs 2024-03-28T07:32:44.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6236 sec 2024-03-28T07:32:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:44 smithi086 ceph-mon[35163]: pgmap v3825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:45.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:44 smithi159 ceph-mon[36109]: pgmap v3825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:45.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:44 smithi055 ceph-mon[31863]: pgmap v3825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:45.981 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6237 sec 2024-03-28T07:32:46.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6238 sec 2024-03-28T07:32:47.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:46 smithi055 ceph-mon[31863]: pgmap v3826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:46 smithi086 ceph-mon[35163]: pgmap v3826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:47.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:46 smithi159 ceph-mon[36109]: pgmap v3826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:47.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6239 sec 2024-03-28T07:32:48.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6240 sec 2024-03-28T07:32:49.122 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5567.883168 secs 2024-03-28T07:32:49.122 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:48 smithi086 ceph-mon[35163]: pgmap v3827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5567.883168 secs 2024-03-28T07:32:49.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:48 smithi055 ceph-mon[31863]: pgmap v3827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5567.883168 secs 2024-03-28T07:32:49.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:48 smithi159 ceph-mon[36109]: pgmap v3827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:49.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6241 sec 2024-03-28T07:32:50.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6242 sec 2024-03-28T07:32:51.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:50 smithi055 ceph-mon[31863]: pgmap v3828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:50 smithi086 ceph-mon[35163]: pgmap v3828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:51.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:50 smithi159 ceph-mon[36109]: pgmap v3828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:51.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6243 sec 2024-03-28T07:32:52.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6244 sec 2024-03-28T07:32:53.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:52 smithi055 ceph-mon[31863]: pgmap v3829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:52 smithi086 ceph-mon[35163]: pgmap v3829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:53.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:52 smithi159 ceph-mon[36109]: pgmap v3829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:53.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6245 sec 2024-03-28T07:32:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5572.883260 secs 2024-03-28T07:32:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5572.883260 secs 2024-03-28T07:32:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5572.883260 secs 2024-03-28T07:32:54.982 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6246 sec 2024-03-28T07:32:55.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:54 smithi055 ceph-mon[31863]: pgmap v3830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:54 smithi086 ceph-mon[35163]: pgmap v3830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:54 smithi159 ceph-mon[36109]: pgmap v3830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:32:55.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6247 sec 2024-03-28T07:32:56.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6248 sec 2024-03-28T07:32:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:56 smithi086 ceph-mon[35163]: pgmap v3831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:57.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:56 smithi159 ceph-mon[36109]: pgmap v3831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:56 smithi055 ceph-mon[31863]: pgmap v3831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:32:57.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6249 sec 2024-03-28T07:32:58.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6250 sec 2024-03-28T07:32:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5577.883336 secs 2024-03-28T07:32:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:32:58 smithi086 ceph-mon[35163]: pgmap v3832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5577.883336 secs 2024-03-28T07:32:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:32:58 smithi159 ceph-mon[36109]: pgmap v3832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5577.883336 secs 2024-03-28T07:32:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:32:58 smithi055 ceph-mon[31863]: pgmap v3832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:32:59.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6251 sec 2024-03-28T07:33:00.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6252 sec 2024-03-28T07:33:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:00 smithi086 ceph-mon[35163]: pgmap v3833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:00 smithi159 ceph-mon[36109]: pgmap v3833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:01.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:00 smithi055 ceph-mon[31863]: pgmap v3833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:01.983 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6253 sec 2024-03-28T07:33:02.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6254 sec 2024-03-28T07:33:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:02 smithi086 ceph-mon[35163]: pgmap v3834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:33:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:02 smithi159 ceph-mon[36109]: pgmap v3834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:03.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:33:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:02 smithi055 ceph-mon[31863]: pgmap v3834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:03.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:33:03.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6255 sec 2024-03-28T07:33:04.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5582.883452 secs 2024-03-28T07:33:04.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:33:04.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:33:04.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:33:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5582.883452 secs 2024-03-28T07:33:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:33:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:33:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:33:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5582.883452 secs 2024-03-28T07:33:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:33:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:33:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:33:04.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6256 sec 2024-03-28T07:33:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:04 smithi086 ceph-mon[35163]: pgmap v3835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:04 smithi086 ceph-mon[35163]: pgmap v3836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:04 smithi159 ceph-mon[36109]: pgmap v3835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:04 smithi159 ceph-mon[36109]: pgmap v3836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:04 smithi055 ceph-mon[31863]: pgmap v3835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:04 smithi055 ceph-mon[31863]: pgmap v3836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:05.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6257 sec 2024-03-28T07:33:06.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6258 sec 2024-03-28T07:33:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:06 smithi086 ceph-mon[35163]: pgmap v3837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:07.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:06 smithi159 ceph-mon[36109]: pgmap v3837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:06 smithi055 ceph-mon[31863]: pgmap v3837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:07.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6259 sec 2024-03-28T07:33:08.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6260 sec 2024-03-28T07:33:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:08 smithi086 ceph-mon[35163]: pgmap v3838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5587.883508 secs 2024-03-28T07:33:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:08 smithi159 ceph-mon[36109]: pgmap v3838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:09.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5587.883508 secs 2024-03-28T07:33:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:08 smithi055 ceph-mon[31863]: pgmap v3838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5587.883508 secs 2024-03-28T07:33:09.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6261 sec 2024-03-28T07:33:10.984 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6262 sec 2024-03-28T07:33:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:10 smithi086 ceph-mon[35163]: pgmap v3839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:11.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:10 smithi159 ceph-mon[36109]: pgmap v3839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:10 smithi055 ceph-mon[31863]: pgmap v3839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:11.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6263 sec 2024-03-28T07:33:12.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6264 sec 2024-03-28T07:33:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:12 smithi086 ceph-mon[35163]: pgmap v3840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:13.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:12 smithi159 ceph-mon[36109]: pgmap v3840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:13.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:12 smithi055 ceph-mon[31863]: pgmap v3840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:13.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6265 sec 2024-03-28T07:33:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5592.883600 secs 2024-03-28T07:33:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5592.883600 secs 2024-03-28T07:33:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5592.883600 secs 2024-03-28T07:33:14.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6266 sec 2024-03-28T07:33:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:14 smithi086 ceph-mon[35163]: pgmap v3841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:15.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:14 smithi159 ceph-mon[36109]: pgmap v3841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:14 smithi055 ceph-mon[31863]: pgmap v3841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:15.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6267 sec 2024-03-28T07:33:16.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6268 sec 2024-03-28T07:33:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:16 smithi086 ceph-mon[35163]: pgmap v3842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:16 smithi159 ceph-mon[36109]: pgmap v3842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:17.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:16 smithi055 ceph-mon[31863]: pgmap v3842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:17.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6269 sec 2024-03-28T07:33:18.985 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6270 sec 2024-03-28T07:33:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:18 smithi086 ceph-mon[35163]: pgmap v3843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:33:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5597.883720 secs 2024-03-28T07:33:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:18 smithi159 ceph-mon[36109]: pgmap v3843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:33:19.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5597.883720 secs 2024-03-28T07:33:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:18 smithi055 ceph-mon[31863]: pgmap v3843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:33:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5597.883720 secs 2024-03-28T07:33:19.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6271 sec 2024-03-28T07:33:20.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6272 sec 2024-03-28T07:33:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:20 smithi086 ceph-mon[35163]: pgmap v3844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:21.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:20 smithi159 ceph-mon[36109]: pgmap v3844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:20 smithi055 ceph-mon[31863]: pgmap v3844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:21.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6273 sec 2024-03-28T07:33:22.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6274 sec 2024-03-28T07:33:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:23 smithi086 ceph-mon[35163]: pgmap v3845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:23.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:23 smithi159 ceph-mon[36109]: pgmap v3845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:23.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:23 smithi055 ceph-mon[31863]: pgmap v3845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:23.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6275 sec 2024-03-28T07:33:24.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5602.883844 secs 2024-03-28T07:33:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5602.883844 secs 2024-03-28T07:33:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5602.883844 secs 2024-03-28T07:33:24.986 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6276 sec 2024-03-28T07:33:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:25 smithi086 ceph-mon[35163]: pgmap v3846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:25.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:25 smithi159 ceph-mon[36109]: pgmap v3846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:25 smithi055 ceph-mon[31863]: pgmap v3846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:33:25.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6277 sec 2024-03-28T07:33:26.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6278 sec 2024-03-28T07:33:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:27 smithi086 ceph-mon[35163]: pgmap v3847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:27.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:27 smithi159 ceph-mon[36109]: pgmap v3847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:27.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:27 smithi055 ceph-mon[31863]: pgmap v3847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:33:27.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6279 sec 2024-03-28T07:33:28.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6280 sec 2024-03-28T07:33:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:29 smithi086 ceph-mon[35163]: pgmap v3848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5607.883963 secs 2024-03-28T07:33:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:29 smithi159 ceph-mon[36109]: pgmap v3848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:29.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5607.883963 secs 2024-03-28T07:33:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:29 smithi055 ceph-mon[31863]: pgmap v3848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:29.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5607.883963 secs 2024-03-28T07:33:29.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6281 sec 2024-03-28T07:33:30.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6282 sec 2024-03-28T07:33:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:31 smithi086 ceph-mon[35163]: pgmap v3849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:31.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:31 smithi159 ceph-mon[36109]: pgmap v3849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:31.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:31 smithi055 ceph-mon[31863]: pgmap v3849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:31.987 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6283 sec 2024-03-28T07:33:32.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6284 sec 2024-03-28T07:33:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:33 smithi086 ceph-mon[35163]: pgmap v3850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:33 smithi159 ceph-mon[36109]: pgmap v3850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:33 smithi055 ceph-mon[31863]: pgmap v3850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:33.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6285 sec 2024-03-28T07:33:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5612.884084 secs 2024-03-28T07:33:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5612.884084 secs 2024-03-28T07:33:34.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5612.884084 secs 2024-03-28T07:33:34.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6286 sec 2024-03-28T07:33:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:35 smithi086 ceph-mon[35163]: pgmap v3851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:35.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:35 smithi159 ceph-mon[36109]: pgmap v3851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:35.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:35 smithi055 ceph-mon[31863]: pgmap v3851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:35.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6287 sec 2024-03-28T07:33:36.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6288 sec 2024-03-28T07:33:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:37 smithi086 ceph-mon[35163]: pgmap v3852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:37.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:37 smithi159 ceph-mon[36109]: pgmap v3852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:37.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:37 smithi055 ceph-mon[31863]: pgmap v3852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:37.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6289 sec 2024-03-28T07:33:38.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6290 sec 2024-03-28T07:33:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:39 smithi055 ceph-mon[31863]: pgmap v3853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:39.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5617.884167 secs 2024-03-28T07:33:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:39 smithi086 ceph-mon[35163]: pgmap v3853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5617.884167 secs 2024-03-28T07:33:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:39 smithi159 ceph-mon[36109]: pgmap v3853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:39.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5617.884167 secs 2024-03-28T07:33:39.988 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6291 sec 2024-03-28T07:33:40.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6292 sec 2024-03-28T07:33:41.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:41 smithi055 ceph-mon[31863]: pgmap v3854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:41 smithi086 ceph-mon[35163]: pgmap v3854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:41.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:41 smithi159 ceph-mon[36109]: pgmap v3854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:41.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6293 sec 2024-03-28T07:33:42.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6294 sec 2024-03-28T07:33:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:43 smithi055 ceph-mon[31863]: pgmap v3855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:43 smithi086 ceph-mon[35163]: pgmap v3855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:43.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:43 smithi159 ceph-mon[36109]: pgmap v3855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:43.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6295 sec 2024-03-28T07:33:44.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5622.884243 secs 2024-03-28T07:33:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5622.884243 secs 2024-03-28T07:33:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5622.884243 secs 2024-03-28T07:33:44.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6296 sec 2024-03-28T07:33:45.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:45 smithi055 ceph-mon[31863]: pgmap v3856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:45 smithi086 ceph-mon[35163]: pgmap v3856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:45.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:45 smithi159 ceph-mon[36109]: pgmap v3856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:45.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6297 sec 2024-03-28T07:33:46.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6298 sec 2024-03-28T07:33:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:47 smithi055 ceph-mon[31863]: pgmap v3857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:47 smithi086 ceph-mon[35163]: pgmap v3857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:47 smithi159 ceph-mon[36109]: pgmap v3857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:47.989 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6299 sec 2024-03-28T07:33:48.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6300 sec 2024-03-28T07:33:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:49 smithi086 ceph-mon[35163]: pgmap v3858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5627.884361 secs 2024-03-28T07:33:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:49 smithi159 ceph-mon[36109]: pgmap v3858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:49.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5627.884361 secs 2024-03-28T07:33:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:49 smithi055 ceph-mon[31863]: pgmap v3858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:49.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5627.884361 secs 2024-03-28T07:33:49.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6301 sec 2024-03-28T07:33:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:50 smithi086 ceph-mon[35163]: pgmap v3859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:50 smithi159 ceph-mon[36109]: pgmap v3859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:50.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:50 smithi055 ceph-mon[31863]: pgmap v3859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:50.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6302 sec 2024-03-28T07:33:51.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6303 sec 2024-03-28T07:33:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:52 smithi086 ceph-mon[35163]: pgmap v3860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:52 smithi159 ceph-mon[36109]: pgmap v3860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:52 smithi055 ceph-mon[31863]: pgmap v3860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:52.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6304 sec 2024-03-28T07:33:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5632.884438 secs 2024-03-28T07:33:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5632.884438 secs 2024-03-28T07:33:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5632.884438 secs 2024-03-28T07:33:53.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6305 sec 2024-03-28T07:33:54.778 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:54 smithi055 ceph-mon[31863]: pgmap v3861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:54 smithi086 ceph-mon[35163]: pgmap v3861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:54.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:54 smithi159 ceph-mon[36109]: pgmap v3861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:33:54.990 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6306 sec 2024-03-28T07:33:55.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6307 sec 2024-03-28T07:33:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:56 smithi086 ceph-mon[35163]: pgmap v3862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:56.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:56 smithi159 ceph-mon[36109]: pgmap v3862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:56 smithi055 ceph-mon[31863]: pgmap v3862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:33:56.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6308 sec 2024-03-28T07:33:57.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6309 sec 2024-03-28T07:33:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:58 smithi086 ceph-mon[35163]: pgmap v3863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5637.884523 secs 2024-03-28T07:33:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:58 smithi159 ceph-mon[36109]: pgmap v3863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:58.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5637.884523 secs 2024-03-28T07:33:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:58 smithi055 ceph-mon[31863]: pgmap v3863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:33:58.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5637.884523 secs 2024-03-28T07:33:58.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6310 sec 2024-03-28T07:33:59.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6311 sec 2024-03-28T07:34:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:00 smithi086 ceph-mon[35163]: pgmap v3864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:00.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:00 smithi159 ceph-mon[36109]: pgmap v3864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:00 smithi055 ceph-mon[31863]: pgmap v3864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:00.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6312 sec 2024-03-28T07:34:01.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6313 sec 2024-03-28T07:34:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:02 smithi086 ceph-mon[35163]: pgmap v3865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:02 smithi159 ceph-mon[36109]: pgmap v3865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:02 smithi055 ceph-mon[31863]: pgmap v3865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:02.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6314 sec 2024-03-28T07:34:03.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5642.884646 secs 2024-03-28T07:34:03.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6315 sec 2024-03-28T07:34:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5642.884646 secs 2024-03-28T07:34:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5642.884646 secs 2024-03-28T07:34:04.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:04 smithi055 ceph-mon[31863]: pgmap v3866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:04.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:34:04.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:04 smithi159 ceph-mon[36109]: pgmap v3866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:04.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:34:04.991 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6316 sec 2024-03-28T07:34:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:04 smithi086 ceph-mon[35163]: pgmap v3866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:34:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:34:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:34:05.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:34:05.992 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6317 sec 2024-03-28T07:34:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:34:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:34:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:34:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:34:06.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:34:06.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:34:06.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:06 smithi055 ceph-mon[31863]: pgmap v3867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:06.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:06 smithi055 ceph-mon[31863]: pgmap v3868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:34:06.992 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6318 sec 2024-03-28T07:34:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:06 smithi086 ceph-mon[35163]: pgmap v3867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:06 smithi086 ceph-mon[35163]: pgmap v3868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:34:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:06 smithi159 ceph-mon[36109]: pgmap v3867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:07.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:06 smithi159 ceph-mon[36109]: pgmap v3868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:34:07.992 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6319 sec 2024-03-28T07:34:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:08 smithi055 ceph-mon[31863]: pgmap v3869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:08.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5647.884707 secs 2024-03-28T07:34:08.992 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6320 sec 2024-03-28T07:34:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:08 smithi086 ceph-mon[35163]: pgmap v3869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5647.884707 secs 2024-03-28T07:34:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:08 smithi159 ceph-mon[36109]: pgmap v3869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5647.884707 secs 2024-03-28T07:34:09.992 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6321 sec 2024-03-28T07:34:10.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:10 smithi055 ceph-mon[31863]: pgmap v3870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:10.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6322 sec 2024-03-28T07:34:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:10 smithi086 ceph-mon[35163]: pgmap v3870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:10 smithi159 ceph-mon[36109]: pgmap v3870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:11.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6323 sec 2024-03-28T07:34:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:12 smithi055 ceph-mon[31863]: pgmap v3871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:12.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6324 sec 2024-03-28T07:34:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:12 smithi086 ceph-mon[35163]: pgmap v3871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:12 smithi159 ceph-mon[36109]: pgmap v3871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:13.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6325 sec 2024-03-28T07:34:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5652.884820 secs 2024-03-28T07:34:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5652.884820 secs 2024-03-28T07:34:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5652.884820 secs 2024-03-28T07:34:14.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6326 sec 2024-03-28T07:34:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:14 smithi086 ceph-mon[35163]: pgmap v3872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:15.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:14 smithi159 ceph-mon[36109]: pgmap v3872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:14 smithi055 ceph-mon[31863]: pgmap v3872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:15.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6327 sec 2024-03-28T07:34:16.993 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6328 sec 2024-03-28T07:34:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:16 smithi086 ceph-mon[35163]: pgmap v3873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:34:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:16 smithi159 ceph-mon[36109]: pgmap v3873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:34:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:16 smithi055 ceph-mon[31863]: pgmap v3873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:34:17.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6329 sec 2024-03-28T07:34:18.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6330 sec 2024-03-28T07:34:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:18 smithi086 ceph-mon[35163]: pgmap v3874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5657.884907 secs 2024-03-28T07:34:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:18 smithi159 ceph-mon[36109]: pgmap v3874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5657.884907 secs 2024-03-28T07:34:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:18 smithi055 ceph-mon[31863]: pgmap v3874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5657.884907 secs 2024-03-28T07:34:19.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6331 sec 2024-03-28T07:34:20.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6332 sec 2024-03-28T07:34:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:20 smithi086 ceph-mon[35163]: pgmap v3875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:20 smithi159 ceph-mon[36109]: pgmap v3875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:21.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:20 smithi055 ceph-mon[31863]: pgmap v3875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:21.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6333 sec 2024-03-28T07:34:22.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6334 sec 2024-03-28T07:34:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:22 smithi086 ceph-mon[35163]: pgmap v3876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:23.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:22 smithi159 ceph-mon[36109]: pgmap v3876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:22 smithi055 ceph-mon[31863]: pgmap v3876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:23.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6335 sec 2024-03-28T07:34:24.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5662.885014 secs 2024-03-28T07:34:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5662.885014 secs 2024-03-28T07:34:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5662.885014 secs 2024-03-28T07:34:24.994 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6336 sec 2024-03-28T07:34:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:24 smithi086 ceph-mon[35163]: pgmap v3877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:25.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:24 smithi159 ceph-mon[36109]: pgmap v3877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:24 smithi055 ceph-mon[31863]: pgmap v3877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:25.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6337 sec 2024-03-28T07:34:26.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6338 sec 2024-03-28T07:34:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:26 smithi086 ceph-mon[35163]: pgmap v3878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:26 smithi159 ceph-mon[36109]: pgmap v3878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:27.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:26 smithi055 ceph-mon[31863]: pgmap v3878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:27.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6339 sec 2024-03-28T07:34:28.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6340 sec 2024-03-28T07:34:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:28 smithi086 ceph-mon[35163]: pgmap v3879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5667.885134 secs 2024-03-28T07:34:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:28 smithi159 ceph-mon[36109]: pgmap v3879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5667.885134 secs 2024-03-28T07:34:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:28 smithi055 ceph-mon[31863]: pgmap v3879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5667.885134 secs 2024-03-28T07:34:29.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6341 sec 2024-03-28T07:34:30.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6342 sec 2024-03-28T07:34:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:30 smithi086 ceph-mon[35163]: pgmap v3880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:31.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:30 smithi159 ceph-mon[36109]: pgmap v3880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:31.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:30 smithi055 ceph-mon[31863]: pgmap v3880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:31.995 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6343 sec 2024-03-28T07:34:32.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6344 sec 2024-03-28T07:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:32 smithi086 ceph-mon[35163]: pgmap v3881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:32 smithi159 ceph-mon[36109]: pgmap v3881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:32 smithi055 ceph-mon[31863]: pgmap v3881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:33.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6345 sec 2024-03-28T07:34:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5672.885189 secs 2024-03-28T07:34:34.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5672.885189 secs 2024-03-28T07:34:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5672.885189 secs 2024-03-28T07:34:34.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6346 sec 2024-03-28T07:34:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:34 smithi086 ceph-mon[35163]: pgmap v3882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:35.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:34 smithi159 ceph-mon[36109]: pgmap v3882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:35.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:34 smithi055 ceph-mon[31863]: pgmap v3882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:35.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6347 sec 2024-03-28T07:34:36.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6348 sec 2024-03-28T07:34:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:36 smithi086 ceph-mon[35163]: pgmap v3883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:36 smithi159 ceph-mon[36109]: pgmap v3883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:36 smithi055 ceph-mon[31863]: pgmap v3883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:37.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6349 sec 2024-03-28T07:34:38.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6350 sec 2024-03-28T07:34:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:38 smithi086 ceph-mon[35163]: pgmap v3884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5677.885310 secs 2024-03-28T07:34:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:38 smithi159 ceph-mon[36109]: pgmap v3884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5677.885310 secs 2024-03-28T07:34:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:38 smithi055 ceph-mon[31863]: pgmap v3884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5677.885310 secs 2024-03-28T07:34:39.996 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6351 sec 2024-03-28T07:34:40.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6352 sec 2024-03-28T07:34:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:40 smithi086 ceph-mon[35163]: pgmap v3885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:41.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:40 smithi159 ceph-mon[36109]: pgmap v3885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:41.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:40 smithi055 ceph-mon[31863]: pgmap v3885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:41.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6353 sec 2024-03-28T07:34:42.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6354 sec 2024-03-28T07:34:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:42 smithi086 ceph-mon[35163]: pgmap v3886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:43.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:42 smithi159 ceph-mon[36109]: pgmap v3886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:43.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:42 smithi055 ceph-mon[31863]: pgmap v3886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:43.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6355 sec 2024-03-28T07:34:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5682.885384 secs 2024-03-28T07:34:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5682.885384 secs 2024-03-28T07:34:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5682.885384 secs 2024-03-28T07:34:44.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6356 sec 2024-03-28T07:34:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:44 smithi086 ceph-mon[35163]: pgmap v3887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:44 smithi159 ceph-mon[36109]: pgmap v3887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:44 smithi055 ceph-mon[31863]: pgmap v3887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:45.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6357 sec 2024-03-28T07:34:46.997 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6358 sec 2024-03-28T07:34:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:46 smithi086 ceph-mon[35163]: pgmap v3888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:47.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:46 smithi159 ceph-mon[36109]: pgmap v3888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:46 smithi055 ceph-mon[31863]: pgmap v3888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:47.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6359 sec 2024-03-28T07:34:48.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6360 sec 2024-03-28T07:34:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:48 smithi086 ceph-mon[35163]: pgmap v3889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5687.885505 secs 2024-03-28T07:34:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:48 smithi159 ceph-mon[36109]: pgmap v3889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5687.885505 secs 2024-03-28T07:34:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:48 smithi055 ceph-mon[31863]: pgmap v3889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5687.885505 secs 2024-03-28T07:34:49.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6361 sec 2024-03-28T07:34:50.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6362 sec 2024-03-28T07:34:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:50 smithi086 ceph-mon[35163]: pgmap v3890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:51.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:50 smithi159 ceph-mon[36109]: pgmap v3890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:50 smithi055 ceph-mon[31863]: pgmap v3890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:51.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6363 sec 2024-03-28T07:34:52.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6364 sec 2024-03-28T07:34:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:52 smithi086 ceph-mon[35163]: pgmap v3891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:52 smithi159 ceph-mon[36109]: pgmap v3891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:52 smithi055 ceph-mon[31863]: pgmap v3891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:53.998 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6365 sec 2024-03-28T07:34:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5692.885625 secs 2024-03-28T07:34:54.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5692.885625 secs 2024-03-28T07:34:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5692.885625 secs 2024-03-28T07:34:54.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6366 sec 2024-03-28T07:34:55.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:54 smithi055 ceph-mon[31863]: pgmap v3892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:54 smithi086 ceph-mon[35163]: pgmap v3892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:54 smithi159 ceph-mon[36109]: pgmap v3892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:55.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6367 sec 2024-03-28T07:34:56.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6368 sec 2024-03-28T07:34:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:56 smithi055 ceph-mon[31863]: pgmap v3893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:56 smithi086 ceph-mon[35163]: pgmap v3893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:56 smithi159 ceph-mon[36109]: pgmap v3893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:34:57.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6369 sec 2024-03-28T07:34:58.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6370 sec 2024-03-28T07:34:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:58 smithi055 ceph-mon[31863]: pgmap v3894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:34:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5697.885744 secs 2024-03-28T07:34:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:58 smithi086 ceph-mon[35163]: pgmap v3894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:34:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5697.885744 secs 2024-03-28T07:34:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:58 smithi159 ceph-mon[36109]: pgmap v3894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:34:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:34:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5697.885744 secs 2024-03-28T07:34:59.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6371 sec 2024-03-28T07:35:00.999 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6372 sec 2024-03-28T07:35:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:00 smithi055 ceph-mon[31863]: pgmap v3895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:00 smithi086 ceph-mon[35163]: pgmap v3895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:00 smithi159 ceph-mon[36109]: pgmap v3895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:02.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6373 sec 2024-03-28T07:35:03.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6374 sec 2024-03-28T07:35:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:02 smithi055 ceph-mon[31863]: pgmap v3896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:02 smithi086 ceph-mon[35163]: pgmap v3896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:02 smithi159 ceph-mon[36109]: pgmap v3896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:04.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6375 sec 2024-03-28T07:35:04.223 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5702.885814 secs 2024-03-28T07:35:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5702.885814 secs 2024-03-28T07:35:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5702.885814 secs 2024-03-28T07:35:05.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6376 sec 2024-03-28T07:35:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:04 smithi086 ceph-mon[35163]: pgmap v3897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:05.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:04 smithi159 ceph-mon[36109]: pgmap v3897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:05.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:04 smithi055 ceph-mon[31863]: pgmap v3897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:06.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6377 sec 2024-03-28T07:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:35:06.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:35:06.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:35:07.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6378 sec 2024-03-28T07:35:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:06 smithi086 ceph-mon[35163]: pgmap v3898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:06 smithi159 ceph-mon[36109]: pgmap v3898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:06 smithi055 ceph-mon[31863]: pgmap v3898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:08.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6379 sec 2024-03-28T07:35:09.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6380 sec 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: pgmap v3899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5707.885885 secs 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: pgmap v3900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: pgmap v3901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: pgmap v3899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5707.885885 secs 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: pgmap v3900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: pgmap v3901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:09.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: pgmap v3899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5707.885885 secs 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:35:09.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:35:09.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: pgmap v3900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:35:09.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: pgmap v3901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:09.127 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:35:10.000 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6381 sec 2024-03-28T07:35:11.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6382 sec 2024-03-28T07:35:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:10 smithi159 ceph-mon[36109]: pgmap v3902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:10 smithi055 ceph-mon[31863]: pgmap v3902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:10 smithi086 ceph-mon[35163]: pgmap v3902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:12.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6383 sec 2024-03-28T07:35:13.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6384 sec 2024-03-28T07:35:13.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:12 smithi055 ceph-mon[31863]: pgmap v3903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:12 smithi086 ceph-mon[35163]: pgmap v3903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:13.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:12 smithi159 ceph-mon[36109]: pgmap v3903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:14.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6385 sec 2024-03-28T07:35:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5712.886001 secs 2024-03-28T07:35:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5712.886001 secs 2024-03-28T07:35:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5712.886001 secs 2024-03-28T07:35:15.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6386 sec 2024-03-28T07:35:15.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:14 smithi055 ceph-mon[31863]: pgmap v3904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:14 smithi086 ceph-mon[35163]: pgmap v3904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:15.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:14 smithi159 ceph-mon[36109]: pgmap v3904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:16.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6387 sec 2024-03-28T07:35:17.001 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6388 sec 2024-03-28T07:35:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:16 smithi055 ceph-mon[31863]: pgmap v3905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:16 smithi086 ceph-mon[35163]: pgmap v3905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:16 smithi159 ceph-mon[36109]: pgmap v3905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:35:18.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6389 sec 2024-03-28T07:35:19.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6390 sec 2024-03-28T07:35:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5717.886131 secs 2024-03-28T07:35:19.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:18 smithi055 ceph-mon[31863]: pgmap v3906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:35:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5717.886131 secs 2024-03-28T07:35:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:18 smithi086 ceph-mon[35163]: pgmap v3906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:35:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5717.886131 secs 2024-03-28T07:35:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:18 smithi159 ceph-mon[36109]: pgmap v3906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:35:20.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6391 sec 2024-03-28T07:35:21.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6392 sec 2024-03-28T07:35:21.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:20 smithi086 ceph-mon[35163]: pgmap v3907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:21.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:20 smithi055 ceph-mon[31863]: pgmap v3907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:21.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:20 smithi159 ceph-mon[36109]: pgmap v3907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:22.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6393 sec 2024-03-28T07:35:23.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6394 sec 2024-03-28T07:35:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:22 smithi055 ceph-mon[31863]: pgmap v3908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:22 smithi086 ceph-mon[35163]: pgmap v3908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:22 smithi159 ceph-mon[36109]: pgmap v3908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:24.002 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6395 sec 2024-03-28T07:35:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5722.886196 secs 2024-03-28T07:35:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5722.886196 secs 2024-03-28T07:35:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5722.886196 secs 2024-03-28T07:35:25.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6396 sec 2024-03-28T07:35:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:24 smithi086 ceph-mon[35163]: pgmap v3909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:24 smithi159 ceph-mon[36109]: pgmap v3909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:24 smithi055 ceph-mon[31863]: pgmap v3909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:26.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6397 sec 2024-03-28T07:35:27.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6398 sec 2024-03-28T07:35:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:26 smithi086 ceph-mon[35163]: pgmap v3910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:27.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:26 smithi159 ceph-mon[36109]: pgmap v3910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:26 smithi055 ceph-mon[31863]: pgmap v3910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:28.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6399 sec 2024-03-28T07:35:29.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6400 sec 2024-03-28T07:35:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5727.886319 secs 2024-03-28T07:35:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:28 smithi086 ceph-mon[35163]: pgmap v3911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5727.886319 secs 2024-03-28T07:35:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:28 smithi159 ceph-mon[36109]: pgmap v3911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5727.886319 secs 2024-03-28T07:35:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:28 smithi055 ceph-mon[31863]: pgmap v3911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:30.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6401 sec 2024-03-28T07:35:31.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6402 sec 2024-03-28T07:35:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:30 smithi086 ceph-mon[35163]: pgmap v3912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:30 smithi159 ceph-mon[36109]: pgmap v3912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:30 smithi055 ceph-mon[31863]: pgmap v3912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:32.003 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6403 sec 2024-03-28T07:35:33.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6404 sec 2024-03-28T07:35:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:32 smithi086 ceph-mon[35163]: pgmap v3913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:32 smithi159 ceph-mon[36109]: pgmap v3913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:32 smithi055 ceph-mon[31863]: pgmap v3913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:34.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6405 sec 2024-03-28T07:35:34.223 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5732.886437 secs 2024-03-28T07:35:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5732.886437 secs 2024-03-28T07:35:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5732.886437 secs 2024-03-28T07:35:35.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6406 sec 2024-03-28T07:35:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:34 smithi086 ceph-mon[35163]: pgmap v3914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:35.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:34 smithi159 ceph-mon[36109]: pgmap v3914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:35.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:34 smithi055 ceph-mon[31863]: pgmap v3914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:36.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6407 sec 2024-03-28T07:35:37.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6408 sec 2024-03-28T07:35:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:36 smithi086 ceph-mon[35163]: pgmap v3915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:37.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:36 smithi159 ceph-mon[36109]: pgmap v3915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:37.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:36 smithi055 ceph-mon[31863]: pgmap v3915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:38.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6409 sec 2024-03-28T07:35:39.004 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6410 sec 2024-03-28T07:35:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5737.886497 secs 2024-03-28T07:35:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:38 smithi086 ceph-mon[35163]: pgmap v3916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5737.886497 secs 2024-03-28T07:35:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:38 smithi159 ceph-mon[36109]: pgmap v3916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5737.886497 secs 2024-03-28T07:35:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:38 smithi055 ceph-mon[31863]: pgmap v3916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:40.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6411 sec 2024-03-28T07:35:41.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6412 sec 2024-03-28T07:35:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:40 smithi086 ceph-mon[35163]: pgmap v3917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:40 smithi159 ceph-mon[36109]: pgmap v3917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:40 smithi055 ceph-mon[31863]: pgmap v3917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:42.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6413 sec 2024-03-28T07:35:43.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6414 sec 2024-03-28T07:35:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:42 smithi086 ceph-mon[35163]: pgmap v3918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:42 smithi159 ceph-mon[36109]: pgmap v3918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:42 smithi055 ceph-mon[31863]: pgmap v3918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:44.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6415 sec 2024-03-28T07:35:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5742.886616 secs 2024-03-28T07:35:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5742.886616 secs 2024-03-28T07:35:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5742.886616 secs 2024-03-28T07:35:45.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6416 sec 2024-03-28T07:35:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:44 smithi086 ceph-mon[35163]: pgmap v3919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:45.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:44 smithi159 ceph-mon[36109]: pgmap v3919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:45.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:44 smithi055 ceph-mon[31863]: pgmap v3919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:46.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6417 sec 2024-03-28T07:35:47.005 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6418 sec 2024-03-28T07:35:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:46 smithi086 ceph-mon[35163]: pgmap v3920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:47.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:46 smithi159 ceph-mon[36109]: pgmap v3920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:47.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:46 smithi055 ceph-mon[31863]: pgmap v3920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:48.006 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6419 sec 2024-03-28T07:35:49.006 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6420 sec 2024-03-28T07:35:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5747.886734 secs 2024-03-28T07:35:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:48 smithi086 ceph-mon[35163]: pgmap v3921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5747.886734 secs 2024-03-28T07:35:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:48 smithi159 ceph-mon[36109]: pgmap v3921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5747.886734 secs 2024-03-28T07:35:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:48 smithi055 ceph-mon[31863]: pgmap v3921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:50.006 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6421 sec 2024-03-28T07:35:51.006 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6422 sec 2024-03-28T07:35:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:50 smithi086 ceph-mon[35163]: pgmap v3922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:50 smithi159 ceph-mon[36109]: pgmap v3922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:51.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:50 smithi055 ceph-mon[31863]: pgmap v3922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:52.006 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6423 sec 2024-03-28T07:35:53.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6424 sec 2024-03-28T07:35:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:53 smithi086 ceph-mon[35163]: pgmap v3923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:53 smithi159 ceph-mon[36109]: pgmap v3923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:53.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:53 smithi055 ceph-mon[31863]: pgmap v3923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:54.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6425 sec 2024-03-28T07:35:54.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5752.886830 secs 2024-03-28T07:35:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5752.886830 secs 2024-03-28T07:35:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5752.886830 secs 2024-03-28T07:35:55.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6426 sec 2024-03-28T07:35:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:55 smithi086 ceph-mon[35163]: pgmap v3924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:55 smithi159 ceph-mon[36109]: pgmap v3924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:55 smithi055 ceph-mon[31863]: pgmap v3924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:35:56.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6427 sec 2024-03-28T07:35:57.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6428 sec 2024-03-28T07:35:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:57 smithi086 ceph-mon[35163]: pgmap v3925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:57 smithi159 ceph-mon[36109]: pgmap v3925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:57 smithi055 ceph-mon[31863]: pgmap v3925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:35:58.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6429 sec 2024-03-28T07:35:59.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6430 sec 2024-03-28T07:35:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5757.886948 secs 2024-03-28T07:35:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:35:59 smithi086 ceph-mon[35163]: pgmap v3926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5757.886948 secs 2024-03-28T07:35:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:35:59 smithi159 ceph-mon[36109]: pgmap v3926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:35:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5757.886948 secs 2024-03-28T07:35:59.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:35:59 smithi055 ceph-mon[31863]: pgmap v3926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:00.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6431 sec 2024-03-28T07:36:01.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6432 sec 2024-03-28T07:36:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:01 smithi086 ceph-mon[35163]: pgmap v3927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:01 smithi159 ceph-mon[36109]: pgmap v3927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:01.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:01 smithi055 ceph-mon[31863]: pgmap v3927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:02.007 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6433 sec 2024-03-28T07:36:03.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6434 sec 2024-03-28T07:36:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:03 smithi159 ceph-mon[36109]: pgmap v3928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:03 smithi055 ceph-mon[31863]: pgmap v3928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:03 smithi086 ceph-mon[35163]: pgmap v3928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:04.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6435 sec 2024-03-28T07:36:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:04 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 5762.887035 secs 2024-03-28T07:36:04.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:04 smithi055 ceph-mon[31863]: slow request 5762.887035 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T07:36:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:04 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 5762.887035 secs 2024-03-28T07:36:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:04 smithi086 ceph-mon[35163]: slow request 5762.887035 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T07:36:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:04 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 5762.887035 secs 2024-03-28T07:36:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:04 smithi159 ceph-mon[36109]: slow request 5762.887035 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T07:36:05.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6436 sec 2024-03-28T07:36:05.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:05 smithi055 ceph-mon[31863]: pgmap v3929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:05 smithi086 ceph-mon[35163]: pgmap v3929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:05 smithi159 ceph-mon[36109]: pgmap v3929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:06.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6437 sec 2024-03-28T07:36:07.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6438 sec 2024-03-28T07:36:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:07 smithi055 ceph-mon[31863]: pgmap v3930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:07 smithi086 ceph-mon[35163]: pgmap v3930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:07 smithi159 ceph-mon[36109]: pgmap v3930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:08.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6439 sec 2024-03-28T07:36:09.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6440 sec 2024-03-28T07:36:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5767.887155 secs 2024-03-28T07:36:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:09 smithi055 ceph-mon[31863]: pgmap v3931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:09.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:36:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5767.887155 secs 2024-03-28T07:36:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:09 smithi086 ceph-mon[35163]: pgmap v3931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:36:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5767.887155 secs 2024-03-28T07:36:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:09 smithi159 ceph-mon[36109]: pgmap v3931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:36:10.008 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6441 sec 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:10.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:36:11.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6442 sec 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: pgmap v3932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:36:11.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: pgmap v3932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:36:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: pgmap v3932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:36:11.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:36:12.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6443 sec 2024-03-28T07:36:12.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:12 smithi055 ceph-mon[31863]: pgmap v3933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:12.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:12 smithi055 ceph-mon[31863]: pgmap v3934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:36:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:12 smithi086 ceph-mon[35163]: pgmap v3933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:12 smithi086 ceph-mon[35163]: pgmap v3934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:36:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:12 smithi159 ceph-mon[36109]: pgmap v3933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:12 smithi159 ceph-mon[36109]: pgmap v3934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:36:13.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6444 sec 2024-03-28T07:36:14.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6445 sec 2024-03-28T07:36:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:14 smithi086 ceph-mon[35163]: pgmap v3935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5772.887220 secs 2024-03-28T07:36:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:14 smithi159 ceph-mon[36109]: pgmap v3935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5772.887220 secs 2024-03-28T07:36:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:14 smithi055 ceph-mon[31863]: pgmap v3935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5772.887220 secs 2024-03-28T07:36:15.009 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6446 sec 2024-03-28T07:36:16.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6447 sec 2024-03-28T07:36:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:16 smithi086 ceph-mon[35163]: pgmap v3936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:16 smithi159 ceph-mon[36109]: pgmap v3936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:16 smithi055 ceph-mon[31863]: pgmap v3936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:17.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6448 sec 2024-03-28T07:36:18.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6449 sec 2024-03-28T07:36:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:18 smithi086 ceph-mon[35163]: pgmap v3937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:18 smithi159 ceph-mon[36109]: pgmap v3937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:18 smithi055 ceph-mon[31863]: pgmap v3937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:19.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6450 sec 2024-03-28T07:36:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5777.887345 secs 2024-03-28T07:36:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5777.887345 secs 2024-03-28T07:36:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5777.887345 secs 2024-03-28T07:36:20.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6451 sec 2024-03-28T07:36:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:20 smithi086 ceph-mon[35163]: pgmap v3938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:20 smithi159 ceph-mon[36109]: pgmap v3938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:20 smithi055 ceph-mon[31863]: pgmap v3938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:36:21.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6452 sec 2024-03-28T07:36:21.471 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:21 smithi086 ceph-mon[35163]: pgmap v3939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:36:21.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:21 smithi159 ceph-mon[36109]: pgmap v3939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:36:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:21 smithi055 ceph-mon[31863]: pgmap v3939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:36:22.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6453 sec 2024-03-28T07:36:23.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6454 sec 2024-03-28T07:36:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:23 smithi086 ceph-mon[35163]: pgmap v3940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5782.887376 secs 2024-03-28T07:36:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:23 smithi159 ceph-mon[36109]: pgmap v3940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5782.887376 secs 2024-03-28T07:36:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:23 smithi055 ceph-mon[31863]: pgmap v3940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5782.887376 secs 2024-03-28T07:36:24.010 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6455 sec 2024-03-28T07:36:25.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6456 sec 2024-03-28T07:36:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:25 smithi086 ceph-mon[35163]: pgmap v3941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:25 smithi159 ceph-mon[36109]: pgmap v3941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:25 smithi055 ceph-mon[31863]: pgmap v3941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:26.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6457 sec 2024-03-28T07:36:27.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6458 sec 2024-03-28T07:36:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:27 smithi086 ceph-mon[35163]: pgmap v3942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:27.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:27 smithi159 ceph-mon[36109]: pgmap v3942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:27.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:27 smithi055 ceph-mon[31863]: pgmap v3942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:28.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6459 sec 2024-03-28T07:36:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5787.887489 secs 2024-03-28T07:36:28.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5787.887489 secs 2024-03-28T07:36:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5787.887489 secs 2024-03-28T07:36:29.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6460 sec 2024-03-28T07:36:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:29 smithi086 ceph-mon[35163]: pgmap v3943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:29 smithi159 ceph-mon[36109]: pgmap v3943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:29.876 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:29 smithi055 ceph-mon[31863]: pgmap v3943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:30.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6461 sec 2024-03-28T07:36:31.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6462 sec 2024-03-28T07:36:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:31 smithi086 ceph-mon[35163]: pgmap v3944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:31.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:31 smithi159 ceph-mon[36109]: pgmap v3944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:31.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:31 smithi055 ceph-mon[31863]: pgmap v3944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:32.011 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6463 sec 2024-03-28T07:36:33.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6464 sec 2024-03-28T07:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:33 smithi086 ceph-mon[35163]: pgmap v3945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5792.887609 secs 2024-03-28T07:36:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:33 smithi159 ceph-mon[36109]: pgmap v3945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5792.887609 secs 2024-03-28T07:36:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:33 smithi055 ceph-mon[31863]: pgmap v3945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5792.887609 secs 2024-03-28T07:36:34.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6465 sec 2024-03-28T07:36:35.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6466 sec 2024-03-28T07:36:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:35 smithi086 ceph-mon[35163]: pgmap v3946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:35 smithi159 ceph-mon[36109]: pgmap v3946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:35 smithi055 ceph-mon[31863]: pgmap v3946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:36.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6467 sec 2024-03-28T07:36:37.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6468 sec 2024-03-28T07:36:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:37 smithi086 ceph-mon[35163]: pgmap v3947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:37 smithi159 ceph-mon[36109]: pgmap v3947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:37.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:37 smithi055 ceph-mon[31863]: pgmap v3947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:38.012 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6469 sec 2024-03-28T07:36:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5797.887636 secs 2024-03-28T07:36:39.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6470 sec 2024-03-28T07:36:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5797.887636 secs 2024-03-28T07:36:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5797.887636 secs 2024-03-28T07:36:39.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:39 smithi055 ceph-mon[31863]: pgmap v3948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:40.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6471 sec 2024-03-28T07:36:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:39 smithi086 ceph-mon[35163]: pgmap v3948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:40.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:39 smithi159 ceph-mon[36109]: pgmap v3948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:41.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6472 sec 2024-03-28T07:36:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:41 smithi055 ceph-mon[31863]: pgmap v3949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:42.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6473 sec 2024-03-28T07:36:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:41 smithi086 ceph-mon[35163]: pgmap v3949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:42.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:41 smithi159 ceph-mon[36109]: pgmap v3949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:43.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6474 sec 2024-03-28T07:36:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:43 smithi055 ceph-mon[31863]: pgmap v3950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5802.887757 secs 2024-03-28T07:36:44.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6475 sec 2024-03-28T07:36:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:43 smithi086 ceph-mon[35163]: pgmap v3950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5802.887757 secs 2024-03-28T07:36:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:43 smithi159 ceph-mon[36109]: pgmap v3950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5802.887757 secs 2024-03-28T07:36:45.013 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6476 sec 2024-03-28T07:36:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:45 smithi055 ceph-mon[31863]: pgmap v3951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:46.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6477 sec 2024-03-28T07:36:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:45 smithi086 ceph-mon[35163]: pgmap v3951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:45 smithi159 ceph-mon[36109]: pgmap v3951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:47.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6478 sec 2024-03-28T07:36:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:47 smithi055 ceph-mon[31863]: pgmap v3952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:48.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6479 sec 2024-03-28T07:36:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:47 smithi086 ceph-mon[35163]: pgmap v3952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:47 smithi159 ceph-mon[36109]: pgmap v3952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:48.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5807.887877 secs 2024-03-28T07:36:49.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6480 sec 2024-03-28T07:36:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5807.887877 secs 2024-03-28T07:36:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5807.887877 secs 2024-03-28T07:36:50.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6481 sec 2024-03-28T07:36:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:49 smithi086 ceph-mon[35163]: pgmap v3953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:50.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:49 smithi159 ceph-mon[36109]: pgmap v3953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:50.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:49 smithi055 ceph-mon[31863]: pgmap v3953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:51.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6482 sec 2024-03-28T07:36:52.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6483 sec 2024-03-28T07:36:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:51 smithi086 ceph-mon[35163]: pgmap v3954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:51 smithi159 ceph-mon[36109]: pgmap v3954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:51 smithi055 ceph-mon[31863]: pgmap v3954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:36:53.014 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6484 sec 2024-03-28T07:36:54.015 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6485 sec 2024-03-28T07:36:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:53 smithi086 ceph-mon[35163]: pgmap v3955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5812.887941 secs 2024-03-28T07:36:54.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:53 smithi159 ceph-mon[36109]: pgmap v3955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:54.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5812.887941 secs 2024-03-28T07:36:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:53 smithi055 ceph-mon[31863]: pgmap v3955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:36:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5812.887941 secs 2024-03-28T07:36:55.015 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6486 sec 2024-03-28T07:36:55.927 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:55 smithi055 ceph-mon[31863]: pgmap v3956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:56.015 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6487 sec 2024-03-28T07:36:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:55 smithi086 ceph-mon[35163]: pgmap v3956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:56.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:55 smithi159 ceph-mon[36109]: pgmap v3956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:57.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6488 sec 2024-03-28T07:36:58.015 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6489 sec 2024-03-28T07:36:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:57 smithi086 ceph-mon[35163]: pgmap v3957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:57 smithi159 ceph-mon[36109]: pgmap v3957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:57 smithi055 ceph-mon[31863]: pgmap v3957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:36:59.015 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6490 sec 2024-03-28T07:36:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5817.888026 secs 2024-03-28T07:36:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5817.888026 secs 2024-03-28T07:36:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5817.888026 secs 2024-03-28T07:37:00.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6491 sec 2024-03-28T07:37:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:36:59 smithi086 ceph-mon[35163]: pgmap v3958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:00.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:36:59 smithi159 ceph-mon[36109]: pgmap v3958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:00.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:36:59 smithi055 ceph-mon[31863]: pgmap v3958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:01.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6492 sec 2024-03-28T07:37:02.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6493 sec 2024-03-28T07:37:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:01 smithi086 ceph-mon[35163]: pgmap v3959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:01 smithi159 ceph-mon[36109]: pgmap v3959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:02.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:01 smithi055 ceph-mon[31863]: pgmap v3959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:03.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6494 sec 2024-03-28T07:37:04.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6495 sec 2024-03-28T07:37:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:03 smithi086 ceph-mon[35163]: pgmap v3960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5822.888089 secs 2024-03-28T07:37:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:03 smithi159 ceph-mon[36109]: pgmap v3960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5822.888089 secs 2024-03-28T07:37:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:03 smithi055 ceph-mon[31863]: pgmap v3960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5822.888089 secs 2024-03-28T07:37:05.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6496 sec 2024-03-28T07:37:06.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6497 sec 2024-03-28T07:37:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:05 smithi086 ceph-mon[35163]: pgmap v3961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:06.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:05 smithi159 ceph-mon[36109]: pgmap v3961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:06.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:05 smithi055 ceph-mon[31863]: pgmap v3961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:07.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6498 sec 2024-03-28T07:37:08.016 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6499 sec 2024-03-28T07:37:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:07 smithi086 ceph-mon[35163]: pgmap v3962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:08.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:07 smithi159 ceph-mon[36109]: pgmap v3962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:07 smithi055 ceph-mon[31863]: pgmap v3962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:09.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6500 sec 2024-03-28T07:37:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5827.888207 secs 2024-03-28T07:37:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5827.888207 secs 2024-03-28T07:37:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5827.888207 secs 2024-03-28T07:37:10.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6501 sec 2024-03-28T07:37:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:09 smithi086 ceph-mon[35163]: pgmap v3963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:09 smithi159 ceph-mon[36109]: pgmap v3963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:09 smithi055 ceph-mon[31863]: pgmap v3963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:11.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6502 sec 2024-03-28T07:37:12.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6503 sec 2024-03-28T07:37:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:11 smithi086 ceph-mon[35163]: pgmap v3964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:37:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:11 smithi159 ceph-mon[36109]: pgmap v3964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:12.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:11 smithi055 ceph-mon[31863]: pgmap v3964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:37:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:37:13.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6504 sec 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:37:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:37:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:37:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:37:13.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:37:13.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:37:13.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:37:14.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6505 sec 2024-03-28T07:37:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:13 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:37:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:13 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:37:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:13 smithi086 ceph-mon[35163]: pgmap v3965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:13 smithi086 ceph-mon[35163]: pgmap v3966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5832.888281 secs 2024-03-28T07:37:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:13 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:37:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:13 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:37:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:13 smithi159 ceph-mon[36109]: pgmap v3965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:13 smithi159 ceph-mon[36109]: pgmap v3966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:14.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5832.888281 secs 2024-03-28T07:37:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:13 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:37:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:13 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:37:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:13 smithi055 ceph-mon[31863]: pgmap v3965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:13 smithi055 ceph-mon[31863]: pgmap v3966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:14.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5832.888281 secs 2024-03-28T07:37:15.017 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6506 sec 2024-03-28T07:37:16.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6507 sec 2024-03-28T07:37:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:15 smithi086 ceph-mon[35163]: pgmap v3967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:16.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:15 smithi159 ceph-mon[36109]: pgmap v3967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:16.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:15 smithi055 ceph-mon[31863]: pgmap v3967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:17.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6508 sec 2024-03-28T07:37:18.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6509 sec 2024-03-28T07:37:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:17 smithi086 ceph-mon[35163]: pgmap v3968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:18.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:17 smithi159 ceph-mon[36109]: pgmap v3968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:18.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:17 smithi055 ceph-mon[31863]: pgmap v3968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:19.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6510 sec 2024-03-28T07:37:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5837.888340 secs 2024-03-28T07:37:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5837.888340 secs 2024-03-28T07:37:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5837.888340 secs 2024-03-28T07:37:20.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6511 sec 2024-03-28T07:37:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:19 smithi086 ceph-mon[35163]: pgmap v3969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:19 smithi159 ceph-mon[36109]: pgmap v3969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:20.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:19 smithi055 ceph-mon[31863]: pgmap v3969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:21.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6512 sec 2024-03-28T07:37:22.018 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6513 sec 2024-03-28T07:37:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:21 smithi086 ceph-mon[35163]: pgmap v3970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:37:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:21 smithi159 ceph-mon[36109]: pgmap v3970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:37:22.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:21 smithi055 ceph-mon[31863]: pgmap v3970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:37:23.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6514 sec 2024-03-28T07:37:24.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6515 sec 2024-03-28T07:37:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:23 smithi086 ceph-mon[35163]: pgmap v3971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:37:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5842.888464 secs 2024-03-28T07:37:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:23 smithi159 ceph-mon[36109]: pgmap v3971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:37:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5842.888464 secs 2024-03-28T07:37:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:23 smithi055 ceph-mon[31863]: pgmap v3971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:37:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5842.888464 secs 2024-03-28T07:37:25.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6516 sec 2024-03-28T07:37:26.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6517 sec 2024-03-28T07:37:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:25 smithi086 ceph-mon[35163]: pgmap v3972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:26.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:25 smithi159 ceph-mon[36109]: pgmap v3972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:26.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:25 smithi055 ceph-mon[31863]: pgmap v3972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:27.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6518 sec 2024-03-28T07:37:28.019 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6519 sec 2024-03-28T07:37:28.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:27 smithi055 ceph-mon[31863]: pgmap v3973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:27 smithi086 ceph-mon[35163]: pgmap v3973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:27 smithi159 ceph-mon[36109]: pgmap v3973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:29.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6520 sec 2024-03-28T07:37:29.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5847.888584 secs 2024-03-28T07:37:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5847.888584 secs 2024-03-28T07:37:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5847.888584 secs 2024-03-28T07:37:30.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6521 sec 2024-03-28T07:37:30.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:29 smithi055 ceph-mon[31863]: pgmap v3974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:29 smithi086 ceph-mon[35163]: pgmap v3974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:30.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:29 smithi159 ceph-mon[36109]: pgmap v3974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:31.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6522 sec 2024-03-28T07:37:32.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6523 sec 2024-03-28T07:37:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:31 smithi055 ceph-mon[31863]: pgmap v3975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:31 smithi086 ceph-mon[35163]: pgmap v3975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:32.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:31 smithi159 ceph-mon[36109]: pgmap v3975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:33.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6524 sec 2024-03-28T07:37:34.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6525 sec 2024-03-28T07:37:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:33 smithi055 ceph-mon[31863]: pgmap v3976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5852.888707 secs 2024-03-28T07:37:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:33 smithi086 ceph-mon[35163]: pgmap v3976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5852.888707 secs 2024-03-28T07:37:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:33 smithi159 ceph-mon[36109]: pgmap v3976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5852.888707 secs 2024-03-28T07:37:35.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6526 sec 2024-03-28T07:37:36.020 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6527 sec 2024-03-28T07:37:36.124 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:35 smithi159 ceph-mon[36109]: pgmap v3977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:35 smithi055 ceph-mon[31863]: pgmap v3977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:35 smithi086 ceph-mon[35163]: pgmap v3977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:37.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6528 sec 2024-03-28T07:37:38.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6529 sec 2024-03-28T07:37:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:37 smithi055 ceph-mon[31863]: pgmap v3978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:37 smithi086 ceph-mon[35163]: pgmap v3978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:37 smithi159 ceph-mon[36109]: pgmap v3978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:39.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6530 sec 2024-03-28T07:37:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5857.888827 secs 2024-03-28T07:37:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5857.888827 secs 2024-03-28T07:37:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5857.888827 secs 2024-03-28T07:37:40.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6531 sec 2024-03-28T07:37:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:39 smithi086 ceph-mon[35163]: pgmap v3979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:40.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:39 smithi159 ceph-mon[36109]: pgmap v3979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:39 smithi055 ceph-mon[31863]: pgmap v3979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:41.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6532 sec 2024-03-28T07:37:42.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6533 sec 2024-03-28T07:37:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:41 smithi086 ceph-mon[35163]: pgmap v3980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:42.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:41 smithi159 ceph-mon[36109]: pgmap v3980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:41 smithi055 ceph-mon[31863]: pgmap v3980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:43.021 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6534 sec 2024-03-28T07:37:44.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6535 sec 2024-03-28T07:37:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:43 smithi086 ceph-mon[35163]: pgmap v3981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5862.888917 secs 2024-03-28T07:37:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:43 smithi159 ceph-mon[36109]: pgmap v3981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5862.888917 secs 2024-03-28T07:37:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:43 smithi055 ceph-mon[31863]: pgmap v3981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5862.888917 secs 2024-03-28T07:37:45.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6536 sec 2024-03-28T07:37:46.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6537 sec 2024-03-28T07:37:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:45 smithi086 ceph-mon[35163]: pgmap v3982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:45 smithi159 ceph-mon[36109]: pgmap v3982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:45 smithi055 ceph-mon[31863]: pgmap v3982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:47.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6538 sec 2024-03-28T07:37:48.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6539 sec 2024-03-28T07:37:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:47 smithi086 ceph-mon[35163]: pgmap v3983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:47 smithi159 ceph-mon[36109]: pgmap v3983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:47 smithi055 ceph-mon[31863]: pgmap v3983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:49.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6540 sec 2024-03-28T07:37:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5867.889005 secs 2024-03-28T07:37:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5867.889005 secs 2024-03-28T07:37:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5867.889005 secs 2024-03-28T07:37:50.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6541 sec 2024-03-28T07:37:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:49 smithi086 ceph-mon[35163]: pgmap v3984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:50.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:49 smithi159 ceph-mon[36109]: pgmap v3984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:50.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:49 smithi055 ceph-mon[31863]: pgmap v3984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:51.022 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6542 sec 2024-03-28T07:37:52.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6543 sec 2024-03-28T07:37:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:51 smithi086 ceph-mon[35163]: pgmap v3985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:51 smithi159 ceph-mon[36109]: pgmap v3985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:51 smithi055 ceph-mon[31863]: pgmap v3985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:37:53.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6544 sec 2024-03-28T07:37:54.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6545 sec 2024-03-28T07:37:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:53 smithi086 ceph-mon[35163]: pgmap v3986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5872.889091 secs 2024-03-28T07:37:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:53 smithi159 ceph-mon[36109]: pgmap v3986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5872.889091 secs 2024-03-28T07:37:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:53 smithi055 ceph-mon[31863]: pgmap v3986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5872.889091 secs 2024-03-28T07:37:55.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6546 sec 2024-03-28T07:37:56.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6547 sec 2024-03-28T07:37:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:55 smithi086 ceph-mon[35163]: pgmap v3987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:56.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:55 smithi159 ceph-mon[36109]: pgmap v3987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:55 smithi055 ceph-mon[31863]: pgmap v3987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:57.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6548 sec 2024-03-28T07:37:58.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6549 sec 2024-03-28T07:37:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:57 smithi086 ceph-mon[35163]: pgmap v3988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:57 smithi159 ceph-mon[36109]: pgmap v3988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:57 smithi055 ceph-mon[31863]: pgmap v3988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:37:59.023 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6550 sec 2024-03-28T07:37:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5877.889210 secs 2024-03-28T07:37:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5877.889210 secs 2024-03-28T07:37:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5877.889210 secs 2024-03-28T07:38:00.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6551 sec 2024-03-28T07:38:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:37:59 smithi086 ceph-mon[35163]: pgmap v3989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:00.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:37:59 smithi159 ceph-mon[36109]: pgmap v3989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:00.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:37:59 smithi055 ceph-mon[31863]: pgmap v3989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:01.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6552 sec 2024-03-28T07:38:02.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6553 sec 2024-03-28T07:38:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:01 smithi086 ceph-mon[35163]: pgmap v3990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:02.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:01 smithi159 ceph-mon[36109]: pgmap v3990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:02.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:01 smithi055 ceph-mon[31863]: pgmap v3990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:03.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6554 sec 2024-03-28T07:38:04.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6555 sec 2024-03-28T07:38:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:03 smithi086 ceph-mon[35163]: pgmap v3991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5882.889331 secs 2024-03-28T07:38:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:03 smithi159 ceph-mon[36109]: pgmap v3991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5882.889331 secs 2024-03-28T07:38:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:03 smithi055 ceph-mon[31863]: pgmap v3991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5882.889331 secs 2024-03-28T07:38:05.024 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6556 sec 2024-03-28T07:38:06.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6557 sec 2024-03-28T07:38:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:06 smithi086 ceph-mon[35163]: pgmap v3992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:06.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:06 smithi159 ceph-mon[36109]: pgmap v3992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:06.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:06 smithi055 ceph-mon[31863]: pgmap v3992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:07.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6558 sec 2024-03-28T07:38:08.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6559 sec 2024-03-28T07:38:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:08 smithi086 ceph-mon[35163]: pgmap v3993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:08 smithi159 ceph-mon[36109]: pgmap v3993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:08 smithi055 ceph-mon[31863]: pgmap v3993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:09.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6560 sec 2024-03-28T07:38:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5887.889408 secs 2024-03-28T07:38:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5887.889408 secs 2024-03-28T07:38:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5887.889408 secs 2024-03-28T07:38:10.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6561 sec 2024-03-28T07:38:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:10 smithi086 ceph-mon[35163]: pgmap v3994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:10.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:10 smithi159 ceph-mon[36109]: pgmap v3994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:10.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:10 smithi055 ceph-mon[31863]: pgmap v3994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:11.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6562 sec 2024-03-28T07:38:12.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6563 sec 2024-03-28T07:38:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:12 smithi086 ceph-mon[35163]: pgmap v3995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:12.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:12 smithi159 ceph-mon[36109]: pgmap v3995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:12.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:12 smithi055 ceph-mon[31863]: pgmap v3995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:13.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6564 sec 2024-03-28T07:38:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:38:13.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:38:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:38:14.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6565 sec 2024-03-28T07:38:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:14 smithi086 ceph-mon[35163]: pgmap v3996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5892.889532 secs 2024-03-28T07:38:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:38:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:38:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:38:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:14 smithi159 ceph-mon[36109]: pgmap v3996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5892.889532 secs 2024-03-28T07:38:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:38:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:38:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:38:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:14 smithi055 ceph-mon[31863]: pgmap v3996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5892.889532 secs 2024-03-28T07:38:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:38:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:38:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:38:15.025 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6566 sec 2024-03-28T07:38:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:15 smithi055 ceph-mon[31863]: pgmap v3997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:15 smithi055 ceph-mon[31863]: pgmap v3998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:15 smithi086 ceph-mon[35163]: pgmap v3997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:15 smithi086 ceph-mon[35163]: pgmap v3998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:15.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:15 smithi159 ceph-mon[36109]: pgmap v3997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:15.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:15 smithi159 ceph-mon[36109]: pgmap v3998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:16.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6567 sec 2024-03-28T07:38:17.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6568 sec 2024-03-28T07:38:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:17 smithi055 ceph-mon[31863]: pgmap v3999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:17 smithi086 ceph-mon[35163]: pgmap v3999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:17 smithi159 ceph-mon[36109]: pgmap v3999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:18.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6569 sec 2024-03-28T07:38:19.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6570 sec 2024-03-28T07:38:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5897.889650 secs 2024-03-28T07:38:19.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:19 smithi055 ceph-mon[31863]: pgmap v4000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5897.889650 secs 2024-03-28T07:38:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:19 smithi086 ceph-mon[35163]: pgmap v4000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5897.889650 secs 2024-03-28T07:38:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:19 smithi159 ceph-mon[36109]: pgmap v4000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:20.026 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6571 sec 2024-03-28T07:38:21.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6572 sec 2024-03-28T07:38:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:21 smithi055 ceph-mon[31863]: pgmap v4001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:21 smithi086 ceph-mon[35163]: pgmap v4001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:21.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:21 smithi159 ceph-mon[36109]: pgmap v4001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:22.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6573 sec 2024-03-28T07:38:23.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6574 sec 2024-03-28T07:38:23.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:23 smithi086 ceph-mon[35163]: pgmap v4002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:23 smithi055 ceph-mon[31863]: pgmap v4002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:23 smithi159 ceph-mon[36109]: pgmap v4002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:24.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6575 sec 2024-03-28T07:38:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5902.889719 secs 2024-03-28T07:38:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5902.889719 secs 2024-03-28T07:38:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5902.889719 secs 2024-03-28T07:38:25.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6576 sec 2024-03-28T07:38:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:25 smithi055 ceph-mon[31863]: pgmap v4003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:38:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:25 smithi086 ceph-mon[35163]: pgmap v4003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:38:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:25 smithi159 ceph-mon[36109]: pgmap v4003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:38:26.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6577 sec 2024-03-28T07:38:27.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6578 sec 2024-03-28T07:38:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:27 smithi086 ceph-mon[35163]: pgmap v4004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:27 smithi159 ceph-mon[36109]: pgmap v4004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:27 smithi055 ceph-mon[31863]: pgmap v4004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:28.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6579 sec 2024-03-28T07:38:29.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6580 sec 2024-03-28T07:38:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5907.889809 secs 2024-03-28T07:38:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:29 smithi086 ceph-mon[35163]: pgmap v4005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5907.889809 secs 2024-03-28T07:38:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:29 smithi159 ceph-mon[36109]: pgmap v4005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5907.889809 secs 2024-03-28T07:38:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:29 smithi055 ceph-mon[31863]: pgmap v4005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:30.027 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6581 sec 2024-03-28T07:38:31.028 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6582 sec 2024-03-28T07:38:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:31 smithi086 ceph-mon[35163]: pgmap v4006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:31 smithi159 ceph-mon[36109]: pgmap v4006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:31.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:31 smithi055 ceph-mon[31863]: pgmap v4006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:32.028 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6583 sec 2024-03-28T07:38:33.028 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6584 sec 2024-03-28T07:38:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:32 smithi086 ceph-mon[35163]: pgmap v4007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:32 smithi159 ceph-mon[36109]: pgmap v4007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:32 smithi055 ceph-mon[31863]: pgmap v4007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:34.028 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6585 sec 2024-03-28T07:38:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5912.889880 secs 2024-03-28T07:38:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5912.889880 secs 2024-03-28T07:38:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5912.889880 secs 2024-03-28T07:38:35.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6586 sec 2024-03-28T07:38:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:34 smithi086 ceph-mon[35163]: pgmap v4008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:35.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:34 smithi159 ceph-mon[36109]: pgmap v4008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:35.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:34 smithi055 ceph-mon[31863]: pgmap v4008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:36.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6587 sec 2024-03-28T07:38:37.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6588 sec 2024-03-28T07:38:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:37 smithi086 ceph-mon[35163]: pgmap v4009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:37.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:37 smithi159 ceph-mon[36109]: pgmap v4009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:37.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:37 smithi055 ceph-mon[31863]: pgmap v4009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:38.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6589 sec 2024-03-28T07:38:39.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6590 sec 2024-03-28T07:38:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5917.890000 secs 2024-03-28T07:38:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:39 smithi086 ceph-mon[35163]: pgmap v4010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5917.890000 secs 2024-03-28T07:38:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:39 smithi159 ceph-mon[36109]: pgmap v4010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5917.890000 secs 2024-03-28T07:38:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:39 smithi055 ceph-mon[31863]: pgmap v4010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:40.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6591 sec 2024-03-28T07:38:41.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6592 sec 2024-03-28T07:38:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:41 smithi086 ceph-mon[35163]: pgmap v4011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:41 smithi159 ceph-mon[36109]: pgmap v4011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:41 smithi055 ceph-mon[31863]: pgmap v4011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:42.029 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6593 sec 2024-03-28T07:38:43.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6594 sec 2024-03-28T07:38:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:43 smithi159 ceph-mon[36109]: pgmap v4012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:43 smithi055 ceph-mon[31863]: pgmap v4012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:43 smithi086 ceph-mon[35163]: pgmap v4012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:44.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6595 sec 2024-03-28T07:38:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5922.890076 secs 2024-03-28T07:38:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5922.890076 secs 2024-03-28T07:38:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5922.890076 secs 2024-03-28T07:38:45.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6596 sec 2024-03-28T07:38:45.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:45 smithi055 ceph-mon[31863]: pgmap v4013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:45 smithi086 ceph-mon[35163]: pgmap v4013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:45 smithi159 ceph-mon[36109]: pgmap v4013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:46.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6597 sec 2024-03-28T07:38:47.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6598 sec 2024-03-28T07:38:47.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:47 smithi055 ceph-mon[31863]: pgmap v4014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:47 smithi086 ceph-mon[35163]: pgmap v4014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:47 smithi159 ceph-mon[36109]: pgmap v4014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:48.030 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6599 sec 2024-03-28T07:38:49.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6600 sec 2024-03-28T07:38:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5927.890197 secs 2024-03-28T07:38:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:49 smithi055 ceph-mon[31863]: pgmap v4015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5927.890197 secs 2024-03-28T07:38:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:49 smithi086 ceph-mon[35163]: pgmap v4015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5927.890197 secs 2024-03-28T07:38:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:49 smithi159 ceph-mon[36109]: pgmap v4015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:50.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6601 sec 2024-03-28T07:38:51.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6602 sec 2024-03-28T07:38:51.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:51 smithi055 ceph-mon[31863]: pgmap v4016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:51 smithi086 ceph-mon[35163]: pgmap v4016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:51.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:51 smithi159 ceph-mon[36109]: pgmap v4016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:38:52.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6603 sec 2024-03-28T07:38:53.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6604 sec 2024-03-28T07:38:53.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:53 smithi086 ceph-mon[35163]: pgmap v4017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:53.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:53 smithi055 ceph-mon[31863]: pgmap v4017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:53.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:53 smithi159 ceph-mon[36109]: pgmap v4017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:54.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6605 sec 2024-03-28T07:38:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5932.890274 secs 2024-03-28T07:38:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5932.890274 secs 2024-03-28T07:38:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5932.890274 secs 2024-03-28T07:38:55.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6606 sec 2024-03-28T07:38:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:55 smithi086 ceph-mon[35163]: pgmap v4018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:55.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:55 smithi159 ceph-mon[36109]: pgmap v4018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:55.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:55 smithi055 ceph-mon[31863]: pgmap v4018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:38:56.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6607 sec 2024-03-28T07:38:57.031 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6608 sec 2024-03-28T07:38:57.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:57 smithi055 ceph-mon[31863]: pgmap v4019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:38:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:57 smithi086 ceph-mon[35163]: pgmap v4019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:38:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:57 smithi159 ceph-mon[36109]: pgmap v4019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:38:58.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6609 sec 2024-03-28T07:38:59.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6610 sec 2024-03-28T07:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5937.890334 secs 2024-03-28T07:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:38:59 smithi086 ceph-mon[35163]: pgmap v4020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5937.890334 secs 2024-03-28T07:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:38:59 smithi159 ceph-mon[36109]: pgmap v4020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5937.890334 secs 2024-03-28T07:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:38:59 smithi055 ceph-mon[31863]: pgmap v4020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:00.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6611 sec 2024-03-28T07:39:01.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6612 sec 2024-03-28T07:39:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:01 smithi086 ceph-mon[35163]: pgmap v4021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:01.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:01 smithi159 ceph-mon[36109]: pgmap v4021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:01.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:01 smithi055 ceph-mon[31863]: pgmap v4021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:02.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6613 sec 2024-03-28T07:39:03.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6614 sec 2024-03-28T07:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:03 smithi086 ceph-mon[35163]: pgmap v4022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:03 smithi159 ceph-mon[36109]: pgmap v4022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:03 smithi055 ceph-mon[31863]: pgmap v4022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:04.032 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6615 sec 2024-03-28T07:39:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5942.890425 secs 2024-03-28T07:39:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5942.890425 secs 2024-03-28T07:39:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5942.890425 secs 2024-03-28T07:39:05.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6616 sec 2024-03-28T07:39:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:05 smithi086 ceph-mon[35163]: pgmap v4023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:05 smithi159 ceph-mon[36109]: pgmap v4023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:05 smithi055 ceph-mon[31863]: pgmap v4023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:06.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6617 sec 2024-03-28T07:39:07.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6618 sec 2024-03-28T07:39:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:07 smithi086 ceph-mon[35163]: pgmap v4024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:07.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:07 smithi159 ceph-mon[36109]: pgmap v4024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:07.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:07 smithi055 ceph-mon[31863]: pgmap v4024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:39:08.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6619 sec 2024-03-28T07:39:09.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6620 sec 2024-03-28T07:39:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5947.890504 secs 2024-03-28T07:39:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:09 smithi086 ceph-mon[35163]: pgmap v4025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5947.890504 secs 2024-03-28T07:39:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:09 smithi159 ceph-mon[36109]: pgmap v4025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5947.890504 secs 2024-03-28T07:39:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:09 smithi055 ceph-mon[31863]: pgmap v4025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:10.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6621 sec 2024-03-28T07:39:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:10 smithi086 ceph-mon[35163]: pgmap v4026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:10 smithi159 ceph-mon[36109]: pgmap v4026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:10 smithi055 ceph-mon[31863]: pgmap v4026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:11.033 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6622 sec 2024-03-28T07:39:12.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6623 sec 2024-03-28T07:39:13.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6624 sec 2024-03-28T07:39:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:13 smithi055 ceph-mon[31863]: pgmap v4027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:13 smithi086 ceph-mon[35163]: pgmap v4027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:13 smithi159 ceph-mon[36109]: pgmap v4027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:14.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6625 sec 2024-03-28T07:39:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5952.890566 secs 2024-03-28T07:39:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5952.890566 secs 2024-03-28T07:39:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5952.890566 secs 2024-03-28T07:39:15.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6626 sec 2024-03-28T07:39:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:15 smithi055 ceph-mon[31863]: pgmap v4028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:39:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:15 smithi086 ceph-mon[35163]: pgmap v4028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:39:15.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:15 smithi159 ceph-mon[36109]: pgmap v4028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:15.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:39:16.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6627 sec 2024-03-28T07:39:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:17.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6628 sec 2024-03-28T07:39:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:17 smithi086 ceph-mon[35163]: pgmap v4029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:39:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:39:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:17 smithi159 ceph-mon[36109]: pgmap v4029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:39:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:39:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:17.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:17 smithi055 ceph-mon[31863]: pgmap v4029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:17.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:39:17.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:39:17.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:39:18.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6629 sec 2024-03-28T07:39:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:18 smithi086 ceph-mon[35163]: pgmap v4030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:39:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:18 smithi086 ceph-mon[35163]: pgmap v4031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:18 smithi159 ceph-mon[36109]: pgmap v4030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:39:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:18 smithi159 ceph-mon[36109]: pgmap v4031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:18 smithi055 ceph-mon[31863]: pgmap v4030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:39:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:18 smithi055 ceph-mon[31863]: pgmap v4031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:19.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6630 sec 2024-03-28T07:39:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5957.890684 secs 2024-03-28T07:39:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5957.890684 secs 2024-03-28T07:39:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5957.890684 secs 2024-03-28T07:39:20.034 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6631 sec 2024-03-28T07:39:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:20 smithi086 ceph-mon[35163]: pgmap v4032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:20 smithi159 ceph-mon[36109]: pgmap v4032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:20 smithi055 ceph-mon[31863]: pgmap v4032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:21.035 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6632 sec 2024-03-28T07:39:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:21 smithi086 ceph-mon[35163]: pgmap v4033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:21.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:21 smithi159 ceph-mon[36109]: pgmap v4033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:21 smithi055 ceph-mon[31863]: pgmap v4033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:39:22.035 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6633 sec 2024-03-28T07:39:23.035 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6634 sec 2024-03-28T07:39:24.035 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6635 sec 2024-03-28T07:39:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5962.890761 secs 2024-03-28T07:39:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:23 smithi086 ceph-mon[35163]: pgmap v4034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5962.890761 secs 2024-03-28T07:39:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:23 smithi159 ceph-mon[36109]: pgmap v4034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5962.890761 secs 2024-03-28T07:39:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:23 smithi055 ceph-mon[31863]: pgmap v4034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:25.035 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6636 sec 2024-03-28T07:39:26.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6637 sec 2024-03-28T07:39:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:25 smithi086 ceph-mon[35163]: pgmap v4035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:26.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:25 smithi159 ceph-mon[36109]: pgmap v4035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:26.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:25 smithi055 ceph-mon[31863]: pgmap v4035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:27.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6638 sec 2024-03-28T07:39:28.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6639 sec 2024-03-28T07:39:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:27 smithi086 ceph-mon[35163]: pgmap v4036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:27 smithi159 ceph-mon[36109]: pgmap v4036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:27 smithi055 ceph-mon[31863]: pgmap v4036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:29.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6640 sec 2024-03-28T07:39:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5967.890878 secs 2024-03-28T07:39:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5967.890878 secs 2024-03-28T07:39:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5967.890878 secs 2024-03-28T07:39:30.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6641 sec 2024-03-28T07:39:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:29 smithi086 ceph-mon[35163]: pgmap v4037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:30.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:29 smithi159 ceph-mon[36109]: pgmap v4037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:30.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:29 smithi055 ceph-mon[31863]: pgmap v4037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:31.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6642 sec 2024-03-28T07:39:32.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6643 sec 2024-03-28T07:39:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:31 smithi086 ceph-mon[35163]: pgmap v4038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:32.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:31 smithi159 ceph-mon[36109]: pgmap v4038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:31 smithi055 ceph-mon[31863]: pgmap v4038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:33.036 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6644 sec 2024-03-28T07:39:34.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6645 sec 2024-03-28T07:39:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5972.890898 secs 2024-03-28T07:39:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:34 smithi086 ceph-mon[35163]: pgmap v4039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5972.890898 secs 2024-03-28T07:39:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:34 smithi159 ceph-mon[36109]: pgmap v4039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5972.890898 secs 2024-03-28T07:39:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:34 smithi055 ceph-mon[31863]: pgmap v4039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:35.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6646 sec 2024-03-28T07:39:36.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6647 sec 2024-03-28T07:39:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:36 smithi086 ceph-mon[35163]: pgmap v4040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:36 smithi159 ceph-mon[36109]: pgmap v4040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:36 smithi055 ceph-mon[31863]: pgmap v4040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:37.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6648 sec 2024-03-28T07:39:38.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6649 sec 2024-03-28T07:39:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:38 smithi086 ceph-mon[35163]: pgmap v4041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:38 smithi159 ceph-mon[36109]: pgmap v4041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:38 smithi055 ceph-mon[31863]: pgmap v4041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:39.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6650 sec 2024-03-28T07:39:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5977.891004 secs 2024-03-28T07:39:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5977.891004 secs 2024-03-28T07:39:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5977.891004 secs 2024-03-28T07:39:40.037 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6651 sec 2024-03-28T07:39:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:40 smithi086 ceph-mon[35163]: pgmap v4042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:40 smithi159 ceph-mon[36109]: pgmap v4042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:40 smithi055 ceph-mon[31863]: pgmap v4042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:41.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6652 sec 2024-03-28T07:39:42.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6653 sec 2024-03-28T07:39:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:42 smithi086 ceph-mon[35163]: pgmap v4043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:42.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:42 smithi159 ceph-mon[36109]: pgmap v4043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:42 smithi055 ceph-mon[31863]: pgmap v4043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:39:43.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6654 sec 2024-03-28T07:39:44.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6655 sec 2024-03-28T07:39:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5982.891050 secs 2024-03-28T07:39:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:44 smithi086 ceph-mon[35163]: pgmap v4044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5982.891050 secs 2024-03-28T07:39:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:44 smithi159 ceph-mon[36109]: pgmap v4044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5982.891050 secs 2024-03-28T07:39:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:44 smithi055 ceph-mon[31863]: pgmap v4044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:39:45.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6656 sec 2024-03-28T07:39:46.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6657 sec 2024-03-28T07:39:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:46 smithi086 ceph-mon[35163]: pgmap v4045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:46 smithi159 ceph-mon[36109]: pgmap v4045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:46 smithi055 ceph-mon[31863]: pgmap v4045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:47.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6658 sec 2024-03-28T07:39:48.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6659 sec 2024-03-28T07:39:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:48 smithi055 ceph-mon[31863]: pgmap v4046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:48 smithi086 ceph-mon[35163]: pgmap v4046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:48 smithi159 ceph-mon[36109]: pgmap v4046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:49.038 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6660 sec 2024-03-28T07:39:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5987.891119 secs 2024-03-28T07:39:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5987.891119 secs 2024-03-28T07:39:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5987.891119 secs 2024-03-28T07:39:50.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6661 sec 2024-03-28T07:39:50.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:50 smithi055 ceph-mon[31863]: pgmap v4047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:50 smithi086 ceph-mon[35163]: pgmap v4047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:50 smithi159 ceph-mon[36109]: pgmap v4047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:51.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6662 sec 2024-03-28T07:39:52.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6663 sec 2024-03-28T07:39:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:52 smithi055 ceph-mon[31863]: pgmap v4048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:52 smithi086 ceph-mon[35163]: pgmap v4048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:52 smithi159 ceph-mon[36109]: pgmap v4048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:53.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6664 sec 2024-03-28T07:39:54.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6665 sec 2024-03-28T07:39:54.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5992.891245 secs 2024-03-28T07:39:54.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:54 smithi086 ceph-mon[35163]: pgmap v4049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5992.891245 secs 2024-03-28T07:39:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:54 smithi055 ceph-mon[31863]: pgmap v4049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5992.891245 secs 2024-03-28T07:39:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:54 smithi159 ceph-mon[36109]: pgmap v4049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:39:55.039 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6666 sec 2024-03-28T07:39:56.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6667 sec 2024-03-28T07:39:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:56 smithi055 ceph-mon[31863]: pgmap v4050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:56 smithi086 ceph-mon[35163]: pgmap v4050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:56.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:56 smithi159 ceph-mon[36109]: pgmap v4050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:39:57.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6668 sec 2024-03-28T07:39:58.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6669 sec 2024-03-28T07:39:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:58 smithi055 ceph-mon[31863]: pgmap v4051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:58 smithi086 ceph-mon[35163]: pgmap v4051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:58 smithi159 ceph-mon[36109]: pgmap v4051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:39:59.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6670 sec 2024-03-28T07:39:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:39:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 5997.891314 secs 2024-03-28T07:39:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:39:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 5997.891314 secs 2024-03-28T07:39:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:39:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 5997.891314 secs 2024-03-28T07:40:00.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6671 sec 2024-03-28T07:40:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:00 smithi086 ceph-mon[35163]: pgmap v4052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:40:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:00 smithi159 ceph-mon[36109]: pgmap v4052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:40:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:00 smithi055 ceph-mon[31863]: pgmap v4052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:40:01.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6672 sec 2024-03-28T07:40:02.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6673 sec 2024-03-28T07:40:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:02 smithi086 ceph-mon[35163]: pgmap v4053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:02 smithi159 ceph-mon[36109]: pgmap v4053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:02 smithi055 ceph-mon[31863]: pgmap v4053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:03.040 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6674 sec 2024-03-28T07:40:04.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6675 sec 2024-03-28T07:40:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6002.891436 secs 2024-03-28T07:40:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:04 smithi086 ceph-mon[35163]: pgmap v4054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6002.891436 secs 2024-03-28T07:40:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:04 smithi159 ceph-mon[36109]: pgmap v4054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6002.891436 secs 2024-03-28T07:40:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:04 smithi055 ceph-mon[31863]: pgmap v4054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:05.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6676 sec 2024-03-28T07:40:06.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6677 sec 2024-03-28T07:40:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:06 smithi086 ceph-mon[35163]: pgmap v4055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:06.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:06 smithi159 ceph-mon[36109]: pgmap v4055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:06.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:06 smithi055 ceph-mon[31863]: pgmap v4055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:07.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6678 sec 2024-03-28T07:40:08.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6679 sec 2024-03-28T07:40:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:08 smithi086 ceph-mon[35163]: pgmap v4056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:08 smithi159 ceph-mon[36109]: pgmap v4056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:08 smithi055 ceph-mon[31863]: pgmap v4056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:09.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6680 sec 2024-03-28T07:40:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6007.891555 secs 2024-03-28T07:40:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6007.891555 secs 2024-03-28T07:40:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6007.891555 secs 2024-03-28T07:40:10.041 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6681 sec 2024-03-28T07:40:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:10 smithi086 ceph-mon[35163]: pgmap v4057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:10 smithi159 ceph-mon[36109]: pgmap v4057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:10 smithi055 ceph-mon[31863]: pgmap v4057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:11.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6682 sec 2024-03-28T07:40:12.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6683 sec 2024-03-28T07:40:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:12 smithi086 ceph-mon[35163]: pgmap v4058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:12 smithi159 ceph-mon[36109]: pgmap v4058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:12 smithi055 ceph-mon[31863]: pgmap v4058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:13.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6684 sec 2024-03-28T07:40:14.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6685 sec 2024-03-28T07:40:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6012.891627 secs 2024-03-28T07:40:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:14 smithi086 ceph-mon[35163]: pgmap v4059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6012.891627 secs 2024-03-28T07:40:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:14 smithi159 ceph-mon[36109]: pgmap v4059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6012.891627 secs 2024-03-28T07:40:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:14 smithi055 ceph-mon[31863]: pgmap v4059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:15.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6686 sec 2024-03-28T07:40:16.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6687 sec 2024-03-28T07:40:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:16 smithi086 ceph-mon[35163]: pgmap v4060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:16 smithi159 ceph-mon[36109]: pgmap v4060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:16 smithi055 ceph-mon[31863]: pgmap v4060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:17.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6688 sec 2024-03-28T07:40:18.042 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6689 sec 2024-03-28T07:40:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:18 smithi086 ceph-mon[35163]: pgmap v4061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:40:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:18 smithi159 ceph-mon[36109]: pgmap v4061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:40:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:18 smithi055 ceph-mon[31863]: pgmap v4061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:40:19.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6690 sec 2024-03-28T07:40:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6017.891742 secs 2024-03-28T07:40:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6017.891742 secs 2024-03-28T07:40:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6017.891742 secs 2024-03-28T07:40:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6691 sec 2024-03-28T07:40:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:20 smithi055 ceph-mon[31863]: pgmap v4062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:20 smithi086 ceph-mon[35163]: pgmap v4062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:20 smithi159 ceph-mon[36109]: pgmap v4062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:21.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6692 sec 2024-03-28T07:40:22.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6693 sec 2024-03-28T07:40:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:22 smithi055 ceph-mon[31863]: pgmap v4063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:22.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:22 smithi086 ceph-mon[35163]: pgmap v4063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:22 smithi159 ceph-mon[36109]: pgmap v4063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:23.043 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6694 sec 2024-03-28T07:40:24.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6695 sec 2024-03-28T07:40:24.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6022.891867 secs 2024-03-28T07:40:24.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:24 smithi086 ceph-mon[35163]: pgmap v4064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:24.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:40:24.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:40:24.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6022.891867 secs 2024-03-28T07:40:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:24 smithi055 ceph-mon[31863]: pgmap v4064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:40:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:40:24.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6022.891867 secs 2024-03-28T07:40:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:24 smithi159 ceph-mon[36109]: pgmap v4064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:40:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:40:24.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:40:25.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6696 sec 2024-03-28T07:40:25.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:25 smithi055 ceph-mon[31863]: pgmap v4065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:40:25.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:25 smithi055 ceph-mon[31863]: pgmap v4066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:25 smithi086 ceph-mon[35163]: pgmap v4065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:40:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:25 smithi086 ceph-mon[35163]: pgmap v4066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:25 smithi159 ceph-mon[36109]: pgmap v4065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:40:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:25 smithi159 ceph-mon[36109]: pgmap v4066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:26.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6697 sec 2024-03-28T07:40:27.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6698 sec 2024-03-28T07:40:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:27 smithi055 ceph-mon[31863]: pgmap v4067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:27 smithi086 ceph-mon[35163]: pgmap v4067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:27 smithi159 ceph-mon[36109]: pgmap v4067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:28.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6699 sec 2024-03-28T07:40:29.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6700 sec 2024-03-28T07:40:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:29 smithi055 ceph-mon[31863]: pgmap v4068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6027.892001 secs 2024-03-28T07:40:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:29 smithi086 ceph-mon[35163]: pgmap v4068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6027.892001 secs 2024-03-28T07:40:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:29 smithi159 ceph-mon[36109]: pgmap v4068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6027.892001 secs 2024-03-28T07:40:30.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6701 sec 2024-03-28T07:40:31.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6702 sec 2024-03-28T07:40:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:31 smithi055 ceph-mon[31863]: pgmap v4069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:31 smithi086 ceph-mon[35163]: pgmap v4069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:31 smithi159 ceph-mon[36109]: pgmap v4069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:40:32.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6703 sec 2024-03-28T07:40:33.044 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6704 sec 2024-03-28T07:40:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:33 smithi055 ceph-mon[31863]: pgmap v4070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:33 smithi086 ceph-mon[35163]: pgmap v4070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:33 smithi159 ceph-mon[36109]: pgmap v4070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:40:34.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6705 sec 2024-03-28T07:40:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6032.892084 secs 2024-03-28T07:40:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6032.892084 secs 2024-03-28T07:40:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6032.892084 secs 2024-03-28T07:40:35.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6706 sec 2024-03-28T07:40:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:35 smithi086 ceph-mon[35163]: pgmap v4071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:40:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:35 smithi159 ceph-mon[36109]: pgmap v4071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:40:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:35 smithi055 ceph-mon[31863]: pgmap v4071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:40:36.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6707 sec 2024-03-28T07:40:37.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6708 sec 2024-03-28T07:40:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:37 smithi086 ceph-mon[35163]: pgmap v4072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:37 smithi159 ceph-mon[36109]: pgmap v4072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:37 smithi055 ceph-mon[31863]: pgmap v4072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:38.045 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6709 sec 2024-03-28T07:40:39.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6710 sec 2024-03-28T07:40:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:39 smithi086 ceph-mon[35163]: pgmap v4073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6037.892163 secs 2024-03-28T07:40:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:39 smithi159 ceph-mon[36109]: pgmap v4073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6037.892163 secs 2024-03-28T07:40:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:39 smithi055 ceph-mon[31863]: pgmap v4073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6037.892163 secs 2024-03-28T07:40:40.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6711 sec 2024-03-28T07:40:41.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6712 sec 2024-03-28T07:40:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:41 smithi086 ceph-mon[35163]: pgmap v4074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:41.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:41 smithi159 ceph-mon[36109]: pgmap v4074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:41 smithi055 ceph-mon[31863]: pgmap v4074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:42.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6713 sec 2024-03-28T07:40:43.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6714 sec 2024-03-28T07:40:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:43 smithi086 ceph-mon[35163]: pgmap v4075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:43 smithi159 ceph-mon[36109]: pgmap v4075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:43 smithi055 ceph-mon[31863]: pgmap v4075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:44.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6715 sec 2024-03-28T07:40:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6042.892247 secs 2024-03-28T07:40:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6042.892247 secs 2024-03-28T07:40:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6042.892247 secs 2024-03-28T07:40:45.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6716 sec 2024-03-28T07:40:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:45 smithi086 ceph-mon[35163]: pgmap v4076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:45 smithi159 ceph-mon[36109]: pgmap v4076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:45 smithi055 ceph-mon[31863]: pgmap v4076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:46.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6717 sec 2024-03-28T07:40:47.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6718 sec 2024-03-28T07:40:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:47 smithi086 ceph-mon[35163]: pgmap v4077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:47 smithi159 ceph-mon[36109]: pgmap v4077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:47 smithi055 ceph-mon[31863]: pgmap v4077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:48.046 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6719 sec 2024-03-28T07:40:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:48 smithi086 ceph-mon[35163]: pgmap v4078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:48 smithi159 ceph-mon[36109]: pgmap v4078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:48 smithi055 ceph-mon[31863]: pgmap v4078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:49.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6720 sec 2024-03-28T07:40:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6047.892368 secs 2024-03-28T07:40:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6047.892368 secs 2024-03-28T07:40:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6047.892368 secs 2024-03-28T07:40:50.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6721 sec 2024-03-28T07:40:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:50 smithi086 ceph-mon[35163]: pgmap v4079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:50 smithi159 ceph-mon[36109]: pgmap v4079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:50 smithi055 ceph-mon[31863]: pgmap v4079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:51.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6722 sec 2024-03-28T07:40:52.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6723 sec 2024-03-28T07:40:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:52 smithi086 ceph-mon[35163]: pgmap v4080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:52 smithi159 ceph-mon[36109]: pgmap v4080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:52 smithi055 ceph-mon[31863]: pgmap v4080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:53.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6724 sec 2024-03-28T07:40:54.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6725 sec 2024-03-28T07:40:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6052.892490 secs 2024-03-28T07:40:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:54 smithi086 ceph-mon[35163]: pgmap v4081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6052.892490 secs 2024-03-28T07:40:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:54 smithi159 ceph-mon[36109]: pgmap v4081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6052.892490 secs 2024-03-28T07:40:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:54 smithi055 ceph-mon[31863]: pgmap v4081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:40:55.047 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6726 sec 2024-03-28T07:40:56.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6727 sec 2024-03-28T07:40:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:56 smithi086 ceph-mon[35163]: pgmap v4082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:56.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:56 smithi159 ceph-mon[36109]: pgmap v4082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:56.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:56 smithi055 ceph-mon[31863]: pgmap v4082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:40:57.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6728 sec 2024-03-28T07:40:58.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6729 sec 2024-03-28T07:40:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:58 smithi086 ceph-mon[35163]: pgmap v4083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:58 smithi159 ceph-mon[36109]: pgmap v4083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:58 smithi055 ceph-mon[31863]: pgmap v4083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:40:59.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6730 sec 2024-03-28T07:40:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:40:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6057.892606 secs 2024-03-28T07:40:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:40:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6057.892606 secs 2024-03-28T07:40:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:40:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6057.892606 secs 2024-03-28T07:41:00.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6731 sec 2024-03-28T07:41:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:00 smithi086 ceph-mon[35163]: pgmap v4084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:00 smithi159 ceph-mon[36109]: pgmap v4084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:00 smithi055 ceph-mon[31863]: pgmap v4084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:01.048 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6732 sec 2024-03-28T07:41:02.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6733 sec 2024-03-28T07:41:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:02 smithi086 ceph-mon[35163]: pgmap v4085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:02 smithi159 ceph-mon[36109]: pgmap v4085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:02 smithi055 ceph-mon[31863]: pgmap v4085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:03.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6734 sec 2024-03-28T07:41:04.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6735 sec 2024-03-28T07:41:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6062.892731 secs 2024-03-28T07:41:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:04 smithi086 ceph-mon[35163]: pgmap v4086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6062.892731 secs 2024-03-28T07:41:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:04 smithi159 ceph-mon[36109]: pgmap v4086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6062.892731 secs 2024-03-28T07:41:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:04 smithi055 ceph-mon[31863]: pgmap v4086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:05.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6736 sec 2024-03-28T07:41:06.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6737 sec 2024-03-28T07:41:06.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:06 smithi055 ceph-mon[31863]: pgmap v4087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:06 smithi086 ceph-mon[35163]: pgmap v4087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:06 smithi159 ceph-mon[36109]: pgmap v4087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:07.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6738 sec 2024-03-28T07:41:08.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6739 sec 2024-03-28T07:41:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:08 smithi055 ceph-mon[31863]: pgmap v4088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:08 smithi086 ceph-mon[35163]: pgmap v4088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:08 smithi159 ceph-mon[36109]: pgmap v4088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:09.049 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6740 sec 2024-03-28T07:41:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6067.892866 secs 2024-03-28T07:41:09.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6067.892866 secs 2024-03-28T07:41:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6067.892866 secs 2024-03-28T07:41:10.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6741 sec 2024-03-28T07:41:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:10 smithi055 ceph-mon[31863]: pgmap v4089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:10 smithi086 ceph-mon[35163]: pgmap v4089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:10 smithi159 ceph-mon[36109]: pgmap v4089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:11.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6742 sec 2024-03-28T07:41:12.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6743 sec 2024-03-28T07:41:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:12 smithi055 ceph-mon[31863]: pgmap v4090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:12 smithi086 ceph-mon[35163]: pgmap v4090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:12 smithi159 ceph-mon[36109]: pgmap v4090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:13.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6744 sec 2024-03-28T07:41:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6072.892988 secs 2024-03-28T07:41:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6072.892988 secs 2024-03-28T07:41:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6072.892988 secs 2024-03-28T07:41:14.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6745 sec 2024-03-28T07:41:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:14 smithi055 ceph-mon[31863]: pgmap v4091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:14 smithi086 ceph-mon[35163]: pgmap v4091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:14 smithi159 ceph-mon[36109]: pgmap v4091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:15.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6746 sec 2024-03-28T07:41:16.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6747 sec 2024-03-28T07:41:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:16 smithi086 ceph-mon[35163]: pgmap v4092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:16 smithi159 ceph-mon[36109]: pgmap v4092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:16 smithi055 ceph-mon[31863]: pgmap v4092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:41:17.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6748 sec 2024-03-28T07:41:18.050 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6749 sec 2024-03-28T07:41:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:18 smithi086 ceph-mon[35163]: pgmap v4093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6077.893055 secs 2024-03-28T07:41:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:18 smithi159 ceph-mon[36109]: pgmap v4093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6077.893055 secs 2024-03-28T07:41:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:18 smithi055 ceph-mon[31863]: pgmap v4093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6077.893055 secs 2024-03-28T07:41:19.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6750 sec 2024-03-28T07:41:20.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6751 sec 2024-03-28T07:41:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:20 smithi086 ceph-mon[35163]: pgmap v4094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:20.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:20 smithi159 ceph-mon[36109]: pgmap v4094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:20 smithi055 ceph-mon[31863]: pgmap v4094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:21.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6752 sec 2024-03-28T07:41:22.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6753 sec 2024-03-28T07:41:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:22 smithi086 ceph-mon[35163]: pgmap v4095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:22 smithi159 ceph-mon[36109]: pgmap v4095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:22 smithi055 ceph-mon[31863]: pgmap v4095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:23.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6754 sec 2024-03-28T07:41:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6082.893184 secs 2024-03-28T07:41:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6082.893184 secs 2024-03-28T07:41:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6082.893184 secs 2024-03-28T07:41:24.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6755 sec 2024-03-28T07:41:24.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:24 smithi086 ceph-mon[35163]: pgmap v4096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:24.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:41:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:24 smithi159 ceph-mon[36109]: pgmap v4096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:41:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:24 smithi055 ceph-mon[31863]: pgmap v4096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:41:25.051 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6756 sec 2024-03-28T07:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:25 smithi086 ceph-mon[35163]: pgmap v4097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:25 smithi086 ceph-mon[35163]: pgmap v4098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:41:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:41:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:41:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:25 smithi159 ceph-mon[36109]: pgmap v4097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:25 smithi159 ceph-mon[36109]: pgmap v4098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:41:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:41:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:41:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:41:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:25 smithi055 ceph-mon[31863]: pgmap v4097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:25 smithi055 ceph-mon[31863]: pgmap v4098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:41:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:41:26.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6757 sec 2024-03-28T07:41:27.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6758 sec 2024-03-28T07:41:28.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6759 sec 2024-03-28T07:41:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:28 smithi086 ceph-mon[35163]: pgmap v4099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:28 smithi159 ceph-mon[36109]: pgmap v4099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:28 smithi055 ceph-mon[31863]: pgmap v4099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:29.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6760 sec 2024-03-28T07:41:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6087.893304 secs 2024-03-28T07:41:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6087.893304 secs 2024-03-28T07:41:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6087.893304 secs 2024-03-28T07:41:30.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6761 sec 2024-03-28T07:41:30.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:30 smithi055 ceph-mon[31863]: pgmap v4100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:30 smithi086 ceph-mon[35163]: pgmap v4100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:30 smithi159 ceph-mon[36109]: pgmap v4100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:31.052 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6762 sec 2024-03-28T07:41:32.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6763 sec 2024-03-28T07:41:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:32 smithi055 ceph-mon[31863]: pgmap v4101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:32 smithi086 ceph-mon[35163]: pgmap v4101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:32 smithi159 ceph-mon[36109]: pgmap v4101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:33.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6764 sec 2024-03-28T07:41:34.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6765 sec 2024-03-28T07:41:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6092.893359 secs 2024-03-28T07:41:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:34 smithi055 ceph-mon[31863]: pgmap v4102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6092.893359 secs 2024-03-28T07:41:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:34 smithi086 ceph-mon[35163]: pgmap v4102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6092.893359 secs 2024-03-28T07:41:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:34 smithi159 ceph-mon[36109]: pgmap v4102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:41:35.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6766 sec 2024-03-28T07:41:36.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6767 sec 2024-03-28T07:41:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:36 smithi055 ceph-mon[31863]: pgmap v4103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:41:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:36 smithi086 ceph-mon[35163]: pgmap v4103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:41:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:36 smithi159 ceph-mon[36109]: pgmap v4103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:41:37.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6768 sec 2024-03-28T07:41:38.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6769 sec 2024-03-28T07:41:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:38 smithi055 ceph-mon[31863]: pgmap v4104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:38 smithi086 ceph-mon[35163]: pgmap v4104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:38 smithi159 ceph-mon[36109]: pgmap v4104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:39.053 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6770 sec 2024-03-28T07:41:39.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6097.893473 secs 2024-03-28T07:41:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6097.893473 secs 2024-03-28T07:41:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6097.893473 secs 2024-03-28T07:41:40.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6771 sec 2024-03-28T07:41:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:40 smithi086 ceph-mon[35163]: pgmap v4105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:40.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:40 smithi159 ceph-mon[36109]: pgmap v4105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:40 smithi055 ceph-mon[31863]: pgmap v4105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:41.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6772 sec 2024-03-28T07:41:42.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6773 sec 2024-03-28T07:41:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:42 smithi086 ceph-mon[35163]: pgmap v4106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:42.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:42 smithi159 ceph-mon[36109]: pgmap v4106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:42 smithi055 ceph-mon[31863]: pgmap v4106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:43.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6774 sec 2024-03-28T07:41:44.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6775 sec 2024-03-28T07:41:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6102.893547 secs 2024-03-28T07:41:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:44 smithi086 ceph-mon[35163]: pgmap v4107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6102.893547 secs 2024-03-28T07:41:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:44 smithi159 ceph-mon[36109]: pgmap v4107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6102.893547 secs 2024-03-28T07:41:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:44 smithi055 ceph-mon[31863]: pgmap v4107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:45.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6776 sec 2024-03-28T07:41:46.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6777 sec 2024-03-28T07:41:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:46 smithi086 ceph-mon[35163]: pgmap v4108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:46 smithi159 ceph-mon[36109]: pgmap v4108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:46.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:46 smithi055 ceph-mon[31863]: pgmap v4108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:47.054 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6778 sec 2024-03-28T07:41:48.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6779 sec 2024-03-28T07:41:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:48 smithi086 ceph-mon[35163]: pgmap v4109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:48 smithi159 ceph-mon[36109]: pgmap v4109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:48 smithi055 ceph-mon[31863]: pgmap v4109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:49.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6780 sec 2024-03-28T07:41:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6107.893606 secs 2024-03-28T07:41:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6107.893606 secs 2024-03-28T07:41:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6107.893606 secs 2024-03-28T07:41:50.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6781 sec 2024-03-28T07:41:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:50 smithi086 ceph-mon[35163]: pgmap v4110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:50 smithi159 ceph-mon[36109]: pgmap v4110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:50 smithi055 ceph-mon[31863]: pgmap v4110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:51.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6782 sec 2024-03-28T07:41:52.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6783 sec 2024-03-28T07:41:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:52 smithi086 ceph-mon[35163]: pgmap v4111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:52 smithi159 ceph-mon[36109]: pgmap v4111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:52 smithi055 ceph-mon[31863]: pgmap v4111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:53.055 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6784 sec 2024-03-28T07:41:54.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6785 sec 2024-03-28T07:41:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6112.893720 secs 2024-03-28T07:41:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:54 smithi086 ceph-mon[35163]: pgmap v4112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6112.893720 secs 2024-03-28T07:41:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:54 smithi159 ceph-mon[36109]: pgmap v4112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6112.893720 secs 2024-03-28T07:41:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:54 smithi055 ceph-mon[31863]: pgmap v4112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:55.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6786 sec 2024-03-28T07:41:56.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6787 sec 2024-03-28T07:41:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:56 smithi086 ceph-mon[35163]: pgmap v4113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:56.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:56 smithi159 ceph-mon[36109]: pgmap v4113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:56.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:56 smithi055 ceph-mon[31863]: pgmap v4113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:41:57.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6788 sec 2024-03-28T07:41:58.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6789 sec 2024-03-28T07:41:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:58 smithi086 ceph-mon[35163]: pgmap v4114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:58 smithi159 ceph-mon[36109]: pgmap v4114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:58 smithi055 ceph-mon[31863]: pgmap v4114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:41:59.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6790 sec 2024-03-28T07:41:59.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:41:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6117.893811 secs 2024-03-28T07:41:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:41:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6117.893811 secs 2024-03-28T07:41:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:41:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6117.893811 secs 2024-03-28T07:42:00.056 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6791 sec 2024-03-28T07:42:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:00 smithi086 ceph-mon[35163]: pgmap v4115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:00 smithi159 ceph-mon[36109]: pgmap v4115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:00 smithi055 ceph-mon[31863]: pgmap v4115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:01.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6792 sec 2024-03-28T07:42:02.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6793 sec 2024-03-28T07:42:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:02 smithi086 ceph-mon[35163]: pgmap v4116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:02 smithi159 ceph-mon[36109]: pgmap v4116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:02 smithi055 ceph-mon[31863]: pgmap v4116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:03.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6794 sec 2024-03-28T07:42:04.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6795 sec 2024-03-28T07:42:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6122.893878 secs 2024-03-28T07:42:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:04 smithi086 ceph-mon[35163]: pgmap v4117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6122.893878 secs 2024-03-28T07:42:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:04 smithi159 ceph-mon[36109]: pgmap v4117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6122.893878 secs 2024-03-28T07:42:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:04 smithi055 ceph-mon[31863]: pgmap v4117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:05.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6796 sec 2024-03-28T07:42:06.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6797 sec 2024-03-28T07:42:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:06 smithi086 ceph-mon[35163]: pgmap v4118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:06 smithi159 ceph-mon[36109]: pgmap v4118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:06.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:06 smithi055 ceph-mon[31863]: pgmap v4118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:07.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6798 sec 2024-03-28T07:42:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:07 smithi086 ceph-mon[35163]: pgmap v4119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:07.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:07 smithi159 ceph-mon[36109]: pgmap v4119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:07.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:07 smithi055 ceph-mon[31863]: pgmap v4119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:08.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6799 sec 2024-03-28T07:42:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6127.893951 secs 2024-03-28T07:42:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6127.893951 secs 2024-03-28T07:42:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6127.893951 secs 2024-03-28T07:42:09.057 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6800 sec 2024-03-28T07:42:09.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:09 smithi159 ceph-mon[36109]: pgmap v4120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:09 smithi086 ceph-mon[35163]: pgmap v4120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:09 smithi055 ceph-mon[31863]: pgmap v4120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:10.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6801 sec 2024-03-28T07:42:11.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6802 sec 2024-03-28T07:42:12.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6803 sec 2024-03-28T07:42:12.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:12 smithi055 ceph-mon[31863]: pgmap v4121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:12 smithi086 ceph-mon[35163]: pgmap v4121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:12 smithi159 ceph-mon[36109]: pgmap v4121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:13.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6804 sec 2024-03-28T07:42:14.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6805 sec 2024-03-28T07:42:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6132.894026 secs 2024-03-28T07:42:14.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:14 smithi055 ceph-mon[31863]: pgmap v4122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6132.894026 secs 2024-03-28T07:42:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:14 smithi086 ceph-mon[35163]: pgmap v4122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6132.894026 secs 2024-03-28T07:42:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:14 smithi159 ceph-mon[36109]: pgmap v4122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:15.058 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6806 sec 2024-03-28T07:42:16.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6807 sec 2024-03-28T07:42:16.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:16 smithi055 ceph-mon[31863]: pgmap v4123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:16 smithi086 ceph-mon[35163]: pgmap v4123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:16 smithi159 ceph-mon[36109]: pgmap v4123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:17.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6808 sec 2024-03-28T07:42:18.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6809 sec 2024-03-28T07:42:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:18 smithi055 ceph-mon[31863]: pgmap v4124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:18 smithi086 ceph-mon[35163]: pgmap v4124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:18 smithi159 ceph-mon[36109]: pgmap v4124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:19.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6810 sec 2024-03-28T07:42:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6137.894149 secs 2024-03-28T07:42:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6137.894149 secs 2024-03-28T07:42:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6137.894149 secs 2024-03-28T07:42:20.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6811 sec 2024-03-28T07:42:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:20 smithi086 ceph-mon[35163]: pgmap v4125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:20 smithi159 ceph-mon[36109]: pgmap v4125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:20 smithi055 ceph-mon[31863]: pgmap v4125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:21.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6812 sec 2024-03-28T07:42:22.059 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6813 sec 2024-03-28T07:42:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:22 smithi086 ceph-mon[35163]: pgmap v4126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:22 smithi159 ceph-mon[36109]: pgmap v4126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:22 smithi055 ceph-mon[31863]: pgmap v4126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:23.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6814 sec 2024-03-28T07:42:24.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6815 sec 2024-03-28T07:42:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6142.894268 secs 2024-03-28T07:42:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:24 smithi086 ceph-mon[35163]: pgmap v4127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6142.894268 secs 2024-03-28T07:42:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:24 smithi159 ceph-mon[36109]: pgmap v4127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6142.894268 secs 2024-03-28T07:42:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:24 smithi055 ceph-mon[31863]: pgmap v4127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:25.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6816 sec 2024-03-28T07:42:26.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6817 sec 2024-03-28T07:42:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:26 smithi086 ceph-mon[35163]: pgmap v4128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:42:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:26 smithi159 ceph-mon[36109]: pgmap v4128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:42:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:26 smithi055 ceph-mon[31863]: pgmap v4128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:42:27.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6818 sec 2024-03-28T07:42:28.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6819 sec 2024-03-28T07:42:28.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:28 smithi086 ceph-mon[35163]: pgmap v4129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:28 smithi055 ceph-mon[31863]: pgmap v4129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:28 smithi159 ceph-mon[36109]: pgmap v4129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:29.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6820 sec 2024-03-28T07:42:29.438 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6147.894307 secs 2024-03-28T07:42:29.452 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6147.894307 secs 2024-03-28T07:42:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6147.894307 secs 2024-03-28T07:42:30.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6821 sec 2024-03-28T07:42:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:30 smithi086 ceph-mon[35163]: pgmap v4130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:30 smithi159 ceph-mon[36109]: pgmap v4130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:30 smithi055 ceph-mon[31863]: pgmap v4130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:31.060 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6822 sec 2024-03-28T07:42:32.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6823 sec 2024-03-28T07:42:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:32 smithi055 ceph-mon[31863]: pgmap v4131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:32 smithi086 ceph-mon[35163]: pgmap v4131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:32 smithi159 ceph-mon[36109]: pgmap v4131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6824 sec 2024-03-28T07:42:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:42:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:42:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: pgmap v4132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:42:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: pgmap v4133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:42:33.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: pgmap v4132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: pgmap v4133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: pgmap v4132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:42:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: pgmap v4133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:42:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:42:34.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6825 sec 2024-03-28T07:42:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6152.894328 secs 2024-03-28T07:42:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6152.894328 secs 2024-03-28T07:42:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6152.894328 secs 2024-03-28T07:42:35.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6826 sec 2024-03-28T07:42:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:35 smithi086 ceph-mon[35163]: pgmap v4134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:35 smithi159 ceph-mon[36109]: pgmap v4134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:35 smithi055 ceph-mon[31863]: pgmap v4134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:36.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6827 sec 2024-03-28T07:42:37.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6828 sec 2024-03-28T07:42:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:37 smithi086 ceph-mon[35163]: pgmap v4135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:37 smithi159 ceph-mon[36109]: pgmap v4135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:37.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:37 smithi055 ceph-mon[31863]: pgmap v4135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:38.061 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6829 sec 2024-03-28T07:42:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6157.894393 secs 2024-03-28T07:42:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6157.894393 secs 2024-03-28T07:42:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6157.894393 secs 2024-03-28T07:42:39.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6830 sec 2024-03-28T07:42:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:39 smithi086 ceph-mon[35163]: pgmap v4136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:39 smithi159 ceph-mon[36109]: pgmap v4136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:39 smithi055 ceph-mon[31863]: pgmap v4136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:40.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6831 sec 2024-03-28T07:42:41.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6832 sec 2024-03-28T07:42:41.798 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:41 smithi086 ceph-mon[35163]: pgmap v4137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:41 smithi159 ceph-mon[36109]: pgmap v4137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:41 smithi055 ceph-mon[31863]: pgmap v4137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:42.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6833 sec 2024-03-28T07:42:43.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6834 sec 2024-03-28T07:42:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:43 smithi086 ceph-mon[35163]: pgmap v4138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:42:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6162.894475 secs 2024-03-28T07:42:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:43 smithi159 ceph-mon[36109]: pgmap v4138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:42:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6162.894475 secs 2024-03-28T07:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:43 smithi055 ceph-mon[31863]: pgmap v4138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:42:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6162.894475 secs 2024-03-28T07:42:44.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6835 sec 2024-03-28T07:42:45.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6836 sec 2024-03-28T07:42:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:45 smithi086 ceph-mon[35163]: pgmap v4139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:45 smithi159 ceph-mon[36109]: pgmap v4139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:45 smithi055 ceph-mon[31863]: pgmap v4139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:46.062 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6837 sec 2024-03-28T07:42:47.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6838 sec 2024-03-28T07:42:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:47 smithi086 ceph-mon[35163]: pgmap v4140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:47.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:47 smithi159 ceph-mon[36109]: pgmap v4140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:47 smithi055 ceph-mon[31863]: pgmap v4140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:48.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6839 sec 2024-03-28T07:42:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6167.894553 secs 2024-03-28T07:42:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6167.894553 secs 2024-03-28T07:42:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6167.894553 secs 2024-03-28T07:42:49.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6840 sec 2024-03-28T07:42:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:49 smithi086 ceph-mon[35163]: pgmap v4141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:49 smithi159 ceph-mon[36109]: pgmap v4141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:49 smithi055 ceph-mon[31863]: pgmap v4141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:50.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6841 sec 2024-03-28T07:42:51.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6842 sec 2024-03-28T07:42:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:51 smithi086 ceph-mon[35163]: pgmap v4142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:51.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:51 smithi159 ceph-mon[36109]: pgmap v4142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:51.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:51 smithi055 ceph-mon[31863]: pgmap v4142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:42:52.063 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6843 sec 2024-03-28T07:42:53.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6844 sec 2024-03-28T07:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:53 smithi086 ceph-mon[35163]: pgmap v4143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6172.894674 secs 2024-03-28T07:42:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:53 smithi159 ceph-mon[36109]: pgmap v4143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6172.894674 secs 2024-03-28T07:42:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:53 smithi055 ceph-mon[31863]: pgmap v4143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:42:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6172.894674 secs 2024-03-28T07:42:54.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6845 sec 2024-03-28T07:42:55.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6846 sec 2024-03-28T07:42:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:55 smithi086 ceph-mon[35163]: pgmap v4144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:55 smithi159 ceph-mon[36109]: pgmap v4144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:55 smithi055 ceph-mon[31863]: pgmap v4144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:56.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6847 sec 2024-03-28T07:42:57.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6848 sec 2024-03-28T07:42:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:57 smithi086 ceph-mon[35163]: pgmap v4145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:57 smithi159 ceph-mon[36109]: pgmap v4145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:57 smithi055 ceph-mon[31863]: pgmap v4145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:58.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6849 sec 2024-03-28T07:42:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6177.894807 secs 2024-03-28T07:42:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6177.894807 secs 2024-03-28T07:42:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6177.894807 secs 2024-03-28T07:42:59.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6850 sec 2024-03-28T07:42:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:42:59 smithi086 ceph-mon[35163]: pgmap v4146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:42:59 smithi159 ceph-mon[36109]: pgmap v4146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:42:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:42:59 smithi055 ceph-mon[31863]: pgmap v4146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:00.064 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6851 sec 2024-03-28T07:43:01.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6852 sec 2024-03-28T07:43:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:01 smithi055 ceph-mon[31863]: pgmap v4147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:02.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6853 sec 2024-03-28T07:43:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:01 smithi086 ceph-mon[35163]: pgmap v4147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:01 smithi159 ceph-mon[36109]: pgmap v4147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:03.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6854 sec 2024-03-28T07:43:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:03 smithi055 ceph-mon[31863]: pgmap v4148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6182.894882 secs 2024-03-28T07:43:04.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6855 sec 2024-03-28T07:43:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:03 smithi086 ceph-mon[35163]: pgmap v4148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6182.894882 secs 2024-03-28T07:43:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:03 smithi159 ceph-mon[36109]: pgmap v4148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6182.894882 secs 2024-03-28T07:43:05.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6856 sec 2024-03-28T07:43:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:05 smithi055 ceph-mon[31863]: pgmap v4149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:06.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6857 sec 2024-03-28T07:43:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:05 smithi086 ceph-mon[35163]: pgmap v4149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:05 smithi159 ceph-mon[36109]: pgmap v4149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:07.066 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6858 sec 2024-03-28T07:43:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:07 smithi055 ceph-mon[31863]: pgmap v4150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:08.066 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6859 sec 2024-03-28T07:43:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:07 smithi086 ceph-mon[35163]: pgmap v4150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:08.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:07 smithi159 ceph-mon[36109]: pgmap v4150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6187.894971 secs 2024-03-28T07:43:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6187.894971 secs 2024-03-28T07:43:09.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6860 sec 2024-03-28T07:43:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6187.894971 secs 2024-03-28T07:43:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:09 smithi055 ceph-mon[31863]: pgmap v4151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:09 smithi159 ceph-mon[36109]: pgmap v4151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:10.065 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6861 sec 2024-03-28T07:43:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:09 smithi086 ceph-mon[35163]: pgmap v4151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:11.066 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6862 sec 2024-03-28T07:43:11.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:11 smithi055 ceph-mon[31863]: pgmap v4152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:12.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6863 sec 2024-03-28T07:43:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:11 smithi086 ceph-mon[35163]: pgmap v4152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:12.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:11 smithi159 ceph-mon[36109]: pgmap v4152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:13.066 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6864 sec 2024-03-28T07:43:14.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6865 sec 2024-03-28T07:43:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:13 smithi086 ceph-mon[35163]: pgmap v4153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:43:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6192.896038 secs 2024-03-28T07:43:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:13 smithi159 ceph-mon[36109]: pgmap v4153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:43:14.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6192.896038 secs 2024-03-28T07:43:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:13 smithi055 ceph-mon[31863]: pgmap v4153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:43:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6192.896038 secs 2024-03-28T07:43:15.066 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6866 sec 2024-03-28T07:43:16.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6867 sec 2024-03-28T07:43:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:15 smithi086 ceph-mon[35163]: pgmap v4154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:15 smithi159 ceph-mon[36109]: pgmap v4154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:15 smithi055 ceph-mon[31863]: pgmap v4154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:17.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6868 sec 2024-03-28T07:43:18.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6869 sec 2024-03-28T07:43:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:17 smithi086 ceph-mon[35163]: pgmap v4155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:18.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:17 smithi159 ceph-mon[36109]: pgmap v4155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:18.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:17 smithi055 ceph-mon[31863]: pgmap v4155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:43:19.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6870 sec 2024-03-28T07:43:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6197.896162 secs 2024-03-28T07:43:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6197.896162 secs 2024-03-28T07:43:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6197.896162 secs 2024-03-28T07:43:20.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6871 sec 2024-03-28T07:43:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:19 smithi086 ceph-mon[35163]: pgmap v4156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:19 smithi159 ceph-mon[36109]: pgmap v4156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:20.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:19 smithi055 ceph-mon[31863]: pgmap v4156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:21.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6872 sec 2024-03-28T07:43:22.067 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6873 sec 2024-03-28T07:43:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:21 smithi086 ceph-mon[35163]: pgmap v4157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:21 smithi159 ceph-mon[36109]: pgmap v4157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:22.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:21 smithi055 ceph-mon[31863]: pgmap v4157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:23.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6874 sec 2024-03-28T07:43:24.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6875 sec 2024-03-28T07:43:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:23 smithi086 ceph-mon[35163]: pgmap v4158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6202.896241 secs 2024-03-28T07:43:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:23 smithi159 ceph-mon[36109]: pgmap v4158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6202.896241 secs 2024-03-28T07:43:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:23 smithi055 ceph-mon[31863]: pgmap v4158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6202.896241 secs 2024-03-28T07:43:25.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6876 sec 2024-03-28T07:43:26.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6877 sec 2024-03-28T07:43:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:25 smithi086 ceph-mon[35163]: pgmap v4159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:26.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:25 smithi159 ceph-mon[36109]: pgmap v4159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:25 smithi055 ceph-mon[31863]: pgmap v4159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:27.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6878 sec 2024-03-28T07:43:28.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6879 sec 2024-03-28T07:43:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:27 smithi086 ceph-mon[35163]: pgmap v4160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:28.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:27 smithi159 ceph-mon[36109]: pgmap v4160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:27 smithi055 ceph-mon[31863]: pgmap v4160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:29.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6207.896358 secs 2024-03-28T07:43:29.068 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6880 sec 2024-03-28T07:43:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6207.896358 secs 2024-03-28T07:43:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6207.896358 secs 2024-03-28T07:43:30.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6881 sec 2024-03-28T07:43:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:29 smithi086 ceph-mon[35163]: pgmap v4161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:30.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:29 smithi159 ceph-mon[36109]: pgmap v4161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:30.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:29 smithi055 ceph-mon[31863]: pgmap v4161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:31.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6882 sec 2024-03-28T07:43:32.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6883 sec 2024-03-28T07:43:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:31 smithi086 ceph-mon[35163]: pgmap v4162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:31 smithi159 ceph-mon[36109]: pgmap v4162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:31 smithi055 ceph-mon[31863]: pgmap v4162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:33.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6884 sec 2024-03-28T07:43:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:33 smithi086 ceph-mon[35163]: pgmap v4163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6212.896440 secs 2024-03-28T07:43:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:43:34.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6885 sec 2024-03-28T07:43:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:33 smithi159 ceph-mon[36109]: pgmap v4163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6212.896440 secs 2024-03-28T07:43:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:43:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:33 smithi055 ceph-mon[31863]: pgmap v4163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6212.896440 secs 2024-03-28T07:43:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:43:35.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6886 sec 2024-03-28T07:43:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:35 smithi086 ceph-mon[35163]: pgmap v4164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:36.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6887 sec 2024-03-28T07:43:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:35 smithi159 ceph-mon[36109]: pgmap v4164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:35 smithi055 ceph-mon[31863]: pgmap v4164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:37.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6888 sec 2024-03-28T07:43:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:37 smithi086 ceph-mon[35163]: pgmap v4165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:38.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6889 sec 2024-03-28T07:43:38.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:37 smithi159 ceph-mon[36109]: pgmap v4165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:37 smithi055 ceph-mon[31863]: pgmap v4165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6217.896561 secs 2024-03-28T07:43:39.069 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6890 sec 2024-03-28T07:43:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6217.896561 secs 2024-03-28T07:43:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6217.896561 secs 2024-03-28T07:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: pgmap v4166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:43:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6891 sec 2024-03-28T07:43:40.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: pgmap v4166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:40.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:43:40.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:43:40.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: pgmap v4166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:43:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:43:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:40 smithi086 ceph-mon[35163]: pgmap v4167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:43:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:40 smithi086 ceph-mon[35163]: pgmap v4168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:41.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6892 sec 2024-03-28T07:43:41.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:40 smithi159 ceph-mon[36109]: pgmap v4167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:43:41.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:40 smithi159 ceph-mon[36109]: pgmap v4168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:41.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:40 smithi055 ceph-mon[31863]: pgmap v4167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:43:41.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:40 smithi055 ceph-mon[31863]: pgmap v4168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:42.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6893 sec 2024-03-28T07:43:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:42 smithi086 ceph-mon[35163]: pgmap v4169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:43.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6894 sec 2024-03-28T07:43:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:42 smithi159 ceph-mon[36109]: pgmap v4169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:43.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:42 smithi055 ceph-mon[31863]: pgmap v4169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6222.896652 secs 2024-03-28T07:43:44.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6895 sec 2024-03-28T07:43:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6222.896652 secs 2024-03-28T07:43:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6222.896652 secs 2024-03-28T07:43:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:44 smithi086 ceph-mon[35163]: pgmap v4170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:45.070 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6896 sec 2024-03-28T07:43:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:44 smithi159 ceph-mon[36109]: pgmap v4170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:44 smithi055 ceph-mon[31863]: pgmap v4170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T07:43:46.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6897 sec 2024-03-28T07:43:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:46 smithi086 ceph-mon[35163]: pgmap v4171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:43:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:46 smithi159 ceph-mon[36109]: pgmap v4171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:43:47.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6898 sec 2024-03-28T07:43:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:46 smithi055 ceph-mon[31863]: pgmap v4171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T07:43:48.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6899 sec 2024-03-28T07:43:49.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6900 sec 2024-03-28T07:43:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:48 smithi055 ceph-mon[31863]: pgmap v4172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6227.896768 secs 2024-03-28T07:43:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:48 smithi086 ceph-mon[35163]: pgmap v4172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6227.896768 secs 2024-03-28T07:43:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:48 smithi159 ceph-mon[36109]: pgmap v4172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6227.896768 secs 2024-03-28T07:43:50.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6901 sec 2024-03-28T07:43:51.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6902 sec 2024-03-28T07:43:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:50 smithi055 ceph-mon[31863]: pgmap v4173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:50 smithi086 ceph-mon[35163]: pgmap v4173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:50 smithi159 ceph-mon[36109]: pgmap v4173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:43:52.071 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6903 sec 2024-03-28T07:43:53.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6904 sec 2024-03-28T07:43:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:52 smithi055 ceph-mon[31863]: pgmap v4174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:52 smithi086 ceph-mon[35163]: pgmap v4174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:52 smithi159 ceph-mon[36109]: pgmap v4174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:54.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6905 sec 2024-03-28T07:43:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6232.896891 secs 2024-03-28T07:43:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6232.896891 secs 2024-03-28T07:43:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6232.896891 secs 2024-03-28T07:43:55.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6906 sec 2024-03-28T07:43:55.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:54 smithi055 ceph-mon[31863]: pgmap v4175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:55.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:54 smithi086 ceph-mon[35163]: pgmap v4175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:54 smithi159 ceph-mon[36109]: pgmap v4175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:43:56.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6907 sec 2024-03-28T07:43:57.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6908 sec 2024-03-28T07:43:57.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:56 smithi055 ceph-mon[31863]: pgmap v4176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:56 smithi086 ceph-mon[35163]: pgmap v4176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:56 smithi159 ceph-mon[36109]: pgmap v4176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:43:58.072 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6909 sec 2024-03-28T07:43:59.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6910 sec 2024-03-28T07:43:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:58 smithi055 ceph-mon[31863]: pgmap v4177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:43:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6237.897016 secs 2024-03-28T07:43:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:58 smithi086 ceph-mon[35163]: pgmap v4177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:43:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6237.897016 secs 2024-03-28T07:43:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:58 smithi159 ceph-mon[36109]: pgmap v4177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:43:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:43:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6237.897016 secs 2024-03-28T07:44:00.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6911 sec 2024-03-28T07:44:01.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6912 sec 2024-03-28T07:44:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:00 smithi055 ceph-mon[31863]: pgmap v4178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:00 smithi086 ceph-mon[35163]: pgmap v4178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:00 smithi159 ceph-mon[36109]: pgmap v4178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:02.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6913 sec 2024-03-28T07:44:03.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6914 sec 2024-03-28T07:44:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:02 smithi055 ceph-mon[31863]: pgmap v4179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:02 smithi086 ceph-mon[35163]: pgmap v4179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:02 smithi159 ceph-mon[36109]: pgmap v4179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:04.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6915 sec 2024-03-28T07:44:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6242.897096 secs 2024-03-28T07:44:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6242.897096 secs 2024-03-28T07:44:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6242.897096 secs 2024-03-28T07:44:05.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6916 sec 2024-03-28T07:44:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:04 smithi086 ceph-mon[35163]: pgmap v4180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:05.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:04 smithi159 ceph-mon[36109]: pgmap v4180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:05.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:04 smithi055 ceph-mon[31863]: pgmap v4180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:06.073 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6917 sec 2024-03-28T07:44:07.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6918 sec 2024-03-28T07:44:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:06 smithi086 ceph-mon[35163]: pgmap v4181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:06 smithi159 ceph-mon[36109]: pgmap v4181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:06 smithi055 ceph-mon[31863]: pgmap v4181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:08.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6919 sec 2024-03-28T07:44:09.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6920 sec 2024-03-28T07:44:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:08 smithi086 ceph-mon[35163]: pgmap v4182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6247.897148 secs 2024-03-28T07:44:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:08 smithi159 ceph-mon[36109]: pgmap v4182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6247.897148 secs 2024-03-28T07:44:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:08 smithi055 ceph-mon[31863]: pgmap v4182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6247.897148 secs 2024-03-28T07:44:10.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6921 sec 2024-03-28T07:44:11.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6922 sec 2024-03-28T07:44:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:10 smithi086 ceph-mon[35163]: pgmap v4183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:11.326 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:10 smithi159 ceph-mon[36109]: pgmap v4183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:11.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:10 smithi055 ceph-mon[31863]: pgmap v4183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:12.074 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6923 sec 2024-03-28T07:44:13.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6924 sec 2024-03-28T07:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:12 smithi086 ceph-mon[35163]: pgmap v4184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:13.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:12 smithi159 ceph-mon[36109]: pgmap v4184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:13.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:12 smithi055 ceph-mon[31863]: pgmap v4184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:14.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6925 sec 2024-03-28T07:44:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6252.897227 secs 2024-03-28T07:44:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6252.897227 secs 2024-03-28T07:44:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6252.897227 secs 2024-03-28T07:44:15.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6926 sec 2024-03-28T07:44:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:14 smithi086 ceph-mon[35163]: pgmap v4185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:14 smithi159 ceph-mon[36109]: pgmap v4185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:14 smithi055 ceph-mon[31863]: pgmap v4185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:16.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6927 sec 2024-03-28T07:44:17.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6928 sec 2024-03-28T07:44:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:16 smithi086 ceph-mon[35163]: pgmap v4186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:16 smithi159 ceph-mon[36109]: pgmap v4186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:16 smithi055 ceph-mon[31863]: pgmap v4186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:18.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6929 sec 2024-03-28T07:44:19.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6930 sec 2024-03-28T07:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:19 smithi086 ceph-mon[35163]: pgmap v4187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6257.897351 secs 2024-03-28T07:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:19 smithi159 ceph-mon[36109]: pgmap v4187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6257.897351 secs 2024-03-28T07:44:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:19 smithi055 ceph-mon[31863]: pgmap v4187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6257.897351 secs 2024-03-28T07:44:20.075 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6931 sec 2024-03-28T07:44:21.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6932 sec 2024-03-28T07:44:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:21 smithi086 ceph-mon[35163]: pgmap v4188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:21.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:21 smithi159 ceph-mon[36109]: pgmap v4188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:21.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:21 smithi055 ceph-mon[31863]: pgmap v4188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:22.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6933 sec 2024-03-28T07:44:23.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6934 sec 2024-03-28T07:44:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:23 smithi086 ceph-mon[35163]: pgmap v4189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:23 smithi159 ceph-mon[36109]: pgmap v4189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:23 smithi055 ceph-mon[31863]: pgmap v4189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:24.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6935 sec 2024-03-28T07:44:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6262.897474 secs 2024-03-28T07:44:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6262.897474 secs 2024-03-28T07:44:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6262.897474 secs 2024-03-28T07:44:25.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6936 sec 2024-03-28T07:44:25.471 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:25 smithi086 ceph-mon[35163]: pgmap v4190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:25 smithi159 ceph-mon[36109]: pgmap v4190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:25 smithi055 ceph-mon[31863]: pgmap v4190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:26.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6937 sec 2024-03-28T07:44:27.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6938 sec 2024-03-28T07:44:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:27 smithi086 ceph-mon[35163]: pgmap v4191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:27 smithi159 ceph-mon[36109]: pgmap v4191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:27 smithi055 ceph-mon[31863]: pgmap v4191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:28.076 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6939 sec 2024-03-28T07:44:29.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6940 sec 2024-03-28T07:44:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:29 smithi086 ceph-mon[35163]: pgmap v4192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6267.897553 secs 2024-03-28T07:44:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:29 smithi159 ceph-mon[36109]: pgmap v4192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6267.897553 secs 2024-03-28T07:44:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:29 smithi055 ceph-mon[31863]: pgmap v4192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6267.897553 secs 2024-03-28T07:44:30.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6941 sec 2024-03-28T07:44:31.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6942 sec 2024-03-28T07:44:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:31 smithi086 ceph-mon[35163]: pgmap v4193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:31 smithi159 ceph-mon[36109]: pgmap v4193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:31.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:31 smithi055 ceph-mon[31863]: pgmap v4193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:32.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6943 sec 2024-03-28T07:44:33.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6944 sec 2024-03-28T07:44:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:33 smithi086 ceph-mon[35163]: pgmap v4194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:33 smithi159 ceph-mon[36109]: pgmap v4194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:33 smithi055 ceph-mon[31863]: pgmap v4194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:34.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6945 sec 2024-03-28T07:44:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6272.897631 secs 2024-03-28T07:44:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6272.897631 secs 2024-03-28T07:44:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6272.897631 secs 2024-03-28T07:44:35.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6946 sec 2024-03-28T07:44:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:35 smithi086 ceph-mon[35163]: pgmap v4195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:35 smithi159 ceph-mon[36109]: pgmap v4195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:35 smithi055 ceph-mon[31863]: pgmap v4195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:36.077 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6947 sec 2024-03-28T07:44:37.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6948 sec 2024-03-28T07:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:37 smithi086 ceph-mon[35163]: pgmap v4196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:37 smithi159 ceph-mon[36109]: pgmap v4196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:37 smithi055 ceph-mon[31863]: pgmap v4196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:44:38.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6949 sec 2024-03-28T07:44:39.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6950 sec 2024-03-28T07:44:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:39 smithi086 ceph-mon[35163]: pgmap v4197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6277.897716 secs 2024-03-28T07:44:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:39 smithi159 ceph-mon[36109]: pgmap v4197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6277.897716 secs 2024-03-28T07:44:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:39 smithi055 ceph-mon[31863]: pgmap v4197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6277.897716 secs 2024-03-28T07:44:40.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6951 sec 2024-03-28T07:44:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:44:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:44:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:44:41.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6952 sec 2024-03-28T07:44:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:41 smithi086 ceph-mon[35163]: pgmap v4198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:44:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:44:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:44:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:41 smithi159 ceph-mon[36109]: pgmap v4198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:41.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:44:41.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:44:41.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:44:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:41 smithi055 ceph-mon[31863]: pgmap v4198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:44:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:44:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:44:42.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6953 sec 2024-03-28T07:44:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:42 smithi086 ceph-mon[35163]: pgmap v4199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:42 smithi086 ceph-mon[35163]: pgmap v4200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:42.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:42 smithi159 ceph-mon[36109]: pgmap v4199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:42.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:42 smithi159 ceph-mon[36109]: pgmap v4200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:42 smithi055 ceph-mon[31863]: pgmap v4199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:42 smithi055 ceph-mon[31863]: pgmap v4200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:43.078 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6954 sec 2024-03-28T07:44:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:43 smithi086 ceph-mon[35163]: pgmap v4201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:43 smithi159 ceph-mon[36109]: pgmap v4201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:43 smithi055 ceph-mon[31863]: pgmap v4201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:44.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6955 sec 2024-03-28T07:44:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6282.897837 secs 2024-03-28T07:44:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6282.897837 secs 2024-03-28T07:44:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6282.897837 secs 2024-03-28T07:44:45.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6956 sec 2024-03-28T07:44:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:45 smithi086 ceph-mon[35163]: pgmap v4202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:44:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:45 smithi159 ceph-mon[36109]: pgmap v4202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:44:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:45 smithi055 ceph-mon[31863]: pgmap v4202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:44:46.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6957 sec 2024-03-28T07:44:47.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6958 sec 2024-03-28T07:44:48.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6959 sec 2024-03-28T07:44:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:48 smithi086 ceph-mon[35163]: pgmap v4203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:48 smithi159 ceph-mon[36109]: pgmap v4203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:48 smithi055 ceph-mon[31863]: pgmap v4203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:49.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6960 sec 2024-03-28T07:44:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6287.897905 secs 2024-03-28T07:44:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6287.897905 secs 2024-03-28T07:44:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6287.897905 secs 2024-03-28T07:44:50.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6961 sec 2024-03-28T07:44:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:50 smithi086 ceph-mon[35163]: pgmap v4204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:50 smithi159 ceph-mon[36109]: pgmap v4204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:50 smithi055 ceph-mon[31863]: pgmap v4204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:44:51.079 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6962 sec 2024-03-28T07:44:52.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6963 sec 2024-03-28T07:44:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:52 smithi086 ceph-mon[35163]: pgmap v4205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:44:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:52 smithi159 ceph-mon[36109]: pgmap v4205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:44:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:52 smithi055 ceph-mon[31863]: pgmap v4205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:44:53.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6964 sec 2024-03-28T07:44:54.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6965 sec 2024-03-28T07:44:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6292.898022 secs 2024-03-28T07:44:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:54 smithi086 ceph-mon[35163]: pgmap v4206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6292.898022 secs 2024-03-28T07:44:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:54 smithi159 ceph-mon[36109]: pgmap v4206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6292.898022 secs 2024-03-28T07:44:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:54 smithi055 ceph-mon[31863]: pgmap v4206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:55.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6966 sec 2024-03-28T07:44:56.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6967 sec 2024-03-28T07:44:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:56 smithi086 ceph-mon[35163]: pgmap v4207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:56 smithi159 ceph-mon[36109]: pgmap v4207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:56 smithi055 ceph-mon[31863]: pgmap v4207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:44:57.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6968 sec 2024-03-28T07:44:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:57 smithi086 ceph-mon[35163]: pgmap v4208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:57 smithi159 ceph-mon[36109]: pgmap v4208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:57 smithi055 ceph-mon[31863]: pgmap v4208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:58.080 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6969 sec 2024-03-28T07:44:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6297.898100 secs 2024-03-28T07:44:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6297.898100 secs 2024-03-28T07:44:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6297.898100 secs 2024-03-28T07:44:59.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6970 sec 2024-03-28T07:44:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:44:59 smithi086 ceph-mon[35163]: pgmap v4209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:44:59 smithi159 ceph-mon[36109]: pgmap v4209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:44:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:44:59 smithi055 ceph-mon[31863]: pgmap v4209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:00.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6971 sec 2024-03-28T07:45:01.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6972 sec 2024-03-28T07:45:02.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6973 sec 2024-03-28T07:45:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:02 smithi086 ceph-mon[35163]: pgmap v4210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:02 smithi159 ceph-mon[36109]: pgmap v4210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:02.577 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:02 smithi055 ceph-mon[31863]: pgmap v4210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:03.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6974 sec 2024-03-28T07:45:04.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6975 sec 2024-03-28T07:45:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6302.898188 secs 2024-03-28T07:45:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:04 smithi086 ceph-mon[35163]: pgmap v4211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6302.898188 secs 2024-03-28T07:45:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:04 smithi159 ceph-mon[36109]: pgmap v4211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6302.898188 secs 2024-03-28T07:45:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:04 smithi055 ceph-mon[31863]: pgmap v4211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:05.081 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6976 sec 2024-03-28T07:45:06.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6977 sec 2024-03-28T07:45:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:06 smithi086 ceph-mon[35163]: pgmap v4212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:06 smithi159 ceph-mon[36109]: pgmap v4212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:06.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:06 smithi055 ceph-mon[31863]: pgmap v4212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:07.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6978 sec 2024-03-28T07:45:08.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6979 sec 2024-03-28T07:45:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:08 smithi086 ceph-mon[35163]: pgmap v4213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:08 smithi159 ceph-mon[36109]: pgmap v4213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:08 smithi055 ceph-mon[31863]: pgmap v4213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:09.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6980 sec 2024-03-28T07:45:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6307.898268 secs 2024-03-28T07:45:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6307.898268 secs 2024-03-28T07:45:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6307.898268 secs 2024-03-28T07:45:10.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6981 sec 2024-03-28T07:45:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:10 smithi086 ceph-mon[35163]: pgmap v4214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:10 smithi159 ceph-mon[36109]: pgmap v4214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:10 smithi055 ceph-mon[31863]: pgmap v4214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:11.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6982 sec 2024-03-28T07:45:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:11 smithi086 ceph-mon[35163]: pgmap v4215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:11.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:11 smithi159 ceph-mon[36109]: pgmap v4215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:11 smithi055 ceph-mon[31863]: pgmap v4215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:12.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6983 sec 2024-03-28T07:45:13.082 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6984 sec 2024-03-28T07:45:14.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6985 sec 2024-03-28T07:45:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6312.898353 secs 2024-03-28T07:45:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:14 smithi086 ceph-mon[35163]: pgmap v4216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6312.898353 secs 2024-03-28T07:45:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:14 smithi159 ceph-mon[36109]: pgmap v4216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6312.898353 secs 2024-03-28T07:45:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:14 smithi055 ceph-mon[31863]: pgmap v4216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:15.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6986 sec 2024-03-28T07:45:16.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6987 sec 2024-03-28T07:45:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:16 smithi086 ceph-mon[35163]: pgmap v4217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:16 smithi159 ceph-mon[36109]: pgmap v4217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:16 smithi055 ceph-mon[31863]: pgmap v4217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:17.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6988 sec 2024-03-28T07:45:18.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6989 sec 2024-03-28T07:45:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:18 smithi086 ceph-mon[35163]: pgmap v4218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:18 smithi159 ceph-mon[36109]: pgmap v4218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:18 smithi055 ceph-mon[31863]: pgmap v4218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:19.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6990 sec 2024-03-28T07:45:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6317.898422 secs 2024-03-28T07:45:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6317.898422 secs 2024-03-28T07:45:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6317.898422 secs 2024-03-28T07:45:20.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6991 sec 2024-03-28T07:45:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:20 smithi086 ceph-mon[35163]: pgmap v4219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:20 smithi159 ceph-mon[36109]: pgmap v4219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:20 smithi055 ceph-mon[31863]: pgmap v4219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:21.083 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6992 sec 2024-03-28T07:45:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:21 smithi055 ceph-mon[31863]: pgmap v4220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:21 smithi086 ceph-mon[35163]: pgmap v4220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:21 smithi159 ceph-mon[36109]: pgmap v4220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:22.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6993 sec 2024-03-28T07:45:23.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6994 sec 2024-03-28T07:45:24.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6995 sec 2024-03-28T07:45:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6322.898507 secs 2024-03-28T07:45:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:24 smithi086 ceph-mon[35163]: pgmap v4221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6322.898507 secs 2024-03-28T07:45:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:24 smithi159 ceph-mon[36109]: pgmap v4221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6322.898507 secs 2024-03-28T07:45:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:24 smithi055 ceph-mon[31863]: pgmap v4221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:25.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6996 sec 2024-03-28T07:45:26.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6997 sec 2024-03-28T07:45:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:26 smithi086 ceph-mon[35163]: pgmap v4222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:26 smithi159 ceph-mon[36109]: pgmap v4222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:26 smithi055 ceph-mon[31863]: pgmap v4222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:27.084 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6998 sec 2024-03-28T07:45:28.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 6999 sec 2024-03-28T07:45:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:28 smithi086 ceph-mon[35163]: pgmap v4223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:45:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:28 smithi159 ceph-mon[36109]: pgmap v4223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:45:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:28 smithi055 ceph-mon[31863]: pgmap v4223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:45:29.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7000 sec 2024-03-28T07:45:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6327.898591 secs 2024-03-28T07:45:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6327.898591 secs 2024-03-28T07:45:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6327.898591 secs 2024-03-28T07:45:30.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7001 sec 2024-03-28T07:45:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:30 smithi086 ceph-mon[35163]: pgmap v4224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:30 smithi159 ceph-mon[36109]: pgmap v4224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:30 smithi055 ceph-mon[31863]: pgmap v4224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:31.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7002 sec 2024-03-28T07:45:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:31 smithi086 ceph-mon[35163]: pgmap v4225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:31 smithi159 ceph-mon[36109]: pgmap v4225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:31.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:31 smithi055 ceph-mon[31863]: pgmap v4225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:32.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7003 sec 2024-03-28T07:45:33.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7004 sec 2024-03-28T07:45:34.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7005 sec 2024-03-28T07:45:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6332.898679 secs 2024-03-28T07:45:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:34 smithi086 ceph-mon[35163]: pgmap v4226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6332.898679 secs 2024-03-28T07:45:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:34 smithi159 ceph-mon[36109]: pgmap v4226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6332.898679 secs 2024-03-28T07:45:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:34 smithi055 ceph-mon[31863]: pgmap v4226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:35.085 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7006 sec 2024-03-28T07:45:36.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7007 sec 2024-03-28T07:45:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:36 smithi086 ceph-mon[35163]: pgmap v4227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:36 smithi159 ceph-mon[36109]: pgmap v4227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:36 smithi055 ceph-mon[31863]: pgmap v4227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:45:37.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7008 sec 2024-03-28T07:45:38.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7009 sec 2024-03-28T07:45:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:38 smithi086 ceph-mon[35163]: pgmap v4228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:38 smithi159 ceph-mon[36109]: pgmap v4228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:38 smithi055 ceph-mon[31863]: pgmap v4228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:39.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7010 sec 2024-03-28T07:45:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6337.898834 secs 2024-03-28T07:45:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6337.898834 secs 2024-03-28T07:45:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6337.898834 secs 2024-03-28T07:45:40.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7011 sec 2024-03-28T07:45:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:40 smithi086 ceph-mon[35163]: pgmap v4229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:40.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:40 smithi159 ceph-mon[36109]: pgmap v4229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:40 smithi055 ceph-mon[31863]: pgmap v4229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:41.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7012 sec 2024-03-28T07:45:42.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7013 sec 2024-03-28T07:45:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:42 smithi086 ceph-mon[35163]: pgmap v4230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:45:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:42 smithi159 ceph-mon[36109]: pgmap v4230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:45:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:42 smithi055 ceph-mon[31863]: pgmap v4230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:45:43.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7014 sec 2024-03-28T07:45:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:45:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:45:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:43 smithi086 ceph-mon[35163]: pgmap v4231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:43 smithi086 ceph-mon[35163]: pgmap v4232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:45:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:45:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:45:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:43 smithi159 ceph-mon[36109]: pgmap v4231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:43 smithi159 ceph-mon[36109]: pgmap v4232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:45:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:45:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:45:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:43 smithi055 ceph-mon[31863]: pgmap v4231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:43 smithi055 ceph-mon[31863]: pgmap v4232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:45:44.086 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7015 sec 2024-03-28T07:45:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6342.898900 secs 2024-03-28T07:45:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6342.898900 secs 2024-03-28T07:45:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6342.898900 secs 2024-03-28T07:45:45.087 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7016 sec 2024-03-28T07:45:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:45 smithi086 ceph-mon[35163]: pgmap v4233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:45:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:45 smithi159 ceph-mon[36109]: pgmap v4233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:45:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:45 smithi055 ceph-mon[31863]: pgmap v4233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:45:46.087 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7017 sec 2024-03-28T07:45:47.087 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7018 sec 2024-03-28T07:45:48.087 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7019 sec 2024-03-28T07:45:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:48 smithi086 ceph-mon[35163]: pgmap v4234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:48 smithi159 ceph-mon[36109]: pgmap v4234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:48 smithi055 ceph-mon[31863]: pgmap v4234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:49.087 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7020 sec 2024-03-28T07:45:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6347.898981 secs 2024-03-28T07:45:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6347.898981 secs 2024-03-28T07:45:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6347.898981 secs 2024-03-28T07:45:50.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7021 sec 2024-03-28T07:45:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:50 smithi086 ceph-mon[35163]: pgmap v4235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:50.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:50 smithi159 ceph-mon[36109]: pgmap v4235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:50 smithi055 ceph-mon[31863]: pgmap v4235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:51.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7022 sec 2024-03-28T07:45:52.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7023 sec 2024-03-28T07:45:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:52 smithi086 ceph-mon[35163]: pgmap v4236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:52 smithi159 ceph-mon[36109]: pgmap v4236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:52 smithi055 ceph-mon[31863]: pgmap v4236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:45:53.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7024 sec 2024-03-28T07:45:54.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7025 sec 2024-03-28T07:45:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6352.899069 secs 2024-03-28T07:45:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:54 smithi159 ceph-mon[36109]: pgmap v4237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6352.899069 secs 2024-03-28T07:45:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:54 smithi055 ceph-mon[31863]: pgmap v4237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6352.899069 secs 2024-03-28T07:45:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:54 smithi086 ceph-mon[35163]: pgmap v4237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:45:55.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7026 sec 2024-03-28T07:45:56.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7027 sec 2024-03-28T07:45:56.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:56 smithi086 ceph-mon[35163]: pgmap v4238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:56 smithi055 ceph-mon[31863]: pgmap v4238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:56 smithi159 ceph-mon[36109]: pgmap v4238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:45:57.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7028 sec 2024-03-28T07:45:58.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7029 sec 2024-03-28T07:45:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:58 smithi055 ceph-mon[31863]: pgmap v4239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:58 smithi086 ceph-mon[35163]: pgmap v4239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:58 smithi159 ceph-mon[36109]: pgmap v4239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:45:59.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7030 sec 2024-03-28T07:45:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:45:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6357.899133 secs 2024-03-28T07:45:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:45:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6357.899133 secs 2024-03-28T07:45:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:45:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6357.899133 secs 2024-03-28T07:46:00.088 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7031 sec 2024-03-28T07:46:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:00 smithi055 ceph-mon[31863]: pgmap v4240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:00 smithi086 ceph-mon[35163]: pgmap v4240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:00 smithi159 ceph-mon[36109]: pgmap v4240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:01.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7032 sec 2024-03-28T07:46:02.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7033 sec 2024-03-28T07:46:02.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:02 smithi055 ceph-mon[31863]: pgmap v4241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:02 smithi086 ceph-mon[35163]: pgmap v4241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:02 smithi159 ceph-mon[36109]: pgmap v4241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:03.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7034 sec 2024-03-28T07:46:04.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7035 sec 2024-03-28T07:46:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6362.899253 secs 2024-03-28T07:46:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:04 smithi055 ceph-mon[31863]: pgmap v4242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6362.899253 secs 2024-03-28T07:46:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:04 smithi086 ceph-mon[35163]: pgmap v4242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6362.899253 secs 2024-03-28T07:46:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:04 smithi159 ceph-mon[36109]: pgmap v4242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:05.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7036 sec 2024-03-28T07:46:06.089 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7037 sec 2024-03-28T07:46:06.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:06 smithi055 ceph-mon[31863]: pgmap v4243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:06 smithi086 ceph-mon[35163]: pgmap v4243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:06 smithi159 ceph-mon[36109]: pgmap v4243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:07.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7038 sec 2024-03-28T07:46:08.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7039 sec 2024-03-28T07:46:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:08 smithi086 ceph-mon[35163]: pgmap v4244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:08 smithi159 ceph-mon[36109]: pgmap v4244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:08 smithi055 ceph-mon[31863]: pgmap v4244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:09.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7040 sec 2024-03-28T07:46:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6367.899335 secs 2024-03-28T07:46:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6367.899335 secs 2024-03-28T07:46:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6367.899335 secs 2024-03-28T07:46:10.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7041 sec 2024-03-28T07:46:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:10 smithi086 ceph-mon[35163]: pgmap v4245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:10 smithi159 ceph-mon[36109]: pgmap v4245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:10 smithi055 ceph-mon[31863]: pgmap v4245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:11.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7042 sec 2024-03-28T07:46:12.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7043 sec 2024-03-28T07:46:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:12 smithi086 ceph-mon[35163]: pgmap v4246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:12 smithi159 ceph-mon[36109]: pgmap v4246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:12 smithi055 ceph-mon[31863]: pgmap v4246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:13.090 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7044 sec 2024-03-28T07:46:14.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7045 sec 2024-03-28T07:46:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6372.899409 secs 2024-03-28T07:46:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:14 smithi086 ceph-mon[35163]: pgmap v4247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6372.899409 secs 2024-03-28T07:46:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:14 smithi159 ceph-mon[36109]: pgmap v4247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6372.899409 secs 2024-03-28T07:46:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:14 smithi055 ceph-mon[31863]: pgmap v4247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:15.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7046 sec 2024-03-28T07:46:16.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7047 sec 2024-03-28T07:46:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:16 smithi086 ceph-mon[35163]: pgmap v4248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:16 smithi159 ceph-mon[36109]: pgmap v4248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:16 smithi055 ceph-mon[31863]: pgmap v4248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:17.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7048 sec 2024-03-28T07:46:18.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7049 sec 2024-03-28T07:46:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:18 smithi086 ceph-mon[35163]: pgmap v4249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:18 smithi159 ceph-mon[36109]: pgmap v4249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:18 smithi055 ceph-mon[31863]: pgmap v4249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:19.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7050 sec 2024-03-28T07:46:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6377.899474 secs 2024-03-28T07:46:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6377.899474 secs 2024-03-28T07:46:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6377.899474 secs 2024-03-28T07:46:20.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7051 sec 2024-03-28T07:46:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:20 smithi086 ceph-mon[35163]: pgmap v4250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:20 smithi159 ceph-mon[36109]: pgmap v4250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:20 smithi055 ceph-mon[31863]: pgmap v4250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:21.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7052 sec 2024-03-28T07:46:22.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7053 sec 2024-03-28T07:46:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:22 smithi086 ceph-mon[35163]: pgmap v4251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:22 smithi159 ceph-mon[36109]: pgmap v4251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:22 smithi055 ceph-mon[31863]: pgmap v4251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:23.091 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7054 sec 2024-03-28T07:46:24.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7055 sec 2024-03-28T07:46:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6382.899597 secs 2024-03-28T07:46:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:24 smithi086 ceph-mon[35163]: pgmap v4252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6382.899597 secs 2024-03-28T07:46:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:24 smithi159 ceph-mon[36109]: pgmap v4252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6382.899597 secs 2024-03-28T07:46:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:24 smithi055 ceph-mon[31863]: pgmap v4252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:25.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7056 sec 2024-03-28T07:46:26.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7057 sec 2024-03-28T07:46:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:26 smithi086 ceph-mon[35163]: pgmap v4253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:26 smithi159 ceph-mon[36109]: pgmap v4253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:26 smithi055 ceph-mon[31863]: pgmap v4253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:27.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7058 sec 2024-03-28T07:46:28.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7059 sec 2024-03-28T07:46:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:28 smithi086 ceph-mon[35163]: pgmap v4254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:28 smithi159 ceph-mon[36109]: pgmap v4254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:28 smithi055 ceph-mon[31863]: pgmap v4254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:29.092 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7060 sec 2024-03-28T07:46:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6387.899719 secs 2024-03-28T07:46:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6387.899719 secs 2024-03-28T07:46:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6387.899719 secs 2024-03-28T07:46:30.093 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7061 sec 2024-03-28T07:46:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:30 smithi086 ceph-mon[35163]: pgmap v4255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:30 smithi159 ceph-mon[36109]: pgmap v4255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:30 smithi055 ceph-mon[31863]: pgmap v4255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:31.093 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7062 sec 2024-03-28T07:46:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:31 smithi086 ceph-mon[35163]: pgmap v4256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:31 smithi159 ceph-mon[36109]: pgmap v4256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:31.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:31 smithi055 ceph-mon[31863]: pgmap v4256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:32.093 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7063 sec 2024-03-28T07:46:33.093 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7064 sec 2024-03-28T07:46:34.093 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7065 sec 2024-03-28T07:46:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6392.899817 secs 2024-03-28T07:46:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:34 smithi086 ceph-mon[35163]: pgmap v4257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6392.899817 secs 2024-03-28T07:46:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:34 smithi159 ceph-mon[36109]: pgmap v4257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:34.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6392.899817 secs 2024-03-28T07:46:34.328 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:34 smithi055 ceph-mon[31863]: pgmap v4257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:35.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7066 sec 2024-03-28T07:46:36.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7067 sec 2024-03-28T07:46:36.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:36 smithi086 ceph-mon[35163]: pgmap v4258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:36.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:36 smithi159 ceph-mon[36109]: pgmap v4258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:36 smithi055 ceph-mon[31863]: pgmap v4258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:37.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7068 sec 2024-03-28T07:46:38.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7069 sec 2024-03-28T07:46:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:38 smithi055 ceph-mon[31863]: pgmap v4259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:38 smithi086 ceph-mon[35163]: pgmap v4259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:38 smithi159 ceph-mon[36109]: pgmap v4259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:39.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7070 sec 2024-03-28T07:46:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6397.899930 secs 2024-03-28T07:46:39.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6397.899930 secs 2024-03-28T07:46:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6397.899930 secs 2024-03-28T07:46:40.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7071 sec 2024-03-28T07:46:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:40 smithi055 ceph-mon[31863]: pgmap v4260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:40 smithi086 ceph-mon[35163]: pgmap v4260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:40.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:40 smithi159 ceph-mon[36109]: pgmap v4260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:41.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7072 sec 2024-03-28T07:46:42.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7073 sec 2024-03-28T07:46:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:42 smithi055 ceph-mon[31863]: pgmap v4261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:42 smithi086 ceph-mon[35163]: pgmap v4261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:42 smithi159 ceph-mon[36109]: pgmap v4261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:43.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7074 sec 2024-03-28T07:46:44.094 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7075 sec 2024-03-28T07:46:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6402.900022 secs 2024-03-28T07:46:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:44 smithi055 ceph-mon[31863]: pgmap v4262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:46:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6402.900022 secs 2024-03-28T07:46:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:44 smithi086 ceph-mon[35163]: pgmap v4262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:46:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6402.900022 secs 2024-03-28T07:46:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:44 smithi159 ceph-mon[36109]: pgmap v4262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:46:45.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7076 sec 2024-03-28T07:46:45.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:46:45.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:46:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:46:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:46:45.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:46:45.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:46:45.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:46:46.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7077 sec 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: pgmap v4263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:46 smithi055 ceph-mon[31863]: pgmap v4264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:46:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:46:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:46:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:46:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: pgmap v4263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:46 smithi086 ceph-mon[35163]: pgmap v4264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: pgmap v4263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:46:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:46 smithi159 ceph-mon[36109]: pgmap v4264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:47.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7078 sec 2024-03-28T07:46:48.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7079 sec 2024-03-28T07:46:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:48 smithi086 ceph-mon[35163]: pgmap v4265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:48 smithi159 ceph-mon[36109]: pgmap v4265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:48 smithi055 ceph-mon[31863]: pgmap v4265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:49.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7080 sec 2024-03-28T07:46:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6407.900095 secs 2024-03-28T07:46:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6407.900095 secs 2024-03-28T07:46:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6407.900095 secs 2024-03-28T07:46:50.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7081 sec 2024-03-28T07:46:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:50 smithi086 ceph-mon[35163]: pgmap v4266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:50 smithi159 ceph-mon[36109]: pgmap v4266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:50 smithi055 ceph-mon[31863]: pgmap v4266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:51.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7082 sec 2024-03-28T07:46:52.095 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7083 sec 2024-03-28T07:46:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:52 smithi086 ceph-mon[35163]: pgmap v4267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:52 smithi159 ceph-mon[36109]: pgmap v4267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:52 smithi055 ceph-mon[31863]: pgmap v4267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:53.096 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7084 sec 2024-03-28T07:46:54.096 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7085 sec 2024-03-28T07:46:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6412.900167 secs 2024-03-28T07:46:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:54 smithi086 ceph-mon[35163]: pgmap v4268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6412.900167 secs 2024-03-28T07:46:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:54 smithi159 ceph-mon[36109]: pgmap v4268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6412.900167 secs 2024-03-28T07:46:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:54 smithi055 ceph-mon[31863]: pgmap v4268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:46:55.096 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7086 sec 2024-03-28T07:46:56.096 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7087 sec 2024-03-28T07:46:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:56 smithi086 ceph-mon[35163]: pgmap v4269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:46:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:56 smithi159 ceph-mon[36109]: pgmap v4269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:46:56.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:56 smithi055 ceph-mon[31863]: pgmap v4269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:46:57.096 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7088 sec 2024-03-28T07:46:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:57 smithi055 ceph-mon[31863]: pgmap v4270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:57 smithi086 ceph-mon[35163]: pgmap v4270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:57 smithi159 ceph-mon[36109]: pgmap v4270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:58.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7089 sec 2024-03-28T07:46:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6417.900284 secs 2024-03-28T07:46:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6417.900284 secs 2024-03-28T07:46:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6417.900284 secs 2024-03-28T07:46:59.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7090 sec 2024-03-28T07:46:59.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:46:59 smithi086 ceph-mon[35163]: pgmap v4271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:59.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:46:59 smithi159 ceph-mon[36109]: pgmap v4271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:46:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:46:59 smithi055 ceph-mon[31863]: pgmap v4271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:00.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7091 sec 2024-03-28T07:47:01.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7092 sec 2024-03-28T07:47:02.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7093 sec 2024-03-28T07:47:02.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:01 smithi055 ceph-mon[31863]: pgmap v4272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:01 smithi086 ceph-mon[35163]: pgmap v4272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:02.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:01 smithi159 ceph-mon[36109]: pgmap v4272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:03.097 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7094 sec 2024-03-28T07:47:04.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7095 sec 2024-03-28T07:47:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6422.900402 secs 2024-03-28T07:47:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:03 smithi055 ceph-mon[31863]: pgmap v4273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6422.900402 secs 2024-03-28T07:47:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:03 smithi086 ceph-mon[35163]: pgmap v4273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6422.900402 secs 2024-03-28T07:47:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:03 smithi159 ceph-mon[36109]: pgmap v4273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:05.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7096 sec 2024-03-28T07:47:06.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7097 sec 2024-03-28T07:47:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:05 smithi055 ceph-mon[31863]: pgmap v4274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:05 smithi086 ceph-mon[35163]: pgmap v4274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:06.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:05 smithi159 ceph-mon[36109]: pgmap v4274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:07.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7098 sec 2024-03-28T07:47:08.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7099 sec 2024-03-28T07:47:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:07 smithi055 ceph-mon[31863]: pgmap v4275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:07 smithi086 ceph-mon[35163]: pgmap v4275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:07 smithi159 ceph-mon[36109]: pgmap v4275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:09.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7100 sec 2024-03-28T07:47:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6427.900491 secs 2024-03-28T07:47:09.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6427.900491 secs 2024-03-28T07:47:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6427.900491 secs 2024-03-28T07:47:10.098 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7101 sec 2024-03-28T07:47:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:09 smithi055 ceph-mon[31863]: pgmap v4276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:09 smithi086 ceph-mon[35163]: pgmap v4276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:10.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:09 smithi159 ceph-mon[36109]: pgmap v4276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:11.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7102 sec 2024-03-28T07:47:12.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7103 sec 2024-03-28T07:47:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:11 smithi055 ceph-mon[31863]: pgmap v4277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:11 smithi086 ceph-mon[35163]: pgmap v4277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:11 smithi159 ceph-mon[36109]: pgmap v4277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:13.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7104 sec 2024-03-28T07:47:14.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7105 sec 2024-03-28T07:47:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6432.900567 secs 2024-03-28T07:47:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:13 smithi086 ceph-mon[35163]: pgmap v4278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6432.900567 secs 2024-03-28T07:47:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:13 smithi159 ceph-mon[36109]: pgmap v4278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6432.900567 secs 2024-03-28T07:47:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:13 smithi055 ceph-mon[31863]: pgmap v4278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:15.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7106 sec 2024-03-28T07:47:16.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7107 sec 2024-03-28T07:47:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:15 smithi086 ceph-mon[35163]: pgmap v4279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:16.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:15 smithi159 ceph-mon[36109]: pgmap v4279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:15 smithi055 ceph-mon[31863]: pgmap v4279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:17.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7108 sec 2024-03-28T07:47:18.099 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7109 sec 2024-03-28T07:47:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:17 smithi086 ceph-mon[35163]: pgmap v4280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:17 smithi159 ceph-mon[36109]: pgmap v4280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:17 smithi055 ceph-mon[31863]: pgmap v4280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:19.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7110 sec 2024-03-28T07:47:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6437.900688 secs 2024-03-28T07:47:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6437.900688 secs 2024-03-28T07:47:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6437.900688 secs 2024-03-28T07:47:20.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7111 sec 2024-03-28T07:47:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:19 smithi086 ceph-mon[35163]: pgmap v4281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:20.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:19 smithi159 ceph-mon[36109]: pgmap v4281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:19 smithi055 ceph-mon[31863]: pgmap v4281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:21.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7112 sec 2024-03-28T07:47:22.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7113 sec 2024-03-28T07:47:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:21 smithi086 ceph-mon[35163]: pgmap v4282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:22.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:21 smithi159 ceph-mon[36109]: pgmap v4282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:21 smithi055 ceph-mon[31863]: pgmap v4282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:23.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7114 sec 2024-03-28T07:47:24.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7115 sec 2024-03-28T07:47:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6442.900811 secs 2024-03-28T07:47:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:23 smithi086 ceph-mon[35163]: pgmap v4283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6442.900811 secs 2024-03-28T07:47:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:23 smithi159 ceph-mon[36109]: pgmap v4283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6442.900811 secs 2024-03-28T07:47:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:23 smithi055 ceph-mon[31863]: pgmap v4283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:25.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7116 sec 2024-03-28T07:47:26.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7117 sec 2024-03-28T07:47:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:25 smithi086 ceph-mon[35163]: pgmap v4284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:26.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:25 smithi159 ceph-mon[36109]: pgmap v4284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:26.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:25 smithi055 ceph-mon[31863]: pgmap v4284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:27.100 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7118 sec 2024-03-28T07:47:28.101 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7119 sec 2024-03-28T07:47:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:27 smithi086 ceph-mon[35163]: pgmap v4285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:27 smithi159 ceph-mon[36109]: pgmap v4285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:27 smithi055 ceph-mon[31863]: pgmap v4285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:29.101 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7120 sec 2024-03-28T07:47:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6447.900931 secs 2024-03-28T07:47:29.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6447.900931 secs 2024-03-28T07:47:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6447.900931 secs 2024-03-28T07:47:30.101 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7121 sec 2024-03-28T07:47:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:29 smithi086 ceph-mon[35163]: pgmap v4286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:30.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:29 smithi159 ceph-mon[36109]: pgmap v4286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:30.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:29 smithi055 ceph-mon[31863]: pgmap v4286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:31.101 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7122 sec 2024-03-28T07:47:32.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7123 sec 2024-03-28T07:47:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:31 smithi086 ceph-mon[35163]: pgmap v4287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:31 smithi159 ceph-mon[36109]: pgmap v4287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:31 smithi055 ceph-mon[31863]: pgmap v4287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:33.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7124 sec 2024-03-28T07:47:34.101 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7125 sec 2024-03-28T07:47:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6452.900991 secs 2024-03-28T07:47:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:33 smithi086 ceph-mon[35163]: pgmap v4288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6452.900991 secs 2024-03-28T07:47:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:33 smithi159 ceph-mon[36109]: pgmap v4288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6452.900991 secs 2024-03-28T07:47:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:33 smithi055 ceph-mon[31863]: pgmap v4288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:35.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7126 sec 2024-03-28T07:47:36.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7127 sec 2024-03-28T07:47:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:36 smithi086 ceph-mon[35163]: pgmap v4289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:36 smithi159 ceph-mon[36109]: pgmap v4289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:36 smithi055 ceph-mon[31863]: pgmap v4289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:37.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7128 sec 2024-03-28T07:47:38.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7129 sec 2024-03-28T07:47:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:38 smithi086 ceph-mon[35163]: pgmap v4290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:38 smithi159 ceph-mon[36109]: pgmap v4290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:38 smithi055 ceph-mon[31863]: pgmap v4290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:39.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7130 sec 2024-03-28T07:47:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6457.901111 secs 2024-03-28T07:47:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6457.901111 secs 2024-03-28T07:47:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6457.901111 secs 2024-03-28T07:47:40.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7131 sec 2024-03-28T07:47:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:40 smithi086 ceph-mon[35163]: pgmap v4291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:40.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:40 smithi159 ceph-mon[36109]: pgmap v4291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:40 smithi055 ceph-mon[31863]: pgmap v4291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:41.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7132 sec 2024-03-28T07:47:42.102 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7133 sec 2024-03-28T07:47:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:42 smithi086 ceph-mon[35163]: pgmap v4292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:42 smithi159 ceph-mon[36109]: pgmap v4292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:42 smithi055 ceph-mon[31863]: pgmap v4292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:43.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7134 sec 2024-03-28T07:47:44.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7135 sec 2024-03-28T07:47:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6462.901151 secs 2024-03-28T07:47:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:44 smithi086 ceph-mon[35163]: pgmap v4293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6462.901151 secs 2024-03-28T07:47:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:44 smithi159 ceph-mon[36109]: pgmap v4293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6462.901151 secs 2024-03-28T07:47:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:44 smithi055 ceph-mon[31863]: pgmap v4293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:45.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7136 sec 2024-03-28T07:47:46.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7137 sec 2024-03-28T07:47:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:46 smithi086 ceph-mon[35163]: pgmap v4294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:47:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:46 smithi159 ceph-mon[36109]: pgmap v4294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:47:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:46 smithi055 ceph-mon[31863]: pgmap v4294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:47:47.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7138 sec 2024-03-28T07:47:47.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:47:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:47:47.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:47:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:47:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:47:47.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:47:47.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:47:47.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:47:48.103 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7139 sec 2024-03-28T07:47:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:48 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:47:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:48 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:47:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:48 smithi055 ceph-mon[31863]: pgmap v4295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:48 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:47:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:48 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:47:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:48 smithi086 ceph-mon[35163]: pgmap v4295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:48 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:47:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:48 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:47:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:48 smithi159 ceph-mon[36109]: pgmap v4295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:49.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7140 sec 2024-03-28T07:47:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6467.901223 secs 2024-03-28T07:47:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6467.901223 secs 2024-03-28T07:47:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6467.901223 secs 2024-03-28T07:47:50.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7141 sec 2024-03-28T07:47:50.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:50 smithi055 ceph-mon[31863]: pgmap v4296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:50 smithi086 ceph-mon[35163]: pgmap v4296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:50 smithi159 ceph-mon[36109]: pgmap v4296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:51.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7142 sec 2024-03-28T07:47:52.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7143 sec 2024-03-28T07:47:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:52 smithi055 ceph-mon[31863]: pgmap v4297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:47:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:52 smithi086 ceph-mon[35163]: pgmap v4297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:47:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:52 smithi159 ceph-mon[36109]: pgmap v4297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:47:53.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7144 sec 2024-03-28T07:47:54.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7145 sec 2024-03-28T07:47:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6472.901295 secs 2024-03-28T07:47:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:54 smithi055 ceph-mon[31863]: pgmap v4298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6472.901295 secs 2024-03-28T07:47:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:54 smithi086 ceph-mon[35163]: pgmap v4298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6472.901295 secs 2024-03-28T07:47:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:54 smithi159 ceph-mon[36109]: pgmap v4298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:55.104 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7146 sec 2024-03-28T07:47:56.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7147 sec 2024-03-28T07:47:56.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:56 smithi086 ceph-mon[35163]: pgmap v4299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:56 smithi055 ceph-mon[31863]: pgmap v4299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:56.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:56 smithi159 ceph-mon[36109]: pgmap v4299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:47:57.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7148 sec 2024-03-28T07:47:58.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7149 sec 2024-03-28T07:47:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:58 smithi055 ceph-mon[31863]: pgmap v4300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:58 smithi086 ceph-mon[35163]: pgmap v4300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:58 smithi159 ceph-mon[36109]: pgmap v4300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:47:59.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7150 sec 2024-03-28T07:47:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:47:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6477.901367 secs 2024-03-28T07:47:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:47:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6477.901367 secs 2024-03-28T07:47:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:47:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6477.901367 secs 2024-03-28T07:48:00.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7151 sec 2024-03-28T07:48:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:00 smithi086 ceph-mon[35163]: pgmap v4301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:00 smithi159 ceph-mon[36109]: pgmap v4301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:00 smithi055 ceph-mon[31863]: pgmap v4301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:01.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7152 sec 2024-03-28T07:48:02.105 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7153 sec 2024-03-28T07:48:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:02 smithi086 ceph-mon[35163]: pgmap v4302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:02 smithi159 ceph-mon[36109]: pgmap v4302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:02 smithi055 ceph-mon[31863]: pgmap v4302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:03.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7154 sec 2024-03-28T07:48:04.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7155 sec 2024-03-28T07:48:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6482.901458 secs 2024-03-28T07:48:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:04 smithi086 ceph-mon[35163]: pgmap v4303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6482.901458 secs 2024-03-28T07:48:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:04 smithi159 ceph-mon[36109]: pgmap v4303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6482.901458 secs 2024-03-28T07:48:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:04 smithi055 ceph-mon[31863]: pgmap v4303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:05.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7156 sec 2024-03-28T07:48:06.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7157 sec 2024-03-28T07:48:06.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:06 smithi055 ceph-mon[31863]: pgmap v4304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:06 smithi086 ceph-mon[35163]: pgmap v4304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:06 smithi159 ceph-mon[36109]: pgmap v4304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:07.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7158 sec 2024-03-28T07:48:08.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7159 sec 2024-03-28T07:48:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:08 smithi086 ceph-mon[35163]: pgmap v4305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:08 smithi159 ceph-mon[36109]: pgmap v4305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:08 smithi055 ceph-mon[31863]: pgmap v4305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:09.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7160 sec 2024-03-28T07:48:09.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6487.901577 secs 2024-03-28T07:48:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6487.901577 secs 2024-03-28T07:48:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6487.901577 secs 2024-03-28T07:48:10.106 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7161 sec 2024-03-28T07:48:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:10 smithi086 ceph-mon[35163]: pgmap v4306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:10 smithi159 ceph-mon[36109]: pgmap v4306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:10 smithi055 ceph-mon[31863]: pgmap v4306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:11.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7162 sec 2024-03-28T07:48:12.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7163 sec 2024-03-28T07:48:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:12 smithi086 ceph-mon[35163]: pgmap v4307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:12 smithi159 ceph-mon[36109]: pgmap v4307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:12 smithi055 ceph-mon[31863]: pgmap v4307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:13.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7164 sec 2024-03-28T07:48:14.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7165 sec 2024-03-28T07:48:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6492.901700 secs 2024-03-28T07:48:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:14 smithi086 ceph-mon[35163]: pgmap v4308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6492.901700 secs 2024-03-28T07:48:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:14 smithi159 ceph-mon[36109]: pgmap v4308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6492.901700 secs 2024-03-28T07:48:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:14 smithi055 ceph-mon[31863]: pgmap v4308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:15.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7166 sec 2024-03-28T07:48:16.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7167 sec 2024-03-28T07:48:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:16 smithi086 ceph-mon[35163]: pgmap v4309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:16 smithi159 ceph-mon[36109]: pgmap v4309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:16 smithi055 ceph-mon[31863]: pgmap v4309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:17.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7168 sec 2024-03-28T07:48:18.107 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7169 sec 2024-03-28T07:48:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:18 smithi086 ceph-mon[35163]: pgmap v4310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:18 smithi159 ceph-mon[36109]: pgmap v4310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:18 smithi055 ceph-mon[31863]: pgmap v4310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:19.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7170 sec 2024-03-28T07:48:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6497.901770 secs 2024-03-28T07:48:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6497.901770 secs 2024-03-28T07:48:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6497.901770 secs 2024-03-28T07:48:20.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7171 sec 2024-03-28T07:48:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:20 smithi086 ceph-mon[35163]: pgmap v4311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:20 smithi159 ceph-mon[36109]: pgmap v4311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:20 smithi055 ceph-mon[31863]: pgmap v4311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:21.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7172 sec 2024-03-28T07:48:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:21 smithi055 ceph-mon[31863]: pgmap v4312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:21 smithi086 ceph-mon[35163]: pgmap v4312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:21 smithi159 ceph-mon[36109]: pgmap v4312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:22.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7173 sec 2024-03-28T07:48:23.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7174 sec 2024-03-28T07:48:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6502.901854 secs 2024-03-28T07:48:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:23 smithi086 ceph-mon[35163]: pgmap v4313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6502.901854 secs 2024-03-28T07:48:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:23 smithi159 ceph-mon[36109]: pgmap v4313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:24.108 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7175 sec 2024-03-28T07:48:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6502.901854 secs 2024-03-28T07:48:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:23 smithi055 ceph-mon[31863]: pgmap v4313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:25.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7176 sec 2024-03-28T07:48:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:25 smithi086 ceph-mon[35163]: pgmap v4314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:25 smithi159 ceph-mon[36109]: pgmap v4314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:26.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7177 sec 2024-03-28T07:48:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:25 smithi055 ceph-mon[31863]: pgmap v4314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:27.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7178 sec 2024-03-28T07:48:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:27 smithi086 ceph-mon[35163]: pgmap v4315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:27 smithi159 ceph-mon[36109]: pgmap v4315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:28.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7179 sec 2024-03-28T07:48:28.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:27 smithi055 ceph-mon[31863]: pgmap v4315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6507.901971 secs 2024-03-28T07:48:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6507.901971 secs 2024-03-28T07:48:29.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7180 sec 2024-03-28T07:48:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6507.901971 secs 2024-03-28T07:48:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:29 smithi086 ceph-mon[35163]: pgmap v4316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:30.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:29 smithi159 ceph-mon[36109]: pgmap v4316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:30.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7181 sec 2024-03-28T07:48:30.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:29 smithi055 ceph-mon[31863]: pgmap v4316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:31.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7182 sec 2024-03-28T07:48:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:31 smithi086 ceph-mon[35163]: pgmap v4317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:31 smithi159 ceph-mon[36109]: pgmap v4317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:32.109 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7183 sec 2024-03-28T07:48:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:31 smithi055 ceph-mon[31863]: pgmap v4317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:33.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7184 sec 2024-03-28T07:48:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6512.902084 secs 2024-03-28T07:48:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:33 smithi086 ceph-mon[35163]: pgmap v4318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:34.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6512.902084 secs 2024-03-28T07:48:34.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:33 smithi159 ceph-mon[36109]: pgmap v4318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:34.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7185 sec 2024-03-28T07:48:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6512.902084 secs 2024-03-28T07:48:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:33 smithi055 ceph-mon[31863]: pgmap v4318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:35.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7186 sec 2024-03-28T07:48:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:35 smithi086 ceph-mon[35163]: pgmap v4319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:35 smithi159 ceph-mon[36109]: pgmap v4319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:36.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7187 sec 2024-03-28T07:48:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:35 smithi055 ceph-mon[31863]: pgmap v4319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:37.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7188 sec 2024-03-28T07:48:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:37 smithi086 ceph-mon[35163]: pgmap v4320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:37 smithi159 ceph-mon[36109]: pgmap v4320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:38.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7189 sec 2024-03-28T07:48:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:37 smithi055 ceph-mon[31863]: pgmap v4320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6517.902206 secs 2024-03-28T07:48:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6517.902206 secs 2024-03-28T07:48:39.110 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7190 sec 2024-03-28T07:48:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6517.902206 secs 2024-03-28T07:48:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:39 smithi086 ceph-mon[35163]: pgmap v4321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:39 smithi159 ceph-mon[36109]: pgmap v4321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:40.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7191 sec 2024-03-28T07:48:40.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:39 smithi055 ceph-mon[31863]: pgmap v4321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:41.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7192 sec 2024-03-28T07:48:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:41 smithi086 ceph-mon[35163]: pgmap v4322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:41 smithi159 ceph-mon[36109]: pgmap v4322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:42.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7193 sec 2024-03-28T07:48:42.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:41 smithi055 ceph-mon[31863]: pgmap v4322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:48:43.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7194 sec 2024-03-28T07:48:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6522.902284 secs 2024-03-28T07:48:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:43 smithi086 ceph-mon[35163]: pgmap v4323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6522.902284 secs 2024-03-28T07:48:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:43 smithi159 ceph-mon[36109]: pgmap v4323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:44.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7195 sec 2024-03-28T07:48:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6522.902284 secs 2024-03-28T07:48:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:43 smithi055 ceph-mon[31863]: pgmap v4323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:48:45.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7196 sec 2024-03-28T07:48:46.111 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7197 sec 2024-03-28T07:48:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:45 smithi055 ceph-mon[31863]: pgmap v4324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:45 smithi086 ceph-mon[35163]: pgmap v4324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:45 smithi159 ceph-mon[36109]: pgmap v4324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:47.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7198 sec 2024-03-28T07:48:48.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7199 sec 2024-03-28T07:48:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:47 smithi055 ceph-mon[31863]: pgmap v4325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:48:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:47 smithi086 ceph-mon[35163]: pgmap v4325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:48:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:47 smithi159 ceph-mon[36109]: pgmap v4325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:48:49.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7200 sec 2024-03-28T07:48:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6527.902401 secs 2024-03-28T07:48:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:48:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:48:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:48:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6527.902401 secs 2024-03-28T07:48:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:48:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:48:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:48:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6527.902401 secs 2024-03-28T07:48:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:48:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:48:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:48:50.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7201 sec 2024-03-28T07:48:50.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:49 smithi055 ceph-mon[31863]: pgmap v4326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:50.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:49 smithi055 ceph-mon[31863]: pgmap v4327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:48:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:49 smithi086 ceph-mon[35163]: pgmap v4326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:49 smithi086 ceph-mon[35163]: pgmap v4327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:48:50.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:49 smithi159 ceph-mon[36109]: pgmap v4326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:48:50.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:49 smithi159 ceph-mon[36109]: pgmap v4327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:48:51.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7202 sec 2024-03-28T07:48:52.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7203 sec 2024-03-28T07:48:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:51 smithi055 ceph-mon[31863]: pgmap v4328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:51 smithi086 ceph-mon[35163]: pgmap v4328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:51 smithi159 ceph-mon[36109]: pgmap v4328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:53.112 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7204 sec 2024-03-28T07:48:54.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7205 sec 2024-03-28T07:48:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:53 smithi055 ceph-mon[31863]: pgmap v4329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6532.902519 secs 2024-03-28T07:48:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:53 smithi086 ceph-mon[35163]: pgmap v4329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6532.902519 secs 2024-03-28T07:48:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:53 smithi159 ceph-mon[36109]: pgmap v4329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6532.902519 secs 2024-03-28T07:48:55.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7206 sec 2024-03-28T07:48:56.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7207 sec 2024-03-28T07:48:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:55 smithi055 ceph-mon[31863]: pgmap v4330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:55 smithi086 ceph-mon[35163]: pgmap v4330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:55 smithi159 ceph-mon[36109]: pgmap v4330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:57.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7208 sec 2024-03-28T07:48:58.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7209 sec 2024-03-28T07:48:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:57 smithi086 ceph-mon[35163]: pgmap v4331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:57 smithi159 ceph-mon[36109]: pgmap v4331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:57 smithi055 ceph-mon[31863]: pgmap v4331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:48:59.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7210 sec 2024-03-28T07:48:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6537.902638 secs 2024-03-28T07:48:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6537.902638 secs 2024-03-28T07:48:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6537.902638 secs 2024-03-28T07:49:00.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7211 sec 2024-03-28T07:49:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:48:59 smithi086 ceph-mon[35163]: pgmap v4332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:49:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:48:59 smithi159 ceph-mon[36109]: pgmap v4332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:49:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:48:59 smithi055 ceph-mon[31863]: pgmap v4332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T07:49:01.113 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7212 sec 2024-03-28T07:49:02.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7213 sec 2024-03-28T07:49:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:01 smithi086 ceph-mon[35163]: pgmap v4333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:49:02.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:01 smithi159 ceph-mon[36109]: pgmap v4333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:49:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:01 smithi055 ceph-mon[31863]: pgmap v4333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:49:03.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7214 sec 2024-03-28T07:49:04.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7215 sec 2024-03-28T07:49:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:03 smithi086 ceph-mon[35163]: pgmap v4334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6542.902757 secs 2024-03-28T07:49:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:03 smithi159 ceph-mon[36109]: pgmap v4334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6542.902757 secs 2024-03-28T07:49:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:03 smithi055 ceph-mon[31863]: pgmap v4334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6542.902757 secs 2024-03-28T07:49:05.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7216 sec 2024-03-28T07:49:06.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7217 sec 2024-03-28T07:49:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:05 smithi086 ceph-mon[35163]: pgmap v4335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:05 smithi159 ceph-mon[36109]: pgmap v4335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:05 smithi055 ceph-mon[31863]: pgmap v4335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:07.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7218 sec 2024-03-28T07:49:08.114 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7219 sec 2024-03-28T07:49:08.177 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:07 smithi055 ceph-mon[31863]: pgmap v4336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:07 smithi086 ceph-mon[35163]: pgmap v4336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:07 smithi159 ceph-mon[36109]: pgmap v4336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:09.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7220 sec 2024-03-28T07:49:09.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6547.902831 secs 2024-03-28T07:49:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6547.902831 secs 2024-03-28T07:49:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6547.902831 secs 2024-03-28T07:49:10.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7221 sec 2024-03-28T07:49:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:09 smithi086 ceph-mon[35163]: pgmap v4337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:09 smithi159 ceph-mon[36109]: pgmap v4337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:09 smithi055 ceph-mon[31863]: pgmap v4337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:11.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7222 sec 2024-03-28T07:49:12.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7223 sec 2024-03-28T07:49:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:11 smithi086 ceph-mon[35163]: pgmap v4338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:11 smithi159 ceph-mon[36109]: pgmap v4338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:11 smithi055 ceph-mon[31863]: pgmap v4338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:13.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7224 sec 2024-03-28T07:49:14.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7225 sec 2024-03-28T07:49:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:13 smithi086 ceph-mon[35163]: pgmap v4339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6552.902951 secs 2024-03-28T07:49:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:13 smithi159 ceph-mon[36109]: pgmap v4339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6552.902951 secs 2024-03-28T07:49:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:13 smithi055 ceph-mon[31863]: pgmap v4339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6552.902951 secs 2024-03-28T07:49:15.115 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7226 sec 2024-03-28T07:49:16.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7227 sec 2024-03-28T07:49:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:15 smithi086 ceph-mon[35163]: pgmap v4340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:15 smithi159 ceph-mon[36109]: pgmap v4340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:16.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:15 smithi055 ceph-mon[31863]: pgmap v4340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:17.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7228 sec 2024-03-28T07:49:18.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7229 sec 2024-03-28T07:49:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:17 smithi086 ceph-mon[35163]: pgmap v4341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:17 smithi159 ceph-mon[36109]: pgmap v4341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:17 smithi055 ceph-mon[31863]: pgmap v4341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:19.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7230 sec 2024-03-28T07:49:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6557.903035 secs 2024-03-28T07:49:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6557.903035 secs 2024-03-28T07:49:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6557.903035 secs 2024-03-28T07:49:20.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7231 sec 2024-03-28T07:49:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:19 smithi086 ceph-mon[35163]: pgmap v4342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:20.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:19 smithi159 ceph-mon[36109]: pgmap v4342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:19 smithi055 ceph-mon[31863]: pgmap v4342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:21.116 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7232 sec 2024-03-28T07:49:22.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7233 sec 2024-03-28T07:49:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:21 smithi086 ceph-mon[35163]: pgmap v4343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:22.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:21 smithi159 ceph-mon[36109]: pgmap v4343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:21 smithi055 ceph-mon[31863]: pgmap v4343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:23.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7234 sec 2024-03-28T07:49:24.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7235 sec 2024-03-28T07:49:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:24 smithi086 ceph-mon[35163]: pgmap v4344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6562.903155 secs 2024-03-28T07:49:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:24 smithi159 ceph-mon[36109]: pgmap v4344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6562.903155 secs 2024-03-28T07:49:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:24 smithi055 ceph-mon[31863]: pgmap v4344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6562.903155 secs 2024-03-28T07:49:25.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7236 sec 2024-03-28T07:49:26.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7237 sec 2024-03-28T07:49:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:26 smithi086 ceph-mon[35163]: pgmap v4345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:26 smithi159 ceph-mon[36109]: pgmap v4345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:26 smithi055 ceph-mon[31863]: pgmap v4345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:27.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7238 sec 2024-03-28T07:49:28.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7239 sec 2024-03-28T07:49:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:28 smithi086 ceph-mon[35163]: pgmap v4346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:28 smithi159 ceph-mon[36109]: pgmap v4346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:28 smithi055 ceph-mon[31863]: pgmap v4346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:29.117 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7240 sec 2024-03-28T07:49:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6567.903275 secs 2024-03-28T07:49:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6567.903275 secs 2024-03-28T07:49:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6567.903275 secs 2024-03-28T07:49:30.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7241 sec 2024-03-28T07:49:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:30 smithi086 ceph-mon[35163]: pgmap v4347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:30.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:30 smithi159 ceph-mon[36109]: pgmap v4347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:30.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:30 smithi055 ceph-mon[31863]: pgmap v4347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:31.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7242 sec 2024-03-28T07:49:32.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7243 sec 2024-03-28T07:49:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:32 smithi086 ceph-mon[35163]: pgmap v4348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:32.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:32 smithi159 ceph-mon[36109]: pgmap v4348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:32 smithi055 ceph-mon[31863]: pgmap v4348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:33.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7244 sec 2024-03-28T07:49:34.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7245 sec 2024-03-28T07:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:34 smithi086 ceph-mon[35163]: pgmap v4349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6572.903396 secs 2024-03-28T07:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:34 smithi159 ceph-mon[36109]: pgmap v4349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6572.903396 secs 2024-03-28T07:49:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:34 smithi055 ceph-mon[31863]: pgmap v4349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6572.903396 secs 2024-03-28T07:49:35.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7246 sec 2024-03-28T07:49:36.118 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7247 sec 2024-03-28T07:49:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:36 smithi086 ceph-mon[35163]: pgmap v4350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:36 smithi159 ceph-mon[36109]: pgmap v4350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:36 smithi055 ceph-mon[31863]: pgmap v4350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:37.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7248 sec 2024-03-28T07:49:38.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7249 sec 2024-03-28T07:49:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:38 smithi086 ceph-mon[35163]: pgmap v4351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:38 smithi159 ceph-mon[36109]: pgmap v4351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:38 smithi055 ceph-mon[31863]: pgmap v4351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:39.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7250 sec 2024-03-28T07:49:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6577.903484 secs 2024-03-28T07:49:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6577.903484 secs 2024-03-28T07:49:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6577.903484 secs 2024-03-28T07:49:40.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7251 sec 2024-03-28T07:49:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:40 smithi055 ceph-mon[31863]: pgmap v4352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:40 smithi086 ceph-mon[35163]: pgmap v4352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:40.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:40 smithi159 ceph-mon[36109]: pgmap v4352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:41.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7252 sec 2024-03-28T07:49:42.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7253 sec 2024-03-28T07:49:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:42 smithi055 ceph-mon[31863]: pgmap v4353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:42 smithi086 ceph-mon[35163]: pgmap v4353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:42.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:42 smithi159 ceph-mon[36109]: pgmap v4353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:43.119 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7254 sec 2024-03-28T07:49:44.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7255 sec 2024-03-28T07:49:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:44 smithi055 ceph-mon[31863]: pgmap v4354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6582.903602 secs 2024-03-28T07:49:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:44 smithi086 ceph-mon[35163]: pgmap v4354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6582.903602 secs 2024-03-28T07:49:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:44 smithi159 ceph-mon[36109]: pgmap v4354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6582.903602 secs 2024-03-28T07:49:45.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7256 sec 2024-03-28T07:49:46.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7257 sec 2024-03-28T07:49:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:46 smithi055 ceph-mon[31863]: pgmap v4355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:46 smithi086 ceph-mon[35163]: pgmap v4355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:46 smithi159 ceph-mon[36109]: pgmap v4355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:47.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7258 sec 2024-03-28T07:49:48.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7259 sec 2024-03-28T07:49:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:48 smithi055 ceph-mon[31863]: pgmap v4356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:48 smithi086 ceph-mon[35163]: pgmap v4356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:48 smithi159 ceph-mon[36109]: pgmap v4356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:49.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7260 sec 2024-03-28T07:49:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6587.903687 secs 2024-03-28T07:49:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:49:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6587.903687 secs 2024-03-28T07:49:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:49:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6587.903687 secs 2024-03-28T07:49:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:49:50.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7261 sec 2024-03-28T07:49:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:50 smithi086 ceph-mon[35163]: pgmap v4357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:50 smithi159 ceph-mon[36109]: pgmap v4357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:50 smithi055 ceph-mon[31863]: pgmap v4357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:49:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:51.120 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7262 sec 2024-03-28T07:49:52.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7263 sec 2024-03-28T07:49:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:52 smithi086 ceph-mon[35163]: pgmap v4358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:49:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:49:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:52 smithi159 ceph-mon[36109]: pgmap v4358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:49:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:49:52.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:52 smithi055 ceph-mon[31863]: pgmap v4358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:49:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:49:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:49:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:49:53.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7264 sec 2024-03-28T07:49:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:53 smithi086 ceph-mon[35163]: pgmap v4359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:49:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:53 smithi086 ceph-mon[35163]: pgmap v4360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:53 smithi159 ceph-mon[36109]: pgmap v4359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:49:53.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:53 smithi159 ceph-mon[36109]: pgmap v4360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:53.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:53 smithi055 ceph-mon[31863]: pgmap v4359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:49:53.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:53 smithi055 ceph-mon[31863]: pgmap v4360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:54.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7265 sec 2024-03-28T07:49:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6592.903748 secs 2024-03-28T07:49:54.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6592.903748 secs 2024-03-28T07:49:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6592.903748 secs 2024-03-28T07:49:55.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7266 sec 2024-03-28T07:49:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:55 smithi086 ceph-mon[35163]: pgmap v4361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:55 smithi159 ceph-mon[36109]: pgmap v4361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:55.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:55 smithi055 ceph-mon[31863]: pgmap v4361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T07:49:56.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7267 sec 2024-03-28T07:49:57.121 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7268 sec 2024-03-28T07:49:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:57 smithi086 ceph-mon[35163]: pgmap v4362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:49:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:57 smithi159 ceph-mon[36109]: pgmap v4362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:49:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:57 smithi055 ceph-mon[31863]: pgmap v4362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T07:49:58.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7269 sec 2024-03-28T07:49:59.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7270 sec 2024-03-28T07:49:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:59 smithi086 ceph-mon[35163]: pgmap v4363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:49:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6597.903832 secs 2024-03-28T07:49:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:59 smithi159 ceph-mon[36109]: pgmap v4363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:49:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6597.903832 secs 2024-03-28T07:49:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:59 smithi055 ceph-mon[31863]: pgmap v4363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:49:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:49:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6597.903832 secs 2024-03-28T07:50:00.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7271 sec 2024-03-28T07:50:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:50:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:50:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T07:50:01.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7272 sec 2024-03-28T07:50:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:01 smithi086 ceph-mon[35163]: pgmap v4364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:01.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:01 smithi159 ceph-mon[36109]: pgmap v4364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:01.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:01 smithi055 ceph-mon[31863]: pgmap v4364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:02.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7273 sec 2024-03-28T07:50:03.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7274 sec 2024-03-28T07:50:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:03 smithi086 ceph-mon[35163]: pgmap v4365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:50:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:03 smithi159 ceph-mon[36109]: pgmap v4365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:50:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:03 smithi055 ceph-mon[31863]: pgmap v4365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:50:04.122 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7275 sec 2024-03-28T07:50:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6602.903927 secs 2024-03-28T07:50:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6602.903927 secs 2024-03-28T07:50:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6602.903927 secs 2024-03-28T07:50:05.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7276 sec 2024-03-28T07:50:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:05 smithi086 ceph-mon[35163]: pgmap v4366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:05 smithi159 ceph-mon[36109]: pgmap v4366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:05 smithi055 ceph-mon[31863]: pgmap v4366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:06.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7277 sec 2024-03-28T07:50:07.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7278 sec 2024-03-28T07:50:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:07 smithi086 ceph-mon[35163]: pgmap v4367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:07 smithi159 ceph-mon[36109]: pgmap v4367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:07.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:07 smithi055 ceph-mon[31863]: pgmap v4367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:08.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7279 sec 2024-03-28T07:50:09.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7280 sec 2024-03-28T07:50:09.449 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:09 smithi055 ceph-mon[31863]: pgmap v4368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:09.449 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6607.903950 secs 2024-03-28T07:50:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:09 smithi086 ceph-mon[35163]: pgmap v4368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6607.903950 secs 2024-03-28T07:50:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:09 smithi159 ceph-mon[36109]: pgmap v4368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6607.903950 secs 2024-03-28T07:50:10.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7281 sec 2024-03-28T07:50:11.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7282 sec 2024-03-28T07:50:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:11 smithi086 ceph-mon[35163]: pgmap v4369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:11.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:11 smithi159 ceph-mon[36109]: pgmap v4369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:11 smithi055 ceph-mon[31863]: pgmap v4369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:12.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7283 sec 2024-03-28T07:50:13.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7284 sec 2024-03-28T07:50:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:13 smithi086 ceph-mon[35163]: pgmap v4370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:13 smithi159 ceph-mon[36109]: pgmap v4370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:13 smithi055 ceph-mon[31863]: pgmap v4370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:14.123 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7285 sec 2024-03-28T07:50:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6612.904031 secs 2024-03-28T07:50:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6612.904031 secs 2024-03-28T07:50:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6612.904031 secs 2024-03-28T07:50:15.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7286 sec 2024-03-28T07:50:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:15 smithi086 ceph-mon[35163]: pgmap v4371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:15 smithi159 ceph-mon[36109]: pgmap v4371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:15 smithi055 ceph-mon[31863]: pgmap v4371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:16.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7287 sec 2024-03-28T07:50:17.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7288 sec 2024-03-28T07:50:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:17 smithi086 ceph-mon[35163]: pgmap v4372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:17 smithi159 ceph-mon[36109]: pgmap v4372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:17 smithi055 ceph-mon[31863]: pgmap v4372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:18.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7289 sec 2024-03-28T07:50:19.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7290 sec 2024-03-28T07:50:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:19 smithi086 ceph-mon[35163]: pgmap v4373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6617.904108 secs 2024-03-28T07:50:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:19 smithi159 ceph-mon[36109]: pgmap v4373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6617.904108 secs 2024-03-28T07:50:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:19 smithi055 ceph-mon[31863]: pgmap v4373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6617.904108 secs 2024-03-28T07:50:20.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7291 sec 2024-03-28T07:50:21.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7292 sec 2024-03-28T07:50:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:21 smithi086 ceph-mon[35163]: pgmap v4374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:21 smithi159 ceph-mon[36109]: pgmap v4374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:21 smithi055 ceph-mon[31863]: pgmap v4374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:22.124 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7293 sec 2024-03-28T07:50:23.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7294 sec 2024-03-28T07:50:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:23 smithi055 ceph-mon[31863]: pgmap v4375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:23 smithi086 ceph-mon[35163]: pgmap v4375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:23 smithi159 ceph-mon[36109]: pgmap v4375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:24.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7295 sec 2024-03-28T07:50:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6622.904228 secs 2024-03-28T07:50:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6622.904228 secs 2024-03-28T07:50:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6622.904228 secs 2024-03-28T07:50:25.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7296 sec 2024-03-28T07:50:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:25 smithi055 ceph-mon[31863]: pgmap v4376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:25 smithi086 ceph-mon[35163]: pgmap v4376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:25 smithi159 ceph-mon[36109]: pgmap v4376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:26.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7297 sec 2024-03-28T07:50:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:26 smithi055 ceph-mon[31863]: pgmap v4377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:26 smithi086 ceph-mon[35163]: pgmap v4377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:26.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:26 smithi159 ceph-mon[36109]: pgmap v4377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:27.125 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7298 sec 2024-03-28T07:50:28.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7299 sec 2024-03-28T07:50:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:28 smithi086 ceph-mon[35163]: pgmap v4378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:28 smithi159 ceph-mon[36109]: pgmap v4378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:28 smithi055 ceph-mon[31863]: pgmap v4378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:29.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7300 sec 2024-03-28T07:50:29.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6627.904298 secs 2024-03-28T07:50:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6627.904298 secs 2024-03-28T07:50:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6627.904298 secs 2024-03-28T07:50:30.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7301 sec 2024-03-28T07:50:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:30 smithi086 ceph-mon[35163]: pgmap v4379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:30 smithi159 ceph-mon[36109]: pgmap v4379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:30 smithi055 ceph-mon[31863]: pgmap v4379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:31.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7302 sec 2024-03-28T07:50:32.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7303 sec 2024-03-28T07:50:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:32 smithi086 ceph-mon[35163]: pgmap v4380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:32.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:32 smithi159 ceph-mon[36109]: pgmap v4380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:32.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:32 smithi055 ceph-mon[31863]: pgmap v4380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:33.126 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7304 sec 2024-03-28T07:50:34.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7305 sec 2024-03-28T07:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6632.904428 secs 2024-03-28T07:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:34 smithi086 ceph-mon[35163]: pgmap v4381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6632.904428 secs 2024-03-28T07:50:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:34 smithi159 ceph-mon[36109]: pgmap v4381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6632.904428 secs 2024-03-28T07:50:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:34 smithi055 ceph-mon[31863]: pgmap v4381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:35.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7306 sec 2024-03-28T07:50:36.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7307 sec 2024-03-28T07:50:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:36 smithi086 ceph-mon[35163]: pgmap v4382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:36.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:36 smithi159 ceph-mon[36109]: pgmap v4382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:36.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:36 smithi055 ceph-mon[31863]: pgmap v4382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:37.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7308 sec 2024-03-28T07:50:38.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7309 sec 2024-03-28T07:50:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:38 smithi086 ceph-mon[35163]: pgmap v4383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:38 smithi159 ceph-mon[36109]: pgmap v4383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:38 smithi055 ceph-mon[31863]: pgmap v4383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:39.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7310 sec 2024-03-28T07:50:39.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6637.904542 secs 2024-03-28T07:50:39.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6637.904542 secs 2024-03-28T07:50:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6637.904542 secs 2024-03-28T07:50:40.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7311 sec 2024-03-28T07:50:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:40 smithi086 ceph-mon[35163]: pgmap v4384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:40 smithi159 ceph-mon[36109]: pgmap v4384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:40.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:40 smithi055 ceph-mon[31863]: pgmap v4384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:41.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7312 sec 2024-03-28T07:50:42.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7313 sec 2024-03-28T07:50:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:42 smithi086 ceph-mon[35163]: pgmap v4385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:42 smithi159 ceph-mon[36109]: pgmap v4385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:42 smithi055 ceph-mon[31863]: pgmap v4385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:43.127 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7314 sec 2024-03-28T07:50:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6642.904678 secs 2024-03-28T07:50:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6642.904678 secs 2024-03-28T07:50:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6642.904678 secs 2024-03-28T07:50:44.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7315 sec 2024-03-28T07:50:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:44 smithi086 ceph-mon[35163]: pgmap v4386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:44.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:44 smithi159 ceph-mon[36109]: pgmap v4386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:44 smithi055 ceph-mon[31863]: pgmap v4386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:45.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7316 sec 2024-03-28T07:50:46.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7317 sec 2024-03-28T07:50:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:46 smithi086 ceph-mon[35163]: pgmap v4387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:46 smithi159 ceph-mon[36109]: pgmap v4387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:46 smithi055 ceph-mon[31863]: pgmap v4387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:47.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7318 sec 2024-03-28T07:50:48.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7319 sec 2024-03-28T07:50:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:48 smithi086 ceph-mon[35163]: pgmap v4388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6647.904751 secs 2024-03-28T07:50:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:48 smithi159 ceph-mon[36109]: pgmap v4388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6647.904751 secs 2024-03-28T07:50:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:48 smithi055 ceph-mon[31863]: pgmap v4388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6647.904751 secs 2024-03-28T07:50:49.128 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7320 sec 2024-03-28T07:50:50.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7321 sec 2024-03-28T07:50:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:50 smithi086 ceph-mon[35163]: pgmap v4389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:50 smithi159 ceph-mon[36109]: pgmap v4389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:50 smithi055 ceph-mon[31863]: pgmap v4389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:51.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7322 sec 2024-03-28T07:50:52.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7323 sec 2024-03-28T07:50:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:52 smithi086 ceph-mon[35163]: pgmap v4390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:50:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:52 smithi159 ceph-mon[36109]: pgmap v4390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:50:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:52 smithi055 ceph-mon[31863]: pgmap v4390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:50:53.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7324 sec 2024-03-28T07:50:54.042 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6652.904836 secs 2024-03-28T07:50:54.042 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6652.904836 secs 2024-03-28T07:50:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6652.904836 secs 2024-03-28T07:50:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:54.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7325 sec 2024-03-28T07:50:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:54 smithi086 ceph-mon[35163]: pgmap v4391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:55.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:54 smithi159 ceph-mon[36109]: pgmap v4391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:55.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:54 smithi055 ceph-mon[31863]: pgmap v4391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:50:55.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7326 sec 2024-03-28T07:50:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:56.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7327 sec 2024-03-28T07:50:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:56 smithi086 ceph-mon[35163]: pgmap v4392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:56 smithi159 ceph-mon[36109]: pgmap v4392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:56 smithi055 ceph-mon[31863]: pgmap v4392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:50:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:57.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7328 sec 2024-03-28T07:50:58.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7329 sec 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: pgmap v4393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6657.904920 secs 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: pgmap v4394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: pgmap v4395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:50:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:59.129 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7330 sec 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: pgmap v4393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6657.904920 secs 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: pgmap v4394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: pgmap v4395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:50:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: pgmap v4393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6657.904920 secs 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: pgmap v4394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: pgmap v4395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:50:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:50:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:51:00.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7331 sec 2024-03-28T07:51:01.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:00 smithi086 ceph-mon[35163]: pgmap v4396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:00 smithi055 ceph-mon[31863]: pgmap v4396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:01.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7332 sec 2024-03-28T07:51:01.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:00 smithi159 ceph-mon[36109]: pgmap v4396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:02.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7333 sec 2024-03-28T07:51:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:02 smithi055 ceph-mon[31863]: pgmap v4397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:03.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7334 sec 2024-03-28T07:51:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:02 smithi086 ceph-mon[35163]: pgmap v4397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:03.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:02 smithi159 ceph-mon[36109]: pgmap v4397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T07:51:04.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7335 sec 2024-03-28T07:51:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6662.905017 secs 2024-03-28T07:51:04.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6662.905017 secs 2024-03-28T07:51:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6662.905017 secs 2024-03-28T07:51:05.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7336 sec 2024-03-28T07:51:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:04 smithi086 ceph-mon[35163]: pgmap v4398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:51:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:04 smithi159 ceph-mon[36109]: pgmap v4398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:51:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:04 smithi055 ceph-mon[31863]: pgmap v4398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T07:51:06.130 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7337 sec 2024-03-28T07:51:07.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7338 sec 2024-03-28T07:51:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:06 smithi086 ceph-mon[35163]: pgmap v4399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:51:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:06 smithi159 ceph-mon[36109]: pgmap v4399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:51:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:06 smithi055 ceph-mon[31863]: pgmap v4399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T07:51:08.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7339 sec 2024-03-28T07:51:09.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7340 sec 2024-03-28T07:51:09.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6667.905107 secs 2024-03-28T07:51:09.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:08 smithi055 ceph-mon[31863]: pgmap v4400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:51:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6667.905107 secs 2024-03-28T07:51:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:08 smithi086 ceph-mon[35163]: pgmap v4400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:51:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6667.905107 secs 2024-03-28T07:51:09.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:08 smithi159 ceph-mon[36109]: pgmap v4400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:51:10.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7341 sec 2024-03-28T07:51:11.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7342 sec 2024-03-28T07:51:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:10 smithi086 ceph-mon[35163]: pgmap v4401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:10 smithi159 ceph-mon[36109]: pgmap v4401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:11.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:10 smithi055 ceph-mon[31863]: pgmap v4401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:12.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7343 sec 2024-03-28T07:51:13.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7344 sec 2024-03-28T07:51:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:12 smithi086 ceph-mon[35163]: pgmap v4402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:12 smithi159 ceph-mon[36109]: pgmap v4402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:12 smithi055 ceph-mon[31863]: pgmap v4402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:14.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7345 sec 2024-03-28T07:51:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6672.905183 secs 2024-03-28T07:51:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6672.905183 secs 2024-03-28T07:51:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6672.905183 secs 2024-03-28T07:51:15.131 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7346 sec 2024-03-28T07:51:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:14 smithi086 ceph-mon[35163]: pgmap v4403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:15.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:14 smithi159 ceph-mon[36109]: pgmap v4403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:15.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:14 smithi055 ceph-mon[31863]: pgmap v4403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:16.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7347 sec 2024-03-28T07:51:17.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7348 sec 2024-03-28T07:51:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:16 smithi086 ceph-mon[35163]: pgmap v4404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:16 smithi159 ceph-mon[36109]: pgmap v4404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:16 smithi055 ceph-mon[31863]: pgmap v4404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:18.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7349 sec 2024-03-28T07:51:19.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7350 sec 2024-03-28T07:51:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6677.905306 secs 2024-03-28T07:51:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:18 smithi086 ceph-mon[35163]: pgmap v4405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6677.905306 secs 2024-03-28T07:51:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:18 smithi159 ceph-mon[36109]: pgmap v4405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6677.905306 secs 2024-03-28T07:51:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:18 smithi055 ceph-mon[31863]: pgmap v4405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:20.132 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7351 sec 2024-03-28T07:51:21.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7352 sec 2024-03-28T07:51:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:20 smithi086 ceph-mon[35163]: pgmap v4406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:21.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:20 smithi159 ceph-mon[36109]: pgmap v4406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:21.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:20 smithi055 ceph-mon[31863]: pgmap v4406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:22.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7353 sec 2024-03-28T07:51:23.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7354 sec 2024-03-28T07:51:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:22 smithi086 ceph-mon[35163]: pgmap v4407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:22 smithi159 ceph-mon[36109]: pgmap v4407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:22 smithi055 ceph-mon[31863]: pgmap v4407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:24.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7355 sec 2024-03-28T07:51:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6682.905431 secs 2024-03-28T07:51:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6682.905431 secs 2024-03-28T07:51:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6682.905431 secs 2024-03-28T07:51:25.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7356 sec 2024-03-28T07:51:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:24 smithi086 ceph-mon[35163]: pgmap v4408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:24 smithi159 ceph-mon[36109]: pgmap v4408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:24 smithi055 ceph-mon[31863]: pgmap v4408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:26.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7357 sec 2024-03-28T07:51:27.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7358 sec 2024-03-28T07:51:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:26 smithi086 ceph-mon[35163]: pgmap v4409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:27.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:26 smithi159 ceph-mon[36109]: pgmap v4409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:26 smithi055 ceph-mon[31863]: pgmap v4409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:28.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7359 sec 2024-03-28T07:51:29.133 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7360 sec 2024-03-28T07:51:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6687.905497 secs 2024-03-28T07:51:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:28 smithi086 ceph-mon[35163]: pgmap v4410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6687.905497 secs 2024-03-28T07:51:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:28 smithi159 ceph-mon[36109]: pgmap v4410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6687.905497 secs 2024-03-28T07:51:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:28 smithi055 ceph-mon[31863]: pgmap v4410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:30.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7361 sec 2024-03-28T07:51:31.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7362 sec 2024-03-28T07:51:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:30 smithi086 ceph-mon[35163]: pgmap v4411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:30 smithi159 ceph-mon[36109]: pgmap v4411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:30 smithi055 ceph-mon[31863]: pgmap v4411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:32.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7363 sec 2024-03-28T07:51:33.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7364 sec 2024-03-28T07:51:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:32 smithi086 ceph-mon[35163]: pgmap v4412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:33 smithi159 ceph-mon[36109]: pgmap v4412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:32 smithi055 ceph-mon[31863]: pgmap v4412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:34.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7365 sec 2024-03-28T07:51:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6692.905619 secs 2024-03-28T07:51:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6692.905619 secs 2024-03-28T07:51:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6692.905619 secs 2024-03-28T07:51:35.134 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7366 sec 2024-03-28T07:51:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:35 smithi086 ceph-mon[35163]: pgmap v4413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:35 smithi159 ceph-mon[36109]: pgmap v4413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:35 smithi055 ceph-mon[31863]: pgmap v4413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:36.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7367 sec 2024-03-28T07:51:37.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7368 sec 2024-03-28T07:51:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:37 smithi086 ceph-mon[35163]: pgmap v4414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:37.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:37 smithi159 ceph-mon[36109]: pgmap v4414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:37.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:37 smithi055 ceph-mon[31863]: pgmap v4414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:38.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7369 sec 2024-03-28T07:51:39.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7370 sec 2024-03-28T07:51:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6697.905738 secs 2024-03-28T07:51:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:39 smithi086 ceph-mon[35163]: pgmap v4415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6697.905738 secs 2024-03-28T07:51:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:39 smithi159 ceph-mon[36109]: pgmap v4415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6697.905738 secs 2024-03-28T07:51:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:39 smithi055 ceph-mon[31863]: pgmap v4415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:40.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7371 sec 2024-03-28T07:51:41.135 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7372 sec 2024-03-28T07:51:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:41 smithi086 ceph-mon[35163]: pgmap v4416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:41 smithi159 ceph-mon[36109]: pgmap v4416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:41 smithi055 ceph-mon[31863]: pgmap v4416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:42.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7373 sec 2024-03-28T07:51:43.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7374 sec 2024-03-28T07:51:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:43 smithi086 ceph-mon[35163]: pgmap v4417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:43 smithi159 ceph-mon[36109]: pgmap v4417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:43 smithi055 ceph-mon[31863]: pgmap v4417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:44.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7375 sec 2024-03-28T07:51:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6702.905857 secs 2024-03-28T07:51:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6702.905857 secs 2024-03-28T07:51:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6702.905857 secs 2024-03-28T07:51:45.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7376 sec 2024-03-28T07:51:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:45 smithi086 ceph-mon[35163]: pgmap v4418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:45 smithi159 ceph-mon[36109]: pgmap v4418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:45 smithi055 ceph-mon[31863]: pgmap v4418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:46.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7377 sec 2024-03-28T07:51:47.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7378 sec 2024-03-28T07:51:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:47 smithi086 ceph-mon[35163]: pgmap v4419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:47.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:47 smithi159 ceph-mon[36109]: pgmap v4419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:47 smithi055 ceph-mon[31863]: pgmap v4419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:48.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7379 sec 2024-03-28T07:51:49.136 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7380 sec 2024-03-28T07:51:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6707.905945 secs 2024-03-28T07:51:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:49 smithi055 ceph-mon[31863]: pgmap v4420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6707.905945 secs 2024-03-28T07:51:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:49 smithi086 ceph-mon[35163]: pgmap v4420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6707.905945 secs 2024-03-28T07:51:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:49 smithi159 ceph-mon[36109]: pgmap v4420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:50.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7381 sec 2024-03-28T07:51:51.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7382 sec 2024-03-28T07:51:51.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:51 smithi055 ceph-mon[31863]: pgmap v4421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:51 smithi086 ceph-mon[35163]: pgmap v4421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:51.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:51 smithi159 ceph-mon[36109]: pgmap v4421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:51:52.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7383 sec 2024-03-28T07:51:53.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7384 sec 2024-03-28T07:51:53.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:53 smithi055 ceph-mon[31863]: pgmap v4422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:53 smithi086 ceph-mon[35163]: pgmap v4422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:53.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:53 smithi159 ceph-mon[36109]: pgmap v4422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:54.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7385 sec 2024-03-28T07:51:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6712.905969 secs 2024-03-28T07:51:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6712.905969 secs 2024-03-28T07:51:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6712.905969 secs 2024-03-28T07:51:55.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7386 sec 2024-03-28T07:51:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:55 smithi055 ceph-mon[31863]: pgmap v4423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:55 smithi086 ceph-mon[35163]: pgmap v4423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:55.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:55 smithi159 ceph-mon[36109]: pgmap v4423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:56.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7387 sec 2024-03-28T07:51:57.137 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7388 sec 2024-03-28T07:51:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:57 smithi055 ceph-mon[31863]: pgmap v4424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:57 smithi086 ceph-mon[35163]: pgmap v4424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:57 smithi159 ceph-mon[36109]: pgmap v4424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:58.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7389 sec 2024-03-28T07:51:59.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7390 sec 2024-03-28T07:51:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6717.906048 secs 2024-03-28T07:51:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:59 smithi086 ceph-mon[35163]: pgmap v4425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:51:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:51:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6717.906048 secs 2024-03-28T07:51:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:59 smithi159 ceph-mon[36109]: pgmap v4425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:51:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:51:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6717.906048 secs 2024-03-28T07:51:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:59 smithi055 ceph-mon[31863]: pgmap v4425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:51:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:51:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:52:00.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7391 sec 2024-03-28T07:52:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:52:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:52:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:52:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:52:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:52:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:52:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:52:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:52:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:52:01.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7392 sec 2024-03-28T07:52:01.471 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:01 smithi086 ceph-mon[35163]: pgmap v4426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:01.471 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:01 smithi086 ceph-mon[35163]: pgmap v4427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:01.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:01 smithi159 ceph-mon[36109]: pgmap v4426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:01.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:01 smithi159 ceph-mon[36109]: pgmap v4427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:01.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:01 smithi055 ceph-mon[31863]: pgmap v4426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:01.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:01 smithi055 ceph-mon[31863]: pgmap v4427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:02.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7393 sec 2024-03-28T07:52:03.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7394 sec 2024-03-28T07:52:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:03 smithi086 ceph-mon[35163]: pgmap v4428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:03 smithi159 ceph-mon[36109]: pgmap v4428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:03 smithi055 ceph-mon[31863]: pgmap v4428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:04.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7395 sec 2024-03-28T07:52:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6722.906136 secs 2024-03-28T07:52:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6722.906136 secs 2024-03-28T07:52:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6722.906136 secs 2024-03-28T07:52:05.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7396 sec 2024-03-28T07:52:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:05 smithi086 ceph-mon[35163]: pgmap v4429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:05 smithi159 ceph-mon[36109]: pgmap v4429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:05 smithi055 ceph-mon[31863]: pgmap v4429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:52:06.138 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7397 sec 2024-03-28T07:52:07.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7398 sec 2024-03-28T07:52:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:07 smithi086 ceph-mon[35163]: pgmap v4430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:07 smithi159 ceph-mon[36109]: pgmap v4430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:07 smithi055 ceph-mon[31863]: pgmap v4430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:08.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7399 sec 2024-03-28T07:52:09.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7400 sec 2024-03-28T07:52:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6727.906224 secs 2024-03-28T07:52:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:09 smithi086 ceph-mon[35163]: pgmap v4431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:52:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6727.906224 secs 2024-03-28T07:52:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:09 smithi159 ceph-mon[36109]: pgmap v4431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:52:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6727.906224 secs 2024-03-28T07:52:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:09 smithi055 ceph-mon[31863]: pgmap v4431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:52:10.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7401 sec 2024-03-28T07:52:11.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7402 sec 2024-03-28T07:52:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:11 smithi086 ceph-mon[35163]: pgmap v4432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:11.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:11 smithi159 ceph-mon[36109]: pgmap v4432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:11.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:11 smithi055 ceph-mon[31863]: pgmap v4432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:12.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7403 sec 2024-03-28T07:52:13.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7404 sec 2024-03-28T07:52:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:13 smithi086 ceph-mon[35163]: pgmap v4433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:13 smithi159 ceph-mon[36109]: pgmap v4433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:13 smithi055 ceph-mon[31863]: pgmap v4433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:14.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7405 sec 2024-03-28T07:52:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6732.906346 secs 2024-03-28T07:52:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6732.906346 secs 2024-03-28T07:52:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6732.906346 secs 2024-03-28T07:52:15.139 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7406 sec 2024-03-28T07:52:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:15 smithi086 ceph-mon[35163]: pgmap v4434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:15 smithi159 ceph-mon[36109]: pgmap v4434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:15.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:15 smithi055 ceph-mon[31863]: pgmap v4434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:16.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7407 sec 2024-03-28T07:52:17.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7408 sec 2024-03-28T07:52:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:17 smithi086 ceph-mon[35163]: pgmap v4435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:17 smithi159 ceph-mon[36109]: pgmap v4435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:17.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:17 smithi055 ceph-mon[31863]: pgmap v4435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:18.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7409 sec 2024-03-28T07:52:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:18 smithi086 ceph-mon[35163]: pgmap v4436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:18 smithi159 ceph-mon[36109]: pgmap v4436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:18 smithi055 ceph-mon[31863]: pgmap v4436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:19.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7410 sec 2024-03-28T07:52:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6737.906429 secs 2024-03-28T07:52:19.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6737.906429 secs 2024-03-28T07:52:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6737.906429 secs 2024-03-28T07:52:20.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7411 sec 2024-03-28T07:52:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:20 smithi086 ceph-mon[35163]: pgmap v4437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:20.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:20 smithi159 ceph-mon[36109]: pgmap v4437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:20 smithi055 ceph-mon[31863]: pgmap v4437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:21.140 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7412 sec 2024-03-28T07:52:22.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7413 sec 2024-03-28T07:52:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:22 smithi086 ceph-mon[35163]: pgmap v4438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:22 smithi159 ceph-mon[36109]: pgmap v4438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:22 smithi055 ceph-mon[31863]: pgmap v4438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:23.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7414 sec 2024-03-28T07:52:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6742.906514 secs 2024-03-28T07:52:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6742.906514 secs 2024-03-28T07:52:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6742.906514 secs 2024-03-28T07:52:24.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7415 sec 2024-03-28T07:52:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:24 smithi086 ceph-mon[35163]: pgmap v4439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:25.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:24 smithi159 ceph-mon[36109]: pgmap v4439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:24 smithi055 ceph-mon[31863]: pgmap v4439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:25.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7416 sec 2024-03-28T07:52:26.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7417 sec 2024-03-28T07:52:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:26 smithi086 ceph-mon[35163]: pgmap v4440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:27.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:26 smithi159 ceph-mon[36109]: pgmap v4440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:27.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:26 smithi055 ceph-mon[31863]: pgmap v4440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:27.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7418 sec 2024-03-28T07:52:28.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7419 sec 2024-03-28T07:52:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6747.906601 secs 2024-03-28T07:52:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:28 smithi086 ceph-mon[35163]: pgmap v4441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6747.906601 secs 2024-03-28T07:52:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:28 smithi159 ceph-mon[36109]: pgmap v4441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6747.906601 secs 2024-03-28T07:52:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:28 smithi055 ceph-mon[31863]: pgmap v4441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:29.141 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7420 sec 2024-03-28T07:52:30.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7421 sec 2024-03-28T07:52:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:30 smithi086 ceph-mon[35163]: pgmap v4442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:30 smithi159 ceph-mon[36109]: pgmap v4442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:31.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:30 smithi055 ceph-mon[31863]: pgmap v4442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:31.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7422 sec 2024-03-28T07:52:32.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7423 sec 2024-03-28T07:52:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:32 smithi086 ceph-mon[35163]: pgmap v4443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:32 smithi159 ceph-mon[36109]: pgmap v4443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:32 smithi055 ceph-mon[31863]: pgmap v4443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:33.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7424 sec 2024-03-28T07:52:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6752.906679 secs 2024-03-28T07:52:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6752.906679 secs 2024-03-28T07:52:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6752.906679 secs 2024-03-28T07:52:34.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7425 sec 2024-03-28T07:52:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:34 smithi086 ceph-mon[35163]: pgmap v4444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:35.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:34 smithi159 ceph-mon[36109]: pgmap v4444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:35.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:34 smithi055 ceph-mon[31863]: pgmap v4444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:35.142 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7426 sec 2024-03-28T07:52:36.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7427 sec 2024-03-28T07:52:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:36 smithi086 ceph-mon[35163]: pgmap v4445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:37.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:36 smithi159 ceph-mon[36109]: pgmap v4445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:36 smithi055 ceph-mon[31863]: pgmap v4445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:37.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7428 sec 2024-03-28T07:52:38.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7429 sec 2024-03-28T07:52:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6757.906813 secs 2024-03-28T07:52:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:38 smithi086 ceph-mon[35163]: pgmap v4446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6757.906813 secs 2024-03-28T07:52:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:38 smithi159 ceph-mon[36109]: pgmap v4446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6757.906813 secs 2024-03-28T07:52:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:38 smithi055 ceph-mon[31863]: pgmap v4446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:39.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7430 sec 2024-03-28T07:52:40.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7431 sec 2024-03-28T07:52:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:40 smithi086 ceph-mon[35163]: pgmap v4447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:40 smithi159 ceph-mon[36109]: pgmap v4447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:41.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:40 smithi055 ceph-mon[31863]: pgmap v4447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:41.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7432 sec 2024-03-28T07:52:42.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7433 sec 2024-03-28T07:52:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:42 smithi086 ceph-mon[35163]: pgmap v4448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:43.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:42 smithi159 ceph-mon[36109]: pgmap v4448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:43.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:42 smithi055 ceph-mon[31863]: pgmap v4448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:43.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7434 sec 2024-03-28T07:52:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6762.906935 secs 2024-03-28T07:52:44.143 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7435 sec 2024-03-28T07:52:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6762.906935 secs 2024-03-28T07:52:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6762.906935 secs 2024-03-28T07:52:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:44 smithi055 ceph-mon[31863]: pgmap v4449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:45.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7436 sec 2024-03-28T07:52:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:44 smithi086 ceph-mon[35163]: pgmap v4449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:45.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:44 smithi159 ceph-mon[36109]: pgmap v4449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:52:46.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7437 sec 2024-03-28T07:52:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:46 smithi055 ceph-mon[31863]: pgmap v4450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:47.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7438 sec 2024-03-28T07:52:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:46 smithi086 ceph-mon[35163]: pgmap v4450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:47.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:46 smithi159 ceph-mon[36109]: pgmap v4450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:52:48.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7439 sec 2024-03-28T07:52:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6767.907013 secs 2024-03-28T07:52:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:48 smithi055 ceph-mon[31863]: pgmap v4451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:49.144 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7440 sec 2024-03-28T07:52:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6767.907013 secs 2024-03-28T07:52:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:48 smithi086 ceph-mon[35163]: pgmap v4451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6767.907013 secs 2024-03-28T07:52:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:48 smithi159 ceph-mon[36109]: pgmap v4451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:52:50.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7441 sec 2024-03-28T07:52:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:50 smithi055 ceph-mon[31863]: pgmap v4452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:51.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7442 sec 2024-03-28T07:52:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:50 smithi086 ceph-mon[35163]: pgmap v4452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:51.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:50 smithi159 ceph-mon[36109]: pgmap v4452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:52.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7443 sec 2024-03-28T07:52:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:52 smithi055 ceph-mon[31863]: pgmap v4453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:53.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7444 sec 2024-03-28T07:52:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:52 smithi086 ceph-mon[35163]: pgmap v4453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:52 smithi159 ceph-mon[36109]: pgmap v4453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6772.907099 secs 2024-03-28T07:52:54.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7445 sec 2024-03-28T07:52:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6772.907099 secs 2024-03-28T07:52:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6772.907099 secs 2024-03-28T07:52:55.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:54 smithi055 ceph-mon[31863]: pgmap v4454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:55.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7446 sec 2024-03-28T07:52:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:54 smithi086 ceph-mon[35163]: pgmap v4454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:54 smithi159 ceph-mon[36109]: pgmap v4454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:56.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7447 sec 2024-03-28T07:52:57.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7448 sec 2024-03-28T07:52:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:56 smithi086 ceph-mon[35163]: pgmap v4455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:56 smithi159 ceph-mon[36109]: pgmap v4455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:56 smithi055 ceph-mon[31863]: pgmap v4455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:52:58.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7449 sec 2024-03-28T07:52:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:58 smithi086 ceph-mon[35163]: pgmap v4456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:52:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:58 smithi159 ceph-mon[36109]: pgmap v4456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:52:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:58 smithi055 ceph-mon[31863]: pgmap v4456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:52:59.145 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7450 sec 2024-03-28T07:52:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:52:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6777.907168 secs 2024-03-28T07:52:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:52:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6777.907168 secs 2024-03-28T07:52:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:52:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6777.907168 secs 2024-03-28T07:53:00.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7451 sec 2024-03-28T07:53:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:00 smithi086 ceph-mon[35163]: pgmap v4457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:53:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:53:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:00 smithi159 ceph-mon[36109]: pgmap v4457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:53:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:53:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:00 smithi055 ceph-mon[31863]: pgmap v4457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:53:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:53:01.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7452 sec 2024-03-28T07:53:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:53:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:53:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:53:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:53:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:53:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:53:02.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7453 sec 2024-03-28T07:53:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:02 smithi086 ceph-mon[35163]: pgmap v4458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:53:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:02 smithi159 ceph-mon[36109]: pgmap v4458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:53:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:02 smithi055 ceph-mon[31863]: pgmap v4458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:53:03.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7454 sec 2024-03-28T07:53:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6782.907239 secs 2024-03-28T07:53:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6782.907239 secs 2024-03-28T07:53:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6782.907239 secs 2024-03-28T07:53:04.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7455 sec 2024-03-28T07:53:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:04 smithi086 ceph-mon[35163]: pgmap v4459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:04 smithi159 ceph-mon[36109]: pgmap v4459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:04 smithi055 ceph-mon[31863]: pgmap v4459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:05.146 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7456 sec 2024-03-28T07:53:06.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7457 sec 2024-03-28T07:53:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:06 smithi086 ceph-mon[35163]: pgmap v4460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:06 smithi159 ceph-mon[36109]: pgmap v4460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:06 smithi055 ceph-mon[31863]: pgmap v4460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:07.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7458 sec 2024-03-28T07:53:08.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7459 sec 2024-03-28T07:53:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:08 smithi086 ceph-mon[35163]: pgmap v4461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6787.907364 secs 2024-03-28T07:53:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:08 smithi159 ceph-mon[36109]: pgmap v4461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6787.907364 secs 2024-03-28T07:53:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:08 smithi055 ceph-mon[31863]: pgmap v4461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6787.907364 secs 2024-03-28T07:53:09.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7460 sec 2024-03-28T07:53:10.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7461 sec 2024-03-28T07:53:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:10 smithi086 ceph-mon[35163]: pgmap v4462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:10 smithi159 ceph-mon[36109]: pgmap v4462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:10 smithi055 ceph-mon[31863]: pgmap v4462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:11.147 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7462 sec 2024-03-28T07:53:12.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7463 sec 2024-03-28T07:53:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:12 smithi086 ceph-mon[35163]: pgmap v4463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:12 smithi159 ceph-mon[36109]: pgmap v4463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:12 smithi055 ceph-mon[31863]: pgmap v4463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:13.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7464 sec 2024-03-28T07:53:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6792.907444 secs 2024-03-28T07:53:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6792.907444 secs 2024-03-28T07:53:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6792.907444 secs 2024-03-28T07:53:14.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7465 sec 2024-03-28T07:53:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:14 smithi086 ceph-mon[35163]: pgmap v4464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:14 smithi159 ceph-mon[36109]: pgmap v4464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:14 smithi055 ceph-mon[31863]: pgmap v4464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:15.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7466 sec 2024-03-28T07:53:16.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7467 sec 2024-03-28T07:53:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:16 smithi086 ceph-mon[35163]: pgmap v4465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:16 smithi159 ceph-mon[36109]: pgmap v4465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:16 smithi055 ceph-mon[31863]: pgmap v4465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:17.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7468 sec 2024-03-28T07:53:18.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7469 sec 2024-03-28T07:53:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:18 smithi086 ceph-mon[35163]: pgmap v4466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6797.907553 secs 2024-03-28T07:53:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:18 smithi159 ceph-mon[36109]: pgmap v4466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6797.907553 secs 2024-03-28T07:53:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:18 smithi055 ceph-mon[31863]: pgmap v4466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6797.907553 secs 2024-03-28T07:53:19.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7470 sec 2024-03-28T07:53:20.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7471 sec 2024-03-28T07:53:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:20 smithi086 ceph-mon[35163]: pgmap v4467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:20 smithi159 ceph-mon[36109]: pgmap v4467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:20 smithi055 ceph-mon[31863]: pgmap v4467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:21.148 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7472 sec 2024-03-28T07:53:22.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7473 sec 2024-03-28T07:53:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:22 smithi055 ceph-mon[31863]: pgmap v4468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:22 smithi086 ceph-mon[35163]: pgmap v4468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:22 smithi159 ceph-mon[36109]: pgmap v4468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:23.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7474 sec 2024-03-28T07:53:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6802.907656 secs 2024-03-28T07:53:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6802.907656 secs 2024-03-28T07:53:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6802.907656 secs 2024-03-28T07:53:24.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7475 sec 2024-03-28T07:53:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:24 smithi055 ceph-mon[31863]: pgmap v4469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:24 smithi086 ceph-mon[35163]: pgmap v4469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:25.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:24 smithi159 ceph-mon[36109]: pgmap v4469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:25.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7476 sec 2024-03-28T07:53:26.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7477 sec 2024-03-28T07:53:26.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:26 smithi055 ceph-mon[31863]: pgmap v4470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:26 smithi086 ceph-mon[35163]: pgmap v4470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:26 smithi159 ceph-mon[36109]: pgmap v4470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:27.149 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7478 sec 2024-03-28T07:53:28.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7479 sec 2024-03-28T07:53:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:28 smithi055 ceph-mon[31863]: pgmap v4471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6807.907817 secs 2024-03-28T07:53:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:28 smithi086 ceph-mon[35163]: pgmap v4471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6807.907817 secs 2024-03-28T07:53:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:28 smithi159 ceph-mon[36109]: pgmap v4471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:29.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6807.907817 secs 2024-03-28T07:53:29.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7480 sec 2024-03-28T07:53:30.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7481 sec 2024-03-28T07:53:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:30 smithi055 ceph-mon[31863]: pgmap v4472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:30 smithi086 ceph-mon[35163]: pgmap v4472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:31.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:30 smithi159 ceph-mon[36109]: pgmap v4472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:31.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7482 sec 2024-03-28T07:53:32.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7483 sec 2024-03-28T07:53:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:32 smithi086 ceph-mon[35163]: pgmap v4473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:32 smithi159 ceph-mon[36109]: pgmap v4473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:32 smithi055 ceph-mon[31863]: pgmap v4473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:33.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7484 sec 2024-03-28T07:53:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6812.907936 secs 2024-03-28T07:53:34.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6812.907936 secs 2024-03-28T07:53:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6812.907936 secs 2024-03-28T07:53:34.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7485 sec 2024-03-28T07:53:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:34 smithi086 ceph-mon[35163]: pgmap v4474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:35.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:34 smithi159 ceph-mon[36109]: pgmap v4474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:34 smithi055 ceph-mon[31863]: pgmap v4474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:35.150 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7486 sec 2024-03-28T07:53:36.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7487 sec 2024-03-28T07:53:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:36 smithi086 ceph-mon[35163]: pgmap v4475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:37.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:36 smithi159 ceph-mon[36109]: pgmap v4475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:37.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:36 smithi055 ceph-mon[31863]: pgmap v4475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:37.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7488 sec 2024-03-28T07:53:38.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7489 sec 2024-03-28T07:53:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:38 smithi086 ceph-mon[35163]: pgmap v4476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6817.908057 secs 2024-03-28T07:53:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:38 smithi159 ceph-mon[36109]: pgmap v4476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:39.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6817.908057 secs 2024-03-28T07:53:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:38 smithi055 ceph-mon[31863]: pgmap v4476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6817.908057 secs 2024-03-28T07:53:39.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7490 sec 2024-03-28T07:53:40.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7491 sec 2024-03-28T07:53:40.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:40 smithi055 ceph-mon[31863]: pgmap v4477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:40 smithi086 ceph-mon[35163]: pgmap v4477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:41.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:40 smithi159 ceph-mon[36109]: pgmap v4477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:41.151 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7492 sec 2024-03-28T07:53:42.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7493 sec 2024-03-28T07:53:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:42 smithi086 ceph-mon[35163]: pgmap v4478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:43.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:42 smithi159 ceph-mon[36109]: pgmap v4478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:43.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:42 smithi055 ceph-mon[31863]: pgmap v4478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:43.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7494 sec 2024-03-28T07:53:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6822.908176 secs 2024-03-28T07:53:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6822.908176 secs 2024-03-28T07:53:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6822.908176 secs 2024-03-28T07:53:44.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7495 sec 2024-03-28T07:53:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:44 smithi086 ceph-mon[35163]: pgmap v4479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:44 smithi159 ceph-mon[36109]: pgmap v4479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:44 smithi055 ceph-mon[31863]: pgmap v4479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:45.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7496 sec 2024-03-28T07:53:46.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7497 sec 2024-03-28T07:53:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:46 smithi086 ceph-mon[35163]: pgmap v4480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:47.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:46 smithi159 ceph-mon[36109]: pgmap v4480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:46 smithi055 ceph-mon[31863]: pgmap v4480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:47.152 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7498 sec 2024-03-28T07:53:48.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7499 sec 2024-03-28T07:53:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:48 smithi086 ceph-mon[35163]: pgmap v4481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6827.908301 secs 2024-03-28T07:53:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:48 smithi159 ceph-mon[36109]: pgmap v4481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6827.908301 secs 2024-03-28T07:53:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:48 smithi055 ceph-mon[31863]: pgmap v4481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6827.908301 secs 2024-03-28T07:53:49.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7500 sec 2024-03-28T07:53:50.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7501 sec 2024-03-28T07:53:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:50 smithi086 ceph-mon[35163]: pgmap v4482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:51.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:50 smithi159 ceph-mon[36109]: pgmap v4482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:50 smithi055 ceph-mon[31863]: pgmap v4482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:51.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7502 sec 2024-03-28T07:53:52.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7503 sec 2024-03-28T07:53:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:52 smithi086 ceph-mon[35163]: pgmap v4483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:52 smithi159 ceph-mon[36109]: pgmap v4483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:52 smithi055 ceph-mon[31863]: pgmap v4483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:53.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7504 sec 2024-03-28T07:53:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6832.908425 secs 2024-03-28T07:53:54.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6832.908425 secs 2024-03-28T07:53:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6832.908425 secs 2024-03-28T07:53:54.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7505 sec 2024-03-28T07:53:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:54 smithi086 ceph-mon[35163]: pgmap v4484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:54 smithi159 ceph-mon[36109]: pgmap v4484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:55.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:54 smithi055 ceph-mon[31863]: pgmap v4484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:53:55.153 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7506 sec 2024-03-28T07:53:56.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7507 sec 2024-03-28T07:53:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:56 smithi086 ceph-mon[35163]: pgmap v4485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:56 smithi159 ceph-mon[36109]: pgmap v4485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:56 smithi055 ceph-mon[31863]: pgmap v4485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:53:57.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7508 sec 2024-03-28T07:53:58.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7509 sec 2024-03-28T07:53:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:58 smithi086 ceph-mon[35163]: pgmap v4486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:53:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6837.908515 secs 2024-03-28T07:53:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:58 smithi159 ceph-mon[36109]: pgmap v4486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:53:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6837.908515 secs 2024-03-28T07:53:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:58 smithi055 ceph-mon[31863]: pgmap v4486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:53:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:53:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6837.908515 secs 2024-03-28T07:53:59.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7510 sec 2024-03-28T07:54:00.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7511 sec 2024-03-28T07:54:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:00 smithi086 ceph-mon[35163]: pgmap v4487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:00 smithi159 ceph-mon[36109]: pgmap v4487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:00 smithi055 ceph-mon[31863]: pgmap v4487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:01.154 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7512 sec 2024-03-28T07:54:02.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7513 sec 2024-03-28T07:54:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:02 smithi086 ceph-mon[35163]: pgmap v4488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:54:03.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:02 smithi159 ceph-mon[36109]: pgmap v4488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:03.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:54:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:02 smithi055 ceph-mon[31863]: pgmap v4488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:54:03.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7514 sec 2024-03-28T07:54:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6842.908590 secs 2024-03-28T07:54:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:54:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:54:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: pgmap v4489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: pgmap v4490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6842.908590 secs 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: pgmap v4489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: pgmap v4490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6842.908590 secs 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: pgmap v4489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: pgmap v4490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:54:04.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7515 sec 2024-03-28T07:54:05.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7516 sec 2024-03-28T07:54:06.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7517 sec 2024-03-28T07:54:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:06 smithi086 ceph-mon[35163]: pgmap v4491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:54:06.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:06 smithi159 ceph-mon[36109]: pgmap v4491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:54:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:06 smithi055 ceph-mon[31863]: pgmap v4491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:54:07.155 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7518 sec 2024-03-28T07:54:08.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7519 sec 2024-03-28T07:54:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:08 smithi086 ceph-mon[35163]: pgmap v4492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:08 smithi159 ceph-mon[36109]: pgmap v4492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:08 smithi055 ceph-mon[31863]: pgmap v4492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:09.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7520 sec 2024-03-28T07:54:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6847.908661 secs 2024-03-28T07:54:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6847.908661 secs 2024-03-28T07:54:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6847.908661 secs 2024-03-28T07:54:10.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7521 sec 2024-03-28T07:54:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:10 smithi086 ceph-mon[35163]: pgmap v4493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:10 smithi159 ceph-mon[36109]: pgmap v4493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:10 smithi055 ceph-mon[31863]: pgmap v4493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:11.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7522 sec 2024-03-28T07:54:12.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7523 sec 2024-03-28T07:54:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:12 smithi055 ceph-mon[31863]: pgmap v4494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:12 smithi086 ceph-mon[35163]: pgmap v4494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:12 smithi159 ceph-mon[36109]: pgmap v4494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:13.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7524 sec 2024-03-28T07:54:14.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7525 sec 2024-03-28T07:54:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6852.908805 secs 2024-03-28T07:54:14.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:14 smithi055 ceph-mon[31863]: pgmap v4495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:54:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6852.908805 secs 2024-03-28T07:54:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:14 smithi086 ceph-mon[35163]: pgmap v4495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:54:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6852.908805 secs 2024-03-28T07:54:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:14 smithi159 ceph-mon[36109]: pgmap v4495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:54:15.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7526 sec 2024-03-28T07:54:16.156 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7527 sec 2024-03-28T07:54:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:16 smithi055 ceph-mon[31863]: pgmap v4496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:16 smithi086 ceph-mon[35163]: pgmap v4496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:16 smithi159 ceph-mon[36109]: pgmap v4496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:17.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7528 sec 2024-03-28T07:54:18.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7529 sec 2024-03-28T07:54:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:18 smithi055 ceph-mon[31863]: pgmap v4497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:18 smithi086 ceph-mon[35163]: pgmap v4497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:18 smithi159 ceph-mon[36109]: pgmap v4497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:19.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7530 sec 2024-03-28T07:54:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6857.908921 secs 2024-03-28T07:54:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6857.908921 secs 2024-03-28T07:54:19.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6857.908921 secs 2024-03-28T07:54:20.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7531 sec 2024-03-28T07:54:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:20 smithi055 ceph-mon[31863]: pgmap v4498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:20 smithi086 ceph-mon[35163]: pgmap v4498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:20 smithi159 ceph-mon[36109]: pgmap v4498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:21.157 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7532 sec 2024-03-28T07:54:22.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7533 sec 2024-03-28T07:54:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:22 smithi086 ceph-mon[35163]: pgmap v4499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:22 smithi159 ceph-mon[36109]: pgmap v4499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:22 smithi055 ceph-mon[31863]: pgmap v4499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:23.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7534 sec 2024-03-28T07:54:24.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7535 sec 2024-03-28T07:54:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6862.909045 secs 2024-03-28T07:54:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:24 smithi086 ceph-mon[35163]: pgmap v4500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6862.909045 secs 2024-03-28T07:54:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:24 smithi159 ceph-mon[36109]: pgmap v4500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6862.909045 secs 2024-03-28T07:54:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:24 smithi055 ceph-mon[31863]: pgmap v4500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:25.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7536 sec 2024-03-28T07:54:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:25 smithi086 ceph-mon[35163]: pgmap v4501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:25 smithi159 ceph-mon[36109]: pgmap v4501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:25 smithi055 ceph-mon[31863]: pgmap v4501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:26.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7537 sec 2024-03-28T07:54:27.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7538 sec 2024-03-28T07:54:28.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7539 sec 2024-03-28T07:54:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:28 smithi086 ceph-mon[35163]: pgmap v4502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:28 smithi159 ceph-mon[36109]: pgmap v4502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:28 smithi055 ceph-mon[31863]: pgmap v4502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:29.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7540 sec 2024-03-28T07:54:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6867.909140 secs 2024-03-28T07:54:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6867.909140 secs 2024-03-28T07:54:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6867.909140 secs 2024-03-28T07:54:30.158 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7541 sec 2024-03-28T07:54:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:30 smithi055 ceph-mon[31863]: pgmap v4503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:30 smithi086 ceph-mon[35163]: pgmap v4503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:30 smithi159 ceph-mon[36109]: pgmap v4503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:31.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7542 sec 2024-03-28T07:54:32.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7543 sec 2024-03-28T07:54:32.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:32 smithi086 ceph-mon[35163]: pgmap v4504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:32 smithi055 ceph-mon[31863]: pgmap v4504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:32.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:32 smithi159 ceph-mon[36109]: pgmap v4504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:33.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7544 sec 2024-03-28T07:54:34.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7545 sec 2024-03-28T07:54:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6872.909219 secs 2024-03-28T07:54:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:34 smithi055 ceph-mon[31863]: pgmap v4505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6872.909219 secs 2024-03-28T07:54:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:34 smithi086 ceph-mon[35163]: pgmap v4505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6872.909219 secs 2024-03-28T07:54:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:34 smithi159 ceph-mon[36109]: pgmap v4505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:35.159 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7546 sec 2024-03-28T07:54:36.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7547 sec 2024-03-28T07:54:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:36 smithi055 ceph-mon[31863]: pgmap v4506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:36 smithi086 ceph-mon[35163]: pgmap v4506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:36 smithi159 ceph-mon[36109]: pgmap v4506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:37.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7548 sec 2024-03-28T07:54:38.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7549 sec 2024-03-28T07:54:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:38 smithi055 ceph-mon[31863]: pgmap v4507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:38 smithi086 ceph-mon[35163]: pgmap v4507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:38 smithi159 ceph-mon[36109]: pgmap v4507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:39.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7550 sec 2024-03-28T07:54:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6877.909326 secs 2024-03-28T07:54:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6877.909326 secs 2024-03-28T07:54:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6877.909326 secs 2024-03-28T07:54:40.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7551 sec 2024-03-28T07:54:40.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:40 smithi159 ceph-mon[36109]: pgmap v4508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:40 smithi086 ceph-mon[35163]: pgmap v4508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:40.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:40 smithi055 ceph-mon[31863]: pgmap v4508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:41.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7552 sec 2024-03-28T07:54:42.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7553 sec 2024-03-28T07:54:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:42 smithi086 ceph-mon[35163]: pgmap v4509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:42 smithi159 ceph-mon[36109]: pgmap v4509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:42.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:42 smithi055 ceph-mon[31863]: pgmap v4509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:43.160 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7554 sec 2024-03-28T07:54:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:43 smithi086 ceph-mon[35163]: pgmap v4510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:43 smithi159 ceph-mon[36109]: pgmap v4510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:43 smithi055 ceph-mon[31863]: pgmap v4510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:44.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7555 sec 2024-03-28T07:54:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6882.909394 secs 2024-03-28T07:54:44.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6882.909394 secs 2024-03-28T07:54:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6882.909394 secs 2024-03-28T07:54:45.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7556 sec 2024-03-28T07:54:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:45 smithi086 ceph-mon[35163]: pgmap v4511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:54:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:45 smithi159 ceph-mon[36109]: pgmap v4511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:54:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:45 smithi055 ceph-mon[31863]: pgmap v4511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T07:54:46.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7557 sec 2024-03-28T07:54:47.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7558 sec 2024-03-28T07:54:48.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7559 sec 2024-03-28T07:54:48.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:48 smithi159 ceph-mon[36109]: pgmap v4512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:48 smithi055 ceph-mon[31863]: pgmap v4512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:48 smithi086 ceph-mon[35163]: pgmap v4512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:54:49.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7560 sec 2024-03-28T07:54:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6887.909519 secs 2024-03-28T07:54:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6887.909519 secs 2024-03-28T07:54:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6887.909519 secs 2024-03-28T07:54:50.161 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7561 sec 2024-03-28T07:54:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:50 smithi055 ceph-mon[31863]: pgmap v4513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:50 smithi086 ceph-mon[35163]: pgmap v4513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:50 smithi159 ceph-mon[36109]: pgmap v4513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:51.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7562 sec 2024-03-28T07:54:52.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7563 sec 2024-03-28T07:54:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:52 smithi055 ceph-mon[31863]: pgmap v4514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:52 smithi086 ceph-mon[35163]: pgmap v4514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:52 smithi159 ceph-mon[36109]: pgmap v4514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:53.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7564 sec 2024-03-28T07:54:54.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7565 sec 2024-03-28T07:54:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6892.909644 secs 2024-03-28T07:54:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:54 smithi055 ceph-mon[31863]: pgmap v4515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6892.909644 secs 2024-03-28T07:54:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:54 smithi086 ceph-mon[35163]: pgmap v4515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6892.909644 secs 2024-03-28T07:54:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:54 smithi159 ceph-mon[36109]: pgmap v4515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:55.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7566 sec 2024-03-28T07:54:56.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7567 sec 2024-03-28T07:54:56.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:56 smithi055 ceph-mon[31863]: pgmap v4516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:56 smithi086 ceph-mon[35163]: pgmap v4516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:56 smithi159 ceph-mon[36109]: pgmap v4516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:54:57.162 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7568 sec 2024-03-28T07:54:58.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7569 sec 2024-03-28T07:54:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:58 smithi055 ceph-mon[31863]: pgmap v4517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:58 smithi086 ceph-mon[35163]: pgmap v4517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:58 smithi159 ceph-mon[36109]: pgmap v4517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:54:59.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7570 sec 2024-03-28T07:54:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:54:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6897.909764 secs 2024-03-28T07:54:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:54:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6897.909764 secs 2024-03-28T07:54:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:54:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6897.909764 secs 2024-03-28T07:55:00.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7571 sec 2024-03-28T07:55:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:00 smithi086 ceph-mon[35163]: pgmap v4518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:00 smithi159 ceph-mon[36109]: pgmap v4518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:00 smithi055 ceph-mon[31863]: pgmap v4518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:01.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7572 sec 2024-03-28T07:55:02.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7573 sec 2024-03-28T07:55:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:02 smithi086 ceph-mon[35163]: pgmap v4519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:02 smithi159 ceph-mon[36109]: pgmap v4519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:02 smithi055 ceph-mon[31863]: pgmap v4519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:03.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7574 sec 2024-03-28T07:55:04.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7575 sec 2024-03-28T07:55:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6902.909895 secs 2024-03-28T07:55:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:04 smithi086 ceph-mon[35163]: pgmap v4520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:55:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6902.909895 secs 2024-03-28T07:55:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:04 smithi159 ceph-mon[36109]: pgmap v4520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:55:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6902.909895 secs 2024-03-28T07:55:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:04 smithi055 ceph-mon[31863]: pgmap v4520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:55:05.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7576 sec 2024-03-28T07:55:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:55:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:55:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:55:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:55:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:55:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:55:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:55:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:55:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:55:06.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7577 sec 2024-03-28T07:55:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:06 smithi086 ceph-mon[35163]: pgmap v4521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:06 smithi086 ceph-mon[35163]: pgmap v4522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:06 smithi159 ceph-mon[36109]: pgmap v4521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:06 smithi159 ceph-mon[36109]: pgmap v4522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:06 smithi055 ceph-mon[31863]: pgmap v4521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:06 smithi055 ceph-mon[31863]: pgmap v4522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:07.163 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7578 sec 2024-03-28T07:55:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:07 smithi086 ceph-mon[35163]: pgmap v4523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:07 smithi159 ceph-mon[36109]: pgmap v4523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:07 smithi055 ceph-mon[31863]: pgmap v4523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:08.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7579 sec 2024-03-28T07:55:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6907.909978 secs 2024-03-28T07:55:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6907.909978 secs 2024-03-28T07:55:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6907.909978 secs 2024-03-28T07:55:09.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7580 sec 2024-03-28T07:55:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:09 smithi086 ceph-mon[35163]: pgmap v4524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:09 smithi159 ceph-mon[36109]: pgmap v4524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:09 smithi055 ceph-mon[31863]: pgmap v4524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:10.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7581 sec 2024-03-28T07:55:11.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7582 sec 2024-03-28T07:55:12.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7583 sec 2024-03-28T07:55:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:12 smithi055 ceph-mon[31863]: pgmap v4525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:12.524 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:12 smithi159 ceph-mon[36109]: pgmap v4525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:12 smithi086 ceph-mon[35163]: pgmap v4525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:13.164 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7584 sec 2024-03-28T07:55:14.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7585 sec 2024-03-28T07:55:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6912.910099 secs 2024-03-28T07:55:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:14 smithi055 ceph-mon[31863]: pgmap v4526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6912.910099 secs 2024-03-28T07:55:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:14 smithi086 ceph-mon[35163]: pgmap v4526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6912.910099 secs 2024-03-28T07:55:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:14 smithi159 ceph-mon[36109]: pgmap v4526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:55:15.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7586 sec 2024-03-28T07:55:16.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7587 sec 2024-03-28T07:55:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:16 smithi086 ceph-mon[35163]: pgmap v4527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:55:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:16 smithi159 ceph-mon[36109]: pgmap v4527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:55:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:16 smithi055 ceph-mon[31863]: pgmap v4527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:55:17.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7588 sec 2024-03-28T07:55:18.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7589 sec 2024-03-28T07:55:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:18 smithi086 ceph-mon[35163]: pgmap v4528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:18 smithi159 ceph-mon[36109]: pgmap v4528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:18 smithi055 ceph-mon[31863]: pgmap v4528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:19.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7590 sec 2024-03-28T07:55:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6917.910223 secs 2024-03-28T07:55:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6917.910223 secs 2024-03-28T07:55:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6917.910223 secs 2024-03-28T07:55:20.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7591 sec 2024-03-28T07:55:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:20 smithi086 ceph-mon[35163]: pgmap v4529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:20 smithi159 ceph-mon[36109]: pgmap v4529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:20 smithi055 ceph-mon[31863]: pgmap v4529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:21.165 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7592 sec 2024-03-28T07:55:22.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7593 sec 2024-03-28T07:55:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:22 smithi086 ceph-mon[35163]: pgmap v4530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:22 smithi159 ceph-mon[36109]: pgmap v4530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:22 smithi055 ceph-mon[31863]: pgmap v4530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:23.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7594 sec 2024-03-28T07:55:24.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7595 sec 2024-03-28T07:55:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6922.910297 secs 2024-03-28T07:55:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:24 smithi086 ceph-mon[35163]: pgmap v4531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6922.910297 secs 2024-03-28T07:55:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:24 smithi159 ceph-mon[36109]: pgmap v4531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6922.910297 secs 2024-03-28T07:55:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:24 smithi055 ceph-mon[31863]: pgmap v4531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:25.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7596 sec 2024-03-28T07:55:26.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7597 sec 2024-03-28T07:55:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:26 smithi086 ceph-mon[35163]: pgmap v4532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:26 smithi159 ceph-mon[36109]: pgmap v4532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:26 smithi055 ceph-mon[31863]: pgmap v4532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:27.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7598 sec 2024-03-28T07:55:28.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7599 sec 2024-03-28T07:55:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:28 smithi086 ceph-mon[35163]: pgmap v4533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:28 smithi159 ceph-mon[36109]: pgmap v4533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:28 smithi055 ceph-mon[31863]: pgmap v4533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:29.166 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7600 sec 2024-03-28T07:55:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6927.910360 secs 2024-03-28T07:55:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6927.910360 secs 2024-03-28T07:55:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6927.910360 secs 2024-03-28T07:55:30.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7601 sec 2024-03-28T07:55:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:30 smithi086 ceph-mon[35163]: pgmap v4534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:30 smithi159 ceph-mon[36109]: pgmap v4534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:30 smithi055 ceph-mon[31863]: pgmap v4534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:31.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7602 sec 2024-03-28T07:55:32.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7603 sec 2024-03-28T07:55:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:32 smithi086 ceph-mon[35163]: pgmap v4535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:32 smithi159 ceph-mon[36109]: pgmap v4535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:32 smithi055 ceph-mon[31863]: pgmap v4535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:33.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7604 sec 2024-03-28T07:55:34.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7605 sec 2024-03-28T07:55:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6932.910439 secs 2024-03-28T07:55:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:34 smithi086 ceph-mon[35163]: pgmap v4536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6932.910439 secs 2024-03-28T07:55:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:34 smithi159 ceph-mon[36109]: pgmap v4536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6932.910439 secs 2024-03-28T07:55:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:34 smithi055 ceph-mon[31863]: pgmap v4536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:35.167 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7606 sec 2024-03-28T07:55:36.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7607 sec 2024-03-28T07:55:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:36 smithi086 ceph-mon[35163]: pgmap v4537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:36 smithi159 ceph-mon[36109]: pgmap v4537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:36 smithi055 ceph-mon[31863]: pgmap v4537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:37.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7608 sec 2024-03-28T07:55:38.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7609 sec 2024-03-28T07:55:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:38 smithi086 ceph-mon[35163]: pgmap v4538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:38 smithi159 ceph-mon[36109]: pgmap v4538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:38 smithi055 ceph-mon[31863]: pgmap v4538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:39.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7610 sec 2024-03-28T07:55:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6937.910556 secs 2024-03-28T07:55:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6937.910556 secs 2024-03-28T07:55:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6937.910556 secs 2024-03-28T07:55:40.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7611 sec 2024-03-28T07:55:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:40 smithi086 ceph-mon[35163]: pgmap v4539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:40 smithi159 ceph-mon[36109]: pgmap v4539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:40 smithi055 ceph-mon[31863]: pgmap v4539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:41.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7612 sec 2024-03-28T07:55:42.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7613 sec 2024-03-28T07:55:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:42 smithi086 ceph-mon[35163]: pgmap v4540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:42.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:42 smithi159 ceph-mon[36109]: pgmap v4540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:42 smithi055 ceph-mon[31863]: pgmap v4540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:43.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7614 sec 2024-03-28T07:55:44.168 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7615 sec 2024-03-28T07:55:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6942.910674 secs 2024-03-28T07:55:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:44 smithi086 ceph-mon[35163]: pgmap v4541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6942.910674 secs 2024-03-28T07:55:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:44 smithi159 ceph-mon[36109]: pgmap v4541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6942.910674 secs 2024-03-28T07:55:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:44 smithi055 ceph-mon[31863]: pgmap v4541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:45.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7616 sec 2024-03-28T07:55:46.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7617 sec 2024-03-28T07:55:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:46 smithi086 ceph-mon[35163]: pgmap v4542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:46.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:46 smithi159 ceph-mon[36109]: pgmap v4542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:46.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:46 smithi055 ceph-mon[31863]: pgmap v4542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:47.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7618 sec 2024-03-28T07:55:48.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7619 sec 2024-03-28T07:55:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:48 smithi086 ceph-mon[35163]: pgmap v4543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:48.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:48 smithi159 ceph-mon[36109]: pgmap v4543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:48 smithi055 ceph-mon[31863]: pgmap v4543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:49.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7620 sec 2024-03-28T07:55:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6947.910805 secs 2024-03-28T07:55:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6947.910805 secs 2024-03-28T07:55:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6947.910805 secs 2024-03-28T07:55:50.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7621 sec 2024-03-28T07:55:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:50 smithi086 ceph-mon[35163]: pgmap v4544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:50.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:50 smithi159 ceph-mon[36109]: pgmap v4544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:50 smithi055 ceph-mon[31863]: pgmap v4544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:51.169 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7622 sec 2024-03-28T07:55:52.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7623 sec 2024-03-28T07:55:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:52 smithi055 ceph-mon[31863]: pgmap v4545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:52 smithi086 ceph-mon[35163]: pgmap v4545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:52 smithi159 ceph-mon[36109]: pgmap v4545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:53.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7624 sec 2024-03-28T07:55:54.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7625 sec 2024-03-28T07:55:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6952.910920 secs 2024-03-28T07:55:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:54 smithi055 ceph-mon[31863]: pgmap v4546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6952.910920 secs 2024-03-28T07:55:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:54 smithi086 ceph-mon[35163]: pgmap v4546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6952.910920 secs 2024-03-28T07:55:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:54 smithi159 ceph-mon[36109]: pgmap v4546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:55.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7626 sec 2024-03-28T07:55:56.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7627 sec 2024-03-28T07:55:56.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:56 smithi055 ceph-mon[31863]: pgmap v4547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:56 smithi086 ceph-mon[35163]: pgmap v4547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:56 smithi159 ceph-mon[36109]: pgmap v4547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:55:57.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7628 sec 2024-03-28T07:55:58.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7629 sec 2024-03-28T07:55:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:58 smithi055 ceph-mon[31863]: pgmap v4548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:58 smithi086 ceph-mon[35163]: pgmap v4548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:58 smithi159 ceph-mon[36109]: pgmap v4548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:55:59.170 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7630 sec 2024-03-28T07:55:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:55:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6957.911007 secs 2024-03-28T07:55:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:55:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6957.911007 secs 2024-03-28T07:55:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:55:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6957.911007 secs 2024-03-28T07:56:00.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7631 sec 2024-03-28T07:56:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:00 smithi055 ceph-mon[31863]: pgmap v4549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:00 smithi086 ceph-mon[35163]: pgmap v4549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:00 smithi159 ceph-mon[36109]: pgmap v4549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:01.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7632 sec 2024-03-28T07:56:02.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7633 sec 2024-03-28T07:56:02.622 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:02 smithi086 ceph-mon[35163]: pgmap v4550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:02.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:02 smithi055 ceph-mon[31863]: pgmap v4550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:02 smithi159 ceph-mon[36109]: pgmap v4550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:03.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7634 sec 2024-03-28T07:56:04.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7635 sec 2024-03-28T07:56:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6962.911100 secs 2024-03-28T07:56:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:04 smithi086 ceph-mon[35163]: pgmap v4551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6962.911100 secs 2024-03-28T07:56:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:04 smithi159 ceph-mon[36109]: pgmap v4551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:04.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6962.911100 secs 2024-03-28T07:56:04.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:04 smithi055 ceph-mon[31863]: pgmap v4551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:05.171 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7636 sec 2024-03-28T07:56:06.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7637 sec 2024-03-28T07:56:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:06 smithi086 ceph-mon[35163]: pgmap v4552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:56:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:06 smithi159 ceph-mon[36109]: pgmap v4552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:56:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:06 smithi055 ceph-mon[31863]: pgmap v4552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:56:07.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7638 sec 2024-03-28T07:56:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:56:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:56:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:56:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:56:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:56:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:56:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:56:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:56:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:56:08.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7639 sec 2024-03-28T07:56:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:08 smithi086 ceph-mon[35163]: pgmap v4553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:08 smithi086 ceph-mon[35163]: pgmap v4554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:08 smithi159 ceph-mon[36109]: pgmap v4553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:08 smithi159 ceph-mon[36109]: pgmap v4554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:08 smithi055 ceph-mon[31863]: pgmap v4553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:08 smithi055 ceph-mon[31863]: pgmap v4554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:09.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7640 sec 2024-03-28T07:56:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6967.911223 secs 2024-03-28T07:56:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6967.911223 secs 2024-03-28T07:56:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6967.911223 secs 2024-03-28T07:56:10.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7641 sec 2024-03-28T07:56:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:10 smithi086 ceph-mon[35163]: pgmap v4555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:10 smithi159 ceph-mon[36109]: pgmap v4555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:10 smithi055 ceph-mon[31863]: pgmap v4555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:11.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7642 sec 2024-03-28T07:56:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:11 smithi086 ceph-mon[35163]: pgmap v4556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:11 smithi159 ceph-mon[36109]: pgmap v4556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:11.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:11 smithi055 ceph-mon[31863]: pgmap v4556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:12.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7643 sec 2024-03-28T07:56:13.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7644 sec 2024-03-28T07:56:14.172 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7645 sec 2024-03-28T07:56:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6972.911343 secs 2024-03-28T07:56:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:13 smithi086 ceph-mon[35163]: pgmap v4557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6972.911343 secs 2024-03-28T07:56:14.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:13 smithi159 ceph-mon[36109]: pgmap v4557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6972.911343 secs 2024-03-28T07:56:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:13 smithi055 ceph-mon[31863]: pgmap v4557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:15.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7646 sec 2024-03-28T07:56:16.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7647 sec 2024-03-28T07:56:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:15 smithi086 ceph-mon[35163]: pgmap v4558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:15 smithi159 ceph-mon[36109]: pgmap v4558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:16.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:15 smithi055 ceph-mon[31863]: pgmap v4558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:17.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7648 sec 2024-03-28T07:56:18.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7649 sec 2024-03-28T07:56:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:17 smithi086 ceph-mon[35163]: pgmap v4559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:56:18.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:17 smithi159 ceph-mon[36109]: pgmap v4559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:56:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:17 smithi055 ceph-mon[31863]: pgmap v4559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:56:19.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7650 sec 2024-03-28T07:56:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6977.911464 secs 2024-03-28T07:56:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6977.911464 secs 2024-03-28T07:56:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6977.911464 secs 2024-03-28T07:56:20.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7651 sec 2024-03-28T07:56:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:19 smithi086 ceph-mon[35163]: pgmap v4560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:19 smithi159 ceph-mon[36109]: pgmap v4560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:19 smithi055 ceph-mon[31863]: pgmap v4560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:21.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7652 sec 2024-03-28T07:56:22.173 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7653 sec 2024-03-28T07:56:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:21 smithi086 ceph-mon[35163]: pgmap v4561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:22.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:21 smithi159 ceph-mon[36109]: pgmap v4561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:21 smithi055 ceph-mon[31863]: pgmap v4561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:23.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7654 sec 2024-03-28T07:56:24.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7655 sec 2024-03-28T07:56:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6982.911589 secs 2024-03-28T07:56:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:23 smithi086 ceph-mon[35163]: pgmap v4562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6982.911589 secs 2024-03-28T07:56:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:23 smithi159 ceph-mon[36109]: pgmap v4562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6982.911589 secs 2024-03-28T07:56:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:23 smithi055 ceph-mon[31863]: pgmap v4562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:25.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7656 sec 2024-03-28T07:56:26.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7657 sec 2024-03-28T07:56:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:25 smithi086 ceph-mon[35163]: pgmap v4563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:26.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:25 smithi159 ceph-mon[36109]: pgmap v4563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:26.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:25 smithi055 ceph-mon[31863]: pgmap v4563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:27.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7658 sec 2024-03-28T07:56:28.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7659 sec 2024-03-28T07:56:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:27 smithi086 ceph-mon[35163]: pgmap v4564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:27 smithi159 ceph-mon[36109]: pgmap v4564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:27 smithi055 ceph-mon[31863]: pgmap v4564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:29.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7660 sec 2024-03-28T07:56:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6987.911708 secs 2024-03-28T07:56:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6987.911708 secs 2024-03-28T07:56:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6987.911708 secs 2024-03-28T07:56:30.174 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7661 sec 2024-03-28T07:56:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:29 smithi086 ceph-mon[35163]: pgmap v4565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:29 smithi159 ceph-mon[36109]: pgmap v4565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:29 smithi055 ceph-mon[31863]: pgmap v4565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:31.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7662 sec 2024-03-28T07:56:32.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7663 sec 2024-03-28T07:56:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:31 smithi086 ceph-mon[35163]: pgmap v4566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:31 smithi159 ceph-mon[36109]: pgmap v4566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:31 smithi055 ceph-mon[31863]: pgmap v4566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:33.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7664 sec 2024-03-28T07:56:34.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7665 sec 2024-03-28T07:56:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6992.911845 secs 2024-03-28T07:56:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:33 smithi086 ceph-mon[35163]: pgmap v4567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6992.911845 secs 2024-03-28T07:56:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:33 smithi159 ceph-mon[36109]: pgmap v4567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6992.911845 secs 2024-03-28T07:56:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:33 smithi055 ceph-mon[31863]: pgmap v4567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:35.175 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7666 sec 2024-03-28T07:56:36.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7667 sec 2024-03-28T07:56:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:35 smithi086 ceph-mon[35163]: pgmap v4568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:35 smithi159 ceph-mon[36109]: pgmap v4568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:35 smithi055 ceph-mon[31863]: pgmap v4568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:37.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7668 sec 2024-03-28T07:56:38.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7669 sec 2024-03-28T07:56:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:37 smithi086 ceph-mon[35163]: pgmap v4569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:37 smithi159 ceph-mon[36109]: pgmap v4569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:37 smithi055 ceph-mon[31863]: pgmap v4569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:39.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7670 sec 2024-03-28T07:56:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 6997.911968 secs 2024-03-28T07:56:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 6997.911968 secs 2024-03-28T07:56:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 6997.911968 secs 2024-03-28T07:56:40.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7671 sec 2024-03-28T07:56:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:40 smithi086 ceph-mon[35163]: pgmap v4570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:40.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:40 smithi159 ceph-mon[36109]: pgmap v4570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:40 smithi055 ceph-mon[31863]: pgmap v4570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:41.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7672 sec 2024-03-28T07:56:42.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7673 sec 2024-03-28T07:56:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:42 smithi086 ceph-mon[35163]: pgmap v4571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:42 smithi159 ceph-mon[36109]: pgmap v4571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:42 smithi055 ceph-mon[31863]: pgmap v4571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:43.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7674 sec 2024-03-28T07:56:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7002.912032 secs 2024-03-28T07:56:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:44 smithi086 ceph-mon[35163]: pgmap v4572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:44.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7675 sec 2024-03-28T07:56:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7002.912032 secs 2024-03-28T07:56:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:44 smithi159 ceph-mon[36109]: pgmap v4572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7002.912032 secs 2024-03-28T07:56:44.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:44 smithi055 ceph-mon[31863]: pgmap v4572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:45.176 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7676 sec 2024-03-28T07:56:46.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7677 sec 2024-03-28T07:56:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:46 smithi086 ceph-mon[35163]: pgmap v4573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:46 smithi159 ceph-mon[36109]: pgmap v4573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:46 smithi055 ceph-mon[31863]: pgmap v4573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:47.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7678 sec 2024-03-28T07:56:48.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7679 sec 2024-03-28T07:56:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:48 smithi086 ceph-mon[35163]: pgmap v4574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:48 smithi159 ceph-mon[36109]: pgmap v4574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:48 smithi055 ceph-mon[31863]: pgmap v4574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:49.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7680 sec 2024-03-28T07:56:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7007.912136 secs 2024-03-28T07:56:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7007.912136 secs 2024-03-28T07:56:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7007.912136 secs 2024-03-28T07:56:50.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7681 sec 2024-03-28T07:56:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:50 smithi086 ceph-mon[35163]: pgmap v4575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:50 smithi159 ceph-mon[36109]: pgmap v4575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:50.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:50 smithi055 ceph-mon[31863]: pgmap v4575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:51.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7682 sec 2024-03-28T07:56:52.177 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7683 sec 2024-03-28T07:56:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:52 smithi086 ceph-mon[35163]: pgmap v4576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:52 smithi159 ceph-mon[36109]: pgmap v4576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:52 smithi055 ceph-mon[31863]: pgmap v4576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:53.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7684 sec 2024-03-28T07:56:54.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7685 sec 2024-03-28T07:56:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7012.912221 secs 2024-03-28T07:56:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:54 smithi086 ceph-mon[35163]: pgmap v4577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7012.912221 secs 2024-03-28T07:56:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:54 smithi159 ceph-mon[36109]: pgmap v4577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7012.912221 secs 2024-03-28T07:56:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:54 smithi055 ceph-mon[31863]: pgmap v4577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:55.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7686 sec 2024-03-28T07:56:56.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7687 sec 2024-03-28T07:56:56.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:56 smithi159 ceph-mon[36109]: pgmap v4578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:56 smithi055 ceph-mon[31863]: pgmap v4578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:56 smithi086 ceph-mon[35163]: pgmap v4578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:56:57.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7688 sec 2024-03-28T07:56:58.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7689 sec 2024-03-28T07:56:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:58 smithi055 ceph-mon[31863]: pgmap v4579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:58 smithi086 ceph-mon[35163]: pgmap v4579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:58 smithi159 ceph-mon[36109]: pgmap v4579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:56:59.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7690 sec 2024-03-28T07:56:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:56:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7017.912342 secs 2024-03-28T07:56:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:56:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7017.912342 secs 2024-03-28T07:56:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:56:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7017.912342 secs 2024-03-28T07:57:00.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7691 sec 2024-03-28T07:57:00.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:00 smithi055 ceph-mon[31863]: pgmap v4580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:00 smithi086 ceph-mon[35163]: pgmap v4580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:00 smithi159 ceph-mon[36109]: pgmap v4580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:01.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7692 sec 2024-03-28T07:57:02.178 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7693 sec 2024-03-28T07:57:02.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:02 smithi086 ceph-mon[35163]: pgmap v4581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:02 smithi055 ceph-mon[31863]: pgmap v4581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:02 smithi159 ceph-mon[36109]: pgmap v4581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:03.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7694 sec 2024-03-28T07:57:04.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7695 sec 2024-03-28T07:57:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7022.912408 secs 2024-03-28T07:57:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:04 smithi055 ceph-mon[31863]: pgmap v4582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7022.912408 secs 2024-03-28T07:57:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:04 smithi086 ceph-mon[35163]: pgmap v4582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7022.912408 secs 2024-03-28T07:57:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:04 smithi159 ceph-mon[36109]: pgmap v4582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:05.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7696 sec 2024-03-28T07:57:06.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7697 sec 2024-03-28T07:57:06.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:06 smithi055 ceph-mon[31863]: pgmap v4583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:06 smithi086 ceph-mon[35163]: pgmap v4583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:06.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:06 smithi159 ceph-mon[36109]: pgmap v4583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:07.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7698 sec 2024-03-28T07:57:08.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7699 sec 2024-03-28T07:57:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:08 smithi086 ceph-mon[35163]: pgmap v4584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:57:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:08 smithi159 ceph-mon[36109]: pgmap v4584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:57:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:08 smithi055 ceph-mon[31863]: pgmap v4584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:57:09.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7700 sec 2024-03-28T07:57:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7027.912441 secs 2024-03-28T07:57:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:57:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7027.912441 secs 2024-03-28T07:57:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:57:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:57:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7027.912441 secs 2024-03-28T07:57:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:57:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:57:10.179 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7701 sec 2024-03-28T07:57:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:57:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:57:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:57:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:57:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: pgmap v4585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:10 smithi086 ceph-mon[35163]: pgmap v4586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: pgmap v4585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:10 smithi159 ceph-mon[36109]: pgmap v4586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: pgmap v4585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:10 smithi055 ceph-mon[31863]: pgmap v4586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:11.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7702 sec 2024-03-28T07:57:12.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7703 sec 2024-03-28T07:57:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:12 smithi086 ceph-mon[35163]: pgmap v4587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:12 smithi159 ceph-mon[36109]: pgmap v4587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:12 smithi055 ceph-mon[31863]: pgmap v4587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:13.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7704 sec 2024-03-28T07:57:14.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7705 sec 2024-03-28T07:57:14.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7032.912563 secs 2024-03-28T07:57:14.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:14 smithi055 ceph-mon[31863]: pgmap v4588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:57:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7032.912563 secs 2024-03-28T07:57:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:14 smithi086 ceph-mon[35163]: pgmap v4588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:57:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7032.912563 secs 2024-03-28T07:57:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:14 smithi159 ceph-mon[36109]: pgmap v4588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:57:15.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7706 sec 2024-03-28T07:57:16.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7707 sec 2024-03-28T07:57:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:16 smithi086 ceph-mon[35163]: pgmap v4589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:16 smithi159 ceph-mon[36109]: pgmap v4589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:16 smithi055 ceph-mon[31863]: pgmap v4589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:17.180 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7708 sec 2024-03-28T07:57:18.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7709 sec 2024-03-28T07:57:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:18 smithi086 ceph-mon[35163]: pgmap v4590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:18 smithi159 ceph-mon[36109]: pgmap v4590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:18 smithi055 ceph-mon[31863]: pgmap v4590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:19.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7710 sec 2024-03-28T07:57:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7037.912684 secs 2024-03-28T07:57:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7037.912684 secs 2024-03-28T07:57:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7037.912684 secs 2024-03-28T07:57:20.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7711 sec 2024-03-28T07:57:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:20 smithi086 ceph-mon[35163]: pgmap v4591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:57:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:20 smithi159 ceph-mon[36109]: pgmap v4591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:57:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:20 smithi055 ceph-mon[31863]: pgmap v4591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:57:21.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7712 sec 2024-03-28T07:57:22.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7713 sec 2024-03-28T07:57:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:22 smithi086 ceph-mon[35163]: pgmap v4592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:22 smithi159 ceph-mon[36109]: pgmap v4592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:22 smithi055 ceph-mon[31863]: pgmap v4592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:23.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7714 sec 2024-03-28T07:57:24.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7715 sec 2024-03-28T07:57:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7042.912759 secs 2024-03-28T07:57:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:24 smithi086 ceph-mon[35163]: pgmap v4593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7042.912759 secs 2024-03-28T07:57:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:24 smithi159 ceph-mon[36109]: pgmap v4593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7042.912759 secs 2024-03-28T07:57:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:24 smithi055 ceph-mon[31863]: pgmap v4593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:25.181 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7716 sec 2024-03-28T07:57:26.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7717 sec 2024-03-28T07:57:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:26 smithi086 ceph-mon[35163]: pgmap v4594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:26 smithi159 ceph-mon[36109]: pgmap v4594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:26 smithi055 ceph-mon[31863]: pgmap v4594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:27.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7718 sec 2024-03-28T07:57:28.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7719 sec 2024-03-28T07:57:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:28 smithi086 ceph-mon[35163]: pgmap v4595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:28 smithi159 ceph-mon[36109]: pgmap v4595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:28 smithi055 ceph-mon[31863]: pgmap v4595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:29.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7720 sec 2024-03-28T07:57:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7047.912877 secs 2024-03-28T07:57:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7047.912877 secs 2024-03-28T07:57:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7047.912877 secs 2024-03-28T07:57:30.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7721 sec 2024-03-28T07:57:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:30 smithi086 ceph-mon[35163]: pgmap v4596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:30 smithi159 ceph-mon[36109]: pgmap v4596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:30 smithi055 ceph-mon[31863]: pgmap v4596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:31.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7722 sec 2024-03-28T07:57:32.182 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7723 sec 2024-03-28T07:57:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:32 smithi086 ceph-mon[35163]: pgmap v4597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:32 smithi159 ceph-mon[36109]: pgmap v4597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:32 smithi055 ceph-mon[31863]: pgmap v4597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:33.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7724 sec 2024-03-28T07:57:34.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7725 sec 2024-03-28T07:57:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7052.912995 secs 2024-03-28T07:57:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:34 smithi086 ceph-mon[35163]: pgmap v4598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7052.912995 secs 2024-03-28T07:57:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:34 smithi159 ceph-mon[36109]: pgmap v4598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7052.912995 secs 2024-03-28T07:57:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:34 smithi055 ceph-mon[31863]: pgmap v4598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:35.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7726 sec 2024-03-28T07:57:36.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7727 sec 2024-03-28T07:57:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:36 smithi086 ceph-mon[35163]: pgmap v4599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:36 smithi159 ceph-mon[36109]: pgmap v4599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:36 smithi055 ceph-mon[31863]: pgmap v4599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:37.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7728 sec 2024-03-28T07:57:38.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7729 sec 2024-03-28T07:57:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:38 smithi086 ceph-mon[35163]: pgmap v4600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:38 smithi159 ceph-mon[36109]: pgmap v4600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:38 smithi055 ceph-mon[31863]: pgmap v4600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:39.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7730 sec 2024-03-28T07:57:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7057.913113 secs 2024-03-28T07:57:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7057.913113 secs 2024-03-28T07:57:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7057.913113 secs 2024-03-28T07:57:40.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7731 sec 2024-03-28T07:57:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:40 smithi086 ceph-mon[35163]: pgmap v4601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:40.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:40 smithi159 ceph-mon[36109]: pgmap v4601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:40 smithi055 ceph-mon[31863]: pgmap v4601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:41.183 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7732 sec 2024-03-28T07:57:42.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7733 sec 2024-03-28T07:57:42.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:42 smithi086 ceph-mon[35163]: pgmap v4602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:42.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:42 smithi159 ceph-mon[36109]: pgmap v4602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:42 smithi055 ceph-mon[31863]: pgmap v4602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:43.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7734 sec 2024-03-28T07:57:44.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7735 sec 2024-03-28T07:57:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7062.913206 secs 2024-03-28T07:57:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:44 smithi055 ceph-mon[31863]: pgmap v4603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7062.913206 secs 2024-03-28T07:57:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:44 smithi086 ceph-mon[35163]: pgmap v4603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:44.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7062.913206 secs 2024-03-28T07:57:44.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:44 smithi159 ceph-mon[36109]: pgmap v4603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:45.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7736 sec 2024-03-28T07:57:46.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7737 sec 2024-03-28T07:57:46.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:46 smithi055 ceph-mon[31863]: pgmap v4604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:46 smithi086 ceph-mon[35163]: pgmap v4604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:46 smithi159 ceph-mon[36109]: pgmap v4604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:47.184 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7738 sec 2024-03-28T07:57:48.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7739 sec 2024-03-28T07:57:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:48 smithi055 ceph-mon[31863]: pgmap v4605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:48 smithi086 ceph-mon[35163]: pgmap v4605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:48 smithi159 ceph-mon[36109]: pgmap v4605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:49.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7740 sec 2024-03-28T07:57:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7067.913290 secs 2024-03-28T07:57:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7067.913290 secs 2024-03-28T07:57:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7067.913290 secs 2024-03-28T07:57:50.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7741 sec 2024-03-28T07:57:50.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:50 smithi055 ceph-mon[31863]: pgmap v4606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:50 smithi086 ceph-mon[35163]: pgmap v4606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:50 smithi159 ceph-mon[36109]: pgmap v4606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:51.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7742 sec 2024-03-28T07:57:52.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7743 sec 2024-03-28T07:57:52.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:52 smithi055 ceph-mon[31863]: pgmap v4607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:52 smithi086 ceph-mon[35163]: pgmap v4607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:52 smithi159 ceph-mon[36109]: pgmap v4607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:57:53.185 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7744 sec 2024-03-28T07:57:54.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7745 sec 2024-03-28T07:57:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7072.913411 secs 2024-03-28T07:57:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:54 smithi086 ceph-mon[35163]: pgmap v4608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7072.913411 secs 2024-03-28T07:57:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:54 smithi159 ceph-mon[36109]: pgmap v4608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7072.913411 secs 2024-03-28T07:57:54.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:54 smithi055 ceph-mon[31863]: pgmap v4608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:57:55.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7746 sec 2024-03-28T07:57:56.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7747 sec 2024-03-28T07:57:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:56 smithi086 ceph-mon[35163]: pgmap v4609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:56 smithi159 ceph-mon[36109]: pgmap v4609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:56 smithi055 ceph-mon[31863]: pgmap v4609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:57.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7748 sec 2024-03-28T07:57:58.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7749 sec 2024-03-28T07:57:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:58 smithi086 ceph-mon[35163]: pgmap v4610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:58 smithi159 ceph-mon[36109]: pgmap v4610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:58 smithi055 ceph-mon[31863]: pgmap v4610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:57:59.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7750 sec 2024-03-28T07:57:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:57:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7077.913476 secs 2024-03-28T07:57:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:57:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7077.913476 secs 2024-03-28T07:57:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:57:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7077.913476 secs 2024-03-28T07:58:00.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7751 sec 2024-03-28T07:58:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:00 smithi086 ceph-mon[35163]: pgmap v4611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:00 smithi159 ceph-mon[36109]: pgmap v4611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:00 smithi055 ceph-mon[31863]: pgmap v4611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:01.186 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7752 sec 2024-03-28T07:58:02.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7753 sec 2024-03-28T07:58:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:02 smithi086 ceph-mon[35163]: pgmap v4612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:02 smithi159 ceph-mon[36109]: pgmap v4612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:02 smithi055 ceph-mon[31863]: pgmap v4612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:03.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7754 sec 2024-03-28T07:58:04.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7755 sec 2024-03-28T07:58:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7082.913598 secs 2024-03-28T07:58:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:04 smithi086 ceph-mon[35163]: pgmap v4613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7082.913598 secs 2024-03-28T07:58:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:04 smithi159 ceph-mon[36109]: pgmap v4613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7082.913598 secs 2024-03-28T07:58:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:04 smithi055 ceph-mon[31863]: pgmap v4613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:05.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7756 sec 2024-03-28T07:58:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:05 smithi086 ceph-mon[35163]: pgmap v4614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:05 smithi159 ceph-mon[36109]: pgmap v4614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:05 smithi055 ceph-mon[31863]: pgmap v4614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:06.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7757 sec 2024-03-28T07:58:07.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7758 sec 2024-03-28T07:58:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:07 smithi086 ceph-mon[35163]: pgmap v4615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:07 smithi159 ceph-mon[36109]: pgmap v4615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:07 smithi055 ceph-mon[31863]: pgmap v4615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:08.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7759 sec 2024-03-28T07:58:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7087.913723 secs 2024-03-28T07:58:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7087.913723 secs 2024-03-28T07:58:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7087.913723 secs 2024-03-28T07:58:09.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7760 sec 2024-03-28T07:58:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:09 smithi086 ceph-mon[35163]: pgmap v4616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:58:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:09 smithi159 ceph-mon[36109]: pgmap v4616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:58:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:09 smithi055 ceph-mon[31863]: pgmap v4616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:58:10.187 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7761 sec 2024-03-28T07:58:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: pgmap v4617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: pgmap v4618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:58:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:58:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:58:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: pgmap v4617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: pgmap v4618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:58:11.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:58:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: pgmap v4617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: pgmap v4618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:58:11.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:58:11.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7762 sec 2024-03-28T07:58:12.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7763 sec 2024-03-28T07:58:13.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7764 sec 2024-03-28T07:58:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:13 smithi055 ceph-mon[31863]: pgmap v4619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:13 smithi086 ceph-mon[35163]: pgmap v4619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:13 smithi159 ceph-mon[36109]: pgmap v4619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:14.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7765 sec 2024-03-28T07:58:14.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7092.913848 secs 2024-03-28T07:58:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7092.913848 secs 2024-03-28T07:58:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7092.913848 secs 2024-03-28T07:58:15.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7766 sec 2024-03-28T07:58:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:15 smithi086 ceph-mon[35163]: pgmap v4620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:15 smithi159 ceph-mon[36109]: pgmap v4620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:15 smithi055 ceph-mon[31863]: pgmap v4620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:16.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7767 sec 2024-03-28T07:58:17.188 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7768 sec 2024-03-28T07:58:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:17 smithi086 ceph-mon[35163]: pgmap v4621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:17.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:17 smithi159 ceph-mon[36109]: pgmap v4621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:17.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:17 smithi055 ceph-mon[31863]: pgmap v4621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:18.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7769 sec 2024-03-28T07:58:19.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7770 sec 2024-03-28T07:58:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7097.913970 secs 2024-03-28T07:58:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:19 smithi086 ceph-mon[35163]: pgmap v4622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:19.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7097.913970 secs 2024-03-28T07:58:19.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:19 smithi159 ceph-mon[36109]: pgmap v4622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7097.913970 secs 2024-03-28T07:58:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:19 smithi055 ceph-mon[31863]: pgmap v4622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:20.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7771 sec 2024-03-28T07:58:21.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7772 sec 2024-03-28T07:58:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:21 smithi086 ceph-mon[35163]: pgmap v4623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-28T07:58:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:21 smithi159 ceph-mon[36109]: pgmap v4623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-28T07:58:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:21 smithi055 ceph-mon[31863]: pgmap v4623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-28T07:58:22.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7773 sec 2024-03-28T07:58:23.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7774 sec 2024-03-28T07:58:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:23 smithi086 ceph-mon[35163]: pgmap v4624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:23 smithi159 ceph-mon[36109]: pgmap v4624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:23 smithi055 ceph-mon[31863]: pgmap v4624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:24.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7775 sec 2024-03-28T07:58:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7102.914056 secs 2024-03-28T07:58:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7102.914056 secs 2024-03-28T07:58:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7102.914056 secs 2024-03-28T07:58:25.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7776 sec 2024-03-28T07:58:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:25 smithi086 ceph-mon[35163]: pgmap v4625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:25 smithi159 ceph-mon[36109]: pgmap v4625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:25 smithi055 ceph-mon[31863]: pgmap v4625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:26.189 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7777 sec 2024-03-28T07:58:27.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7778 sec 2024-03-28T07:58:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:27 smithi086 ceph-mon[35163]: pgmap v4626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:27.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:27 smithi159 ceph-mon[36109]: pgmap v4626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:27.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:27 smithi055 ceph-mon[31863]: pgmap v4626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:28.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7779 sec 2024-03-28T07:58:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:28 smithi086 ceph-mon[35163]: pgmap v4627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:28 smithi159 ceph-mon[36109]: pgmap v4627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:28 smithi055 ceph-mon[31863]: pgmap v4627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:29.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7780 sec 2024-03-28T07:58:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7107.914152 secs 2024-03-28T07:58:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7107.914152 secs 2024-03-28T07:58:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7107.914152 secs 2024-03-28T07:58:30.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7781 sec 2024-03-28T07:58:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:30 smithi086 ceph-mon[35163]: pgmap v4628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:30 smithi159 ceph-mon[36109]: pgmap v4628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:30 smithi055 ceph-mon[31863]: pgmap v4628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:31.190 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7782 sec 2024-03-28T07:58:32.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7783 sec 2024-03-28T07:58:33.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7784 sec 2024-03-28T07:58:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:33 smithi086 ceph-mon[35163]: pgmap v4629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:33 smithi159 ceph-mon[36109]: pgmap v4629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:33 smithi055 ceph-mon[31863]: pgmap v4629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:34.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7785 sec 2024-03-28T07:58:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7112.914216 secs 2024-03-28T07:58:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7112.914216 secs 2024-03-28T07:58:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7112.914216 secs 2024-03-28T07:58:35.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7786 sec 2024-03-28T07:58:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:35 smithi086 ceph-mon[35163]: pgmap v4630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:35 smithi159 ceph-mon[36109]: pgmap v4630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:35 smithi055 ceph-mon[31863]: pgmap v4630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:36.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7787 sec 2024-03-28T07:58:37.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7788 sec 2024-03-28T07:58:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:37 smithi086 ceph-mon[35163]: pgmap v4631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:37 smithi159 ceph-mon[36109]: pgmap v4631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:37.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:37 smithi055 ceph-mon[31863]: pgmap v4631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:38.191 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7789 sec 2024-03-28T07:58:39.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7790 sec 2024-03-28T07:58:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7117.914282 secs 2024-03-28T07:58:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:39 smithi086 ceph-mon[35163]: pgmap v4632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7117.914282 secs 2024-03-28T07:58:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:39 smithi159 ceph-mon[36109]: pgmap v4632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7117.914282 secs 2024-03-28T07:58:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:39 smithi055 ceph-mon[31863]: pgmap v4632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:40.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7791 sec 2024-03-28T07:58:41.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7792 sec 2024-03-28T07:58:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:41 smithi086 ceph-mon[35163]: pgmap v4633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:41.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:41 smithi159 ceph-mon[36109]: pgmap v4633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:41 smithi055 ceph-mon[31863]: pgmap v4633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:42.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7793 sec 2024-03-28T07:58:43.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7794 sec 2024-03-28T07:58:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:43 smithi086 ceph-mon[35163]: pgmap v4634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:43 smithi159 ceph-mon[36109]: pgmap v4634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:43 smithi055 ceph-mon[31863]: pgmap v4634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:44.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7795 sec 2024-03-28T07:58:44.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7122.914346 secs 2024-03-28T07:58:44.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7122.914346 secs 2024-03-28T07:58:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7122.914346 secs 2024-03-28T07:58:45.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7796 sec 2024-03-28T07:58:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:45 smithi086 ceph-mon[35163]: pgmap v4635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:45 smithi159 ceph-mon[36109]: pgmap v4635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:45 smithi055 ceph-mon[31863]: pgmap v4635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:46.192 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7797 sec 2024-03-28T07:58:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:46 smithi086 ceph-mon[35163]: pgmap v4636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:46 smithi159 ceph-mon[36109]: pgmap v4636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:46 smithi055 ceph-mon[31863]: pgmap v4636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:47.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7798 sec 2024-03-28T07:58:48.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7799 sec 2024-03-28T07:58:49.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7800 sec 2024-03-28T07:58:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7127.914412 secs 2024-03-28T07:58:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:49 smithi086 ceph-mon[35163]: pgmap v4637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7127.914412 secs 2024-03-28T07:58:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:49 smithi159 ceph-mon[36109]: pgmap v4637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7127.914412 secs 2024-03-28T07:58:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:49 smithi055 ceph-mon[31863]: pgmap v4637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:50.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7801 sec 2024-03-28T07:58:51.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7802 sec 2024-03-28T07:58:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:51 smithi086 ceph-mon[35163]: pgmap v4638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:51.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:51 smithi159 ceph-mon[36109]: pgmap v4638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:51.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:51 smithi055 ceph-mon[31863]: pgmap v4638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:58:52.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7803 sec 2024-03-28T07:58:53.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7804 sec 2024-03-28T07:58:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:53 smithi086 ceph-mon[35163]: pgmap v4639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:53 smithi159 ceph-mon[36109]: pgmap v4639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:53 smithi055 ceph-mon[31863]: pgmap v4639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:58:54.193 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7805 sec 2024-03-28T07:58:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7132.914535 secs 2024-03-28T07:58:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7132.914535 secs 2024-03-28T07:58:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7132.914535 secs 2024-03-28T07:58:55.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7806 sec 2024-03-28T07:58:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:55 smithi086 ceph-mon[35163]: pgmap v4640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:55.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:55 smithi159 ceph-mon[36109]: pgmap v4640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:55 smithi055 ceph-mon[31863]: pgmap v4640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:56.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7807 sec 2024-03-28T07:58:57.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7808 sec 2024-03-28T07:58:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:57 smithi086 ceph-mon[35163]: pgmap v4641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:57 smithi159 ceph-mon[36109]: pgmap v4641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:57 smithi055 ceph-mon[31863]: pgmap v4641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:58.194 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7809 sec 2024-03-28T07:58:59.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7810 sec 2024-03-28T07:58:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7137.914568 secs 2024-03-28T07:58:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:58:59 smithi086 ceph-mon[35163]: pgmap v4642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7137.914568 secs 2024-03-28T07:58:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:58:59 smithi159 ceph-mon[36109]: pgmap v4642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:58:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7137.914568 secs 2024-03-28T07:58:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:58:59 smithi055 ceph-mon[31863]: pgmap v4642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:00.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7811 sec 2024-03-28T07:59:01.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7812 sec 2024-03-28T07:59:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:01 smithi086 ceph-mon[35163]: pgmap v4643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:01 smithi159 ceph-mon[36109]: pgmap v4643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:01 smithi055 ceph-mon[31863]: pgmap v4643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:02.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7813 sec 2024-03-28T07:59:03.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7814 sec 2024-03-28T07:59:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:03 smithi086 ceph-mon[35163]: pgmap v4644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:03 smithi159 ceph-mon[36109]: pgmap v4644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:03 smithi055 ceph-mon[31863]: pgmap v4644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:04.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7815 sec 2024-03-28T07:59:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7142.914634 secs 2024-03-28T07:59:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:04 smithi086 ceph-mon[35163]: pgmap v4645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7142.914634 secs 2024-03-28T07:59:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:04 smithi159 ceph-mon[36109]: pgmap v4645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7142.914634 secs 2024-03-28T07:59:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:04 smithi055 ceph-mon[31863]: pgmap v4645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:05.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7816 sec 2024-03-28T07:59:06.195 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7817 sec 2024-03-28T07:59:07.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7818 sec 2024-03-28T07:59:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:07 smithi086 ceph-mon[35163]: pgmap v4646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:07 smithi159 ceph-mon[36109]: pgmap v4646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:07 smithi055 ceph-mon[31863]: pgmap v4646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:08.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7819 sec 2024-03-28T07:59:09.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7820 sec 2024-03-28T07:59:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7147.914754 secs 2024-03-28T07:59:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:09 smithi086 ceph-mon[35163]: pgmap v4647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7147.914754 secs 2024-03-28T07:59:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:09 smithi159 ceph-mon[36109]: pgmap v4647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7147.914754 secs 2024-03-28T07:59:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:09 smithi055 ceph-mon[31863]: pgmap v4647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:10.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7821 sec 2024-03-28T07:59:11.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7822 sec 2024-03-28T07:59:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:11 smithi086 ceph-mon[35163]: pgmap v4648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:59:11.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:11 smithi159 ceph-mon[36109]: pgmap v4648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:11.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:59:11.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:11 smithi055 ceph-mon[31863]: pgmap v4648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T07:59:11.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T07:59:12.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7823 sec 2024-03-28T07:59:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:59:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:59:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:59:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:59:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:59:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:59:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T07:59:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T07:59:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T07:59:13.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7824 sec 2024-03-28T07:59:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:13 smithi086 ceph-mon[35163]: pgmap v4649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:13 smithi086 ceph-mon[35163]: pgmap v4650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:13 smithi159 ceph-mon[36109]: pgmap v4649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:13 smithi159 ceph-mon[36109]: pgmap v4650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:13 smithi055 ceph-mon[31863]: pgmap v4649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:13 smithi055 ceph-mon[31863]: pgmap v4650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:14.196 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7825 sec 2024-03-28T07:59:14.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7152.914823 secs 2024-03-28T07:59:14.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7152.914823 secs 2024-03-28T07:59:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7152.914823 secs 2024-03-28T07:59:15.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7826 sec 2024-03-28T07:59:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:15 smithi086 ceph-mon[35163]: pgmap v4651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:15 smithi159 ceph-mon[36109]: pgmap v4651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:15 smithi055 ceph-mon[31863]: pgmap v4651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:16.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7827 sec 2024-03-28T07:59:17.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7828 sec 2024-03-28T07:59:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:17 smithi086 ceph-mon[35163]: pgmap v4652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:17.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:17 smithi159 ceph-mon[36109]: pgmap v4652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:17.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:17 smithi055 ceph-mon[31863]: pgmap v4652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:18.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7829 sec 2024-03-28T07:59:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:18 smithi086 ceph-mon[35163]: pgmap v4653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:18 smithi159 ceph-mon[36109]: pgmap v4653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:18 smithi055 ceph-mon[31863]: pgmap v4653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T07:59:19.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7830 sec 2024-03-28T07:59:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7157.914910 secs 2024-03-28T07:59:19.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7157.914910 secs 2024-03-28T07:59:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7157.914910 secs 2024-03-28T07:59:20.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7831 sec 2024-03-28T07:59:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:20 smithi086 ceph-mon[35163]: pgmap v4654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:59:20.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:20 smithi159 ceph-mon[36109]: pgmap v4654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:59:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:20 smithi055 ceph-mon[31863]: pgmap v4654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T07:59:21.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7832 sec 2024-03-28T07:59:22.197 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7833 sec 2024-03-28T07:59:23.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7834 sec 2024-03-28T07:59:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:23 smithi086 ceph-mon[35163]: pgmap v4655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:59:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:23 smithi159 ceph-mon[36109]: pgmap v4655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:59:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:23 smithi055 ceph-mon[31863]: pgmap v4655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T07:59:24.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7835 sec 2024-03-28T07:59:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7162.915029 secs 2024-03-28T07:59:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7162.915029 secs 2024-03-28T07:59:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7162.915029 secs 2024-03-28T07:59:25.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7836 sec 2024-03-28T07:59:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:25 smithi086 ceph-mon[35163]: pgmap v4656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:25.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:25 smithi159 ceph-mon[36109]: pgmap v4656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:25 smithi055 ceph-mon[31863]: pgmap v4656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:26.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7837 sec 2024-03-28T07:59:27.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7838 sec 2024-03-28T07:59:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:27 smithi086 ceph-mon[35163]: pgmap v4657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:27 smithi159 ceph-mon[36109]: pgmap v4657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:27 smithi055 ceph-mon[31863]: pgmap v4657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:28.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7839 sec 2024-03-28T07:59:29.198 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7840 sec 2024-03-28T07:59:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7167.915116 secs 2024-03-28T07:59:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:29 smithi086 ceph-mon[35163]: pgmap v4658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7167.915116 secs 2024-03-28T07:59:29.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:29 smithi159 ceph-mon[36109]: pgmap v4658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7167.915116 secs 2024-03-28T07:59:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:29 smithi055 ceph-mon[31863]: pgmap v4658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:30.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7841 sec 2024-03-28T07:59:31.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7842 sec 2024-03-28T07:59:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:31 smithi086 ceph-mon[35163]: pgmap v4659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:31 smithi159 ceph-mon[36109]: pgmap v4659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:31.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:31 smithi055 ceph-mon[31863]: pgmap v4659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:32.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7843 sec 2024-03-28T07:59:33.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7844 sec 2024-03-28T07:59:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:33 smithi086 ceph-mon[35163]: pgmap v4660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:33 smithi159 ceph-mon[36109]: pgmap v4660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:33 smithi055 ceph-mon[31863]: pgmap v4660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:34.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7845 sec 2024-03-28T07:59:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7172.915238 secs 2024-03-28T07:59:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7172.915238 secs 2024-03-28T07:59:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7172.915238 secs 2024-03-28T07:59:35.199 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7846 sec 2024-03-28T07:59:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:35 smithi086 ceph-mon[35163]: pgmap v4661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:35 smithi159 ceph-mon[36109]: pgmap v4661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:35 smithi055 ceph-mon[31863]: pgmap v4661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:36.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7847 sec 2024-03-28T07:59:37.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7848 sec 2024-03-28T07:59:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:37 smithi086 ceph-mon[35163]: pgmap v4662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:37 smithi159 ceph-mon[36109]: pgmap v4662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:37 smithi055 ceph-mon[31863]: pgmap v4662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:38.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7849 sec 2024-03-28T07:59:39.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7850 sec 2024-03-28T07:59:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7177.915313 secs 2024-03-28T07:59:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:39 smithi086 ceph-mon[35163]: pgmap v4663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7177.915313 secs 2024-03-28T07:59:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:39 smithi159 ceph-mon[36109]: pgmap v4663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7177.915313 secs 2024-03-28T07:59:39.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:39 smithi055 ceph-mon[31863]: pgmap v4663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:40.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7851 sec 2024-03-28T07:59:41.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7852 sec 2024-03-28T07:59:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:41 smithi086 ceph-mon[35163]: pgmap v4664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:41 smithi159 ceph-mon[36109]: pgmap v4664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:41 smithi055 ceph-mon[31863]: pgmap v4664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:42.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7853 sec 2024-03-28T07:59:43.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7854 sec 2024-03-28T07:59:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:43 smithi086 ceph-mon[35163]: pgmap v4665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:43 smithi159 ceph-mon[36109]: pgmap v4665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:43 smithi055 ceph-mon[31863]: pgmap v4665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:44.200 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7855 sec 2024-03-28T07:59:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7182.915435 secs 2024-03-28T07:59:44.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7182.915435 secs 2024-03-28T07:59:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7182.915435 secs 2024-03-28T07:59:45.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7856 sec 2024-03-28T07:59:45.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:45 smithi055 ceph-mon[31863]: pgmap v4666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:45 smithi086 ceph-mon[35163]: pgmap v4666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:45 smithi159 ceph-mon[36109]: pgmap v4666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:46.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7857 sec 2024-03-28T07:59:47.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7858 sec 2024-03-28T07:59:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:47 smithi055 ceph-mon[31863]: pgmap v4667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:47 smithi086 ceph-mon[35163]: pgmap v4667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:47 smithi159 ceph-mon[36109]: pgmap v4667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:48.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7859 sec 2024-03-28T07:59:49.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7860 sec 2024-03-28T07:59:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7187.915556 secs 2024-03-28T07:59:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:49 smithi055 ceph-mon[31863]: pgmap v4668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7187.915556 secs 2024-03-28T07:59:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:49 smithi086 ceph-mon[35163]: pgmap v4668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7187.915556 secs 2024-03-28T07:59:49.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:49 smithi159 ceph-mon[36109]: pgmap v4668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:50.201 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7861 sec 2024-03-28T07:59:51.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7862 sec 2024-03-28T07:59:51.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:51 smithi055 ceph-mon[31863]: pgmap v4669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:51 smithi086 ceph-mon[35163]: pgmap v4669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:51.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:51 smithi159 ceph-mon[36109]: pgmap v4669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T07:59:52.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7863 sec 2024-03-28T07:59:53.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7864 sec 2024-03-28T07:59:53.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:53 smithi055 ceph-mon[31863]: pgmap v4670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:53 smithi086 ceph-mon[35163]: pgmap v4670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:53 smithi159 ceph-mon[36109]: pgmap v4670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:54.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7865 sec 2024-03-28T07:59:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7192.915635 secs 2024-03-28T07:59:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7192.915635 secs 2024-03-28T07:59:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7192.915635 secs 2024-03-28T07:59:55.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7866 sec 2024-03-28T07:59:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:55 smithi086 ceph-mon[35163]: pgmap v4671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:55.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:55 smithi159 ceph-mon[36109]: pgmap v4671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:55 smithi055 ceph-mon[31863]: pgmap v4671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:56.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7867 sec 2024-03-28T07:59:57.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7868 sec 2024-03-28T07:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:57 smithi086 ceph-mon[35163]: pgmap v4672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:57 smithi159 ceph-mon[36109]: pgmap v4672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:57 smithi055 ceph-mon[31863]: pgmap v4672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:58.202 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7869 sec 2024-03-28T07:59:59.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7870 sec 2024-03-28T07:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7197.915760 secs 2024-03-28T07:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 07:59:59 smithi086 ceph-mon[35163]: pgmap v4673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7197.915760 secs 2024-03-28T07:59:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 07:59:59 smithi159 ceph-mon[36109]: pgmap v4673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T07:59:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7197.915760 secs 2024-03-28T07:59:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 07:59:59 smithi055 ceph-mon[31863]: pgmap v4673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:00.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7871 sec 2024-03-28T08:00:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:00:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:00:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:00:01.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7872 sec 2024-03-28T08:00:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:01 smithi086 ceph-mon[35163]: pgmap v4674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:01 smithi159 ceph-mon[36109]: pgmap v4674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:01 smithi055 ceph-mon[31863]: pgmap v4674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:02.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7873 sec 2024-03-28T08:00:03.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7874 sec 2024-03-28T08:00:03.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:03 smithi159 ceph-mon[36109]: pgmap v4675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:03.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:03 smithi086 ceph-mon[35163]: pgmap v4675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:03 smithi055 ceph-mon[31863]: pgmap v4675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:04.203 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7875 sec 2024-03-28T08:00:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7202.915865 secs 2024-03-28T08:00:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7202.915865 secs 2024-03-28T08:00:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7202.915865 secs 2024-03-28T08:00:05.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7876 sec 2024-03-28T08:00:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:05 smithi086 ceph-mon[35163]: pgmap v4676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:05 smithi159 ceph-mon[36109]: pgmap v4676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:05 smithi055 ceph-mon[31863]: pgmap v4676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:06.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7877 sec 2024-03-28T08:00:07.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7878 sec 2024-03-28T08:00:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:07 smithi086 ceph-mon[35163]: pgmap v4677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:07 smithi159 ceph-mon[36109]: pgmap v4677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:07 smithi055 ceph-mon[31863]: pgmap v4677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:08.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7879 sec 2024-03-28T08:00:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7207.915956 secs 2024-03-28T08:00:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7207.915956 secs 2024-03-28T08:00:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7207.915956 secs 2024-03-28T08:00:09.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7880 sec 2024-03-28T08:00:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:09 smithi086 ceph-mon[35163]: pgmap v4678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:09.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:09 smithi159 ceph-mon[36109]: pgmap v4678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:09 smithi055 ceph-mon[31863]: pgmap v4678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:10.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7881 sec 2024-03-28T08:00:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:10 smithi086 ceph-mon[35163]: pgmap v4679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:10 smithi159 ceph-mon[36109]: pgmap v4679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:10 smithi055 ceph-mon[31863]: pgmap v4679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:11.204 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7882 sec 2024-03-28T08:00:12.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7883 sec 2024-03-28T08:00:13.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7884 sec 2024-03-28T08:00:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:13 smithi086 ceph-mon[35163]: pgmap v4680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7212.916048 secs 2024-03-28T08:00:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:00:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:13 smithi159 ceph-mon[36109]: pgmap v4680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7212.916048 secs 2024-03-28T08:00:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:00:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:13 smithi055 ceph-mon[31863]: pgmap v4680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7212.916048 secs 2024-03-28T08:00:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:00:14.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7885 sec 2024-03-28T08:00:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:15.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7886 sec 2024-03-28T08:00:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:15 smithi086 ceph-mon[35163]: pgmap v4681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:00:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:00:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:15 smithi159 ceph-mon[36109]: pgmap v4681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:00:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:00:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:15 smithi055 ceph-mon[31863]: pgmap v4681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:00:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:00:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:00:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:00:16.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7887 sec 2024-03-28T08:00:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:16 smithi086 ceph-mon[35163]: pgmap v4682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:00:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:16 smithi086 ceph-mon[35163]: pgmap v4683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:16 smithi159 ceph-mon[36109]: pgmap v4682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:00:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:16 smithi159 ceph-mon[36109]: pgmap v4683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:16 smithi055 ceph-mon[31863]: pgmap v4682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:00:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:16 smithi055 ceph-mon[31863]: pgmap v4683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:17.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7888 sec 2024-03-28T08:00:18.205 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7889 sec 2024-03-28T08:00:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:18 smithi086 ceph-mon[35163]: pgmap v4684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7217.916138 secs 2024-03-28T08:00:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:18 smithi159 ceph-mon[36109]: pgmap v4684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7217.916138 secs 2024-03-28T08:00:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:18 smithi055 ceph-mon[31863]: pgmap v4684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7217.916138 secs 2024-03-28T08:00:19.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7890 sec 2024-03-28T08:00:20.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7891 sec 2024-03-28T08:00:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:20 smithi086 ceph-mon[35163]: pgmap v4685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:20.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:20 smithi159 ceph-mon[36109]: pgmap v4685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:20 smithi055 ceph-mon[31863]: pgmap v4685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:21.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7892 sec 2024-03-28T08:00:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:21 smithi086 ceph-mon[35163]: pgmap v4686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:21 smithi159 ceph-mon[36109]: pgmap v4686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:21 smithi055 ceph-mon[31863]: pgmap v4686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:00:22.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7893 sec 2024-03-28T08:00:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7222.916263 secs 2024-03-28T08:00:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7222.916263 secs 2024-03-28T08:00:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7222.916263 secs 2024-03-28T08:00:23.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7894 sec 2024-03-28T08:00:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:23 smithi086 ceph-mon[35163]: pgmap v4687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:23 smithi159 ceph-mon[36109]: pgmap v4687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:23 smithi055 ceph-mon[31863]: pgmap v4687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:00:24.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7895 sec 2024-03-28T08:00:25.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7896 sec 2024-03-28T08:00:26.206 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7897 sec 2024-03-28T08:00:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:25 smithi086 ceph-mon[35163]: pgmap v4688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:00:26.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:25 smithi159 ceph-mon[36109]: pgmap v4688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:00:26.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:25 smithi055 ceph-mon[31863]: pgmap v4688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:00:27.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7898 sec 2024-03-28T08:00:28.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7899 sec 2024-03-28T08:00:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:27 smithi086 ceph-mon[35163]: pgmap v4689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:00:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7227.916386 secs 2024-03-28T08:00:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:27 smithi159 ceph-mon[36109]: pgmap v4689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:00:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7227.916386 secs 2024-03-28T08:00:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:27 smithi055 ceph-mon[31863]: pgmap v4689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:00:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7227.916386 secs 2024-03-28T08:00:29.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7900 sec 2024-03-28T08:00:30.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7901 sec 2024-03-28T08:00:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:29 smithi086 ceph-mon[35163]: pgmap v4690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:30.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:29 smithi159 ceph-mon[36109]: pgmap v4690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:30.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:29 smithi055 ceph-mon[31863]: pgmap v4690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:31.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7902 sec 2024-03-28T08:00:32.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7903 sec 2024-03-28T08:00:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:31 smithi086 ceph-mon[35163]: pgmap v4691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:32.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:31 smithi159 ceph-mon[36109]: pgmap v4691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:32.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:31 smithi055 ceph-mon[31863]: pgmap v4691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:33.207 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7904 sec 2024-03-28T08:00:33.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7232.916511 secs 2024-03-28T08:00:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7232.916511 secs 2024-03-28T08:00:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7232.916511 secs 2024-03-28T08:00:34.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7905 sec 2024-03-28T08:00:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:33 smithi086 ceph-mon[35163]: pgmap v4692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:33 smithi159 ceph-mon[36109]: pgmap v4692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:33 smithi055 ceph-mon[31863]: pgmap v4692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:35.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7906 sec 2024-03-28T08:00:36.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7907 sec 2024-03-28T08:00:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:35 smithi086 ceph-mon[35163]: pgmap v4693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:35 smithi159 ceph-mon[36109]: pgmap v4693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:35 smithi055 ceph-mon[31863]: pgmap v4693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:37.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7908 sec 2024-03-28T08:00:38.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7909 sec 2024-03-28T08:00:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:37 smithi086 ceph-mon[35163]: pgmap v4694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7237.916574 secs 2024-03-28T08:00:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:37 smithi159 ceph-mon[36109]: pgmap v4694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:38.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7237.916574 secs 2024-03-28T08:00:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:37 smithi055 ceph-mon[31863]: pgmap v4694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7237.916574 secs 2024-03-28T08:00:39.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7910 sec 2024-03-28T08:00:40.208 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7911 sec 2024-03-28T08:00:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:39 smithi086 ceph-mon[35163]: pgmap v4695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:40.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:39 smithi159 ceph-mon[36109]: pgmap v4695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:39 smithi055 ceph-mon[31863]: pgmap v4695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:41.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7912 sec 2024-03-28T08:00:42.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7913 sec 2024-03-28T08:00:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:41 smithi086 ceph-mon[35163]: pgmap v4696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:42.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:41 smithi159 ceph-mon[36109]: pgmap v4696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:42.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:41 smithi055 ceph-mon[31863]: pgmap v4696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:43.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7914 sec 2024-03-28T08:00:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7242.916644 secs 2024-03-28T08:00:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7242.916644 secs 2024-03-28T08:00:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7242.916644 secs 2024-03-28T08:00:44.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7915 sec 2024-03-28T08:00:44.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:43 smithi055 ceph-mon[31863]: pgmap v4697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:43 smithi086 ceph-mon[35163]: pgmap v4697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:44.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:43 smithi159 ceph-mon[36109]: pgmap v4697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:45.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7916 sec 2024-03-28T08:00:46.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7917 sec 2024-03-28T08:00:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:46 smithi086 ceph-mon[35163]: pgmap v4698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:46.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:46 smithi159 ceph-mon[36109]: pgmap v4698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:46.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:46 smithi055 ceph-mon[31863]: pgmap v4698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:47.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7918 sec 2024-03-28T08:00:48.209 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7919 sec 2024-03-28T08:00:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:48 smithi086 ceph-mon[35163]: pgmap v4699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7247.916760 secs 2024-03-28T08:00:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:48 smithi159 ceph-mon[36109]: pgmap v4699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:48.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7247.916760 secs 2024-03-28T08:00:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:48 smithi055 ceph-mon[31863]: pgmap v4699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:48.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7247.916760 secs 2024-03-28T08:00:49.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7920 sec 2024-03-28T08:00:50.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7921 sec 2024-03-28T08:00:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:50 smithi086 ceph-mon[35163]: pgmap v4700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:50.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:50 smithi159 ceph-mon[36109]: pgmap v4700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:50.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:50 smithi055 ceph-mon[31863]: pgmap v4700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:51.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7922 sec 2024-03-28T08:00:52.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7923 sec 2024-03-28T08:00:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:52 smithi086 ceph-mon[35163]: pgmap v4701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:52.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:52 smithi159 ceph-mon[36109]: pgmap v4701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:52.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:52 smithi055 ceph-mon[31863]: pgmap v4701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:53.210 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7924 sec 2024-03-28T08:00:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7252.916820 secs 2024-03-28T08:00:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7252.916820 secs 2024-03-28T08:00:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7252.916820 secs 2024-03-28T08:00:54.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7925 sec 2024-03-28T08:00:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:54 smithi086 ceph-mon[35163]: pgmap v4702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:54.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:54 smithi159 ceph-mon[36109]: pgmap v4702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:54 smithi055 ceph-mon[31863]: pgmap v4702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:55.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7926 sec 2024-03-28T08:00:56.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7927 sec 2024-03-28T08:00:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:56 smithi086 ceph-mon[35163]: pgmap v4703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:56.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:56 smithi159 ceph-mon[36109]: pgmap v4703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:56.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:56 smithi055 ceph-mon[31863]: pgmap v4703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:00:57.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7928 sec 2024-03-28T08:00:58.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7929 sec 2024-03-28T08:00:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:58 smithi055 ceph-mon[31863]: pgmap v4704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:00:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7257.916887 secs 2024-03-28T08:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:58 smithi086 ceph-mon[35163]: pgmap v4704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:00:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7257.916887 secs 2024-03-28T08:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:58 smithi159 ceph-mon[36109]: pgmap v4704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:00:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7257.916887 secs 2024-03-28T08:00:59.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7930 sec 2024-03-28T08:01:00.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7931 sec 2024-03-28T08:01:00.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:00 smithi055 ceph-mon[31863]: pgmap v4705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:00 smithi086 ceph-mon[35163]: pgmap v4705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:00.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:00 smithi159 ceph-mon[36109]: pgmap v4705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:01.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7932 sec 2024-03-28T08:01:02.211 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7933 sec 2024-03-28T08:01:02.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:02 smithi055 ceph-mon[31863]: pgmap v4706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:02 smithi086 ceph-mon[35163]: pgmap v4706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:02.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:02 smithi159 ceph-mon[36109]: pgmap v4706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:03.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7934 sec 2024-03-28T08:01:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7262.916912 secs 2024-03-28T08:01:03.471 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7262.916912 secs 2024-03-28T08:01:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7262.916912 secs 2024-03-28T08:01:04.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7935 sec 2024-03-28T08:01:04.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:04 smithi055 ceph-mon[31863]: pgmap v4707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:04 smithi086 ceph-mon[35163]: pgmap v4707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:04 smithi159 ceph-mon[36109]: pgmap v4707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:05.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7936 sec 2024-03-28T08:01:06.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7937 sec 2024-03-28T08:01:06.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:06 smithi055 ceph-mon[31863]: pgmap v4708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:06 smithi086 ceph-mon[35163]: pgmap v4708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:06.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:06 smithi159 ceph-mon[36109]: pgmap v4708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:07.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7938 sec 2024-03-28T08:01:08.212 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7939 sec 2024-03-28T08:01:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:08 smithi086 ceph-mon[35163]: pgmap v4709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7267.916982 secs 2024-03-28T08:01:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:08 smithi159 ceph-mon[36109]: pgmap v4709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7267.916982 secs 2024-03-28T08:01:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:08 smithi055 ceph-mon[31863]: pgmap v4709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7267.916982 secs 2024-03-28T08:01:09.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7940 sec 2024-03-28T08:01:10.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7941 sec 2024-03-28T08:01:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:10 smithi086 ceph-mon[35163]: pgmap v4710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:10 smithi159 ceph-mon[36109]: pgmap v4710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:10.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:10 smithi055 ceph-mon[31863]: pgmap v4710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:11.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7942 sec 2024-03-28T08:01:12.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7943 sec 2024-03-28T08:01:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:12 smithi086 ceph-mon[35163]: pgmap v4711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:12.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:12 smithi159 ceph-mon[36109]: pgmap v4711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:12 smithi055 ceph-mon[31863]: pgmap v4711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:13.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7944 sec 2024-03-28T08:01:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7272.917014 secs 2024-03-28T08:01:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7272.917014 secs 2024-03-28T08:01:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7272.917014 secs 2024-03-28T08:01:14.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7945 sec 2024-03-28T08:01:14.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:14 smithi159 ceph-mon[36109]: pgmap v4712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:14.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:14 smithi055 ceph-mon[31863]: pgmap v4712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:14 smithi086 ceph-mon[35163]: pgmap v4712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:15.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7946 sec 2024-03-28T08:01:16.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7947 sec 2024-03-28T08:01:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:16 smithi055 ceph-mon[31863]: pgmap v4713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:16.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:01:16.551 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:16 smithi086 ceph-mon[35163]: pgmap v4713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:16.551 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:01:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:16 smithi159 ceph-mon[36109]: pgmap v4713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:01:17.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7948 sec 2024-03-28T08:01:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:17.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:18.213 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7949 sec 2024-03-28T08:01:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:18 smithi086 ceph-mon[35163]: pgmap v4714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7277.917084 secs 2024-03-28T08:01:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:18 smithi159 ceph-mon[36109]: pgmap v4714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7277.917084 secs 2024-03-28T08:01:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:18 smithi055 ceph-mon[31863]: pgmap v4714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7277.917084 secs 2024-03-28T08:01:19.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7950 sec 2024-03-28T08:01:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:19.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:19.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7951 sec 2024-03-28T08:01:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:20 smithi086 ceph-mon[35163]: pgmap v4715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:20 smithi159 ceph-mon[36109]: pgmap v4715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:20 smithi055 ceph-mon[31863]: pgmap v4715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:21.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7952 sec 2024-03-28T08:01:22.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7953 sec 2024-03-28T08:01:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: pgmap v4716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:01:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:01:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: pgmap v4717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:01:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: pgmap v4718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: pgmap v4716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:01:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:01:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: pgmap v4717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:01:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: pgmap v4718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:22.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: pgmap v4716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:01:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:01:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: pgmap v4717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:01:22.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: pgmap v4718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:22.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:01:23.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7954 sec 2024-03-28T08:01:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7282.917149 secs 2024-03-28T08:01:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7282.917149 secs 2024-03-28T08:01:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7282.917149 secs 2024-03-28T08:01:24.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7955 sec 2024-03-28T08:01:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:24 smithi055 ceph-mon[31863]: pgmap v4719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:01:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:24 smithi086 ceph-mon[35163]: pgmap v4719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:01:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:24 smithi159 ceph-mon[36109]: pgmap v4719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:01:25.214 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7956 sec 2024-03-28T08:01:26.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7957 sec 2024-03-28T08:01:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:26 smithi055 ceph-mon[31863]: pgmap v4720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:26 smithi086 ceph-mon[35163]: pgmap v4720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:26.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:26 smithi159 ceph-mon[36109]: pgmap v4720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:27.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7958 sec 2024-03-28T08:01:28.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7959 sec 2024-03-28T08:01:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:28 smithi055 ceph-mon[31863]: pgmap v4721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7287.917214 secs 2024-03-28T08:01:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:28 smithi086 ceph-mon[35163]: pgmap v4721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7287.917214 secs 2024-03-28T08:01:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:28 smithi159 ceph-mon[36109]: pgmap v4721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7287.917214 secs 2024-03-28T08:01:29.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7960 sec 2024-03-28T08:01:30.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7961 sec 2024-03-28T08:01:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:30 smithi055 ceph-mon[31863]: pgmap v4722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:30 smithi086 ceph-mon[35163]: pgmap v4722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:30 smithi159 ceph-mon[36109]: pgmap v4722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:01:31.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7962 sec 2024-03-28T08:01:32.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7963 sec 2024-03-28T08:01:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:32 smithi086 ceph-mon[35163]: pgmap v4723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:01:32.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:32 smithi159 ceph-mon[36109]: pgmap v4723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:01:32.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:32 smithi055 ceph-mon[31863]: pgmap v4723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:01:33.215 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7964 sec 2024-03-28T08:01:33.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7292.917329 secs 2024-03-28T08:01:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7292.917329 secs 2024-03-28T08:01:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7292.917329 secs 2024-03-28T08:01:34.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7965 sec 2024-03-28T08:01:34.740 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:34 smithi086 ceph-mon[35163]: pgmap v4724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:34 smithi159 ceph-mon[36109]: pgmap v4724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:34 smithi055 ceph-mon[31863]: pgmap v4724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:35.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7966 sec 2024-03-28T08:01:36.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7967 sec 2024-03-28T08:01:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:36 smithi086 ceph-mon[35163]: pgmap v4725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:36.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:36 smithi159 ceph-mon[36109]: pgmap v4725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:36.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:36 smithi055 ceph-mon[31863]: pgmap v4725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:37.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7968 sec 2024-03-28T08:01:38.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7969 sec 2024-03-28T08:01:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:38 smithi086 ceph-mon[35163]: pgmap v4726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7297.917405 secs 2024-03-28T08:01:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:38 smithi159 ceph-mon[36109]: pgmap v4726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7297.917405 secs 2024-03-28T08:01:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:38 smithi055 ceph-mon[31863]: pgmap v4726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7297.917405 secs 2024-03-28T08:01:39.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7970 sec 2024-03-28T08:01:40.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7971 sec 2024-03-28T08:01:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:40 smithi086 ceph-mon[35163]: pgmap v4727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:40 smithi159 ceph-mon[36109]: pgmap v4727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:40.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:40 smithi055 ceph-mon[31863]: pgmap v4727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:41.216 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7972 sec 2024-03-28T08:01:42.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7973 sec 2024-03-28T08:01:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:42 smithi086 ceph-mon[35163]: pgmap v4728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:42 smithi159 ceph-mon[36109]: pgmap v4728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:42.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:42 smithi055 ceph-mon[31863]: pgmap v4728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:43.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7974 sec 2024-03-28T08:01:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7302.917529 secs 2024-03-28T08:01:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7302.917529 secs 2024-03-28T08:01:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7302.917529 secs 2024-03-28T08:01:44.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7975 sec 2024-03-28T08:01:44.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:44 smithi159 ceph-mon[36109]: pgmap v4729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:44.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:44 smithi055 ceph-mon[31863]: pgmap v4729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:44 smithi086 ceph-mon[35163]: pgmap v4729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:45.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7976 sec 2024-03-28T08:01:46.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7977 sec 2024-03-28T08:01:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:46 smithi086 ceph-mon[35163]: pgmap v4730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:46 smithi159 ceph-mon[36109]: pgmap v4730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:46 smithi055 ceph-mon[31863]: pgmap v4730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:47.217 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7978 sec 2024-03-28T08:01:48.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7979 sec 2024-03-28T08:01:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:48 smithi086 ceph-mon[35163]: pgmap v4731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7307.917590 secs 2024-03-28T08:01:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:48 smithi159 ceph-mon[36109]: pgmap v4731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7307.917590 secs 2024-03-28T08:01:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:48 smithi055 ceph-mon[31863]: pgmap v4731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7307.917590 secs 2024-03-28T08:01:49.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7980 sec 2024-03-28T08:01:50.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7981 sec 2024-03-28T08:01:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:50 smithi086 ceph-mon[35163]: pgmap v4732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:50 smithi159 ceph-mon[36109]: pgmap v4732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:50 smithi055 ceph-mon[31863]: pgmap v4732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:51.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7982 sec 2024-03-28T08:01:52.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7983 sec 2024-03-28T08:01:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:52 smithi086 ceph-mon[35163]: pgmap v4733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:52 smithi159 ceph-mon[36109]: pgmap v4733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:52 smithi055 ceph-mon[31863]: pgmap v4733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:53.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7984 sec 2024-03-28T08:01:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7312.917653 secs 2024-03-28T08:01:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7312.917653 secs 2024-03-28T08:01:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7312.917653 secs 2024-03-28T08:01:54.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7985 sec 2024-03-28T08:01:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:54 smithi086 ceph-mon[35163]: pgmap v4734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:54 smithi159 ceph-mon[36109]: pgmap v4734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:54 smithi055 ceph-mon[31863]: pgmap v4734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:55.218 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7986 sec 2024-03-28T08:01:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:55 smithi086 ceph-mon[35163]: pgmap v4735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:55.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:55 smithi159 ceph-mon[36109]: pgmap v4735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:55 smithi055 ceph-mon[31863]: pgmap v4735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:01:56.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7987 sec 2024-03-28T08:01:57.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7988 sec 2024-03-28T08:01:58.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7989 sec 2024-03-28T08:01:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:58 smithi055 ceph-mon[31863]: pgmap v4736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:01:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7317.917816 secs 2024-03-28T08:01:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:58 smithi086 ceph-mon[35163]: pgmap v4736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:01:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7317.917816 secs 2024-03-28T08:01:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:58 smithi159 ceph-mon[36109]: pgmap v4736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:01:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:01:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7317.917816 secs 2024-03-28T08:01:59.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7990 sec 2024-03-28T08:02:00.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7991 sec 2024-03-28T08:02:00.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:00 smithi055 ceph-mon[31863]: pgmap v4737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:00 smithi086 ceph-mon[35163]: pgmap v4737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:00 smithi159 ceph-mon[36109]: pgmap v4737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:01.219 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7992 sec 2024-03-28T08:02:02.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7993 sec 2024-03-28T08:02:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:02 smithi086 ceph-mon[35163]: pgmap v4738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:02 smithi159 ceph-mon[36109]: pgmap v4738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:02 smithi055 ceph-mon[31863]: pgmap v4738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:03.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7994 sec 2024-03-28T08:02:03.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7322.917895 secs 2024-03-28T08:02:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7322.917895 secs 2024-03-28T08:02:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7322.917895 secs 2024-03-28T08:02:04.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7995 sec 2024-03-28T08:02:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:04 smithi086 ceph-mon[35163]: pgmap v4739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:04 smithi159 ceph-mon[36109]: pgmap v4739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:04 smithi055 ceph-mon[31863]: pgmap v4739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:05.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7996 sec 2024-03-28T08:02:06.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7997 sec 2024-03-28T08:02:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:06 smithi086 ceph-mon[35163]: pgmap v4740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:06 smithi159 ceph-mon[36109]: pgmap v4740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:06 smithi055 ceph-mon[31863]: pgmap v4740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:07.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7998 sec 2024-03-28T08:02:08.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 7999 sec 2024-03-28T08:02:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:08 smithi086 ceph-mon[35163]: pgmap v4741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7327.917976 secs 2024-03-28T08:02:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:08 smithi159 ceph-mon[36109]: pgmap v4741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7327.917976 secs 2024-03-28T08:02:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:08 smithi055 ceph-mon[31863]: pgmap v4741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7327.917976 secs 2024-03-28T08:02:09.220 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8000 sec 2024-03-28T08:02:10.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8001 sec 2024-03-28T08:02:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:10 smithi086 ceph-mon[35163]: pgmap v4742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:10 smithi159 ceph-mon[36109]: pgmap v4742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:10 smithi055 ceph-mon[31863]: pgmap v4742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:11.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8002 sec 2024-03-28T08:02:12.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8003 sec 2024-03-28T08:02:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:12 smithi086 ceph-mon[35163]: pgmap v4743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:12 smithi159 ceph-mon[36109]: pgmap v4743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:12 smithi055 ceph-mon[31863]: pgmap v4743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:13.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8004 sec 2024-03-28T08:02:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7332.918071 secs 2024-03-28T08:02:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7332.918071 secs 2024-03-28T08:02:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7332.918071 secs 2024-03-28T08:02:14.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8005 sec 2024-03-28T08:02:14.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:14 smithi159 ceph-mon[36109]: pgmap v4744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:14.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:14 smithi055 ceph-mon[31863]: pgmap v4744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:14 smithi086 ceph-mon[35163]: pgmap v4744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:15.221 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8006 sec 2024-03-28T08:02:16.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8007 sec 2024-03-28T08:02:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:16 smithi086 ceph-mon[35163]: pgmap v4745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:16 smithi159 ceph-mon[36109]: pgmap v4745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:16 smithi055 ceph-mon[31863]: pgmap v4745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:17.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8008 sec 2024-03-28T08:02:18.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8009 sec 2024-03-28T08:02:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:18 smithi086 ceph-mon[35163]: pgmap v4746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7337.918137 secs 2024-03-28T08:02:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:18 smithi159 ceph-mon[36109]: pgmap v4746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7337.918137 secs 2024-03-28T08:02:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:18 smithi055 ceph-mon[31863]: pgmap v4746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7337.918137 secs 2024-03-28T08:02:19.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8010 sec 2024-03-28T08:02:20.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8011 sec 2024-03-28T08:02:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:20 smithi086 ceph-mon[35163]: pgmap v4747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:20.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:20 smithi159 ceph-mon[36109]: pgmap v4747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:20 smithi055 ceph-mon[31863]: pgmap v4747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:21.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8012 sec 2024-03-28T08:02:22.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8013 sec 2024-03-28T08:02:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:22 smithi086 ceph-mon[35163]: pgmap v4748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:02:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:22 smithi159 ceph-mon[36109]: pgmap v4748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:02:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:22 smithi055 ceph-mon[31863]: pgmap v4748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:02:23.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8014 sec 2024-03-28T08:02:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7342.918263 secs 2024-03-28T08:02:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:02:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:02:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:02:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7342.918263 secs 2024-03-28T08:02:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:02:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:02:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:02:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7342.918263 secs 2024-03-28T08:02:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:02:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:02:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:02:24.222 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8015 sec 2024-03-28T08:02:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:24 smithi086 ceph-mon[35163]: pgmap v4749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:24 smithi086 ceph-mon[35163]: pgmap v4750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:24 smithi159 ceph-mon[36109]: pgmap v4749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:24 smithi159 ceph-mon[36109]: pgmap v4750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:24 smithi055 ceph-mon[31863]: pgmap v4749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:24 smithi055 ceph-mon[31863]: pgmap v4750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:25.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8016 sec 2024-03-28T08:02:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:25 smithi086 ceph-mon[35163]: pgmap v4751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:25 smithi159 ceph-mon[36109]: pgmap v4751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:25 smithi055 ceph-mon[31863]: pgmap v4751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:26.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8017 sec 2024-03-28T08:02:27.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8018 sec 2024-03-28T08:02:28.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8019 sec 2024-03-28T08:02:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:28 smithi086 ceph-mon[35163]: pgmap v4752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7347.918344 secs 2024-03-28T08:02:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:28 smithi159 ceph-mon[36109]: pgmap v4752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7347.918344 secs 2024-03-28T08:02:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:28 smithi055 ceph-mon[31863]: pgmap v4752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7347.918344 secs 2024-03-28T08:02:29.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8020 sec 2024-03-28T08:02:30.223 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8021 sec 2024-03-28T08:02:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:30 smithi086 ceph-mon[35163]: pgmap v4753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:30 smithi159 ceph-mon[36109]: pgmap v4753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:30 smithi055 ceph-mon[31863]: pgmap v4753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:31.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8022 sec 2024-03-28T08:02:32.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8023 sec 2024-03-28T08:02:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:32 smithi086 ceph-mon[35163]: pgmap v4754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:32 smithi159 ceph-mon[36109]: pgmap v4754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:32 smithi055 ceph-mon[31863]: pgmap v4754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:02:33.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8024 sec 2024-03-28T08:02:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7352.918465 secs 2024-03-28T08:02:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7352.918465 secs 2024-03-28T08:02:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7352.918465 secs 2024-03-28T08:02:34.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8025 sec 2024-03-28T08:02:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:34 smithi086 ceph-mon[35163]: pgmap v4755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:02:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:34 smithi159 ceph-mon[36109]: pgmap v4755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:02:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:34 smithi055 ceph-mon[31863]: pgmap v4755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:02:35.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8026 sec 2024-03-28T08:02:36.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8027 sec 2024-03-28T08:02:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:36 smithi086 ceph-mon[35163]: pgmap v4756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:36 smithi159 ceph-mon[36109]: pgmap v4756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:36 smithi055 ceph-mon[31863]: pgmap v4756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:37.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8028 sec 2024-03-28T08:02:38.224 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8029 sec 2024-03-28T08:02:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:38 smithi086 ceph-mon[35163]: pgmap v4757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7357.918529 secs 2024-03-28T08:02:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:38 smithi159 ceph-mon[36109]: pgmap v4757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7357.918529 secs 2024-03-28T08:02:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:38 smithi055 ceph-mon[31863]: pgmap v4757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7357.918529 secs 2024-03-28T08:02:39.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8030 sec 2024-03-28T08:02:40.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8031 sec 2024-03-28T08:02:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:40 smithi055 ceph-mon[31863]: pgmap v4758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:40 smithi086 ceph-mon[35163]: pgmap v4758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:40 smithi159 ceph-mon[36109]: pgmap v4758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:41.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8032 sec 2024-03-28T08:02:42.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8033 sec 2024-03-28T08:02:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:42 smithi055 ceph-mon[31863]: pgmap v4759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:42 smithi086 ceph-mon[35163]: pgmap v4759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:42 smithi159 ceph-mon[36109]: pgmap v4759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:43.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8034 sec 2024-03-28T08:02:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7362.918609 secs 2024-03-28T08:02:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7362.918609 secs 2024-03-28T08:02:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7362.918609 secs 2024-03-28T08:02:44.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8035 sec 2024-03-28T08:02:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:44 smithi055 ceph-mon[31863]: pgmap v4760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:44.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:44 smithi159 ceph-mon[36109]: pgmap v4760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:44 smithi086 ceph-mon[35163]: pgmap v4760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:45.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8036 sec 2024-03-28T08:02:46.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8037 sec 2024-03-28T08:02:46.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:46 smithi055 ceph-mon[31863]: pgmap v4761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:46 smithi086 ceph-mon[35163]: pgmap v4761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:46 smithi159 ceph-mon[36109]: pgmap v4761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:47.225 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8038 sec 2024-03-28T08:02:48.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8039 sec 2024-03-28T08:02:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:48 smithi055 ceph-mon[31863]: pgmap v4762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7367.918733 secs 2024-03-28T08:02:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:48 smithi086 ceph-mon[35163]: pgmap v4762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7367.918733 secs 2024-03-28T08:02:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:48 smithi159 ceph-mon[36109]: pgmap v4762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7367.918733 secs 2024-03-28T08:02:49.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8040 sec 2024-03-28T08:02:50.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8041 sec 2024-03-28T08:02:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:50 smithi086 ceph-mon[35163]: pgmap v4763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:50 smithi159 ceph-mon[36109]: pgmap v4763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:50 smithi055 ceph-mon[31863]: pgmap v4763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:51.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8042 sec 2024-03-28T08:02:52.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8043 sec 2024-03-28T08:02:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:52 smithi086 ceph-mon[35163]: pgmap v4764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:52 smithi159 ceph-mon[36109]: pgmap v4764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:52 smithi055 ceph-mon[31863]: pgmap v4764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:53.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8044 sec 2024-03-28T08:02:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7372.918843 secs 2024-03-28T08:02:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7372.918843 secs 2024-03-28T08:02:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7372.918843 secs 2024-03-28T08:02:54.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8045 sec 2024-03-28T08:02:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:54 smithi086 ceph-mon[35163]: pgmap v4765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:54 smithi159 ceph-mon[36109]: pgmap v4765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:54 smithi055 ceph-mon[31863]: pgmap v4765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:55.226 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8046 sec 2024-03-28T08:02:56.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8047 sec 2024-03-28T08:02:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:56 smithi086 ceph-mon[35163]: pgmap v4766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:56 smithi159 ceph-mon[36109]: pgmap v4766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:56 smithi055 ceph-mon[31863]: pgmap v4766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:02:57.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8048 sec 2024-03-28T08:02:58.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8049 sec 2024-03-28T08:02:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:58 smithi086 ceph-mon[35163]: pgmap v4767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:02:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7377.918962 secs 2024-03-28T08:02:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:58 smithi159 ceph-mon[36109]: pgmap v4767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:02:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7377.918962 secs 2024-03-28T08:02:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:58 smithi055 ceph-mon[31863]: pgmap v4767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:02:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:02:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7377.918962 secs 2024-03-28T08:02:59.227 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8050 sec 2024-03-28T08:03:00.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8051 sec 2024-03-28T08:03:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:00 smithi086 ceph-mon[35163]: pgmap v4768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:00 smithi159 ceph-mon[36109]: pgmap v4768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:00 smithi055 ceph-mon[31863]: pgmap v4768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:01.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8052 sec 2024-03-28T08:03:02.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8053 sec 2024-03-28T08:03:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:02 smithi086 ceph-mon[35163]: pgmap v4769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:02.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:02 smithi159 ceph-mon[36109]: pgmap v4769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:02 smithi055 ceph-mon[31863]: pgmap v4769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:03.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8054 sec 2024-03-28T08:03:03.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7382.919087 secs 2024-03-28T08:03:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7382.919087 secs 2024-03-28T08:03:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7382.919087 secs 2024-03-28T08:03:04.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8055 sec 2024-03-28T08:03:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:04 smithi086 ceph-mon[35163]: pgmap v4770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:04 smithi159 ceph-mon[36109]: pgmap v4770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:04 smithi055 ceph-mon[31863]: pgmap v4770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:05.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8056 sec 2024-03-28T08:03:06.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8057 sec 2024-03-28T08:03:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:06 smithi086 ceph-mon[35163]: pgmap v4771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:06 smithi159 ceph-mon[36109]: pgmap v4771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:06 smithi055 ceph-mon[31863]: pgmap v4771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:07.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8058 sec 2024-03-28T08:03:08.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8059 sec 2024-03-28T08:03:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:08 smithi086 ceph-mon[35163]: pgmap v4772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7387.919212 secs 2024-03-28T08:03:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:08 smithi159 ceph-mon[36109]: pgmap v4772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7387.919212 secs 2024-03-28T08:03:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:08 smithi055 ceph-mon[31863]: pgmap v4772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7387.919212 secs 2024-03-28T08:03:09.228 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8060 sec 2024-03-28T08:03:10.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8061 sec 2024-03-28T08:03:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:10 smithi086 ceph-mon[35163]: pgmap v4773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:10 smithi159 ceph-mon[36109]: pgmap v4773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:10 smithi055 ceph-mon[31863]: pgmap v4773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:11.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8062 sec 2024-03-28T08:03:12.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8063 sec 2024-03-28T08:03:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:12 smithi086 ceph-mon[35163]: pgmap v4774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:12.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:12 smithi159 ceph-mon[36109]: pgmap v4774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:12.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:12 smithi055 ceph-mon[31863]: pgmap v4774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:13.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8064 sec 2024-03-28T08:03:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7392.919336 secs 2024-03-28T08:03:13.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7392.919336 secs 2024-03-28T08:03:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7392.919336 secs 2024-03-28T08:03:14.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8065 sec 2024-03-28T08:03:14.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:14 smithi055 ceph-mon[31863]: pgmap v4775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:14 smithi086 ceph-mon[35163]: pgmap v4775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:14.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:14 smithi159 ceph-mon[36109]: pgmap v4775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:15.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8066 sec 2024-03-28T08:03:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:15 smithi086 ceph-mon[35163]: pgmap v4776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:15 smithi159 ceph-mon[36109]: pgmap v4776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:15 smithi055 ceph-mon[31863]: pgmap v4776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:16.229 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8067 sec 2024-03-28T08:03:17.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8068 sec 2024-03-28T08:03:18.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8069 sec 2024-03-28T08:03:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:18 smithi086 ceph-mon[35163]: pgmap v4777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7397.919462 secs 2024-03-28T08:03:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:18 smithi159 ceph-mon[36109]: pgmap v4777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7397.919462 secs 2024-03-28T08:03:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:18 smithi055 ceph-mon[31863]: pgmap v4777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7397.919462 secs 2024-03-28T08:03:19.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8070 sec 2024-03-28T08:03:20.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8071 sec 2024-03-28T08:03:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:20 smithi086 ceph-mon[35163]: pgmap v4778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:20 smithi159 ceph-mon[36109]: pgmap v4778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:20 smithi055 ceph-mon[31863]: pgmap v4778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:21.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8072 sec 2024-03-28T08:03:22.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8073 sec 2024-03-28T08:03:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:22 smithi086 ceph-mon[35163]: pgmap v4779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:22.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:22 smithi159 ceph-mon[36109]: pgmap v4779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:22 smithi055 ceph-mon[31863]: pgmap v4779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:23.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8074 sec 2024-03-28T08:03:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7402.919552 secs 2024-03-28T08:03:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7402.919552 secs 2024-03-28T08:03:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7402.919552 secs 2024-03-28T08:03:24.230 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8075 sec 2024-03-28T08:03:24.346 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:24 smithi086 ceph-mon[35163]: pgmap v4780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:24.346 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:03:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:24 smithi055 ceph-mon[31863]: pgmap v4780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:03:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:24 smithi159 ceph-mon[36109]: pgmap v4780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:03:25.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8076 sec 2024-03-28T08:03:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:03:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:03:25.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:03:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:03:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:03:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:03:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:03:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:03:25.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:03:26.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8077 sec 2024-03-28T08:03:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:26 smithi055 ceph-mon[31863]: pgmap v4781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:26 smithi055 ceph-mon[31863]: pgmap v4782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:26 smithi086 ceph-mon[35163]: pgmap v4781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:26 smithi086 ceph-mon[35163]: pgmap v4782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:26.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:26 smithi159 ceph-mon[36109]: pgmap v4781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:26.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:26 smithi159 ceph-mon[36109]: pgmap v4782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:27.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8078 sec 2024-03-28T08:03:28.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8079 sec 2024-03-28T08:03:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:28 smithi055 ceph-mon[31863]: pgmap v4783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7407.919676 secs 2024-03-28T08:03:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:28 smithi086 ceph-mon[35163]: pgmap v4783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7407.919676 secs 2024-03-28T08:03:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:28 smithi159 ceph-mon[36109]: pgmap v4783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:28.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7407.919676 secs 2024-03-28T08:03:29.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8080 sec 2024-03-28T08:03:30.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8081 sec 2024-03-28T08:03:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:30 smithi055 ceph-mon[31863]: pgmap v4784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:30 smithi086 ceph-mon[35163]: pgmap v4784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:30 smithi159 ceph-mon[36109]: pgmap v4784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:31.231 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8082 sec 2024-03-28T08:03:32.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8083 sec 2024-03-28T08:03:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:32 smithi055 ceph-mon[31863]: pgmap v4785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:32 smithi086 ceph-mon[35163]: pgmap v4785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:32.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:32 smithi159 ceph-mon[36109]: pgmap v4785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:33.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8084 sec 2024-03-28T08:03:33.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7412.919820 secs 2024-03-28T08:03:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7412.919820 secs 2024-03-28T08:03:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7412.919820 secs 2024-03-28T08:03:34.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8085 sec 2024-03-28T08:03:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:34 smithi086 ceph-mon[35163]: pgmap v4786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:34 smithi159 ceph-mon[36109]: pgmap v4786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:34 smithi055 ceph-mon[31863]: pgmap v4786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:03:35.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8086 sec 2024-03-28T08:03:36.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8087 sec 2024-03-28T08:03:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:36 smithi086 ceph-mon[35163]: pgmap v4787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:03:36.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:36 smithi159 ceph-mon[36109]: pgmap v4787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:03:36.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:36 smithi055 ceph-mon[31863]: pgmap v4787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:03:37.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8088 sec 2024-03-28T08:03:38.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8089 sec 2024-03-28T08:03:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:38 smithi086 ceph-mon[35163]: pgmap v4788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7417.919909 secs 2024-03-28T08:03:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:38 smithi159 ceph-mon[36109]: pgmap v4788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7417.919909 secs 2024-03-28T08:03:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:38 smithi055 ceph-mon[31863]: pgmap v4788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7417.919909 secs 2024-03-28T08:03:39.232 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8090 sec 2024-03-28T08:03:40.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8091 sec 2024-03-28T08:03:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:40 smithi086 ceph-mon[35163]: pgmap v4789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:40.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:40 smithi159 ceph-mon[36109]: pgmap v4789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:40.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:40 smithi055 ceph-mon[31863]: pgmap v4789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:41.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8092 sec 2024-03-28T08:03:42.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8093 sec 2024-03-28T08:03:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:42 smithi086 ceph-mon[35163]: pgmap v4790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:42.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:42 smithi159 ceph-mon[36109]: pgmap v4790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:42.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:42 smithi055 ceph-mon[31863]: pgmap v4790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:43.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8094 sec 2024-03-28T08:03:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7422.919972 secs 2024-03-28T08:03:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7422.919972 secs 2024-03-28T08:03:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7422.919972 secs 2024-03-28T08:03:44.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8095 sec 2024-03-28T08:03:44.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:44 smithi159 ceph-mon[36109]: pgmap v4791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:44.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:44 smithi055 ceph-mon[31863]: pgmap v4791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:44 smithi086 ceph-mon[35163]: pgmap v4791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:45.233 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8096 sec 2024-03-28T08:03:46.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8097 sec 2024-03-28T08:03:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:46 smithi086 ceph-mon[35163]: pgmap v4792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:46 smithi159 ceph-mon[36109]: pgmap v4792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:46 smithi055 ceph-mon[31863]: pgmap v4792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:47.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8098 sec 2024-03-28T08:03:48.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8099 sec 2024-03-28T08:03:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:48 smithi086 ceph-mon[35163]: pgmap v4793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7427.920039 secs 2024-03-28T08:03:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:48 smithi159 ceph-mon[36109]: pgmap v4793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7427.920039 secs 2024-03-28T08:03:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:48 smithi055 ceph-mon[31863]: pgmap v4793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7427.920039 secs 2024-03-28T08:03:49.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8100 sec 2024-03-28T08:03:50.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8101 sec 2024-03-28T08:03:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:50 smithi086 ceph-mon[35163]: pgmap v4794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:50 smithi159 ceph-mon[36109]: pgmap v4794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:50 smithi055 ceph-mon[31863]: pgmap v4794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:51.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8102 sec 2024-03-28T08:03:52.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8103 sec 2024-03-28T08:03:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:52 smithi086 ceph-mon[35163]: pgmap v4795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:52 smithi159 ceph-mon[36109]: pgmap v4795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:52 smithi055 ceph-mon[31863]: pgmap v4795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:53.234 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8104 sec 2024-03-28T08:03:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7432.920109 secs 2024-03-28T08:03:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7432.920109 secs 2024-03-28T08:03:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7432.920109 secs 2024-03-28T08:03:54.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8105 sec 2024-03-28T08:03:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:54 smithi086 ceph-mon[35163]: pgmap v4796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:54 smithi159 ceph-mon[36109]: pgmap v4796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:54 smithi055 ceph-mon[31863]: pgmap v4796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:55.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8106 sec 2024-03-28T08:03:56.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8107 sec 2024-03-28T08:03:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:56 smithi086 ceph-mon[35163]: pgmap v4797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:56 smithi159 ceph-mon[36109]: pgmap v4797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:56 smithi055 ceph-mon[31863]: pgmap v4797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:03:57.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8108 sec 2024-03-28T08:03:58.235 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8109 sec 2024-03-28T08:03:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:58 smithi086 ceph-mon[35163]: pgmap v4798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:03:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7437.920142 secs 2024-03-28T08:03:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:58 smithi159 ceph-mon[36109]: pgmap v4798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:03:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7437.920142 secs 2024-03-28T08:03:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:58 smithi055 ceph-mon[31863]: pgmap v4798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:03:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:03:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7437.920142 secs 2024-03-28T08:03:59.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8110 sec 2024-03-28T08:04:00.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8111 sec 2024-03-28T08:04:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:00 smithi086 ceph-mon[35163]: pgmap v4799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:00 smithi159 ceph-mon[36109]: pgmap v4799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:00 smithi055 ceph-mon[31863]: pgmap v4799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:01.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8112 sec 2024-03-28T08:04:02.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8113 sec 2024-03-28T08:04:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:02 smithi086 ceph-mon[35163]: pgmap v4800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:02 smithi159 ceph-mon[36109]: pgmap v4800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:02 smithi055 ceph-mon[31863]: pgmap v4800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:03.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8114 sec 2024-03-28T08:04:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7442.920262 secs 2024-03-28T08:04:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7442.920262 secs 2024-03-28T08:04:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7442.920262 secs 2024-03-28T08:04:04.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8115 sec 2024-03-28T08:04:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:04 smithi086 ceph-mon[35163]: pgmap v4801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:04.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:04 smithi159 ceph-mon[36109]: pgmap v4801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:04 smithi055 ceph-mon[31863]: pgmap v4801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:05.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8116 sec 2024-03-28T08:04:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:05 smithi086 ceph-mon[35163]: pgmap v4802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:05 smithi159 ceph-mon[36109]: pgmap v4802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:05 smithi055 ceph-mon[31863]: pgmap v4802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:06.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8117 sec 2024-03-28T08:04:07.236 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8118 sec 2024-03-28T08:04:08.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8119 sec 2024-03-28T08:04:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:08 smithi086 ceph-mon[35163]: pgmap v4803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7447.920342 secs 2024-03-28T08:04:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:08 smithi159 ceph-mon[36109]: pgmap v4803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:08.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7447.920342 secs 2024-03-28T08:04:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:08 smithi055 ceph-mon[31863]: pgmap v4803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7447.920342 secs 2024-03-28T08:04:09.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8120 sec 2024-03-28T08:04:10.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8121 sec 2024-03-28T08:04:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:10 smithi086 ceph-mon[35163]: pgmap v4804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:10.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:10 smithi159 ceph-mon[36109]: pgmap v4804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:10 smithi055 ceph-mon[31863]: pgmap v4804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:11.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8122 sec 2024-03-28T08:04:12.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8123 sec 2024-03-28T08:04:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:12 smithi086 ceph-mon[35163]: pgmap v4805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:12 smithi159 ceph-mon[36109]: pgmap v4805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:12 smithi055 ceph-mon[31863]: pgmap v4805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:13.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8124 sec 2024-03-28T08:04:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7452.920406 secs 2024-03-28T08:04:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7452.920406 secs 2024-03-28T08:04:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7452.920406 secs 2024-03-28T08:04:14.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8125 sec 2024-03-28T08:04:14.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:14 smithi159 ceph-mon[36109]: pgmap v4806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:14.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:14 smithi055 ceph-mon[31863]: pgmap v4806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:14 smithi086 ceph-mon[35163]: pgmap v4806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:15.237 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8126 sec 2024-03-28T08:04:16.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8127 sec 2024-03-28T08:04:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:16 smithi086 ceph-mon[35163]: pgmap v4807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:16.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:16 smithi159 ceph-mon[36109]: pgmap v4807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:16.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:16 smithi055 ceph-mon[31863]: pgmap v4807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:17.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8128 sec 2024-03-28T08:04:18.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8129 sec 2024-03-28T08:04:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:18 smithi086 ceph-mon[35163]: pgmap v4808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7457.920430 secs 2024-03-28T08:04:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:18 smithi159 ceph-mon[36109]: pgmap v4808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:18.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7457.920430 secs 2024-03-28T08:04:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:18 smithi055 ceph-mon[31863]: pgmap v4808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:18.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7457.920430 secs 2024-03-28T08:04:19.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8130 sec 2024-03-28T08:04:20.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8131 sec 2024-03-28T08:04:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:20 smithi086 ceph-mon[35163]: pgmap v4809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:20.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:20 smithi159 ceph-mon[36109]: pgmap v4809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:20.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:20 smithi055 ceph-mon[31863]: pgmap v4809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:21.238 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8132 sec 2024-03-28T08:04:22.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8133 sec 2024-03-28T08:04:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:22 smithi086 ceph-mon[35163]: pgmap v4810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:22 smithi159 ceph-mon[36109]: pgmap v4810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:22.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:22 smithi055 ceph-mon[31863]: pgmap v4810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:23.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8134 sec 2024-03-28T08:04:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7462.920554 secs 2024-03-28T08:04:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7462.920554 secs 2024-03-28T08:04:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7462.920554 secs 2024-03-28T08:04:24.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8135 sec 2024-03-28T08:04:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:24 smithi086 ceph-mon[35163]: pgmap v4811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:24 smithi159 ceph-mon[36109]: pgmap v4811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:24.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:24 smithi055 ceph-mon[31863]: pgmap v4811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:25.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8136 sec 2024-03-28T08:04:26.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8137 sec 2024-03-28T08:04:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:26 smithi086 ceph-mon[35163]: pgmap v4812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:04:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:26 smithi159 ceph-mon[36109]: pgmap v4812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:26.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:04:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:26 smithi055 ceph-mon[31863]: pgmap v4812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:04:27.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8138 sec 2024-03-28T08:04:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:04:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:04:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:04:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:04:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:04:27.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:04:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:04:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:04:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:04:28.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8139 sec 2024-03-28T08:04:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:28 smithi086 ceph-mon[35163]: pgmap v4813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:28 smithi086 ceph-mon[35163]: pgmap v4814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7467.920630 secs 2024-03-28T08:04:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:28 smithi159 ceph-mon[36109]: pgmap v4813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:28 smithi159 ceph-mon[36109]: pgmap v4814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7467.920630 secs 2024-03-28T08:04:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:28 smithi055 ceph-mon[31863]: pgmap v4813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:28 smithi055 ceph-mon[31863]: pgmap v4814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7467.920630 secs 2024-03-28T08:04:29.239 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8140 sec 2024-03-28T08:04:30.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8141 sec 2024-03-28T08:04:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:30 smithi086 ceph-mon[35163]: pgmap v4815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:30.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:30 smithi159 ceph-mon[36109]: pgmap v4815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:30 smithi055 ceph-mon[31863]: pgmap v4815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:31.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8142 sec 2024-03-28T08:04:32.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8143 sec 2024-03-28T08:04:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:32 smithi086 ceph-mon[35163]: pgmap v4816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:32.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:32 smithi159 ceph-mon[36109]: pgmap v4816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:32.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:32 smithi055 ceph-mon[31863]: pgmap v4816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:33.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8144 sec 2024-03-28T08:04:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7472.920753 secs 2024-03-28T08:04:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7472.920753 secs 2024-03-28T08:04:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7472.920753 secs 2024-03-28T08:04:34.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8145 sec 2024-03-28T08:04:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:34 smithi086 ceph-mon[35163]: pgmap v4817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:34 smithi159 ceph-mon[36109]: pgmap v4817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:34 smithi055 ceph-mon[31863]: pgmap v4817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:35.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8146 sec 2024-03-28T08:04:36.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8147 sec 2024-03-28T08:04:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:36 smithi159 ceph-mon[36109]: pgmap v4818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:36 smithi055 ceph-mon[31863]: pgmap v4818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:36 smithi086 ceph-mon[35163]: pgmap v4818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:04:37.240 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8148 sec 2024-03-28T08:04:38.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8149 sec 2024-03-28T08:04:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:38 smithi055 ceph-mon[31863]: pgmap v4819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:04:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7477.920819 secs 2024-03-28T08:04:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:38 smithi086 ceph-mon[35163]: pgmap v4819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:04:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7477.920819 secs 2024-03-28T08:04:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:38 smithi159 ceph-mon[36109]: pgmap v4819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:04:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7477.920819 secs 2024-03-28T08:04:39.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8150 sec 2024-03-28T08:04:40.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8151 sec 2024-03-28T08:04:40.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:40 smithi055 ceph-mon[31863]: pgmap v4820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:40 smithi086 ceph-mon[35163]: pgmap v4820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:40 smithi159 ceph-mon[36109]: pgmap v4820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:41.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8152 sec 2024-03-28T08:04:42.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8153 sec 2024-03-28T08:04:42.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:42 smithi055 ceph-mon[31863]: pgmap v4821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:42 smithi086 ceph-mon[35163]: pgmap v4821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:42 smithi159 ceph-mon[36109]: pgmap v4821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:43.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8154 sec 2024-03-28T08:04:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7482.920911 secs 2024-03-28T08:04:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7482.920911 secs 2024-03-28T08:04:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7482.920911 secs 2024-03-28T08:04:44.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8155 sec 2024-03-28T08:04:44.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:44 smithi159 ceph-mon[36109]: pgmap v4822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:44 smithi086 ceph-mon[35163]: pgmap v4822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:44 smithi055 ceph-mon[31863]: pgmap v4822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:45.241 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8156 sec 2024-03-28T08:04:46.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8157 sec 2024-03-28T08:04:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:46 smithi086 ceph-mon[35163]: pgmap v4823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:46 smithi159 ceph-mon[36109]: pgmap v4823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:46 smithi055 ceph-mon[31863]: pgmap v4823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:47.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8158 sec 2024-03-28T08:04:48.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8159 sec 2024-03-28T08:04:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:48 smithi086 ceph-mon[35163]: pgmap v4824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7487.921004 secs 2024-03-28T08:04:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:48 smithi159 ceph-mon[36109]: pgmap v4824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7487.921004 secs 2024-03-28T08:04:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:48 smithi055 ceph-mon[31863]: pgmap v4824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7487.921004 secs 2024-03-28T08:04:49.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8160 sec 2024-03-28T08:04:50.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8161 sec 2024-03-28T08:04:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:50 smithi086 ceph-mon[35163]: pgmap v4825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:50.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:50 smithi159 ceph-mon[36109]: pgmap v4825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:50 smithi055 ceph-mon[31863]: pgmap v4825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:51.242 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8162 sec 2024-03-28T08:04:52.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8163 sec 2024-03-28T08:04:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:52 smithi086 ceph-mon[35163]: pgmap v4826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:52.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:52 smithi159 ceph-mon[36109]: pgmap v4826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:52 smithi055 ceph-mon[31863]: pgmap v4826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:53.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8164 sec 2024-03-28T08:04:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7492.921083 secs 2024-03-28T08:04:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7492.921083 secs 2024-03-28T08:04:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7492.921083 secs 2024-03-28T08:04:54.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8165 sec 2024-03-28T08:04:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:54 smithi086 ceph-mon[35163]: pgmap v4827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:54 smithi159 ceph-mon[36109]: pgmap v4827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:54 smithi055 ceph-mon[31863]: pgmap v4827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:55.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8166 sec 2024-03-28T08:04:56.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8167 sec 2024-03-28T08:04:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:56 smithi086 ceph-mon[35163]: pgmap v4828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:56 smithi159 ceph-mon[36109]: pgmap v4828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:56 smithi055 ceph-mon[31863]: pgmap v4828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:04:57.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8168 sec 2024-03-28T08:04:58.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8169 sec 2024-03-28T08:04:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:58 smithi086 ceph-mon[35163]: pgmap v4829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7497.921207 secs 2024-03-28T08:04:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:58 smithi159 ceph-mon[36109]: pgmap v4829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:58.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7497.921207 secs 2024-03-28T08:04:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:58 smithi055 ceph-mon[31863]: pgmap v4829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:04:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7497.921207 secs 2024-03-28T08:04:59.243 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8170 sec 2024-03-28T08:05:00.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8171 sec 2024-03-28T08:05:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:00 smithi086 ceph-mon[35163]: pgmap v4830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:00 smithi159 ceph-mon[36109]: pgmap v4830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:00 smithi055 ceph-mon[31863]: pgmap v4830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:01.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8172 sec 2024-03-28T08:05:02.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8173 sec 2024-03-28T08:05:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:02 smithi086 ceph-mon[35163]: pgmap v4831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:02 smithi159 ceph-mon[36109]: pgmap v4831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:02 smithi055 ceph-mon[31863]: pgmap v4831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:03.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8174 sec 2024-03-28T08:05:03.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7502.921330 secs 2024-03-28T08:05:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7502.921330 secs 2024-03-28T08:05:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7502.921330 secs 2024-03-28T08:05:04.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8175 sec 2024-03-28T08:05:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:04 smithi086 ceph-mon[35163]: pgmap v4832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:04 smithi159 ceph-mon[36109]: pgmap v4832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:04 smithi055 ceph-mon[31863]: pgmap v4832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:05.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8176 sec 2024-03-28T08:05:06.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8177 sec 2024-03-28T08:05:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:06 smithi086 ceph-mon[35163]: pgmap v4833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:06.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:06 smithi159 ceph-mon[36109]: pgmap v4833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:06 smithi055 ceph-mon[31863]: pgmap v4833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:07.244 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8178 sec 2024-03-28T08:05:08.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8179 sec 2024-03-28T08:05:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:08 smithi086 ceph-mon[35163]: pgmap v4834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7507.921407 secs 2024-03-28T08:05:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:08 smithi159 ceph-mon[36109]: pgmap v4834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:08.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7507.921407 secs 2024-03-28T08:05:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:08 smithi055 ceph-mon[31863]: pgmap v4834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7507.921407 secs 2024-03-28T08:05:09.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8180 sec 2024-03-28T08:05:10.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8181 sec 2024-03-28T08:05:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:10 smithi086 ceph-mon[35163]: pgmap v4835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:10 smithi159 ceph-mon[36109]: pgmap v4835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:10 smithi055 ceph-mon[31863]: pgmap v4835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:11.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8182 sec 2024-03-28T08:05:12.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8183 sec 2024-03-28T08:05:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:12 smithi086 ceph-mon[35163]: pgmap v4836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:12 smithi159 ceph-mon[36109]: pgmap v4836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:12 smithi055 ceph-mon[31863]: pgmap v4836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:13.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8184 sec 2024-03-28T08:05:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7512.921497 secs 2024-03-28T08:05:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7512.921497 secs 2024-03-28T08:05:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7512.921497 secs 2024-03-28T08:05:14.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8185 sec 2024-03-28T08:05:14.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:14 smithi055 ceph-mon[31863]: pgmap v4837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:14 smithi086 ceph-mon[35163]: pgmap v4837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:14 smithi159 ceph-mon[36109]: pgmap v4837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:15.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8186 sec 2024-03-28T08:05:16.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8187 sec 2024-03-28T08:05:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:16 smithi086 ceph-mon[35163]: pgmap v4838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:16.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:16 smithi159 ceph-mon[36109]: pgmap v4838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:16 smithi055 ceph-mon[31863]: pgmap v4838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:17.245 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8188 sec 2024-03-28T08:05:18.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8189 sec 2024-03-28T08:05:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:18 smithi086 ceph-mon[35163]: pgmap v4839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7517.921622 secs 2024-03-28T08:05:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:18 smithi159 ceph-mon[36109]: pgmap v4839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7517.921622 secs 2024-03-28T08:05:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:18 smithi055 ceph-mon[31863]: pgmap v4839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7517.921622 secs 2024-03-28T08:05:19.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8190 sec 2024-03-28T08:05:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:19 smithi055 ceph-mon[31863]: pgmap v4840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:19 smithi086 ceph-mon[35163]: pgmap v4840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:19 smithi159 ceph-mon[36109]: pgmap v4840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:20.246 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8191 sec 2024-03-28T08:05:21.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8192 sec 2024-03-28T08:05:22.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8193 sec 2024-03-28T08:05:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:21 smithi086 ceph-mon[35163]: pgmap v4841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:22.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:21 smithi159 ceph-mon[36109]: pgmap v4841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:22.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:21 smithi055 ceph-mon[31863]: pgmap v4841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:23.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8194 sec 2024-03-28T08:05:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7522.921742 secs 2024-03-28T08:05:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7522.921742 secs 2024-03-28T08:05:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7522.921742 secs 2024-03-28T08:05:24.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8195 sec 2024-03-28T08:05:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:24 smithi086 ceph-mon[35163]: pgmap v4842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:24 smithi159 ceph-mon[36109]: pgmap v4842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:24 smithi055 ceph-mon[31863]: pgmap v4842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:25.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8196 sec 2024-03-28T08:05:26.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8197 sec 2024-03-28T08:05:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:26 smithi086 ceph-mon[35163]: pgmap v4843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:26.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:26 smithi159 ceph-mon[36109]: pgmap v4843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:26.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:26 smithi055 ceph-mon[31863]: pgmap v4843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:27.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8198 sec 2024-03-28T08:05:28.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8199 sec 2024-03-28T08:05:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:28 smithi086 ceph-mon[35163]: pgmap v4844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:05:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7527.921812 secs 2024-03-28T08:05:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:28 smithi159 ceph-mon[36109]: pgmap v4844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:05:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7527.921812 secs 2024-03-28T08:05:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:28 smithi055 ceph-mon[31863]: pgmap v4844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:05:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7527.921812 secs 2024-03-28T08:05:29.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8200 sec 2024-03-28T08:05:30.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8201 sec 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: pgmap v4845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:05:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:05:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: pgmap v4846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:05:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: pgmap v4847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: pgmap v4845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: pgmap v4846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:05:30.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: pgmap v4847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:30.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: pgmap v4845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: pgmap v4846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:05:30.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: pgmap v4847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:30.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:05:31.247 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8202 sec 2024-03-28T08:05:31.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:31 smithi055 ceph-mon[31863]: pgmap v4848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:31 smithi086 ceph-mon[35163]: pgmap v4848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:31 smithi159 ceph-mon[36109]: pgmap v4848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:32.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8203 sec 2024-03-28T08:05:32.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7532.921933 secs 2024-03-28T08:05:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7532.921933 secs 2024-03-28T08:05:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7532.921933 secs 2024-03-28T08:05:33.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8204 sec 2024-03-28T08:05:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:33 smithi055 ceph-mon[31863]: pgmap v4849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:33.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:33 smithi086 ceph-mon[35163]: pgmap v4849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:33 smithi159 ceph-mon[36109]: pgmap v4849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:34.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8205 sec 2024-03-28T08:05:35.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8206 sec 2024-03-28T08:05:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:35 smithi055 ceph-mon[31863]: pgmap v4850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:35 smithi086 ceph-mon[35163]: pgmap v4850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:35 smithi159 ceph-mon[36109]: pgmap v4850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:05:36.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8207 sec 2024-03-28T08:05:37.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8208 sec 2024-03-28T08:05:37.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7537.922021 secs 2024-03-28T08:05:37.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:37 smithi055 ceph-mon[31863]: pgmap v4851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7537.922021 secs 2024-03-28T08:05:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:37 smithi086 ceph-mon[35163]: pgmap v4851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7537.922021 secs 2024-03-28T08:05:38.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:37 smithi159 ceph-mon[36109]: pgmap v4851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:38.248 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8209 sec 2024-03-28T08:05:39.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8210 sec 2024-03-28T08:05:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:39 smithi055 ceph-mon[31863]: pgmap v4852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:05:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:39 smithi086 ceph-mon[35163]: pgmap v4852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:05:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:39 smithi159 ceph-mon[36109]: pgmap v4852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:05:40.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8211 sec 2024-03-28T08:05:41.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8212 sec 2024-03-28T08:05:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:41 smithi055 ceph-mon[31863]: pgmap v4853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:41 smithi086 ceph-mon[35163]: pgmap v4853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:42.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:41 smithi159 ceph-mon[36109]: pgmap v4853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:42.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8213 sec 2024-03-28T08:05:42.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7542.922109 secs 2024-03-28T08:05:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7542.922109 secs 2024-03-28T08:05:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7542.922109 secs 2024-03-28T08:05:43.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8214 sec 2024-03-28T08:05:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:43 smithi055 ceph-mon[31863]: pgmap v4854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:43 smithi086 ceph-mon[35163]: pgmap v4854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:43 smithi159 ceph-mon[36109]: pgmap v4854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:44.249 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8215 sec 2024-03-28T08:05:45.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8216 sec 2024-03-28T08:05:45.874 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:45 smithi159 ceph-mon[36109]: pgmap v4855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:45 smithi055 ceph-mon[31863]: pgmap v4855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:45 smithi086 ceph-mon[35163]: pgmap v4855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:46.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8217 sec 2024-03-28T08:05:47.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8218 sec 2024-03-28T08:05:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7547.922231 secs 2024-03-28T08:05:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:47 smithi055 ceph-mon[31863]: pgmap v4856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7547.922231 secs 2024-03-28T08:05:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:47 smithi086 ceph-mon[35163]: pgmap v4856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7547.922231 secs 2024-03-28T08:05:48.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:47 smithi159 ceph-mon[36109]: pgmap v4856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:48.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8219 sec 2024-03-28T08:05:49.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8220 sec 2024-03-28T08:05:50.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8221 sec 2024-03-28T08:05:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:50 smithi055 ceph-mon[31863]: pgmap v4857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:50 smithi086 ceph-mon[35163]: pgmap v4857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:51.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:50 smithi159 ceph-mon[36109]: pgmap v4857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:51.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8222 sec 2024-03-28T08:05:52.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8223 sec 2024-03-28T08:05:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:52 smithi055 ceph-mon[31863]: pgmap v4858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:52.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7552.922317 secs 2024-03-28T08:05:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:52 smithi086 ceph-mon[35163]: pgmap v4858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7552.922317 secs 2024-03-28T08:05:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:52 smithi159 ceph-mon[36109]: pgmap v4858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7552.922317 secs 2024-03-28T08:05:53.250 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8224 sec 2024-03-28T08:05:54.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8225 sec 2024-03-28T08:05:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:54 smithi055 ceph-mon[31863]: pgmap v4859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:54 smithi086 ceph-mon[35163]: pgmap v4859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:54 smithi159 ceph-mon[36109]: pgmap v4859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:05:55.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8226 sec 2024-03-28T08:05:56.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8227 sec 2024-03-28T08:05:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:56 smithi055 ceph-mon[31863]: pgmap v4860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:56 smithi086 ceph-mon[35163]: pgmap v4860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:56 smithi159 ceph-mon[36109]: pgmap v4860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:05:57.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8228 sec 2024-03-28T08:05:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7557.922398 secs 2024-03-28T08:05:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7557.922398 secs 2024-03-28T08:05:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7557.922398 secs 2024-03-28T08:05:58.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8229 sec 2024-03-28T08:05:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:05:58 smithi086 ceph-mon[35163]: pgmap v4861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:05:58 smithi159 ceph-mon[36109]: pgmap v4861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:05:58 smithi055 ceph-mon[31863]: pgmap v4861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:05:59.251 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8230 sec 2024-03-28T08:06:00.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8231 sec 2024-03-28T08:06:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:00 smithi086 ceph-mon[35163]: pgmap v4862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:00 smithi159 ceph-mon[36109]: pgmap v4862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:00 smithi055 ceph-mon[31863]: pgmap v4862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:01.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8232 sec 2024-03-28T08:06:02.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8233 sec 2024-03-28T08:06:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:02 smithi086 ceph-mon[35163]: pgmap v4863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7562.922520 secs 2024-03-28T08:06:03.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:02 smithi159 ceph-mon[36109]: pgmap v4863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:03.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7562.922520 secs 2024-03-28T08:06:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:02 smithi055 ceph-mon[31863]: pgmap v4863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7562.922520 secs 2024-03-28T08:06:03.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8234 sec 2024-03-28T08:06:04.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8235 sec 2024-03-28T08:06:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:04 smithi086 ceph-mon[35163]: pgmap v4864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:04 smithi159 ceph-mon[36109]: pgmap v4864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:05.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:04 smithi055 ceph-mon[31863]: pgmap v4864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:05.252 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8236 sec 2024-03-28T08:06:06.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8237 sec 2024-03-28T08:06:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:06 smithi086 ceph-mon[35163]: pgmap v4865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:06 smithi159 ceph-mon[36109]: pgmap v4865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:06 smithi055 ceph-mon[31863]: pgmap v4865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:07.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8238 sec 2024-03-28T08:06:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7567.922588 secs 2024-03-28T08:06:08.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7567.922588 secs 2024-03-28T08:06:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7567.922588 secs 2024-03-28T08:06:08.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8239 sec 2024-03-28T08:06:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:08 smithi086 ceph-mon[35163]: pgmap v4866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:06:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:08 smithi159 ceph-mon[36109]: pgmap v4866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:06:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:08 smithi055 ceph-mon[31863]: pgmap v4866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:06:09.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8240 sec 2024-03-28T08:06:10.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8241 sec 2024-03-28T08:06:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:10 smithi086 ceph-mon[35163]: pgmap v4867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:10 smithi159 ceph-mon[36109]: pgmap v4867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:10 smithi055 ceph-mon[31863]: pgmap v4867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:11.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8242 sec 2024-03-28T08:06:12.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8243 sec 2024-03-28T08:06:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:12 smithi086 ceph-mon[35163]: pgmap v4868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7572.922711 secs 2024-03-28T08:06:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:12 smithi159 ceph-mon[36109]: pgmap v4868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:13.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7572.922711 secs 2024-03-28T08:06:13.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:12 smithi055 ceph-mon[31863]: pgmap v4868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:06:13.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7572.922711 secs 2024-03-28T08:06:13.253 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8244 sec 2024-03-28T08:06:14.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8245 sec 2024-03-28T08:06:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:14 smithi086 ceph-mon[35163]: pgmap v4869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:14 smithi159 ceph-mon[36109]: pgmap v4869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:14 smithi055 ceph-mon[31863]: pgmap v4869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:15.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8246 sec 2024-03-28T08:06:16.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8247 sec 2024-03-28T08:06:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:16 smithi086 ceph-mon[35163]: pgmap v4870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:17.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:16 smithi159 ceph-mon[36109]: pgmap v4870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:16 smithi055 ceph-mon[31863]: pgmap v4870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:17.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8248 sec 2024-03-28T08:06:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7577.922836 secs 2024-03-28T08:06:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7577.922836 secs 2024-03-28T08:06:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7577.922836 secs 2024-03-28T08:06:18.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8249 sec 2024-03-28T08:06:19.254 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8250 sec 2024-03-28T08:06:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:18 smithi086 ceph-mon[35163]: pgmap v4871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:19.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:18 smithi159 ceph-mon[36109]: pgmap v4871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:19.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:18 smithi055 ceph-mon[31863]: pgmap v4871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:20.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8251 sec 2024-03-28T08:06:21.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8252 sec 2024-03-28T08:06:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:20 smithi086 ceph-mon[35163]: pgmap v4872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:20 smithi159 ceph-mon[36109]: pgmap v4872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:20 smithi055 ceph-mon[31863]: pgmap v4872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:22.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8253 sec 2024-03-28T08:06:23.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8254 sec 2024-03-28T08:06:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:22 smithi086 ceph-mon[35163]: pgmap v4873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7582.922927 secs 2024-03-28T08:06:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:22 smithi159 ceph-mon[36109]: pgmap v4873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7582.922927 secs 2024-03-28T08:06:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:22 smithi055 ceph-mon[31863]: pgmap v4873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7582.922927 secs 2024-03-28T08:06:24.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8255 sec 2024-03-28T08:06:25.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8256 sec 2024-03-28T08:06:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:24 smithi086 ceph-mon[35163]: pgmap v4874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:24 smithi159 ceph-mon[36109]: pgmap v4874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:24 smithi055 ceph-mon[31863]: pgmap v4874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:26.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8257 sec 2024-03-28T08:06:27.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8258 sec 2024-03-28T08:06:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:26 smithi086 ceph-mon[35163]: pgmap v4875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:27.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:26 smithi159 ceph-mon[36109]: pgmap v4875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:26 smithi055 ceph-mon[31863]: pgmap v4875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:06:28.255 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8259 sec 2024-03-28T08:06:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7587.923047 secs 2024-03-28T08:06:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7587.923047 secs 2024-03-28T08:06:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7587.923047 secs 2024-03-28T08:06:29.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8260 sec 2024-03-28T08:06:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:28 smithi086 ceph-mon[35163]: pgmap v4876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:28 smithi159 ceph-mon[36109]: pgmap v4876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:28 smithi055 ceph-mon[31863]: pgmap v4876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:30.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8261 sec 2024-03-28T08:06:31.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8262 sec 2024-03-28T08:06:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:30 smithi086 ceph-mon[35163]: pgmap v4877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:06:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:30 smithi159 ceph-mon[36109]: pgmap v4877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:31.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:06:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:30 smithi055 ceph-mon[31863]: pgmap v4877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:31.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:06:32.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8263 sec 2024-03-28T08:06:33.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8264 sec 2024-03-28T08:06:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: pgmap v4878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: pgmap v4879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: pgmap v4880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7592.923122 secs 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: pgmap v4878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: pgmap v4879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: pgmap v4880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7592.923122 secs 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: pgmap v4878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: pgmap v4879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:06:33.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: pgmap v4880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:06:33.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7592.923122 secs 2024-03-28T08:06:34.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8265 sec 2024-03-28T08:06:35.256 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8266 sec 2024-03-28T08:06:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:35 smithi086 ceph-mon[35163]: pgmap v4881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:06:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:35 smithi159 ceph-mon[36109]: pgmap v4881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:06:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:35 smithi055 ceph-mon[31863]: pgmap v4881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:06:36.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8267 sec 2024-03-28T08:06:37.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8268 sec 2024-03-28T08:06:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:37 smithi086 ceph-mon[35163]: pgmap v4882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:37 smithi159 ceph-mon[36109]: pgmap v4882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:37 smithi055 ceph-mon[31863]: pgmap v4882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:38.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8269 sec 2024-03-28T08:06:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7597.923241 secs 2024-03-28T08:06:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7597.923241 secs 2024-03-28T08:06:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7597.923241 secs 2024-03-28T08:06:39.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8270 sec 2024-03-28T08:06:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:39 smithi086 ceph-mon[35163]: pgmap v4883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:39 smithi159 ceph-mon[36109]: pgmap v4883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:39 smithi055 ceph-mon[31863]: pgmap v4883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:06:40.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8271 sec 2024-03-28T08:06:41.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8272 sec 2024-03-28T08:06:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:41 smithi086 ceph-mon[35163]: pgmap v4884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:41 smithi159 ceph-mon[36109]: pgmap v4884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:41 smithi055 ceph-mon[31863]: pgmap v4884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:42.257 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8273 sec 2024-03-28T08:06:43.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8274 sec 2024-03-28T08:06:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:43 smithi086 ceph-mon[35163]: pgmap v4885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7602.923314 secs 2024-03-28T08:06:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:43 smithi159 ceph-mon[36109]: pgmap v4885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7602.923314 secs 2024-03-28T08:06:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:43 smithi055 ceph-mon[31863]: pgmap v4885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:06:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7602.923314 secs 2024-03-28T08:06:44.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8275 sec 2024-03-28T08:06:45.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8276 sec 2024-03-28T08:06:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:45 smithi086 ceph-mon[35163]: pgmap v4886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:45 smithi159 ceph-mon[36109]: pgmap v4886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:45 smithi055 ceph-mon[31863]: pgmap v4886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:46.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8277 sec 2024-03-28T08:06:47.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8278 sec 2024-03-28T08:06:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:47 smithi086 ceph-mon[35163]: pgmap v4887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:47 smithi159 ceph-mon[36109]: pgmap v4887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:47 smithi055 ceph-mon[31863]: pgmap v4887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:48.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8279 sec 2024-03-28T08:06:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7607.923434 secs 2024-03-28T08:06:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7607.923434 secs 2024-03-28T08:06:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7607.923434 secs 2024-03-28T08:06:49.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8280 sec 2024-03-28T08:06:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:49 smithi086 ceph-mon[35163]: pgmap v4888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:49 smithi159 ceph-mon[36109]: pgmap v4888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:49 smithi055 ceph-mon[31863]: pgmap v4888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:50.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8281 sec 2024-03-28T08:06:51.258 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8282 sec 2024-03-28T08:06:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:51 smithi086 ceph-mon[35163]: pgmap v4889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:51 smithi159 ceph-mon[36109]: pgmap v4889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:51.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:51 smithi055 ceph-mon[31863]: pgmap v4889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:06:52.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8283 sec 2024-03-28T08:06:53.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8284 sec 2024-03-28T08:06:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:53 smithi086 ceph-mon[35163]: pgmap v4890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7612.923555 secs 2024-03-28T08:06:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:53 smithi159 ceph-mon[36109]: pgmap v4890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7612.923555 secs 2024-03-28T08:06:53.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:53 smithi055 ceph-mon[31863]: pgmap v4890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:53.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7612.923555 secs 2024-03-28T08:06:54.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8285 sec 2024-03-28T08:06:55.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8286 sec 2024-03-28T08:06:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:55 smithi086 ceph-mon[35163]: pgmap v4891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:55.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:55 smithi159 ceph-mon[36109]: pgmap v4891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:55.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:55 smithi055 ceph-mon[31863]: pgmap v4891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:56.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8287 sec 2024-03-28T08:06:57.259 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8288 sec 2024-03-28T08:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:57 smithi086 ceph-mon[35163]: pgmap v4892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:57 smithi159 ceph-mon[36109]: pgmap v4892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:57 smithi055 ceph-mon[31863]: pgmap v4892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:58.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8289 sec 2024-03-28T08:06:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7617.923676 secs 2024-03-28T08:06:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7617.923676 secs 2024-03-28T08:06:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7617.923676 secs 2024-03-28T08:06:59.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8290 sec 2024-03-28T08:06:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:06:59 smithi086 ceph-mon[35163]: pgmap v4893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:06:59 smithi159 ceph-mon[36109]: pgmap v4893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:06:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:06:59 smithi055 ceph-mon[31863]: pgmap v4893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:00.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8291 sec 2024-03-28T08:07:01.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8292 sec 2024-03-28T08:07:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:01 smithi086 ceph-mon[35163]: pgmap v4894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:01.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:01 smithi159 ceph-mon[36109]: pgmap v4894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:01 smithi055 ceph-mon[31863]: pgmap v4894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:02.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8293 sec 2024-03-28T08:07:03.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8294 sec 2024-03-28T08:07:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:03 smithi055 ceph-mon[31863]: pgmap v4895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7622.923809 secs 2024-03-28T08:07:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:03 smithi086 ceph-mon[35163]: pgmap v4895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7622.923809 secs 2024-03-28T08:07:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:03 smithi159 ceph-mon[36109]: pgmap v4895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7622.923809 secs 2024-03-28T08:07:04.260 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8295 sec 2024-03-28T08:07:05.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8296 sec 2024-03-28T08:07:05.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:05 smithi086 ceph-mon[35163]: pgmap v4896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:05 smithi055 ceph-mon[31863]: pgmap v4896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:05.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:05 smithi159 ceph-mon[36109]: pgmap v4896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:06.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8297 sec 2024-03-28T08:07:07.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8298 sec 2024-03-28T08:07:07.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:07 smithi055 ceph-mon[31863]: pgmap v4897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:07 smithi086 ceph-mon[35163]: pgmap v4897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:07 smithi159 ceph-mon[36109]: pgmap v4897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:08.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8299 sec 2024-03-28T08:07:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7627.923888 secs 2024-03-28T08:07:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7627.923888 secs 2024-03-28T08:07:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7627.923888 secs 2024-03-28T08:07:09.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8300 sec 2024-03-28T08:07:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:09 smithi055 ceph-mon[31863]: pgmap v4898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:09 smithi086 ceph-mon[35163]: pgmap v4898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:09 smithi159 ceph-mon[36109]: pgmap v4898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:10.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8301 sec 2024-03-28T08:07:11.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8302 sec 2024-03-28T08:07:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:11 smithi055 ceph-mon[31863]: pgmap v4899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:11 smithi086 ceph-mon[35163]: pgmap v4899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:11 smithi159 ceph-mon[36109]: pgmap v4899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:12.261 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8303 sec 2024-03-28T08:07:13.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8304 sec 2024-03-28T08:07:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:13 smithi055 ceph-mon[31863]: pgmap v4900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7632.923951 secs 2024-03-28T08:07:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:13 smithi086 ceph-mon[35163]: pgmap v4900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7632.923951 secs 2024-03-28T08:07:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:13 smithi159 ceph-mon[36109]: pgmap v4900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7632.923951 secs 2024-03-28T08:07:14.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8305 sec 2024-03-28T08:07:15.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8306 sec 2024-03-28T08:07:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:15 smithi086 ceph-mon[35163]: pgmap v4901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:15 smithi159 ceph-mon[36109]: pgmap v4901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:15 smithi055 ceph-mon[31863]: pgmap v4901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:16.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8307 sec 2024-03-28T08:07:17.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8308 sec 2024-03-28T08:07:17.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:17 smithi055 ceph-mon[31863]: pgmap v4902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:17 smithi086 ceph-mon[35163]: pgmap v4902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:17 smithi159 ceph-mon[36109]: pgmap v4902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:18.262 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8309 sec 2024-03-28T08:07:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7637.924043 secs 2024-03-28T08:07:18.831 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7637.924043 secs 2024-03-28T08:07:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7637.924043 secs 2024-03-28T08:07:19.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8310 sec 2024-03-28T08:07:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:19 smithi086 ceph-mon[35163]: pgmap v4903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:19 smithi159 ceph-mon[36109]: pgmap v4903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:19 smithi055 ceph-mon[31863]: pgmap v4903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:20.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8311 sec 2024-03-28T08:07:21.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8312 sec 2024-03-28T08:07:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:21 smithi086 ceph-mon[35163]: pgmap v4904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:21 smithi159 ceph-mon[36109]: pgmap v4904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:21 smithi055 ceph-mon[31863]: pgmap v4904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:22.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8313 sec 2024-03-28T08:07:23.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8314 sec 2024-03-28T08:07:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:23 smithi086 ceph-mon[35163]: pgmap v4905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7642.924184 secs 2024-03-28T08:07:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:23 smithi159 ceph-mon[36109]: pgmap v4905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:23.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7642.924184 secs 2024-03-28T08:07:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:23 smithi055 ceph-mon[31863]: pgmap v4905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7642.924184 secs 2024-03-28T08:07:24.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8315 sec 2024-03-28T08:07:25.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8316 sec 2024-03-28T08:07:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:25 smithi086 ceph-mon[35163]: pgmap v4906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:25 smithi159 ceph-mon[36109]: pgmap v4906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:25 smithi055 ceph-mon[31863]: pgmap v4906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:26.263 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8317 sec 2024-03-28T08:07:27.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8318 sec 2024-03-28T08:07:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:27 smithi086 ceph-mon[35163]: pgmap v4907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:27 smithi159 ceph-mon[36109]: pgmap v4907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:27.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:27 smithi055 ceph-mon[31863]: pgmap v4907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:28.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8319 sec 2024-03-28T08:07:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7647.924307 secs 2024-03-28T08:07:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7647.924307 secs 2024-03-28T08:07:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7647.924307 secs 2024-03-28T08:07:29.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8320 sec 2024-03-28T08:07:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:29 smithi086 ceph-mon[35163]: pgmap v4908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:29 smithi159 ceph-mon[36109]: pgmap v4908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:29 smithi055 ceph-mon[31863]: pgmap v4908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:30.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8321 sec 2024-03-28T08:07:31.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8322 sec 2024-03-28T08:07:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:31 smithi086 ceph-mon[35163]: pgmap v4909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:31 smithi159 ceph-mon[36109]: pgmap v4909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:31 smithi055 ceph-mon[31863]: pgmap v4909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:32.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8323 sec 2024-03-28T08:07:33.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8324 sec 2024-03-28T08:07:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:33 smithi086 ceph-mon[35163]: pgmap v4910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7652.924405 secs 2024-03-28T08:07:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:07:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:33 smithi159 ceph-mon[36109]: pgmap v4910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7652.924405 secs 2024-03-28T08:07:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:07:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:33 smithi055 ceph-mon[31863]: pgmap v4910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7652.924405 secs 2024-03-28T08:07:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:07:34.264 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8325 sec 2024-03-28T08:07:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:07:34.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:07:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:07:34.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:07:35.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8326 sec 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: pgmap v4911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:35 smithi086 ceph-mon[35163]: pgmap v4912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: pgmap v4911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:35.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:35 smithi159 ceph-mon[36109]: pgmap v4912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: pgmap v4911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:35 smithi055 ceph-mon[31863]: pgmap v4912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:36.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8327 sec 2024-03-28T08:07:37.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8328 sec 2024-03-28T08:07:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:37 smithi086 ceph-mon[35163]: pgmap v4913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:37.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:37 smithi159 ceph-mon[36109]: pgmap v4913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:37 smithi055 ceph-mon[31863]: pgmap v4913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:07:38.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8329 sec 2024-03-28T08:07:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7657.924526 secs 2024-03-28T08:07:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7657.924526 secs 2024-03-28T08:07:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7657.924526 secs 2024-03-28T08:07:39.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8330 sec 2024-03-28T08:07:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:39 smithi086 ceph-mon[35163]: pgmap v4914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:39 smithi159 ceph-mon[36109]: pgmap v4914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:39 smithi055 ceph-mon[31863]: pgmap v4914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:40.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8331 sec 2024-03-28T08:07:41.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8332 sec 2024-03-28T08:07:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:41 smithi086 ceph-mon[35163]: pgmap v4915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:41 smithi159 ceph-mon[36109]: pgmap v4915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:41.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:41 smithi055 ceph-mon[31863]: pgmap v4915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:42.265 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8333 sec 2024-03-28T08:07:43.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8334 sec 2024-03-28T08:07:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:43 smithi086 ceph-mon[35163]: pgmap v4916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7662.924598 secs 2024-03-28T08:07:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:43 smithi159 ceph-mon[36109]: pgmap v4916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7662.924598 secs 2024-03-28T08:07:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:43 smithi055 ceph-mon[31863]: pgmap v4916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7662.924598 secs 2024-03-28T08:07:44.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8335 sec 2024-03-28T08:07:45.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8336 sec 2024-03-28T08:07:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:45 smithi086 ceph-mon[35163]: pgmap v4917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:45 smithi159 ceph-mon[36109]: pgmap v4917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:45 smithi055 ceph-mon[31863]: pgmap v4917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:07:46.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8337 sec 2024-03-28T08:07:47.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8338 sec 2024-03-28T08:07:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:47 smithi086 ceph-mon[35163]: pgmap v4918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:47 smithi159 ceph-mon[36109]: pgmap v4918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:47 smithi055 ceph-mon[31863]: pgmap v4918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:48.266 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8339 sec 2024-03-28T08:07:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7667.924680 secs 2024-03-28T08:07:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7667.924680 secs 2024-03-28T08:07:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7667.924680 secs 2024-03-28T08:07:49.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8340 sec 2024-03-28T08:07:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:49 smithi086 ceph-mon[35163]: pgmap v4919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:49 smithi159 ceph-mon[36109]: pgmap v4919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:49.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:49 smithi055 ceph-mon[31863]: pgmap v4919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:07:50.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8341 sec 2024-03-28T08:07:50.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:50 smithi055 ceph-mon[31863]: pgmap v4920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:50 smithi086 ceph-mon[35163]: pgmap v4920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:50 smithi159 ceph-mon[36109]: pgmap v4920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:07:51.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8342 sec 2024-03-28T08:07:52.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8343 sec 2024-03-28T08:07:53.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8344 sec 2024-03-28T08:07:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:53 smithi086 ceph-mon[35163]: pgmap v4921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7672.924804 secs 2024-03-28T08:07:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:53 smithi159 ceph-mon[36109]: pgmap v4921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7672.924804 secs 2024-03-28T08:07:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:53 smithi055 ceph-mon[31863]: pgmap v4921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7672.924804 secs 2024-03-28T08:07:54.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8345 sec 2024-03-28T08:07:55.267 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8346 sec 2024-03-28T08:07:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:55 smithi086 ceph-mon[35163]: pgmap v4922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:55 smithi159 ceph-mon[36109]: pgmap v4922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:55 smithi055 ceph-mon[31863]: pgmap v4922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:56.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8347 sec 2024-03-28T08:07:57.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8348 sec 2024-03-28T08:07:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:57 smithi086 ceph-mon[35163]: pgmap v4923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:57 smithi159 ceph-mon[36109]: pgmap v4923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:57 smithi055 ceph-mon[31863]: pgmap v4923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:58.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8349 sec 2024-03-28T08:07:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7677.924890 secs 2024-03-28T08:07:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7677.924890 secs 2024-03-28T08:07:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7677.924890 secs 2024-03-28T08:07:59.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8350 sec 2024-03-28T08:07:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:07:59 smithi055 ceph-mon[31863]: pgmap v4924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:07:59 smithi086 ceph-mon[35163]: pgmap v4924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:07:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:07:59 smithi159 ceph-mon[36109]: pgmap v4924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:00.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8351 sec 2024-03-28T08:08:01.268 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8352 sec 2024-03-28T08:08:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:01 smithi055 ceph-mon[31863]: pgmap v4925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:01 smithi086 ceph-mon[35163]: pgmap v4925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:01 smithi159 ceph-mon[36109]: pgmap v4925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:02.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8353 sec 2024-03-28T08:08:03.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8354 sec 2024-03-28T08:08:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:03 smithi055 ceph-mon[31863]: pgmap v4926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7682.924972 secs 2024-03-28T08:08:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:03 smithi086 ceph-mon[35163]: pgmap v4926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7682.924972 secs 2024-03-28T08:08:03.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:03 smithi159 ceph-mon[36109]: pgmap v4926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:03.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7682.924972 secs 2024-03-28T08:08:04.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8355 sec 2024-03-28T08:08:05.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8356 sec 2024-03-28T08:08:05.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:05 smithi086 ceph-mon[35163]: pgmap v4927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:05 smithi055 ceph-mon[31863]: pgmap v4927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:05 smithi159 ceph-mon[36109]: pgmap v4927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:06.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8357 sec 2024-03-28T08:08:07.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8358 sec 2024-03-28T08:08:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:07 smithi055 ceph-mon[31863]: pgmap v4928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:07 smithi086 ceph-mon[35163]: pgmap v4928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:07 smithi159 ceph-mon[36109]: pgmap v4928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:08.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8359 sec 2024-03-28T08:08:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7687.925058 secs 2024-03-28T08:08:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7687.925058 secs 2024-03-28T08:08:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7687.925058 secs 2024-03-28T08:08:09.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8360 sec 2024-03-28T08:08:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:09 smithi055 ceph-mon[31863]: pgmap v4929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:09 smithi086 ceph-mon[35163]: pgmap v4929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:09 smithi159 ceph-mon[36109]: pgmap v4929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:10.269 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8361 sec 2024-03-28T08:08:11.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8362 sec 2024-03-28T08:08:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:11 smithi086 ceph-mon[35163]: pgmap v4930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:11 smithi159 ceph-mon[36109]: pgmap v4930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:11 smithi055 ceph-mon[31863]: pgmap v4930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:12.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8363 sec 2024-03-28T08:08:13.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8364 sec 2024-03-28T08:08:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:13 smithi086 ceph-mon[35163]: pgmap v4931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7692.925143 secs 2024-03-28T08:08:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:13 smithi159 ceph-mon[36109]: pgmap v4931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:13.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7692.925143 secs 2024-03-28T08:08:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:13 smithi055 ceph-mon[31863]: pgmap v4931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7692.925143 secs 2024-03-28T08:08:14.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8365 sec 2024-03-28T08:08:15.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8366 sec 2024-03-28T08:08:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:15 smithi086 ceph-mon[35163]: pgmap v4932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:15 smithi159 ceph-mon[36109]: pgmap v4932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:15 smithi055 ceph-mon[31863]: pgmap v4932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:16.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8367 sec 2024-03-28T08:08:17.270 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8368 sec 2024-03-28T08:08:17.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:17 smithi055 ceph-mon[31863]: pgmap v4933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:17 smithi086 ceph-mon[35163]: pgmap v4933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:17 smithi159 ceph-mon[36109]: pgmap v4933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:18.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8369 sec 2024-03-28T08:08:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7697.925219 secs 2024-03-28T08:08:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7697.925219 secs 2024-03-28T08:08:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7697.925219 secs 2024-03-28T08:08:19.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8370 sec 2024-03-28T08:08:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:19 smithi086 ceph-mon[35163]: pgmap v4934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:19 smithi159 ceph-mon[36109]: pgmap v4934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:19 smithi055 ceph-mon[31863]: pgmap v4934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:20.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8371 sec 2024-03-28T08:08:21.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8372 sec 2024-03-28T08:08:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:21 smithi086 ceph-mon[35163]: pgmap v4935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:21 smithi159 ceph-mon[36109]: pgmap v4935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:21 smithi055 ceph-mon[31863]: pgmap v4935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:22.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8373 sec 2024-03-28T08:08:23.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8374 sec 2024-03-28T08:08:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:23 smithi086 ceph-mon[35163]: pgmap v4936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7702.925296 secs 2024-03-28T08:08:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:23 smithi159 ceph-mon[36109]: pgmap v4936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7702.925296 secs 2024-03-28T08:08:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:23 smithi055 ceph-mon[31863]: pgmap v4936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7702.925296 secs 2024-03-28T08:08:24.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8375 sec 2024-03-28T08:08:25.271 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8376 sec 2024-03-28T08:08:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:25 smithi086 ceph-mon[35163]: pgmap v4937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:25 smithi159 ceph-mon[36109]: pgmap v4937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:25 smithi055 ceph-mon[31863]: pgmap v4937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:26.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8377 sec 2024-03-28T08:08:27.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8378 sec 2024-03-28T08:08:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:27 smithi086 ceph-mon[35163]: pgmap v4938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:27 smithi159 ceph-mon[36109]: pgmap v4938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:27 smithi055 ceph-mon[31863]: pgmap v4938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:28.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8379 sec 2024-03-28T08:08:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7707.925381 secs 2024-03-28T08:08:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7707.925381 secs 2024-03-28T08:08:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7707.925381 secs 2024-03-28T08:08:29.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8380 sec 2024-03-28T08:08:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:29 smithi086 ceph-mon[35163]: pgmap v4939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:29 smithi159 ceph-mon[36109]: pgmap v4939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:29 smithi055 ceph-mon[31863]: pgmap v4939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:30.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8381 sec 2024-03-28T08:08:31.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8382 sec 2024-03-28T08:08:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:31 smithi086 ceph-mon[35163]: pgmap v4940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:31 smithi159 ceph-mon[36109]: pgmap v4940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:31 smithi055 ceph-mon[31863]: pgmap v4940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:32.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8383 sec 2024-03-28T08:08:33.272 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8384 sec 2024-03-28T08:08:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:33 smithi086 ceph-mon[35163]: pgmap v4941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7712.925446 secs 2024-03-28T08:08:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:33 smithi159 ceph-mon[36109]: pgmap v4941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7712.925446 secs 2024-03-28T08:08:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:33 smithi055 ceph-mon[31863]: pgmap v4941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7712.925446 secs 2024-03-28T08:08:34.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8385 sec 2024-03-28T08:08:35.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8386 sec 2024-03-28T08:08:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:35 smithi086 ceph-mon[35163]: pgmap v4942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:08:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:35 smithi159 ceph-mon[36109]: pgmap v4942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:08:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:35 smithi055 ceph-mon[31863]: pgmap v4942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:08:36.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8387 sec 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:08:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:08:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:08:36.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:08:37.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8388 sec 2024-03-28T08:08:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:37 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:08:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:37 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:08:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:37 smithi086 ceph-mon[35163]: pgmap v4943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:37 smithi086 ceph-mon[35163]: pgmap v4944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:37 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:08:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:37 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:08:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:37 smithi159 ceph-mon[36109]: pgmap v4943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:37 smithi159 ceph-mon[36109]: pgmap v4944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:37 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:08:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:37 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:08:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:37 smithi055 ceph-mon[31863]: pgmap v4943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:37 smithi055 ceph-mon[31863]: pgmap v4944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:38.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8389 sec 2024-03-28T08:08:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7717.925517 secs 2024-03-28T08:08:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7717.925517 secs 2024-03-28T08:08:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7717.925517 secs 2024-03-28T08:08:39.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8390 sec 2024-03-28T08:08:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:39 smithi086 ceph-mon[35163]: pgmap v4945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:08:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:39 smithi159 ceph-mon[36109]: pgmap v4945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:08:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:39 smithi055 ceph-mon[31863]: pgmap v4945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:08:40.273 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8391 sec 2024-03-28T08:08:41.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8392 sec 2024-03-28T08:08:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:41 smithi086 ceph-mon[35163]: pgmap v4946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:41 smithi159 ceph-mon[36109]: pgmap v4946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:41 smithi055 ceph-mon[31863]: pgmap v4946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:42.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8393 sec 2024-03-28T08:08:43.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8394 sec 2024-03-28T08:08:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:43 smithi086 ceph-mon[35163]: pgmap v4947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7722.925643 secs 2024-03-28T08:08:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:43 smithi159 ceph-mon[36109]: pgmap v4947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7722.925643 secs 2024-03-28T08:08:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:43 smithi055 ceph-mon[31863]: pgmap v4947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7722.925643 secs 2024-03-28T08:08:44.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8395 sec 2024-03-28T08:08:45.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8396 sec 2024-03-28T08:08:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:45 smithi086 ceph-mon[35163]: pgmap v4948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:45 smithi159 ceph-mon[36109]: pgmap v4948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:45 smithi055 ceph-mon[31863]: pgmap v4948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:08:46.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8397 sec 2024-03-28T08:08:47.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8398 sec 2024-03-28T08:08:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:47 smithi086 ceph-mon[35163]: pgmap v4949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:08:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:47 smithi159 ceph-mon[36109]: pgmap v4949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:08:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:47 smithi055 ceph-mon[31863]: pgmap v4949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:08:48.274 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8399 sec 2024-03-28T08:08:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7727.925721 secs 2024-03-28T08:08:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7727.925721 secs 2024-03-28T08:08:48.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7727.925721 secs 2024-03-28T08:08:49.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8400 sec 2024-03-28T08:08:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:49 smithi086 ceph-mon[35163]: pgmap v4950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:49 smithi159 ceph-mon[36109]: pgmap v4950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:49 smithi055 ceph-mon[31863]: pgmap v4950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:50.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8401 sec 2024-03-28T08:08:51.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8402 sec 2024-03-28T08:08:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:51 smithi086 ceph-mon[35163]: pgmap v4951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:51 smithi159 ceph-mon[36109]: pgmap v4951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:51 smithi055 ceph-mon[31863]: pgmap v4951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:52.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8403 sec 2024-03-28T08:08:53.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8404 sec 2024-03-28T08:08:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:53 smithi086 ceph-mon[35163]: pgmap v4952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7732.925848 secs 2024-03-28T08:08:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:53 smithi159 ceph-mon[36109]: pgmap v4952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7732.925848 secs 2024-03-28T08:08:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:53 smithi055 ceph-mon[31863]: pgmap v4952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7732.925848 secs 2024-03-28T08:08:54.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8405 sec 2024-03-28T08:08:55.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8406 sec 2024-03-28T08:08:55.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:55 smithi055 ceph-mon[31863]: pgmap v4953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:55 smithi086 ceph-mon[35163]: pgmap v4953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:55 smithi159 ceph-mon[36109]: pgmap v4953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:56.275 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8407 sec 2024-03-28T08:08:57.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8408 sec 2024-03-28T08:08:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:57 smithi055 ceph-mon[31863]: pgmap v4954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:57 smithi086 ceph-mon[35163]: pgmap v4954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:57 smithi159 ceph-mon[36109]: pgmap v4954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:08:58.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8409 sec 2024-03-28T08:08:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7737.925883 secs 2024-03-28T08:08:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7737.925883 secs 2024-03-28T08:08:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7737.925883 secs 2024-03-28T08:08:59.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8410 sec 2024-03-28T08:08:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:08:59 smithi055 ceph-mon[31863]: pgmap v4955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:08:59 smithi086 ceph-mon[35163]: pgmap v4955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:08:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:08:59 smithi159 ceph-mon[36109]: pgmap v4955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:00.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8411 sec 2024-03-28T08:09:01.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8412 sec 2024-03-28T08:09:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:01 smithi055 ceph-mon[31863]: pgmap v4956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:01 smithi086 ceph-mon[35163]: pgmap v4956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:01 smithi159 ceph-mon[36109]: pgmap v4956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:02.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8413 sec 2024-03-28T08:09:03.276 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8414 sec 2024-03-28T08:09:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:03 smithi055 ceph-mon[31863]: pgmap v4957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7742.925947 secs 2024-03-28T08:09:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:03 smithi086 ceph-mon[35163]: pgmap v4957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7742.925947 secs 2024-03-28T08:09:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:03 smithi159 ceph-mon[36109]: pgmap v4957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7742.925947 secs 2024-03-28T08:09:04.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8415 sec 2024-03-28T08:09:05.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8416 sec 2024-03-28T08:09:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:05 smithi086 ceph-mon[35163]: pgmap v4958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:05 smithi159 ceph-mon[36109]: pgmap v4958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:05 smithi055 ceph-mon[31863]: pgmap v4958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:06.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8417 sec 2024-03-28T08:09:07.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8418 sec 2024-03-28T08:09:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:07 smithi086 ceph-mon[35163]: pgmap v4959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:07 smithi159 ceph-mon[36109]: pgmap v4959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:07 smithi055 ceph-mon[31863]: pgmap v4959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:08.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8419 sec 2024-03-28T08:09:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7747.926015 secs 2024-03-28T08:09:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7747.926015 secs 2024-03-28T08:09:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7747.926015 secs 2024-03-28T08:09:09.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8420 sec 2024-03-28T08:09:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:09 smithi086 ceph-mon[35163]: pgmap v4960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:09 smithi159 ceph-mon[36109]: pgmap v4960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:09 smithi055 ceph-mon[31863]: pgmap v4960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:10.277 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8421 sec 2024-03-28T08:09:11.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8422 sec 2024-03-28T08:09:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:11 smithi086 ceph-mon[35163]: pgmap v4961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:11 smithi159 ceph-mon[36109]: pgmap v4961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:11 smithi055 ceph-mon[31863]: pgmap v4961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:12.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8423 sec 2024-03-28T08:09:13.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8424 sec 2024-03-28T08:09:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:13 smithi086 ceph-mon[35163]: pgmap v4962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7752.926138 secs 2024-03-28T08:09:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:13 smithi159 ceph-mon[36109]: pgmap v4962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7752.926138 secs 2024-03-28T08:09:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:13 smithi055 ceph-mon[31863]: pgmap v4962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7752.926138 secs 2024-03-28T08:09:14.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8425 sec 2024-03-28T08:09:15.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8426 sec 2024-03-28T08:09:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:15 smithi086 ceph-mon[35163]: pgmap v4963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:15 smithi159 ceph-mon[36109]: pgmap v4963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:15 smithi055 ceph-mon[31863]: pgmap v4963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:16.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8427 sec 2024-03-28T08:09:17.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8428 sec 2024-03-28T08:09:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:17 smithi086 ceph-mon[35163]: pgmap v4964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:17 smithi159 ceph-mon[36109]: pgmap v4964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:17 smithi055 ceph-mon[31863]: pgmap v4964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:18.278 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8429 sec 2024-03-28T08:09:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7757.926221 secs 2024-03-28T08:09:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7757.926221 secs 2024-03-28T08:09:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7757.926221 secs 2024-03-28T08:09:19.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8430 sec 2024-03-28T08:09:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:19 smithi086 ceph-mon[35163]: pgmap v4965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:19 smithi159 ceph-mon[36109]: pgmap v4965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:19 smithi055 ceph-mon[31863]: pgmap v4965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:20.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8431 sec 2024-03-28T08:09:21.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8432 sec 2024-03-28T08:09:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:21 smithi086 ceph-mon[35163]: pgmap v4966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:21 smithi159 ceph-mon[36109]: pgmap v4966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:21 smithi055 ceph-mon[31863]: pgmap v4966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:22.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8433 sec 2024-03-28T08:09:23.279 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8434 sec 2024-03-28T08:09:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:23 smithi086 ceph-mon[35163]: pgmap v4967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7762.926345 secs 2024-03-28T08:09:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:23 smithi159 ceph-mon[36109]: pgmap v4967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7762.926345 secs 2024-03-28T08:09:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:23 smithi055 ceph-mon[31863]: pgmap v4967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7762.926345 secs 2024-03-28T08:09:24.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8435 sec 2024-03-28T08:09:25.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8436 sec 2024-03-28T08:09:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:25 smithi086 ceph-mon[35163]: pgmap v4968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:25 smithi159 ceph-mon[36109]: pgmap v4968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:25 smithi055 ceph-mon[31863]: pgmap v4968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:26.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8437 sec 2024-03-28T08:09:27.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8438 sec 2024-03-28T08:09:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:27 smithi086 ceph-mon[35163]: pgmap v4969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:27 smithi159 ceph-mon[36109]: pgmap v4969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:27 smithi055 ceph-mon[31863]: pgmap v4969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:28.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8439 sec 2024-03-28T08:09:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7767.926468 secs 2024-03-28T08:09:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7767.926468 secs 2024-03-28T08:09:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7767.926468 secs 2024-03-28T08:09:29.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8440 sec 2024-03-28T08:09:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:29 smithi086 ceph-mon[35163]: pgmap v4970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:29 smithi159 ceph-mon[36109]: pgmap v4970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:29 smithi055 ceph-mon[31863]: pgmap v4970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:30.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8441 sec 2024-03-28T08:09:31.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8442 sec 2024-03-28T08:09:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:31 smithi086 ceph-mon[35163]: pgmap v4971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:31 smithi159 ceph-mon[36109]: pgmap v4971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:31 smithi055 ceph-mon[31863]: pgmap v4971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:32.280 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8443 sec 2024-03-28T08:09:33.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8444 sec 2024-03-28T08:09:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:33 smithi086 ceph-mon[35163]: pgmap v4972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7772.926594 secs 2024-03-28T08:09:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:33 smithi159 ceph-mon[36109]: pgmap v4972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7772.926594 secs 2024-03-28T08:09:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:33 smithi055 ceph-mon[31863]: pgmap v4972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7772.926594 secs 2024-03-28T08:09:34.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8445 sec 2024-03-28T08:09:35.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8446 sec 2024-03-28T08:09:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:35 smithi086 ceph-mon[35163]: pgmap v4973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:35 smithi159 ceph-mon[36109]: pgmap v4973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:35 smithi055 ceph-mon[31863]: pgmap v4973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:36.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8447 sec 2024-03-28T08:09:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:09:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:09:36.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:09:37.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8448 sec 2024-03-28T08:09:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:37 smithi086 ceph-mon[35163]: pgmap v4974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:37 smithi159 ceph-mon[36109]: pgmap v4974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:37 smithi055 ceph-mon[31863]: pgmap v4974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:38.281 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8449 sec 2024-03-28T08:09:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7777.926720 secs 2024-03-28T08:09:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:09:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:09:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:09:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7777.926720 secs 2024-03-28T08:09:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:09:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:09:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:09:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7777.926720 secs 2024-03-28T08:09:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:09:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:09:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:09:39.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8450 sec 2024-03-28T08:09:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:39 smithi086 ceph-mon[35163]: pgmap v4975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:39 smithi086 ceph-mon[35163]: pgmap v4976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:39 smithi159 ceph-mon[36109]: pgmap v4975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:39 smithi159 ceph-mon[36109]: pgmap v4976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:39 smithi055 ceph-mon[31863]: pgmap v4975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:39 smithi055 ceph-mon[31863]: pgmap v4976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:40.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8451 sec 2024-03-28T08:09:41.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8452 sec 2024-03-28T08:09:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:41 smithi086 ceph-mon[35163]: pgmap v4977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:41 smithi159 ceph-mon[36109]: pgmap v4977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:41 smithi055 ceph-mon[31863]: pgmap v4977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:42.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8453 sec 2024-03-28T08:09:43.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8454 sec 2024-03-28T08:09:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:43 smithi086 ceph-mon[35163]: pgmap v4978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7782.926805 secs 2024-03-28T08:09:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:43 smithi159 ceph-mon[36109]: pgmap v4978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7782.926805 secs 2024-03-28T08:09:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:43 smithi055 ceph-mon[31863]: pgmap v4978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7782.926805 secs 2024-03-28T08:09:44.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8455 sec 2024-03-28T08:09:45.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8456 sec 2024-03-28T08:09:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:45 smithi055 ceph-mon[31863]: pgmap v4979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:45 smithi086 ceph-mon[35163]: pgmap v4979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:45 smithi159 ceph-mon[36109]: pgmap v4979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:09:46.282 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8457 sec 2024-03-28T08:09:47.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8458 sec 2024-03-28T08:09:47.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:47 smithi159 ceph-mon[36109]: pgmap v4980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:47 smithi055 ceph-mon[31863]: pgmap v4980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:47 smithi086 ceph-mon[35163]: pgmap v4980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:48.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8459 sec 2024-03-28T08:09:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7787.926930 secs 2024-03-28T08:09:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7787.926930 secs 2024-03-28T08:09:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7787.926930 secs 2024-03-28T08:09:49.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8460 sec 2024-03-28T08:09:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:49 smithi055 ceph-mon[31863]: pgmap v4981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:49 smithi086 ceph-mon[35163]: pgmap v4981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:49 smithi159 ceph-mon[36109]: pgmap v4981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:09:50.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8461 sec 2024-03-28T08:09:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:50 smithi055 ceph-mon[31863]: pgmap v4982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:50 smithi086 ceph-mon[35163]: pgmap v4982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:50 smithi159 ceph-mon[36109]: pgmap v4982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:51.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8462 sec 2024-03-28T08:09:52.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8463 sec 2024-03-28T08:09:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:52 smithi086 ceph-mon[35163]: pgmap v4983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7792.927047 secs 2024-03-28T08:09:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:52 smithi159 ceph-mon[36109]: pgmap v4983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7792.927047 secs 2024-03-28T08:09:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:52 smithi055 ceph-mon[31863]: pgmap v4983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7792.927047 secs 2024-03-28T08:09:53.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8464 sec 2024-03-28T08:09:54.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8465 sec 2024-03-28T08:09:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:54 smithi086 ceph-mon[35163]: pgmap v4984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:54 smithi159 ceph-mon[36109]: pgmap v4984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:54 smithi055 ceph-mon[31863]: pgmap v4984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:09:55.283 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8466 sec 2024-03-28T08:09:56.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8467 sec 2024-03-28T08:09:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:56 smithi086 ceph-mon[35163]: pgmap v4985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:09:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:56 smithi159 ceph-mon[36109]: pgmap v4985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:09:57.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:56 smithi055 ceph-mon[31863]: pgmap v4985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:09:57.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8468 sec 2024-03-28T08:09:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7797.927166 secs 2024-03-28T08:09:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7797.927166 secs 2024-03-28T08:09:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7797.927166 secs 2024-03-28T08:09:58.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8469 sec 2024-03-28T08:09:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:09:58 smithi086 ceph-mon[35163]: pgmap v4986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:09:58 smithi159 ceph-mon[36109]: pgmap v4986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:09:58 smithi055 ceph-mon[31863]: pgmap v4986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:09:59.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8470 sec 2024-03-28T08:10:00.284 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8471 sec 2024-03-28T08:10:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:00 smithi086 ceph-mon[35163]: pgmap v4987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:10:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:00 smithi159 ceph-mon[36109]: pgmap v4987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:10:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:00 smithi055 ceph-mon[31863]: pgmap v4987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:10:01.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8472 sec 2024-03-28T08:10:02.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8473 sec 2024-03-28T08:10:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:02 smithi086 ceph-mon[35163]: pgmap v4988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7802.927251 secs 2024-03-28T08:10:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:02 smithi159 ceph-mon[36109]: pgmap v4988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7802.927251 secs 2024-03-28T08:10:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:02 smithi055 ceph-mon[31863]: pgmap v4988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7802.927251 secs 2024-03-28T08:10:03.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8474 sec 2024-03-28T08:10:04.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8475 sec 2024-03-28T08:10:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:04 smithi086 ceph-mon[35163]: pgmap v4989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:05.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:04 smithi159 ceph-mon[36109]: pgmap v4989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:04 smithi055 ceph-mon[31863]: pgmap v4989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:05.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8476 sec 2024-03-28T08:10:06.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8477 sec 2024-03-28T08:10:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:06 smithi086 ceph-mon[35163]: pgmap v4990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:06 smithi159 ceph-mon[36109]: pgmap v4990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:06 smithi055 ceph-mon[31863]: pgmap v4990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:07.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8478 sec 2024-03-28T08:10:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7807.927340 secs 2024-03-28T08:10:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7807.927340 secs 2024-03-28T08:10:08.285 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8479 sec 2024-03-28T08:10:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7807.927340 secs 2024-03-28T08:10:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:08 smithi055 ceph-mon[31863]: pgmap v4991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:10:09.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8480 sec 2024-03-28T08:10:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:08 smithi086 ceph-mon[35163]: pgmap v4991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:10:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:08 smithi159 ceph-mon[36109]: pgmap v4991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:10:10.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8481 sec 2024-03-28T08:10:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:10 smithi055 ceph-mon[31863]: pgmap v4992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:11.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8482 sec 2024-03-28T08:10:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:10 smithi086 ceph-mon[35163]: pgmap v4992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:10 smithi159 ceph-mon[36109]: pgmap v4992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:12.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8483 sec 2024-03-28T08:10:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:12 smithi055 ceph-mon[31863]: pgmap v4993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7812.927461 secs 2024-03-28T08:10:13.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8484 sec 2024-03-28T08:10:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:12 smithi086 ceph-mon[35163]: pgmap v4993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7812.927461 secs 2024-03-28T08:10:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:12 smithi159 ceph-mon[36109]: pgmap v4993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:10:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7812.927461 secs 2024-03-28T08:10:14.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8485 sec 2024-03-28T08:10:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:14 smithi055 ceph-mon[31863]: pgmap v4994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:15.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8486 sec 2024-03-28T08:10:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:14 smithi086 ceph-mon[35163]: pgmap v4994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:14 smithi159 ceph-mon[36109]: pgmap v4994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:16.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8487 sec 2024-03-28T08:10:17.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:16 smithi159 ceph-mon[36109]: pgmap v4995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:16 smithi055 ceph-mon[31863]: pgmap v4995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:17.286 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8488 sec 2024-03-28T08:10:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:16 smithi086 ceph-mon[35163]: pgmap v4995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7817.927592 secs 2024-03-28T08:10:18.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8489 sec 2024-03-28T08:10:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7817.927592 secs 2024-03-28T08:10:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7817.927592 secs 2024-03-28T08:10:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:18 smithi055 ceph-mon[31863]: pgmap v4996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:19.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8490 sec 2024-03-28T08:10:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:18 smithi086 ceph-mon[35163]: pgmap v4996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:18 smithi159 ceph-mon[36109]: pgmap v4996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:20.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8491 sec 2024-03-28T08:10:21.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8492 sec 2024-03-28T08:10:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:20 smithi086 ceph-mon[35163]: pgmap v4997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:20 smithi159 ceph-mon[36109]: pgmap v4997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:20 smithi055 ceph-mon[31863]: pgmap v4997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:22.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8493 sec 2024-03-28T08:10:23.287 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8494 sec 2024-03-28T08:10:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:22 smithi086 ceph-mon[35163]: pgmap v4998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7822.927666 secs 2024-03-28T08:10:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:22 smithi159 ceph-mon[36109]: pgmap v4998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7822.927666 secs 2024-03-28T08:10:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:22 smithi055 ceph-mon[31863]: pgmap v4998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7822.927666 secs 2024-03-28T08:10:24.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8495 sec 2024-03-28T08:10:25.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8496 sec 2024-03-28T08:10:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:24 smithi086 ceph-mon[35163]: pgmap v4999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:24 smithi159 ceph-mon[36109]: pgmap v4999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:24 smithi055 ceph-mon[31863]: pgmap v4999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:26.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8497 sec 2024-03-28T08:10:27.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8498 sec 2024-03-28T08:10:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:26 smithi086 ceph-mon[35163]: pgmap v5000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:26 smithi159 ceph-mon[36109]: pgmap v5000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:26 smithi055 ceph-mon[31863]: pgmap v5000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:28.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8499 sec 2024-03-28T08:10:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7827.927749 secs 2024-03-28T08:10:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7827.927749 secs 2024-03-28T08:10:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7827.927749 secs 2024-03-28T08:10:29.288 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8500 sec 2024-03-28T08:10:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:28 smithi086 ceph-mon[35163]: pgmap v5001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:28 smithi159 ceph-mon[36109]: pgmap v5001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:28 smithi055 ceph-mon[31863]: pgmap v5001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:30.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8501 sec 2024-03-28T08:10:31.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8502 sec 2024-03-28T08:10:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:30 smithi086 ceph-mon[35163]: pgmap v5002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:30 smithi159 ceph-mon[36109]: pgmap v5002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:30 smithi055 ceph-mon[31863]: pgmap v5002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:32.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8503 sec 2024-03-28T08:10:33.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8504 sec 2024-03-28T08:10:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:32 smithi086 ceph-mon[35163]: pgmap v5003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7832.927841 secs 2024-03-28T08:10:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:32 smithi159 ceph-mon[36109]: pgmap v5003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7832.927841 secs 2024-03-28T08:10:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:32 smithi055 ceph-mon[31863]: pgmap v5003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7832.927841 secs 2024-03-28T08:10:34.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8505 sec 2024-03-28T08:10:35.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8506 sec 2024-03-28T08:10:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:34 smithi086 ceph-mon[35163]: pgmap v5004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:34 smithi159 ceph-mon[36109]: pgmap v5004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:34 smithi055 ceph-mon[31863]: pgmap v5004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:36.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8507 sec 2024-03-28T08:10:37.289 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8508 sec 2024-03-28T08:10:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:36 smithi086 ceph-mon[35163]: pgmap v5005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:37.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:36 smithi159 ceph-mon[36109]: pgmap v5005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:36 smithi055 ceph-mon[31863]: pgmap v5005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:38.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8509 sec 2024-03-28T08:10:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7837.927963 secs 2024-03-28T08:10:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7837.927963 secs 2024-03-28T08:10:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7837.927963 secs 2024-03-28T08:10:39.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8510 sec 2024-03-28T08:10:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:38 smithi086 ceph-mon[35163]: pgmap v5006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:10:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:38 smithi159 ceph-mon[36109]: pgmap v5006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:10:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:39.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:38 smithi055 ceph-mon[31863]: pgmap v5006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:10:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8511 sec 2024-03-28T08:10:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:40.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:41.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8512 sec 2024-03-28T08:10:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: pgmap v5007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:10:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:10:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: pgmap v5008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: pgmap v5009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: pgmap v5007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:10:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:10:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: pgmap v5008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: pgmap v5009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: pgmap v5007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:10:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:10:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: pgmap v5008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: pgmap v5009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:41.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:10:42.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8513 sec 2024-03-28T08:10:43.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8514 sec 2024-03-28T08:10:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:43 smithi086 ceph-mon[35163]: pgmap v5010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7842.928085 secs 2024-03-28T08:10:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:43 smithi159 ceph-mon[36109]: pgmap v5010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7842.928085 secs 2024-03-28T08:10:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:43 smithi055 ceph-mon[31863]: pgmap v5010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7842.928085 secs 2024-03-28T08:10:44.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8515 sec 2024-03-28T08:10:45.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8516 sec 2024-03-28T08:10:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:45 smithi086 ceph-mon[35163]: pgmap v5011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:45 smithi159 ceph-mon[36109]: pgmap v5011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:45 smithi055 ceph-mon[31863]: pgmap v5011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:46.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8517 sec 2024-03-28T08:10:47.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8518 sec 2024-03-28T08:10:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:47 smithi086 ceph-mon[35163]: pgmap v5012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:47 smithi159 ceph-mon[36109]: pgmap v5012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:47 smithi055 ceph-mon[31863]: pgmap v5012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:48.290 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8519 sec 2024-03-28T08:10:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7847.928208 secs 2024-03-28T08:10:48.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7847.928208 secs 2024-03-28T08:10:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7847.928208 secs 2024-03-28T08:10:49.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8520 sec 2024-03-28T08:10:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:49 smithi159 ceph-mon[36109]: pgmap v5013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:49 smithi086 ceph-mon[35163]: pgmap v5013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:49 smithi055 ceph-mon[31863]: pgmap v5013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:10:50.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8521 sec 2024-03-28T08:10:51.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8522 sec 2024-03-28T08:10:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:51 smithi086 ceph-mon[35163]: pgmap v5014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:51 smithi159 ceph-mon[36109]: pgmap v5014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:51 smithi055 ceph-mon[31863]: pgmap v5014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:10:52.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8523 sec 2024-03-28T08:10:53.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8524 sec 2024-03-28T08:10:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:53 smithi086 ceph-mon[35163]: pgmap v5015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7852.928328 secs 2024-03-28T08:10:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:53 smithi159 ceph-mon[36109]: pgmap v5015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7852.928328 secs 2024-03-28T08:10:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:53 smithi055 ceph-mon[31863]: pgmap v5015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:10:53.879 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7852.928328 secs 2024-03-28T08:10:54.291 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8525 sec 2024-03-28T08:10:55.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8526 sec 2024-03-28T08:10:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:55 smithi086 ceph-mon[35163]: pgmap v5016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:55 smithi159 ceph-mon[36109]: pgmap v5016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:55 smithi055 ceph-mon[31863]: pgmap v5016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:56.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8527 sec 2024-03-28T08:10:57.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8528 sec 2024-03-28T08:10:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:57 smithi086 ceph-mon[35163]: pgmap v5017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:57 smithi159 ceph-mon[36109]: pgmap v5017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:57 smithi055 ceph-mon[31863]: pgmap v5017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:58.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8529 sec 2024-03-28T08:10:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7857.928418 secs 2024-03-28T08:10:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7857.928418 secs 2024-03-28T08:10:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7857.928418 secs 2024-03-28T08:10:59.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8530 sec 2024-03-28T08:10:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:10:59 smithi086 ceph-mon[35163]: pgmap v5018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:10:59 smithi159 ceph-mon[36109]: pgmap v5018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:10:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:10:59 smithi055 ceph-mon[31863]: pgmap v5018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:00.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8531 sec 2024-03-28T08:11:01.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8532 sec 2024-03-28T08:11:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:01 smithi086 ceph-mon[35163]: pgmap v5019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:01 smithi159 ceph-mon[36109]: pgmap v5019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:01 smithi055 ceph-mon[31863]: pgmap v5019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:02.292 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8533 sec 2024-03-28T08:11:03.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8534 sec 2024-03-28T08:11:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:03 smithi086 ceph-mon[35163]: pgmap v5020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7862.928540 secs 2024-03-28T08:11:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:03 smithi159 ceph-mon[36109]: pgmap v5020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7862.928540 secs 2024-03-28T08:11:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:03 smithi055 ceph-mon[31863]: pgmap v5020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7862.928540 secs 2024-03-28T08:11:04.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8535 sec 2024-03-28T08:11:05.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8536 sec 2024-03-28T08:11:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:05 smithi086 ceph-mon[35163]: pgmap v5021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:05 smithi159 ceph-mon[36109]: pgmap v5021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:05 smithi055 ceph-mon[31863]: pgmap v5021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:06.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8537 sec 2024-03-28T08:11:07.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8538 sec 2024-03-28T08:11:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:07 smithi086 ceph-mon[35163]: pgmap v5022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:07 smithi159 ceph-mon[36109]: pgmap v5022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:07 smithi055 ceph-mon[31863]: pgmap v5022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:08.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8539 sec 2024-03-28T08:11:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7867.928597 secs 2024-03-28T08:11:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7867.928597 secs 2024-03-28T08:11:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7867.928597 secs 2024-03-28T08:11:09.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8540 sec 2024-03-28T08:11:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:09 smithi086 ceph-mon[35163]: pgmap v5023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:09 smithi159 ceph-mon[36109]: pgmap v5023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:09 smithi055 ceph-mon[31863]: pgmap v5023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:10.293 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8541 sec 2024-03-28T08:11:11.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8542 sec 2024-03-28T08:11:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:11 smithi086 ceph-mon[35163]: pgmap v5024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:11 smithi159 ceph-mon[36109]: pgmap v5024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:11 smithi055 ceph-mon[31863]: pgmap v5024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:12.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8543 sec 2024-03-28T08:11:13.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8544 sec 2024-03-28T08:11:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:13 smithi086 ceph-mon[35163]: pgmap v5025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7872.928688 secs 2024-03-28T08:11:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:13 smithi159 ceph-mon[36109]: pgmap v5025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7872.928688 secs 2024-03-28T08:11:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:13 smithi055 ceph-mon[31863]: pgmap v5025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7872.928688 secs 2024-03-28T08:11:14.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8545 sec 2024-03-28T08:11:15.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8546 sec 2024-03-28T08:11:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:15 smithi086 ceph-mon[35163]: pgmap v5026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:15 smithi159 ceph-mon[36109]: pgmap v5026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:15 smithi055 ceph-mon[31863]: pgmap v5026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:16.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8547 sec 2024-03-28T08:11:17.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8548 sec 2024-03-28T08:11:17.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:17 smithi055 ceph-mon[31863]: pgmap v5027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:17 smithi086 ceph-mon[35163]: pgmap v5027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:17 smithi159 ceph-mon[36109]: pgmap v5027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:18.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8549 sec 2024-03-28T08:11:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7877.928840 secs 2024-03-28T08:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7877.928840 secs 2024-03-28T08:11:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7877.928840 secs 2024-03-28T08:11:19.294 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8550 sec 2024-03-28T08:11:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:19 smithi055 ceph-mon[31863]: pgmap v5028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:19 smithi086 ceph-mon[35163]: pgmap v5028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:19 smithi159 ceph-mon[36109]: pgmap v5028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:20.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8551 sec 2024-03-28T08:11:21.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8552 sec 2024-03-28T08:11:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:21 smithi055 ceph-mon[31863]: pgmap v5029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:21 smithi086 ceph-mon[35163]: pgmap v5029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:21 smithi159 ceph-mon[36109]: pgmap v5029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:22.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8553 sec 2024-03-28T08:11:23.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8554 sec 2024-03-28T08:11:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:23 smithi055 ceph-mon[31863]: pgmap v5030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7882.928922 secs 2024-03-28T08:11:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:23 smithi086 ceph-mon[35163]: pgmap v5030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7882.928922 secs 2024-03-28T08:11:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:23 smithi159 ceph-mon[36109]: pgmap v5030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7882.928922 secs 2024-03-28T08:11:24.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8555 sec 2024-03-28T08:11:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:24 smithi086 ceph-mon[35163]: pgmap v5031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:24 smithi159 ceph-mon[36109]: pgmap v5031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:24 smithi055 ceph-mon[31863]: pgmap v5031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:25.295 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8556 sec 2024-03-28T08:11:26.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8557 sec 2024-03-28T08:11:27.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8558 sec 2024-03-28T08:11:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:27 smithi086 ceph-mon[35163]: pgmap v5032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:27 smithi159 ceph-mon[36109]: pgmap v5032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:27 smithi055 ceph-mon[31863]: pgmap v5032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:28.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8559 sec 2024-03-28T08:11:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7887.929005 secs 2024-03-28T08:11:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7887.929005 secs 2024-03-28T08:11:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7887.929005 secs 2024-03-28T08:11:29.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8560 sec 2024-03-28T08:11:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:29 smithi086 ceph-mon[35163]: pgmap v5033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:29 smithi159 ceph-mon[36109]: pgmap v5033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:29 smithi055 ceph-mon[31863]: pgmap v5033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:30.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8561 sec 2024-03-28T08:11:31.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8562 sec 2024-03-28T08:11:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:31 smithi086 ceph-mon[35163]: pgmap v5034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:31 smithi159 ceph-mon[36109]: pgmap v5034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:31 smithi055 ceph-mon[31863]: pgmap v5034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:32.296 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8563 sec 2024-03-28T08:11:33.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8564 sec 2024-03-28T08:11:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:33 smithi086 ceph-mon[35163]: pgmap v5035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7892.929047 secs 2024-03-28T08:11:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:33 smithi159 ceph-mon[36109]: pgmap v5035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7892.929047 secs 2024-03-28T08:11:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:33 smithi055 ceph-mon[31863]: pgmap v5035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7892.929047 secs 2024-03-28T08:11:34.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8565 sec 2024-03-28T08:11:35.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8566 sec 2024-03-28T08:11:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:35 smithi086 ceph-mon[35163]: pgmap v5036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:35 smithi159 ceph-mon[36109]: pgmap v5036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:35 smithi055 ceph-mon[31863]: pgmap v5036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:36.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8567 sec 2024-03-28T08:11:37.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8568 sec 2024-03-28T08:11:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:37 smithi086 ceph-mon[35163]: pgmap v5037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:37 smithi159 ceph-mon[36109]: pgmap v5037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:37 smithi055 ceph-mon[31863]: pgmap v5037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:38.297 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8569 sec 2024-03-28T08:11:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7897.929183 secs 2024-03-28T08:11:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7897.929183 secs 2024-03-28T08:11:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7897.929183 secs 2024-03-28T08:11:39.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8570 sec 2024-03-28T08:11:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:39 smithi086 ceph-mon[35163]: pgmap v5038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:39 smithi159 ceph-mon[36109]: pgmap v5038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:39 smithi055 ceph-mon[31863]: pgmap v5038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:40.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8571 sec 2024-03-28T08:11:41.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8572 sec 2024-03-28T08:11:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:41 smithi086 ceph-mon[35163]: pgmap v5039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:11:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:41 smithi159 ceph-mon[36109]: pgmap v5039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:11:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:41 smithi055 ceph-mon[31863]: pgmap v5039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:11:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:11:42.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8573 sec 2024-03-28T08:11:42.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:42.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:42.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:42 smithi159 ceph-mon[36109]: pgmap v5040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:42.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7902.929210 secs 2024-03-28T08:11:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:42 smithi086 ceph-mon[35163]: pgmap v5040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7902.929210 secs 2024-03-28T08:11:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:42 smithi055 ceph-mon[31863]: pgmap v5040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:11:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7902.929210 secs 2024-03-28T08:11:43.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8574 sec 2024-03-28T08:11:44.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8575 sec 2024-03-28T08:11:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:44 smithi086 ceph-mon[35163]: pgmap v5041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:44 smithi159 ceph-mon[36109]: pgmap v5041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:44 smithi055 ceph-mon[31863]: pgmap v5041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:45.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8576 sec 2024-03-28T08:11:46.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8577 sec 2024-03-28T08:11:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:46.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:47.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8578 sec 2024-03-28T08:11:47.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:47 smithi159 ceph-mon[36109]: pgmap v5042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:47.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:11:47.724 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:11:47.724 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:47 smithi086 ceph-mon[35163]: pgmap v5042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:11:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:11:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:47 smithi055 ceph-mon[31863]: pgmap v5042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:11:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:11:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:11:47.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:11:48.298 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8579 sec 2024-03-28T08:11:48.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:48 smithi055 ceph-mon[31863]: pgmap v5043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:11:48.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:48 smithi055 ceph-mon[31863]: pgmap v5044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:48.776 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7907.929294 secs 2024-03-28T08:11:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:48 smithi086 ceph-mon[35163]: pgmap v5043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:11:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:48 smithi086 ceph-mon[35163]: pgmap v5044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7907.929294 secs 2024-03-28T08:11:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:48 smithi159 ceph-mon[36109]: pgmap v5043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:11:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:48 smithi159 ceph-mon[36109]: pgmap v5044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7907.929294 secs 2024-03-28T08:11:49.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8580 sec 2024-03-28T08:11:50.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8581 sec 2024-03-28T08:11:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:50 smithi086 ceph-mon[35163]: pgmap v5045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:11:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:50 smithi159 ceph-mon[36109]: pgmap v5045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:11:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:50 smithi055 ceph-mon[31863]: pgmap v5045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:11:51.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8582 sec 2024-03-28T08:11:52.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8583 sec 2024-03-28T08:11:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:52 smithi086 ceph-mon[35163]: pgmap v5046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:52 smithi159 ceph-mon[36109]: pgmap v5046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:52 smithi055 ceph-mon[31863]: pgmap v5046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:53.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8584 sec 2024-03-28T08:11:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7912.929380 secs 2024-03-28T08:11:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7912.929380 secs 2024-03-28T08:11:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7912.929380 secs 2024-03-28T08:11:54.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8585 sec 2024-03-28T08:11:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:54 smithi086 ceph-mon[35163]: pgmap v5047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:54 smithi159 ceph-mon[36109]: pgmap v5047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:54 smithi055 ceph-mon[31863]: pgmap v5047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:11:55.299 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8586 sec 2024-03-28T08:11:56.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8587 sec 2024-03-28T08:11:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:56 smithi086 ceph-mon[35163]: pgmap v5048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:56 smithi159 ceph-mon[36109]: pgmap v5048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:56 smithi055 ceph-mon[31863]: pgmap v5048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:11:57.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8588 sec 2024-03-28T08:11:58.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8589 sec 2024-03-28T08:11:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:58 smithi086 ceph-mon[35163]: pgmap v5049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:11:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:11:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7917.929501 secs 2024-03-28T08:11:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:58 smithi159 ceph-mon[36109]: pgmap v5049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:11:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:11:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7917.929501 secs 2024-03-28T08:11:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:58 smithi055 ceph-mon[31863]: pgmap v5049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:11:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:11:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7917.929501 secs 2024-03-28T08:11:59.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8590 sec 2024-03-28T08:12:00.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8591 sec 2024-03-28T08:12:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:00 smithi086 ceph-mon[35163]: pgmap v5050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:00 smithi159 ceph-mon[36109]: pgmap v5050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:00 smithi055 ceph-mon[31863]: pgmap v5050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:01.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8592 sec 2024-03-28T08:12:02.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8593 sec 2024-03-28T08:12:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:02 smithi086 ceph-mon[35163]: pgmap v5051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:02 smithi159 ceph-mon[36109]: pgmap v5051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:02 smithi055 ceph-mon[31863]: pgmap v5051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:03.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8594 sec 2024-03-28T08:12:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7922.929623 secs 2024-03-28T08:12:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7922.929623 secs 2024-03-28T08:12:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7922.929623 secs 2024-03-28T08:12:04.300 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8595 sec 2024-03-28T08:12:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:04 smithi086 ceph-mon[35163]: pgmap v5052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:04 smithi159 ceph-mon[36109]: pgmap v5052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:04 smithi055 ceph-mon[31863]: pgmap v5052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:05.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8596 sec 2024-03-28T08:12:06.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8597 sec 2024-03-28T08:12:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:06 smithi086 ceph-mon[35163]: pgmap v5053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:06 smithi159 ceph-mon[36109]: pgmap v5053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:06 smithi055 ceph-mon[31863]: pgmap v5053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:07.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8598 sec 2024-03-28T08:12:08.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8599 sec 2024-03-28T08:12:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:08 smithi086 ceph-mon[35163]: pgmap v5054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7927.929747 secs 2024-03-28T08:12:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:08 smithi159 ceph-mon[36109]: pgmap v5054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7927.929747 secs 2024-03-28T08:12:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:08 smithi055 ceph-mon[31863]: pgmap v5054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7927.929747 secs 2024-03-28T08:12:09.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8600 sec 2024-03-28T08:12:10.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8601 sec 2024-03-28T08:12:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:10 smithi086 ceph-mon[35163]: pgmap v5055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:10 smithi159 ceph-mon[36109]: pgmap v5055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:10 smithi055 ceph-mon[31863]: pgmap v5055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:11.301 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8602 sec 2024-03-28T08:12:12.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8603 sec 2024-03-28T08:12:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:12 smithi086 ceph-mon[35163]: pgmap v5056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:12 smithi159 ceph-mon[36109]: pgmap v5056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:12 smithi055 ceph-mon[31863]: pgmap v5056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:13.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8604 sec 2024-03-28T08:12:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7932.929860 secs 2024-03-28T08:12:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7932.929860 secs 2024-03-28T08:12:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7932.929860 secs 2024-03-28T08:12:14.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8605 sec 2024-03-28T08:12:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:14 smithi086 ceph-mon[35163]: pgmap v5057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:14 smithi159 ceph-mon[36109]: pgmap v5057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:14 smithi055 ceph-mon[31863]: pgmap v5057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:15.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8606 sec 2024-03-28T08:12:16.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8607 sec 2024-03-28T08:12:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:16 smithi086 ceph-mon[35163]: pgmap v5058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:16 smithi159 ceph-mon[36109]: pgmap v5058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:16 smithi055 ceph-mon[31863]: pgmap v5058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:17.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8608 sec 2024-03-28T08:12:18.302 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8609 sec 2024-03-28T08:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:18 smithi086 ceph-mon[35163]: pgmap v5059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7937.929932 secs 2024-03-28T08:12:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:18 smithi159 ceph-mon[36109]: pgmap v5059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7937.929932 secs 2024-03-28T08:12:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:18 smithi055 ceph-mon[31863]: pgmap v5059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7937.929932 secs 2024-03-28T08:12:19.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8610 sec 2024-03-28T08:12:20.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8611 sec 2024-03-28T08:12:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:20 smithi086 ceph-mon[35163]: pgmap v5060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:20 smithi159 ceph-mon[36109]: pgmap v5060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:20 smithi055 ceph-mon[31863]: pgmap v5060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:21.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8612 sec 2024-03-28T08:12:22.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8613 sec 2024-03-28T08:12:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:22 smithi086 ceph-mon[35163]: pgmap v5061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:22 smithi159 ceph-mon[36109]: pgmap v5061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:22 smithi055 ceph-mon[31863]: pgmap v5061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:23.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8614 sec 2024-03-28T08:12:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7942.930051 secs 2024-03-28T08:12:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7942.930051 secs 2024-03-28T08:12:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7942.930051 secs 2024-03-28T08:12:24.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8615 sec 2024-03-28T08:12:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:24 smithi055 ceph-mon[31863]: pgmap v5062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:24 smithi086 ceph-mon[35163]: pgmap v5062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:24 smithi159 ceph-mon[36109]: pgmap v5062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:25.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8616 sec 2024-03-28T08:12:26.303 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8617 sec 2024-03-28T08:12:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:26 smithi055 ceph-mon[31863]: pgmap v5063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:26 smithi086 ceph-mon[35163]: pgmap v5063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:26 smithi159 ceph-mon[36109]: pgmap v5063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:27.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8618 sec 2024-03-28T08:12:28.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8619 sec 2024-03-28T08:12:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:28 smithi055 ceph-mon[31863]: pgmap v5064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7947.930126 secs 2024-03-28T08:12:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:28 smithi086 ceph-mon[35163]: pgmap v5064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7947.930126 secs 2024-03-28T08:12:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:28 smithi159 ceph-mon[36109]: pgmap v5064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7947.930126 secs 2024-03-28T08:12:29.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8620 sec 2024-03-28T08:12:30.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8621 sec 2024-03-28T08:12:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:30 smithi055 ceph-mon[31863]: pgmap v5065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:30 smithi086 ceph-mon[35163]: pgmap v5065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:30 smithi159 ceph-mon[36109]: pgmap v5065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:31.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8622 sec 2024-03-28T08:12:32.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8623 sec 2024-03-28T08:12:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:32 smithi055 ceph-mon[31863]: pgmap v5066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:32 smithi086 ceph-mon[35163]: pgmap v5066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:32 smithi159 ceph-mon[36109]: pgmap v5066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:33.304 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8624 sec 2024-03-28T08:12:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7952.930240 secs 2024-03-28T08:12:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7952.930240 secs 2024-03-28T08:12:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7952.930240 secs 2024-03-28T08:12:34.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8625 sec 2024-03-28T08:12:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:34 smithi055 ceph-mon[31863]: pgmap v5067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:34 smithi086 ceph-mon[35163]: pgmap v5067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:34 smithi159 ceph-mon[36109]: pgmap v5067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:35.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8626 sec 2024-03-28T08:12:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:35 smithi086 ceph-mon[35163]: pgmap v5068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:35 smithi159 ceph-mon[36109]: pgmap v5068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:35 smithi055 ceph-mon[31863]: pgmap v5068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:36.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8627 sec 2024-03-28T08:12:37.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8628 sec 2024-03-28T08:12:38.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8629 sec 2024-03-28T08:12:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:37 smithi086 ceph-mon[35163]: pgmap v5069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7957.930365 secs 2024-03-28T08:12:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:37 smithi159 ceph-mon[36109]: pgmap v5069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7957.930365 secs 2024-03-28T08:12:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:37 smithi055 ceph-mon[31863]: pgmap v5069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7957.930365 secs 2024-03-28T08:12:39.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8630 sec 2024-03-28T08:12:40.305 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8631 sec 2024-03-28T08:12:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:39 smithi086 ceph-mon[35163]: pgmap v5070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:39 smithi159 ceph-mon[36109]: pgmap v5070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:39 smithi055 ceph-mon[31863]: pgmap v5070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:41.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8632 sec 2024-03-28T08:12:42.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8633 sec 2024-03-28T08:12:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:41 smithi086 ceph-mon[35163]: pgmap v5071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:41 smithi159 ceph-mon[36109]: pgmap v5071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:41 smithi055 ceph-mon[31863]: pgmap v5071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:43.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8634 sec 2024-03-28T08:12:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7962.930454 secs 2024-03-28T08:12:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7962.930454 secs 2024-03-28T08:12:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7962.930454 secs 2024-03-28T08:12:44.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8635 sec 2024-03-28T08:12:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:43 smithi086 ceph-mon[35163]: pgmap v5072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:43 smithi159 ceph-mon[36109]: pgmap v5072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:43 smithi055 ceph-mon[31863]: pgmap v5072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:45.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8636 sec 2024-03-28T08:12:46.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8637 sec 2024-03-28T08:12:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:45 smithi086 ceph-mon[35163]: pgmap v5073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:45 smithi159 ceph-mon[36109]: pgmap v5073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:45 smithi055 ceph-mon[31863]: pgmap v5073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:12:47.306 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8638 sec 2024-03-28T08:12:48.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8639 sec 2024-03-28T08:12:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:48 smithi086 ceph-mon[35163]: pgmap v5074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:12:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7967.930525 secs 2024-03-28T08:12:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:48 smithi159 ceph-mon[36109]: pgmap v5074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:12:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7967.930525 secs 2024-03-28T08:12:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:48 smithi055 ceph-mon[31863]: pgmap v5074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:12:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7967.930525 secs 2024-03-28T08:12:49.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8640 sec 2024-03-28T08:12:50.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:50 smithi086 ceph-mon[35163]: pgmap v5075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:50.272 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:50 smithi055 ceph-mon[31863]: pgmap v5075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:50.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8641 sec 2024-03-28T08:12:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:50 smithi159 ceph-mon[36109]: pgmap v5075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:51.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8642 sec 2024-03-28T08:12:52.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8643 sec 2024-03-28T08:12:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:52 smithi086 ceph-mon[35163]: pgmap v5076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:52 smithi159 ceph-mon[36109]: pgmap v5076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:52 smithi055 ceph-mon[31863]: pgmap v5076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:53.032 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7972.930600 secs 2024-03-28T08:12:53.267 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7972.930600 secs 2024-03-28T08:12:53.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8644 sec 2024-03-28T08:12:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7972.930600 secs 2024-03-28T08:12:54.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8645 sec 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: pgmap v5077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:12:54.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: pgmap v5077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:12:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: pgmap v5077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:12:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:12:55.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8646 sec 2024-03-28T08:12:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:55 smithi086 ceph-mon[35163]: pgmap v5078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:12:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:55 smithi086 ceph-mon[35163]: pgmap v5079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:55 smithi159 ceph-mon[36109]: pgmap v5078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:12:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:55 smithi159 ceph-mon[36109]: pgmap v5079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:55 smithi055 ceph-mon[31863]: pgmap v5078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:12:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:55 smithi055 ceph-mon[31863]: pgmap v5079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:56.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8647 sec 2024-03-28T08:12:57.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8648 sec 2024-03-28T08:12:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:57 smithi086 ceph-mon[35163]: pgmap v5080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:57 smithi159 ceph-mon[36109]: pgmap v5080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:57 smithi055 ceph-mon[31863]: pgmap v5080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:58.307 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8649 sec 2024-03-28T08:12:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7977.930729 secs 2024-03-28T08:12:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7977.930729 secs 2024-03-28T08:12:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7977.930729 secs 2024-03-28T08:12:59.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8650 sec 2024-03-28T08:12:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:12:59 smithi086 ceph-mon[35163]: pgmap v5081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:12:59 smithi159 ceph-mon[36109]: pgmap v5081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:12:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:12:59 smithi055 ceph-mon[31863]: pgmap v5081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:00.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8651 sec 2024-03-28T08:13:01.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8652 sec 2024-03-28T08:13:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:01 smithi086 ceph-mon[35163]: pgmap v5082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:01 smithi159 ceph-mon[36109]: pgmap v5082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:01 smithi055 ceph-mon[31863]: pgmap v5082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:02.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8653 sec 2024-03-28T08:13:03.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8654 sec 2024-03-28T08:13:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:03 smithi086 ceph-mon[35163]: pgmap v5083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7982.930858 secs 2024-03-28T08:13:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:03 smithi159 ceph-mon[36109]: pgmap v5083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7982.930858 secs 2024-03-28T08:13:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:03 smithi055 ceph-mon[31863]: pgmap v5083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7982.930858 secs 2024-03-28T08:13:04.308 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8655 sec 2024-03-28T08:13:05.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8656 sec 2024-03-28T08:13:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:05 smithi086 ceph-mon[35163]: pgmap v5084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:05 smithi159 ceph-mon[36109]: pgmap v5084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:05 smithi055 ceph-mon[31863]: pgmap v5084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:06.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8657 sec 2024-03-28T08:13:07.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8658 sec 2024-03-28T08:13:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:07 smithi086 ceph-mon[35163]: pgmap v5085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:07 smithi159 ceph-mon[36109]: pgmap v5085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:07 smithi055 ceph-mon[31863]: pgmap v5085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:08.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8659 sec 2024-03-28T08:13:08.749 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7987.930947 secs 2024-03-28T08:13:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7987.930947 secs 2024-03-28T08:13:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7987.930947 secs 2024-03-28T08:13:09.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8660 sec 2024-03-28T08:13:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:09 smithi086 ceph-mon[35163]: pgmap v5086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:09 smithi159 ceph-mon[36109]: pgmap v5086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:09 smithi055 ceph-mon[31863]: pgmap v5086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:10.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8661 sec 2024-03-28T08:13:11.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8662 sec 2024-03-28T08:13:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:11 smithi086 ceph-mon[35163]: pgmap v5087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:11 smithi159 ceph-mon[36109]: pgmap v5087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:11 smithi055 ceph-mon[31863]: pgmap v5087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:12.309 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8663 sec 2024-03-28T08:13:13.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8664 sec 2024-03-28T08:13:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:13 smithi086 ceph-mon[35163]: pgmap v5088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7992.931011 secs 2024-03-28T08:13:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:13 smithi159 ceph-mon[36109]: pgmap v5088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7992.931011 secs 2024-03-28T08:13:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:13 smithi055 ceph-mon[31863]: pgmap v5088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7992.931011 secs 2024-03-28T08:13:14.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8665 sec 2024-03-28T08:13:15.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8666 sec 2024-03-28T08:13:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:15 smithi086 ceph-mon[35163]: pgmap v5089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:15 smithi159 ceph-mon[36109]: pgmap v5089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:15 smithi055 ceph-mon[31863]: pgmap v5089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:16.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8667 sec 2024-03-28T08:13:17.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8668 sec 2024-03-28T08:13:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:17 smithi086 ceph-mon[35163]: pgmap v5090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:17 smithi159 ceph-mon[36109]: pgmap v5090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:17 smithi055 ceph-mon[31863]: pgmap v5090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:18.310 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8669 sec 2024-03-28T08:13:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 7997.931078 secs 2024-03-28T08:13:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 7997.931078 secs 2024-03-28T08:13:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 7997.931078 secs 2024-03-28T08:13:19.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8670 sec 2024-03-28T08:13:19.805 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:19 smithi055 ceph-mon[31863]: pgmap v5091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:19 smithi086 ceph-mon[35163]: pgmap v5091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:19 smithi159 ceph-mon[36109]: pgmap v5091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:20.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8671 sec 2024-03-28T08:13:21.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8672 sec 2024-03-28T08:13:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:21 smithi086 ceph-mon[35163]: pgmap v5092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:21 smithi159 ceph-mon[36109]: pgmap v5092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:21 smithi055 ceph-mon[31863]: pgmap v5092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:22.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8673 sec 2024-03-28T08:13:23.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8674 sec 2024-03-28T08:13:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:23 smithi086 ceph-mon[35163]: pgmap v5093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8002.931149 secs 2024-03-28T08:13:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:23 smithi159 ceph-mon[36109]: pgmap v5093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8002.931149 secs 2024-03-28T08:13:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:23 smithi055 ceph-mon[31863]: pgmap v5093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:13:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8002.931149 secs 2024-03-28T08:13:24.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8675 sec 2024-03-28T08:13:25.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8676 sec 2024-03-28T08:13:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:25 smithi086 ceph-mon[35163]: pgmap v5094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:25 smithi159 ceph-mon[36109]: pgmap v5094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:25 smithi055 ceph-mon[31863]: pgmap v5094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:26.311 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8677 sec 2024-03-28T08:13:27.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8678 sec 2024-03-28T08:13:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:27 smithi086 ceph-mon[35163]: pgmap v5095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:27 smithi159 ceph-mon[36109]: pgmap v5095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:27 smithi055 ceph-mon[31863]: pgmap v5095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:28.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8679 sec 2024-03-28T08:13:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8007.931237 secs 2024-03-28T08:13:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8007.931237 secs 2024-03-28T08:13:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8007.931237 secs 2024-03-28T08:13:29.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8680 sec 2024-03-28T08:13:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:29 smithi055 ceph-mon[31863]: pgmap v5096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:29 smithi086 ceph-mon[35163]: pgmap v5096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:29 smithi159 ceph-mon[36109]: pgmap v5096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:13:30.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8681 sec 2024-03-28T08:13:31.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8682 sec 2024-03-28T08:13:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:31 smithi055 ceph-mon[31863]: pgmap v5097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:31 smithi086 ceph-mon[35163]: pgmap v5097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:31 smithi159 ceph-mon[36109]: pgmap v5097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:32.312 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8683 sec 2024-03-28T08:13:33.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8684 sec 2024-03-28T08:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:33 smithi055 ceph-mon[31863]: pgmap v5098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8012.931324 secs 2024-03-28T08:13:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:33 smithi086 ceph-mon[35163]: pgmap v5098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8012.931324 secs 2024-03-28T08:13:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:33 smithi159 ceph-mon[36109]: pgmap v5098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8012.931324 secs 2024-03-28T08:13:34.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8685 sec 2024-03-28T08:13:35.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8686 sec 2024-03-28T08:13:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:35 smithi055 ceph-mon[31863]: pgmap v5099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:35 smithi086 ceph-mon[35163]: pgmap v5099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:35 smithi159 ceph-mon[36109]: pgmap v5099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:36.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8687 sec 2024-03-28T08:13:37.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8688 sec 2024-03-28T08:13:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:37 smithi086 ceph-mon[35163]: pgmap v5100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:37 smithi159 ceph-mon[36109]: pgmap v5100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:37 smithi055 ceph-mon[31863]: pgmap v5100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:38.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8689 sec 2024-03-28T08:13:38.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8017.931407 secs 2024-03-28T08:13:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8017.931407 secs 2024-03-28T08:13:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8017.931407 secs 2024-03-28T08:13:39.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8690 sec 2024-03-28T08:13:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:39 smithi086 ceph-mon[35163]: pgmap v5101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:39 smithi159 ceph-mon[36109]: pgmap v5101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:39 smithi055 ceph-mon[31863]: pgmap v5101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:40.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8691 sec 2024-03-28T08:13:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:40 smithi086 ceph-mon[35163]: pgmap v5102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:40 smithi159 ceph-mon[36109]: pgmap v5102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:40 smithi055 ceph-mon[31863]: pgmap v5102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:41.313 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8692 sec 2024-03-28T08:13:42.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8693 sec 2024-03-28T08:13:43.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8694 sec 2024-03-28T08:13:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:43 smithi086 ceph-mon[35163]: pgmap v5103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8022.931533 secs 2024-03-28T08:13:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:43 smithi159 ceph-mon[36109]: pgmap v5103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8022.931533 secs 2024-03-28T08:13:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:43 smithi055 ceph-mon[31863]: pgmap v5103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8022.931533 secs 2024-03-28T08:13:44.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8695 sec 2024-03-28T08:13:45.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8696 sec 2024-03-28T08:13:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:45 smithi086 ceph-mon[35163]: pgmap v5104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:45 smithi159 ceph-mon[36109]: pgmap v5104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:45 smithi055 ceph-mon[31863]: pgmap v5104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:46.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8697 sec 2024-03-28T08:13:47.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8698 sec 2024-03-28T08:13:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:47 smithi086 ceph-mon[35163]: pgmap v5105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:47 smithi159 ceph-mon[36109]: pgmap v5105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:47 smithi055 ceph-mon[31863]: pgmap v5105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:48.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8699 sec 2024-03-28T08:13:48.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8027.931655 secs 2024-03-28T08:13:48.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8027.931655 secs 2024-03-28T08:13:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8027.931655 secs 2024-03-28T08:13:49.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8700 sec 2024-03-28T08:13:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:49 smithi086 ceph-mon[35163]: pgmap v5106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:49 smithi159 ceph-mon[36109]: pgmap v5106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:49 smithi055 ceph-mon[31863]: pgmap v5106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:50.314 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8701 sec 2024-03-28T08:13:51.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8702 sec 2024-03-28T08:13:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:51 smithi086 ceph-mon[35163]: pgmap v5107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:51 smithi159 ceph-mon[36109]: pgmap v5107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:51.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:51 smithi055 ceph-mon[31863]: pgmap v5107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:13:52.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8703 sec 2024-03-28T08:13:53.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8704 sec 2024-03-28T08:13:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:53 smithi086 ceph-mon[35163]: pgmap v5108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8032.931769 secs 2024-03-28T08:13:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:53 smithi159 ceph-mon[36109]: pgmap v5108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8032.931769 secs 2024-03-28T08:13:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:53 smithi055 ceph-mon[31863]: pgmap v5108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:13:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8032.931769 secs 2024-03-28T08:13:54.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8705 sec 2024-03-28T08:13:55.315 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8706 sec 2024-03-28T08:13:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:55 smithi086 ceph-mon[35163]: pgmap v5109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:13:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:55 smithi159 ceph-mon[36109]: pgmap v5109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:13:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:55 smithi055 ceph-mon[31863]: pgmap v5109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:13:56.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8707 sec 2024-03-28T08:13:57.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8708 sec 2024-03-28T08:13:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:57 smithi159 ceph-mon[36109]: pgmap v5110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:57 smithi086 ceph-mon[35163]: pgmap v5110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:57 smithi055 ceph-mon[31863]: pgmap v5110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:58.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8709 sec 2024-03-28T08:13:58.711 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8037.931824 secs 2024-03-28T08:13:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8037.931824 secs 2024-03-28T08:13:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8037.931824 secs 2024-03-28T08:13:59.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8710 sec 2024-03-28T08:13:59.745 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:13:59 smithi159 ceph-mon[36109]: pgmap v5111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:13:59 smithi086 ceph-mon[35163]: pgmap v5111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:13:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:13:59 smithi055 ceph-mon[31863]: pgmap v5111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:00.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8711 sec 2024-03-28T08:14:01.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8712 sec 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: pgmap v5112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:14:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: pgmap v5112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:14:01.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: pgmap v5112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:14:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:14:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:14:01.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:14:02.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8713 sec 2024-03-28T08:14:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:02 smithi086 ceph-mon[35163]: pgmap v5113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:14:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:02 smithi086 ceph-mon[35163]: pgmap v5114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:02 smithi159 ceph-mon[36109]: pgmap v5113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:14:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:02 smithi159 ceph-mon[36109]: pgmap v5114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:02 smithi055 ceph-mon[31863]: pgmap v5113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:14:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:02 smithi055 ceph-mon[31863]: pgmap v5114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:03.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8714 sec 2024-03-28T08:14:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8042.931942 secs 2024-03-28T08:14:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8042.931942 secs 2024-03-28T08:14:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8042.931942 secs 2024-03-28T08:14:04.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8715 sec 2024-03-28T08:14:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:04 smithi086 ceph-mon[35163]: pgmap v5115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:04 smithi159 ceph-mon[36109]: pgmap v5115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:04 smithi055 ceph-mon[31863]: pgmap v5115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:14:05.316 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8716 sec 2024-03-28T08:14:06.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8717 sec 2024-03-28T08:14:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:06 smithi086 ceph-mon[35163]: pgmap v5116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:06 smithi159 ceph-mon[36109]: pgmap v5116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:06 smithi055 ceph-mon[31863]: pgmap v5116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:07.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8718 sec 2024-03-28T08:14:08.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8719 sec 2024-03-28T08:14:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:08 smithi086 ceph-mon[35163]: pgmap v5117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8047.932059 secs 2024-03-28T08:14:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:08 smithi159 ceph-mon[36109]: pgmap v5117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8047.932059 secs 2024-03-28T08:14:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:08 smithi055 ceph-mon[31863]: pgmap v5117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8047.932059 secs 2024-03-28T08:14:09.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8720 sec 2024-03-28T08:14:10.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8721 sec 2024-03-28T08:14:10.799 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:10 smithi159 ceph-mon[36109]: pgmap v5118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:10 smithi086 ceph-mon[35163]: pgmap v5118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:10 smithi055 ceph-mon[31863]: pgmap v5118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:11.317 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8722 sec 2024-03-28T08:14:12.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8723 sec 2024-03-28T08:14:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:12 smithi086 ceph-mon[35163]: pgmap v5119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:14:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:12 smithi159 ceph-mon[36109]: pgmap v5119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:14:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:12 smithi055 ceph-mon[31863]: pgmap v5119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:14:13.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8724 sec 2024-03-28T08:14:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8052.932131 secs 2024-03-28T08:14:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8052.932131 secs 2024-03-28T08:14:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8052.932131 secs 2024-03-28T08:14:14.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8725 sec 2024-03-28T08:14:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:14 smithi086 ceph-mon[35163]: pgmap v5120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:14 smithi159 ceph-mon[36109]: pgmap v5120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:14 smithi055 ceph-mon[31863]: pgmap v5120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:15.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8726 sec 2024-03-28T08:14:16.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8727 sec 2024-03-28T08:14:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:16 smithi086 ceph-mon[35163]: pgmap v5121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:16 smithi159 ceph-mon[36109]: pgmap v5121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:16 smithi055 ceph-mon[31863]: pgmap v5121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:17.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8728 sec 2024-03-28T08:14:18.318 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8729 sec 2024-03-28T08:14:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:18 smithi086 ceph-mon[35163]: pgmap v5122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8057.932252 secs 2024-03-28T08:14:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:18 smithi159 ceph-mon[36109]: pgmap v5122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8057.932252 secs 2024-03-28T08:14:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:18 smithi055 ceph-mon[31863]: pgmap v5122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8057.932252 secs 2024-03-28T08:14:19.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8730 sec 2024-03-28T08:14:20.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8731 sec 2024-03-28T08:14:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:20 smithi086 ceph-mon[35163]: pgmap v5123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:20 smithi159 ceph-mon[36109]: pgmap v5123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:20 smithi055 ceph-mon[31863]: pgmap v5123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:21.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8732 sec 2024-03-28T08:14:22.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8733 sec 2024-03-28T08:14:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:22 smithi086 ceph-mon[35163]: pgmap v5124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:22 smithi159 ceph-mon[36109]: pgmap v5124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:22 smithi055 ceph-mon[31863]: pgmap v5124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:23.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8734 sec 2024-03-28T08:14:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8062.932345 secs 2024-03-28T08:14:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8062.932345 secs 2024-03-28T08:14:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8062.932345 secs 2024-03-28T08:14:24.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8735 sec 2024-03-28T08:14:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:24 smithi055 ceph-mon[31863]: pgmap v5125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:24 smithi086 ceph-mon[35163]: pgmap v5125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:24 smithi159 ceph-mon[36109]: pgmap v5125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:25.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8736 sec 2024-03-28T08:14:26.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8737 sec 2024-03-28T08:14:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:26 smithi055 ceph-mon[31863]: pgmap v5126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:26 smithi086 ceph-mon[35163]: pgmap v5126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:26 smithi159 ceph-mon[36109]: pgmap v5126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:27.319 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8738 sec 2024-03-28T08:14:28.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8739 sec 2024-03-28T08:14:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:28 smithi055 ceph-mon[31863]: pgmap v5127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8067.932464 secs 2024-03-28T08:14:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:28 smithi086 ceph-mon[35163]: pgmap v5127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8067.932464 secs 2024-03-28T08:14:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:28 smithi159 ceph-mon[36109]: pgmap v5127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8067.932464 secs 2024-03-28T08:14:29.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8740 sec 2024-03-28T08:14:30.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8741 sec 2024-03-28T08:14:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:30 smithi055 ceph-mon[31863]: pgmap v5128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:30 smithi086 ceph-mon[35163]: pgmap v5128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:30 smithi159 ceph-mon[36109]: pgmap v5128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:31.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8742 sec 2024-03-28T08:14:32.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8743 sec 2024-03-28T08:14:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:32 smithi055 ceph-mon[31863]: pgmap v5129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:32 smithi086 ceph-mon[35163]: pgmap v5129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:32 smithi159 ceph-mon[36109]: pgmap v5129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:33.320 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8744 sec 2024-03-28T08:14:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8072.932586 secs 2024-03-28T08:14:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8072.932586 secs 2024-03-28T08:14:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8072.932586 secs 2024-03-28T08:14:34.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8745 sec 2024-03-28T08:14:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:34 smithi086 ceph-mon[35163]: pgmap v5130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:34 smithi159 ceph-mon[36109]: pgmap v5130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:34 smithi055 ceph-mon[31863]: pgmap v5130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:35.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8746 sec 2024-03-28T08:14:36.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8747 sec 2024-03-28T08:14:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:36 smithi086 ceph-mon[35163]: pgmap v5131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:36 smithi159 ceph-mon[36109]: pgmap v5131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:36 smithi055 ceph-mon[31863]: pgmap v5131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:37.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8748 sec 2024-03-28T08:14:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8077.932711 secs 2024-03-28T08:14:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8077.932711 secs 2024-03-28T08:14:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8077.932711 secs 2024-03-28T08:14:38.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8749 sec 2024-03-28T08:14:38.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:38 smithi086 ceph-mon[35163]: pgmap v5132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:38 smithi159 ceph-mon[36109]: pgmap v5132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:38 smithi055 ceph-mon[31863]: pgmap v5132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:39.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8750 sec 2024-03-28T08:14:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:39 smithi086 ceph-mon[35163]: pgmap v5133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:39 smithi159 ceph-mon[36109]: pgmap v5133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:39 smithi055 ceph-mon[31863]: pgmap v5133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:40.321 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8751 sec 2024-03-28T08:14:41.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8752 sec 2024-03-28T08:14:42.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8753 sec 2024-03-28T08:14:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:42 smithi086 ceph-mon[35163]: pgmap v5134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:42 smithi159 ceph-mon[36109]: pgmap v5134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:42 smithi055 ceph-mon[31863]: pgmap v5134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:43.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8754 sec 2024-03-28T08:14:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8082.932834 secs 2024-03-28T08:14:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8082.932834 secs 2024-03-28T08:14:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8082.932834 secs 2024-03-28T08:14:44.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8755 sec 2024-03-28T08:14:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:44 smithi086 ceph-mon[35163]: pgmap v5135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:44 smithi159 ceph-mon[36109]: pgmap v5135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:44 smithi055 ceph-mon[31863]: pgmap v5135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:45.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8756 sec 2024-03-28T08:14:46.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8757 sec 2024-03-28T08:14:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:46 smithi086 ceph-mon[35163]: pgmap v5136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:46 smithi159 ceph-mon[36109]: pgmap v5136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:46 smithi055 ceph-mon[31863]: pgmap v5136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:47.322 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8758 sec 2024-03-28T08:14:48.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8759 sec 2024-03-28T08:14:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:48 smithi086 ceph-mon[35163]: pgmap v5137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8087.932900 secs 2024-03-28T08:14:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:48 smithi159 ceph-mon[36109]: pgmap v5137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8087.932900 secs 2024-03-28T08:14:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:48 smithi055 ceph-mon[31863]: pgmap v5137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8087.932900 secs 2024-03-28T08:14:49.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8760 sec 2024-03-28T08:14:50.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8761 sec 2024-03-28T08:14:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:50 smithi086 ceph-mon[35163]: pgmap v5138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:50 smithi159 ceph-mon[36109]: pgmap v5138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:50 smithi055 ceph-mon[31863]: pgmap v5138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:51.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8762 sec 2024-03-28T08:14:52.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8763 sec 2024-03-28T08:14:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:52 smithi086 ceph-mon[35163]: pgmap v5139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:52 smithi159 ceph-mon[36109]: pgmap v5139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:52 smithi055 ceph-mon[31863]: pgmap v5139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:53.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8764 sec 2024-03-28T08:14:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8092.932979 secs 2024-03-28T08:14:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8092.932979 secs 2024-03-28T08:14:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8092.932979 secs 2024-03-28T08:14:54.323 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8765 sec 2024-03-28T08:14:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:54 smithi086 ceph-mon[35163]: pgmap v5140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:54 smithi159 ceph-mon[36109]: pgmap v5140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:54 smithi055 ceph-mon[31863]: pgmap v5140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:55.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8766 sec 2024-03-28T08:14:56.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8767 sec 2024-03-28T08:14:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:56 smithi086 ceph-mon[35163]: pgmap v5141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:56 smithi159 ceph-mon[36109]: pgmap v5141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:56 smithi055 ceph-mon[31863]: pgmap v5141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:14:57.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8768 sec 2024-03-28T08:14:58.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8769 sec 2024-03-28T08:14:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:58 smithi086 ceph-mon[35163]: pgmap v5142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:14:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8097.933072 secs 2024-03-28T08:14:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:58 smithi159 ceph-mon[36109]: pgmap v5142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:14:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8097.933072 secs 2024-03-28T08:14:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:58 smithi055 ceph-mon[31863]: pgmap v5142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:14:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:14:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8097.933072 secs 2024-03-28T08:14:59.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8770 sec 2024-03-28T08:15:00.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8771 sec 2024-03-28T08:15:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:00 smithi086 ceph-mon[35163]: pgmap v5143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:00 smithi159 ceph-mon[36109]: pgmap v5143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:00 smithi055 ceph-mon[31863]: pgmap v5143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:01.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8772 sec 2024-03-28T08:15:02.324 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8773 sec 2024-03-28T08:15:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:02 smithi086 ceph-mon[35163]: pgmap v5144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:15:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:02 smithi159 ceph-mon[36109]: pgmap v5144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:15:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:02 smithi055 ceph-mon[31863]: pgmap v5144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:15:03.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8774 sec 2024-03-28T08:15:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8102.933147 secs 2024-03-28T08:15:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:15:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:15:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:15:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8102.933147 secs 2024-03-28T08:15:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:15:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:15:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:15:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8102.933147 secs 2024-03-28T08:15:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:15:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:15:03.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:15:04.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8775 sec 2024-03-28T08:15:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:04 smithi159 ceph-mon[36109]: pgmap v5145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:04.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:04 smithi159 ceph-mon[36109]: pgmap v5146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:04 smithi055 ceph-mon[31863]: pgmap v5145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:04 smithi055 ceph-mon[31863]: pgmap v5146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:04 smithi086 ceph-mon[35163]: pgmap v5145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:04 smithi086 ceph-mon[35163]: pgmap v5146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:05.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8776 sec 2024-03-28T08:15:06.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8777 sec 2024-03-28T08:15:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:06 smithi055 ceph-mon[31863]: pgmap v5147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:06 smithi086 ceph-mon[35163]: pgmap v5147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:06 smithi159 ceph-mon[36109]: pgmap v5147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:07.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8778 sec 2024-03-28T08:15:08.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8779 sec 2024-03-28T08:15:08.622 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:08 smithi086 ceph-mon[35163]: pgmap v5148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:08.622 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8107.933268 secs 2024-03-28T08:15:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:08 smithi055 ceph-mon[31863]: pgmap v5148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8107.933268 secs 2024-03-28T08:15:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:08 smithi159 ceph-mon[36109]: pgmap v5148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8107.933268 secs 2024-03-28T08:15:09.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8780 sec 2024-03-28T08:15:10.325 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8781 sec 2024-03-28T08:15:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:10 smithi086 ceph-mon[35163]: pgmap v5149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:10 smithi055 ceph-mon[31863]: pgmap v5149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:10 smithi159 ceph-mon[36109]: pgmap v5149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:11.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8782 sec 2024-03-28T08:15:12.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8783 sec 2024-03-28T08:15:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:12 smithi055 ceph-mon[31863]: pgmap v5150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:12 smithi086 ceph-mon[35163]: pgmap v5150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:12 smithi159 ceph-mon[36109]: pgmap v5150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:13.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8784 sec 2024-03-28T08:15:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8112.933393 secs 2024-03-28T08:15:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8112.933393 secs 2024-03-28T08:15:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8112.933393 secs 2024-03-28T08:15:14.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8785 sec 2024-03-28T08:15:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:14 smithi055 ceph-mon[31863]: pgmap v5151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:15:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:14 smithi086 ceph-mon[35163]: pgmap v5151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:15:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:14 smithi159 ceph-mon[36109]: pgmap v5151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:15:15.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8786 sec 2024-03-28T08:15:16.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8787 sec 2024-03-28T08:15:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:16 smithi055 ceph-mon[31863]: pgmap v5152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:16 smithi086 ceph-mon[35163]: pgmap v5152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:16 smithi159 ceph-mon[36109]: pgmap v5152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:17.326 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8788 sec 2024-03-28T08:15:18.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8789 sec 2024-03-28T08:15:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:18 smithi086 ceph-mon[35163]: pgmap v5153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8117.933489 secs 2024-03-28T08:15:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:18 smithi159 ceph-mon[36109]: pgmap v5153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8117.933489 secs 2024-03-28T08:15:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:18 smithi055 ceph-mon[31863]: pgmap v5153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8117.933489 secs 2024-03-28T08:15:19.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8790 sec 2024-03-28T08:15:20.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8791 sec 2024-03-28T08:15:20.665 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:20 smithi086 ceph-mon[35163]: pgmap v5154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:20 smithi159 ceph-mon[36109]: pgmap v5154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:20 smithi055 ceph-mon[31863]: pgmap v5154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:21.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8792 sec 2024-03-28T08:15:22.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8793 sec 2024-03-28T08:15:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:22 smithi086 ceph-mon[35163]: pgmap v5155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:22 smithi159 ceph-mon[36109]: pgmap v5155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:22 smithi055 ceph-mon[31863]: pgmap v5155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:23.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8794 sec 2024-03-28T08:15:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8122.933618 secs 2024-03-28T08:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8122.933618 secs 2024-03-28T08:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8122.933618 secs 2024-03-28T08:15:24.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8795 sec 2024-03-28T08:15:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:24 smithi086 ceph-mon[35163]: pgmap v5156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:24 smithi159 ceph-mon[36109]: pgmap v5156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:24 smithi055 ceph-mon[31863]: pgmap v5156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:25.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8796 sec 2024-03-28T08:15:26.327 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8797 sec 2024-03-28T08:15:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:26 smithi086 ceph-mon[35163]: pgmap v5157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:26 smithi159 ceph-mon[36109]: pgmap v5157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:26 smithi055 ceph-mon[31863]: pgmap v5157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:27.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8798 sec 2024-03-28T08:15:28.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8799 sec 2024-03-28T08:15:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:28 smithi086 ceph-mon[35163]: pgmap v5158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8127.933691 secs 2024-03-28T08:15:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:28 smithi159 ceph-mon[36109]: pgmap v5158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8127.933691 secs 2024-03-28T08:15:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:28 smithi055 ceph-mon[31863]: pgmap v5158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8127.933691 secs 2024-03-28T08:15:29.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8800 sec 2024-03-28T08:15:30.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8801 sec 2024-03-28T08:15:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:30 smithi086 ceph-mon[35163]: pgmap v5159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:30 smithi159 ceph-mon[36109]: pgmap v5159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:30 smithi055 ceph-mon[31863]: pgmap v5159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:31.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8802 sec 2024-03-28T08:15:32.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8803 sec 2024-03-28T08:15:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:32 smithi086 ceph-mon[35163]: pgmap v5160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:32 smithi159 ceph-mon[36109]: pgmap v5160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:32 smithi055 ceph-mon[31863]: pgmap v5160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:33.328 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8804 sec 2024-03-28T08:15:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8132.933786 secs 2024-03-28T08:15:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8132.933786 secs 2024-03-28T08:15:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8132.933786 secs 2024-03-28T08:15:34.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8805 sec 2024-03-28T08:15:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:34 smithi086 ceph-mon[35163]: pgmap v5161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:34 smithi159 ceph-mon[36109]: pgmap v5161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:34 smithi055 ceph-mon[31863]: pgmap v5161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:35.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8806 sec 2024-03-28T08:15:36.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8807 sec 2024-03-28T08:15:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:36 smithi086 ceph-mon[35163]: pgmap v5162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:36 smithi159 ceph-mon[36109]: pgmap v5162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:36 smithi055 ceph-mon[31863]: pgmap v5162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:37.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8808 sec 2024-03-28T08:15:38.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8809 sec 2024-03-28T08:15:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:38 smithi086 ceph-mon[35163]: pgmap v5163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8137.933866 secs 2024-03-28T08:15:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:38 smithi159 ceph-mon[36109]: pgmap v5163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8137.933866 secs 2024-03-28T08:15:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:38 smithi055 ceph-mon[31863]: pgmap v5163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8137.933866 secs 2024-03-28T08:15:39.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8810 sec 2024-03-28T08:15:40.329 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8811 sec 2024-03-28T08:15:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:40 smithi086 ceph-mon[35163]: pgmap v5164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:40 smithi159 ceph-mon[36109]: pgmap v5164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:40 smithi055 ceph-mon[31863]: pgmap v5164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:41.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8812 sec 2024-03-28T08:15:42.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8813 sec 2024-03-28T08:15:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:42 smithi086 ceph-mon[35163]: pgmap v5165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:42 smithi159 ceph-mon[36109]: pgmap v5165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:42 smithi055 ceph-mon[31863]: pgmap v5165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:43.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8814 sec 2024-03-28T08:15:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8142.933932 secs 2024-03-28T08:15:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8142.933932 secs 2024-03-28T08:15:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8142.933932 secs 2024-03-28T08:15:44.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8815 sec 2024-03-28T08:15:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:44 smithi086 ceph-mon[35163]: pgmap v5166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:44 smithi159 ceph-mon[36109]: pgmap v5166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:44 smithi055 ceph-mon[31863]: pgmap v5166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:15:45.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8816 sec 2024-03-28T08:15:46.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8817 sec 2024-03-28T08:15:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:46 smithi086 ceph-mon[35163]: pgmap v5167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:46 smithi159 ceph-mon[36109]: pgmap v5167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:46 smithi055 ceph-mon[31863]: pgmap v5167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:15:47.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8818 sec 2024-03-28T08:15:48.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8819 sec 2024-03-28T08:15:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:48 smithi086 ceph-mon[35163]: pgmap v5168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8147.934003 secs 2024-03-28T08:15:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:48 smithi159 ceph-mon[36109]: pgmap v5168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8147.934003 secs 2024-03-28T08:15:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:48 smithi055 ceph-mon[31863]: pgmap v5168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8147.934003 secs 2024-03-28T08:15:49.330 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8820 sec 2024-03-28T08:15:50.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8821 sec 2024-03-28T08:15:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:50 smithi086 ceph-mon[35163]: pgmap v5169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:50 smithi159 ceph-mon[36109]: pgmap v5169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:50 smithi055 ceph-mon[31863]: pgmap v5169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:51.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8822 sec 2024-03-28T08:15:52.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8823 sec 2024-03-28T08:15:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:52 smithi086 ceph-mon[35163]: pgmap v5170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:52 smithi159 ceph-mon[36109]: pgmap v5170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:52 smithi055 ceph-mon[31863]: pgmap v5170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:53.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8824 sec 2024-03-28T08:15:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8152.934095 secs 2024-03-28T08:15:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8152.934095 secs 2024-03-28T08:15:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8152.934095 secs 2024-03-28T08:15:54.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8825 sec 2024-03-28T08:15:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:54 smithi086 ceph-mon[35163]: pgmap v5171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:54 smithi159 ceph-mon[36109]: pgmap v5171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:54 smithi055 ceph-mon[31863]: pgmap v5171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:55.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8826 sec 2024-03-28T08:15:56.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8827 sec 2024-03-28T08:15:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:56 smithi086 ceph-mon[35163]: pgmap v5172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:15:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:56 smithi159 ceph-mon[36109]: pgmap v5172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:15:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:56 smithi055 ceph-mon[31863]: pgmap v5172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:15:57.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8828 sec 2024-03-28T08:15:58.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8829 sec 2024-03-28T08:15:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:58 smithi086 ceph-mon[35163]: pgmap v5173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:15:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8157.934177 secs 2024-03-28T08:15:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:58 smithi159 ceph-mon[36109]: pgmap v5173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:15:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8157.934177 secs 2024-03-28T08:15:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:58 smithi055 ceph-mon[31863]: pgmap v5173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:15:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:15:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8157.934177 secs 2024-03-28T08:15:59.331 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8830 sec 2024-03-28T08:16:00.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8831 sec 2024-03-28T08:16:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:00 smithi086 ceph-mon[35163]: pgmap v5174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:00 smithi159 ceph-mon[36109]: pgmap v5174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:00 smithi055 ceph-mon[31863]: pgmap v5174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:01.332 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8832 sec 2024-03-28T08:16:02.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8833 sec 2024-03-28T08:16:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:02 smithi086 ceph-mon[35163]: pgmap v5175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:02 smithi159 ceph-mon[36109]: pgmap v5175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:02 smithi055 ceph-mon[31863]: pgmap v5175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:03.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8834 sec 2024-03-28T08:16:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8162.934245 secs 2024-03-28T08:16:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:16:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8162.934245 secs 2024-03-28T08:16:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:16:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8162.934245 secs 2024-03-28T08:16:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:16:04.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8835 sec 2024-03-28T08:16:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:04 smithi055 ceph-mon[31863]: pgmap v5176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:04 smithi086 ceph-mon[35163]: pgmap v5176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:04 smithi159 ceph-mon[36109]: pgmap v5176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:05.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8836 sec 2024-03-28T08:16:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:16:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:16:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:16:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:16:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:16:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:16:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:16:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:16:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:16:06.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8837 sec 2024-03-28T08:16:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:06 smithi055 ceph-mon[31863]: pgmap v5177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:06.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:06 smithi055 ceph-mon[31863]: pgmap v5178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:06 smithi086 ceph-mon[35163]: pgmap v5177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:06 smithi086 ceph-mon[35163]: pgmap v5178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:06 smithi159 ceph-mon[36109]: pgmap v5177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:06 smithi159 ceph-mon[36109]: pgmap v5178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:07.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8838 sec 2024-03-28T08:16:08.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8839 sec 2024-03-28T08:16:08.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:08 smithi086 ceph-mon[35163]: pgmap v5179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:08.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8167.934318 secs 2024-03-28T08:16:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:08 smithi055 ceph-mon[31863]: pgmap v5179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8167.934318 secs 2024-03-28T08:16:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:08 smithi159 ceph-mon[36109]: pgmap v5179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8167.934318 secs 2024-03-28T08:16:09.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8840 sec 2024-03-28T08:16:10.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8841 sec 2024-03-28T08:16:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:10 smithi055 ceph-mon[31863]: pgmap v5180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:10 smithi086 ceph-mon[35163]: pgmap v5180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:10 smithi159 ceph-mon[36109]: pgmap v5180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:11.333 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8842 sec 2024-03-28T08:16:12.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8843 sec 2024-03-28T08:16:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:12 smithi055 ceph-mon[31863]: pgmap v5181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:12 smithi086 ceph-mon[35163]: pgmap v5181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:12 smithi159 ceph-mon[36109]: pgmap v5181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:13.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8844 sec 2024-03-28T08:16:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8172.934442 secs 2024-03-28T08:16:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8172.934442 secs 2024-03-28T08:16:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8172.934442 secs 2024-03-28T08:16:14.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8845 sec 2024-03-28T08:16:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:14 smithi086 ceph-mon[35163]: pgmap v5182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:14 smithi159 ceph-mon[36109]: pgmap v5182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:14 smithi055 ceph-mon[31863]: pgmap v5182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:16:15.334 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8846 sec 2024-03-28T08:16:16.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8847 sec 2024-03-28T08:16:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:16 smithi086 ceph-mon[35163]: pgmap v5183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:16:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:16 smithi159 ceph-mon[36109]: pgmap v5183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:16:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:16 smithi055 ceph-mon[31863]: pgmap v5183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:16:17.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8848 sec 2024-03-28T08:16:18.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8849 sec 2024-03-28T08:16:18.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:18 smithi055 ceph-mon[31863]: pgmap v5184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:18.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8177.934564 secs 2024-03-28T08:16:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:18 smithi086 ceph-mon[35163]: pgmap v5184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8177.934564 secs 2024-03-28T08:16:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:18 smithi159 ceph-mon[36109]: pgmap v5184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8177.934564 secs 2024-03-28T08:16:19.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8850 sec 2024-03-28T08:16:20.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8851 sec 2024-03-28T08:16:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:20 smithi086 ceph-mon[35163]: pgmap v5185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:20 smithi159 ceph-mon[36109]: pgmap v5185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:20 smithi055 ceph-mon[31863]: pgmap v5185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:21.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8852 sec 2024-03-28T08:16:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:21 smithi086 ceph-mon[35163]: pgmap v5186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:21 smithi159 ceph-mon[36109]: pgmap v5186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:21 smithi055 ceph-mon[31863]: pgmap v5186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:22.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8853 sec 2024-03-28T08:16:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8182.934682 secs 2024-03-28T08:16:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8182.934682 secs 2024-03-28T08:16:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8182.934682 secs 2024-03-28T08:16:23.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8854 sec 2024-03-28T08:16:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:23 smithi086 ceph-mon[35163]: pgmap v5187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:23 smithi159 ceph-mon[36109]: pgmap v5187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:23 smithi055 ceph-mon[31863]: pgmap v5187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:24.335 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8855 sec 2024-03-28T08:16:25.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8856 sec 2024-03-28T08:16:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:25 smithi086 ceph-mon[35163]: pgmap v5188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:25 smithi159 ceph-mon[36109]: pgmap v5188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:25 smithi055 ceph-mon[31863]: pgmap v5188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:26.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8857 sec 2024-03-28T08:16:27.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8858 sec 2024-03-28T08:16:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:27 smithi086 ceph-mon[35163]: pgmap v5189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8187.934830 secs 2024-03-28T08:16:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:27 smithi159 ceph-mon[36109]: pgmap v5189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8187.934830 secs 2024-03-28T08:16:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:27 smithi055 ceph-mon[31863]: pgmap v5189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8187.934830 secs 2024-03-28T08:16:28.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8859 sec 2024-03-28T08:16:29.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8860 sec 2024-03-28T08:16:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:29 smithi086 ceph-mon[35163]: pgmap v5190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:29 smithi159 ceph-mon[36109]: pgmap v5190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:29 smithi055 ceph-mon[31863]: pgmap v5190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:30.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8861 sec 2024-03-28T08:16:31.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8862 sec 2024-03-28T08:16:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:31 smithi055 ceph-mon[31863]: pgmap v5191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:31 smithi086 ceph-mon[35163]: pgmap v5191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:31 smithi159 ceph-mon[36109]: pgmap v5191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:32.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8863 sec 2024-03-28T08:16:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8192.934914 secs 2024-03-28T08:16:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8192.934914 secs 2024-03-28T08:16:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8192.934914 secs 2024-03-28T08:16:33.336 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8864 sec 2024-03-28T08:16:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:33 smithi055 ceph-mon[31863]: pgmap v5192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:33 smithi086 ceph-mon[35163]: pgmap v5192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:33 smithi159 ceph-mon[36109]: pgmap v5192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:34.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8865 sec 2024-03-28T08:16:35.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8866 sec 2024-03-28T08:16:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:35 smithi055 ceph-mon[31863]: pgmap v5193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:35 smithi086 ceph-mon[35163]: pgmap v5193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:35 smithi159 ceph-mon[36109]: pgmap v5193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:36.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8867 sec 2024-03-28T08:16:37.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8868 sec 2024-03-28T08:16:38.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:37 smithi086 ceph-mon[35163]: pgmap v5194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:38.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8197.934978 secs 2024-03-28T08:16:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:37 smithi055 ceph-mon[31863]: pgmap v5194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8197.934978 secs 2024-03-28T08:16:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:37 smithi159 ceph-mon[36109]: pgmap v5194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8197.934978 secs 2024-03-28T08:16:38.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8869 sec 2024-03-28T08:16:39.337 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8870 sec 2024-03-28T08:16:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:39 smithi086 ceph-mon[35163]: pgmap v5195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:39 smithi159 ceph-mon[36109]: pgmap v5195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:40.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8871 sec 2024-03-28T08:16:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:39 smithi055 ceph-mon[31863]: pgmap v5195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:41.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8872 sec 2024-03-28T08:16:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:41 smithi086 ceph-mon[35163]: pgmap v5196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:41 smithi159 ceph-mon[36109]: pgmap v5196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:42.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8873 sec 2024-03-28T08:16:42.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:41 smithi055 ceph-mon[31863]: pgmap v5196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8202.935044 secs 2024-03-28T08:16:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8202.935044 secs 2024-03-28T08:16:43.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8874 sec 2024-03-28T08:16:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8202.935044 secs 2024-03-28T08:16:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:43 smithi086 ceph-mon[35163]: pgmap v5197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:43 smithi159 ceph-mon[36109]: pgmap v5197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:44.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8875 sec 2024-03-28T08:16:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:43 smithi055 ceph-mon[31863]: pgmap v5197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:45.338 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8876 sec 2024-03-28T08:16:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:45 smithi086 ceph-mon[35163]: pgmap v5198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:45 smithi159 ceph-mon[36109]: pgmap v5198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:46.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8877 sec 2024-03-28T08:16:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:45 smithi055 ceph-mon[31863]: pgmap v5198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:47.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8878 sec 2024-03-28T08:16:48.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:47 smithi055 ceph-mon[31863]: pgmap v5199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:48.177 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8207.935108 secs 2024-03-28T08:16:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:47 smithi086 ceph-mon[35163]: pgmap v5199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8207.935108 secs 2024-03-28T08:16:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:47 smithi159 ceph-mon[36109]: pgmap v5199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8207.935108 secs 2024-03-28T08:16:48.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8879 sec 2024-03-28T08:16:49.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8880 sec 2024-03-28T08:16:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:49 smithi086 ceph-mon[35163]: pgmap v5200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:49 smithi159 ceph-mon[36109]: pgmap v5200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:50.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8881 sec 2024-03-28T08:16:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:49 smithi055 ceph-mon[31863]: pgmap v5200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:51.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8882 sec 2024-03-28T08:16:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:51 smithi086 ceph-mon[35163]: pgmap v5201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:51 smithi159 ceph-mon[36109]: pgmap v5201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:52.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8883 sec 2024-03-28T08:16:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:51 smithi055 ceph-mon[31863]: pgmap v5201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8212.935193 secs 2024-03-28T08:16:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8212.935193 secs 2024-03-28T08:16:53.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8884 sec 2024-03-28T08:16:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8212.935193 secs 2024-03-28T08:16:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:53 smithi086 ceph-mon[35163]: pgmap v5202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:53 smithi159 ceph-mon[36109]: pgmap v5202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:54.339 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8885 sec 2024-03-28T08:16:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:53 smithi055 ceph-mon[31863]: pgmap v5202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:55.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8886 sec 2024-03-28T08:16:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:55 smithi086 ceph-mon[35163]: pgmap v5203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:55 smithi159 ceph-mon[36109]: pgmap v5203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:56.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8887 sec 2024-03-28T08:16:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:55 smithi055 ceph-mon[31863]: pgmap v5203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:16:57.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8888 sec 2024-03-28T08:16:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:57 smithi086 ceph-mon[35163]: pgmap v5204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8217.935286 secs 2024-03-28T08:16:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:57 smithi159 ceph-mon[36109]: pgmap v5204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8217.935286 secs 2024-03-28T08:16:58.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8889 sec 2024-03-28T08:16:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:57 smithi055 ceph-mon[31863]: pgmap v5204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:16:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8217.935286 secs 2024-03-28T08:16:59.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8890 sec 2024-03-28T08:17:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:16:59 smithi086 ceph-mon[35163]: pgmap v5205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:16:59 smithi159 ceph-mon[36109]: pgmap v5205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:00.340 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8891 sec 2024-03-28T08:17:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:16:59 smithi055 ceph-mon[31863]: pgmap v5205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:01.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8892 sec 2024-03-28T08:17:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:01 smithi086 ceph-mon[35163]: pgmap v5206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:01 smithi159 ceph-mon[36109]: pgmap v5206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:02.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8893 sec 2024-03-28T08:17:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:01 smithi055 ceph-mon[31863]: pgmap v5206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8222.935349 secs 2024-03-28T08:17:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8222.935349 secs 2024-03-28T08:17:03.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8894 sec 2024-03-28T08:17:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8222.935349 secs 2024-03-28T08:17:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:03 smithi086 ceph-mon[35163]: pgmap v5207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:03 smithi159 ceph-mon[36109]: pgmap v5207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:04.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8895 sec 2024-03-28T08:17:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:03 smithi055 ceph-mon[31863]: pgmap v5207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:05.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8896 sec 2024-03-28T08:17:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:06 smithi086 ceph-mon[35163]: pgmap v5208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:17:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:06 smithi159 ceph-mon[36109]: pgmap v5208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:17:06.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8897 sec 2024-03-28T08:17:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:06 smithi055 ceph-mon[31863]: pgmap v5208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:17:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:17:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:17:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:07 smithi086 ceph-mon[35163]: pgmap v5209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:07 smithi086 ceph-mon[35163]: pgmap v5210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:17:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:17:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:17:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:07 smithi159 ceph-mon[36109]: pgmap v5209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:07 smithi159 ceph-mon[36109]: pgmap v5210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:17:07.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8898 sec 2024-03-28T08:17:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:17:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:17:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:07 smithi055 ceph-mon[31863]: pgmap v5209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:07 smithi055 ceph-mon[31863]: pgmap v5210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:17:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8227.935414 secs 2024-03-28T08:17:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8227.935414 secs 2024-03-28T08:17:08.341 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8899 sec 2024-03-28T08:17:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8227.935414 secs 2024-03-28T08:17:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:09 smithi086 ceph-mon[35163]: pgmap v5211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:09 smithi159 ceph-mon[36109]: pgmap v5211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:09.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8900 sec 2024-03-28T08:17:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:09 smithi055 ceph-mon[31863]: pgmap v5211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:10.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8901 sec 2024-03-28T08:17:11.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8902 sec 2024-03-28T08:17:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:11 smithi055 ceph-mon[31863]: pgmap v5212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:11 smithi086 ceph-mon[35163]: pgmap v5212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:11 smithi159 ceph-mon[36109]: pgmap v5212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:12.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8903 sec 2024-03-28T08:17:13.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8904 sec 2024-03-28T08:17:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8232.935488 secs 2024-03-28T08:17:13.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:13 smithi055 ceph-mon[31863]: pgmap v5213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:17:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8232.935488 secs 2024-03-28T08:17:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:13 smithi086 ceph-mon[35163]: pgmap v5213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:17:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8232.935488 secs 2024-03-28T08:17:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:13 smithi159 ceph-mon[36109]: pgmap v5213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:17:14.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8905 sec 2024-03-28T08:17:15.342 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8906 sec 2024-03-28T08:17:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:15 smithi086 ceph-mon[35163]: pgmap v5214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:15 smithi159 ceph-mon[36109]: pgmap v5214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:15 smithi055 ceph-mon[31863]: pgmap v5214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:17:16.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8907 sec 2024-03-28T08:17:17.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8908 sec 2024-03-28T08:17:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:17 smithi086 ceph-mon[35163]: pgmap v5215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:17 smithi159 ceph-mon[36109]: pgmap v5215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:17 smithi055 ceph-mon[31863]: pgmap v5215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:17:18.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8909 sec 2024-03-28T08:17:18.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8237.935552 secs 2024-03-28T08:17:19.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8237.935552 secs 2024-03-28T08:17:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8237.935552 secs 2024-03-28T08:17:19.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8910 sec 2024-03-28T08:17:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:19 smithi086 ceph-mon[35163]: pgmap v5216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:19 smithi159 ceph-mon[36109]: pgmap v5216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:19 smithi055 ceph-mon[31863]: pgmap v5216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:20.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8911 sec 2024-03-28T08:17:21.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8912 sec 2024-03-28T08:17:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:21 smithi086 ceph-mon[35163]: pgmap v5217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:21 smithi159 ceph-mon[36109]: pgmap v5217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:21 smithi055 ceph-mon[31863]: pgmap v5217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:22.343 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8913 sec 2024-03-28T08:17:23.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8914 sec 2024-03-28T08:17:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8242.935676 secs 2024-03-28T08:17:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:23 smithi086 ceph-mon[35163]: pgmap v5218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8242.935676 secs 2024-03-28T08:17:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:23 smithi159 ceph-mon[36109]: pgmap v5218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8242.935676 secs 2024-03-28T08:17:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:23 smithi055 ceph-mon[31863]: pgmap v5218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:24.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8915 sec 2024-03-28T08:17:25.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8916 sec 2024-03-28T08:17:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:25 smithi086 ceph-mon[35163]: pgmap v5219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:25 smithi159 ceph-mon[36109]: pgmap v5219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:25 smithi055 ceph-mon[31863]: pgmap v5219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:26.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8917 sec 2024-03-28T08:17:27.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8918 sec 2024-03-28T08:17:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:27 smithi086 ceph-mon[35163]: pgmap v5220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8247.935818 secs 2024-03-28T08:17:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:27 smithi159 ceph-mon[36109]: pgmap v5220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8247.935818 secs 2024-03-28T08:17:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:27 smithi055 ceph-mon[31863]: pgmap v5220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8247.935818 secs 2024-03-28T08:17:28.344 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8919 sec 2024-03-28T08:17:29.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8920 sec 2024-03-28T08:17:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:29 smithi086 ceph-mon[35163]: pgmap v5221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:29 smithi159 ceph-mon[36109]: pgmap v5221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:29 smithi055 ceph-mon[31863]: pgmap v5221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:30.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8921 sec 2024-03-28T08:17:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:30 smithi086 ceph-mon[35163]: pgmap v5222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:30 smithi159 ceph-mon[36109]: pgmap v5222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:30 smithi055 ceph-mon[31863]: pgmap v5222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:31.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8922 sec 2024-03-28T08:17:32.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8923 sec 2024-03-28T08:17:33.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8924 sec 2024-03-28T08:17:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8252.935938 secs 2024-03-28T08:17:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:33 smithi086 ceph-mon[35163]: pgmap v5223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8252.935938 secs 2024-03-28T08:17:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:33 smithi159 ceph-mon[36109]: pgmap v5223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8252.935938 secs 2024-03-28T08:17:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:33 smithi055 ceph-mon[31863]: pgmap v5223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:34.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8925 sec 2024-03-28T08:17:35.345 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8926 sec 2024-03-28T08:17:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:35 smithi086 ceph-mon[35163]: pgmap v5224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:35 smithi159 ceph-mon[36109]: pgmap v5224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:35 smithi055 ceph-mon[31863]: pgmap v5224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:36.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8927 sec 2024-03-28T08:17:37.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8928 sec 2024-03-28T08:17:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:37 smithi086 ceph-mon[35163]: pgmap v5225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:37 smithi159 ceph-mon[36109]: pgmap v5225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:37 smithi055 ceph-mon[31863]: pgmap v5225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:38.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8929 sec 2024-03-28T08:17:38.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8257.936014 secs 2024-03-28T08:17:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8257.936014 secs 2024-03-28T08:17:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8257.936014 secs 2024-03-28T08:17:39.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8930 sec 2024-03-28T08:17:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:39 smithi086 ceph-mon[35163]: pgmap v5226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:39 smithi159 ceph-mon[36109]: pgmap v5226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:39 smithi055 ceph-mon[31863]: pgmap v5226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:40.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8931 sec 2024-03-28T08:17:41.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8932 sec 2024-03-28T08:17:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:41 smithi086 ceph-mon[35163]: pgmap v5227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:41 smithi159 ceph-mon[36109]: pgmap v5227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:41 smithi055 ceph-mon[31863]: pgmap v5227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:42.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8933 sec 2024-03-28T08:17:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8262.936106 secs 2024-03-28T08:17:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8262.936106 secs 2024-03-28T08:17:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8262.936106 secs 2024-03-28T08:17:43.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8934 sec 2024-03-28T08:17:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:43 smithi086 ceph-mon[35163]: pgmap v5228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:43 smithi159 ceph-mon[36109]: pgmap v5228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:43 smithi055 ceph-mon[31863]: pgmap v5228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:44.346 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8935 sec 2024-03-28T08:17:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:44 smithi086 ceph-mon[35163]: pgmap v5229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:44 smithi159 ceph-mon[36109]: pgmap v5229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:44 smithi055 ceph-mon[31863]: pgmap v5229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:45.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8936 sec 2024-03-28T08:17:46.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8937 sec 2024-03-28T08:17:47.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8938 sec 2024-03-28T08:17:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:47 smithi086 ceph-mon[35163]: pgmap v5230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:47 smithi159 ceph-mon[36109]: pgmap v5230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:47 smithi055 ceph-mon[31863]: pgmap v5230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:48.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8939 sec 2024-03-28T08:17:48.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8267.936193 secs 2024-03-28T08:17:49.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8267.936193 secs 2024-03-28T08:17:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8267.936193 secs 2024-03-28T08:17:49.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8940 sec 2024-03-28T08:17:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:49 smithi086 ceph-mon[35163]: pgmap v5231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:49 smithi159 ceph-mon[36109]: pgmap v5231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:49 smithi055 ceph-mon[31863]: pgmap v5231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:50.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8941 sec 2024-03-28T08:17:51.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8942 sec 2024-03-28T08:17:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:51 smithi086 ceph-mon[35163]: pgmap v5232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:51 smithi159 ceph-mon[36109]: pgmap v5232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:51 smithi055 ceph-mon[31863]: pgmap v5232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:17:52.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8943 sec 2024-03-28T08:17:53.347 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8944 sec 2024-03-28T08:17:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8272.936301 secs 2024-03-28T08:17:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:53 smithi086 ceph-mon[35163]: pgmap v5233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8272.936301 secs 2024-03-28T08:17:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:53 smithi159 ceph-mon[36109]: pgmap v5233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8272.936301 secs 2024-03-28T08:17:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:53 smithi055 ceph-mon[31863]: pgmap v5233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:17:54.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8945 sec 2024-03-28T08:17:55.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8946 sec 2024-03-28T08:17:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:55 smithi086 ceph-mon[35163]: pgmap v5234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:55 smithi159 ceph-mon[36109]: pgmap v5234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:55 smithi055 ceph-mon[31863]: pgmap v5234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:56.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8947 sec 2024-03-28T08:17:57.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8948 sec 2024-03-28T08:17:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:57 smithi086 ceph-mon[35163]: pgmap v5235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8277.936365 secs 2024-03-28T08:17:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:57 smithi159 ceph-mon[36109]: pgmap v5235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8277.936365 secs 2024-03-28T08:17:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:57 smithi055 ceph-mon[31863]: pgmap v5235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8277.936365 secs 2024-03-28T08:17:58.348 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8949 sec 2024-03-28T08:17:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:17:58 smithi086 ceph-mon[35163]: pgmap v5236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:17:58 smithi159 ceph-mon[36109]: pgmap v5236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:17:58 smithi055 ceph-mon[31863]: pgmap v5236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:17:59.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8950 sec 2024-03-28T08:18:00.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8951 sec 2024-03-28T08:18:01.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8952 sec 2024-03-28T08:18:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:01 smithi086 ceph-mon[35163]: pgmap v5237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:01 smithi159 ceph-mon[36109]: pgmap v5237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:01 smithi055 ceph-mon[31863]: pgmap v5237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:02.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8953 sec 2024-03-28T08:18:03.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8954 sec 2024-03-28T08:18:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8282.936490 secs 2024-03-28T08:18:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:03 smithi086 ceph-mon[35163]: pgmap v5238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8282.936490 secs 2024-03-28T08:18:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:03 smithi159 ceph-mon[36109]: pgmap v5238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8282.936490 secs 2024-03-28T08:18:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:03 smithi055 ceph-mon[31863]: pgmap v5238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:04.349 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8955 sec 2024-03-28T08:18:05.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8956 sec 2024-03-28T08:18:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:05 smithi086 ceph-mon[35163]: pgmap v5239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:05 smithi159 ceph-mon[36109]: pgmap v5239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:05 smithi055 ceph-mon[31863]: pgmap v5239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:06.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8957 sec 2024-03-28T08:18:07.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8958 sec 2024-03-28T08:18:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:07 smithi086 ceph-mon[35163]: pgmap v5240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:18:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:07 smithi159 ceph-mon[36109]: pgmap v5240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:18:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:07 smithi055 ceph-mon[31863]: pgmap v5240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:18:08.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8959 sec 2024-03-28T08:18:08.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8287.936613 secs 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:18:08.971 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:18:08.972 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:18:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8287.936613 secs 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.090 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:18:09.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:18:09.091 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8287.936613 secs 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:18:09.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:18:09.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8960 sec 2024-03-28T08:18:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:18:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:18:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:18:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:18:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: pgmap v5241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:09 smithi086 ceph-mon[35163]: pgmap v5242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:18:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:18:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:18:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:18:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: pgmap v5241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:10.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:09 smithi159 ceph-mon[36109]: pgmap v5242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:18:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:18:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:18:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:18:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: pgmap v5241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:10.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:09 smithi055 ceph-mon[31863]: pgmap v5242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:10.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8961 sec 2024-03-28T08:18:11.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8962 sec 2024-03-28T08:18:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:11 smithi086 ceph-mon[35163]: pgmap v5243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:11 smithi159 ceph-mon[36109]: pgmap v5243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:11 smithi055 ceph-mon[31863]: pgmap v5243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:12.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8963 sec 2024-03-28T08:18:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8292.936642 secs 2024-03-28T08:18:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8292.936642 secs 2024-03-28T08:18:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8292.936642 secs 2024-03-28T08:18:13.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8964 sec 2024-03-28T08:18:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:13 smithi086 ceph-mon[35163]: pgmap v5244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:13 smithi159 ceph-mon[36109]: pgmap v5244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:13 smithi055 ceph-mon[31863]: pgmap v5244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:14.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8965 sec 2024-03-28T08:18:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:14 smithi086 ceph-mon[35163]: pgmap v5245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:14 smithi159 ceph-mon[36109]: pgmap v5245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:14 smithi055 ceph-mon[31863]: pgmap v5245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:15.350 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8966 sec 2024-03-28T08:18:16.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8967 sec 2024-03-28T08:18:17.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8968 sec 2024-03-28T08:18:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:17 smithi086 ceph-mon[35163]: pgmap v5246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:17 smithi159 ceph-mon[36109]: pgmap v5246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:17 smithi055 ceph-mon[31863]: pgmap v5246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:18:18.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8969 sec 2024-03-28T08:18:18.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8297.936708 secs 2024-03-28T08:18:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8297.936708 secs 2024-03-28T08:18:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8297.936708 secs 2024-03-28T08:18:19.351 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8970 sec 2024-03-28T08:18:19.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:19 smithi055 ceph-mon[31863]: pgmap v5247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:18:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:19 smithi086 ceph-mon[35163]: pgmap v5247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:18:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:19 smithi159 ceph-mon[36109]: pgmap v5247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:18:20.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8971 sec 2024-03-28T08:18:21.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8972 sec 2024-03-28T08:18:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:21 smithi086 ceph-mon[35163]: pgmap v5248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:21 smithi159 ceph-mon[36109]: pgmap v5248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:21 smithi055 ceph-mon[31863]: pgmap v5248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:22.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8973 sec 2024-03-28T08:18:23.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8974 sec 2024-03-28T08:18:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:23 smithi086 ceph-mon[35163]: pgmap v5249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8302.936773 secs 2024-03-28T08:18:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:23 smithi159 ceph-mon[36109]: pgmap v5249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8302.936773 secs 2024-03-28T08:18:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:23 smithi055 ceph-mon[31863]: pgmap v5249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8302.936773 secs 2024-03-28T08:18:24.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8975 sec 2024-03-28T08:18:25.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8976 sec 2024-03-28T08:18:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:25 smithi086 ceph-mon[35163]: pgmap v5250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:25 smithi159 ceph-mon[36109]: pgmap v5250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:25 smithi055 ceph-mon[31863]: pgmap v5250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:26.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8977 sec 2024-03-28T08:18:27.352 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8978 sec 2024-03-28T08:18:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:27 smithi086 ceph-mon[35163]: pgmap v5251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:27 smithi159 ceph-mon[36109]: pgmap v5251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:27 smithi055 ceph-mon[31863]: pgmap v5251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:28.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8979 sec 2024-03-28T08:18:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8307.936897 secs 2024-03-28T08:18:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8307.936897 secs 2024-03-28T08:18:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8307.936897 secs 2024-03-28T08:18:29.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8980 sec 2024-03-28T08:18:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:29 smithi086 ceph-mon[35163]: pgmap v5252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:29 smithi159 ceph-mon[36109]: pgmap v5252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:29 smithi055 ceph-mon[31863]: pgmap v5252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:30.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8981 sec 2024-03-28T08:18:31.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8982 sec 2024-03-28T08:18:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:31 smithi086 ceph-mon[35163]: pgmap v5253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:31 smithi159 ceph-mon[36109]: pgmap v5253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:31 smithi055 ceph-mon[31863]: pgmap v5253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:32.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8983 sec 2024-03-28T08:18:33.353 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8984 sec 2024-03-28T08:18:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:33 smithi086 ceph-mon[35163]: pgmap v5254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8312.936979 secs 2024-03-28T08:18:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:33 smithi159 ceph-mon[36109]: pgmap v5254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8312.936979 secs 2024-03-28T08:18:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:33 smithi055 ceph-mon[31863]: pgmap v5254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8312.936979 secs 2024-03-28T08:18:34.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8985 sec 2024-03-28T08:18:35.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8986 sec 2024-03-28T08:18:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:35 smithi086 ceph-mon[35163]: pgmap v5255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:35 smithi159 ceph-mon[36109]: pgmap v5255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:35 smithi055 ceph-mon[31863]: pgmap v5255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:36.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8987 sec 2024-03-28T08:18:37.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8988 sec 2024-03-28T08:18:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:37 smithi086 ceph-mon[35163]: pgmap v5256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:37 smithi159 ceph-mon[36109]: pgmap v5256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:37 smithi055 ceph-mon[31863]: pgmap v5256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:38.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8989 sec 2024-03-28T08:18:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8317.937050 secs 2024-03-28T08:18:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8317.937050 secs 2024-03-28T08:18:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8317.937050 secs 2024-03-28T08:18:39.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8990 sec 2024-03-28T08:18:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:39 smithi086 ceph-mon[35163]: pgmap v5257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:39 smithi159 ceph-mon[36109]: pgmap v5257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:39 smithi055 ceph-mon[31863]: pgmap v5257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:40.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8991 sec 2024-03-28T08:18:41.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8992 sec 2024-03-28T08:18:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:41 smithi086 ceph-mon[35163]: pgmap v5258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:41 smithi159 ceph-mon[36109]: pgmap v5258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:41 smithi055 ceph-mon[31863]: pgmap v5258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:42.354 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8993 sec 2024-03-28T08:18:43.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8994 sec 2024-03-28T08:18:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:43 smithi086 ceph-mon[35163]: pgmap v5259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8322.937185 secs 2024-03-28T08:18:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:43 smithi159 ceph-mon[36109]: pgmap v5259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8322.937185 secs 2024-03-28T08:18:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:43 smithi055 ceph-mon[31863]: pgmap v5259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8322.937185 secs 2024-03-28T08:18:44.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8995 sec 2024-03-28T08:18:45.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8996 sec 2024-03-28T08:18:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:45 smithi086 ceph-mon[35163]: pgmap v5260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:45 smithi159 ceph-mon[36109]: pgmap v5260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:45 smithi055 ceph-mon[31863]: pgmap v5260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:46.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8997 sec 2024-03-28T08:18:47.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8998 sec 2024-03-28T08:18:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:47 smithi086 ceph-mon[35163]: pgmap v5261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:47 smithi159 ceph-mon[36109]: pgmap v5261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:47 smithi055 ceph-mon[31863]: pgmap v5261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:48.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 8999 sec 2024-03-28T08:18:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8327.937297 secs 2024-03-28T08:18:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8327.937297 secs 2024-03-28T08:18:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8327.937297 secs 2024-03-28T08:18:49.355 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9000 sec 2024-03-28T08:18:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:49 smithi086 ceph-mon[35163]: pgmap v5262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:49 smithi159 ceph-mon[36109]: pgmap v5262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:49 smithi055 ceph-mon[31863]: pgmap v5262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:50.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9001 sec 2024-03-28T08:18:51.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9002 sec 2024-03-28T08:18:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:51 smithi086 ceph-mon[35163]: pgmap v5263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:51 smithi159 ceph-mon[36109]: pgmap v5263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:51 smithi055 ceph-mon[31863]: pgmap v5263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:18:52.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9003 sec 2024-03-28T08:18:53.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9004 sec 2024-03-28T08:18:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:53 smithi086 ceph-mon[35163]: pgmap v5264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8332.937421 secs 2024-03-28T08:18:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:53 smithi159 ceph-mon[36109]: pgmap v5264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8332.937421 secs 2024-03-28T08:18:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:53 smithi055 ceph-mon[31863]: pgmap v5264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:18:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8332.937421 secs 2024-03-28T08:18:54.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9005 sec 2024-03-28T08:18:55.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9006 sec 2024-03-28T08:18:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:55 smithi055 ceph-mon[31863]: pgmap v5265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:55 smithi086 ceph-mon[35163]: pgmap v5265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:55 smithi159 ceph-mon[36109]: pgmap v5265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:56.356 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9007 sec 2024-03-28T08:18:57.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9008 sec 2024-03-28T08:18:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:57 smithi055 ceph-mon[31863]: pgmap v5266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:57 smithi086 ceph-mon[35163]: pgmap v5266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:57 smithi159 ceph-mon[36109]: pgmap v5266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:18:58.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9009 sec 2024-03-28T08:18:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8337.937497 secs 2024-03-28T08:18:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8337.937497 secs 2024-03-28T08:18:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8337.937497 secs 2024-03-28T08:18:59.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9010 sec 2024-03-28T08:18:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:18:59 smithi055 ceph-mon[31863]: pgmap v5267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:18:59 smithi086 ceph-mon[35163]: pgmap v5267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:18:59 smithi159 ceph-mon[36109]: pgmap v5267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:00.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9011 sec 2024-03-28T08:19:01.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9012 sec 2024-03-28T08:19:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:01 smithi055 ceph-mon[31863]: pgmap v5268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:19:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:01 smithi086 ceph-mon[35163]: pgmap v5268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:19:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:01 smithi159 ceph-mon[36109]: pgmap v5268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:19:02.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9013 sec 2024-03-28T08:19:03.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9014 sec 2024-03-28T08:19:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:03 smithi055 ceph-mon[31863]: pgmap v5269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8342.937578 secs 2024-03-28T08:19:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:03 smithi086 ceph-mon[35163]: pgmap v5269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8342.937578 secs 2024-03-28T08:19:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:03 smithi159 ceph-mon[36109]: pgmap v5269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8342.937578 secs 2024-03-28T08:19:04.357 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9015 sec 2024-03-28T08:19:05.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9016 sec 2024-03-28T08:19:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:05 smithi086 ceph-mon[35163]: pgmap v5270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:05 smithi159 ceph-mon[36109]: pgmap v5270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:05 smithi055 ceph-mon[31863]: pgmap v5270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:06.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9017 sec 2024-03-28T08:19:07.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9018 sec 2024-03-28T08:19:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:07 smithi086 ceph-mon[35163]: pgmap v5271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:07 smithi159 ceph-mon[36109]: pgmap v5271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:07 smithi055 ceph-mon[31863]: pgmap v5271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:08.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9019 sec 2024-03-28T08:19:08.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8347.937603 secs 2024-03-28T08:19:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8347.937603 secs 2024-03-28T08:19:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8347.937603 secs 2024-03-28T08:19:09.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9020 sec 2024-03-28T08:19:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:09 smithi086 ceph-mon[35163]: pgmap v5272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:19:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:09 smithi159 ceph-mon[36109]: pgmap v5272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:19:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:09 smithi055 ceph-mon[31863]: pgmap v5272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:19:10.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9021 sec 2024-03-28T08:19:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:19:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:19:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:19:11.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:19:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:19:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:19:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:19:11.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:19:11.358 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9022 sec 2024-03-28T08:19:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:11 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:19:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:11 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:19:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:11 smithi086 ceph-mon[35163]: pgmap v5273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:11 smithi086 ceph-mon[35163]: pgmap v5274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:19:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:11 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:19:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:11 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:19:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:11 smithi159 ceph-mon[36109]: pgmap v5273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:11 smithi159 ceph-mon[36109]: pgmap v5274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:19:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:11 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:19:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:11 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:19:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:11 smithi055 ceph-mon[31863]: pgmap v5273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:11 smithi055 ceph-mon[31863]: pgmap v5274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:19:12.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9023 sec 2024-03-28T08:19:13.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9024 sec 2024-03-28T08:19:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:13 smithi086 ceph-mon[35163]: pgmap v5275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8352.937723 secs 2024-03-28T08:19:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:13 smithi159 ceph-mon[36109]: pgmap v5275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8352.937723 secs 2024-03-28T08:19:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:13 smithi055 ceph-mon[31863]: pgmap v5275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8352.937723 secs 2024-03-28T08:19:14.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9025 sec 2024-03-28T08:19:15.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9026 sec 2024-03-28T08:19:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:15 smithi086 ceph-mon[35163]: pgmap v5276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:15 smithi159 ceph-mon[36109]: pgmap v5276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:15 smithi055 ceph-mon[31863]: pgmap v5276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:16.359 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9027 sec 2024-03-28T08:19:17.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9028 sec 2024-03-28T08:19:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:17 smithi086 ceph-mon[35163]: pgmap v5277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8357.937853 secs 2024-03-28T08:19:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:17 smithi159 ceph-mon[36109]: pgmap v5277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8357.937853 secs 2024-03-28T08:19:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:17 smithi055 ceph-mon[31863]: pgmap v5277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8357.937853 secs 2024-03-28T08:19:18.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9029 sec 2024-03-28T08:19:19.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9030 sec 2024-03-28T08:19:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:19 smithi086 ceph-mon[35163]: pgmap v5278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:19 smithi159 ceph-mon[36109]: pgmap v5278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:19 smithi055 ceph-mon[31863]: pgmap v5278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:19:20.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9031 sec 2024-03-28T08:19:21.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9032 sec 2024-03-28T08:19:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:21 smithi086 ceph-mon[35163]: pgmap v5279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:19:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:21 smithi159 ceph-mon[36109]: pgmap v5279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:19:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:21 smithi055 ceph-mon[31863]: pgmap v5279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:19:22.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9033 sec 2024-03-28T08:19:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8362.937944 secs 2024-03-28T08:19:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8362.937944 secs 2024-03-28T08:19:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8362.937944 secs 2024-03-28T08:19:23.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9034 sec 2024-03-28T08:19:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:23 smithi086 ceph-mon[35163]: pgmap v5280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:23 smithi159 ceph-mon[36109]: pgmap v5280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:23 smithi055 ceph-mon[31863]: pgmap v5280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:24.360 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9035 sec 2024-03-28T08:19:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:24 smithi086 ceph-mon[35163]: pgmap v5281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:24 smithi159 ceph-mon[36109]: pgmap v5281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:24 smithi055 ceph-mon[31863]: pgmap v5281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:25.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9036 sec 2024-03-28T08:19:26.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9037 sec 2024-03-28T08:19:27.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9038 sec 2024-03-28T08:19:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:27 smithi086 ceph-mon[35163]: pgmap v5282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:27 smithi159 ceph-mon[36109]: pgmap v5282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:27 smithi055 ceph-mon[31863]: pgmap v5282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:28.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9039 sec 2024-03-28T08:19:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8367.938064 secs 2024-03-28T08:19:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8367.938064 secs 2024-03-28T08:19:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8367.938064 secs 2024-03-28T08:19:29.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9040 sec 2024-03-28T08:19:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:29 smithi086 ceph-mon[35163]: pgmap v5283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:29 smithi159 ceph-mon[36109]: pgmap v5283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:29 smithi055 ceph-mon[31863]: pgmap v5283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:30.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9041 sec 2024-03-28T08:19:31.361 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9042 sec 2024-03-28T08:19:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:31 smithi086 ceph-mon[35163]: pgmap v5284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:31 smithi159 ceph-mon[36109]: pgmap v5284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:31 smithi055 ceph-mon[31863]: pgmap v5284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:32.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9043 sec 2024-03-28T08:19:33.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9044 sec 2024-03-28T08:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:33 smithi086 ceph-mon[35163]: pgmap v5285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8372.938138 secs 2024-03-28T08:19:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:33 smithi159 ceph-mon[36109]: pgmap v5285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8372.938138 secs 2024-03-28T08:19:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:33 smithi055 ceph-mon[31863]: pgmap v5285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8372.938138 secs 2024-03-28T08:19:34.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9045 sec 2024-03-28T08:19:35.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9046 sec 2024-03-28T08:19:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:35 smithi086 ceph-mon[35163]: pgmap v5286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:35 smithi159 ceph-mon[36109]: pgmap v5286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:35 smithi055 ceph-mon[31863]: pgmap v5286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:36.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9047 sec 2024-03-28T08:19:37.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9048 sec 2024-03-28T08:19:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:37 smithi086 ceph-mon[35163]: pgmap v5287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:37 smithi159 ceph-mon[36109]: pgmap v5287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:37 smithi055 ceph-mon[31863]: pgmap v5287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:38.362 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9049 sec 2024-03-28T08:19:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8377.938204 secs 2024-03-28T08:19:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8377.938204 secs 2024-03-28T08:19:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8377.938204 secs 2024-03-28T08:19:39.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9050 sec 2024-03-28T08:19:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:39 smithi086 ceph-mon[35163]: pgmap v5288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:39 smithi159 ceph-mon[36109]: pgmap v5288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:39 smithi055 ceph-mon[31863]: pgmap v5288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:40.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9051 sec 2024-03-28T08:19:41.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9052 sec 2024-03-28T08:19:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:41 smithi055 ceph-mon[31863]: pgmap v5289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:41 smithi086 ceph-mon[35163]: pgmap v5289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:41 smithi159 ceph-mon[36109]: pgmap v5289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:42.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9053 sec 2024-03-28T08:19:43.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9054 sec 2024-03-28T08:19:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:43 smithi055 ceph-mon[31863]: pgmap v5290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:43.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8382.938270 secs 2024-03-28T08:19:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:43 smithi086 ceph-mon[35163]: pgmap v5290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8382.938270 secs 2024-03-28T08:19:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:43 smithi159 ceph-mon[36109]: pgmap v5290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8382.938270 secs 2024-03-28T08:19:44.363 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9055 sec 2024-03-28T08:19:45.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9056 sec 2024-03-28T08:19:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:45 smithi055 ceph-mon[31863]: pgmap v5291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:45 smithi086 ceph-mon[35163]: pgmap v5291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:45 smithi159 ceph-mon[36109]: pgmap v5291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:46.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9057 sec 2024-03-28T08:19:47.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9058 sec 2024-03-28T08:19:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:47 smithi055 ceph-mon[31863]: pgmap v5292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:47 smithi086 ceph-mon[35163]: pgmap v5292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:47 smithi159 ceph-mon[36109]: pgmap v5292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:48.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9059 sec 2024-03-28T08:19:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8387.938337 secs 2024-03-28T08:19:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8387.938337 secs 2024-03-28T08:19:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8387.938337 secs 2024-03-28T08:19:49.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9060 sec 2024-03-28T08:19:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:49 smithi055 ceph-mon[31863]: pgmap v5293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:49.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:49 smithi159 ceph-mon[36109]: pgmap v5293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:49 smithi086 ceph-mon[35163]: pgmap v5293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:50.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9061 sec 2024-03-28T08:19:51.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9062 sec 2024-03-28T08:19:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:51 smithi055 ceph-mon[31863]: pgmap v5294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:51 smithi086 ceph-mon[35163]: pgmap v5294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:51 smithi159 ceph-mon[36109]: pgmap v5294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:19:52.364 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9063 sec 2024-03-28T08:19:53.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9064 sec 2024-03-28T08:19:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:53 smithi086 ceph-mon[35163]: pgmap v5295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8392.938458 secs 2024-03-28T08:19:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:53 smithi159 ceph-mon[36109]: pgmap v5295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8392.938458 secs 2024-03-28T08:19:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:53 smithi055 ceph-mon[31863]: pgmap v5295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8392.938458 secs 2024-03-28T08:19:54.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9065 sec 2024-03-28T08:19:55.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9066 sec 2024-03-28T08:19:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:55 smithi086 ceph-mon[35163]: pgmap v5296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:55 smithi159 ceph-mon[36109]: pgmap v5296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:55 smithi055 ceph-mon[31863]: pgmap v5296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:56.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9067 sec 2024-03-28T08:19:57.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9068 sec 2024-03-28T08:19:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:57 smithi086 ceph-mon[35163]: pgmap v5297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:57 smithi159 ceph-mon[36109]: pgmap v5297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:57 smithi055 ceph-mon[31863]: pgmap v5297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:58.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9069 sec 2024-03-28T08:19:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8397.938582 secs 2024-03-28T08:19:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8397.938582 secs 2024-03-28T08:19:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8397.938582 secs 2024-03-28T08:19:59.365 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9070 sec 2024-03-28T08:19:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:19:59 smithi086 ceph-mon[35163]: pgmap v5298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:19:59 smithi159 ceph-mon[36109]: pgmap v5298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:19:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:19:59 smithi055 ceph-mon[31863]: pgmap v5298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:00.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9071 sec 2024-03-28T08:20:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:20:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:20:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:20:01.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9072 sec 2024-03-28T08:20:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:01 smithi086 ceph-mon[35163]: pgmap v5299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:01 smithi159 ceph-mon[36109]: pgmap v5299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:01 smithi055 ceph-mon[31863]: pgmap v5299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:02.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9073 sec 2024-03-28T08:20:03.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9074 sec 2024-03-28T08:20:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:03 smithi086 ceph-mon[35163]: pgmap v5300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8402.938702 secs 2024-03-28T08:20:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:03 smithi159 ceph-mon[36109]: pgmap v5300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8402.938702 secs 2024-03-28T08:20:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:03 smithi055 ceph-mon[31863]: pgmap v5300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8402.938702 secs 2024-03-28T08:20:04.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9075 sec 2024-03-28T08:20:05.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9076 sec 2024-03-28T08:20:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:05 smithi086 ceph-mon[35163]: pgmap v5301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:05 smithi159 ceph-mon[36109]: pgmap v5301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:05 smithi055 ceph-mon[31863]: pgmap v5301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:06.366 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9077 sec 2024-03-28T08:20:07.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9078 sec 2024-03-28T08:20:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:07 smithi086 ceph-mon[35163]: pgmap v5302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:07 smithi159 ceph-mon[36109]: pgmap v5302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:07 smithi055 ceph-mon[31863]: pgmap v5302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:08.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9079 sec 2024-03-28T08:20:08.721 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8407.938816 secs 2024-03-28T08:20:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8407.938816 secs 2024-03-28T08:20:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8407.938816 secs 2024-03-28T08:20:09.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9080 sec 2024-03-28T08:20:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:09 smithi086 ceph-mon[35163]: pgmap v5303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:09 smithi159 ceph-mon[36109]: pgmap v5303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:09 smithi055 ceph-mon[31863]: pgmap v5303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:10.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9081 sec 2024-03-28T08:20:11.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9082 sec 2024-03-28T08:20:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:11 smithi086 ceph-mon[35163]: pgmap v5304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:20:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:11 smithi159 ceph-mon[36109]: pgmap v5304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:20:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:11 smithi055 ceph-mon[31863]: pgmap v5304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:20:12.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9083 sec 2024-03-28T08:20:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:20:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:20:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:20:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:20:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:20:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:20:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:20:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:20:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:20:13.367 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9084 sec 2024-03-28T08:20:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:13 smithi086 ceph-mon[35163]: pgmap v5305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:13 smithi086 ceph-mon[35163]: pgmap v5306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8412.938938 secs 2024-03-28T08:20:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:13 smithi159 ceph-mon[36109]: pgmap v5305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:13 smithi159 ceph-mon[36109]: pgmap v5306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8412.938938 secs 2024-03-28T08:20:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:13 smithi055 ceph-mon[31863]: pgmap v5305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:13 smithi055 ceph-mon[31863]: pgmap v5306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8412.938938 secs 2024-03-28T08:20:14.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9085 sec 2024-03-28T08:20:15.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9086 sec 2024-03-28T08:20:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:15 smithi086 ceph-mon[35163]: pgmap v5307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:15 smithi159 ceph-mon[36109]: pgmap v5307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:15 smithi055 ceph-mon[31863]: pgmap v5307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:16.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9087 sec 2024-03-28T08:20:17.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9088 sec 2024-03-28T08:20:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:17 smithi086 ceph-mon[35163]: pgmap v5308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:17 smithi159 ceph-mon[36109]: pgmap v5308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:17 smithi055 ceph-mon[31863]: pgmap v5308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:18.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9089 sec 2024-03-28T08:20:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8417.939031 secs 2024-03-28T08:20:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8417.939031 secs 2024-03-28T08:20:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8417.939031 secs 2024-03-28T08:20:19.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9090 sec 2024-03-28T08:20:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:19 smithi086 ceph-mon[35163]: pgmap v5309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:19 smithi159 ceph-mon[36109]: pgmap v5309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:19 smithi055 ceph-mon[31863]: pgmap v5309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:20.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9091 sec 2024-03-28T08:20:21.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9092 sec 2024-03-28T08:20:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:21 smithi086 ceph-mon[35163]: pgmap v5310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:21 smithi159 ceph-mon[36109]: pgmap v5310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:21 smithi055 ceph-mon[31863]: pgmap v5310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:20:22.368 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9093 sec 2024-03-28T08:20:23.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9094 sec 2024-03-28T08:20:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:23 smithi086 ceph-mon[35163]: pgmap v5311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8422.939150 secs 2024-03-28T08:20:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:23 smithi159 ceph-mon[36109]: pgmap v5311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8422.939150 secs 2024-03-28T08:20:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:23 smithi055 ceph-mon[31863]: pgmap v5311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8422.939150 secs 2024-03-28T08:20:24.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9095 sec 2024-03-28T08:20:25.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9096 sec 2024-03-28T08:20:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:25 smithi086 ceph-mon[35163]: pgmap v5312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:25 smithi159 ceph-mon[36109]: pgmap v5312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:25 smithi055 ceph-mon[31863]: pgmap v5312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:26.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9097 sec 2024-03-28T08:20:27.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9098 sec 2024-03-28T08:20:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:27 smithi159 ceph-mon[36109]: pgmap v5313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:27 smithi086 ceph-mon[35163]: pgmap v5313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:27 smithi055 ceph-mon[31863]: pgmap v5313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:28.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9099 sec 2024-03-28T08:20:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8427.939273 secs 2024-03-28T08:20:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8427.939273 secs 2024-03-28T08:20:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8427.939273 secs 2024-03-28T08:20:29.369 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9100 sec 2024-03-28T08:20:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:29 smithi055 ceph-mon[31863]: pgmap v5314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:29 smithi086 ceph-mon[35163]: pgmap v5314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:29 smithi159 ceph-mon[36109]: pgmap v5314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:30.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9101 sec 2024-03-28T08:20:31.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9102 sec 2024-03-28T08:20:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:31 smithi055 ceph-mon[31863]: pgmap v5315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:31 smithi086 ceph-mon[35163]: pgmap v5315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:31 smithi159 ceph-mon[36109]: pgmap v5315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:32.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9103 sec 2024-03-28T08:20:33.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9104 sec 2024-03-28T08:20:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:33 smithi055 ceph-mon[31863]: pgmap v5316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8432.939336 secs 2024-03-28T08:20:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:33 smithi086 ceph-mon[35163]: pgmap v5316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8432.939336 secs 2024-03-28T08:20:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:33 smithi159 ceph-mon[36109]: pgmap v5316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8432.939336 secs 2024-03-28T08:20:34.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9105 sec 2024-03-28T08:20:35.370 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9106 sec 2024-03-28T08:20:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:35 smithi055 ceph-mon[31863]: pgmap v5317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:35 smithi086 ceph-mon[35163]: pgmap v5317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:35 smithi159 ceph-mon[36109]: pgmap v5317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:36.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9107 sec 2024-03-28T08:20:37.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9108 sec 2024-03-28T08:20:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:37 smithi055 ceph-mon[31863]: pgmap v5318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:37 smithi086 ceph-mon[35163]: pgmap v5318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:37 smithi159 ceph-mon[36109]: pgmap v5318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:38.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9109 sec 2024-03-28T08:20:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8437.939419 secs 2024-03-28T08:20:38.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8437.939419 secs 2024-03-28T08:20:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8437.939419 secs 2024-03-28T08:20:39.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9110 sec 2024-03-28T08:20:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:39 smithi055 ceph-mon[31863]: pgmap v5319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:39 smithi086 ceph-mon[35163]: pgmap v5319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:39 smithi159 ceph-mon[36109]: pgmap v5319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:40.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9111 sec 2024-03-28T08:20:41.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9112 sec 2024-03-28T08:20:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:41 smithi086 ceph-mon[35163]: pgmap v5320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:41 smithi159 ceph-mon[36109]: pgmap v5320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:41 smithi055 ceph-mon[31863]: pgmap v5320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:20:42.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9113 sec 2024-03-28T08:20:43.371 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9114 sec 2024-03-28T08:20:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:43 smithi086 ceph-mon[35163]: pgmap v5321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8442.939485 secs 2024-03-28T08:20:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:43 smithi159 ceph-mon[36109]: pgmap v5321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8442.939485 secs 2024-03-28T08:20:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:43 smithi055 ceph-mon[31863]: pgmap v5321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8442.939485 secs 2024-03-28T08:20:44.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9115 sec 2024-03-28T08:20:45.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9116 sec 2024-03-28T08:20:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:45 smithi086 ceph-mon[35163]: pgmap v5322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:45 smithi159 ceph-mon[36109]: pgmap v5322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:45 smithi055 ceph-mon[31863]: pgmap v5322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:46.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9117 sec 2024-03-28T08:20:47.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9118 sec 2024-03-28T08:20:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:47 smithi086 ceph-mon[35163]: pgmap v5323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:47 smithi159 ceph-mon[36109]: pgmap v5323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:47 smithi055 ceph-mon[31863]: pgmap v5323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:20:48.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9119 sec 2024-03-28T08:20:49.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8447.939608 secs 2024-03-28T08:20:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8447.939608 secs 2024-03-28T08:20:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8447.939608 secs 2024-03-28T08:20:49.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9120 sec 2024-03-28T08:20:49.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:49 smithi159 ceph-mon[36109]: pgmap v5324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:49 smithi086 ceph-mon[35163]: pgmap v5324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:49 smithi055 ceph-mon[31863]: pgmap v5324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:50.372 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9121 sec 2024-03-28T08:20:51.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9122 sec 2024-03-28T08:20:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:51 smithi086 ceph-mon[35163]: pgmap v5325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:20:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:51 smithi159 ceph-mon[36109]: pgmap v5325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:20:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:51 smithi055 ceph-mon[31863]: pgmap v5325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:20:52.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9123 sec 2024-03-28T08:20:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:52 smithi086 ceph-mon[35163]: pgmap v5326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8452.939681 secs 2024-03-28T08:20:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:52 smithi159 ceph-mon[36109]: pgmap v5326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8452.939681 secs 2024-03-28T08:20:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:52 smithi055 ceph-mon[31863]: pgmap v5326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8452.939681 secs 2024-03-28T08:20:53.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9124 sec 2024-03-28T08:20:54.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9125 sec 2024-03-28T08:20:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:55 smithi086 ceph-mon[35163]: pgmap v5327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:55 smithi159 ceph-mon[36109]: pgmap v5327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:55 smithi055 ceph-mon[31863]: pgmap v5327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:55.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9126 sec 2024-03-28T08:20:56.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9127 sec 2024-03-28T08:20:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:57 smithi086 ceph-mon[35163]: pgmap v5328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:57 smithi159 ceph-mon[36109]: pgmap v5328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:57 smithi055 ceph-mon[31863]: pgmap v5328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:57.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9128 sec 2024-03-28T08:20:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8457.939820 secs 2024-03-28T08:20:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8457.939820 secs 2024-03-28T08:20:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8457.939820 secs 2024-03-28T08:20:58.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9129 sec 2024-03-28T08:20:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:20:59 smithi086 ceph-mon[35163]: pgmap v5329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:20:59 smithi159 ceph-mon[36109]: pgmap v5329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:20:59 smithi055 ceph-mon[31863]: pgmap v5329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:20:59.373 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9130 sec 2024-03-28T08:21:00.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9131 sec 2024-03-28T08:21:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:01 smithi086 ceph-mon[35163]: pgmap v5330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:01 smithi159 ceph-mon[36109]: pgmap v5330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:01 smithi055 ceph-mon[31863]: pgmap v5330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:01.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9132 sec 2024-03-28T08:21:02.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9133 sec 2024-03-28T08:21:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:03 smithi055 ceph-mon[31863]: pgmap v5331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8462.939944 secs 2024-03-28T08:21:03.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9134 sec 2024-03-28T08:21:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:03 smithi086 ceph-mon[35163]: pgmap v5331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8462.939944 secs 2024-03-28T08:21:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:03 smithi159 ceph-mon[36109]: pgmap v5331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8462.939944 secs 2024-03-28T08:21:04.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9135 sec 2024-03-28T08:21:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:05 smithi055 ceph-mon[31863]: pgmap v5332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:05.374 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9136 sec 2024-03-28T08:21:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:05 smithi086 ceph-mon[35163]: pgmap v5332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:05 smithi159 ceph-mon[36109]: pgmap v5332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:06.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9137 sec 2024-03-28T08:21:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:07 smithi055 ceph-mon[31863]: pgmap v5333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:07.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9138 sec 2024-03-28T08:21:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:07 smithi086 ceph-mon[35163]: pgmap v5333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:07 smithi159 ceph-mon[36109]: pgmap v5333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8467.940064 secs 2024-03-28T08:21:08.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9139 sec 2024-03-28T08:21:08.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8467.940064 secs 2024-03-28T08:21:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8467.940064 secs 2024-03-28T08:21:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:09 smithi055 ceph-mon[31863]: pgmap v5334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:09.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9140 sec 2024-03-28T08:21:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:09 smithi086 ceph-mon[35163]: pgmap v5334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:09 smithi159 ceph-mon[36109]: pgmap v5334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:10.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9141 sec 2024-03-28T08:21:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:11 smithi055 ceph-mon[31863]: pgmap v5335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:11.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9142 sec 2024-03-28T08:21:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:11 smithi086 ceph-mon[35163]: pgmap v5335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:11 smithi159 ceph-mon[36109]: pgmap v5335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:12.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9143 sec 2024-03-28T08:21:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:13 smithi055 ceph-mon[31863]: pgmap v5336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:21:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8472.940135 secs 2024-03-28T08:21:13.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9144 sec 2024-03-28T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:13 smithi086 ceph-mon[35163]: pgmap v5336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:21:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8472.940135 secs 2024-03-28T08:21:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:13 smithi159 ceph-mon[36109]: pgmap v5336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:21:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8472.940135 secs 2024-03-28T08:21:14.375 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9145 sec 2024-03-28T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:15.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9146 sec 2024-03-28T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: pgmap v5337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: pgmap v5338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:21:15.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: pgmap v5339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:15.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: pgmap v5337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:21:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:21:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: pgmap v5338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:21:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: pgmap v5339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: pgmap v5337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:21:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:21:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: pgmap v5338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:21:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: pgmap v5339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:21:16.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9147 sec 2024-03-28T08:21:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:16 smithi086 ceph-mon[35163]: pgmap v5340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:16 smithi159 ceph-mon[36109]: pgmap v5340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:16 smithi055 ceph-mon[31863]: pgmap v5340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:17.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9148 sec 2024-03-28T08:21:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8477.940200 secs 2024-03-28T08:21:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8477.940200 secs 2024-03-28T08:21:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8477.940200 secs 2024-03-28T08:21:18.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9149 sec 2024-03-28T08:21:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:18 smithi086 ceph-mon[35163]: pgmap v5341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:18 smithi159 ceph-mon[36109]: pgmap v5341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:18 smithi055 ceph-mon[31863]: pgmap v5341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:19.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9150 sec 2024-03-28T08:21:20.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9151 sec 2024-03-28T08:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:20 smithi086 ceph-mon[35163]: pgmap v5342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:20 smithi159 ceph-mon[36109]: pgmap v5342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:20 smithi055 ceph-mon[31863]: pgmap v5342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:21:21.376 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9152 sec 2024-03-28T08:21:22.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9153 sec 2024-03-28T08:21:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8482.940321 secs 2024-03-28T08:21:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:22 smithi086 ceph-mon[35163]: pgmap v5343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8482.940321 secs 2024-03-28T08:21:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:22 smithi159 ceph-mon[36109]: pgmap v5343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8482.940321 secs 2024-03-28T08:21:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:22 smithi055 ceph-mon[31863]: pgmap v5343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:23.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9154 sec 2024-03-28T08:21:24.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9155 sec 2024-03-28T08:21:25.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9156 sec 2024-03-28T08:21:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:25 smithi086 ceph-mon[35163]: pgmap v5344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:25 smithi159 ceph-mon[36109]: pgmap v5344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:25 smithi055 ceph-mon[31863]: pgmap v5344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:26.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9157 sec 2024-03-28T08:21:27.377 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9158 sec 2024-03-28T08:21:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:27 smithi086 ceph-mon[35163]: pgmap v5345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8487.940444 secs 2024-03-28T08:21:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:27 smithi159 ceph-mon[36109]: pgmap v5345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8487.940444 secs 2024-03-28T08:21:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:27 smithi055 ceph-mon[31863]: pgmap v5345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:28.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8487.940444 secs 2024-03-28T08:21:28.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9159 sec 2024-03-28T08:21:29.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9160 sec 2024-03-28T08:21:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:29 smithi086 ceph-mon[35163]: pgmap v5346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:29 smithi159 ceph-mon[36109]: pgmap v5346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:29 smithi055 ceph-mon[31863]: pgmap v5346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:30.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9161 sec 2024-03-28T08:21:31.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9162 sec 2024-03-28T08:21:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:31 smithi086 ceph-mon[35163]: pgmap v5347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:31 smithi159 ceph-mon[36109]: pgmap v5347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:31 smithi055 ceph-mon[31863]: pgmap v5347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:32.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9163 sec 2024-03-28T08:21:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8492.940581 secs 2024-03-28T08:21:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8492.940581 secs 2024-03-28T08:21:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8492.940581 secs 2024-03-28T08:21:33.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9164 sec 2024-03-28T08:21:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:33 smithi055 ceph-mon[31863]: pgmap v5348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:21:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:33 smithi086 ceph-mon[35163]: pgmap v5348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:21:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:33 smithi159 ceph-mon[36109]: pgmap v5348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:21:34.378 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9165 sec 2024-03-28T08:21:35.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9166 sec 2024-03-28T08:21:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:35 smithi055 ceph-mon[31863]: pgmap v5349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:35 smithi086 ceph-mon[35163]: pgmap v5349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:35 smithi159 ceph-mon[36109]: pgmap v5349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:36.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9167 sec 2024-03-28T08:21:37.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9168 sec 2024-03-28T08:21:38.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:37 smithi086 ceph-mon[35163]: pgmap v5350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:38.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8497.940660 secs 2024-03-28T08:21:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:37 smithi055 ceph-mon[31863]: pgmap v5350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8497.940660 secs 2024-03-28T08:21:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:37 smithi159 ceph-mon[36109]: pgmap v5350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8497.940660 secs 2024-03-28T08:21:38.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9169 sec 2024-03-28T08:21:39.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9170 sec 2024-03-28T08:21:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:39 smithi055 ceph-mon[31863]: pgmap v5351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:39 smithi086 ceph-mon[35163]: pgmap v5351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:39 smithi159 ceph-mon[36109]: pgmap v5351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:21:40.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9171 sec 2024-03-28T08:21:41.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9172 sec 2024-03-28T08:21:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:41 smithi055 ceph-mon[31863]: pgmap v5352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:41 smithi086 ceph-mon[35163]: pgmap v5352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:41 smithi159 ceph-mon[36109]: pgmap v5352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:21:42.379 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9173 sec 2024-03-28T08:21:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8502.940821 secs 2024-03-28T08:21:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8502.940821 secs 2024-03-28T08:21:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8502.940821 secs 2024-03-28T08:21:43.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9174 sec 2024-03-28T08:21:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:43 smithi086 ceph-mon[35163]: pgmap v5353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:43 smithi159 ceph-mon[36109]: pgmap v5353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:43 smithi055 ceph-mon[31863]: pgmap v5353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:44.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9175 sec 2024-03-28T08:21:45.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9176 sec 2024-03-28T08:21:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:45 smithi086 ceph-mon[35163]: pgmap v5354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:45 smithi159 ceph-mon[36109]: pgmap v5354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:45 smithi055 ceph-mon[31863]: pgmap v5354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:46.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9177 sec 2024-03-28T08:21:47.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9178 sec 2024-03-28T08:21:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:47 smithi086 ceph-mon[35163]: pgmap v5355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8507.940873 secs 2024-03-28T08:21:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:47 smithi159 ceph-mon[36109]: pgmap v5355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8507.940873 secs 2024-03-28T08:21:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:47 smithi055 ceph-mon[31863]: pgmap v5355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8507.940873 secs 2024-03-28T08:21:48.380 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9179 sec 2024-03-28T08:21:49.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9180 sec 2024-03-28T08:21:50.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:49 smithi055 ceph-mon[31863]: pgmap v5356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:49 smithi086 ceph-mon[35163]: pgmap v5356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:49 smithi159 ceph-mon[36109]: pgmap v5356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:50.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9181 sec 2024-03-28T08:21:51.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9182 sec 2024-03-28T08:21:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:51 smithi086 ceph-mon[35163]: pgmap v5357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:21:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:51 smithi159 ceph-mon[36109]: pgmap v5357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:21:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:51 smithi055 ceph-mon[31863]: pgmap v5357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:21:52.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9183 sec 2024-03-28T08:21:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8512.940949 secs 2024-03-28T08:21:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8512.940949 secs 2024-03-28T08:21:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8512.940949 secs 2024-03-28T08:21:53.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9184 sec 2024-03-28T08:21:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:53 smithi086 ceph-mon[35163]: pgmap v5358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:53 smithi159 ceph-mon[36109]: pgmap v5358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:53 smithi055 ceph-mon[31863]: pgmap v5358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:21:54.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9185 sec 2024-03-28T08:21:55.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9186 sec 2024-03-28T08:21:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:55 smithi086 ceph-mon[35163]: pgmap v5359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:56.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:55 smithi159 ceph-mon[36109]: pgmap v5359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:55 smithi055 ceph-mon[31863]: pgmap v5359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:56.381 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9187 sec 2024-03-28T08:21:57.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9188 sec 2024-03-28T08:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:57 smithi086 ceph-mon[35163]: pgmap v5360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8517.941069 secs 2024-03-28T08:21:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:57 smithi159 ceph-mon[36109]: pgmap v5360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8517.941069 secs 2024-03-28T08:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:57 smithi055 ceph-mon[31863]: pgmap v5360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8517.941069 secs 2024-03-28T08:21:58.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9189 sec 2024-03-28T08:21:59.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9190 sec 2024-03-28T08:22:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:21:59 smithi086 ceph-mon[35163]: pgmap v5361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:21:59 smithi159 ceph-mon[36109]: pgmap v5361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:21:59 smithi055 ceph-mon[31863]: pgmap v5361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:00.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9191 sec 2024-03-28T08:22:01.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9192 sec 2024-03-28T08:22:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:01 smithi086 ceph-mon[35163]: pgmap v5362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:01 smithi159 ceph-mon[36109]: pgmap v5362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:01 smithi055 ceph-mon[31863]: pgmap v5362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:02.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9193 sec 2024-03-28T08:22:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8522.941189 secs 2024-03-28T08:22:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8522.941189 secs 2024-03-28T08:22:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8522.941189 secs 2024-03-28T08:22:03.382 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9194 sec 2024-03-28T08:22:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:03 smithi086 ceph-mon[35163]: pgmap v5363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:03 smithi159 ceph-mon[36109]: pgmap v5363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:03 smithi055 ceph-mon[31863]: pgmap v5363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:04.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9195 sec 2024-03-28T08:22:05.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9196 sec 2024-03-28T08:22:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:05 smithi086 ceph-mon[35163]: pgmap v5364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:06.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:05 smithi159 ceph-mon[36109]: pgmap v5364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:05 smithi055 ceph-mon[31863]: pgmap v5364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:06.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9197 sec 2024-03-28T08:22:07.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9198 sec 2024-03-28T08:22:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:07 smithi086 ceph-mon[35163]: pgmap v5365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8527.941279 secs 2024-03-28T08:22:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:07 smithi159 ceph-mon[36109]: pgmap v5365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8527.941279 secs 2024-03-28T08:22:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:07 smithi055 ceph-mon[31863]: pgmap v5365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8527.941279 secs 2024-03-28T08:22:08.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9199 sec 2024-03-28T08:22:09.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9200 sec 2024-03-28T08:22:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:09 smithi086 ceph-mon[35163]: pgmap v5366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:09 smithi159 ceph-mon[36109]: pgmap v5366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:09 smithi055 ceph-mon[31863]: pgmap v5366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:10.383 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9201 sec 2024-03-28T08:22:11.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9202 sec 2024-03-28T08:22:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:12 smithi086 ceph-mon[35163]: pgmap v5367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:12 smithi159 ceph-mon[36109]: pgmap v5367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:12 smithi055 ceph-mon[31863]: pgmap v5367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:12.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9203 sec 2024-03-28T08:22:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8532.941400 secs 2024-03-28T08:22:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8532.941400 secs 2024-03-28T08:22:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8532.941400 secs 2024-03-28T08:22:13.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9204 sec 2024-03-28T08:22:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:14 smithi086 ceph-mon[35163]: pgmap v5368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:14 smithi159 ceph-mon[36109]: pgmap v5368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:14 smithi055 ceph-mon[31863]: pgmap v5368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:14.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9205 sec 2024-03-28T08:22:15.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9206 sec 2024-03-28T08:22:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:16 smithi086 ceph-mon[35163]: pgmap v5369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:22:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:16 smithi159 ceph-mon[36109]: pgmap v5369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:22:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:16 smithi055 ceph-mon[31863]: pgmap v5369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:22:16.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9207 sec 2024-03-28T08:22:17.352 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:17.352 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:17.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9208 sec 2024-03-28T08:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:18 smithi055 ceph-mon[31863]: pgmap v5370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8537.941472 secs 2024-03-28T08:22:18.384 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9209 sec 2024-03-28T08:22:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:18 smithi086 ceph-mon[35163]: pgmap v5370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8537.941472 secs 2024-03-28T08:22:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:18 smithi159 ceph-mon[36109]: pgmap v5370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8537.941472 secs 2024-03-28T08:22:19.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9210 sec 2024-03-28T08:22:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:20.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9211 sec 2024-03-28T08:22:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:20 smithi086 ceph-mon[35163]: pgmap v5371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:20 smithi159 ceph-mon[36109]: pgmap v5371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:20 smithi055 ceph-mon[31863]: pgmap v5371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:21.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9212 sec 2024-03-28T08:22:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:22:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:22:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:22:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:22:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:22:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:22:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:22:22.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9213 sec 2024-03-28T08:22:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:22 smithi086 ceph-mon[35163]: pgmap v5372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:22 smithi086 ceph-mon[35163]: pgmap v5373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:22:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:22 smithi086 ceph-mon[35163]: pgmap v5374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:22 smithi159 ceph-mon[36109]: pgmap v5372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:22 smithi159 ceph-mon[36109]: pgmap v5373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:22:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:22 smithi159 ceph-mon[36109]: pgmap v5374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:22 smithi055 ceph-mon[31863]: pgmap v5372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:22 smithi055 ceph-mon[31863]: pgmap v5373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:22:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:22 smithi055 ceph-mon[31863]: pgmap v5374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:23.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9214 sec 2024-03-28T08:22:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8542.941544 secs 2024-03-28T08:22:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8542.941544 secs 2024-03-28T08:22:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8542.941544 secs 2024-03-28T08:22:24.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9215 sec 2024-03-28T08:22:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:24 smithi086 ceph-mon[35163]: pgmap v5375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:24 smithi159 ceph-mon[36109]: pgmap v5375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:24 smithi055 ceph-mon[31863]: pgmap v5375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:22:25.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9216 sec 2024-03-28T08:22:26.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9217 sec 2024-03-28T08:22:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:26 smithi086 ceph-mon[35163]: pgmap v5376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:26 smithi159 ceph-mon[36109]: pgmap v5376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:26 smithi055 ceph-mon[31863]: pgmap v5376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:27.385 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9218 sec 2024-03-28T08:22:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:27 smithi086 ceph-mon[35163]: pgmap v5377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8547.941624 secs 2024-03-28T08:22:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:27 smithi159 ceph-mon[36109]: pgmap v5377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8547.941624 secs 2024-03-28T08:22:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:27 smithi055 ceph-mon[31863]: pgmap v5377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:22:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8547.941624 secs 2024-03-28T08:22:28.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9219 sec 2024-03-28T08:22:29.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9220 sec 2024-03-28T08:22:30.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9221 sec 2024-03-28T08:22:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:30 smithi086 ceph-mon[35163]: pgmap v5378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:22:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:30 smithi159 ceph-mon[36109]: pgmap v5378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:22:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:30 smithi055 ceph-mon[31863]: pgmap v5378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:22:31.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9222 sec 2024-03-28T08:22:32.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9223 sec 2024-03-28T08:22:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:32 smithi055 ceph-mon[31863]: pgmap v5379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:22:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:32 smithi086 ceph-mon[35163]: pgmap v5379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:22:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:32 smithi159 ceph-mon[36109]: pgmap v5379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:22:33.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9224 sec 2024-03-28T08:22:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8552.941745 secs 2024-03-28T08:22:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8552.941745 secs 2024-03-28T08:22:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8552.941745 secs 2024-03-28T08:22:34.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9225 sec 2024-03-28T08:22:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:34 smithi055 ceph-mon[31863]: pgmap v5380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:34 smithi086 ceph-mon[35163]: pgmap v5380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:34 smithi159 ceph-mon[36109]: pgmap v5380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:35.386 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9226 sec 2024-03-28T08:22:36.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9227 sec 2024-03-28T08:22:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:36 smithi055 ceph-mon[31863]: pgmap v5381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:36 smithi086 ceph-mon[35163]: pgmap v5381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:36 smithi159 ceph-mon[36109]: pgmap v5381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:37.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9228 sec 2024-03-28T08:22:38.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9229 sec 2024-03-28T08:22:38.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:38 smithi086 ceph-mon[35163]: pgmap v5382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:38.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8557.941837 secs 2024-03-28T08:22:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:38 smithi055 ceph-mon[31863]: pgmap v5382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8557.941837 secs 2024-03-28T08:22:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:38 smithi159 ceph-mon[36109]: pgmap v5382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8557.941837 secs 2024-03-28T08:22:39.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9230 sec 2024-03-28T08:22:40.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9231 sec 2024-03-28T08:22:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:40 smithi055 ceph-mon[31863]: pgmap v5383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:40 smithi086 ceph-mon[35163]: pgmap v5383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:40 smithi159 ceph-mon[36109]: pgmap v5383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:41.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9232 sec 2024-03-28T08:22:42.387 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9233 sec 2024-03-28T08:22:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:42 smithi055 ceph-mon[31863]: pgmap v5384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:42 smithi086 ceph-mon[35163]: pgmap v5384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:42 smithi159 ceph-mon[36109]: pgmap v5384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:43.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9234 sec 2024-03-28T08:22:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8562.941958 secs 2024-03-28T08:22:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8562.941958 secs 2024-03-28T08:22:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8562.941958 secs 2024-03-28T08:22:44.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9235 sec 2024-03-28T08:22:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:44 smithi086 ceph-mon[35163]: pgmap v5385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:44 smithi159 ceph-mon[36109]: pgmap v5385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:44 smithi055 ceph-mon[31863]: pgmap v5385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:45.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9236 sec 2024-03-28T08:22:46.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9237 sec 2024-03-28T08:22:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:46 smithi086 ceph-mon[35163]: pgmap v5386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:46 smithi159 ceph-mon[36109]: pgmap v5386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:46 smithi055 ceph-mon[31863]: pgmap v5386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:47.388 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9238 sec 2024-03-28T08:22:48.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9239 sec 2024-03-28T08:22:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:48 smithi086 ceph-mon[35163]: pgmap v5387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8567.942040 secs 2024-03-28T08:22:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:48 smithi159 ceph-mon[36109]: pgmap v5387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8567.942040 secs 2024-03-28T08:22:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:48 smithi055 ceph-mon[31863]: pgmap v5387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8567.942040 secs 2024-03-28T08:22:49.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9240 sec 2024-03-28T08:22:50.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9241 sec 2024-03-28T08:22:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:50 smithi086 ceph-mon[35163]: pgmap v5388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:50 smithi159 ceph-mon[36109]: pgmap v5388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:50 smithi055 ceph-mon[31863]: pgmap v5388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:51.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9242 sec 2024-03-28T08:22:52.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9243 sec 2024-03-28T08:22:52.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:52 smithi055 ceph-mon[31863]: pgmap v5389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:52 smithi086 ceph-mon[35163]: pgmap v5389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:52 smithi159 ceph-mon[36109]: pgmap v5389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:53.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9244 sec 2024-03-28T08:22:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8572.942095 secs 2024-03-28T08:22:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8572.942095 secs 2024-03-28T08:22:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8572.942095 secs 2024-03-28T08:22:54.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9245 sec 2024-03-28T08:22:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:54 smithi086 ceph-mon[35163]: pgmap v5390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:54 smithi159 ceph-mon[36109]: pgmap v5390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:54 smithi055 ceph-mon[31863]: pgmap v5390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:22:55.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9246 sec 2024-03-28T08:22:56.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9247 sec 2024-03-28T08:22:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:56 smithi086 ceph-mon[35163]: pgmap v5391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:56 smithi159 ceph-mon[36109]: pgmap v5391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:56 smithi055 ceph-mon[31863]: pgmap v5391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:22:57.389 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9248 sec 2024-03-28T08:22:58.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9249 sec 2024-03-28T08:22:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:58 smithi086 ceph-mon[35163]: pgmap v5392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:22:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8577.942212 secs 2024-03-28T08:22:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:58 smithi159 ceph-mon[36109]: pgmap v5392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:22:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8577.942212 secs 2024-03-28T08:22:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:58 smithi055 ceph-mon[31863]: pgmap v5392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:22:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:22:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8577.942212 secs 2024-03-28T08:22:59.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9250 sec 2024-03-28T08:23:00.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9251 sec 2024-03-28T08:23:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:00 smithi086 ceph-mon[35163]: pgmap v5393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:00 smithi159 ceph-mon[36109]: pgmap v5393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:00 smithi055 ceph-mon[31863]: pgmap v5393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:01.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9252 sec 2024-03-28T08:23:02.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9253 sec 2024-03-28T08:23:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:02 smithi086 ceph-mon[35163]: pgmap v5394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:02 smithi159 ceph-mon[36109]: pgmap v5394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:02 smithi055 ceph-mon[31863]: pgmap v5394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:03.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9254 sec 2024-03-28T08:23:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8582.942275 secs 2024-03-28T08:23:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8582.942275 secs 2024-03-28T08:23:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8582.942275 secs 2024-03-28T08:23:04.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9255 sec 2024-03-28T08:23:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:04 smithi086 ceph-mon[35163]: pgmap v5395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:04 smithi159 ceph-mon[36109]: pgmap v5395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:04 smithi055 ceph-mon[31863]: pgmap v5395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:05.390 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9256 sec 2024-03-28T08:23:06.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9257 sec 2024-03-28T08:23:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:06 smithi086 ceph-mon[35163]: pgmap v5396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:06 smithi159 ceph-mon[36109]: pgmap v5396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:06 smithi055 ceph-mon[31863]: pgmap v5396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:07.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9258 sec 2024-03-28T08:23:08.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9259 sec 2024-03-28T08:23:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:08 smithi086 ceph-mon[35163]: pgmap v5397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8587.942399 secs 2024-03-28T08:23:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:08 smithi159 ceph-mon[36109]: pgmap v5397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8587.942399 secs 2024-03-28T08:23:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:08 smithi055 ceph-mon[31863]: pgmap v5397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8587.942399 secs 2024-03-28T08:23:09.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9260 sec 2024-03-28T08:23:10.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9261 sec 2024-03-28T08:23:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:10 smithi086 ceph-mon[35163]: pgmap v5398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:10 smithi159 ceph-mon[36109]: pgmap v5398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:10 smithi055 ceph-mon[31863]: pgmap v5398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:11.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9262 sec 2024-03-28T08:23:12.391 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9263 sec 2024-03-28T08:23:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:12 smithi086 ceph-mon[35163]: pgmap v5399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:12 smithi159 ceph-mon[36109]: pgmap v5399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:12 smithi055 ceph-mon[31863]: pgmap v5399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:13.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9264 sec 2024-03-28T08:23:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8592.942521 secs 2024-03-28T08:23:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8592.942521 secs 2024-03-28T08:23:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8592.942521 secs 2024-03-28T08:23:14.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9265 sec 2024-03-28T08:23:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:14 smithi086 ceph-mon[35163]: pgmap v5400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:14 smithi159 ceph-mon[36109]: pgmap v5400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:14 smithi055 ceph-mon[31863]: pgmap v5400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:15.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9266 sec 2024-03-28T08:23:16.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9267 sec 2024-03-28T08:23:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:16 smithi086 ceph-mon[35163]: pgmap v5401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:16 smithi159 ceph-mon[36109]: pgmap v5401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:16 smithi055 ceph-mon[31863]: pgmap v5401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:23:17.392 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9268 sec 2024-03-28T08:23:18.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9269 sec 2024-03-28T08:23:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:18 smithi086 ceph-mon[35163]: pgmap v5402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8597.942640 secs 2024-03-28T08:23:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:18 smithi159 ceph-mon[36109]: pgmap v5402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8597.942640 secs 2024-03-28T08:23:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:18 smithi055 ceph-mon[31863]: pgmap v5402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8597.942640 secs 2024-03-28T08:23:19.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9270 sec 2024-03-28T08:23:20.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9271 sec 2024-03-28T08:23:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:20 smithi086 ceph-mon[35163]: pgmap v5403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:20 smithi159 ceph-mon[36109]: pgmap v5403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:20 smithi055 ceph-mon[31863]: pgmap v5403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:21.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9272 sec 2024-03-28T08:23:22.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9273 sec 2024-03-28T08:23:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:22 smithi055 ceph-mon[31863]: pgmap v5404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:23:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:22 smithi086 ceph-mon[35163]: pgmap v5404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:23:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:22 smithi159 ceph-mon[36109]: pgmap v5404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:23:23.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9274 sec 2024-03-28T08:23:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8602.942766 secs 2024-03-28T08:23:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:23:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:23:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8602.942766 secs 2024-03-28T08:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:23:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8602.942766 secs 2024-03-28T08:23:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:23:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:23:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:23:24.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9275 sec 2024-03-28T08:23:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:24 smithi055 ceph-mon[31863]: pgmap v5405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:24 smithi055 ceph-mon[31863]: pgmap v5406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:24 smithi086 ceph-mon[35163]: pgmap v5405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:24 smithi086 ceph-mon[35163]: pgmap v5406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:24 smithi159 ceph-mon[36109]: pgmap v5405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:24 smithi159 ceph-mon[36109]: pgmap v5406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:25.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9276 sec 2024-03-28T08:23:26.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9277 sec 2024-03-28T08:23:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:26 smithi055 ceph-mon[31863]: pgmap v5407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:23:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:26 smithi086 ceph-mon[35163]: pgmap v5407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:23:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:26 smithi159 ceph-mon[36109]: pgmap v5407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:23:27.393 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9278 sec 2024-03-28T08:23:28.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9279 sec 2024-03-28T08:23:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:28 smithi055 ceph-mon[31863]: pgmap v5408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8607.942851 secs 2024-03-28T08:23:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:28 smithi086 ceph-mon[35163]: pgmap v5408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8607.942851 secs 2024-03-28T08:23:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:28 smithi159 ceph-mon[36109]: pgmap v5408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8607.942851 secs 2024-03-28T08:23:29.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9280 sec 2024-03-28T08:23:30.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9281 sec 2024-03-28T08:23:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:30 smithi055 ceph-mon[31863]: pgmap v5409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:30 smithi086 ceph-mon[35163]: pgmap v5409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:30 smithi159 ceph-mon[36109]: pgmap v5409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:31.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9282 sec 2024-03-28T08:23:32.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9283 sec 2024-03-28T08:23:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:32 smithi055 ceph-mon[31863]: pgmap v5410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:32 smithi086 ceph-mon[35163]: pgmap v5410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:32 smithi159 ceph-mon[36109]: pgmap v5410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:23:33.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9284 sec 2024-03-28T08:23:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8612.942915 secs 2024-03-28T08:23:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8612.942915 secs 2024-03-28T08:23:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8612.942915 secs 2024-03-28T08:23:34.394 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9285 sec 2024-03-28T08:23:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:34 smithi086 ceph-mon[35163]: pgmap v5411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:23:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:34 smithi159 ceph-mon[36109]: pgmap v5411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:23:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:34 smithi055 ceph-mon[31863]: pgmap v5411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:23:35.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9286 sec 2024-03-28T08:23:36.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9287 sec 2024-03-28T08:23:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:36 smithi086 ceph-mon[35163]: pgmap v5412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:36 smithi159 ceph-mon[36109]: pgmap v5412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:36 smithi055 ceph-mon[31863]: pgmap v5412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:37.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9288 sec 2024-03-28T08:23:38.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9289 sec 2024-03-28T08:23:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:38 smithi086 ceph-mon[35163]: pgmap v5413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8617.942999 secs 2024-03-28T08:23:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:38 smithi159 ceph-mon[36109]: pgmap v5413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8617.942999 secs 2024-03-28T08:23:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:38 smithi055 ceph-mon[31863]: pgmap v5413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8617.942999 secs 2024-03-28T08:23:39.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9290 sec 2024-03-28T08:23:40.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9291 sec 2024-03-28T08:23:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:40 smithi086 ceph-mon[35163]: pgmap v5414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:40 smithi159 ceph-mon[36109]: pgmap v5414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:40 smithi055 ceph-mon[31863]: pgmap v5414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:41.395 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9292 sec 2024-03-28T08:23:42.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9293 sec 2024-03-28T08:23:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:42 smithi086 ceph-mon[35163]: pgmap v5415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:42 smithi159 ceph-mon[36109]: pgmap v5415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:42 smithi055 ceph-mon[31863]: pgmap v5415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:43.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9294 sec 2024-03-28T08:23:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8622.943113 secs 2024-03-28T08:23:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8622.943113 secs 2024-03-28T08:23:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8622.943113 secs 2024-03-28T08:23:44.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9295 sec 2024-03-28T08:23:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:44 smithi086 ceph-mon[35163]: pgmap v5416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:44 smithi159 ceph-mon[36109]: pgmap v5416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:44 smithi055 ceph-mon[31863]: pgmap v5416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:45.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9296 sec 2024-03-28T08:23:46.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9297 sec 2024-03-28T08:23:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:46 smithi086 ceph-mon[35163]: pgmap v5417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:46 smithi159 ceph-mon[36109]: pgmap v5417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:46 smithi055 ceph-mon[31863]: pgmap v5417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:47.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9298 sec 2024-03-28T08:23:48.396 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9299 sec 2024-03-28T08:23:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:48 smithi086 ceph-mon[35163]: pgmap v5418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8627.943202 secs 2024-03-28T08:23:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:48 smithi159 ceph-mon[36109]: pgmap v5418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8627.943202 secs 2024-03-28T08:23:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:48 smithi055 ceph-mon[31863]: pgmap v5418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8627.943202 secs 2024-03-28T08:23:49.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9300 sec 2024-03-28T08:23:50.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9301 sec 2024-03-28T08:23:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:50 smithi086 ceph-mon[35163]: pgmap v5419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:50 smithi159 ceph-mon[36109]: pgmap v5419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:50 smithi055 ceph-mon[31863]: pgmap v5419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:51.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9302 sec 2024-03-28T08:23:52.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9303 sec 2024-03-28T08:23:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:52 smithi086 ceph-mon[35163]: pgmap v5420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:52 smithi159 ceph-mon[36109]: pgmap v5420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:52 smithi055 ceph-mon[31863]: pgmap v5420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:53.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9304 sec 2024-03-28T08:23:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8632.943326 secs 2024-03-28T08:23:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8632.943326 secs 2024-03-28T08:23:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8632.943326 secs 2024-03-28T08:23:54.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9305 sec 2024-03-28T08:23:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:54 smithi086 ceph-mon[35163]: pgmap v5421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:54 smithi159 ceph-mon[36109]: pgmap v5421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:54 smithi055 ceph-mon[31863]: pgmap v5421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:55.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9306 sec 2024-03-28T08:23:56.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9307 sec 2024-03-28T08:23:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:56 smithi086 ceph-mon[35163]: pgmap v5422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:56 smithi159 ceph-mon[36109]: pgmap v5422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:56 smithi055 ceph-mon[31863]: pgmap v5422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:23:57.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9308 sec 2024-03-28T08:23:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8637.943404 secs 2024-03-28T08:23:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8637.943404 secs 2024-03-28T08:23:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8637.943404 secs 2024-03-28T08:23:58.397 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9309 sec 2024-03-28T08:23:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:23:58 smithi086 ceph-mon[35163]: pgmap v5423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:23:58 smithi159 ceph-mon[36109]: pgmap v5423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:23:58 smithi055 ceph-mon[31863]: pgmap v5423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:23:59.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9310 sec 2024-03-28T08:24:00.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9311 sec 2024-03-28T08:24:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:00 smithi086 ceph-mon[35163]: pgmap v5424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:00 smithi159 ceph-mon[36109]: pgmap v5424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:00 smithi055 ceph-mon[31863]: pgmap v5424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:01.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9312 sec 2024-03-28T08:24:02.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9313 sec 2024-03-28T08:24:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:02 smithi086 ceph-mon[35163]: pgmap v5425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8642.943481 secs 2024-03-28T08:24:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:02 smithi159 ceph-mon[36109]: pgmap v5425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8642.943481 secs 2024-03-28T08:24:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:02 smithi055 ceph-mon[31863]: pgmap v5425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8642.943481 secs 2024-03-28T08:24:03.398 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9314 sec 2024-03-28T08:24:04.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9315 sec 2024-03-28T08:24:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:04 smithi086 ceph-mon[35163]: pgmap v5426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:04 smithi159 ceph-mon[36109]: pgmap v5426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:04 smithi055 ceph-mon[31863]: pgmap v5426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:05.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9316 sec 2024-03-28T08:24:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:05 smithi086 ceph-mon[35163]: pgmap v5427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:05 smithi159 ceph-mon[36109]: pgmap v5427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:05 smithi055 ceph-mon[31863]: pgmap v5427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:06.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9317 sec 2024-03-28T08:24:07.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9318 sec 2024-03-28T08:24:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:08 smithi055 ceph-mon[31863]: pgmap v5428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8647.943598 secs 2024-03-28T08:24:08.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9319 sec 2024-03-28T08:24:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:08 smithi086 ceph-mon[35163]: pgmap v5428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8647.943598 secs 2024-03-28T08:24:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:08 smithi159 ceph-mon[36109]: pgmap v5428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8647.943598 secs 2024-03-28T08:24:09.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9320 sec 2024-03-28T08:24:10.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9321 sec 2024-03-28T08:24:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:10 smithi086 ceph-mon[35163]: pgmap v5429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:10 smithi159 ceph-mon[36109]: pgmap v5429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:10 smithi055 ceph-mon[31863]: pgmap v5429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:11.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9322 sec 2024-03-28T08:24:12.399 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9323 sec 2024-03-28T08:24:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:12 smithi086 ceph-mon[35163]: pgmap v5430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:12 smithi159 ceph-mon[36109]: pgmap v5430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:12 smithi055 ceph-mon[31863]: pgmap v5430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:13.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9324 sec 2024-03-28T08:24:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8652.943721 secs 2024-03-28T08:24:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8652.943721 secs 2024-03-28T08:24:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8652.943721 secs 2024-03-28T08:24:14.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9325 sec 2024-03-28T08:24:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:14 smithi086 ceph-mon[35163]: pgmap v5431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:14 smithi159 ceph-mon[36109]: pgmap v5431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:14 smithi055 ceph-mon[31863]: pgmap v5431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:15.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9326 sec 2024-03-28T08:24:16.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9327 sec 2024-03-28T08:24:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:16 smithi086 ceph-mon[35163]: pgmap v5432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:16 smithi159 ceph-mon[36109]: pgmap v5432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:16 smithi055 ceph-mon[31863]: pgmap v5432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:17.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9328 sec 2024-03-28T08:24:18.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9329 sec 2024-03-28T08:24:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:18 smithi086 ceph-mon[35163]: pgmap v5433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8657.943815 secs 2024-03-28T08:24:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:18 smithi159 ceph-mon[36109]: pgmap v5433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8657.943815 secs 2024-03-28T08:24:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:18 smithi055 ceph-mon[31863]: pgmap v5433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8657.943815 secs 2024-03-28T08:24:19.400 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9330 sec 2024-03-28T08:24:20.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9331 sec 2024-03-28T08:24:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:20 smithi055 ceph-mon[31863]: pgmap v5434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:20 smithi086 ceph-mon[35163]: pgmap v5434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:20 smithi159 ceph-mon[36109]: pgmap v5434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:21.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9332 sec 2024-03-28T08:24:22.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9333 sec 2024-03-28T08:24:22.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:22 smithi159 ceph-mon[36109]: pgmap v5435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:22 smithi055 ceph-mon[31863]: pgmap v5435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:22 smithi086 ceph-mon[35163]: pgmap v5435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:23.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9334 sec 2024-03-28T08:24:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8662.943936 secs 2024-03-28T08:24:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:24:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8662.943936 secs 2024-03-28T08:24:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:24:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8662.943936 secs 2024-03-28T08:24:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:24:24.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9335 sec 2024-03-28T08:24:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:24 smithi055 ceph-mon[31863]: pgmap v5436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:24 smithi086 ceph-mon[35163]: pgmap v5436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:24 smithi159 ceph-mon[36109]: pgmap v5436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:25.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9336 sec 2024-03-28T08:24:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:24:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:24:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:24:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:24:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:24:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:24:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:24:26.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:24:26.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:24:26.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9337 sec 2024-03-28T08:24:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:26 smithi086 ceph-mon[35163]: pgmap v5437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:26 smithi086 ceph-mon[35163]: pgmap v5438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:26 smithi159 ceph-mon[36109]: pgmap v5437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:26 smithi159 ceph-mon[36109]: pgmap v5438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:26 smithi055 ceph-mon[31863]: pgmap v5437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:26 smithi055 ceph-mon[31863]: pgmap v5438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:27.401 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9338 sec 2024-03-28T08:24:28.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9339 sec 2024-03-28T08:24:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:28 smithi086 ceph-mon[35163]: pgmap v5439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8667.944008 secs 2024-03-28T08:24:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:28 smithi159 ceph-mon[36109]: pgmap v5439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8667.944008 secs 2024-03-28T08:24:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:28 smithi055 ceph-mon[31863]: pgmap v5439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8667.944008 secs 2024-03-28T08:24:29.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9340 sec 2024-03-28T08:24:30.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9341 sec 2024-03-28T08:24:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:30 smithi086 ceph-mon[35163]: pgmap v5440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:30 smithi159 ceph-mon[36109]: pgmap v5440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:30 smithi055 ceph-mon[31863]: pgmap v5440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:31.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9342 sec 2024-03-28T08:24:32.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9343 sec 2024-03-28T08:24:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:32 smithi086 ceph-mon[35163]: pgmap v5441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:32 smithi159 ceph-mon[36109]: pgmap v5441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:32 smithi055 ceph-mon[31863]: pgmap v5441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:33.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9344 sec 2024-03-28T08:24:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8672.944086 secs 2024-03-28T08:24:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8672.944086 secs 2024-03-28T08:24:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8672.944086 secs 2024-03-28T08:24:34.402 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9345 sec 2024-03-28T08:24:34.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:34 smithi055 ceph-mon[31863]: pgmap v5442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:34 smithi086 ceph-mon[35163]: pgmap v5442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:34 smithi159 ceph-mon[36109]: pgmap v5442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:35.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9346 sec 2024-03-28T08:24:36.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9347 sec 2024-03-28T08:24:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:36 smithi086 ceph-mon[35163]: pgmap v5443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:24:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:36 smithi159 ceph-mon[36109]: pgmap v5443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:24:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:36 smithi055 ceph-mon[31863]: pgmap v5443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:24:37.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9348 sec 2024-03-28T08:24:38.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9349 sec 2024-03-28T08:24:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:38 smithi086 ceph-mon[35163]: pgmap v5444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8677.944206 secs 2024-03-28T08:24:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:38 smithi159 ceph-mon[36109]: pgmap v5444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8677.944206 secs 2024-03-28T08:24:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:38 smithi055 ceph-mon[31863]: pgmap v5444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8677.944206 secs 2024-03-28T08:24:39.403 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9350 sec 2024-03-28T08:24:40.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9351 sec 2024-03-28T08:24:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:40 smithi086 ceph-mon[35163]: pgmap v5445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:40 smithi159 ceph-mon[36109]: pgmap v5445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:40 smithi055 ceph-mon[31863]: pgmap v5445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:41.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9352 sec 2024-03-28T08:24:42.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9353 sec 2024-03-28T08:24:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:42 smithi086 ceph-mon[35163]: pgmap v5446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:42 smithi159 ceph-mon[36109]: pgmap v5446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:42 smithi055 ceph-mon[31863]: pgmap v5446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:43.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9354 sec 2024-03-28T08:24:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8682.944301 secs 2024-03-28T08:24:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8682.944301 secs 2024-03-28T08:24:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8682.944301 secs 2024-03-28T08:24:44.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9355 sec 2024-03-28T08:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:44 smithi086 ceph-mon[35163]: pgmap v5447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:44 smithi159 ceph-mon[36109]: pgmap v5447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:44 smithi055 ceph-mon[31863]: pgmap v5447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:45.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9356 sec 2024-03-28T08:24:46.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9357 sec 2024-03-28T08:24:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:46 smithi086 ceph-mon[35163]: pgmap v5448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:46 smithi159 ceph-mon[36109]: pgmap v5448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:46 smithi055 ceph-mon[31863]: pgmap v5448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:47.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9358 sec 2024-03-28T08:24:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8687.944373 secs 2024-03-28T08:24:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8687.944373 secs 2024-03-28T08:24:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8687.944373 secs 2024-03-28T08:24:48.404 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9359 sec 2024-03-28T08:24:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:48 smithi086 ceph-mon[35163]: pgmap v5449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:48 smithi159 ceph-mon[36109]: pgmap v5449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:48 smithi055 ceph-mon[31863]: pgmap v5449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:49.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9360 sec 2024-03-28T08:24:50.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9361 sec 2024-03-28T08:24:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:50 smithi086 ceph-mon[35163]: pgmap v5450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:50 smithi159 ceph-mon[36109]: pgmap v5450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:50 smithi055 ceph-mon[31863]: pgmap v5450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:51.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9362 sec 2024-03-28T08:24:52.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9363 sec 2024-03-28T08:24:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:52 smithi086 ceph-mon[35163]: pgmap v5451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8692.944495 secs 2024-03-28T08:24:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:52 smithi159 ceph-mon[36109]: pgmap v5451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8692.944495 secs 2024-03-28T08:24:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:52 smithi055 ceph-mon[31863]: pgmap v5451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8692.944495 secs 2024-03-28T08:24:53.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9364 sec 2024-03-28T08:24:54.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9365 sec 2024-03-28T08:24:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:54 smithi086 ceph-mon[35163]: pgmap v5452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:54 smithi159 ceph-mon[36109]: pgmap v5452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:54 smithi055 ceph-mon[31863]: pgmap v5452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:55.405 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9366 sec 2024-03-28T08:24:56.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9367 sec 2024-03-28T08:24:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:56 smithi086 ceph-mon[35163]: pgmap v5453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:56 smithi159 ceph-mon[36109]: pgmap v5453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:56 smithi055 ceph-mon[31863]: pgmap v5453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:24:57.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9368 sec 2024-03-28T08:24:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8697.944573 secs 2024-03-28T08:24:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8697.944573 secs 2024-03-28T08:24:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8697.944573 secs 2024-03-28T08:24:58.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9369 sec 2024-03-28T08:24:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:58 smithi086 ceph-mon[35163]: pgmap v5454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:58 smithi159 ceph-mon[36109]: pgmap v5454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:58 smithi055 ceph-mon[31863]: pgmap v5454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:24:59.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9370 sec 2024-03-28T08:25:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:24:59 smithi086 ceph-mon[35163]: pgmap v5455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:24:59 smithi159 ceph-mon[36109]: pgmap v5455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:24:59 smithi055 ceph-mon[31863]: pgmap v5455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:00.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9371 sec 2024-03-28T08:25:01.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9372 sec 2024-03-28T08:25:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:01 smithi086 ceph-mon[35163]: pgmap v5456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:01 smithi159 ceph-mon[36109]: pgmap v5456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:01 smithi055 ceph-mon[31863]: pgmap v5456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:02.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9373 sec 2024-03-28T08:25:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8702.944691 secs 2024-03-28T08:25:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8702.944691 secs 2024-03-28T08:25:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8702.944691 secs 2024-03-28T08:25:03.406 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9374 sec 2024-03-28T08:25:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:03 smithi086 ceph-mon[35163]: pgmap v5457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:03 smithi159 ceph-mon[36109]: pgmap v5457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:03 smithi055 ceph-mon[31863]: pgmap v5457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:04.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9375 sec 2024-03-28T08:25:05.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9376 sec 2024-03-28T08:25:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:05 smithi086 ceph-mon[35163]: pgmap v5458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:05 smithi159 ceph-mon[36109]: pgmap v5458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:05 smithi055 ceph-mon[31863]: pgmap v5458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:06.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9377 sec 2024-03-28T08:25:07.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9378 sec 2024-03-28T08:25:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:07 smithi086 ceph-mon[35163]: pgmap v5459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8707.944775 secs 2024-03-28T08:25:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:07 smithi159 ceph-mon[36109]: pgmap v5459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8707.944775 secs 2024-03-28T08:25:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:07 smithi055 ceph-mon[31863]: pgmap v5459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8707.944775 secs 2024-03-28T08:25:08.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9379 sec 2024-03-28T08:25:09.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9380 sec 2024-03-28T08:25:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:09 smithi086 ceph-mon[35163]: pgmap v5460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:09 smithi159 ceph-mon[36109]: pgmap v5460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:09 smithi055 ceph-mon[31863]: pgmap v5460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:10.407 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9381 sec 2024-03-28T08:25:11.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9382 sec 2024-03-28T08:25:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:11 smithi086 ceph-mon[35163]: pgmap v5461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:11 smithi159 ceph-mon[36109]: pgmap v5461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:11 smithi055 ceph-mon[31863]: pgmap v5461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:12.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9383 sec 2024-03-28T08:25:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8712.944866 secs 2024-03-28T08:25:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8712.944866 secs 2024-03-28T08:25:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8712.944866 secs 2024-03-28T08:25:13.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9384 sec 2024-03-28T08:25:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:13 smithi086 ceph-mon[35163]: pgmap v5462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:13 smithi159 ceph-mon[36109]: pgmap v5462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:13 smithi055 ceph-mon[31863]: pgmap v5462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:14.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9385 sec 2024-03-28T08:25:15.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9386 sec 2024-03-28T08:25:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:15 smithi086 ceph-mon[35163]: pgmap v5463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:15 smithi159 ceph-mon[36109]: pgmap v5463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:15 smithi055 ceph-mon[31863]: pgmap v5463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:16.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9387 sec 2024-03-28T08:25:17.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9388 sec 2024-03-28T08:25:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:17 smithi086 ceph-mon[35163]: pgmap v5464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8717.944990 secs 2024-03-28T08:25:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:17 smithi159 ceph-mon[36109]: pgmap v5464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8717.944990 secs 2024-03-28T08:25:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:17 smithi055 ceph-mon[31863]: pgmap v5464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8717.944990 secs 2024-03-28T08:25:18.408 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9389 sec 2024-03-28T08:25:19.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9390 sec 2024-03-28T08:25:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:19 smithi086 ceph-mon[35163]: pgmap v5465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:19 smithi159 ceph-mon[36109]: pgmap v5465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:19 smithi055 ceph-mon[31863]: pgmap v5465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:20.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9391 sec 2024-03-28T08:25:21.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9392 sec 2024-03-28T08:25:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:21 smithi086 ceph-mon[35163]: pgmap v5466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:21 smithi159 ceph-mon[36109]: pgmap v5466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:21 smithi055 ceph-mon[31863]: pgmap v5466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:22.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9393 sec 2024-03-28T08:25:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8722.945108 secs 2024-03-28T08:25:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8722.945108 secs 2024-03-28T08:25:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8722.945108 secs 2024-03-28T08:25:23.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9394 sec 2024-03-28T08:25:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:23 smithi086 ceph-mon[35163]: pgmap v5467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:23 smithi159 ceph-mon[36109]: pgmap v5467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:23 smithi055 ceph-mon[31863]: pgmap v5467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:24.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9395 sec 2024-03-28T08:25:25.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9396 sec 2024-03-28T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:26 smithi086 ceph-mon[35163]: pgmap v5468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:25:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:26 smithi159 ceph-mon[36109]: pgmap v5468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:25:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:26 smithi055 ceph-mon[31863]: pgmap v5468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:25:26.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9397 sec 2024-03-28T08:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:27 smithi086 ceph-mon[35163]: pgmap v5469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:27 smithi086 ceph-mon[35163]: pgmap v5470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:27 smithi159 ceph-mon[36109]: pgmap v5469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:27 smithi159 ceph-mon[36109]: pgmap v5470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:25:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:25:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:25:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:27 smithi055 ceph-mon[31863]: pgmap v5469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:27 smithi055 ceph-mon[31863]: pgmap v5470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:27.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:25:27.409 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9398 sec 2024-03-28T08:25:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8727.945195 secs 2024-03-28T08:25:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8727.945195 secs 2024-03-28T08:25:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8727.945195 secs 2024-03-28T08:25:28.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9399 sec 2024-03-28T08:25:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:29 smithi086 ceph-mon[35163]: pgmap v5471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:29 smithi159 ceph-mon[36109]: pgmap v5471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:29 smithi055 ceph-mon[31863]: pgmap v5471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:29.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9400 sec 2024-03-28T08:25:30.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9401 sec 2024-03-28T08:25:31.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9402 sec 2024-03-28T08:25:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:31 smithi086 ceph-mon[35163]: pgmap v5472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:31 smithi159 ceph-mon[36109]: pgmap v5472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:31 smithi055 ceph-mon[31863]: pgmap v5472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:32.410 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9403 sec 2024-03-28T08:25:33.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9404 sec 2024-03-28T08:25:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8732.945276 secs 2024-03-28T08:25:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:33 smithi086 ceph-mon[35163]: pgmap v5473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:25:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8732.945276 secs 2024-03-28T08:25:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:33 smithi159 ceph-mon[36109]: pgmap v5473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:25:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8732.945276 secs 2024-03-28T08:25:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:33 smithi055 ceph-mon[31863]: pgmap v5473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:25:34.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9405 sec 2024-03-28T08:25:35.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9406 sec 2024-03-28T08:25:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:35 smithi086 ceph-mon[35163]: pgmap v5474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:35 smithi159 ceph-mon[36109]: pgmap v5474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:35 smithi055 ceph-mon[31863]: pgmap v5474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:36.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9407 sec 2024-03-28T08:25:37.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9408 sec 2024-03-28T08:25:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:37 smithi086 ceph-mon[35163]: pgmap v5475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:25:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:37 smithi159 ceph-mon[36109]: pgmap v5475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:25:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:37 smithi055 ceph-mon[31863]: pgmap v5475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:25:38.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9409 sec 2024-03-28T08:25:38.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8737.945340 secs 2024-03-28T08:25:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8737.945340 secs 2024-03-28T08:25:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8737.945340 secs 2024-03-28T08:25:39.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9410 sec 2024-03-28T08:25:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:39 smithi086 ceph-mon[35163]: pgmap v5476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:39 smithi159 ceph-mon[36109]: pgmap v5476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:39 smithi055 ceph-mon[31863]: pgmap v5476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:40.411 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9411 sec 2024-03-28T08:25:41.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9412 sec 2024-03-28T08:25:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:41 smithi086 ceph-mon[35163]: pgmap v5477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:41 smithi159 ceph-mon[36109]: pgmap v5477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:41 smithi055 ceph-mon[31863]: pgmap v5477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:42.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9413 sec 2024-03-28T08:25:43.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9414 sec 2024-03-28T08:25:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8742.945428 secs 2024-03-28T08:25:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:43 smithi086 ceph-mon[35163]: pgmap v5478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8742.945428 secs 2024-03-28T08:25:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:43 smithi159 ceph-mon[36109]: pgmap v5478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8742.945428 secs 2024-03-28T08:25:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:43 smithi055 ceph-mon[31863]: pgmap v5478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:44.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9415 sec 2024-03-28T08:25:45.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9416 sec 2024-03-28T08:25:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:45 smithi086 ceph-mon[35163]: pgmap v5479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:45 smithi159 ceph-mon[36109]: pgmap v5479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:45 smithi055 ceph-mon[31863]: pgmap v5479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:46.412 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9417 sec 2024-03-28T08:25:47.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9418 sec 2024-03-28T08:25:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:47 smithi086 ceph-mon[35163]: pgmap v5480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:47 smithi159 ceph-mon[36109]: pgmap v5480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:47 smithi055 ceph-mon[31863]: pgmap v5480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:48.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9419 sec 2024-03-28T08:25:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8747.945552 secs 2024-03-28T08:25:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8747.945552 secs 2024-03-28T08:25:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8747.945552 secs 2024-03-28T08:25:49.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9420 sec 2024-03-28T08:25:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:49 smithi086 ceph-mon[35163]: pgmap v5481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:49 smithi159 ceph-mon[36109]: pgmap v5481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:49 smithi055 ceph-mon[31863]: pgmap v5481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:50.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9421 sec 2024-03-28T08:25:51.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9422 sec 2024-03-28T08:25:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:51 smithi086 ceph-mon[35163]: pgmap v5482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:51 smithi159 ceph-mon[36109]: pgmap v5482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:51 smithi055 ceph-mon[31863]: pgmap v5482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:25:52.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9423 sec 2024-03-28T08:25:53.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8752.945675 secs 2024-03-28T08:25:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8752.945675 secs 2024-03-28T08:25:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8752.945675 secs 2024-03-28T08:25:53.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9424 sec 2024-03-28T08:25:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:53 smithi086 ceph-mon[35163]: pgmap v5483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:53 smithi159 ceph-mon[36109]: pgmap v5483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:53 smithi055 ceph-mon[31863]: pgmap v5483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:25:54.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9425 sec 2024-03-28T08:25:55.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9426 sec 2024-03-28T08:25:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:55 smithi086 ceph-mon[35163]: pgmap v5484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:55 smithi159 ceph-mon[36109]: pgmap v5484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:55 smithi055 ceph-mon[31863]: pgmap v5484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:56.413 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9427 sec 2024-03-28T08:25:57.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9428 sec 2024-03-28T08:25:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:57 smithi086 ceph-mon[35163]: pgmap v5485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8757.945821 secs 2024-03-28T08:25:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:57 smithi159 ceph-mon[36109]: pgmap v5485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8757.945821 secs 2024-03-28T08:25:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:57 smithi055 ceph-mon[31863]: pgmap v5485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:25:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8757.945821 secs 2024-03-28T08:25:58.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9429 sec 2024-03-28T08:25:59.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9430 sec 2024-03-28T08:26:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:25:59 smithi086 ceph-mon[35163]: pgmap v5486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:25:59 smithi159 ceph-mon[36109]: pgmap v5486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:25:59 smithi055 ceph-mon[31863]: pgmap v5486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:00.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9431 sec 2024-03-28T08:26:01.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9432 sec 2024-03-28T08:26:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:01 smithi086 ceph-mon[35163]: pgmap v5487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:01 smithi159 ceph-mon[36109]: pgmap v5487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:01 smithi055 ceph-mon[31863]: pgmap v5487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:02.414 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9433 sec 2024-03-28T08:26:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8762.945921 secs 2024-03-28T08:26:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8762.945921 secs 2024-03-28T08:26:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8762.945921 secs 2024-03-28T08:26:03.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9434 sec 2024-03-28T08:26:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:03 smithi086 ceph-mon[35163]: pgmap v5488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:03 smithi159 ceph-mon[36109]: pgmap v5488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:03 smithi055 ceph-mon[31863]: pgmap v5488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:04.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9435 sec 2024-03-28T08:26:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:04 smithi055 ceph-mon[31863]: pgmap v5489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:04 smithi086 ceph-mon[35163]: pgmap v5489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:04 smithi159 ceph-mon[36109]: pgmap v5489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:05.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9436 sec 2024-03-28T08:26:06.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9437 sec 2024-03-28T08:26:07.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9438 sec 2024-03-28T08:26:08.022 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:07 smithi086 ceph-mon[35163]: pgmap v5490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:07 smithi159 ceph-mon[36109]: pgmap v5490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:07 smithi055 ceph-mon[31863]: pgmap v5490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:08.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9439 sec 2024-03-28T08:26:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8767.946006 secs 2024-03-28T08:26:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8767.946006 secs 2024-03-28T08:26:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8767.946006 secs 2024-03-28T08:26:09.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9440 sec 2024-03-28T08:26:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:09 smithi086 ceph-mon[35163]: pgmap v5491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:09 smithi159 ceph-mon[36109]: pgmap v5491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:09 smithi055 ceph-mon[31863]: pgmap v5491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:10.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9441 sec 2024-03-28T08:26:11.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9442 sec 2024-03-28T08:26:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:11 smithi086 ceph-mon[35163]: pgmap v5492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:11 smithi159 ceph-mon[36109]: pgmap v5492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:11 smithi055 ceph-mon[31863]: pgmap v5492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:12.415 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9443 sec 2024-03-28T08:26:13.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9444 sec 2024-03-28T08:26:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8772.946107 secs 2024-03-28T08:26:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:13 smithi086 ceph-mon[35163]: pgmap v5493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8772.946107 secs 2024-03-28T08:26:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:13 smithi159 ceph-mon[36109]: pgmap v5493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8772.946107 secs 2024-03-28T08:26:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:13 smithi055 ceph-mon[31863]: pgmap v5493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:14.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9445 sec 2024-03-28T08:26:15.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9446 sec 2024-03-28T08:26:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:15 smithi086 ceph-mon[35163]: pgmap v5494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:15 smithi159 ceph-mon[36109]: pgmap v5494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:15 smithi055 ceph-mon[31863]: pgmap v5494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:16.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9447 sec 2024-03-28T08:26:17.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9448 sec 2024-03-28T08:26:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:17 smithi086 ceph-mon[35163]: pgmap v5495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:17 smithi159 ceph-mon[36109]: pgmap v5495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:17 smithi055 ceph-mon[31863]: pgmap v5495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:18.416 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9449 sec 2024-03-28T08:26:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8777.946190 secs 2024-03-28T08:26:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8777.946190 secs 2024-03-28T08:26:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8777.946190 secs 2024-03-28T08:26:19.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9450 sec 2024-03-28T08:26:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:19 smithi086 ceph-mon[35163]: pgmap v5496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:19 smithi159 ceph-mon[36109]: pgmap v5496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:19 smithi055 ceph-mon[31863]: pgmap v5496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:20.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9451 sec 2024-03-28T08:26:21.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9452 sec 2024-03-28T08:26:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:21 smithi086 ceph-mon[35163]: pgmap v5497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:21 smithi159 ceph-mon[36109]: pgmap v5497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:21 smithi055 ceph-mon[31863]: pgmap v5497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:22.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9453 sec 2024-03-28T08:26:23.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9454 sec 2024-03-28T08:26:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8782.946259 secs 2024-03-28T08:26:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:23 smithi086 ceph-mon[35163]: pgmap v5498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8782.946259 secs 2024-03-28T08:26:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:23 smithi159 ceph-mon[36109]: pgmap v5498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8782.946259 secs 2024-03-28T08:26:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:23 smithi055 ceph-mon[31863]: pgmap v5498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:24.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9455 sec 2024-03-28T08:26:25.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9456 sec 2024-03-28T08:26:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:25 smithi086 ceph-mon[35163]: pgmap v5499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:25 smithi159 ceph-mon[36109]: pgmap v5499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:25 smithi055 ceph-mon[31863]: pgmap v5499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:26.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9457 sec 2024-03-28T08:26:27.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9458 sec 2024-03-28T08:26:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:27 smithi086 ceph-mon[35163]: pgmap v5500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:26:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8787.946332 secs 2024-03-28T08:26:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:27 smithi159 ceph-mon[36109]: pgmap v5500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:26:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8787.946332 secs 2024-03-28T08:26:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:27 smithi055 ceph-mon[31863]: pgmap v5500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:26:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8787.946332 secs 2024-03-28T08:26:28.417 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9459 sec 2024-03-28T08:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:26:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:26:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:26:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:26:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:26:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:26:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:26:29.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9460 sec 2024-03-28T08:26:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:29 smithi086 ceph-mon[35163]: pgmap v5501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:29 smithi086 ceph-mon[35163]: pgmap v5502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:29 smithi159 ceph-mon[36109]: pgmap v5501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:29 smithi159 ceph-mon[36109]: pgmap v5502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:29 smithi055 ceph-mon[31863]: pgmap v5501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:29 smithi055 ceph-mon[31863]: pgmap v5502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:30.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9461 sec 2024-03-28T08:26:31.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9462 sec 2024-03-28T08:26:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:31 smithi086 ceph-mon[35163]: pgmap v5503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:31 smithi159 ceph-mon[36109]: pgmap v5503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:31 smithi055 ceph-mon[31863]: pgmap v5503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:32.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9463 sec 2024-03-28T08:26:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8792.946404 secs 2024-03-28T08:26:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8792.946404 secs 2024-03-28T08:26:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8792.946404 secs 2024-03-28T08:26:33.418 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9464 sec 2024-03-28T08:26:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:33 smithi086 ceph-mon[35163]: pgmap v5504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:33 smithi159 ceph-mon[36109]: pgmap v5504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:33 smithi055 ceph-mon[31863]: pgmap v5504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:34.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9465 sec 2024-03-28T08:26:35.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9466 sec 2024-03-28T08:26:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:35 smithi086 ceph-mon[35163]: pgmap v5505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:35 smithi159 ceph-mon[36109]: pgmap v5505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:35 smithi055 ceph-mon[31863]: pgmap v5505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:36.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9467 sec 2024-03-28T08:26:37.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9468 sec 2024-03-28T08:26:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:37 smithi086 ceph-mon[35163]: pgmap v5506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8797.946528 secs 2024-03-28T08:26:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:37 smithi159 ceph-mon[36109]: pgmap v5506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8797.946528 secs 2024-03-28T08:26:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:37 smithi055 ceph-mon[31863]: pgmap v5506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:26:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8797.946528 secs 2024-03-28T08:26:38.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9469 sec 2024-03-28T08:26:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:38 smithi055 ceph-mon[31863]: pgmap v5507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:26:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:38 smithi086 ceph-mon[35163]: pgmap v5507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:26:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:38 smithi159 ceph-mon[36109]: pgmap v5507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:26:39.419 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9470 sec 2024-03-28T08:26:40.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9471 sec 2024-03-28T08:26:41.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9472 sec 2024-03-28T08:26:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:41 smithi086 ceph-mon[35163]: pgmap v5508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:41 smithi159 ceph-mon[36109]: pgmap v5508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:41 smithi055 ceph-mon[31863]: pgmap v5508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:42.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9473 sec 2024-03-28T08:26:43.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9474 sec 2024-03-28T08:26:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:43 smithi086 ceph-mon[35163]: pgmap v5509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8802.946653 secs 2024-03-28T08:26:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:43 smithi159 ceph-mon[36109]: pgmap v5509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8802.946653 secs 2024-03-28T08:26:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:43 smithi055 ceph-mon[31863]: pgmap v5509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8802.946653 secs 2024-03-28T08:26:44.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9475 sec 2024-03-28T08:26:45.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9476 sec 2024-03-28T08:26:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:45 smithi086 ceph-mon[35163]: pgmap v5510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:45 smithi159 ceph-mon[36109]: pgmap v5510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:45 smithi055 ceph-mon[31863]: pgmap v5510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:46.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9477 sec 2024-03-28T08:26:47.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9478 sec 2024-03-28T08:26:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:47 smithi086 ceph-mon[35163]: pgmap v5511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:47 smithi159 ceph-mon[36109]: pgmap v5511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:47 smithi055 ceph-mon[31863]: pgmap v5511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:48.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9479 sec 2024-03-28T08:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8807.946725 secs 2024-03-28T08:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8807.946725 secs 2024-03-28T08:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8807.946725 secs 2024-03-28T08:26:49.420 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9480 sec 2024-03-28T08:26:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:49 smithi086 ceph-mon[35163]: pgmap v5512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:49 smithi159 ceph-mon[36109]: pgmap v5512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:49 smithi055 ceph-mon[31863]: pgmap v5512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:50.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9481 sec 2024-03-28T08:26:51.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9482 sec 2024-03-28T08:26:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:51 smithi086 ceph-mon[35163]: pgmap v5513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:51 smithi159 ceph-mon[36109]: pgmap v5513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:51 smithi055 ceph-mon[31863]: pgmap v5513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:26:52.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9483 sec 2024-03-28T08:26:53.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9484 sec 2024-03-28T08:26:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:53 smithi086 ceph-mon[35163]: pgmap v5514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8812.946825 secs 2024-03-28T08:26:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:53 smithi159 ceph-mon[36109]: pgmap v5514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8812.946825 secs 2024-03-28T08:26:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:53 smithi055 ceph-mon[31863]: pgmap v5514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:26:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8812.946825 secs 2024-03-28T08:26:54.421 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9485 sec 2024-03-28T08:26:55.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9486 sec 2024-03-28T08:26:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:55 smithi086 ceph-mon[35163]: pgmap v5515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:55 smithi159 ceph-mon[36109]: pgmap v5515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:55 smithi055 ceph-mon[31863]: pgmap v5515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:56.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9487 sec 2024-03-28T08:26:57.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9488 sec 2024-03-28T08:26:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:57 smithi086 ceph-mon[35163]: pgmap v5516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:57 smithi159 ceph-mon[36109]: pgmap v5516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:57 smithi055 ceph-mon[31863]: pgmap v5516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:26:58.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9489 sec 2024-03-28T08:26:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8817.946886 secs 2024-03-28T08:26:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8817.946886 secs 2024-03-28T08:26:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8817.946886 secs 2024-03-28T08:26:59.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9490 sec 2024-03-28T08:27:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:26:59 smithi086 ceph-mon[35163]: pgmap v5517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:26:59 smithi159 ceph-mon[36109]: pgmap v5517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:26:59 smithi055 ceph-mon[31863]: pgmap v5517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:00.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9491 sec 2024-03-28T08:27:01.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9492 sec 2024-03-28T08:27:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:01 smithi086 ceph-mon[35163]: pgmap v5518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:27:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:01 smithi159 ceph-mon[36109]: pgmap v5518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:27:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:01 smithi055 ceph-mon[31863]: pgmap v5518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:27:02.422 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9493 sec 2024-03-28T08:27:03.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9494 sec 2024-03-28T08:27:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:03 smithi086 ceph-mon[35163]: pgmap v5519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8822.946939 secs 2024-03-28T08:27:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:03 smithi159 ceph-mon[36109]: pgmap v5519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8822.946939 secs 2024-03-28T08:27:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:03 smithi055 ceph-mon[31863]: pgmap v5519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8822.946939 secs 2024-03-28T08:27:04.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9495 sec 2024-03-28T08:27:05.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9496 sec 2024-03-28T08:27:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:05 smithi086 ceph-mon[35163]: pgmap v5520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:05 smithi159 ceph-mon[36109]: pgmap v5520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:05 smithi055 ceph-mon[31863]: pgmap v5520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:06.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9497 sec 2024-03-28T08:27:07.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9498 sec 2024-03-28T08:27:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:07 smithi086 ceph-mon[35163]: pgmap v5521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:07 smithi159 ceph-mon[36109]: pgmap v5521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:07 smithi055 ceph-mon[31863]: pgmap v5521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:08.423 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9499 sec 2024-03-28T08:27:08.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8827.947020 secs 2024-03-28T08:27:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8827.947020 secs 2024-03-28T08:27:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8827.947020 secs 2024-03-28T08:27:09.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9500 sec 2024-03-28T08:27:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:09 smithi086 ceph-mon[35163]: pgmap v5522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:09 smithi159 ceph-mon[36109]: pgmap v5522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:09 smithi055 ceph-mon[31863]: pgmap v5522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:10.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9501 sec 2024-03-28T08:27:11.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9502 sec 2024-03-28T08:27:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:11 smithi086 ceph-mon[35163]: pgmap v5523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:11 smithi159 ceph-mon[36109]: pgmap v5523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:11 smithi055 ceph-mon[31863]: pgmap v5523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:12.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9503 sec 2024-03-28T08:27:13.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9504 sec 2024-03-28T08:27:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:13 smithi086 ceph-mon[35163]: pgmap v5524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:27:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8832.947115 secs 2024-03-28T08:27:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:13 smithi159 ceph-mon[36109]: pgmap v5524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:27:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8832.947115 secs 2024-03-28T08:27:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:13 smithi055 ceph-mon[31863]: pgmap v5524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:27:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8832.947115 secs 2024-03-28T08:27:14.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9505 sec 2024-03-28T08:27:15.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9506 sec 2024-03-28T08:27:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:15 smithi086 ceph-mon[35163]: pgmap v5525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:15 smithi159 ceph-mon[36109]: pgmap v5525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:15 smithi055 ceph-mon[31863]: pgmap v5525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:16.424 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9507 sec 2024-03-28T08:27:17.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9508 sec 2024-03-28T08:27:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:17 smithi086 ceph-mon[35163]: pgmap v5526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8837.947358 secs 2024-03-28T08:27:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:17 smithi159 ceph-mon[36109]: pgmap v5526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8837.947358 secs 2024-03-28T08:27:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:17 smithi055 ceph-mon[31863]: pgmap v5526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8837.947358 secs 2024-03-28T08:27:18.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9509 sec 2024-03-28T08:27:19.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9510 sec 2024-03-28T08:27:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:19 smithi086 ceph-mon[35163]: pgmap v5527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:19 smithi159 ceph-mon[36109]: pgmap v5527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:19 smithi055 ceph-mon[31863]: pgmap v5527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:20.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9511 sec 2024-03-28T08:27:21.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9512 sec 2024-03-28T08:27:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:21 smithi086 ceph-mon[35163]: pgmap v5528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:21 smithi159 ceph-mon[36109]: pgmap v5528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:21 smithi055 ceph-mon[31863]: pgmap v5528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:22.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9513 sec 2024-03-28T08:27:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8842.947436 secs 2024-03-28T08:27:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8842.947436 secs 2024-03-28T08:27:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8842.947436 secs 2024-03-28T08:27:23.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9514 sec 2024-03-28T08:27:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:23 smithi086 ceph-mon[35163]: pgmap v5529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:23 smithi159 ceph-mon[36109]: pgmap v5529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:23 smithi055 ceph-mon[31863]: pgmap v5529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:24.425 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9515 sec 2024-03-28T08:27:25.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9516 sec 2024-03-28T08:27:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:25 smithi086 ceph-mon[35163]: pgmap v5530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:25 smithi159 ceph-mon[36109]: pgmap v5530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:25 smithi055 ceph-mon[31863]: pgmap v5530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:26.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9517 sec 2024-03-28T08:27:27.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9518 sec 2024-03-28T08:27:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:27 smithi086 ceph-mon[35163]: pgmap v5531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8847.947498 secs 2024-03-28T08:27:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:27 smithi159 ceph-mon[36109]: pgmap v5531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8847.947498 secs 2024-03-28T08:27:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:27 smithi055 ceph-mon[31863]: pgmap v5531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8847.947498 secs 2024-03-28T08:27:28.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9519 sec 2024-03-28T08:27:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:28 smithi055 ceph-mon[31863]: pgmap v5532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:27:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:28 smithi086 ceph-mon[35163]: pgmap v5532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:27:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:28 smithi159 ceph-mon[36109]: pgmap v5532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:27:29.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9520 sec 2024-03-28T08:27:30.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9521 sec 2024-03-28T08:27:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:27:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:27:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:27:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:27:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:27:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:27:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:27:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:27:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:27:31.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9522 sec 2024-03-28T08:27:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:31 smithi086 ceph-mon[35163]: pgmap v5533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:31 smithi086 ceph-mon[35163]: pgmap v5534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:27:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:31 smithi159 ceph-mon[36109]: pgmap v5533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:31 smithi159 ceph-mon[36109]: pgmap v5534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:27:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:31 smithi055 ceph-mon[31863]: pgmap v5533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:31 smithi055 ceph-mon[31863]: pgmap v5534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:27:32.426 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9523 sec 2024-03-28T08:27:33.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9524 sec 2024-03-28T08:27:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:33 smithi086 ceph-mon[35163]: pgmap v5535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8852.947594 secs 2024-03-28T08:27:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:33 smithi159 ceph-mon[36109]: pgmap v5535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8852.947594 secs 2024-03-28T08:27:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:33 smithi055 ceph-mon[31863]: pgmap v5535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8852.947594 secs 2024-03-28T08:27:34.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9525 sec 2024-03-28T08:27:35.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9526 sec 2024-03-28T08:27:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:35 smithi086 ceph-mon[35163]: pgmap v5536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:35 smithi159 ceph-mon[36109]: pgmap v5536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:35 smithi055 ceph-mon[31863]: pgmap v5536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:36.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9527 sec 2024-03-28T08:27:37.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9528 sec 2024-03-28T08:27:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:37 smithi086 ceph-mon[35163]: pgmap v5537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:37 smithi159 ceph-mon[36109]: pgmap v5537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:37 smithi055 ceph-mon[31863]: pgmap v5537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:38.427 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9529 sec 2024-03-28T08:27:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8857.947713 secs 2024-03-28T08:27:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8857.947713 secs 2024-03-28T08:27:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8857.947713 secs 2024-03-28T08:27:39.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9530 sec 2024-03-28T08:27:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:39 smithi086 ceph-mon[35163]: pgmap v5538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:39 smithi159 ceph-mon[36109]: pgmap v5538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:39 smithi055 ceph-mon[31863]: pgmap v5538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:27:40.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9531 sec 2024-03-28T08:27:41.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9532 sec 2024-03-28T08:27:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:41 smithi086 ceph-mon[35163]: pgmap v5539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:41 smithi159 ceph-mon[36109]: pgmap v5539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:41 smithi055 ceph-mon[31863]: pgmap v5539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:27:42.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9533 sec 2024-03-28T08:27:43.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9534 sec 2024-03-28T08:27:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:43 smithi086 ceph-mon[35163]: pgmap v5540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8862.947837 secs 2024-03-28T08:27:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:43 smithi159 ceph-mon[36109]: pgmap v5540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8862.947837 secs 2024-03-28T08:27:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:43 smithi055 ceph-mon[31863]: pgmap v5540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8862.947837 secs 2024-03-28T08:27:44.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9535 sec 2024-03-28T08:27:45.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9536 sec 2024-03-28T08:27:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:45 smithi086 ceph-mon[35163]: pgmap v5541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:45 smithi159 ceph-mon[36109]: pgmap v5541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:45 smithi055 ceph-mon[31863]: pgmap v5541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:46.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9537 sec 2024-03-28T08:27:47.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9538 sec 2024-03-28T08:27:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:47 smithi086 ceph-mon[35163]: pgmap v5542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:47 smithi159 ceph-mon[36109]: pgmap v5542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:47 smithi055 ceph-mon[31863]: pgmap v5542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:48.428 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9539 sec 2024-03-28T08:27:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8867.947926 secs 2024-03-28T08:27:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8867.947926 secs 2024-03-28T08:27:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8867.947926 secs 2024-03-28T08:27:49.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9540 sec 2024-03-28T08:27:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:49 smithi055 ceph-mon[31863]: pgmap v5543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:49 smithi086 ceph-mon[35163]: pgmap v5543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:49 smithi159 ceph-mon[36109]: pgmap v5543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:50.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9541 sec 2024-03-28T08:27:51.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9542 sec 2024-03-28T08:27:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:51 smithi055 ceph-mon[31863]: pgmap v5544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:51 smithi086 ceph-mon[35163]: pgmap v5544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:51 smithi159 ceph-mon[36109]: pgmap v5544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:27:52.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9543 sec 2024-03-28T08:27:53.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9544 sec 2024-03-28T08:27:53.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:53 smithi159 ceph-mon[36109]: pgmap v5545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:53.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8872.948017 secs 2024-03-28T08:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:53 smithi055 ceph-mon[31863]: pgmap v5545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8872.948017 secs 2024-03-28T08:27:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:53 smithi086 ceph-mon[35163]: pgmap v5545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8872.948017 secs 2024-03-28T08:27:54.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9545 sec 2024-03-28T08:27:55.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9546 sec 2024-03-28T08:27:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:55 smithi055 ceph-mon[31863]: pgmap v5546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:55 smithi086 ceph-mon[35163]: pgmap v5546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:55 smithi159 ceph-mon[36109]: pgmap v5546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:56.429 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9547 sec 2024-03-28T08:27:57.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9548 sec 2024-03-28T08:27:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:57 smithi055 ceph-mon[31863]: pgmap v5547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:57 smithi086 ceph-mon[35163]: pgmap v5547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:57 smithi159 ceph-mon[36109]: pgmap v5547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:58.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9549 sec 2024-03-28T08:27:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8877.948105 secs 2024-03-28T08:27:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8877.948105 secs 2024-03-28T08:27:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8877.948105 secs 2024-03-28T08:27:59.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9550 sec 2024-03-28T08:27:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:27:59 smithi086 ceph-mon[35163]: pgmap v5548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:27:59 smithi159 ceph-mon[36109]: pgmap v5548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:27:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:27:59 smithi055 ceph-mon[31863]: pgmap v5548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:00.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9551 sec 2024-03-28T08:28:01.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9552 sec 2024-03-28T08:28:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:01 smithi086 ceph-mon[35163]: pgmap v5549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:01 smithi159 ceph-mon[36109]: pgmap v5549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:01 smithi055 ceph-mon[31863]: pgmap v5549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:02.430 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9553 sec 2024-03-28T08:28:03.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9554 sec 2024-03-28T08:28:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:03 smithi086 ceph-mon[35163]: pgmap v5550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8882.948196 secs 2024-03-28T08:28:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:03 smithi159 ceph-mon[36109]: pgmap v5550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8882.948196 secs 2024-03-28T08:28:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:03 smithi055 ceph-mon[31863]: pgmap v5550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8882.948196 secs 2024-03-28T08:28:04.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9555 sec 2024-03-28T08:28:05.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9556 sec 2024-03-28T08:28:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:05 smithi086 ceph-mon[35163]: pgmap v5551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:05 smithi159 ceph-mon[36109]: pgmap v5551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:05 smithi055 ceph-mon[31863]: pgmap v5551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:06.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9557 sec 2024-03-28T08:28:07.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9558 sec 2024-03-28T08:28:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:07 smithi086 ceph-mon[35163]: pgmap v5552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:07 smithi159 ceph-mon[36109]: pgmap v5552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:07 smithi055 ceph-mon[31863]: pgmap v5552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:08.431 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9559 sec 2024-03-28T08:28:08.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8887.948314 secs 2024-03-28T08:28:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8887.948314 secs 2024-03-28T08:28:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8887.948314 secs 2024-03-28T08:28:09.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9560 sec 2024-03-28T08:28:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:09 smithi086 ceph-mon[35163]: pgmap v5553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:09 smithi159 ceph-mon[36109]: pgmap v5553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:09 smithi055 ceph-mon[31863]: pgmap v5553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:10.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9561 sec 2024-03-28T08:28:11.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9562 sec 2024-03-28T08:28:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:11 smithi086 ceph-mon[35163]: pgmap v5554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:11 smithi159 ceph-mon[36109]: pgmap v5554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:11 smithi055 ceph-mon[31863]: pgmap v5554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:12.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9563 sec 2024-03-28T08:28:13.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9564 sec 2024-03-28T08:28:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:13 smithi086 ceph-mon[35163]: pgmap v5555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8892.948351 secs 2024-03-28T08:28:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:13 smithi159 ceph-mon[36109]: pgmap v5555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8892.948351 secs 2024-03-28T08:28:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:13 smithi055 ceph-mon[31863]: pgmap v5555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8892.948351 secs 2024-03-28T08:28:14.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9565 sec 2024-03-28T08:28:15.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9566 sec 2024-03-28T08:28:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:15 smithi086 ceph-mon[35163]: pgmap v5556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:15 smithi159 ceph-mon[36109]: pgmap v5556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:15 smithi055 ceph-mon[31863]: pgmap v5556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:16.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9567 sec 2024-03-28T08:28:17.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9568 sec 2024-03-28T08:28:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:17 smithi086 ceph-mon[35163]: pgmap v5557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:17 smithi159 ceph-mon[36109]: pgmap v5557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:17 smithi055 ceph-mon[31863]: pgmap v5557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:18.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9569 sec 2024-03-28T08:28:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8897.948487 secs 2024-03-28T08:28:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8897.948487 secs 2024-03-28T08:28:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8897.948487 secs 2024-03-28T08:28:19.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9570 sec 2024-03-28T08:28:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:19 smithi086 ceph-mon[35163]: pgmap v5558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:19 smithi159 ceph-mon[36109]: pgmap v5558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:19 smithi055 ceph-mon[31863]: pgmap v5558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:20.432 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9571 sec 2024-03-28T08:28:21.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9572 sec 2024-03-28T08:28:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:21 smithi086 ceph-mon[35163]: pgmap v5559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:21 smithi159 ceph-mon[36109]: pgmap v5559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:21 smithi055 ceph-mon[31863]: pgmap v5559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:22.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9573 sec 2024-03-28T08:28:23.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9574 sec 2024-03-28T08:28:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:23 smithi086 ceph-mon[35163]: pgmap v5560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8902.948583 secs 2024-03-28T08:28:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:23 smithi159 ceph-mon[36109]: pgmap v5560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8902.948583 secs 2024-03-28T08:28:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:23 smithi055 ceph-mon[31863]: pgmap v5560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8902.948583 secs 2024-03-28T08:28:24.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9575 sec 2024-03-28T08:28:25.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9576 sec 2024-03-28T08:28:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:25 smithi086 ceph-mon[35163]: pgmap v5561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:25 smithi159 ceph-mon[36109]: pgmap v5561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:25 smithi055 ceph-mon[31863]: pgmap v5561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:26.433 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9577 sec 2024-03-28T08:28:27.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9578 sec 2024-03-28T08:28:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:27 smithi086 ceph-mon[35163]: pgmap v5562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8907.948660 secs 2024-03-28T08:28:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:27 smithi159 ceph-mon[36109]: pgmap v5562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8907.948660 secs 2024-03-28T08:28:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:27 smithi055 ceph-mon[31863]: pgmap v5562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8907.948660 secs 2024-03-28T08:28:28.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9579 sec 2024-03-28T08:28:29.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9580 sec 2024-03-28T08:28:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:29 smithi086 ceph-mon[35163]: pgmap v5563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:29 smithi159 ceph-mon[36109]: pgmap v5563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:29 smithi055 ceph-mon[31863]: pgmap v5563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:30.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9581 sec 2024-03-28T08:28:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:28:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:28:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:28:31.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9582 sec 2024-03-28T08:28:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:31 smithi086 ceph-mon[35163]: pgmap v5564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:28:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:31 smithi159 ceph-mon[36109]: pgmap v5564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:28:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:31 smithi055 ceph-mon[31863]: pgmap v5564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:28:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:32.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9583 sec 2024-03-28T08:28:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:28:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8912.948812 secs 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:28:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:28:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:28:33.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8912.948812 secs 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:28:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:28:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:28:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:28:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8912.948812 secs 2024-03-28T08:28:33.434 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9584 sec 2024-03-28T08:28:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:28:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:28:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:28:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:28:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: pgmap v5565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:33 smithi086 ceph-mon[35163]: pgmap v5566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: pgmap v5565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:33 smithi159 ceph-mon[36109]: pgmap v5566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:28:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:28:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:28:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:28:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: pgmap v5565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:33 smithi055 ceph-mon[31863]: pgmap v5566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:28:34.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9585 sec 2024-03-28T08:28:35.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9586 sec 2024-03-28T08:28:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:35 smithi086 ceph-mon[35163]: pgmap v5567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:35 smithi159 ceph-mon[36109]: pgmap v5567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:35 smithi055 ceph-mon[31863]: pgmap v5567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:36.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9587 sec 2024-03-28T08:28:37.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9588 sec 2024-03-28T08:28:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:37 smithi055 ceph-mon[31863]: pgmap v5568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8917.948886 secs 2024-03-28T08:28:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:37 smithi086 ceph-mon[35163]: pgmap v5568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8917.948886 secs 2024-03-28T08:28:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:37 smithi159 ceph-mon[36109]: pgmap v5568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8917.948886 secs 2024-03-28T08:28:38.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9589 sec 2024-03-28T08:28:39.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:38 smithi086 ceph-mon[35163]: pgmap v5569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:38 smithi159 ceph-mon[36109]: pgmap v5569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:38 smithi055 ceph-mon[31863]: pgmap v5569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:39.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9590 sec 2024-03-28T08:28:40.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9591 sec 2024-03-28T08:28:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:40 smithi086 ceph-mon[35163]: pgmap v5570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:40 smithi159 ceph-mon[36109]: pgmap v5570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:40 smithi055 ceph-mon[31863]: pgmap v5570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:41.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9592 sec 2024-03-28T08:28:42.435 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9593 sec 2024-03-28T08:28:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:42 smithi086 ceph-mon[35163]: pgmap v5571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8922.948965 secs 2024-03-28T08:28:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:42 smithi159 ceph-mon[36109]: pgmap v5571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8922.948965 secs 2024-03-28T08:28:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:42 smithi055 ceph-mon[31863]: pgmap v5571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:28:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8922.948965 secs 2024-03-28T08:28:43.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9594 sec 2024-03-28T08:28:44.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9595 sec 2024-03-28T08:28:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:44 smithi086 ceph-mon[35163]: pgmap v5572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:44 smithi159 ceph-mon[36109]: pgmap v5572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:44 smithi055 ceph-mon[31863]: pgmap v5572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:45.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9596 sec 2024-03-28T08:28:46.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9597 sec 2024-03-28T08:28:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:46 smithi086 ceph-mon[35163]: pgmap v5573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:46 smithi159 ceph-mon[36109]: pgmap v5573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:46 smithi055 ceph-mon[31863]: pgmap v5573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:47.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9598 sec 2024-03-28T08:28:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8927.949035 secs 2024-03-28T08:28:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8927.949035 secs 2024-03-28T08:28:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8927.949035 secs 2024-03-28T08:28:48.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9599 sec 2024-03-28T08:28:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:49 smithi086 ceph-mon[35163]: pgmap v5574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:49 smithi159 ceph-mon[36109]: pgmap v5574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:49 smithi055 ceph-mon[31863]: pgmap v5574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:49.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9600 sec 2024-03-28T08:28:50.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9601 sec 2024-03-28T08:28:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:51 smithi086 ceph-mon[35163]: pgmap v5575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:51 smithi159 ceph-mon[36109]: pgmap v5575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:51 smithi055 ceph-mon[31863]: pgmap v5575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:28:51.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9602 sec 2024-03-28T08:28:52.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9603 sec 2024-03-28T08:28:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:53 smithi086 ceph-mon[35163]: pgmap v5576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8932.949126 secs 2024-03-28T08:28:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:53 smithi159 ceph-mon[36109]: pgmap v5576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8932.949126 secs 2024-03-28T08:28:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:53 smithi055 ceph-mon[31863]: pgmap v5576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8932.949126 secs 2024-03-28T08:28:53.436 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9604 sec 2024-03-28T08:28:54.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9605 sec 2024-03-28T08:28:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:55 smithi086 ceph-mon[35163]: pgmap v5577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:55 smithi159 ceph-mon[36109]: pgmap v5577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:55 smithi055 ceph-mon[31863]: pgmap v5577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:55.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9606 sec 2024-03-28T08:28:56.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9607 sec 2024-03-28T08:28:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:57 smithi086 ceph-mon[35163]: pgmap v5578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:57 smithi159 ceph-mon[36109]: pgmap v5578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:57 smithi055 ceph-mon[31863]: pgmap v5578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:57.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9608 sec 2024-03-28T08:28:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8937.949211 secs 2024-03-28T08:28:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8937.949211 secs 2024-03-28T08:28:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8937.949211 secs 2024-03-28T08:28:58.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9609 sec 2024-03-28T08:28:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:28:59 smithi086 ceph-mon[35163]: pgmap v5579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:28:59 smithi159 ceph-mon[36109]: pgmap v5579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:28:59 smithi055 ceph-mon[31863]: pgmap v5579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:28:59.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9610 sec 2024-03-28T08:29:00.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9611 sec 2024-03-28T08:29:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:01 smithi086 ceph-mon[35163]: pgmap v5580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:01 smithi159 ceph-mon[36109]: pgmap v5580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:01 smithi055 ceph-mon[31863]: pgmap v5580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:01.437 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9612 sec 2024-03-28T08:29:02.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9613 sec 2024-03-28T08:29:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:03 smithi086 ceph-mon[35163]: pgmap v5581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8942.949334 secs 2024-03-28T08:29:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:03 smithi159 ceph-mon[36109]: pgmap v5581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8942.949334 secs 2024-03-28T08:29:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:03 smithi055 ceph-mon[31863]: pgmap v5581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8942.949334 secs 2024-03-28T08:29:03.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9614 sec 2024-03-28T08:29:04.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9615 sec 2024-03-28T08:29:05.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:05 smithi055 ceph-mon[31863]: pgmap v5582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:05.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9616 sec 2024-03-28T08:29:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:05 smithi086 ceph-mon[35163]: pgmap v5582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:05 smithi159 ceph-mon[36109]: pgmap v5582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:06.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9617 sec 2024-03-28T08:29:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:07 smithi055 ceph-mon[31863]: pgmap v5583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:07.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9618 sec 2024-03-28T08:29:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:07 smithi086 ceph-mon[35163]: pgmap v5583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:07 smithi159 ceph-mon[36109]: pgmap v5583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8947.949456 secs 2024-03-28T08:29:08.438 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9619 sec 2024-03-28T08:29:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8947.949456 secs 2024-03-28T08:29:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8947.949456 secs 2024-03-28T08:29:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:09 smithi055 ceph-mon[31863]: pgmap v5584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:09.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9620 sec 2024-03-28T08:29:09.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:09 smithi086 ceph-mon[35163]: pgmap v5584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:09 smithi159 ceph-mon[36109]: pgmap v5584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:10.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9621 sec 2024-03-28T08:29:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:11 smithi055 ceph-mon[31863]: pgmap v5585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:11.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9622 sec 2024-03-28T08:29:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:11 smithi086 ceph-mon[35163]: pgmap v5585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:11 smithi159 ceph-mon[36109]: pgmap v5585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:12.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9623 sec 2024-03-28T08:29:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:13 smithi055 ceph-mon[31863]: pgmap v5586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8952.949580 secs 2024-03-28T08:29:13.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9624 sec 2024-03-28T08:29:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:13 smithi086 ceph-mon[35163]: pgmap v5586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8952.949580 secs 2024-03-28T08:29:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:13 smithi159 ceph-mon[36109]: pgmap v5586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8952.949580 secs 2024-03-28T08:29:14.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9625 sec 2024-03-28T08:29:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:15 smithi055 ceph-mon[31863]: pgmap v5587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:15.439 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9626 sec 2024-03-28T08:29:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:15 smithi086 ceph-mon[35163]: pgmap v5587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:15 smithi159 ceph-mon[36109]: pgmap v5587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:16.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9627 sec 2024-03-28T08:29:17.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9628 sec 2024-03-28T08:29:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:17 smithi086 ceph-mon[35163]: pgmap v5588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:17 smithi159 ceph-mon[36109]: pgmap v5588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:17 smithi055 ceph-mon[31863]: pgmap v5588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:18.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9629 sec 2024-03-28T08:29:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8957.949702 secs 2024-03-28T08:29:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8957.949702 secs 2024-03-28T08:29:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8957.949702 secs 2024-03-28T08:29:19.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9630 sec 2024-03-28T08:29:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:19 smithi086 ceph-mon[35163]: pgmap v5589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:19 smithi159 ceph-mon[36109]: pgmap v5589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:19 smithi055 ceph-mon[31863]: pgmap v5589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:20.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9631 sec 2024-03-28T08:29:21.440 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9632 sec 2024-03-28T08:29:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:21 smithi086 ceph-mon[35163]: pgmap v5590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:21 smithi159 ceph-mon[36109]: pgmap v5590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:21 smithi055 ceph-mon[31863]: pgmap v5590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:22.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9633 sec 2024-03-28T08:29:23.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:23 smithi055 ceph-mon[31863]: pgmap v5591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:23.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8962.949830 secs 2024-03-28T08:29:23.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9634 sec 2024-03-28T08:29:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:23 smithi086 ceph-mon[35163]: pgmap v5591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8962.949830 secs 2024-03-28T08:29:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:23 smithi159 ceph-mon[36109]: pgmap v5591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8962.949830 secs 2024-03-28T08:29:24.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9635 sec 2024-03-28T08:29:25.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9636 sec 2024-03-28T08:29:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:25 smithi086 ceph-mon[35163]: pgmap v5592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:25 smithi159 ceph-mon[36109]: pgmap v5592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:25 smithi055 ceph-mon[31863]: pgmap v5592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:26.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9637 sec 2024-03-28T08:29:27.441 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9638 sec 2024-03-28T08:29:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:27 smithi086 ceph-mon[35163]: pgmap v5593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:27 smithi159 ceph-mon[36109]: pgmap v5593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:27 smithi055 ceph-mon[31863]: pgmap v5593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:28.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9639 sec 2024-03-28T08:29:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8967.949921 secs 2024-03-28T08:29:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8967.949921 secs 2024-03-28T08:29:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8967.949921 secs 2024-03-28T08:29:29.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9640 sec 2024-03-28T08:29:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:29 smithi086 ceph-mon[35163]: pgmap v5594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:29 smithi159 ceph-mon[36109]: pgmap v5594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:29 smithi055 ceph-mon[31863]: pgmap v5594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:30.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9641 sec 2024-03-28T08:29:31.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9642 sec 2024-03-28T08:29:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:31 smithi086 ceph-mon[35163]: pgmap v5595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:31 smithi159 ceph-mon[36109]: pgmap v5595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:31 smithi055 ceph-mon[31863]: pgmap v5595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:32.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9643 sec 2024-03-28T08:29:33.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9644 sec 2024-03-28T08:29:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:33 smithi086 ceph-mon[35163]: pgmap v5596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:29:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8972.950000 secs 2024-03-28T08:29:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:33 smithi159 ceph-mon[36109]: pgmap v5596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:29:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8972.950000 secs 2024-03-28T08:29:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:33 smithi055 ceph-mon[31863]: pgmap v5596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:29:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8972.950000 secs 2024-03-28T08:29:34.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9645 sec 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:29:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:29:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: pgmap v5597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: pgmap v5598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:29:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: pgmap v5597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:34.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: pgmap v5598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:34.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:29:34.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:29:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: pgmap v5597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: pgmap v5598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:34.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:29:35.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9646 sec 2024-03-28T08:29:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:35 smithi086 ceph-mon[35163]: pgmap v5599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:35 smithi159 ceph-mon[36109]: pgmap v5599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:35 smithi055 ceph-mon[31863]: pgmap v5599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:36.442 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9647 sec 2024-03-28T08:29:37.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9648 sec 2024-03-28T08:29:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8977.950115 secs 2024-03-28T08:29:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8977.950115 secs 2024-03-28T08:29:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8977.950115 secs 2024-03-28T08:29:38.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9649 sec 2024-03-28T08:29:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:38 smithi086 ceph-mon[35163]: pgmap v5600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:29:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:38 smithi159 ceph-mon[36109]: pgmap v5600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:29:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:38 smithi055 ceph-mon[31863]: pgmap v5600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:29:39.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9650 sec 2024-03-28T08:29:40.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9651 sec 2024-03-28T08:29:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:40 smithi055 ceph-mon[31863]: pgmap v5601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:40 smithi086 ceph-mon[35163]: pgmap v5601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:40 smithi159 ceph-mon[36109]: pgmap v5601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:41.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9652 sec 2024-03-28T08:29:42.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9653 sec 2024-03-28T08:29:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:42 smithi055 ceph-mon[31863]: pgmap v5602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8982.950239 secs 2024-03-28T08:29:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:42 smithi086 ceph-mon[35163]: pgmap v5602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8982.950239 secs 2024-03-28T08:29:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:42 smithi159 ceph-mon[36109]: pgmap v5602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:29:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8982.950239 secs 2024-03-28T08:29:43.443 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9654 sec 2024-03-28T08:29:44.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9655 sec 2024-03-28T08:29:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:44 smithi055 ceph-mon[31863]: pgmap v5603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:44 smithi086 ceph-mon[35163]: pgmap v5603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:44 smithi159 ceph-mon[36109]: pgmap v5603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:29:45.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9656 sec 2024-03-28T08:29:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:45 smithi055 ceph-mon[31863]: pgmap v5604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:45 smithi086 ceph-mon[35163]: pgmap v5604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:45 smithi159 ceph-mon[36109]: pgmap v5604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:46.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9657 sec 2024-03-28T08:29:47.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9658 sec 2024-03-28T08:29:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8987.950353 secs 2024-03-28T08:29:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8987.950353 secs 2024-03-28T08:29:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8987.950353 secs 2024-03-28T08:29:48.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9659 sec 2024-03-28T08:29:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:48 smithi055 ceph-mon[31863]: pgmap v5605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:48 smithi086 ceph-mon[35163]: pgmap v5605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:48 smithi159 ceph-mon[36109]: pgmap v5605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:49.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9660 sec 2024-03-28T08:29:50.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9661 sec 2024-03-28T08:29:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:50 smithi055 ceph-mon[31863]: pgmap v5606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:50 smithi086 ceph-mon[35163]: pgmap v5606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:50 smithi159 ceph-mon[36109]: pgmap v5606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:51.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9662 sec 2024-03-28T08:29:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:51 smithi086 ceph-mon[35163]: pgmap v5607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:51 smithi159 ceph-mon[36109]: pgmap v5607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:51 smithi055 ceph-mon[31863]: pgmap v5607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:52.444 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9663 sec 2024-03-28T08:29:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8992.950475 secs 2024-03-28T08:29:53.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8992.950475 secs 2024-03-28T08:29:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8992.950475 secs 2024-03-28T08:29:53.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9664 sec 2024-03-28T08:29:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:53 smithi086 ceph-mon[35163]: pgmap v5608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:53 smithi159 ceph-mon[36109]: pgmap v5608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:53 smithi055 ceph-mon[31863]: pgmap v5608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:29:54.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9665 sec 2024-03-28T08:29:55.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9666 sec 2024-03-28T08:29:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:55 smithi086 ceph-mon[35163]: pgmap v5609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:55 smithi159 ceph-mon[36109]: pgmap v5609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:55 smithi055 ceph-mon[31863]: pgmap v5609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:29:56.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9667 sec 2024-03-28T08:29:57.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9668 sec 2024-03-28T08:29:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 8997.950596 secs 2024-03-28T08:29:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 8997.950596 secs 2024-03-28T08:29:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 8997.950596 secs 2024-03-28T08:29:58.445 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9669 sec 2024-03-28T08:29:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:29:58 smithi159 ceph-mon[36109]: pgmap v5610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:29:58 smithi055 ceph-mon[31863]: pgmap v5610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:29:58 smithi086 ceph-mon[35163]: pgmap v5610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:29:59.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9670 sec 2024-03-28T08:30:00.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9671 sec 2024-03-28T08:30:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:00 smithi055 ceph-mon[31863]: pgmap v5611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:01.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:30:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:00 smithi086 ceph-mon[35163]: pgmap v5611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:30:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:00 smithi159 ceph-mon[36109]: pgmap v5611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:30:01.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9672 sec 2024-03-28T08:30:02.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9673 sec 2024-03-28T08:30:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:02 smithi055 ceph-mon[31863]: pgmap v5612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9002.950657 secs 2024-03-28T08:30:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:02 smithi086 ceph-mon[35163]: pgmap v5612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9002.950657 secs 2024-03-28T08:30:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:02 smithi159 ceph-mon[36109]: pgmap v5612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9002.950657 secs 2024-03-28T08:30:03.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9674 sec 2024-03-28T08:30:04.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9675 sec 2024-03-28T08:30:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:04 smithi055 ceph-mon[31863]: pgmap v5613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:04 smithi086 ceph-mon[35163]: pgmap v5613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:04 smithi159 ceph-mon[36109]: pgmap v5613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:05.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9676 sec 2024-03-28T08:30:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:05 smithi055 ceph-mon[31863]: pgmap v5614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:05 smithi086 ceph-mon[35163]: pgmap v5614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:05 smithi159 ceph-mon[36109]: pgmap v5614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:06.446 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9677 sec 2024-03-28T08:30:07.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9678 sec 2024-03-28T08:30:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9007.950722 secs 2024-03-28T08:30:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9007.950722 secs 2024-03-28T08:30:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9007.950722 secs 2024-03-28T08:30:08.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9679 sec 2024-03-28T08:30:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:08 smithi055 ceph-mon[31863]: pgmap v5615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:08 smithi086 ceph-mon[35163]: pgmap v5615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:08 smithi159 ceph-mon[36109]: pgmap v5615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:09.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9680 sec 2024-03-28T08:30:10.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9681 sec 2024-03-28T08:30:11.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:10 smithi086 ceph-mon[35163]: pgmap v5616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:10 smithi055 ceph-mon[31863]: pgmap v5616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:11.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:10 smithi159 ceph-mon[36109]: pgmap v5616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:11.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9682 sec 2024-03-28T08:30:12.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9683 sec 2024-03-28T08:30:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:12 smithi055 ceph-mon[31863]: pgmap v5617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9012.950853 secs 2024-03-28T08:30:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:12 smithi086 ceph-mon[35163]: pgmap v5617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9012.950853 secs 2024-03-28T08:30:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:12 smithi159 ceph-mon[36109]: pgmap v5617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9012.950853 secs 2024-03-28T08:30:13.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9684 sec 2024-03-28T08:30:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:13 smithi055 ceph-mon[31863]: pgmap v5618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:13 smithi086 ceph-mon[35163]: pgmap v5618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:13 smithi159 ceph-mon[36109]: pgmap v5618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:14.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9685 sec 2024-03-28T08:30:15.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9686 sec 2024-03-28T08:30:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:15 smithi086 ceph-mon[35163]: pgmap v5619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:15 smithi159 ceph-mon[36109]: pgmap v5619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:15 smithi055 ceph-mon[31863]: pgmap v5619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:16.447 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9687 sec 2024-03-28T08:30:17.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9688 sec 2024-03-28T08:30:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9017.950972 secs 2024-03-28T08:30:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9017.950972 secs 2024-03-28T08:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9017.950972 secs 2024-03-28T08:30:18.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9689 sec 2024-03-28T08:30:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:18 smithi055 ceph-mon[31863]: pgmap v5620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:18 smithi086 ceph-mon[35163]: pgmap v5620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:18 smithi159 ceph-mon[36109]: pgmap v5620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:19.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9690 sec 2024-03-28T08:30:20.448 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9691 sec 2024-03-28T08:30:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:20 smithi055 ceph-mon[31863]: pgmap v5621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:20 smithi086 ceph-mon[35163]: pgmap v5621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:20 smithi159 ceph-mon[36109]: pgmap v5621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:21.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9692 sec 2024-03-28T08:30:22.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9693 sec 2024-03-28T08:30:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:22 smithi055 ceph-mon[31863]: pgmap v5622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:23.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9022.950994 secs 2024-03-28T08:30:23.124 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:22 smithi159 ceph-mon[36109]: pgmap v5622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:23.124 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9022.950994 secs 2024-03-28T08:30:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:22 smithi086 ceph-mon[35163]: pgmap v5622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9022.950994 secs 2024-03-28T08:30:23.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9694 sec 2024-03-28T08:30:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:23 smithi086 ceph-mon[35163]: pgmap v5623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:23 smithi159 ceph-mon[36109]: pgmap v5623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:23 smithi055 ceph-mon[31863]: pgmap v5623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:24.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9695 sec 2024-03-28T08:30:25.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9696 sec 2024-03-28T08:30:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:25 smithi086 ceph-mon[35163]: pgmap v5624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:25 smithi159 ceph-mon[36109]: pgmap v5624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:25 smithi055 ceph-mon[31863]: pgmap v5624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:26.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9697 sec 2024-03-28T08:30:27.449 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9698 sec 2024-03-28T08:30:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9027.951065 secs 2024-03-28T08:30:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9027.951065 secs 2024-03-28T08:30:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9027.951065 secs 2024-03-28T08:30:28.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9699 sec 2024-03-28T08:30:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:28 smithi055 ceph-mon[31863]: pgmap v5625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:28 smithi086 ceph-mon[35163]: pgmap v5625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:28 smithi159 ceph-mon[36109]: pgmap v5625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:29.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9700 sec 2024-03-28T08:30:30.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9701 sec 2024-03-28T08:30:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:30 smithi055 ceph-mon[31863]: pgmap v5626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:30 smithi086 ceph-mon[35163]: pgmap v5626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:30 smithi159 ceph-mon[36109]: pgmap v5626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:31.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9702 sec 2024-03-28T08:30:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:31 smithi086 ceph-mon[35163]: pgmap v5627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:31 smithi159 ceph-mon[36109]: pgmap v5627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:31 smithi055 ceph-mon[31863]: pgmap v5627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:32.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9703 sec 2024-03-28T08:30:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9032.951196 secs 2024-03-28T08:30:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9032.951196 secs 2024-03-28T08:30:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9032.951196 secs 2024-03-28T08:30:33.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9704 sec 2024-03-28T08:30:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:33 smithi086 ceph-mon[35163]: pgmap v5628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:33 smithi159 ceph-mon[36109]: pgmap v5628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:33 smithi055 ceph-mon[31863]: pgmap v5628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:34.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9705 sec 2024-03-28T08:30:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:30:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:30:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:30:35.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9706 sec 2024-03-28T08:30:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:30:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:30:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:35 smithi086 ceph-mon[35163]: pgmap v5629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:35 smithi086 ceph-mon[35163]: pgmap v5630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:30:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:30:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:30:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:35 smithi159 ceph-mon[36109]: pgmap v5629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:35 smithi159 ceph-mon[36109]: pgmap v5630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:30:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:30:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:30:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:35 smithi055 ceph-mon[31863]: pgmap v5629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:35 smithi055 ceph-mon[31863]: pgmap v5630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:30:36.450 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9707 sec 2024-03-28T08:30:37.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9708 sec 2024-03-28T08:30:38.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9709 sec 2024-03-28T08:30:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:38 smithi086 ceph-mon[35163]: pgmap v5631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9037.951275 secs 2024-03-28T08:30:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:38 smithi159 ceph-mon[36109]: pgmap v5631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9037.951275 secs 2024-03-28T08:30:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:38 smithi055 ceph-mon[31863]: pgmap v5631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9037.951275 secs 2024-03-28T08:30:39.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9710 sec 2024-03-28T08:30:40.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9711 sec 2024-03-28T08:30:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:40 smithi086 ceph-mon[35163]: pgmap v5632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:40 smithi159 ceph-mon[36109]: pgmap v5632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:40 smithi055 ceph-mon[31863]: pgmap v5632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:41.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9712 sec 2024-03-28T08:30:42.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9713 sec 2024-03-28T08:30:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:42 smithi086 ceph-mon[35163]: pgmap v5633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:42 smithi159 ceph-mon[36109]: pgmap v5633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:42 smithi055 ceph-mon[31863]: pgmap v5633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:43.451 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9714 sec 2024-03-28T08:30:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9042.951397 secs 2024-03-28T08:30:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9042.951397 secs 2024-03-28T08:30:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9042.951397 secs 2024-03-28T08:30:44.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9715 sec 2024-03-28T08:30:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:44 smithi086 ceph-mon[35163]: pgmap v5634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:44 smithi159 ceph-mon[36109]: pgmap v5634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:44 smithi055 ceph-mon[31863]: pgmap v5634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:45.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9716 sec 2024-03-28T08:30:46.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9717 sec 2024-03-28T08:30:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:46 smithi086 ceph-mon[35163]: pgmap v5635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:30:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:46 smithi159 ceph-mon[36109]: pgmap v5635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:30:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:46 smithi055 ceph-mon[31863]: pgmap v5635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:30:47.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9718 sec 2024-03-28T08:30:48.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9719 sec 2024-03-28T08:30:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:48 smithi086 ceph-mon[35163]: pgmap v5636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9047.951464 secs 2024-03-28T08:30:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:48 smithi159 ceph-mon[36109]: pgmap v5636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9047.951464 secs 2024-03-28T08:30:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:48 smithi055 ceph-mon[31863]: pgmap v5636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9047.951464 secs 2024-03-28T08:30:49.452 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9720 sec 2024-03-28T08:30:50.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9721 sec 2024-03-28T08:30:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:50 smithi086 ceph-mon[35163]: pgmap v5637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:50 smithi159 ceph-mon[36109]: pgmap v5637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:50 smithi055 ceph-mon[31863]: pgmap v5637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:51.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9722 sec 2024-03-28T08:30:52.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9723 sec 2024-03-28T08:30:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:52 smithi055 ceph-mon[31863]: pgmap v5638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:52 smithi086 ceph-mon[35163]: pgmap v5638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:52 smithi159 ceph-mon[36109]: pgmap v5638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:53.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9724 sec 2024-03-28T08:30:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9052.951527 secs 2024-03-28T08:30:53.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9052.951527 secs 2024-03-28T08:30:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9052.951527 secs 2024-03-28T08:30:54.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9725 sec 2024-03-28T08:30:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:54 smithi055 ceph-mon[31863]: pgmap v5639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:54.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:54 smithi159 ceph-mon[36109]: pgmap v5639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:54 smithi086 ceph-mon[35163]: pgmap v5639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:30:55.453 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9726 sec 2024-03-28T08:30:56.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9727 sec 2024-03-28T08:30:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:56 smithi159 ceph-mon[36109]: pgmap v5640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:56 smithi055 ceph-mon[31863]: pgmap v5640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:56 smithi086 ceph-mon[35163]: pgmap v5640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:30:57.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9728 sec 2024-03-28T08:30:58.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9729 sec 2024-03-28T08:30:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:58 smithi055 ceph-mon[31863]: pgmap v5641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:30:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9057.951591 secs 2024-03-28T08:30:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:58 smithi086 ceph-mon[35163]: pgmap v5641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:30:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9057.951591 secs 2024-03-28T08:30:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:58 smithi159 ceph-mon[36109]: pgmap v5641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:30:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:30:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9057.951591 secs 2024-03-28T08:30:59.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9730 sec 2024-03-28T08:31:00.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9731 sec 2024-03-28T08:31:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:00 smithi055 ceph-mon[31863]: pgmap v5642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:00 smithi086 ceph-mon[35163]: pgmap v5642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:00 smithi159 ceph-mon[36109]: pgmap v5642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:01.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9732 sec 2024-03-28T08:31:02.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9733 sec 2024-03-28T08:31:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:02 smithi086 ceph-mon[35163]: pgmap v5643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:02 smithi159 ceph-mon[36109]: pgmap v5643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:02 smithi055 ceph-mon[31863]: pgmap v5643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:03.454 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9734 sec 2024-03-28T08:31:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9062.951654 secs 2024-03-28T08:31:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9062.951654 secs 2024-03-28T08:31:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9062.951654 secs 2024-03-28T08:31:04.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9735 sec 2024-03-28T08:31:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:04 smithi086 ceph-mon[35163]: pgmap v5644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:04 smithi159 ceph-mon[36109]: pgmap v5644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:04 smithi055 ceph-mon[31863]: pgmap v5644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:05.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9736 sec 2024-03-28T08:31:06.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9737 sec 2024-03-28T08:31:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:06 smithi086 ceph-mon[35163]: pgmap v5645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:06 smithi159 ceph-mon[36109]: pgmap v5645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:06 smithi055 ceph-mon[31863]: pgmap v5645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:07.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9738 sec 2024-03-28T08:31:08.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9739 sec 2024-03-28T08:31:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:08 smithi086 ceph-mon[35163]: pgmap v5646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9067.951719 secs 2024-03-28T08:31:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:08 smithi159 ceph-mon[36109]: pgmap v5646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9067.951719 secs 2024-03-28T08:31:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:08 smithi055 ceph-mon[31863]: pgmap v5646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9067.951719 secs 2024-03-28T08:31:09.455 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9740 sec 2024-03-28T08:31:10.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9741 sec 2024-03-28T08:31:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:10 smithi086 ceph-mon[35163]: pgmap v5647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:10 smithi159 ceph-mon[36109]: pgmap v5647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:10 smithi055 ceph-mon[31863]: pgmap v5647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:11.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9742 sec 2024-03-28T08:31:12.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9743 sec 2024-03-28T08:31:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:12 smithi086 ceph-mon[35163]: pgmap v5648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:12 smithi159 ceph-mon[36109]: pgmap v5648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:12 smithi055 ceph-mon[31863]: pgmap v5648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:13.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9744 sec 2024-03-28T08:31:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9072.951844 secs 2024-03-28T08:31:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9072.951844 secs 2024-03-28T08:31:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9072.951844 secs 2024-03-28T08:31:14.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9745 sec 2024-03-28T08:31:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:14 smithi086 ceph-mon[35163]: pgmap v5649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:14 smithi159 ceph-mon[36109]: pgmap v5649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:14 smithi055 ceph-mon[31863]: pgmap v5649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:15.456 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9746 sec 2024-03-28T08:31:16.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9747 sec 2024-03-28T08:31:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:16 smithi086 ceph-mon[35163]: pgmap v5650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:16 smithi159 ceph-mon[36109]: pgmap v5650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:16 smithi055 ceph-mon[31863]: pgmap v5650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:17.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9748 sec 2024-03-28T08:31:18.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9749 sec 2024-03-28T08:31:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:18 smithi086 ceph-mon[35163]: pgmap v5651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9077.951915 secs 2024-03-28T08:31:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:18 smithi159 ceph-mon[36109]: pgmap v5651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9077.951915 secs 2024-03-28T08:31:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:18 smithi055 ceph-mon[31863]: pgmap v5651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9077.951915 secs 2024-03-28T08:31:19.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9750 sec 2024-03-28T08:31:20.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9751 sec 2024-03-28T08:31:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:20 smithi086 ceph-mon[35163]: pgmap v5652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:20 smithi159 ceph-mon[36109]: pgmap v5652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:20 smithi055 ceph-mon[31863]: pgmap v5652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:21.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9752 sec 2024-03-28T08:31:22.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9753 sec 2024-03-28T08:31:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:22 smithi086 ceph-mon[35163]: pgmap v5653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:22 smithi159 ceph-mon[36109]: pgmap v5653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:22 smithi055 ceph-mon[31863]: pgmap v5653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:23.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9754 sec 2024-03-28T08:31:24.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9082.952003 secs 2024-03-28T08:31:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9082.952003 secs 2024-03-28T08:31:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9082.952003 secs 2024-03-28T08:31:24.457 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9755 sec 2024-03-28T08:31:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:24 smithi086 ceph-mon[35163]: pgmap v5654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:24 smithi159 ceph-mon[36109]: pgmap v5654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:24 smithi055 ceph-mon[31863]: pgmap v5654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:25.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9756 sec 2024-03-28T08:31:26.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9757 sec 2024-03-28T08:31:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:26 smithi086 ceph-mon[35163]: pgmap v5655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:26 smithi159 ceph-mon[36109]: pgmap v5655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:26 smithi055 ceph-mon[31863]: pgmap v5655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:27.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9758 sec 2024-03-28T08:31:28.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9759 sec 2024-03-28T08:31:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:28 smithi086 ceph-mon[35163]: pgmap v5656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9087.952081 secs 2024-03-28T08:31:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:28 smithi159 ceph-mon[36109]: pgmap v5656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9087.952081 secs 2024-03-28T08:31:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:28 smithi055 ceph-mon[31863]: pgmap v5656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9087.952081 secs 2024-03-28T08:31:29.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9760 sec 2024-03-28T08:31:30.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9761 sec 2024-03-28T08:31:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:30 smithi086 ceph-mon[35163]: pgmap v5657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:30 smithi159 ceph-mon[36109]: pgmap v5657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:30 smithi055 ceph-mon[31863]: pgmap v5657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:31.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9762 sec 2024-03-28T08:31:32.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9763 sec 2024-03-28T08:31:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:32 smithi086 ceph-mon[35163]: pgmap v5658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9092.952200 secs 2024-03-28T08:31:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:32 smithi159 ceph-mon[36109]: pgmap v5658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9092.952200 secs 2024-03-28T08:31:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:32 smithi055 ceph-mon[31863]: pgmap v5658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9092.952200 secs 2024-03-28T08:31:33.458 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9764 sec 2024-03-28T08:31:34.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9765 sec 2024-03-28T08:31:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:34 smithi086 ceph-mon[35163]: pgmap v5659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:34 smithi159 ceph-mon[36109]: pgmap v5659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:34 smithi055 ceph-mon[31863]: pgmap v5659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:35.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9766 sec 2024-03-28T08:31:36.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9767 sec 2024-03-28T08:31:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:36 smithi086 ceph-mon[35163]: pgmap v5660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:31:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:36 smithi159 ceph-mon[36109]: pgmap v5660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:31:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:36 smithi055 ceph-mon[31863]: pgmap v5660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:31:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:31:37.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9768 sec 2024-03-28T08:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9097.952272 secs 2024-03-28T08:31:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9097.952272 secs 2024-03-28T08:31:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9097.952272 secs 2024-03-28T08:31:38.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9769 sec 2024-03-28T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:38 smithi086 ceph-mon[35163]: pgmap v5661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:31:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:38 smithi159 ceph-mon[36109]: pgmap v5661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:31:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:31:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:38 smithi055 ceph-mon[31863]: pgmap v5661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:31:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:31:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:31:39.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9770 sec 2024-03-28T08:31:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:39 smithi086 ceph-mon[35163]: pgmap v5662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:39 smithi086 ceph-mon[35163]: pgmap v5663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:39 smithi159 ceph-mon[36109]: pgmap v5662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:39 smithi159 ceph-mon[36109]: pgmap v5663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:39 smithi055 ceph-mon[31863]: pgmap v5662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:39 smithi055 ceph-mon[31863]: pgmap v5663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:40.459 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9771 sec 2024-03-28T08:31:41.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9772 sec 2024-03-28T08:31:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:41 smithi055 ceph-mon[31863]: pgmap v5664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:41 smithi086 ceph-mon[35163]: pgmap v5664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:41 smithi159 ceph-mon[36109]: pgmap v5664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:42.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9773 sec 2024-03-28T08:31:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9102.952397 secs 2024-03-28T08:31:43.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9102.952397 secs 2024-03-28T08:31:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9102.952397 secs 2024-03-28T08:31:43.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9774 sec 2024-03-28T08:31:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:43 smithi055 ceph-mon[31863]: pgmap v5665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:44.240 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:43 smithi086 ceph-mon[35163]: pgmap v5665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:43 smithi159 ceph-mon[36109]: pgmap v5665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:44.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9775 sec 2024-03-28T08:31:45.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9776 sec 2024-03-28T08:31:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:45 smithi055 ceph-mon[31863]: pgmap v5666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:45 smithi086 ceph-mon[35163]: pgmap v5666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:45 smithi159 ceph-mon[36109]: pgmap v5666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:46.460 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9777 sec 2024-03-28T08:31:47.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9778 sec 2024-03-28T08:31:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:47 smithi055 ceph-mon[31863]: pgmap v5667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9107.952522 secs 2024-03-28T08:31:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:47 smithi086 ceph-mon[35163]: pgmap v5667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9107.952522 secs 2024-03-28T08:31:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:47 smithi159 ceph-mon[36109]: pgmap v5667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:31:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9107.952522 secs 2024-03-28T08:31:48.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9779 sec 2024-03-28T08:31:49.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9780 sec 2024-03-28T08:31:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:49 smithi055 ceph-mon[31863]: pgmap v5668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:31:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:49 smithi086 ceph-mon[35163]: pgmap v5668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:31:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:49 smithi159 ceph-mon[36109]: pgmap v5668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:31:50.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9781 sec 2024-03-28T08:31:51.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9782 sec 2024-03-28T08:31:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:51 smithi055 ceph-mon[31863]: pgmap v5669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:51 smithi086 ceph-mon[35163]: pgmap v5669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:51 smithi159 ceph-mon[36109]: pgmap v5669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:31:52.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9783 sec 2024-03-28T08:31:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:52 smithi159 ceph-mon[36109]: pgmap v5670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9112.952634 secs 2024-03-28T08:31:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:52 smithi086 ceph-mon[35163]: pgmap v5670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9112.952634 secs 2024-03-28T08:31:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:52 smithi055 ceph-mon[31863]: pgmap v5670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9112.952634 secs 2024-03-28T08:31:53.461 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9784 sec 2024-03-28T08:31:54.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9785 sec 2024-03-28T08:31:55.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9786 sec 2024-03-28T08:31:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:55 smithi086 ceph-mon[35163]: pgmap v5671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:55 smithi159 ceph-mon[36109]: pgmap v5671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:55 smithi055 ceph-mon[31863]: pgmap v5671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:56.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9787 sec 2024-03-28T08:31:57.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9788 sec 2024-03-28T08:31:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:57 smithi086 ceph-mon[35163]: pgmap v5672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:57 smithi159 ceph-mon[36109]: pgmap v5672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:57 smithi055 ceph-mon[31863]: pgmap v5672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:58.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9789 sec 2024-03-28T08:31:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9117.952755 secs 2024-03-28T08:31:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9117.952755 secs 2024-03-28T08:31:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9117.952755 secs 2024-03-28T08:31:59.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9790 sec 2024-03-28T08:31:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:31:59 smithi055 ceph-mon[31863]: pgmap v5673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:31:59 smithi086 ceph-mon[35163]: pgmap v5673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:31:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:31:59 smithi159 ceph-mon[36109]: pgmap v5673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:00.462 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9791 sec 2024-03-28T08:32:01.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9792 sec 2024-03-28T08:32:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:01 smithi055 ceph-mon[31863]: pgmap v5674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:01 smithi086 ceph-mon[35163]: pgmap v5674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:01 smithi159 ceph-mon[36109]: pgmap v5674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:02.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9793 sec 2024-03-28T08:32:03.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9794 sec 2024-03-28T08:32:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:03 smithi055 ceph-mon[31863]: pgmap v5675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9122.952865 secs 2024-03-28T08:32:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:03 smithi086 ceph-mon[35163]: pgmap v5675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9122.952865 secs 2024-03-28T08:32:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:03 smithi159 ceph-mon[36109]: pgmap v5675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9122.952865 secs 2024-03-28T08:32:04.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9795 sec 2024-03-28T08:32:05.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9796 sec 2024-03-28T08:32:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:05 smithi055 ceph-mon[31863]: pgmap v5676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:05 smithi086 ceph-mon[35163]: pgmap v5676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:05 smithi159 ceph-mon[36109]: pgmap v5676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:06.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9797 sec 2024-03-28T08:32:07.463 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9798 sec 2024-03-28T08:32:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:07 smithi086 ceph-mon[35163]: pgmap v5677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:07 smithi159 ceph-mon[36109]: pgmap v5677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:07 smithi055 ceph-mon[31863]: pgmap v5677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:08.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9799 sec 2024-03-28T08:32:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9127.952954 secs 2024-03-28T08:32:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9127.952954 secs 2024-03-28T08:32:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9127.952954 secs 2024-03-28T08:32:09.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9800 sec 2024-03-28T08:32:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:09 smithi086 ceph-mon[35163]: pgmap v5678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:09 smithi159 ceph-mon[36109]: pgmap v5678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:09 smithi055 ceph-mon[31863]: pgmap v5678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:10.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9801 sec 2024-03-28T08:32:11.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9802 sec 2024-03-28T08:32:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:11 smithi086 ceph-mon[35163]: pgmap v5679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:11 smithi159 ceph-mon[36109]: pgmap v5679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:11 smithi055 ceph-mon[31863]: pgmap v5679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:12.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9803 sec 2024-03-28T08:32:13.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9804 sec 2024-03-28T08:32:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:13 smithi086 ceph-mon[35163]: pgmap v5680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9132.953029 secs 2024-03-28T08:32:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:13 smithi159 ceph-mon[36109]: pgmap v5680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9132.953029 secs 2024-03-28T08:32:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:13 smithi055 ceph-mon[31863]: pgmap v5680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9132.953029 secs 2024-03-28T08:32:14.464 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9805 sec 2024-03-28T08:32:15.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9806 sec 2024-03-28T08:32:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:15 smithi086 ceph-mon[35163]: pgmap v5681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:15 smithi159 ceph-mon[36109]: pgmap v5681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:15 smithi055 ceph-mon[31863]: pgmap v5681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:16.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9807 sec 2024-03-28T08:32:17.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9808 sec 2024-03-28T08:32:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:17 smithi086 ceph-mon[35163]: pgmap v5682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:17 smithi159 ceph-mon[36109]: pgmap v5682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:17 smithi055 ceph-mon[31863]: pgmap v5682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:18.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9809 sec 2024-03-28T08:32:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9137.953111 secs 2024-03-28T08:32:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9137.953111 secs 2024-03-28T08:32:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9137.953111 secs 2024-03-28T08:32:19.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9810 sec 2024-03-28T08:32:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:19 smithi086 ceph-mon[35163]: pgmap v5683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:19 smithi159 ceph-mon[36109]: pgmap v5683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:19 smithi055 ceph-mon[31863]: pgmap v5683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:20.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9811 sec 2024-03-28T08:32:21.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9812 sec 2024-03-28T08:32:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:21 smithi086 ceph-mon[35163]: pgmap v5684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:21 smithi159 ceph-mon[36109]: pgmap v5684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:21 smithi055 ceph-mon[31863]: pgmap v5684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:22.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9813 sec 2024-03-28T08:32:23.465 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9814 sec 2024-03-28T08:32:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:23 smithi086 ceph-mon[35163]: pgmap v5685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9142.953235 secs 2024-03-28T08:32:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:23 smithi159 ceph-mon[36109]: pgmap v5685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9142.953235 secs 2024-03-28T08:32:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:23 smithi055 ceph-mon[31863]: pgmap v5685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9142.953235 secs 2024-03-28T08:32:24.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9815 sec 2024-03-28T08:32:25.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9816 sec 2024-03-28T08:32:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:25 smithi086 ceph-mon[35163]: pgmap v5686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:25 smithi159 ceph-mon[36109]: pgmap v5686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:25 smithi055 ceph-mon[31863]: pgmap v5686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:26.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9817 sec 2024-03-28T08:32:27.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9818 sec 2024-03-28T08:32:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:27 smithi086 ceph-mon[35163]: pgmap v5687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:27 smithi159 ceph-mon[36109]: pgmap v5687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:27 smithi055 ceph-mon[31863]: pgmap v5687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:28.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9819 sec 2024-03-28T08:32:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9147.953313 secs 2024-03-28T08:32:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9147.953313 secs 2024-03-28T08:32:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9147.953313 secs 2024-03-28T08:32:29.466 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9820 sec 2024-03-28T08:32:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:29 smithi086 ceph-mon[35163]: pgmap v5688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:29 smithi159 ceph-mon[36109]: pgmap v5688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:29 smithi055 ceph-mon[31863]: pgmap v5688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:30.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9821 sec 2024-03-28T08:32:31.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9822 sec 2024-03-28T08:32:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:31 smithi086 ceph-mon[35163]: pgmap v5689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:31 smithi159 ceph-mon[36109]: pgmap v5689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:31 smithi055 ceph-mon[31863]: pgmap v5689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:32.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9823 sec 2024-03-28T08:32:33.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9824 sec 2024-03-28T08:32:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:33 smithi086 ceph-mon[35163]: pgmap v5690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9152.953378 secs 2024-03-28T08:32:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:33 smithi159 ceph-mon[36109]: pgmap v5690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9152.953378 secs 2024-03-28T08:32:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:33 smithi055 ceph-mon[31863]: pgmap v5690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9152.953378 secs 2024-03-28T08:32:34.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9825 sec 2024-03-28T08:32:35.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9826 sec 2024-03-28T08:32:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:35 smithi086 ceph-mon[35163]: pgmap v5691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:35 smithi159 ceph-mon[36109]: pgmap v5691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:35 smithi055 ceph-mon[31863]: pgmap v5691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:36.467 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9827 sec 2024-03-28T08:32:37.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9828 sec 2024-03-28T08:32:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:37 smithi086 ceph-mon[35163]: pgmap v5692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:37 smithi159 ceph-mon[36109]: pgmap v5692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:37 smithi055 ceph-mon[31863]: pgmap v5692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:38.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9829 sec 2024-03-28T08:32:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9157.953456 secs 2024-03-28T08:32:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9157.953456 secs 2024-03-28T08:32:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9157.953456 secs 2024-03-28T08:32:39.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9830 sec 2024-03-28T08:32:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:39 smithi086 ceph-mon[35163]: pgmap v5693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:32:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:39 smithi159 ceph-mon[36109]: pgmap v5693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:32:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:39 smithi055 ceph-mon[31863]: pgmap v5693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:32:40.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9831 sec 2024-03-28T08:32:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:41.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9832 sec 2024-03-28T08:32:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:41 smithi055 ceph-mon[31863]: pgmap v5694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:41 smithi086 ceph-mon[35163]: pgmap v5694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:41 smithi159 ceph-mon[36109]: pgmap v5694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:42.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9833 sec 2024-03-28T08:32:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9834 sec 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: pgmap v5695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9162.953554 secs 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: pgmap v5695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9162.953554 secs 2024-03-28T08:32:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: pgmap v5695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9162.953554 secs 2024-03-28T08:32:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:44.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9835 sec 2024-03-28T08:32:45.468 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9836 sec 2024-03-28T08:32:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: pgmap v5696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:32:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:32:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: pgmap v5697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: pgmap v5698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: pgmap v5696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:32:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:32:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: pgmap v5697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: pgmap v5698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: pgmap v5696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:32:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:32:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:32:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: pgmap v5697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: pgmap v5698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:32:46.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9837 sec 2024-03-28T08:32:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:46 smithi086 ceph-mon[35163]: pgmap v5699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:46 smithi159 ceph-mon[36109]: pgmap v5699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:46 smithi055 ceph-mon[31863]: pgmap v5699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:32:47.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9838 sec 2024-03-28T08:32:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9167.953629 secs 2024-03-28T08:32:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9167.953629 secs 2024-03-28T08:32:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9167.953629 secs 2024-03-28T08:32:48.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9839 sec 2024-03-28T08:32:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:48 smithi086 ceph-mon[35163]: pgmap v5700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:32:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:48 smithi159 ceph-mon[36109]: pgmap v5700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:32:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:48 smithi055 ceph-mon[31863]: pgmap v5700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:32:49.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9840 sec 2024-03-28T08:32:50.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9841 sec 2024-03-28T08:32:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:50 smithi086 ceph-mon[35163]: pgmap v5701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:32:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:50 smithi159 ceph-mon[36109]: pgmap v5701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:32:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:50 smithi055 ceph-mon[31863]: pgmap v5701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:32:51.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9842 sec 2024-03-28T08:32:52.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9843 sec 2024-03-28T08:32:53.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9172.953746 secs 2024-03-28T08:32:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9172.953746 secs 2024-03-28T08:32:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9172.953746 secs 2024-03-28T08:32:53.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9844 sec 2024-03-28T08:32:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:53 smithi055 ceph-mon[31863]: pgmap v5702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:32:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:53 smithi086 ceph-mon[35163]: pgmap v5702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:32:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:53 smithi159 ceph-mon[36109]: pgmap v5702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:32:54.469 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9845 sec 2024-03-28T08:32:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:54 smithi086 ceph-mon[35163]: pgmap v5703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:54 smithi159 ceph-mon[36109]: pgmap v5703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:54 smithi055 ceph-mon[31863]: pgmap v5703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:32:55.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9846 sec 2024-03-28T08:32:56.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9847 sec 2024-03-28T08:32:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:56 smithi055 ceph-mon[31863]: pgmap v5704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:56 smithi086 ceph-mon[35163]: pgmap v5704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:56 smithi159 ceph-mon[36109]: pgmap v5704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:57.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9848 sec 2024-03-28T08:32:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9177.953809 secs 2024-03-28T08:32:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9177.953809 secs 2024-03-28T08:32:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9177.953809 secs 2024-03-28T08:32:58.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9849 sec 2024-03-28T08:32:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:32:58 smithi086 ceph-mon[35163]: pgmap v5705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:32:58 smithi159 ceph-mon[36109]: pgmap v5705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:32:58 smithi055 ceph-mon[31863]: pgmap v5705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:32:59.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9850 sec 2024-03-28T08:33:00.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9851 sec 2024-03-28T08:33:01.470 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9852 sec 2024-03-28T08:33:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:01 smithi086 ceph-mon[35163]: pgmap v5706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:01 smithi159 ceph-mon[36109]: pgmap v5706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:01 smithi055 ceph-mon[31863]: pgmap v5706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:02.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9853 sec 2024-03-28T08:33:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9182.953932 secs 2024-03-28T08:33:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9182.953932 secs 2024-03-28T08:33:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9182.953932 secs 2024-03-28T08:33:03.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9854 sec 2024-03-28T08:33:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:03 smithi086 ceph-mon[35163]: pgmap v5707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:03 smithi159 ceph-mon[36109]: pgmap v5707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:03 smithi055 ceph-mon[31863]: pgmap v5707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:04.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9855 sec 2024-03-28T08:33:05.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9856 sec 2024-03-28T08:33:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:05 smithi086 ceph-mon[35163]: pgmap v5708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:05 smithi159 ceph-mon[36109]: pgmap v5708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:05 smithi055 ceph-mon[31863]: pgmap v5708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:06.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9857 sec 2024-03-28T08:33:07.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9858 sec 2024-03-28T08:33:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:07 smithi055 ceph-mon[31863]: pgmap v5709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9187.954020 secs 2024-03-28T08:33:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:07 smithi086 ceph-mon[35163]: pgmap v5709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9187.954020 secs 2024-03-28T08:33:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:07 smithi159 ceph-mon[36109]: pgmap v5709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9187.954020 secs 2024-03-28T08:33:08.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9859 sec 2024-03-28T08:33:09.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9860 sec 2024-03-28T08:33:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:09 smithi086 ceph-mon[35163]: pgmap v5710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:09 smithi159 ceph-mon[36109]: pgmap v5710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:09 smithi055 ceph-mon[31863]: pgmap v5710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:10.471 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9861 sec 2024-03-28T08:33:11.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9862 sec 2024-03-28T08:33:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:11 smithi086 ceph-mon[35163]: pgmap v5711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:11 smithi159 ceph-mon[36109]: pgmap v5711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:11 smithi055 ceph-mon[31863]: pgmap v5711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:12.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9863 sec 2024-03-28T08:33:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9192.954122 secs 2024-03-28T08:33:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9192.954122 secs 2024-03-28T08:33:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9192.954122 secs 2024-03-28T08:33:13.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9864 sec 2024-03-28T08:33:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:13 smithi086 ceph-mon[35163]: pgmap v5712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:13 smithi159 ceph-mon[36109]: pgmap v5712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:13 smithi055 ceph-mon[31863]: pgmap v5712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:14.472 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9865 sec 2024-03-28T08:33:15.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9866 sec 2024-03-28T08:33:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:16 smithi086 ceph-mon[35163]: pgmap v5713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:16 smithi159 ceph-mon[36109]: pgmap v5713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:16 smithi055 ceph-mon[31863]: pgmap v5713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:16.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9867 sec 2024-03-28T08:33:17.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9868 sec 2024-03-28T08:33:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:18 smithi086 ceph-mon[35163]: pgmap v5714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9197.954220 secs 2024-03-28T08:33:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:18 smithi159 ceph-mon[36109]: pgmap v5714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9197.954220 secs 2024-03-28T08:33:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:18 smithi055 ceph-mon[31863]: pgmap v5714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9197.954220 secs 2024-03-28T08:33:18.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9869 sec 2024-03-28T08:33:19.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9870 sec 2024-03-28T08:33:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:20 smithi086 ceph-mon[35163]: pgmap v5715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:20 smithi159 ceph-mon[36109]: pgmap v5715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:20 smithi055 ceph-mon[31863]: pgmap v5715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:20.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9871 sec 2024-03-28T08:33:21.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9872 sec 2024-03-28T08:33:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:22 smithi086 ceph-mon[35163]: pgmap v5716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:22 smithi159 ceph-mon[36109]: pgmap v5716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:22 smithi055 ceph-mon[31863]: pgmap v5716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:22.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9873 sec 2024-03-28T08:33:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9202.954345 secs 2024-03-28T08:33:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9202.954345 secs 2024-03-28T08:33:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9202.954345 secs 2024-03-28T08:33:23.473 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9874 sec 2024-03-28T08:33:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:24 smithi086 ceph-mon[35163]: pgmap v5717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:24 smithi159 ceph-mon[36109]: pgmap v5717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:24 smithi055 ceph-mon[31863]: pgmap v5717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:24.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9875 sec 2024-03-28T08:33:25.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9876 sec 2024-03-28T08:33:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:26 smithi086 ceph-mon[35163]: pgmap v5718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:26 smithi159 ceph-mon[36109]: pgmap v5718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:26 smithi055 ceph-mon[31863]: pgmap v5718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:26.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9877 sec 2024-03-28T08:33:27.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9878 sec 2024-03-28T08:33:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:28 smithi086 ceph-mon[35163]: pgmap v5719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9207.954467 secs 2024-03-28T08:33:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:28 smithi159 ceph-mon[36109]: pgmap v5719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9207.954467 secs 2024-03-28T08:33:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:28 smithi055 ceph-mon[31863]: pgmap v5719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9207.954467 secs 2024-03-28T08:33:28.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9879 sec 2024-03-28T08:33:29.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9880 sec 2024-03-28T08:33:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:30 smithi086 ceph-mon[35163]: pgmap v5720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:30 smithi159 ceph-mon[36109]: pgmap v5720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:30 smithi055 ceph-mon[31863]: pgmap v5720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:30.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9881 sec 2024-03-28T08:33:31.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9882 sec 2024-03-28T08:33:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:32 smithi159 ceph-mon[36109]: pgmap v5721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:32 smithi055 ceph-mon[31863]: pgmap v5721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:32.474 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9883 sec 2024-03-28T08:33:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:32 smithi086 ceph-mon[35163]: pgmap v5721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9212.954592 secs 2024-03-28T08:33:33.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9884 sec 2024-03-28T08:33:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9212.954592 secs 2024-03-28T08:33:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9212.954592 secs 2024-03-28T08:33:34.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:34 smithi055 ceph-mon[31863]: pgmap v5722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:34.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9885 sec 2024-03-28T08:33:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:34 smithi086 ceph-mon[35163]: pgmap v5722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:34 smithi159 ceph-mon[36109]: pgmap v5722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:35.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9886 sec 2024-03-28T08:33:36.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:36 smithi055 ceph-mon[31863]: pgmap v5723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:36.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9887 sec 2024-03-28T08:33:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:36 smithi086 ceph-mon[35163]: pgmap v5723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:36 smithi159 ceph-mon[36109]: pgmap v5723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:37.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9888 sec 2024-03-28T08:33:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:38 smithi055 ceph-mon[31863]: pgmap v5724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9217.954715 secs 2024-03-28T08:33:38.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9889 sec 2024-03-28T08:33:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:38 smithi086 ceph-mon[35163]: pgmap v5724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9217.954715 secs 2024-03-28T08:33:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:38 smithi159 ceph-mon[36109]: pgmap v5724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9217.954715 secs 2024-03-28T08:33:39.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9890 sec 2024-03-28T08:33:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:40 smithi055 ceph-mon[31863]: pgmap v5725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:40.475 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9891 sec 2024-03-28T08:33:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:40 smithi086 ceph-mon[35163]: pgmap v5725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:40 smithi159 ceph-mon[36109]: pgmap v5725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:41.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9892 sec 2024-03-28T08:33:42.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9893 sec 2024-03-28T08:33:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:42 smithi086 ceph-mon[35163]: pgmap v5726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:42 smithi159 ceph-mon[36109]: pgmap v5726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:42 smithi055 ceph-mon[31863]: pgmap v5726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:43.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9222.954811 secs 2024-03-28T08:33:43.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9894 sec 2024-03-28T08:33:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9222.954811 secs 2024-03-28T08:33:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9222.954811 secs 2024-03-28T08:33:44.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9895 sec 2024-03-28T08:33:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:44 smithi086 ceph-mon[35163]: pgmap v5727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:44 smithi159 ceph-mon[36109]: pgmap v5727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:44 smithi055 ceph-mon[31863]: pgmap v5727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:45.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9896 sec 2024-03-28T08:33:46.476 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9897 sec 2024-03-28T08:33:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:46 smithi086 ceph-mon[35163]: pgmap v5728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:33:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:46 smithi159 ceph-mon[36109]: pgmap v5728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:33:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:46 smithi055 ceph-mon[31863]: pgmap v5728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:33:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:33:47.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9898 sec 2024-03-28T08:33:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:33:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:33:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:47 smithi086 ceph-mon[35163]: pgmap v5729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:47 smithi086 ceph-mon[35163]: pgmap v5730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:33:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:33:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:33:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:47 smithi159 ceph-mon[36109]: pgmap v5729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:47 smithi159 ceph-mon[36109]: pgmap v5730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:33:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:33:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:33:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:47 smithi055 ceph-mon[31863]: pgmap v5729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:33:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:47 smithi055 ceph-mon[31863]: pgmap v5730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:47.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:33:48.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9899 sec 2024-03-28T08:33:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9227.954883 secs 2024-03-28T08:33:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9227.954883 secs 2024-03-28T08:33:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9227.954883 secs 2024-03-28T08:33:49.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9900 sec 2024-03-28T08:33:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:49 smithi086 ceph-mon[35163]: pgmap v5731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:49 smithi159 ceph-mon[36109]: pgmap v5731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:49 smithi055 ceph-mon[31863]: pgmap v5731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:50.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9901 sec 2024-03-28T08:33:51.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9902 sec 2024-03-28T08:33:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:51 smithi086 ceph-mon[35163]: pgmap v5732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:51 smithi159 ceph-mon[36109]: pgmap v5732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:51 smithi055 ceph-mon[31863]: pgmap v5732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:52.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9903 sec 2024-03-28T08:33:53.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9904 sec 2024-03-28T08:33:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9232.955000 secs 2024-03-28T08:33:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:53 smithi086 ceph-mon[35163]: pgmap v5733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:33:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9232.955000 secs 2024-03-28T08:33:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:53 smithi159 ceph-mon[36109]: pgmap v5733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:33:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9232.955000 secs 2024-03-28T08:33:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:53 smithi055 ceph-mon[31863]: pgmap v5733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:33:54.477 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9905 sec 2024-03-28T08:33:55.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9906 sec 2024-03-28T08:33:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:55 smithi086 ceph-mon[35163]: pgmap v5734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:55 smithi159 ceph-mon[36109]: pgmap v5734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:55 smithi055 ceph-mon[31863]: pgmap v5734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:33:56.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9907 sec 2024-03-28T08:33:57.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9908 sec 2024-03-28T08:33:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:57 smithi086 ceph-mon[35163]: pgmap v5735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:57 smithi159 ceph-mon[36109]: pgmap v5735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:57 smithi055 ceph-mon[31863]: pgmap v5735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:33:58.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9909 sec 2024-03-28T08:33:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9237.955068 secs 2024-03-28T08:33:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9237.955068 secs 2024-03-28T08:33:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9237.955068 secs 2024-03-28T08:33:59.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9910 sec 2024-03-28T08:34:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:33:59 smithi086 ceph-mon[35163]: pgmap v5736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:33:59 smithi159 ceph-mon[36109]: pgmap v5736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:33:59 smithi055 ceph-mon[31863]: pgmap v5736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:00.478 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9911 sec 2024-03-28T08:34:01.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9912 sec 2024-03-28T08:34:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:01 smithi086 ceph-mon[35163]: pgmap v5737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:01 smithi159 ceph-mon[36109]: pgmap v5737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:01 smithi055 ceph-mon[31863]: pgmap v5737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:02.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9913 sec 2024-03-28T08:34:03.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9914 sec 2024-03-28T08:34:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9242.955183 secs 2024-03-28T08:34:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:03 smithi086 ceph-mon[35163]: pgmap v5738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9242.955183 secs 2024-03-28T08:34:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:03 smithi159 ceph-mon[36109]: pgmap v5738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9242.955183 secs 2024-03-28T08:34:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:03 smithi055 ceph-mon[31863]: pgmap v5738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:04.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9915 sec 2024-03-28T08:34:05.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9916 sec 2024-03-28T08:34:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:05 smithi086 ceph-mon[35163]: pgmap v5739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:05 smithi159 ceph-mon[36109]: pgmap v5739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:05 smithi055 ceph-mon[31863]: pgmap v5739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:06.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9917 sec 2024-03-28T08:34:07.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9918 sec 2024-03-28T08:34:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:07 smithi086 ceph-mon[35163]: pgmap v5740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9247.955307 secs 2024-03-28T08:34:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:07 smithi159 ceph-mon[36109]: pgmap v5740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9247.955307 secs 2024-03-28T08:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:07 smithi055 ceph-mon[31863]: pgmap v5740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9247.955307 secs 2024-03-28T08:34:08.479 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9919 sec 2024-03-28T08:34:09.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9920 sec 2024-03-28T08:34:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:09 smithi055 ceph-mon[31863]: pgmap v5741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:09 smithi086 ceph-mon[35163]: pgmap v5741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:09 smithi159 ceph-mon[36109]: pgmap v5741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:10.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9921 sec 2024-03-28T08:34:11.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9922 sec 2024-03-28T08:34:12.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:11 smithi055 ceph-mon[31863]: pgmap v5742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:11 smithi086 ceph-mon[35163]: pgmap v5742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:11 smithi159 ceph-mon[36109]: pgmap v5742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:12.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9923 sec 2024-03-28T08:34:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9252.955389 secs 2024-03-28T08:34:13.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9252.955389 secs 2024-03-28T08:34:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9252.955389 secs 2024-03-28T08:34:13.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9924 sec 2024-03-28T08:34:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:13 smithi055 ceph-mon[31863]: pgmap v5743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:13 smithi086 ceph-mon[35163]: pgmap v5743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:13 smithi159 ceph-mon[36109]: pgmap v5743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:14.480 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9925 sec 2024-03-28T08:34:15.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9926 sec 2024-03-28T08:34:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:15 smithi055 ceph-mon[31863]: pgmap v5744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:15 smithi086 ceph-mon[35163]: pgmap v5744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:15 smithi159 ceph-mon[36109]: pgmap v5744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:16.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9927 sec 2024-03-28T08:34:17.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9928 sec 2024-03-28T08:34:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:17 smithi086 ceph-mon[35163]: pgmap v5745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9257.955509 secs 2024-03-28T08:34:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:17 smithi159 ceph-mon[36109]: pgmap v5745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9257.955509 secs 2024-03-28T08:34:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:17 smithi055 ceph-mon[31863]: pgmap v5745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9257.955509 secs 2024-03-28T08:34:18.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9929 sec 2024-03-28T08:34:19.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9930 sec 2024-03-28T08:34:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:19 smithi086 ceph-mon[35163]: pgmap v5746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:19 smithi159 ceph-mon[36109]: pgmap v5746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:19 smithi055 ceph-mon[31863]: pgmap v5746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:20.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9931 sec 2024-03-28T08:34:21.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9932 sec 2024-03-28T08:34:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:21 smithi086 ceph-mon[35163]: pgmap v5747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:21 smithi159 ceph-mon[36109]: pgmap v5747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:21 smithi055 ceph-mon[31863]: pgmap v5747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:22.481 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9933 sec 2024-03-28T08:34:23.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9262.955589 secs 2024-03-28T08:34:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9262.955589 secs 2024-03-28T08:34:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9262.955589 secs 2024-03-28T08:34:23.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9934 sec 2024-03-28T08:34:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:23 smithi086 ceph-mon[35163]: pgmap v5748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:23 smithi159 ceph-mon[36109]: pgmap v5748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:23 smithi055 ceph-mon[31863]: pgmap v5748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:24.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9935 sec 2024-03-28T08:34:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:24 smithi086 ceph-mon[35163]: pgmap v5749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:24 smithi159 ceph-mon[36109]: pgmap v5749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:24 smithi055 ceph-mon[31863]: pgmap v5749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:25.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9936 sec 2024-03-28T08:34:26.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9937 sec 2024-03-28T08:34:27.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9938 sec 2024-03-28T08:34:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:27 smithi086 ceph-mon[35163]: pgmap v5750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:27 smithi159 ceph-mon[36109]: pgmap v5750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:28.077 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:27 smithi055 ceph-mon[31863]: pgmap v5750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:28.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9939 sec 2024-03-28T08:34:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9267.955711 secs 2024-03-28T08:34:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9267.955711 secs 2024-03-28T08:34:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9267.955711 secs 2024-03-28T08:34:29.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9940 sec 2024-03-28T08:34:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:29 smithi086 ceph-mon[35163]: pgmap v5751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:29 smithi159 ceph-mon[36109]: pgmap v5751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:29 smithi055 ceph-mon[31863]: pgmap v5751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:30.482 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9941 sec 2024-03-28T08:34:31.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9942 sec 2024-03-28T08:34:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:31 smithi086 ceph-mon[35163]: pgmap v5752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:31 smithi159 ceph-mon[36109]: pgmap v5752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:31 smithi055 ceph-mon[31863]: pgmap v5752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:32.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9943 sec 2024-03-28T08:34:33.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9944 sec 2024-03-28T08:34:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9272.955838 secs 2024-03-28T08:34:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:33 smithi086 ceph-mon[35163]: pgmap v5753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9272.955838 secs 2024-03-28T08:34:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:33 smithi159 ceph-mon[36109]: pgmap v5753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9272.955838 secs 2024-03-28T08:34:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:33 smithi055 ceph-mon[31863]: pgmap v5753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:34.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9945 sec 2024-03-28T08:34:35.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9946 sec 2024-03-28T08:34:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:35 smithi086 ceph-mon[35163]: pgmap v5754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:35 smithi159 ceph-mon[36109]: pgmap v5754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:35 smithi055 ceph-mon[31863]: pgmap v5754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:36.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9947 sec 2024-03-28T08:34:37.483 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9948 sec 2024-03-28T08:34:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:37 smithi086 ceph-mon[35163]: pgmap v5755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9277.955954 secs 2024-03-28T08:34:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:37 smithi159 ceph-mon[36109]: pgmap v5755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9277.955954 secs 2024-03-28T08:34:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:37 smithi055 ceph-mon[31863]: pgmap v5755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9277.955954 secs 2024-03-28T08:34:38.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9949 sec 2024-03-28T08:34:39.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9950 sec 2024-03-28T08:34:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:39 smithi086 ceph-mon[35163]: pgmap v5756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:39 smithi159 ceph-mon[36109]: pgmap v5756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:39 smithi055 ceph-mon[31863]: pgmap v5756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:40.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9951 sec 2024-03-28T08:34:41.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9952 sec 2024-03-28T08:34:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:41 smithi055 ceph-mon[31863]: pgmap v5757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:41 smithi086 ceph-mon[35163]: pgmap v5757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:41 smithi159 ceph-mon[36109]: pgmap v5757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:42.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9953 sec 2024-03-28T08:34:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9282.956022 secs 2024-03-28T08:34:43.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9282.956022 secs 2024-03-28T08:34:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9282.956022 secs 2024-03-28T08:34:43.484 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9954 sec 2024-03-28T08:34:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:43 smithi055 ceph-mon[31863]: pgmap v5758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:43 smithi086 ceph-mon[35163]: pgmap v5758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:43 smithi159 ceph-mon[36109]: pgmap v5758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:44.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9955 sec 2024-03-28T08:34:45.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9956 sec 2024-03-28T08:34:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:45 smithi055 ceph-mon[31863]: pgmap v5759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:45 smithi086 ceph-mon[35163]: pgmap v5759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:45 smithi159 ceph-mon[36109]: pgmap v5759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:46.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9957 sec 2024-03-28T08:34:47.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9958 sec 2024-03-28T08:34:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:47 smithi055 ceph-mon[31863]: pgmap v5760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:34:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9287.956102 secs 2024-03-28T08:34:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:47 smithi086 ceph-mon[35163]: pgmap v5760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:34:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9287.956102 secs 2024-03-28T08:34:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:47 smithi159 ceph-mon[36109]: pgmap v5760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:34:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9287.956102 secs 2024-03-28T08:34:48.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9959 sec 2024-03-28T08:34:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:34:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:34:49.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:34:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:34:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:34:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:34:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:34:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:34:49.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:34:49.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9960 sec 2024-03-28T08:34:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:49 smithi055 ceph-mon[31863]: pgmap v5761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:49 smithi086 ceph-mon[35163]: pgmap v5761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:49 smithi159 ceph-mon[36109]: pgmap v5761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:50.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9961 sec 2024-03-28T08:34:51.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9962 sec 2024-03-28T08:34:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:51 smithi086 ceph-mon[35163]: pgmap v5762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:51 smithi159 ceph-mon[36109]: pgmap v5762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:51 smithi055 ceph-mon[31863]: pgmap v5762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:34:52.485 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9963 sec 2024-03-28T08:34:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9292.956179 secs 2024-03-28T08:34:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9292.956179 secs 2024-03-28T08:34:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9292.956179 secs 2024-03-28T08:34:53.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9964 sec 2024-03-28T08:34:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:53 smithi086 ceph-mon[35163]: pgmap v5763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:53 smithi159 ceph-mon[36109]: pgmap v5763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:53 smithi055 ceph-mon[31863]: pgmap v5763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:34:54.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9965 sec 2024-03-28T08:34:55.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9966 sec 2024-03-28T08:34:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:55 smithi086 ceph-mon[35163]: pgmap v5764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:55 smithi159 ceph-mon[36109]: pgmap v5764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:55 smithi055 ceph-mon[31863]: pgmap v5764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:56.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9967 sec 2024-03-28T08:34:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:56 smithi086 ceph-mon[35163]: pgmap v5765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:56 smithi159 ceph-mon[36109]: pgmap v5765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:56 smithi055 ceph-mon[31863]: pgmap v5765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:57.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9968 sec 2024-03-28T08:34:58.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9297.956245 secs 2024-03-28T08:34:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9297.956245 secs 2024-03-28T08:34:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9297.956245 secs 2024-03-28T08:34:58.486 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9969 sec 2024-03-28T08:34:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:34:58 smithi086 ceph-mon[35163]: pgmap v5766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:34:58 smithi159 ceph-mon[36109]: pgmap v5766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:34:58 smithi055 ceph-mon[31863]: pgmap v5766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:34:59.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9970 sec 2024-03-28T08:35:00.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9971 sec 2024-03-28T08:35:01.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9972 sec 2024-03-28T08:35:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:01 smithi086 ceph-mon[35163]: pgmap v5767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:01 smithi159 ceph-mon[36109]: pgmap v5767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:01 smithi055 ceph-mon[31863]: pgmap v5767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:02.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9973 sec 2024-03-28T08:35:03.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9974 sec 2024-03-28T08:35:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:03 smithi086 ceph-mon[35163]: pgmap v5768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9302.956329 secs 2024-03-28T08:35:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:03 smithi159 ceph-mon[36109]: pgmap v5768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9302.956329 secs 2024-03-28T08:35:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:03 smithi055 ceph-mon[31863]: pgmap v5768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9302.956329 secs 2024-03-28T08:35:04.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9975 sec 2024-03-28T08:35:05.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9976 sec 2024-03-28T08:35:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:05 smithi086 ceph-mon[35163]: pgmap v5769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:05.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:05 smithi159 ceph-mon[36109]: pgmap v5769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:05 smithi055 ceph-mon[31863]: pgmap v5769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:06.487 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9977 sec 2024-03-28T08:35:07.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9978 sec 2024-03-28T08:35:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:07 smithi086 ceph-mon[35163]: pgmap v5770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:07 smithi159 ceph-mon[36109]: pgmap v5770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:07 smithi055 ceph-mon[31863]: pgmap v5770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:08.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9979 sec 2024-03-28T08:35:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9307.956450 secs 2024-03-28T08:35:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9307.956450 secs 2024-03-28T08:35:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9307.956450 secs 2024-03-28T08:35:09.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9980 sec 2024-03-28T08:35:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:09 smithi086 ceph-mon[35163]: pgmap v5771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:09 smithi159 ceph-mon[36109]: pgmap v5771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:09 smithi055 ceph-mon[31863]: pgmap v5771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:10.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9981 sec 2024-03-28T08:35:11.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9982 sec 2024-03-28T08:35:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:11 smithi086 ceph-mon[35163]: pgmap v5772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:11 smithi159 ceph-mon[36109]: pgmap v5772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:11 smithi055 ceph-mon[31863]: pgmap v5772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:12.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9983 sec 2024-03-28T08:35:13.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9984 sec 2024-03-28T08:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:13 smithi055 ceph-mon[31863]: pgmap v5773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9312.956530 secs 2024-03-28T08:35:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:13 smithi086 ceph-mon[35163]: pgmap v5773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9312.956530 secs 2024-03-28T08:35:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:13 smithi159 ceph-mon[36109]: pgmap v5773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9312.956530 secs 2024-03-28T08:35:14.488 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9985 sec 2024-03-28T08:35:15.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9986 sec 2024-03-28T08:35:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:15 smithi055 ceph-mon[31863]: pgmap v5774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:15 smithi086 ceph-mon[35163]: pgmap v5774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:15 smithi159 ceph-mon[36109]: pgmap v5774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:16.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9987 sec 2024-03-28T08:35:17.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9988 sec 2024-03-28T08:35:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:17 smithi055 ceph-mon[31863]: pgmap v5775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:17 smithi086 ceph-mon[35163]: pgmap v5775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:17 smithi159 ceph-mon[36109]: pgmap v5775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:18.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9989 sec 2024-03-28T08:35:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9317.956648 secs 2024-03-28T08:35:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9317.956648 secs 2024-03-28T08:35:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9317.956648 secs 2024-03-28T08:35:19.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9990 sec 2024-03-28T08:35:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:19 smithi055 ceph-mon[31863]: pgmap v5776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:19 smithi086 ceph-mon[35163]: pgmap v5776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:19 smithi159 ceph-mon[36109]: pgmap v5776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:20.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9991 sec 2024-03-28T08:35:21.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9992 sec 2024-03-28T08:35:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:21 smithi055 ceph-mon[31863]: pgmap v5777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:21 smithi086 ceph-mon[35163]: pgmap v5777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:21 smithi159 ceph-mon[36109]: pgmap v5777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:22.489 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9993 sec 2024-03-28T08:35:23.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9994 sec 2024-03-28T08:35:23.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:23 smithi159 ceph-mon[36109]: pgmap v5778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:23.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9322.956766 secs 2024-03-28T08:35:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:23 smithi055 ceph-mon[31863]: pgmap v5778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9322.956766 secs 2024-03-28T08:35:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:23 smithi086 ceph-mon[35163]: pgmap v5778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9322.956766 secs 2024-03-28T08:35:24.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9995 sec 2024-03-28T08:35:25.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9996 sec 2024-03-28T08:35:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:25 smithi086 ceph-mon[35163]: pgmap v5779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:25 smithi159 ceph-mon[36109]: pgmap v5779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:25 smithi055 ceph-mon[31863]: pgmap v5779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:26.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9997 sec 2024-03-28T08:35:27.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9998 sec 2024-03-28T08:35:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:27 smithi086 ceph-mon[35163]: pgmap v5780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:27 smithi159 ceph-mon[36109]: pgmap v5780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:27 smithi055 ceph-mon[31863]: pgmap v5780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:28.490 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 9999 sec 2024-03-28T08:35:29.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9327.956867 secs 2024-03-28T08:35:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9327.956867 secs 2024-03-28T08:35:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9327.956867 secs 2024-03-28T08:35:29.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10000 sec 2024-03-28T08:35:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:29 smithi086 ceph-mon[35163]: pgmap v5781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:29 smithi159 ceph-mon[36109]: pgmap v5781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:29 smithi055 ceph-mon[31863]: pgmap v5781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:30.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10001 sec 2024-03-28T08:35:31.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10002 sec 2024-03-28T08:35:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:31 smithi086 ceph-mon[35163]: pgmap v5782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:31 smithi159 ceph-mon[36109]: pgmap v5782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:31 smithi055 ceph-mon[31863]: pgmap v5782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:32.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10003 sec 2024-03-28T08:35:33.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10004 sec 2024-03-28T08:35:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:33 smithi086 ceph-mon[35163]: pgmap v5783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9332.956986 secs 2024-03-28T08:35:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:33 smithi159 ceph-mon[36109]: pgmap v5783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9332.956986 secs 2024-03-28T08:35:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:33 smithi055 ceph-mon[31863]: pgmap v5783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9332.956986 secs 2024-03-28T08:35:34.491 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10005 sec 2024-03-28T08:35:35.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10006 sec 2024-03-28T08:35:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:35 smithi086 ceph-mon[35163]: pgmap v5784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:35 smithi159 ceph-mon[36109]: pgmap v5784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:35 smithi055 ceph-mon[31863]: pgmap v5784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:36.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10007 sec 2024-03-28T08:35:37.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10008 sec 2024-03-28T08:35:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:37 smithi086 ceph-mon[35163]: pgmap v5785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:37 smithi159 ceph-mon[36109]: pgmap v5785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:37 smithi055 ceph-mon[31863]: pgmap v5785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:38.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10009 sec 2024-03-28T08:35:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9337.957063 secs 2024-03-28T08:35:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9337.957063 secs 2024-03-28T08:35:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9337.957063 secs 2024-03-28T08:35:39.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10010 sec 2024-03-28T08:35:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:39 smithi086 ceph-mon[35163]: pgmap v5786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:39 smithi159 ceph-mon[36109]: pgmap v5786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:39 smithi055 ceph-mon[31863]: pgmap v5786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:40.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10011 sec 2024-03-28T08:35:41.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10012 sec 2024-03-28T08:35:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:41 smithi086 ceph-mon[35163]: pgmap v5787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:41 smithi159 ceph-mon[36109]: pgmap v5787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:41 smithi055 ceph-mon[31863]: pgmap v5787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:35:42.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10013 sec 2024-03-28T08:35:43.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10014 sec 2024-03-28T08:35:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:43 smithi086 ceph-mon[35163]: pgmap v5788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9342.957184 secs 2024-03-28T08:35:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:43 smithi159 ceph-mon[36109]: pgmap v5788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9342.957184 secs 2024-03-28T08:35:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:43 smithi055 ceph-mon[31863]: pgmap v5788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:35:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9342.957184 secs 2024-03-28T08:35:44.492 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10015 sec 2024-03-28T08:35:45.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10016 sec 2024-03-28T08:35:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:45 smithi086 ceph-mon[35163]: pgmap v5789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:45 smithi159 ceph-mon[36109]: pgmap v5789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:45 smithi055 ceph-mon[31863]: pgmap v5789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:46.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10017 sec 2024-03-28T08:35:47.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10018 sec 2024-03-28T08:35:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:47 smithi086 ceph-mon[35163]: pgmap v5790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:47 smithi159 ceph-mon[36109]: pgmap v5790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:47 smithi055 ceph-mon[31863]: pgmap v5790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:35:48.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10019 sec 2024-03-28T08:35:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9347.957308 secs 2024-03-28T08:35:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9347.957308 secs 2024-03-28T08:35:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9347.957308 secs 2024-03-28T08:35:49.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10020 sec 2024-03-28T08:35:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:49 smithi086 ceph-mon[35163]: pgmap v5791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:35:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:49 smithi159 ceph-mon[36109]: pgmap v5791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:35:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:49 smithi055 ceph-mon[31863]: pgmap v5791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:35:50.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10021 sec 2024-03-28T08:35:51.493 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10022 sec 2024-03-28T08:35:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: pgmap v5792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: pgmap v5792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:35:52.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: pgmap v5792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:35:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:35:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:35:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:35:52.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10023 sec 2024-03-28T08:35:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:52 smithi086 ceph-mon[35163]: pgmap v5793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:35:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:52 smithi086 ceph-mon[35163]: pgmap v5794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:52 smithi159 ceph-mon[36109]: pgmap v5793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:35:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:52 smithi159 ceph-mon[36109]: pgmap v5794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:52 smithi055 ceph-mon[31863]: pgmap v5793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:35:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:52 smithi055 ceph-mon[31863]: pgmap v5794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:53.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10024 sec 2024-03-28T08:35:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9352.957378 secs 2024-03-28T08:35:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9352.957378 secs 2024-03-28T08:35:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9352.957378 secs 2024-03-28T08:35:54.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10025 sec 2024-03-28T08:35:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:54 smithi086 ceph-mon[35163]: pgmap v5795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:54 smithi159 ceph-mon[36109]: pgmap v5795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:54 smithi055 ceph-mon[31863]: pgmap v5795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:35:55.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10026 sec 2024-03-28T08:35:56.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10027 sec 2024-03-28T08:35:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:56 smithi086 ceph-mon[35163]: pgmap v5796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:35:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:56 smithi159 ceph-mon[36109]: pgmap v5796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:35:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:56 smithi055 ceph-mon[31863]: pgmap v5796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:35:57.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10028 sec 2024-03-28T08:35:58.494 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10029 sec 2024-03-28T08:35:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:58 smithi086 ceph-mon[35163]: pgmap v5797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:35:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:35:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9357.957501 secs 2024-03-28T08:35:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:58 smithi159 ceph-mon[36109]: pgmap v5797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:35:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:35:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9357.957501 secs 2024-03-28T08:35:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:58 smithi055 ceph-mon[31863]: pgmap v5797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:35:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:35:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9357.957501 secs 2024-03-28T08:35:59.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10030 sec 2024-03-28T08:36:00.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10031 sec 2024-03-28T08:36:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:00 smithi086 ceph-mon[35163]: pgmap v5798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:36:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:00 smithi159 ceph-mon[36109]: pgmap v5798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:36:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:00 smithi055 ceph-mon[31863]: pgmap v5798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:36:01.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10032 sec 2024-03-28T08:36:02.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10033 sec 2024-03-28T08:36:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:02 smithi086 ceph-mon[35163]: pgmap v5799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:36:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:02 smithi159 ceph-mon[36109]: pgmap v5799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:36:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:02 smithi055 ceph-mon[31863]: pgmap v5799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:36:03.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10034 sec 2024-03-28T08:36:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9362.957633 secs 2024-03-28T08:36:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9362.957633 secs 2024-03-28T08:36:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9362.957633 secs 2024-03-28T08:36:04.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10035 sec 2024-03-28T08:36:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:04 smithi055 ceph-mon[31863]: pgmap v5800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:04 smithi086 ceph-mon[35163]: pgmap v5800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:04 smithi159 ceph-mon[36109]: pgmap v5800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:05.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10036 sec 2024-03-28T08:36:06.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10037 sec 2024-03-28T08:36:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:06 smithi055 ceph-mon[31863]: pgmap v5801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:06 smithi086 ceph-mon[35163]: pgmap v5801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:06 smithi159 ceph-mon[36109]: pgmap v5801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:07.495 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10038 sec 2024-03-28T08:36:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9367.957770 secs 2024-03-28T08:36:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9367.957770 secs 2024-03-28T08:36:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9367.957770 secs 2024-03-28T08:36:08.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10039 sec 2024-03-28T08:36:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:08 smithi055 ceph-mon[31863]: pgmap v5802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:08 smithi086 ceph-mon[35163]: pgmap v5802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:08 smithi159 ceph-mon[36109]: pgmap v5802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:09.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10040 sec 2024-03-28T08:36:10.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10041 sec 2024-03-28T08:36:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:10 smithi055 ceph-mon[31863]: pgmap v5803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:10 smithi086 ceph-mon[35163]: pgmap v5803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:10 smithi159 ceph-mon[36109]: pgmap v5803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:11.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10042 sec 2024-03-28T08:36:12.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10043 sec 2024-03-28T08:36:13.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:12 smithi086 ceph-mon[35163]: pgmap v5804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:13.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9372.957869 secs 2024-03-28T08:36:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:12 smithi055 ceph-mon[31863]: pgmap v5804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9372.957869 secs 2024-03-28T08:36:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:12 smithi159 ceph-mon[36109]: pgmap v5804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9372.957869 secs 2024-03-28T08:36:13.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10044 sec 2024-03-28T08:36:14.496 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10045 sec 2024-03-28T08:36:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:14 smithi086 ceph-mon[35163]: pgmap v5805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:14 smithi159 ceph-mon[36109]: pgmap v5805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:14 smithi055 ceph-mon[31863]: pgmap v5805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:15.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10046 sec 2024-03-28T08:36:16.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10047 sec 2024-03-28T08:36:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:16 smithi086 ceph-mon[35163]: pgmap v5806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:16 smithi159 ceph-mon[36109]: pgmap v5806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:16 smithi055 ceph-mon[31863]: pgmap v5806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:17.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10048 sec 2024-03-28T08:36:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9377.957911 secs 2024-03-28T08:36:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9377.957911 secs 2024-03-28T08:36:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9377.957911 secs 2024-03-28T08:36:18.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10049 sec 2024-03-28T08:36:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:18 smithi086 ceph-mon[35163]: pgmap v5807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:18 smithi159 ceph-mon[36109]: pgmap v5807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:18 smithi055 ceph-mon[31863]: pgmap v5807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:19.497 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10050 sec 2024-03-28T08:36:20.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10051 sec 2024-03-28T08:36:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:20 smithi086 ceph-mon[35163]: pgmap v5808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:20 smithi159 ceph-mon[36109]: pgmap v5808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:20 smithi055 ceph-mon[31863]: pgmap v5808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:21.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10052 sec 2024-03-28T08:36:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:21 smithi086 ceph-mon[35163]: pgmap v5809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:21 smithi159 ceph-mon[36109]: pgmap v5809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:21 smithi055 ceph-mon[31863]: pgmap v5809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:22.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10053 sec 2024-03-28T08:36:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9382.957977 secs 2024-03-28T08:36:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9382.957977 secs 2024-03-28T08:36:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9382.957977 secs 2024-03-28T08:36:23.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10054 sec 2024-03-28T08:36:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:23 smithi086 ceph-mon[35163]: pgmap v5810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:23 smithi159 ceph-mon[36109]: pgmap v5810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:23 smithi055 ceph-mon[31863]: pgmap v5810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:24.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10055 sec 2024-03-28T08:36:25.498 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10056 sec 2024-03-28T08:36:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:26 smithi086 ceph-mon[35163]: pgmap v5811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:26 smithi159 ceph-mon[36109]: pgmap v5811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:26 smithi055 ceph-mon[31863]: pgmap v5811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:26.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10057 sec 2024-03-28T08:36:27.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10058 sec 2024-03-28T08:36:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:28 smithi055 ceph-mon[31863]: pgmap v5812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9387.958046 secs 2024-03-28T08:36:28.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10059 sec 2024-03-28T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:28 smithi086 ceph-mon[35163]: pgmap v5812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9387.958046 secs 2024-03-28T08:36:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:28 smithi159 ceph-mon[36109]: pgmap v5812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9387.958046 secs 2024-03-28T08:36:29.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10060 sec 2024-03-28T08:36:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:30 smithi055 ceph-mon[31863]: pgmap v5813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:30.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10061 sec 2024-03-28T08:36:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:30 smithi086 ceph-mon[35163]: pgmap v5813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:30 smithi159 ceph-mon[36109]: pgmap v5813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:31.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10062 sec 2024-03-28T08:36:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:32 smithi055 ceph-mon[31863]: pgmap v5814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:32.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10063 sec 2024-03-28T08:36:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:32 smithi086 ceph-mon[35163]: pgmap v5814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:32 smithi159 ceph-mon[36109]: pgmap v5814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9392.958193 secs 2024-03-28T08:36:33.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10064 sec 2024-03-28T08:36:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9392.958193 secs 2024-03-28T08:36:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9392.958193 secs 2024-03-28T08:36:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:34 smithi055 ceph-mon[31863]: pgmap v5815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:34.499 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10065 sec 2024-03-28T08:36:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:34 smithi086 ceph-mon[35163]: pgmap v5815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:34 smithi159 ceph-mon[36109]: pgmap v5815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:35.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10066 sec 2024-03-28T08:36:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:36 smithi055 ceph-mon[31863]: pgmap v5816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:36.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10067 sec 2024-03-28T08:36:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:36 smithi086 ceph-mon[35163]: pgmap v5816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:36 smithi159 ceph-mon[36109]: pgmap v5816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:37.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10068 sec 2024-03-28T08:36:38.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10069 sec 2024-03-28T08:36:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:38 smithi086 ceph-mon[35163]: pgmap v5817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9397.958282 secs 2024-03-28T08:36:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:38 smithi159 ceph-mon[36109]: pgmap v5817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9397.958282 secs 2024-03-28T08:36:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:38 smithi055 ceph-mon[31863]: pgmap v5817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9397.958282 secs 2024-03-28T08:36:39.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10070 sec 2024-03-28T08:36:40.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10071 sec 2024-03-28T08:36:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:40 smithi086 ceph-mon[35163]: pgmap v5818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:40 smithi159 ceph-mon[36109]: pgmap v5818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:40 smithi055 ceph-mon[31863]: pgmap v5818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:41.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10072 sec 2024-03-28T08:36:42.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10073 sec 2024-03-28T08:36:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:42 smithi086 ceph-mon[35163]: pgmap v5819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:42 smithi159 ceph-mon[36109]: pgmap v5819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:42 smithi055 ceph-mon[31863]: pgmap v5819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:43.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9402.958386 secs 2024-03-28T08:36:43.500 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10074 sec 2024-03-28T08:36:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9402.958386 secs 2024-03-28T08:36:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9402.958386 secs 2024-03-28T08:36:44.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10075 sec 2024-03-28T08:36:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:44 smithi086 ceph-mon[35163]: pgmap v5820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:44 smithi159 ceph-mon[36109]: pgmap v5820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:44 smithi055 ceph-mon[31863]: pgmap v5820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:45.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10076 sec 2024-03-28T08:36:46.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10077 sec 2024-03-28T08:36:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:46 smithi086 ceph-mon[35163]: pgmap v5821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:46 smithi159 ceph-mon[36109]: pgmap v5821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:46 smithi055 ceph-mon[31863]: pgmap v5821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:36:47.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10078 sec 2024-03-28T08:36:48.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10079 sec 2024-03-28T08:36:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:48 smithi086 ceph-mon[35163]: pgmap v5822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9407.958457 secs 2024-03-28T08:36:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:48 smithi159 ceph-mon[36109]: pgmap v5822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9407.958457 secs 2024-03-28T08:36:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:48 smithi055 ceph-mon[31863]: pgmap v5822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9407.958457 secs 2024-03-28T08:36:49.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10080 sec 2024-03-28T08:36:50.501 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10081 sec 2024-03-28T08:36:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:50 smithi086 ceph-mon[35163]: pgmap v5823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:50 smithi159 ceph-mon[36109]: pgmap v5823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:50 smithi055 ceph-mon[31863]: pgmap v5823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:51.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10082 sec 2024-03-28T08:36:52.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10083 sec 2024-03-28T08:36:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:52 smithi086 ceph-mon[35163]: pgmap v5824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:36:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:52 smithi159 ceph-mon[36109]: pgmap v5824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:36:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:52 smithi055 ceph-mon[31863]: pgmap v5824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:36:53.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9412.958580 secs 2024-03-28T08:36:53.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10084 sec 2024-03-28T08:36:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9412.958580 secs 2024-03-28T08:36:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9412.958580 secs 2024-03-28T08:36:54.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10085 sec 2024-03-28T08:36:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: pgmap v5825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:36:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:36:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: pgmap v5826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:36:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: pgmap v5827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: pgmap v5825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: pgmap v5826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: pgmap v5827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:54.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: pgmap v5825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: pgmap v5826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: pgmap v5827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:36:55.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10086 sec 2024-03-28T08:36:56.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10087 sec 2024-03-28T08:36:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:56 smithi055 ceph-mon[31863]: pgmap v5828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:56 smithi086 ceph-mon[35163]: pgmap v5828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:56 smithi159 ceph-mon[36109]: pgmap v5828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:36:57.502 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10088 sec 2024-03-28T08:36:58.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10089 sec 2024-03-28T08:36:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:58 smithi055 ceph-mon[31863]: pgmap v5829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:36:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:36:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9417.958643 secs 2024-03-28T08:36:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:58 smithi086 ceph-mon[35163]: pgmap v5829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:36:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:36:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9417.958643 secs 2024-03-28T08:36:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:58 smithi159 ceph-mon[36109]: pgmap v5829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:36:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:36:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9417.958643 secs 2024-03-28T08:36:59.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10090 sec 2024-03-28T08:37:00.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10091 sec 2024-03-28T08:37:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:00 smithi055 ceph-mon[31863]: pgmap v5830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:00 smithi086 ceph-mon[35163]: pgmap v5830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:00 smithi159 ceph-mon[36109]: pgmap v5830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:01.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10092 sec 2024-03-28T08:37:02.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10093 sec 2024-03-28T08:37:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:02 smithi055 ceph-mon[31863]: pgmap v5831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:02 smithi086 ceph-mon[35163]: pgmap v5831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:02 smithi159 ceph-mon[36109]: pgmap v5831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:37:03.503 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10094 sec 2024-03-28T08:37:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9422.958708 secs 2024-03-28T08:37:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9422.958708 secs 2024-03-28T08:37:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9422.958708 secs 2024-03-28T08:37:04.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10095 sec 2024-03-28T08:37:04.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:04 smithi055 ceph-mon[31863]: pgmap v5832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:37:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:04 smithi086 ceph-mon[35163]: pgmap v5832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:37:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:04 smithi159 ceph-mon[36109]: pgmap v5832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:37:05.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10096 sec 2024-03-28T08:37:06.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10097 sec 2024-03-28T08:37:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:06 smithi086 ceph-mon[35163]: pgmap v5833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:06 smithi159 ceph-mon[36109]: pgmap v5833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:06 smithi055 ceph-mon[31863]: pgmap v5833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:07.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10098 sec 2024-03-28T08:37:08.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10099 sec 2024-03-28T08:37:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:08 smithi086 ceph-mon[35163]: pgmap v5834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9427.958773 secs 2024-03-28T08:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:08 smithi159 ceph-mon[36109]: pgmap v5834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9427.958773 secs 2024-03-28T08:37:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:08 smithi055 ceph-mon[31863]: pgmap v5834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9427.958773 secs 2024-03-28T08:37:09.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10100 sec 2024-03-28T08:37:10.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10101 sec 2024-03-28T08:37:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:10 smithi086 ceph-mon[35163]: pgmap v5835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:10 smithi159 ceph-mon[36109]: pgmap v5835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:10 smithi055 ceph-mon[31863]: pgmap v5835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:11.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10102 sec 2024-03-28T08:37:12.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10103 sec 2024-03-28T08:37:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:12 smithi086 ceph-mon[35163]: pgmap v5836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:12 smithi159 ceph-mon[36109]: pgmap v5836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:12 smithi055 ceph-mon[31863]: pgmap v5836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:13.504 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10104 sec 2024-03-28T08:37:13.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9432.958848 secs 2024-03-28T08:37:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9432.958848 secs 2024-03-28T08:37:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9432.958848 secs 2024-03-28T08:37:14.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10105 sec 2024-03-28T08:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:14 smithi086 ceph-mon[35163]: pgmap v5837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:14 smithi159 ceph-mon[36109]: pgmap v5837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:14 smithi055 ceph-mon[31863]: pgmap v5837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:15.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10106 sec 2024-03-28T08:37:16.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10107 sec 2024-03-28T08:37:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:16 smithi086 ceph-mon[35163]: pgmap v5838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:16 smithi159 ceph-mon[36109]: pgmap v5838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:16 smithi055 ceph-mon[31863]: pgmap v5838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:17.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10108 sec 2024-03-28T08:37:18.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10109 sec 2024-03-28T08:37:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:18 smithi086 ceph-mon[35163]: pgmap v5839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9437.958939 secs 2024-03-28T08:37:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:18 smithi159 ceph-mon[36109]: pgmap v5839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9437.958939 secs 2024-03-28T08:37:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:18 smithi055 ceph-mon[31863]: pgmap v5839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9437.958939 secs 2024-03-28T08:37:19.505 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10110 sec 2024-03-28T08:37:20.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10111 sec 2024-03-28T08:37:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:20 smithi086 ceph-mon[35163]: pgmap v5840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:20 smithi159 ceph-mon[36109]: pgmap v5840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:20 smithi055 ceph-mon[31863]: pgmap v5840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:21.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10112 sec 2024-03-28T08:37:22.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10113 sec 2024-03-28T08:37:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:22 smithi086 ceph-mon[35163]: pgmap v5841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:22 smithi159 ceph-mon[36109]: pgmap v5841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:22 smithi055 ceph-mon[31863]: pgmap v5841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:23.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10114 sec 2024-03-28T08:37:23.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9442.959030 secs 2024-03-28T08:37:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9442.959030 secs 2024-03-28T08:37:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9442.959030 secs 2024-03-28T08:37:24.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10115 sec 2024-03-28T08:37:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:24 smithi086 ceph-mon[35163]: pgmap v5842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:24 smithi159 ceph-mon[36109]: pgmap v5842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:24 smithi055 ceph-mon[31863]: pgmap v5842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:25.506 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10116 sec 2024-03-28T08:37:26.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10117 sec 2024-03-28T08:37:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:26 smithi086 ceph-mon[35163]: pgmap v5843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:26 smithi159 ceph-mon[36109]: pgmap v5843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:26 smithi055 ceph-mon[31863]: pgmap v5843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:27.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10118 sec 2024-03-28T08:37:28.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10119 sec 2024-03-28T08:37:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:28 smithi086 ceph-mon[35163]: pgmap v5844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9447.959110 secs 2024-03-28T08:37:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:28 smithi159 ceph-mon[36109]: pgmap v5844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9447.959110 secs 2024-03-28T08:37:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:28 smithi055 ceph-mon[31863]: pgmap v5844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9447.959110 secs 2024-03-28T08:37:29.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10120 sec 2024-03-28T08:37:30.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10121 sec 2024-03-28T08:37:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:30 smithi086 ceph-mon[35163]: pgmap v5845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:30 smithi159 ceph-mon[36109]: pgmap v5845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:30 smithi055 ceph-mon[31863]: pgmap v5845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:31.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10122 sec 2024-03-28T08:37:32.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10123 sec 2024-03-28T08:37:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:32 smithi086 ceph-mon[35163]: pgmap v5846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:32 smithi159 ceph-mon[36109]: pgmap v5846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:32 smithi055 ceph-mon[31863]: pgmap v5846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:33.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10124 sec 2024-03-28T08:37:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9452.959236 secs 2024-03-28T08:37:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9452.959236 secs 2024-03-28T08:37:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9452.959236 secs 2024-03-28T08:37:34.507 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10125 sec 2024-03-28T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:34 smithi086 ceph-mon[35163]: pgmap v5847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:34 smithi159 ceph-mon[36109]: pgmap v5847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:34 smithi055 ceph-mon[31863]: pgmap v5847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:35.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10126 sec 2024-03-28T08:37:36.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10127 sec 2024-03-28T08:37:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:36 smithi086 ceph-mon[35163]: pgmap v5848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:36 smithi159 ceph-mon[36109]: pgmap v5848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:36 smithi055 ceph-mon[31863]: pgmap v5848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:37.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10128 sec 2024-03-28T08:37:38.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10129 sec 2024-03-28T08:37:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:38 smithi086 ceph-mon[35163]: pgmap v5849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9457.959359 secs 2024-03-28T08:37:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:38 smithi159 ceph-mon[36109]: pgmap v5849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9457.959359 secs 2024-03-28T08:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:38 smithi055 ceph-mon[31863]: pgmap v5849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9457.959359 secs 2024-03-28T08:37:39.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10130 sec 2024-03-28T08:37:40.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10131 sec 2024-03-28T08:37:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:40 smithi086 ceph-mon[35163]: pgmap v5850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:40 smithi159 ceph-mon[36109]: pgmap v5850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:40 smithi055 ceph-mon[31863]: pgmap v5850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:41.508 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10132 sec 2024-03-28T08:37:42.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10133 sec 2024-03-28T08:37:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:42 smithi086 ceph-mon[35163]: pgmap v5851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:42 smithi159 ceph-mon[36109]: pgmap v5851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:42 smithi055 ceph-mon[31863]: pgmap v5851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:43.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10134 sec 2024-03-28T08:37:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9462.959476 secs 2024-03-28T08:37:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9462.959476 secs 2024-03-28T08:37:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9462.959476 secs 2024-03-28T08:37:44.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10135 sec 2024-03-28T08:37:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:44 smithi086 ceph-mon[35163]: pgmap v5852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:44 smithi159 ceph-mon[36109]: pgmap v5852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:44 smithi055 ceph-mon[31863]: pgmap v5852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:45.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10136 sec 2024-03-28T08:37:46.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10137 sec 2024-03-28T08:37:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:46 smithi055 ceph-mon[31863]: pgmap v5853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:46 smithi086 ceph-mon[35163]: pgmap v5853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:46 smithi159 ceph-mon[36109]: pgmap v5853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:37:47.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10138 sec 2024-03-28T08:37:48.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10139 sec 2024-03-28T08:37:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:48 smithi055 ceph-mon[31863]: pgmap v5854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9467.959591 secs 2024-03-28T08:37:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:48 smithi086 ceph-mon[35163]: pgmap v5854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9467.959591 secs 2024-03-28T08:37:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:48 smithi159 ceph-mon[36109]: pgmap v5854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9467.959591 secs 2024-03-28T08:37:49.509 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10140 sec 2024-03-28T08:37:50.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10141 sec 2024-03-28T08:37:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:50 smithi055 ceph-mon[31863]: pgmap v5855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:50 smithi086 ceph-mon[35163]: pgmap v5855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:50 smithi159 ceph-mon[36109]: pgmap v5855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:51.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10142 sec 2024-03-28T08:37:52.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10143 sec 2024-03-28T08:37:53.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:52 smithi159 ceph-mon[36109]: pgmap v5856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:53.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9472.959681 secs 2024-03-28T08:37:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:52 smithi055 ceph-mon[31863]: pgmap v5856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:53.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9472.959681 secs 2024-03-28T08:37:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:52 smithi086 ceph-mon[35163]: pgmap v5856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9472.959681 secs 2024-03-28T08:37:53.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10144 sec 2024-03-28T08:37:54.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10145 sec 2024-03-28T08:37:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:54 smithi055 ceph-mon[31863]: pgmap v5857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:37:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:54 smithi086 ceph-mon[35163]: pgmap v5857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:37:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:54 smithi159 ceph-mon[36109]: pgmap v5857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:37:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:37:55.510 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10146 sec 2024-03-28T08:37:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:37:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:37:56.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:37:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:37:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:37:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:37:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:37:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:37:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:37:56.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10147 sec 2024-03-28T08:37:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:56 smithi055 ceph-mon[31863]: pgmap v5858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:56 smithi055 ceph-mon[31863]: pgmap v5859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:37:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:56 smithi086 ceph-mon[35163]: pgmap v5858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:56 smithi086 ceph-mon[35163]: pgmap v5859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:37:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:56 smithi159 ceph-mon[36109]: pgmap v5858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:37:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:56 smithi159 ceph-mon[36109]: pgmap v5859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:37:57.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10148 sec 2024-03-28T08:37:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9477.959747 secs 2024-03-28T08:37:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9477.959747 secs 2024-03-28T08:37:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9477.959747 secs 2024-03-28T08:37:58.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10149 sec 2024-03-28T08:37:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:37:58 smithi086 ceph-mon[35163]: pgmap v5860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:37:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:37:58 smithi159 ceph-mon[36109]: pgmap v5860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:37:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:37:58 smithi055 ceph-mon[31863]: pgmap v5860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:37:59.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10150 sec 2024-03-28T08:38:00.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10151 sec 2024-03-28T08:38:01.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:00 smithi055 ceph-mon[31863]: pgmap v5861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:00 smithi086 ceph-mon[35163]: pgmap v5861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:00 smithi159 ceph-mon[36109]: pgmap v5861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:01.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10152 sec 2024-03-28T08:38:02.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10153 sec 2024-03-28T08:38:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:02 smithi086 ceph-mon[35163]: pgmap v5862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9482.959870 secs 2024-03-28T08:38:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:02 smithi159 ceph-mon[36109]: pgmap v5862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9482.959870 secs 2024-03-28T08:38:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:02 smithi055 ceph-mon[31863]: pgmap v5862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9482.959870 secs 2024-03-28T08:38:03.511 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10154 sec 2024-03-28T08:38:04.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10155 sec 2024-03-28T08:38:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:04 smithi086 ceph-mon[35163]: pgmap v5863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:04 smithi159 ceph-mon[36109]: pgmap v5863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:04 smithi055 ceph-mon[31863]: pgmap v5863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:05.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10156 sec 2024-03-28T08:38:06.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10157 sec 2024-03-28T08:38:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:06 smithi086 ceph-mon[35163]: pgmap v5864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:38:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:06 smithi159 ceph-mon[36109]: pgmap v5864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:38:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:06 smithi055 ceph-mon[31863]: pgmap v5864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:38:07.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10158 sec 2024-03-28T08:38:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9487.959945 secs 2024-03-28T08:38:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9487.959945 secs 2024-03-28T08:38:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9487.959945 secs 2024-03-28T08:38:08.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10159 sec 2024-03-28T08:38:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:08 smithi086 ceph-mon[35163]: pgmap v5865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:08 smithi159 ceph-mon[36109]: pgmap v5865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:08 smithi055 ceph-mon[31863]: pgmap v5865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:09.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10160 sec 2024-03-28T08:38:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:09 smithi086 ceph-mon[35163]: pgmap v5866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:09 smithi159 ceph-mon[36109]: pgmap v5866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:09 smithi055 ceph-mon[31863]: pgmap v5866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:10.512 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10161 sec 2024-03-28T08:38:11.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10162 sec 2024-03-28T08:38:12.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10163 sec 2024-03-28T08:38:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:12 smithi086 ceph-mon[35163]: pgmap v5867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:12 smithi159 ceph-mon[36109]: pgmap v5867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:12 smithi055 ceph-mon[31863]: pgmap v5867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:13.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10164 sec 2024-03-28T08:38:13.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9492.960062 secs 2024-03-28T08:38:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9492.960062 secs 2024-03-28T08:38:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9492.960062 secs 2024-03-28T08:38:14.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10165 sec 2024-03-28T08:38:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:14 smithi086 ceph-mon[35163]: pgmap v5868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:14 smithi159 ceph-mon[36109]: pgmap v5868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:14 smithi055 ceph-mon[31863]: pgmap v5868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:15.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10166 sec 2024-03-28T08:38:16.513 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10167 sec 2024-03-28T08:38:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:16 smithi086 ceph-mon[35163]: pgmap v5869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:16 smithi159 ceph-mon[36109]: pgmap v5869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:16 smithi055 ceph-mon[31863]: pgmap v5869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:17.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10168 sec 2024-03-28T08:38:18.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10169 sec 2024-03-28T08:38:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:18 smithi086 ceph-mon[35163]: pgmap v5870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9497.960185 secs 2024-03-28T08:38:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:18 smithi159 ceph-mon[36109]: pgmap v5870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9497.960185 secs 2024-03-28T08:38:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:18 smithi055 ceph-mon[31863]: pgmap v5870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9497.960185 secs 2024-03-28T08:38:19.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10170 sec 2024-03-28T08:38:20.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10171 sec 2024-03-28T08:38:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:20 smithi086 ceph-mon[35163]: pgmap v5871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:20 smithi159 ceph-mon[36109]: pgmap v5871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:20 smithi055 ceph-mon[31863]: pgmap v5871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:21.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10172 sec 2024-03-28T08:38:22.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10173 sec 2024-03-28T08:38:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:22 smithi086 ceph-mon[35163]: pgmap v5872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:22 smithi159 ceph-mon[36109]: pgmap v5872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:22 smithi055 ceph-mon[31863]: pgmap v5872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:23.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10174 sec 2024-03-28T08:38:23.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9502.960309 secs 2024-03-28T08:38:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9502.960309 secs 2024-03-28T08:38:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9502.960309 secs 2024-03-28T08:38:24.514 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10175 sec 2024-03-28T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:24 smithi086 ceph-mon[35163]: pgmap v5873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:24 smithi159 ceph-mon[36109]: pgmap v5873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:24 smithi055 ceph-mon[31863]: pgmap v5873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:25.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10176 sec 2024-03-28T08:38:26.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10177 sec 2024-03-28T08:38:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:26 smithi086 ceph-mon[35163]: pgmap v5874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:26 smithi159 ceph-mon[36109]: pgmap v5874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:26 smithi055 ceph-mon[31863]: pgmap v5874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:27.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10178 sec 2024-03-28T08:38:28.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10179 sec 2024-03-28T08:38:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:28 smithi086 ceph-mon[35163]: pgmap v5875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9507.960431 secs 2024-03-28T08:38:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:28 smithi159 ceph-mon[36109]: pgmap v5875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9507.960431 secs 2024-03-28T08:38:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:28 smithi055 ceph-mon[31863]: pgmap v5875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9507.960431 secs 2024-03-28T08:38:29.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10180 sec 2024-03-28T08:38:30.515 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10181 sec 2024-03-28T08:38:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:30 smithi086 ceph-mon[35163]: pgmap v5876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:30 smithi159 ceph-mon[36109]: pgmap v5876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:30 smithi055 ceph-mon[31863]: pgmap v5876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:31.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10182 sec 2024-03-28T08:38:32.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10183 sec 2024-03-28T08:38:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:32 smithi086 ceph-mon[35163]: pgmap v5877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:32 smithi159 ceph-mon[36109]: pgmap v5877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:32 smithi055 ceph-mon[31863]: pgmap v5877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:33.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10184 sec 2024-03-28T08:38:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9512.960496 secs 2024-03-28T08:38:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9512.960496 secs 2024-03-28T08:38:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9512.960496 secs 2024-03-28T08:38:34.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10185 sec 2024-03-28T08:38:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:34 smithi086 ceph-mon[35163]: pgmap v5878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:34 smithi159 ceph-mon[36109]: pgmap v5878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:34 smithi055 ceph-mon[31863]: pgmap v5878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:35.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10186 sec 2024-03-28T08:38:36.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10187 sec 2024-03-28T08:38:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:36 smithi086 ceph-mon[35163]: pgmap v5879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:38:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:36 smithi159 ceph-mon[36109]: pgmap v5879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:38:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:36 smithi055 ceph-mon[31863]: pgmap v5879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:38:37.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10188 sec 2024-03-28T08:38:38.516 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10189 sec 2024-03-28T08:38:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:38 smithi086 ceph-mon[35163]: pgmap v5880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9517.960584 secs 2024-03-28T08:38:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:38 smithi159 ceph-mon[36109]: pgmap v5880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9517.960584 secs 2024-03-28T08:38:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:38 smithi055 ceph-mon[31863]: pgmap v5880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9517.960584 secs 2024-03-28T08:38:39.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10190 sec 2024-03-28T08:38:40.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10191 sec 2024-03-28T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:40 smithi086 ceph-mon[35163]: pgmap v5881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:40 smithi159 ceph-mon[36109]: pgmap v5881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:40 smithi055 ceph-mon[31863]: pgmap v5881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:41.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10192 sec 2024-03-28T08:38:42.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10193 sec 2024-03-28T08:38:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:42 smithi086 ceph-mon[35163]: pgmap v5882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:42 smithi159 ceph-mon[36109]: pgmap v5882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:42 smithi055 ceph-mon[31863]: pgmap v5882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:43.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10194 sec 2024-03-28T08:38:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9522.960692 secs 2024-03-28T08:38:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9522.960692 secs 2024-03-28T08:38:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9522.960692 secs 2024-03-28T08:38:44.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10195 sec 2024-03-28T08:38:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:44 smithi055 ceph-mon[31863]: pgmap v5883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:44 smithi086 ceph-mon[35163]: pgmap v5883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:44 smithi159 ceph-mon[36109]: pgmap v5883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:45.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10196 sec 2024-03-28T08:38:46.517 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10197 sec 2024-03-28T08:38:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:46 smithi055 ceph-mon[31863]: pgmap v5884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:46 smithi086 ceph-mon[35163]: pgmap v5884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:46 smithi159 ceph-mon[36109]: pgmap v5884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:38:47.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10198 sec 2024-03-28T08:38:48.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10199 sec 2024-03-28T08:38:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:48 smithi055 ceph-mon[31863]: pgmap v5885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9527.960852 secs 2024-03-28T08:38:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:48 smithi086 ceph-mon[35163]: pgmap v5885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9527.960852 secs 2024-03-28T08:38:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:48 smithi159 ceph-mon[36109]: pgmap v5885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9527.960852 secs 2024-03-28T08:38:49.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10200 sec 2024-03-28T08:38:50.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10201 sec 2024-03-28T08:38:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:50 smithi055 ceph-mon[31863]: pgmap v5886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:50 smithi086 ceph-mon[35163]: pgmap v5886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:50 smithi159 ceph-mon[36109]: pgmap v5886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:51.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10202 sec 2024-03-28T08:38:52.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10203 sec 2024-03-28T08:38:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:52 smithi055 ceph-mon[31863]: pgmap v5887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:52 smithi086 ceph-mon[35163]: pgmap v5887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:52 smithi159 ceph-mon[36109]: pgmap v5887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:53.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10204 sec 2024-03-28T08:38:53.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9532.960974 secs 2024-03-28T08:38:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9532.960974 secs 2024-03-28T08:38:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9532.960974 secs 2024-03-28T08:38:54.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10205 sec 2024-03-28T08:38:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:54 smithi086 ceph-mon[35163]: pgmap v5888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:54 smithi159 ceph-mon[36109]: pgmap v5888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:54 smithi055 ceph-mon[31863]: pgmap v5888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:55.518 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10206 sec 2024-03-28T08:38:56.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10207 sec 2024-03-28T08:38:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:56 smithi086 ceph-mon[35163]: pgmap v5889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:38:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:38:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:56 smithi159 ceph-mon[36109]: pgmap v5889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:38:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:38:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:56 smithi055 ceph-mon[31863]: pgmap v5889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:38:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:38:57.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10208 sec 2024-03-28T08:38:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:38:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:38:58.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:38:58.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:38:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:38:58.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:38:58.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10209 sec 2024-03-28T08:38:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: pgmap v5890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: pgmap v5891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:38:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9537.961105 secs 2024-03-28T08:38:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:38:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:38:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:38:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:38:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: pgmap v5890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: pgmap v5891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:59.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:38:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9537.961105 secs 2024-03-28T08:38:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:38:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:38:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:38:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:38:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: pgmap v5890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:38:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: pgmap v5891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:38:59.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:38:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9537.961105 secs 2024-03-28T08:38:59.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10210 sec 2024-03-28T08:39:00.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10211 sec 2024-03-28T08:39:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:00 smithi086 ceph-mon[35163]: pgmap v5892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:00 smithi159 ceph-mon[36109]: pgmap v5892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:00 smithi055 ceph-mon[31863]: pgmap v5892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:01.519 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10212 sec 2024-03-28T08:39:02.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10213 sec 2024-03-28T08:39:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:02 smithi086 ceph-mon[35163]: pgmap v5893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:02 smithi159 ceph-mon[36109]: pgmap v5893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:02 smithi055 ceph-mon[31863]: pgmap v5893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:03.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10214 sec 2024-03-28T08:39:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9542.961170 secs 2024-03-28T08:39:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9542.961170 secs 2024-03-28T08:39:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9542.961170 secs 2024-03-28T08:39:04.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10215 sec 2024-03-28T08:39:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:04 smithi086 ceph-mon[35163]: pgmap v5894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:04 smithi159 ceph-mon[36109]: pgmap v5894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:04 smithi055 ceph-mon[31863]: pgmap v5894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:05.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10216 sec 2024-03-28T08:39:06.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10217 sec 2024-03-28T08:39:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:06 smithi086 ceph-mon[35163]: pgmap v5895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:06 smithi159 ceph-mon[36109]: pgmap v5895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:06 smithi055 ceph-mon[31863]: pgmap v5895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:39:07.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10218 sec 2024-03-28T08:39:08.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10219 sec 2024-03-28T08:39:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:08 smithi086 ceph-mon[35163]: pgmap v5896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:39:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9547.961234 secs 2024-03-28T08:39:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:08 smithi159 ceph-mon[36109]: pgmap v5896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:39:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9547.961234 secs 2024-03-28T08:39:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:08 smithi055 ceph-mon[31863]: pgmap v5896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:39:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9547.961234 secs 2024-03-28T08:39:09.520 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10220 sec 2024-03-28T08:39:10.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10221 sec 2024-03-28T08:39:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:10 smithi086 ceph-mon[35163]: pgmap v5897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:10 smithi159 ceph-mon[36109]: pgmap v5897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:10 smithi055 ceph-mon[31863]: pgmap v5897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:11.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10222 sec 2024-03-28T08:39:12.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10223 sec 2024-03-28T08:39:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:12 smithi086 ceph-mon[35163]: pgmap v5898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:12 smithi159 ceph-mon[36109]: pgmap v5898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:12 smithi055 ceph-mon[31863]: pgmap v5898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:13.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10224 sec 2024-03-28T08:39:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9552.961317 secs 2024-03-28T08:39:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9552.961317 secs 2024-03-28T08:39:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9552.961317 secs 2024-03-28T08:39:14.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10225 sec 2024-03-28T08:39:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:14 smithi086 ceph-mon[35163]: pgmap v5899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:14 smithi159 ceph-mon[36109]: pgmap v5899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:14 smithi055 ceph-mon[31863]: pgmap v5899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:15.521 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10226 sec 2024-03-28T08:39:16.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10227 sec 2024-03-28T08:39:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:16 smithi086 ceph-mon[35163]: pgmap v5900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:16 smithi159 ceph-mon[36109]: pgmap v5900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:16 smithi055 ceph-mon[31863]: pgmap v5900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:17.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10228 sec 2024-03-28T08:39:18.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10229 sec 2024-03-28T08:39:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:18 smithi086 ceph-mon[35163]: pgmap v5901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9557.961437 secs 2024-03-28T08:39:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:18 smithi159 ceph-mon[36109]: pgmap v5901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9557.961437 secs 2024-03-28T08:39:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:18 smithi055 ceph-mon[31863]: pgmap v5901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9557.961437 secs 2024-03-28T08:39:19.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10230 sec 2024-03-28T08:39:20.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10231 sec 2024-03-28T08:39:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:20 smithi086 ceph-mon[35163]: pgmap v5902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:20 smithi159 ceph-mon[36109]: pgmap v5902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:20 smithi055 ceph-mon[31863]: pgmap v5902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:21.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10232 sec 2024-03-28T08:39:22.522 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10233 sec 2024-03-28T08:39:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:22 smithi086 ceph-mon[35163]: pgmap v5903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:22 smithi159 ceph-mon[36109]: pgmap v5903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:22 smithi055 ceph-mon[31863]: pgmap v5903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:23.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10234 sec 2024-03-28T08:39:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9562.961555 secs 2024-03-28T08:39:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9562.961555 secs 2024-03-28T08:39:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9562.961555 secs 2024-03-28T08:39:24.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10235 sec 2024-03-28T08:39:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:24 smithi086 ceph-mon[35163]: pgmap v5904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:24 smithi159 ceph-mon[36109]: pgmap v5904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:24 smithi055 ceph-mon[31863]: pgmap v5904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:25.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10236 sec 2024-03-28T08:39:26.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10237 sec 2024-03-28T08:39:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:26 smithi086 ceph-mon[35163]: pgmap v5905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:26 smithi159 ceph-mon[36109]: pgmap v5905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:26 smithi055 ceph-mon[31863]: pgmap v5905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:27.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10238 sec 2024-03-28T08:39:28.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10239 sec 2024-03-28T08:39:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:28 smithi086 ceph-mon[35163]: pgmap v5906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9567.961653 secs 2024-03-28T08:39:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:28 smithi159 ceph-mon[36109]: pgmap v5906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9567.961653 secs 2024-03-28T08:39:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:28 smithi055 ceph-mon[31863]: pgmap v5906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9567.961653 secs 2024-03-28T08:39:29.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10240 sec 2024-03-28T08:39:30.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10241 sec 2024-03-28T08:39:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:30 smithi086 ceph-mon[35163]: pgmap v5907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:30 smithi159 ceph-mon[36109]: pgmap v5907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:30 smithi055 ceph-mon[31863]: pgmap v5907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:31.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10242 sec 2024-03-28T08:39:32.523 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10243 sec 2024-03-28T08:39:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:32 smithi086 ceph-mon[35163]: pgmap v5908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:32 smithi159 ceph-mon[36109]: pgmap v5908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:32 smithi055 ceph-mon[31863]: pgmap v5908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:33.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10244 sec 2024-03-28T08:39:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9572.961745 secs 2024-03-28T08:39:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9572.961745 secs 2024-03-28T08:39:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9572.961745 secs 2024-03-28T08:39:34.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10245 sec 2024-03-28T08:39:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:34 smithi086 ceph-mon[35163]: pgmap v5909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:34 smithi159 ceph-mon[36109]: pgmap v5909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:34 smithi055 ceph-mon[31863]: pgmap v5909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:35.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10246 sec 2024-03-28T08:39:36.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10247 sec 2024-03-28T08:39:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:36 smithi086 ceph-mon[35163]: pgmap v5910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:36 smithi159 ceph-mon[36109]: pgmap v5910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:36 smithi055 ceph-mon[31863]: pgmap v5910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:37.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10248 sec 2024-03-28T08:39:38.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10249 sec 2024-03-28T08:39:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:38 smithi086 ceph-mon[35163]: pgmap v5911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9577.961867 secs 2024-03-28T08:39:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:38 smithi159 ceph-mon[36109]: pgmap v5911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9577.961867 secs 2024-03-28T08:39:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:38 smithi055 ceph-mon[31863]: pgmap v5911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9577.961867 secs 2024-03-28T08:39:39.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10250 sec 2024-03-28T08:39:40.524 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10251 sec 2024-03-28T08:39:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:40 smithi086 ceph-mon[35163]: pgmap v5912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:40 smithi159 ceph-mon[36109]: pgmap v5912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:40 smithi055 ceph-mon[31863]: pgmap v5912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:41.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10252 sec 2024-03-28T08:39:42.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10253 sec 2024-03-28T08:39:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:42 smithi086 ceph-mon[35163]: pgmap v5913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:42 smithi159 ceph-mon[36109]: pgmap v5913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:42 smithi055 ceph-mon[31863]: pgmap v5913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:43.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10254 sec 2024-03-28T08:39:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9582.961987 secs 2024-03-28T08:39:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9582.961987 secs 2024-03-28T08:39:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9582.961987 secs 2024-03-28T08:39:44.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10255 sec 2024-03-28T08:39:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:44 smithi055 ceph-mon[31863]: pgmap v5914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:44 smithi086 ceph-mon[35163]: pgmap v5914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:44 smithi159 ceph-mon[36109]: pgmap v5914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:45.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10256 sec 2024-03-28T08:39:46.525 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10257 sec 2024-03-28T08:39:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:46 smithi055 ceph-mon[31863]: pgmap v5915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:46 smithi086 ceph-mon[35163]: pgmap v5915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:46 smithi159 ceph-mon[36109]: pgmap v5915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:47.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10258 sec 2024-03-28T08:39:48.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10259 sec 2024-03-28T08:39:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:48 smithi055 ceph-mon[31863]: pgmap v5916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9587.962106 secs 2024-03-28T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:48 smithi086 ceph-mon[35163]: pgmap v5916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9587.962106 secs 2024-03-28T08:39:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:48 smithi159 ceph-mon[36109]: pgmap v5916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9587.962106 secs 2024-03-28T08:39:49.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10260 sec 2024-03-28T08:39:50.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10261 sec 2024-03-28T08:39:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:50 smithi055 ceph-mon[31863]: pgmap v5917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:50 smithi086 ceph-mon[35163]: pgmap v5917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:50 smithi159 ceph-mon[36109]: pgmap v5917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:51.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10262 sec 2024-03-28T08:39:52.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10263 sec 2024-03-28T08:39:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:52 smithi055 ceph-mon[31863]: pgmap v5918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:52 smithi086 ceph-mon[35163]: pgmap v5918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:52 smithi159 ceph-mon[36109]: pgmap v5918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:53.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10264 sec 2024-03-28T08:39:53.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9592.962197 secs 2024-03-28T08:39:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9592.962197 secs 2024-03-28T08:39:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9592.962197 secs 2024-03-28T08:39:54.526 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10265 sec 2024-03-28T08:39:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:54 smithi086 ceph-mon[35163]: pgmap v5919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:54 smithi159 ceph-mon[36109]: pgmap v5919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:54 smithi055 ceph-mon[31863]: pgmap v5919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:39:55.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10266 sec 2024-03-28T08:39:56.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10267 sec 2024-03-28T08:39:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:56 smithi086 ceph-mon[35163]: pgmap v5920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:56 smithi159 ceph-mon[36109]: pgmap v5920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:56 smithi055 ceph-mon[31863]: pgmap v5920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:39:57.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10268 sec 2024-03-28T08:39:58.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10269 sec 2024-03-28T08:39:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:58 smithi086 ceph-mon[35163]: pgmap v5921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9597.962313 secs 2024-03-28T08:39:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:39:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:58 smithi159 ceph-mon[36109]: pgmap v5921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9597.962313 secs 2024-03-28T08:39:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:39:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:58 smithi055 ceph-mon[31863]: pgmap v5921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:39:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9597.962313 secs 2024-03-28T08:39:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:39:59.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10270 sec 2024-03-28T08:39:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:39:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:39:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:39:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:39:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:39:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:40:00.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10271 sec 2024-03-28T08:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:00 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:00 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:00 smithi086 ceph-mon[35163]: pgmap v5922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:00 smithi086 ceph-mon[35163]: pgmap v5923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:00 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:00 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:00 smithi159 ceph-mon[36109]: pgmap v5922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:00 smithi159 ceph-mon[36109]: pgmap v5923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:00 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:00 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:00 smithi055 ceph-mon[31863]: pgmap v5922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:00 smithi055 ceph-mon[31863]: pgmap v5923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:40:01.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10272 sec 2024-03-28T08:40:02.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10273 sec 2024-03-28T08:40:02.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:02 smithi055 ceph-mon[31863]: pgmap v5924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:02 smithi086 ceph-mon[35163]: pgmap v5924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:02 smithi159 ceph-mon[36109]: pgmap v5924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:03.527 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10274 sec 2024-03-28T08:40:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9602.962392 secs 2024-03-28T08:40:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9602.962392 secs 2024-03-28T08:40:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9602.962392 secs 2024-03-28T08:40:04.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10275 sec 2024-03-28T08:40:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:04 smithi086 ceph-mon[35163]: pgmap v5925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:04 smithi159 ceph-mon[36109]: pgmap v5925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:04 smithi055 ceph-mon[31863]: pgmap v5925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:05.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10276 sec 2024-03-28T08:40:06.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10277 sec 2024-03-28T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:06 smithi086 ceph-mon[35163]: pgmap v5926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:40:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:06 smithi159 ceph-mon[36109]: pgmap v5926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:40:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:06 smithi055 ceph-mon[31863]: pgmap v5926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:40:07.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10278 sec 2024-03-28T08:40:08.528 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10279 sec 2024-03-28T08:40:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:08 smithi086 ceph-mon[35163]: pgmap v5927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:40:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9607.962511 secs 2024-03-28T08:40:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:08 smithi159 ceph-mon[36109]: pgmap v5927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:40:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9607.962511 secs 2024-03-28T08:40:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:08 smithi055 ceph-mon[31863]: pgmap v5927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:40:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9607.962511 secs 2024-03-28T08:40:09.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10280 sec 2024-03-28T08:40:10.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10281 sec 2024-03-28T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:10 smithi086 ceph-mon[35163]: pgmap v5928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:10.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:10 smithi159 ceph-mon[36109]: pgmap v5928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:10 smithi055 ceph-mon[31863]: pgmap v5928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:40:11.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10282 sec 2024-03-28T08:40:12.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10283 sec 2024-03-28T08:40:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:12 smithi086 ceph-mon[35163]: pgmap v5929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:12 smithi159 ceph-mon[36109]: pgmap v5929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:12 smithi055 ceph-mon[31863]: pgmap v5929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:13.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10284 sec 2024-03-28T08:40:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9612.962632 secs 2024-03-28T08:40:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9612.962632 secs 2024-03-28T08:40:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9612.962632 secs 2024-03-28T08:40:14.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10285 sec 2024-03-28T08:40:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:14 smithi086 ceph-mon[35163]: pgmap v5930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:14 smithi159 ceph-mon[36109]: pgmap v5930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:14 smithi055 ceph-mon[31863]: pgmap v5930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:15.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10286 sec 2024-03-28T08:40:16.529 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10287 sec 2024-03-28T08:40:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:16 smithi086 ceph-mon[35163]: pgmap v5931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:16 smithi159 ceph-mon[36109]: pgmap v5931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:16 smithi055 ceph-mon[31863]: pgmap v5931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:17.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10288 sec 2024-03-28T08:40:18.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10289 sec 2024-03-28T08:40:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:18 smithi086 ceph-mon[35163]: pgmap v5932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9617.962748 secs 2024-03-28T08:40:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:18 smithi159 ceph-mon[36109]: pgmap v5932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9617.962748 secs 2024-03-28T08:40:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:18 smithi055 ceph-mon[31863]: pgmap v5932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9617.962748 secs 2024-03-28T08:40:19.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10290 sec 2024-03-28T08:40:20.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10291 sec 2024-03-28T08:40:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:20 smithi086 ceph-mon[35163]: pgmap v5933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:20 smithi159 ceph-mon[36109]: pgmap v5933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:20 smithi055 ceph-mon[31863]: pgmap v5933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:21.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10292 sec 2024-03-28T08:40:22.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10293 sec 2024-03-28T08:40:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:22 smithi086 ceph-mon[35163]: pgmap v5934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:22 smithi159 ceph-mon[36109]: pgmap v5934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:22 smithi055 ceph-mon[31863]: pgmap v5934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:23.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10294 sec 2024-03-28T08:40:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9622.962794 secs 2024-03-28T08:40:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9622.962794 secs 2024-03-28T08:40:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9622.962794 secs 2024-03-28T08:40:24.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10295 sec 2024-03-28T08:40:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:24 smithi086 ceph-mon[35163]: pgmap v5935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:24 smithi159 ceph-mon[36109]: pgmap v5935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:24 smithi055 ceph-mon[31863]: pgmap v5935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:25.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10296 sec 2024-03-28T08:40:26.530 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10297 sec 2024-03-28T08:40:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:26 smithi086 ceph-mon[35163]: pgmap v5936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:26 smithi159 ceph-mon[36109]: pgmap v5936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:26 smithi055 ceph-mon[31863]: pgmap v5936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:27.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10298 sec 2024-03-28T08:40:28.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10299 sec 2024-03-28T08:40:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:28 smithi086 ceph-mon[35163]: pgmap v5937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9627.962861 secs 2024-03-28T08:40:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:28 smithi159 ceph-mon[36109]: pgmap v5937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9627.962861 secs 2024-03-28T08:40:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:28 smithi055 ceph-mon[31863]: pgmap v5937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9627.962861 secs 2024-03-28T08:40:29.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10300 sec 2024-03-28T08:40:30.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10301 sec 2024-03-28T08:40:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:30 smithi086 ceph-mon[35163]: pgmap v5938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:30 smithi159 ceph-mon[36109]: pgmap v5938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:30 smithi055 ceph-mon[31863]: pgmap v5938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:31.531 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10302 sec 2024-03-28T08:40:32.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10303 sec 2024-03-28T08:40:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:32 smithi086 ceph-mon[35163]: pgmap v5939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:32 smithi159 ceph-mon[36109]: pgmap v5939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:32 smithi055 ceph-mon[31863]: pgmap v5939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:33.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10304 sec 2024-03-28T08:40:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9632.962952 secs 2024-03-28T08:40:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9632.962952 secs 2024-03-28T08:40:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9632.962952 secs 2024-03-28T08:40:34.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10305 sec 2024-03-28T08:40:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:34 smithi055 ceph-mon[31863]: pgmap v5940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:34 smithi086 ceph-mon[35163]: pgmap v5940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:34 smithi159 ceph-mon[36109]: pgmap v5940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:35.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10306 sec 2024-03-28T08:40:36.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10307 sec 2024-03-28T08:40:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:36 smithi055 ceph-mon[31863]: pgmap v5941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:36 smithi086 ceph-mon[35163]: pgmap v5941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:36 smithi159 ceph-mon[36109]: pgmap v5941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:37.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10308 sec 2024-03-28T08:40:38.532 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10309 sec 2024-03-28T08:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:38 smithi055 ceph-mon[31863]: pgmap v5942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9637.963072 secs 2024-03-28T08:40:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:38 smithi086 ceph-mon[35163]: pgmap v5942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9637.963072 secs 2024-03-28T08:40:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:38 smithi159 ceph-mon[36109]: pgmap v5942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9637.963072 secs 2024-03-28T08:40:39.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10310 sec 2024-03-28T08:40:40.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10311 sec 2024-03-28T08:40:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:40 smithi055 ceph-mon[31863]: pgmap v5943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:40 smithi086 ceph-mon[35163]: pgmap v5943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:40 smithi159 ceph-mon[36109]: pgmap v5943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:41.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10312 sec 2024-03-28T08:40:42.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10313 sec 2024-03-28T08:40:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:42 smithi055 ceph-mon[31863]: pgmap v5944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:42 smithi086 ceph-mon[35163]: pgmap v5944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:42 smithi159 ceph-mon[36109]: pgmap v5944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:43.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10314 sec 2024-03-28T08:40:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9642.963184 secs 2024-03-28T08:40:43.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9642.963184 secs 2024-03-28T08:40:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9642.963184 secs 2024-03-28T08:40:44.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10315 sec 2024-03-28T08:40:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:44 smithi055 ceph-mon[31863]: pgmap v5945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:44 smithi086 ceph-mon[35163]: pgmap v5945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:44 smithi159 ceph-mon[36109]: pgmap v5945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:45.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10316 sec 2024-03-28T08:40:46.533 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10317 sec 2024-03-28T08:40:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:46 smithi055 ceph-mon[31863]: pgmap v5946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:46 smithi086 ceph-mon[35163]: pgmap v5946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:46 smithi159 ceph-mon[36109]: pgmap v5946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:47.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10318 sec 2024-03-28T08:40:48.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10319 sec 2024-03-28T08:40:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:48 smithi086 ceph-mon[35163]: pgmap v5947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9647.963307 secs 2024-03-28T08:40:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:48 smithi159 ceph-mon[36109]: pgmap v5947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9647.963307 secs 2024-03-28T08:40:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:48 smithi055 ceph-mon[31863]: pgmap v5947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9647.963307 secs 2024-03-28T08:40:49.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10320 sec 2024-03-28T08:40:50.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10321 sec 2024-03-28T08:40:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:50 smithi086 ceph-mon[35163]: pgmap v5948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:50 smithi159 ceph-mon[36109]: pgmap v5948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:50 smithi055 ceph-mon[31863]: pgmap v5948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:51.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10322 sec 2024-03-28T08:40:52.534 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10323 sec 2024-03-28T08:40:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:52 smithi086 ceph-mon[35163]: pgmap v5949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:52 smithi159 ceph-mon[36109]: pgmap v5949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:52 smithi055 ceph-mon[31863]: pgmap v5949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:53.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10324 sec 2024-03-28T08:40:53.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9652.963422 secs 2024-03-28T08:40:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9652.963422 secs 2024-03-28T08:40:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9652.963422 secs 2024-03-28T08:40:54.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10325 sec 2024-03-28T08:40:54.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:54 smithi159 ceph-mon[36109]: pgmap v5950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:54 smithi086 ceph-mon[35163]: pgmap v5950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:54 smithi055 ceph-mon[31863]: pgmap v5950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:55.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10326 sec 2024-03-28T08:40:56.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10327 sec 2024-03-28T08:40:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:56 smithi159 ceph-mon[36109]: pgmap v5951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:56 smithi086 ceph-mon[35163]: pgmap v5951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:56 smithi055 ceph-mon[31863]: pgmap v5951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:40:57.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10328 sec 2024-03-28T08:40:58.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10329 sec 2024-03-28T08:40:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:58 smithi086 ceph-mon[35163]: pgmap v5952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9657.963545 secs 2024-03-28T08:40:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:58 smithi159 ceph-mon[36109]: pgmap v5952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9657.963545 secs 2024-03-28T08:40:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:58 smithi055 ceph-mon[31863]: pgmap v5952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:40:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9657.963545 secs 2024-03-28T08:40:59.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10330 sec 2024-03-28T08:41:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:40:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:41:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:40:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:41:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:40:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:41:00.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10331 sec 2024-03-28T08:41:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:00 smithi086 ceph-mon[35163]: pgmap v5953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:00 smithi159 ceph-mon[36109]: pgmap v5953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:00 smithi055 ceph-mon[31863]: pgmap v5953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:01.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10332 sec 2024-03-28T08:41:02.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:41:02.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:41:02.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:01 smithi055 ceph-mon[31863]: pgmap v5954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:02.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:01 smithi055 ceph-mon[31863]: pgmap v5955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:02.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:41:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:41:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:41:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:01 smithi086 ceph-mon[35163]: pgmap v5954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:01 smithi086 ceph-mon[35163]: pgmap v5955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:41:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:41:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:41:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:01 smithi159 ceph-mon[36109]: pgmap v5954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:01 smithi159 ceph-mon[36109]: pgmap v5955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:41:02.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10333 sec 2024-03-28T08:41:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9662.963651 secs 2024-03-28T08:41:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9662.963651 secs 2024-03-28T08:41:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9662.963651 secs 2024-03-28T08:41:03.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10334 sec 2024-03-28T08:41:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:03 smithi086 ceph-mon[35163]: pgmap v5956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:41:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:03 smithi159 ceph-mon[36109]: pgmap v5956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:41:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:03 smithi055 ceph-mon[31863]: pgmap v5956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:41:04.535 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10335 sec 2024-03-28T08:41:05.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10336 sec 2024-03-28T08:41:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:05 smithi086 ceph-mon[35163]: pgmap v5957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:05 smithi159 ceph-mon[36109]: pgmap v5957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:05 smithi055 ceph-mon[31863]: pgmap v5957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:06.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10337 sec 2024-03-28T08:41:07.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10338 sec 2024-03-28T08:41:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:07 smithi086 ceph-mon[35163]: pgmap v5958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9667.963771 secs 2024-03-28T08:41:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:07 smithi159 ceph-mon[36109]: pgmap v5958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9667.963771 secs 2024-03-28T08:41:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:07 smithi055 ceph-mon[31863]: pgmap v5958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9667.963771 secs 2024-03-28T08:41:08.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10339 sec 2024-03-28T08:41:09.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10340 sec 2024-03-28T08:41:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:09 smithi086 ceph-mon[35163]: pgmap v5959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:09 smithi159 ceph-mon[36109]: pgmap v5959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:09 smithi055 ceph-mon[31863]: pgmap v5959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:41:10.536 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10341 sec 2024-03-28T08:41:11.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10342 sec 2024-03-28T08:41:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:11 smithi086 ceph-mon[35163]: pgmap v5960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:12.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:11 smithi159 ceph-mon[36109]: pgmap v5960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:11 smithi055 ceph-mon[31863]: pgmap v5960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:12.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10343 sec 2024-03-28T08:41:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9672.963850 secs 2024-03-28T08:41:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9672.963850 secs 2024-03-28T08:41:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9672.963850 secs 2024-03-28T08:41:13.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10344 sec 2024-03-28T08:41:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:13 smithi086 ceph-mon[35163]: pgmap v5961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:13 smithi159 ceph-mon[36109]: pgmap v5961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:13 smithi055 ceph-mon[31863]: pgmap v5961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:14.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10345 sec 2024-03-28T08:41:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:15 smithi086 ceph-mon[35163]: pgmap v5962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:15 smithi159 ceph-mon[36109]: pgmap v5962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:15 smithi055 ceph-mon[31863]: pgmap v5962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:15.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10346 sec 2024-03-28T08:41:16.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10347 sec 2024-03-28T08:41:17.537 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10348 sec 2024-03-28T08:41:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:17 smithi086 ceph-mon[35163]: pgmap v5963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9677.963967 secs 2024-03-28T08:41:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:17 smithi159 ceph-mon[36109]: pgmap v5963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9677.963967 secs 2024-03-28T08:41:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:17 smithi055 ceph-mon[31863]: pgmap v5963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9677.963967 secs 2024-03-28T08:41:18.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10349 sec 2024-03-28T08:41:19.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10350 sec 2024-03-28T08:41:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:19 smithi086 ceph-mon[35163]: pgmap v5964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:19 smithi159 ceph-mon[36109]: pgmap v5964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:19 smithi055 ceph-mon[31863]: pgmap v5964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:20.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10351 sec 2024-03-28T08:41:21.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10352 sec 2024-03-28T08:41:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:21 smithi086 ceph-mon[35163]: pgmap v5965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:21 smithi159 ceph-mon[36109]: pgmap v5965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:21 smithi055 ceph-mon[31863]: pgmap v5965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:22.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10353 sec 2024-03-28T08:41:23.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9682.964051 secs 2024-03-28T08:41:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9682.964051 secs 2024-03-28T08:41:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9682.964051 secs 2024-03-28T08:41:23.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10354 sec 2024-03-28T08:41:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:23 smithi086 ceph-mon[35163]: pgmap v5966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:23 smithi159 ceph-mon[36109]: pgmap v5966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:23 smithi055 ceph-mon[31863]: pgmap v5966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:24.538 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10355 sec 2024-03-28T08:41:25.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10356 sec 2024-03-28T08:41:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:25 smithi086 ceph-mon[35163]: pgmap v5967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:41:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:25 smithi159 ceph-mon[36109]: pgmap v5967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:41:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:25 smithi055 ceph-mon[31863]: pgmap v5967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:41:26.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10357 sec 2024-03-28T08:41:27.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10358 sec 2024-03-28T08:41:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:27 smithi086 ceph-mon[35163]: pgmap v5968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9687.964163 secs 2024-03-28T08:41:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:27 smithi159 ceph-mon[36109]: pgmap v5968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9687.964163 secs 2024-03-28T08:41:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:27 smithi055 ceph-mon[31863]: pgmap v5968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9687.964163 secs 2024-03-28T08:41:28.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10359 sec 2024-03-28T08:41:29.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10360 sec 2024-03-28T08:41:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:29 smithi086 ceph-mon[35163]: pgmap v5969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:29 smithi159 ceph-mon[36109]: pgmap v5969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:29 smithi055 ceph-mon[31863]: pgmap v5969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:30.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10361 sec 2024-03-28T08:41:31.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10362 sec 2024-03-28T08:41:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:31 smithi086 ceph-mon[35163]: pgmap v5970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:31 smithi159 ceph-mon[36109]: pgmap v5970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:31 smithi055 ceph-mon[31863]: pgmap v5970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:32.539 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10363 sec 2024-03-28T08:41:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9692.964284 secs 2024-03-28T08:41:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9692.964284 secs 2024-03-28T08:41:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9692.964284 secs 2024-03-28T08:41:33.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10364 sec 2024-03-28T08:41:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:33 smithi086 ceph-mon[35163]: pgmap v5971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:33 smithi159 ceph-mon[36109]: pgmap v5971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:33 smithi055 ceph-mon[31863]: pgmap v5971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:41:34.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10365 sec 2024-03-28T08:41:35.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10366 sec 2024-03-28T08:41:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:35 smithi086 ceph-mon[35163]: pgmap v5972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:35 smithi159 ceph-mon[36109]: pgmap v5972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:35 smithi055 ceph-mon[31863]: pgmap v5972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:36.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10367 sec 2024-03-28T08:41:37.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10368 sec 2024-03-28T08:41:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:37 smithi086 ceph-mon[35163]: pgmap v5973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:38.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9697.964368 secs 2024-03-28T08:41:38.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:37 smithi159 ceph-mon[36109]: pgmap v5973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:38.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9697.964368 secs 2024-03-28T08:41:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:37 smithi055 ceph-mon[31863]: pgmap v5973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:38.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9697.964368 secs 2024-03-28T08:41:38.540 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10369 sec 2024-03-28T08:41:39.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10370 sec 2024-03-28T08:41:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:39 smithi086 ceph-mon[35163]: pgmap v5974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:39 smithi159 ceph-mon[36109]: pgmap v5974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:39 smithi055 ceph-mon[31863]: pgmap v5974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:40.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10371 sec 2024-03-28T08:41:41.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10372 sec 2024-03-28T08:41:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:41 smithi086 ceph-mon[35163]: pgmap v5975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:41 smithi159 ceph-mon[36109]: pgmap v5975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:41 smithi055 ceph-mon[31863]: pgmap v5975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:42.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10373 sec 2024-03-28T08:41:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9702.964396 secs 2024-03-28T08:41:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9702.964396 secs 2024-03-28T08:41:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9702.964396 secs 2024-03-28T08:41:43.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10374 sec 2024-03-28T08:41:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:43 smithi086 ceph-mon[35163]: pgmap v5976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:43 smithi159 ceph-mon[36109]: pgmap v5976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:43 smithi055 ceph-mon[31863]: pgmap v5976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:44.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10375 sec 2024-03-28T08:41:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:45 smithi086 ceph-mon[35163]: pgmap v5977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:45 smithi159 ceph-mon[36109]: pgmap v5977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:45 smithi055 ceph-mon[31863]: pgmap v5977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:45.541 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10376 sec 2024-03-28T08:41:46.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10377 sec 2024-03-28T08:41:47.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10378 sec 2024-03-28T08:41:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:47 smithi086 ceph-mon[35163]: pgmap v5978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9707.964478 secs 2024-03-28T08:41:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:47 smithi159 ceph-mon[36109]: pgmap v5978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9707.964478 secs 2024-03-28T08:41:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:47 smithi055 ceph-mon[31863]: pgmap v5978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9707.964478 secs 2024-03-28T08:41:48.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10379 sec 2024-03-28T08:41:49.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10380 sec 2024-03-28T08:41:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:49 smithi086 ceph-mon[35163]: pgmap v5979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:49 smithi159 ceph-mon[36109]: pgmap v5979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:49 smithi055 ceph-mon[31863]: pgmap v5979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:50.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10381 sec 2024-03-28T08:41:51.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10382 sec 2024-03-28T08:41:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:51 smithi086 ceph-mon[35163]: pgmap v5980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:51 smithi159 ceph-mon[36109]: pgmap v5980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:51 smithi055 ceph-mon[31863]: pgmap v5980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:52.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10383 sec 2024-03-28T08:41:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9712.964548 secs 2024-03-28T08:41:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9712.964548 secs 2024-03-28T08:41:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9712.964548 secs 2024-03-28T08:41:53.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10384 sec 2024-03-28T08:41:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:53 smithi086 ceph-mon[35163]: pgmap v5981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:53 smithi159 ceph-mon[36109]: pgmap v5981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:53 smithi055 ceph-mon[31863]: pgmap v5981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:54.542 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10385 sec 2024-03-28T08:41:55.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10386 sec 2024-03-28T08:41:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:55 smithi086 ceph-mon[35163]: pgmap v5982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:55 smithi159 ceph-mon[36109]: pgmap v5982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:55 smithi055 ceph-mon[31863]: pgmap v5982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:41:56.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10387 sec 2024-03-28T08:41:57.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10388 sec 2024-03-28T08:41:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:57 smithi086 ceph-mon[35163]: pgmap v5983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9717.964577 secs 2024-03-28T08:41:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:57 smithi159 ceph-mon[36109]: pgmap v5983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9717.964577 secs 2024-03-28T08:41:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:57 smithi055 ceph-mon[31863]: pgmap v5983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:41:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9717.964577 secs 2024-03-28T08:41:58.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10389 sec 2024-03-28T08:41:59.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10390 sec 2024-03-28T08:42:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:41:59 smithi086 ceph-mon[35163]: pgmap v5984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:41:59 smithi159 ceph-mon[36109]: pgmap v5984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:41:59 smithi055 ceph-mon[31863]: pgmap v5984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:00.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10391 sec 2024-03-28T08:42:01.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10392 sec 2024-03-28T08:42:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:01 smithi086 ceph-mon[35163]: pgmap v5985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:42:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:01 smithi159 ceph-mon[36109]: pgmap v5985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:42:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:01 smithi055 ceph-mon[31863]: pgmap v5985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:42:02.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10393 sec 2024-03-28T08:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9722.964645 secs 2024-03-28T08:42:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:03 smithi055 ceph-mon[31863]: pgmap v5986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:03.543 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10394 sec 2024-03-28T08:42:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9722.964645 secs 2024-03-28T08:42:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:03 smithi086 ceph-mon[35163]: pgmap v5986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9722.964645 secs 2024-03-28T08:42:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:03 smithi159 ceph-mon[36109]: pgmap v5986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:04.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10395 sec 2024-03-28T08:42:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:42:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:42:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:04 smithi086 ceph-mon[35163]: pgmap v5987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:42:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:04 smithi086 ceph-mon[35163]: pgmap v5988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:42:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:42:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:42:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:04 smithi159 ceph-mon[36109]: pgmap v5987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:42:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:04 smithi159 ceph-mon[36109]: pgmap v5988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:42:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:42:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:42:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:04 smithi055 ceph-mon[31863]: pgmap v5987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:42:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:04 smithi055 ceph-mon[31863]: pgmap v5988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:42:04.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:42:05.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10396 sec 2024-03-28T08:42:06.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10397 sec 2024-03-28T08:42:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:06 smithi086 ceph-mon[35163]: pgmap v5989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T08:42:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:06 smithi159 ceph-mon[36109]: pgmap v5989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T08:42:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:06 smithi055 ceph-mon[31863]: pgmap v5989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T08:42:07.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10398 sec 2024-03-28T08:42:08.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10399 sec 2024-03-28T08:42:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9727.964712 secs 2024-03-28T08:42:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:08 smithi086 ceph-mon[35163]: pgmap v5990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9727.964712 secs 2024-03-28T08:42:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:08 smithi159 ceph-mon[36109]: pgmap v5990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9727.964712 secs 2024-03-28T08:42:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:08 smithi055 ceph-mon[31863]: pgmap v5990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:09.544 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10400 sec 2024-03-28T08:42:10.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10401 sec 2024-03-28T08:42:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:10 smithi086 ceph-mon[35163]: pgmap v5991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:10 smithi159 ceph-mon[36109]: pgmap v5991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:10 smithi055 ceph-mon[31863]: pgmap v5991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:11.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10402 sec 2024-03-28T08:42:12.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10403 sec 2024-03-28T08:42:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:12 smithi086 ceph-mon[35163]: pgmap v5992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:12 smithi159 ceph-mon[36109]: pgmap v5992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:12 smithi055 ceph-mon[31863]: pgmap v5992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:13.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10404 sec 2024-03-28T08:42:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9732.964803 secs 2024-03-28T08:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9732.964803 secs 2024-03-28T08:42:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9732.964803 secs 2024-03-28T08:42:14.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10405 sec 2024-03-28T08:42:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:14 smithi086 ceph-mon[35163]: pgmap v5993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:14 smithi159 ceph-mon[36109]: pgmap v5993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:14 smithi055 ceph-mon[31863]: pgmap v5993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:15.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10406 sec 2024-03-28T08:42:16.545 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10407 sec 2024-03-28T08:42:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:16 smithi086 ceph-mon[35163]: pgmap v5994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:16 smithi159 ceph-mon[36109]: pgmap v5994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:16 smithi055 ceph-mon[31863]: pgmap v5994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:17.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10408 sec 2024-03-28T08:42:18.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10409 sec 2024-03-28T08:42:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9737.964927 secs 2024-03-28T08:42:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:18 smithi086 ceph-mon[35163]: pgmap v5995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9737.964927 secs 2024-03-28T08:42:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:18 smithi159 ceph-mon[36109]: pgmap v5995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9737.964927 secs 2024-03-28T08:42:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:18 smithi055 ceph-mon[31863]: pgmap v5995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:19.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10410 sec 2024-03-28T08:42:20.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10411 sec 2024-03-28T08:42:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:20 smithi086 ceph-mon[35163]: pgmap v5996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:20 smithi159 ceph-mon[36109]: pgmap v5996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:20 smithi055 ceph-mon[31863]: pgmap v5996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:21.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10412 sec 2024-03-28T08:42:22.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10413 sec 2024-03-28T08:42:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:22 smithi086 ceph-mon[35163]: pgmap v5997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:22 smithi159 ceph-mon[36109]: pgmap v5997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:22 smithi055 ceph-mon[31863]: pgmap v5997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:23.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10414 sec 2024-03-28T08:42:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9742.964957 secs 2024-03-28T08:42:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9742.964957 secs 2024-03-28T08:42:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9742.964957 secs 2024-03-28T08:42:24.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10415 sec 2024-03-28T08:42:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:24 smithi086 ceph-mon[35163]: pgmap v5998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:24 smithi159 ceph-mon[36109]: pgmap v5998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:24 smithi055 ceph-mon[31863]: pgmap v5998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:25.546 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10416 sec 2024-03-28T08:42:26.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10417 sec 2024-03-28T08:42:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:26 smithi086 ceph-mon[35163]: pgmap v5999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:26 smithi159 ceph-mon[36109]: pgmap v5999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:26 smithi055 ceph-mon[31863]: pgmap v5999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:27.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10418 sec 2024-03-28T08:42:28.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10419 sec 2024-03-28T08:42:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9747.965078 secs 2024-03-28T08:42:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:28 smithi086 ceph-mon[35163]: pgmap v6000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9747.965078 secs 2024-03-28T08:42:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:28 smithi159 ceph-mon[36109]: pgmap v6000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9747.965078 secs 2024-03-28T08:42:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:28 smithi055 ceph-mon[31863]: pgmap v6000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:29.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10420 sec 2024-03-28T08:42:30.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10421 sec 2024-03-28T08:42:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:30 smithi086 ceph-mon[35163]: pgmap v6001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:30 smithi159 ceph-mon[36109]: pgmap v6001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:30 smithi055 ceph-mon[31863]: pgmap v6001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:31.547 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10422 sec 2024-03-28T08:42:32.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10423 sec 2024-03-28T08:42:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:32 smithi086 ceph-mon[35163]: pgmap v6002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:32 smithi159 ceph-mon[36109]: pgmap v6002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:32 smithi055 ceph-mon[31863]: pgmap v6002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:33.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10424 sec 2024-03-28T08:42:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9752.965198 secs 2024-03-28T08:42:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9752.965198 secs 2024-03-28T08:42:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9752.965198 secs 2024-03-28T08:42:34.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10425 sec 2024-03-28T08:42:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:34 smithi055 ceph-mon[31863]: pgmap v6003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:34 smithi086 ceph-mon[35163]: pgmap v6003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:34 smithi159 ceph-mon[36109]: pgmap v6003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:35.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10426 sec 2024-03-28T08:42:36.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10427 sec 2024-03-28T08:42:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:36 smithi055 ceph-mon[31863]: pgmap v6004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:36 smithi086 ceph-mon[35163]: pgmap v6004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:36 smithi159 ceph-mon[36109]: pgmap v6004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:42:37.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10428 sec 2024-03-28T08:42:38.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10429 sec 2024-03-28T08:42:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9757.965261 secs 2024-03-28T08:42:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:38 smithi055 ceph-mon[31863]: pgmap v6005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:42:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9757.965261 secs 2024-03-28T08:42:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:38 smithi086 ceph-mon[35163]: pgmap v6005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:42:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9757.965261 secs 2024-03-28T08:42:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:38 smithi159 ceph-mon[36109]: pgmap v6005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:42:39.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10430 sec 2024-03-28T08:42:40.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10431 sec 2024-03-28T08:42:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:40 smithi055 ceph-mon[31863]: pgmap v6006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:40 smithi086 ceph-mon[35163]: pgmap v6006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:40 smithi159 ceph-mon[36109]: pgmap v6006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:41.548 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10432 sec 2024-03-28T08:42:42.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10433 sec 2024-03-28T08:42:43.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:42 smithi086 ceph-mon[35163]: pgmap v6007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:42 smithi055 ceph-mon[31863]: pgmap v6007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:42 smithi159 ceph-mon[36109]: pgmap v6007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:42:43.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10434 sec 2024-03-28T08:42:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9762.965325 secs 2024-03-28T08:42:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9762.965325 secs 2024-03-28T08:42:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9762.965325 secs 2024-03-28T08:42:44.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10435 sec 2024-03-28T08:42:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:44 smithi086 ceph-mon[35163]: pgmap v6008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:44 smithi159 ceph-mon[36109]: pgmap v6008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:44 smithi055 ceph-mon[31863]: pgmap v6008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:45.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10436 sec 2024-03-28T08:42:46.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10437 sec 2024-03-28T08:42:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:46 smithi086 ceph-mon[35163]: pgmap v6009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:46 smithi159 ceph-mon[36109]: pgmap v6009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:46 smithi055 ceph-mon[31863]: pgmap v6009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:47.549 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10438 sec 2024-03-28T08:42:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9767.965390 secs 2024-03-28T08:42:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9767.965390 secs 2024-03-28T08:42:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9767.965390 secs 2024-03-28T08:42:48.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10439 sec 2024-03-28T08:42:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:48 smithi086 ceph-mon[35163]: pgmap v6010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:48 smithi159 ceph-mon[36109]: pgmap v6010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:49.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:48 smithi055 ceph-mon[31863]: pgmap v6010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:49.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10440 sec 2024-03-28T08:42:50.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10441 sec 2024-03-28T08:42:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:50 smithi086 ceph-mon[35163]: pgmap v6011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:50 smithi159 ceph-mon[36109]: pgmap v6011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:50 smithi055 ceph-mon[31863]: pgmap v6011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:51.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10442 sec 2024-03-28T08:42:52.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10443 sec 2024-03-28T08:42:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:52 smithi086 ceph-mon[35163]: pgmap v6012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9772.965515 secs 2024-03-28T08:42:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:52 smithi159 ceph-mon[36109]: pgmap v6012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:53.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9772.965515 secs 2024-03-28T08:42:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:52 smithi055 ceph-mon[31863]: pgmap v6012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9772.965515 secs 2024-03-28T08:42:53.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10444 sec 2024-03-28T08:42:54.550 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10445 sec 2024-03-28T08:42:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:54 smithi086 ceph-mon[35163]: pgmap v6013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:54 smithi159 ceph-mon[36109]: pgmap v6013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:54 smithi055 ceph-mon[31863]: pgmap v6013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:42:55.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10446 sec 2024-03-28T08:42:56.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10447 sec 2024-03-28T08:42:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:56 smithi086 ceph-mon[35163]: pgmap v6014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:56 smithi159 ceph-mon[36109]: pgmap v6014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:56 smithi055 ceph-mon[31863]: pgmap v6014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:42:57.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10448 sec 2024-03-28T08:42:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9777.965581 secs 2024-03-28T08:42:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9777.965581 secs 2024-03-28T08:42:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9777.965581 secs 2024-03-28T08:42:58.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10449 sec 2024-03-28T08:42:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:42:58 smithi086 ceph-mon[35163]: pgmap v6015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:42:58 smithi159 ceph-mon[36109]: pgmap v6015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:42:58 smithi055 ceph-mon[31863]: pgmap v6015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:42:59.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10450 sec 2024-03-28T08:43:00.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10451 sec 2024-03-28T08:43:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:00 smithi086 ceph-mon[35163]: pgmap v6016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:00 smithi159 ceph-mon[36109]: pgmap v6016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:00 smithi055 ceph-mon[31863]: pgmap v6016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:01.551 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10452 sec 2024-03-28T08:43:02.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10453 sec 2024-03-28T08:43:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:02 smithi086 ceph-mon[35163]: pgmap v6017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9782.965660 secs 2024-03-28T08:43:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:02 smithi159 ceph-mon[36109]: pgmap v6017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9782.965660 secs 2024-03-28T08:43:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:02 smithi055 ceph-mon[31863]: pgmap v6017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9782.965660 secs 2024-03-28T08:43:03.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10454 sec 2024-03-28T08:43:04.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10455 sec 2024-03-28T08:43:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:04 smithi086 ceph-mon[35163]: pgmap v6018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:43:05.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:04 smithi159 ceph-mon[36109]: pgmap v6018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:05.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:43:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:04 smithi055 ceph-mon[31863]: pgmap v6018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:43:05.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10456 sec 2024-03-28T08:43:06.275 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.275 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:06.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10457 sec 2024-03-28T08:43:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:07 smithi086 ceph-mon[35163]: pgmap v6019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:07 smithi159 ceph-mon[36109]: pgmap v6019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:07 smithi055 ceph-mon[31863]: pgmap v6019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:07.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10458 sec 2024-03-28T08:43:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9787.965733 secs 2024-03-28T08:43:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:08 smithi086 ceph-mon[35163]: pgmap v6020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9787.965733 secs 2024-03-28T08:43:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:08 smithi159 ceph-mon[36109]: pgmap v6020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9787.965733 secs 2024-03-28T08:43:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:08 smithi055 ceph-mon[31863]: pgmap v6020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:08.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10459 sec 2024-03-28T08:43:09.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10460 sec 2024-03-28T08:43:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:10.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10461 sec 2024-03-28T08:43:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:10 smithi086 ceph-mon[35163]: pgmap v6021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:10 smithi055 ceph-mon[31863]: pgmap v6021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:10 smithi159 ceph-mon[36109]: pgmap v6021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:11.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10462 sec 2024-03-28T08:43:12.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10463 sec 2024-03-28T08:43:12.946 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:12 smithi055 ceph-mon[31863]: pgmap v6022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:12.977 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:12 smithi086 ceph-mon[35163]: pgmap v6022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:12 smithi159 ceph-mon[36109]: pgmap v6022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:13.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10464 sec 2024-03-28T08:43:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9792.965803 secs 2024-03-28T08:43:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9792.965803 secs 2024-03-28T08:43:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9792.965803 secs 2024-03-28T08:43:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:14.552 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10465 sec 2024-03-28T08:43:14.886 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:14 smithi055 ceph-mon[31863]: pgmap v6023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:14 smithi086 ceph-mon[35163]: pgmap v6023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:14 smithi159 ceph-mon[36109]: pgmap v6023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:15.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10466 sec 2024-03-28T08:43:16.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10467 sec 2024-03-28T08:43:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: pgmap v6024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:43:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:43:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: pgmap v6024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:43:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:43:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: pgmap v6024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:43:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:43:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:43:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:43:17.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10468 sec 2024-03-28T08:43:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:18 smithi086 ceph-mon[35163]: pgmap v6025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:18 smithi086 ceph-mon[35163]: pgmap v6026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9797.965867 secs 2024-03-28T08:43:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:18 smithi159 ceph-mon[36109]: pgmap v6025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:43:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:18 smithi159 ceph-mon[36109]: pgmap v6026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9797.965867 secs 2024-03-28T08:43:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:18 smithi055 ceph-mon[31863]: pgmap v6025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T08:43:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:18 smithi055 ceph-mon[31863]: pgmap v6026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9797.965867 secs 2024-03-28T08:43:18.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10469 sec 2024-03-28T08:43:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:19 smithi086 ceph-mon[35163]: pgmap v6027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:19 smithi159 ceph-mon[36109]: pgmap v6027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:19 smithi055 ceph-mon[31863]: pgmap v6027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:43:19.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10470 sec 2024-03-28T08:43:20.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10471 sec 2024-03-28T08:43:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:21 smithi086 ceph-mon[35163]: pgmap v6028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:21 smithi159 ceph-mon[36109]: pgmap v6028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:21 smithi055 ceph-mon[31863]: pgmap v6028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:21.553 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10472 sec 2024-03-28T08:43:22.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10473 sec 2024-03-28T08:43:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:23 smithi086 ceph-mon[35163]: pgmap v6029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9802.965988 secs 2024-03-28T08:43:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:23 smithi159 ceph-mon[36109]: pgmap v6029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9802.965988 secs 2024-03-28T08:43:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:23 smithi055 ceph-mon[31863]: pgmap v6029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T08:43:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9802.965988 secs 2024-03-28T08:43:23.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10474 sec 2024-03-28T08:43:24.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10475 sec 2024-03-28T08:43:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:25 smithi086 ceph-mon[35163]: pgmap v6030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:43:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:25 smithi159 ceph-mon[36109]: pgmap v6030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:43:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:25 smithi055 ceph-mon[31863]: pgmap v6030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T08:43:25.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10476 sec 2024-03-28T08:43:26.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10477 sec 2024-03-28T08:43:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:27 smithi086 ceph-mon[35163]: pgmap v6031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:43:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:27 smithi159 ceph-mon[36109]: pgmap v6031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:43:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:27 smithi055 ceph-mon[31863]: pgmap v6031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:43:27.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10478 sec 2024-03-28T08:43:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9807.966054 secs 2024-03-28T08:43:28.554 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10479 sec 2024-03-28T08:43:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9807.966054 secs 2024-03-28T08:43:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9807.966054 secs 2024-03-28T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:29 smithi055 ceph-mon[31863]: pgmap v6032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:29.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10480 sec 2024-03-28T08:43:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:29 smithi086 ceph-mon[35163]: pgmap v6032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:29 smithi159 ceph-mon[36109]: pgmap v6032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:30.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10481 sec 2024-03-28T08:43:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:31 smithi055 ceph-mon[31863]: pgmap v6033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:31.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10482 sec 2024-03-28T08:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:31 smithi086 ceph-mon[35163]: pgmap v6033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:31 smithi159 ceph-mon[36109]: pgmap v6033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:32.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10483 sec 2024-03-28T08:43:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:33 smithi055 ceph-mon[31863]: pgmap v6034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9812.966127 secs 2024-03-28T08:43:33.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10484 sec 2024-03-28T08:43:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:33 smithi086 ceph-mon[35163]: pgmap v6034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9812.966127 secs 2024-03-28T08:43:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:33 smithi159 ceph-mon[36109]: pgmap v6034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9812.966127 secs 2024-03-28T08:43:34.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10485 sec 2024-03-28T08:43:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:35 smithi055 ceph-mon[31863]: pgmap v6035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:35.555 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10486 sec 2024-03-28T08:43:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:35 smithi086 ceph-mon[35163]: pgmap v6035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:35 smithi159 ceph-mon[36109]: pgmap v6035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:36.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10487 sec 2024-03-28T08:43:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:37 smithi055 ceph-mon[31863]: pgmap v6036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:37.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10488 sec 2024-03-28T08:43:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:37 smithi086 ceph-mon[35163]: pgmap v6036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:37 smithi159 ceph-mon[36109]: pgmap v6036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:38.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10489 sec 2024-03-28T08:43:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9817.966247 secs 2024-03-28T08:43:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9817.966247 secs 2024-03-28T08:43:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9817.966247 secs 2024-03-28T08:43:39.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10490 sec 2024-03-28T08:43:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:39 smithi086 ceph-mon[35163]: pgmap v6037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:39 smithi159 ceph-mon[36109]: pgmap v6037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:39 smithi055 ceph-mon[31863]: pgmap v6037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:40.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10491 sec 2024-03-28T08:43:41.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10492 sec 2024-03-28T08:43:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:41 smithi086 ceph-mon[35163]: pgmap v6038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:41 smithi159 ceph-mon[36109]: pgmap v6038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:41 smithi055 ceph-mon[31863]: pgmap v6038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:42.556 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10493 sec 2024-03-28T08:43:43.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10494 sec 2024-03-28T08:43:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:43 smithi086 ceph-mon[35163]: pgmap v6039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9822.966369 secs 2024-03-28T08:43:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:43 smithi159 ceph-mon[36109]: pgmap v6039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9822.966369 secs 2024-03-28T08:43:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:43 smithi055 ceph-mon[31863]: pgmap v6039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9822.966369 secs 2024-03-28T08:43:44.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10495 sec 2024-03-28T08:43:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:45 smithi055 ceph-mon[31863]: pgmap v6040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:45.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10496 sec 2024-03-28T08:43:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:45 smithi086 ceph-mon[35163]: pgmap v6040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:45 smithi159 ceph-mon[36109]: pgmap v6040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:46.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10497 sec 2024-03-28T08:43:47.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10498 sec 2024-03-28T08:43:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:47 smithi086 ceph-mon[35163]: pgmap v6041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:47 smithi159 ceph-mon[36109]: pgmap v6041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:47 smithi055 ceph-mon[31863]: pgmap v6041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:48.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10499 sec 2024-03-28T08:43:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9827.966489 secs 2024-03-28T08:43:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9827.966489 secs 2024-03-28T08:43:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9827.966489 secs 2024-03-28T08:43:49.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10500 sec 2024-03-28T08:43:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:49 smithi086 ceph-mon[35163]: pgmap v6042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:49 smithi159 ceph-mon[36109]: pgmap v6042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:49 smithi055 ceph-mon[31863]: pgmap v6042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:50.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10501 sec 2024-03-28T08:43:51.557 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10502 sec 2024-03-28T08:43:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:51 smithi086 ceph-mon[35163]: pgmap v6043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:51 smithi159 ceph-mon[36109]: pgmap v6043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:51 smithi055 ceph-mon[31863]: pgmap v6043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:43:52.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10503 sec 2024-03-28T08:43:53.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10504 sec 2024-03-28T08:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:53 smithi086 ceph-mon[35163]: pgmap v6044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9832.966610 secs 2024-03-28T08:43:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:53 smithi159 ceph-mon[36109]: pgmap v6044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9832.966610 secs 2024-03-28T08:43:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:53 smithi055 ceph-mon[31863]: pgmap v6044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9832.966610 secs 2024-03-28T08:43:54.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10505 sec 2024-03-28T08:43:55.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10506 sec 2024-03-28T08:43:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:55 smithi086 ceph-mon[35163]: pgmap v6045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:55 smithi159 ceph-mon[36109]: pgmap v6045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:55 smithi055 ceph-mon[31863]: pgmap v6045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:56.558 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10507 sec 2024-03-28T08:43:57.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10508 sec 2024-03-28T08:43:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:57 smithi086 ceph-mon[35163]: pgmap v6046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:57 smithi159 ceph-mon[36109]: pgmap v6046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:57 smithi055 ceph-mon[31863]: pgmap v6046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:58.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10509 sec 2024-03-28T08:43:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9837.966730 secs 2024-03-28T08:43:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9837.966730 secs 2024-03-28T08:43:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9837.966730 secs 2024-03-28T08:43:59.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10510 sec 2024-03-28T08:43:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:43:59 smithi086 ceph-mon[35163]: pgmap v6047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:43:59 smithi159 ceph-mon[36109]: pgmap v6047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:43:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:43:59 smithi055 ceph-mon[31863]: pgmap v6047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:00.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10511 sec 2024-03-28T08:44:01.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10512 sec 2024-03-28T08:44:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:01 smithi086 ceph-mon[35163]: pgmap v6048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:01 smithi159 ceph-mon[36109]: pgmap v6048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:01 smithi055 ceph-mon[31863]: pgmap v6048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:02.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10513 sec 2024-03-28T08:44:03.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10514 sec 2024-03-28T08:44:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:03 smithi086 ceph-mon[35163]: pgmap v6049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9842.966852 secs 2024-03-28T08:44:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:03 smithi159 ceph-mon[36109]: pgmap v6049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9842.966852 secs 2024-03-28T08:44:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:03 smithi055 ceph-mon[31863]: pgmap v6049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9842.966852 secs 2024-03-28T08:44:04.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10515 sec 2024-03-28T08:44:05.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10516 sec 2024-03-28T08:44:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:05 smithi086 ceph-mon[35163]: pgmap v6050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:05 smithi159 ceph-mon[36109]: pgmap v6050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:05 smithi055 ceph-mon[31863]: pgmap v6050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:06.559 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10517 sec 2024-03-28T08:44:07.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10518 sec 2024-03-28T08:44:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:07 smithi086 ceph-mon[35163]: pgmap v6051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:07 smithi159 ceph-mon[36109]: pgmap v6051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:07 smithi055 ceph-mon[31863]: pgmap v6051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:08.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10519 sec 2024-03-28T08:44:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9847.966975 secs 2024-03-28T08:44:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9847.966975 secs 2024-03-28T08:44:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9847.966975 secs 2024-03-28T08:44:09.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10520 sec 2024-03-28T08:44:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:09 smithi086 ceph-mon[35163]: pgmap v6052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:09 smithi159 ceph-mon[36109]: pgmap v6052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:09 smithi055 ceph-mon[31863]: pgmap v6052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:10.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10521 sec 2024-03-28T08:44:11.560 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10522 sec 2024-03-28T08:44:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:11 smithi086 ceph-mon[35163]: pgmap v6053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:11 smithi159 ceph-mon[36109]: pgmap v6053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:11 smithi055 ceph-mon[31863]: pgmap v6053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:12.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10523 sec 2024-03-28T08:44:13.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10524 sec 2024-03-28T08:44:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:13 smithi086 ceph-mon[35163]: pgmap v6054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9852.967097 secs 2024-03-28T08:44:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:13 smithi159 ceph-mon[36109]: pgmap v6054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9852.967097 secs 2024-03-28T08:44:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:13 smithi055 ceph-mon[31863]: pgmap v6054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9852.967097 secs 2024-03-28T08:44:14.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10525 sec 2024-03-28T08:44:15.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10526 sec 2024-03-28T08:44:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:15 smithi086 ceph-mon[35163]: pgmap v6055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:15 smithi159 ceph-mon[36109]: pgmap v6055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:15 smithi055 ceph-mon[31863]: pgmap v6055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:16.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10527 sec 2024-03-28T08:44:17.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10528 sec 2024-03-28T08:44:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:17 smithi086 ceph-mon[35163]: pgmap v6056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:44:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:17 smithi159 ceph-mon[36109]: pgmap v6056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:44:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:17 smithi055 ceph-mon[31863]: pgmap v6056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:44:18.561 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10529 sec 2024-03-28T08:44:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9857.967189 secs 2024-03-28T08:44:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9857.967189 secs 2024-03-28T08:44:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9857.967189 secs 2024-03-28T08:44:19.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10530 sec 2024-03-28T08:44:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:19 smithi086 ceph-mon[35163]: pgmap v6057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:19 smithi159 ceph-mon[36109]: pgmap v6057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:19 smithi055 ceph-mon[31863]: pgmap v6057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:20.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10531 sec 2024-03-28T08:44:21.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10532 sec 2024-03-28T08:44:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:21 smithi086 ceph-mon[35163]: pgmap v6058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:21 smithi159 ceph-mon[36109]: pgmap v6058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:21 smithi055 ceph-mon[31863]: pgmap v6058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:22.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10533 sec 2024-03-28T08:44:23.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10534 sec 2024-03-28T08:44:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: pgmap v6059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9862.967310 secs 2024-03-28T08:44:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:44:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:44:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: pgmap v6059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9862.967310 secs 2024-03-28T08:44:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:44:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:44:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: pgmap v6059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9862.967310 secs 2024-03-28T08:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:44:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:44:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:44:24.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10535 sec 2024-03-28T08:44:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:24 smithi055 ceph-mon[31863]: pgmap v6060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:24 smithi055 ceph-mon[31863]: pgmap v6061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:24 smithi086 ceph-mon[35163]: pgmap v6060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:24 smithi086 ceph-mon[35163]: pgmap v6061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:24 smithi159 ceph-mon[36109]: pgmap v6060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:24 smithi159 ceph-mon[36109]: pgmap v6061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:25.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10536 sec 2024-03-28T08:44:26.562 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10537 sec 2024-03-28T08:44:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:26 smithi055 ceph-mon[31863]: pgmap v6062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T08:44:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:26 smithi086 ceph-mon[35163]: pgmap v6062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T08:44:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:26 smithi159 ceph-mon[36109]: pgmap v6062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T08:44:27.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10538 sec 2024-03-28T08:44:28.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10539 sec 2024-03-28T08:44:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:28 smithi055 ceph-mon[31863]: pgmap v6063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:44:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9867.967401 secs 2024-03-28T08:44:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:28 smithi086 ceph-mon[35163]: pgmap v6063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:44:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9867.967401 secs 2024-03-28T08:44:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:28 smithi159 ceph-mon[36109]: pgmap v6063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:44:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9867.967401 secs 2024-03-28T08:44:29.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10540 sec 2024-03-28T08:44:30.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10541 sec 2024-03-28T08:44:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:30 smithi055 ceph-mon[31863]: pgmap v6064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:30 smithi086 ceph-mon[35163]: pgmap v6064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:30 smithi159 ceph-mon[36109]: pgmap v6064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:31.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10542 sec 2024-03-28T08:44:32.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10543 sec 2024-03-28T08:44:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:32 smithi055 ceph-mon[31863]: pgmap v6065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:32.648 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:32 smithi159 ceph-mon[36109]: pgmap v6065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:32 smithi086 ceph-mon[35163]: pgmap v6065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:44:33.563 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10544 sec 2024-03-28T08:44:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9872.967521 secs 2024-03-28T08:44:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9872.967521 secs 2024-03-28T08:44:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9872.967521 secs 2024-03-28T08:44:34.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10545 sec 2024-03-28T08:44:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:34 smithi055 ceph-mon[31863]: pgmap v6066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:44:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:34 smithi086 ceph-mon[35163]: pgmap v6066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:44:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:34 smithi159 ceph-mon[36109]: pgmap v6066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:44:35.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10546 sec 2024-03-28T08:44:36.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10547 sec 2024-03-28T08:44:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:36 smithi086 ceph-mon[35163]: pgmap v6067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:36 smithi159 ceph-mon[36109]: pgmap v6067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:36 smithi055 ceph-mon[31863]: pgmap v6067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:37.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10548 sec 2024-03-28T08:44:38.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10549 sec 2024-03-28T08:44:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:38 smithi086 ceph-mon[35163]: pgmap v6068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9877.967593 secs 2024-03-28T08:44:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:38 smithi159 ceph-mon[36109]: pgmap v6068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9877.967593 secs 2024-03-28T08:44:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:38 smithi055 ceph-mon[31863]: pgmap v6068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9877.967593 secs 2024-03-28T08:44:39.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10550 sec 2024-03-28T08:44:40.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10551 sec 2024-03-28T08:44:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:40 smithi086 ceph-mon[35163]: pgmap v6069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:40 smithi159 ceph-mon[36109]: pgmap v6069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:40 smithi055 ceph-mon[31863]: pgmap v6069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:41.564 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10552 sec 2024-03-28T08:44:42.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10553 sec 2024-03-28T08:44:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:42 smithi086 ceph-mon[35163]: pgmap v6070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:42 smithi159 ceph-mon[36109]: pgmap v6070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:42 smithi055 ceph-mon[31863]: pgmap v6070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:43.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10554 sec 2024-03-28T08:44:43.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9882.967715 secs 2024-03-28T08:44:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9882.967715 secs 2024-03-28T08:44:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9882.967715 secs 2024-03-28T08:44:44.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10555 sec 2024-03-28T08:44:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:44 smithi086 ceph-mon[35163]: pgmap v6071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:44 smithi159 ceph-mon[36109]: pgmap v6071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:44 smithi055 ceph-mon[31863]: pgmap v6071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:45.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10556 sec 2024-03-28T08:44:46.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10557 sec 2024-03-28T08:44:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:46 smithi086 ceph-mon[35163]: pgmap v6072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:46 smithi159 ceph-mon[36109]: pgmap v6072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:46 smithi055 ceph-mon[31863]: pgmap v6072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:47.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10558 sec 2024-03-28T08:44:48.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10559 sec 2024-03-28T08:44:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:48 smithi086 ceph-mon[35163]: pgmap v6073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9887.967842 secs 2024-03-28T08:44:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:48 smithi159 ceph-mon[36109]: pgmap v6073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9887.967842 secs 2024-03-28T08:44:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:48 smithi055 ceph-mon[31863]: pgmap v6073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9887.967842 secs 2024-03-28T08:44:49.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10560 sec 2024-03-28T08:44:50.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10561 sec 2024-03-28T08:44:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:50 smithi086 ceph-mon[35163]: pgmap v6074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:50 smithi159 ceph-mon[36109]: pgmap v6074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:50 smithi055 ceph-mon[31863]: pgmap v6074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:51.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10562 sec 2024-03-28T08:44:52.565 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10563 sec 2024-03-28T08:44:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:52 smithi086 ceph-mon[35163]: pgmap v6075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:52 smithi159 ceph-mon[36109]: pgmap v6075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:52 smithi055 ceph-mon[31863]: pgmap v6075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:53.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10564 sec 2024-03-28T08:44:53.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9892.967929 secs 2024-03-28T08:44:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9892.967929 secs 2024-03-28T08:44:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9892.967929 secs 2024-03-28T08:44:54.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10565 sec 2024-03-28T08:44:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:54 smithi086 ceph-mon[35163]: pgmap v6076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:54 smithi159 ceph-mon[36109]: pgmap v6076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:54 smithi055 ceph-mon[31863]: pgmap v6076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:44:55.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10566 sec 2024-03-28T08:44:56.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10567 sec 2024-03-28T08:44:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:56 smithi086 ceph-mon[35163]: pgmap v6077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:56 smithi159 ceph-mon[36109]: pgmap v6077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:56 smithi055 ceph-mon[31863]: pgmap v6077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:44:57.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10568 sec 2024-03-28T08:44:58.566 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10569 sec 2024-03-28T08:44:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:58 smithi086 ceph-mon[35163]: pgmap v6078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:44:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9897.968014 secs 2024-03-28T08:44:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:58 smithi159 ceph-mon[36109]: pgmap v6078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:44:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9897.968014 secs 2024-03-28T08:44:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:58 smithi055 ceph-mon[31863]: pgmap v6078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:44:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:44:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9897.968014 secs 2024-03-28T08:44:59.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10570 sec 2024-03-28T08:45:00.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10571 sec 2024-03-28T08:45:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:00 smithi086 ceph-mon[35163]: pgmap v6079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:00 smithi159 ceph-mon[36109]: pgmap v6079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:00 smithi055 ceph-mon[31863]: pgmap v6079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:01.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10572 sec 2024-03-28T08:45:02.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10573 sec 2024-03-28T08:45:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:02 smithi086 ceph-mon[35163]: pgmap v6080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:02 smithi159 ceph-mon[36109]: pgmap v6080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:02 smithi055 ceph-mon[31863]: pgmap v6080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:03.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10574 sec 2024-03-28T08:45:03.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9902.968100 secs 2024-03-28T08:45:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9902.968100 secs 2024-03-28T08:45:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9902.968100 secs 2024-03-28T08:45:04.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10575 sec 2024-03-28T08:45:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:04 smithi086 ceph-mon[35163]: pgmap v6081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:04 smithi159 ceph-mon[36109]: pgmap v6081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:04 smithi055 ceph-mon[31863]: pgmap v6081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:05.567 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10576 sec 2024-03-28T08:45:06.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10577 sec 2024-03-28T08:45:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:06 smithi086 ceph-mon[35163]: pgmap v6082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:06 smithi159 ceph-mon[36109]: pgmap v6082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:06 smithi055 ceph-mon[31863]: pgmap v6082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:07.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10578 sec 2024-03-28T08:45:08.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10579 sec 2024-03-28T08:45:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:08 smithi086 ceph-mon[35163]: pgmap v6083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9907.968184 secs 2024-03-28T08:45:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:08 smithi159 ceph-mon[36109]: pgmap v6083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9907.968184 secs 2024-03-28T08:45:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:08 smithi055 ceph-mon[31863]: pgmap v6083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9907.968184 secs 2024-03-28T08:45:09.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10580 sec 2024-03-28T08:45:10.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10581 sec 2024-03-28T08:45:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:10 smithi086 ceph-mon[35163]: pgmap v6084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:10 smithi159 ceph-mon[36109]: pgmap v6084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:10 smithi055 ceph-mon[31863]: pgmap v6084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:11.568 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10582 sec 2024-03-28T08:45:12.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10583 sec 2024-03-28T08:45:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:12 smithi086 ceph-mon[35163]: pgmap v6085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:12 smithi159 ceph-mon[36109]: pgmap v6085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:12 smithi055 ceph-mon[31863]: pgmap v6085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:13.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10584 sec 2024-03-28T08:45:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9912.968232 secs 2024-03-28T08:45:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9912.968232 secs 2024-03-28T08:45:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9912.968232 secs 2024-03-28T08:45:14.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10585 sec 2024-03-28T08:45:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:14 smithi086 ceph-mon[35163]: pgmap v6086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:14 smithi159 ceph-mon[36109]: pgmap v6086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:14 smithi055 ceph-mon[31863]: pgmap v6086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:15.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10586 sec 2024-03-28T08:45:16.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10587 sec 2024-03-28T08:45:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:16 smithi055 ceph-mon[31863]: pgmap v6087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:16 smithi086 ceph-mon[35163]: pgmap v6087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:16 smithi159 ceph-mon[36109]: pgmap v6087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:45:17.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10588 sec 2024-03-28T08:45:18.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10589 sec 2024-03-28T08:45:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:18 smithi055 ceph-mon[31863]: pgmap v6088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9917.968318 secs 2024-03-28T08:45:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:18 smithi086 ceph-mon[35163]: pgmap v6088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9917.968318 secs 2024-03-28T08:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:18 smithi159 ceph-mon[36109]: pgmap v6088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9917.968318 secs 2024-03-28T08:45:19.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10590 sec 2024-03-28T08:45:20.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10591 sec 2024-03-28T08:45:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:20 smithi055 ceph-mon[31863]: pgmap v6089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:20 smithi086 ceph-mon[35163]: pgmap v6089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:20 smithi159 ceph-mon[36109]: pgmap v6089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:21.569 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10592 sec 2024-03-28T08:45:22.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10593 sec 2024-03-28T08:45:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:22 smithi055 ceph-mon[31863]: pgmap v6090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:22 smithi086 ceph-mon[35163]: pgmap v6090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:22 smithi159 ceph-mon[36109]: pgmap v6090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:23.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10594 sec 2024-03-28T08:45:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9922.968439 secs 2024-03-28T08:45:23.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9922.968439 secs 2024-03-28T08:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9922.968439 secs 2024-03-28T08:45:24.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10595 sec 2024-03-28T08:45:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:24 smithi055 ceph-mon[31863]: pgmap v6091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:24.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:45:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:24 smithi086 ceph-mon[35163]: pgmap v6091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:45:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:24 smithi159 ceph-mon[36109]: pgmap v6091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:45:25.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10596 sec 2024-03-28T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:45:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:45:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:45:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:45:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:45:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:45:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:45:26.570 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10597 sec 2024-03-28T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:26 smithi086 ceph-mon[35163]: pgmap v6092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:26 smithi086 ceph-mon[35163]: pgmap v6093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:45:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:26 smithi159 ceph-mon[36109]: pgmap v6092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:26 smithi159 ceph-mon[36109]: pgmap v6093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:45:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:26 smithi055 ceph-mon[31863]: pgmap v6092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:26 smithi055 ceph-mon[31863]: pgmap v6093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:45:27.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10598 sec 2024-03-28T08:45:28.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10599 sec 2024-03-28T08:45:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:28 smithi086 ceph-mon[35163]: pgmap v6094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9927.968561 secs 2024-03-28T08:45:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:28 smithi159 ceph-mon[36109]: pgmap v6094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9927.968561 secs 2024-03-28T08:45:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:28 smithi055 ceph-mon[31863]: pgmap v6094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9927.968561 secs 2024-03-28T08:45:29.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10600 sec 2024-03-28T08:45:30.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10601 sec 2024-03-28T08:45:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:30 smithi086 ceph-mon[35163]: pgmap v6095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:30 smithi159 ceph-mon[36109]: pgmap v6095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:30 smithi055 ceph-mon[31863]: pgmap v6095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:45:31.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10602 sec 2024-03-28T08:45:32.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10603 sec 2024-03-28T08:45:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:32 smithi086 ceph-mon[35163]: pgmap v6096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:32 smithi159 ceph-mon[36109]: pgmap v6096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:32 smithi055 ceph-mon[31863]: pgmap v6096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:33.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10604 sec 2024-03-28T08:45:34.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9932.968634 secs 2024-03-28T08:45:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9932.968634 secs 2024-03-28T08:45:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9932.968634 secs 2024-03-28T08:45:34.571 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10605 sec 2024-03-28T08:45:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:34 smithi086 ceph-mon[35163]: pgmap v6097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:34 smithi159 ceph-mon[36109]: pgmap v6097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:34 smithi055 ceph-mon[31863]: pgmap v6097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:35.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10606 sec 2024-03-28T08:45:36.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10607 sec 2024-03-28T08:45:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:36 smithi086 ceph-mon[35163]: pgmap v6098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:36 smithi159 ceph-mon[36109]: pgmap v6098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:36 smithi055 ceph-mon[31863]: pgmap v6098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:45:37.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10608 sec 2024-03-28T08:45:38.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10609 sec 2024-03-28T08:45:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:38 smithi086 ceph-mon[35163]: pgmap v6099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9937.968754 secs 2024-03-28T08:45:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:38 smithi159 ceph-mon[36109]: pgmap v6099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9937.968754 secs 2024-03-28T08:45:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:38 smithi055 ceph-mon[31863]: pgmap v6099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9937.968754 secs 2024-03-28T08:45:39.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10610 sec 2024-03-28T08:45:40.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10611 sec 2024-03-28T08:45:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:40 smithi086 ceph-mon[35163]: pgmap v6100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:40 smithi159 ceph-mon[36109]: pgmap v6100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:40 smithi055 ceph-mon[31863]: pgmap v6100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:41.572 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10612 sec 2024-03-28T08:45:42.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10613 sec 2024-03-28T08:45:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:42 smithi086 ceph-mon[35163]: pgmap v6101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:42 smithi159 ceph-mon[36109]: pgmap v6101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:42 smithi055 ceph-mon[31863]: pgmap v6101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:43.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10614 sec 2024-03-28T08:45:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9942.968851 secs 2024-03-28T08:45:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9942.968851 secs 2024-03-28T08:45:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9942.968851 secs 2024-03-28T08:45:44.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10615 sec 2024-03-28T08:45:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:44 smithi086 ceph-mon[35163]: pgmap v6102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:44 smithi159 ceph-mon[36109]: pgmap v6102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:44 smithi055 ceph-mon[31863]: pgmap v6102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:45.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10616 sec 2024-03-28T08:45:46.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10617 sec 2024-03-28T08:45:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:46 smithi086 ceph-mon[35163]: pgmap v6103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:46 smithi159 ceph-mon[36109]: pgmap v6103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:46 smithi055 ceph-mon[31863]: pgmap v6103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:47.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10618 sec 2024-03-28T08:45:48.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10619 sec 2024-03-28T08:45:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:48 smithi086 ceph-mon[35163]: pgmap v6104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9947.968936 secs 2024-03-28T08:45:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:48 smithi159 ceph-mon[36109]: pgmap v6104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9947.968936 secs 2024-03-28T08:45:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:48 smithi055 ceph-mon[31863]: pgmap v6104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9947.968936 secs 2024-03-28T08:45:49.573 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10620 sec 2024-03-28T08:45:50.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10621 sec 2024-03-28T08:45:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:50 smithi086 ceph-mon[35163]: pgmap v6105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:50 smithi159 ceph-mon[36109]: pgmap v6105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:50 smithi055 ceph-mon[31863]: pgmap v6105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:51.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10622 sec 2024-03-28T08:45:52.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10623 sec 2024-03-28T08:45:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:52 smithi086 ceph-mon[35163]: pgmap v6106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:53.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:52 smithi159 ceph-mon[36109]: pgmap v6106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:52 smithi055 ceph-mon[31863]: pgmap v6106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:53.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10624 sec 2024-03-28T08:45:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9952.969023 secs 2024-03-28T08:45:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9952.969023 secs 2024-03-28T08:45:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9952.969023 secs 2024-03-28T08:45:54.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10625 sec 2024-03-28T08:45:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:54 smithi086 ceph-mon[35163]: pgmap v6107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:54 smithi159 ceph-mon[36109]: pgmap v6107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:54 smithi055 ceph-mon[31863]: pgmap v6107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:55.574 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10626 sec 2024-03-28T08:45:56.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10627 sec 2024-03-28T08:45:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:56 smithi086 ceph-mon[35163]: pgmap v6108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:56 smithi159 ceph-mon[36109]: pgmap v6108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:56 smithi055 ceph-mon[31863]: pgmap v6108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:45:57.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10628 sec 2024-03-28T08:45:58.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10629 sec 2024-03-28T08:45:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:58 smithi086 ceph-mon[35163]: pgmap v6109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:45:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9957.969138 secs 2024-03-28T08:45:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:58 smithi159 ceph-mon[36109]: pgmap v6109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:45:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9957.969138 secs 2024-03-28T08:45:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:58 smithi055 ceph-mon[31863]: pgmap v6109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:45:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:45:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9957.969138 secs 2024-03-28T08:45:59.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10630 sec 2024-03-28T08:46:00.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10631 sec 2024-03-28T08:46:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:00 smithi086 ceph-mon[35163]: pgmap v6110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:00 smithi159 ceph-mon[36109]: pgmap v6110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:00 smithi055 ceph-mon[31863]: pgmap v6110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:01.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10632 sec 2024-03-28T08:46:02.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10633 sec 2024-03-28T08:46:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:02 smithi086 ceph-mon[35163]: pgmap v6111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:02 smithi159 ceph-mon[36109]: pgmap v6111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:02 smithi055 ceph-mon[31863]: pgmap v6111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:03.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10634 sec 2024-03-28T08:46:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9962.969260 secs 2024-03-28T08:46:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9962.969260 secs 2024-03-28T08:46:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9962.969260 secs 2024-03-28T08:46:04.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10635 sec 2024-03-28T08:46:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:04 smithi055 ceph-mon[31863]: pgmap v6112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:04 smithi086 ceph-mon[35163]: pgmap v6112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:04 smithi159 ceph-mon[36109]: pgmap v6112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:05.575 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10636 sec 2024-03-28T08:46:06.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10637 sec 2024-03-28T08:46:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:06 smithi055 ceph-mon[31863]: pgmap v6113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:06 smithi086 ceph-mon[35163]: pgmap v6113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:06 smithi159 ceph-mon[36109]: pgmap v6113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:07.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10638 sec 2024-03-28T08:46:08.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10639 sec 2024-03-28T08:46:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:08 smithi055 ceph-mon[31863]: pgmap v6114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9967.969347 secs 2024-03-28T08:46:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:08 smithi086 ceph-mon[35163]: pgmap v6114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9967.969347 secs 2024-03-28T08:46:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:08 smithi159 ceph-mon[36109]: pgmap v6114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9967.969347 secs 2024-03-28T08:46:09.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10640 sec 2024-03-28T08:46:10.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10641 sec 2024-03-28T08:46:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:10 smithi055 ceph-mon[31863]: pgmap v6115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:10 smithi086 ceph-mon[35163]: pgmap v6115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:10 smithi159 ceph-mon[36109]: pgmap v6115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:11.576 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10642 sec 2024-03-28T08:46:12.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10643 sec 2024-03-28T08:46:13.119 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:12 smithi086 ceph-mon[35163]: pgmap v6116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:12 smithi055 ceph-mon[31863]: pgmap v6116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:12 smithi159 ceph-mon[36109]: pgmap v6116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:13.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10644 sec 2024-03-28T08:46:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9972.969421 secs 2024-03-28T08:46:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9972.969421 secs 2024-03-28T08:46:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9972.969421 secs 2024-03-28T08:46:14.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10645 sec 2024-03-28T08:46:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:14 smithi055 ceph-mon[31863]: pgmap v6117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:14 smithi086 ceph-mon[35163]: pgmap v6117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:14 smithi159 ceph-mon[36109]: pgmap v6117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:15.577 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10646 sec 2024-03-28T08:46:16.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10647 sec 2024-03-28T08:46:17.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:16 smithi086 ceph-mon[35163]: pgmap v6118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:17.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:16 smithi159 ceph-mon[36109]: pgmap v6118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:16 smithi055 ceph-mon[31863]: pgmap v6118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:17.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10648 sec 2024-03-28T08:46:18.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10649 sec 2024-03-28T08:46:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:18 smithi086 ceph-mon[35163]: pgmap v6119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9977.969497 secs 2024-03-28T08:46:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:18 smithi159 ceph-mon[36109]: pgmap v6119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9977.969497 secs 2024-03-28T08:46:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:18 smithi055 ceph-mon[31863]: pgmap v6119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9977.969497 secs 2024-03-28T08:46:19.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10650 sec 2024-03-28T08:46:20.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10651 sec 2024-03-28T08:46:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:20 smithi086 ceph-mon[35163]: pgmap v6120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:20 smithi159 ceph-mon[36109]: pgmap v6120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:20 smithi055 ceph-mon[31863]: pgmap v6120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:21.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10652 sec 2024-03-28T08:46:22.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10653 sec 2024-03-28T08:46:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:22 smithi086 ceph-mon[35163]: pgmap v6121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:22 smithi159 ceph-mon[36109]: pgmap v6121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:22 smithi055 ceph-mon[31863]: pgmap v6121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:23.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10654 sec 2024-03-28T08:46:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9982.969620 secs 2024-03-28T08:46:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9982.969620 secs 2024-03-28T08:46:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9982.969620 secs 2024-03-28T08:46:24.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10655 sec 2024-03-28T08:46:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:24 smithi086 ceph-mon[35163]: pgmap v6122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:24 smithi159 ceph-mon[36109]: pgmap v6122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:24 smithi055 ceph-mon[31863]: pgmap v6122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:25.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10656 sec 2024-03-28T08:46:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:46:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:46:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:46:26.578 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10657 sec 2024-03-28T08:46:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:26 smithi086 ceph-mon[35163]: pgmap v6123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:26 smithi159 ceph-mon[36109]: pgmap v6123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:26 smithi055 ceph-mon[31863]: pgmap v6123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:27.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10658 sec 2024-03-28T08:46:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:46:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:46:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: pgmap v6124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: pgmap v6125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:46:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9987.969667 secs 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: pgmap v6124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: pgmap v6125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:46:28.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9987.969667 secs 2024-03-28T08:46:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:46:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:46:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: pgmap v6124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: pgmap v6125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:46:28.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9987.969667 secs 2024-03-28T08:46:28.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10659 sec 2024-03-28T08:46:29.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10660 sec 2024-03-28T08:46:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:30 smithi086 ceph-mon[35163]: pgmap v6126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:30 smithi159 ceph-mon[36109]: pgmap v6126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:30 smithi055 ceph-mon[31863]: pgmap v6126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:30.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10661 sec 2024-03-28T08:46:31.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10662 sec 2024-03-28T08:46:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:32 smithi086 ceph-mon[35163]: pgmap v6127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:32 smithi159 ceph-mon[36109]: pgmap v6127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:32 smithi055 ceph-mon[31863]: pgmap v6127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:32.579 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10663 sec 2024-03-28T08:46:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9992.969810 secs 2024-03-28T08:46:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9992.969810 secs 2024-03-28T08:46:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9992.969810 secs 2024-03-28T08:46:33.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10664 sec 2024-03-28T08:46:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:34 smithi086 ceph-mon[35163]: pgmap v6128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:34 smithi159 ceph-mon[36109]: pgmap v6128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:34 smithi055 ceph-mon[31863]: pgmap v6128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:34.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10665 sec 2024-03-28T08:46:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:35 smithi055 ceph-mon[31863]: pgmap v6129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:35 smithi086 ceph-mon[35163]: pgmap v6129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:35 smithi159 ceph-mon[36109]: pgmap v6129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:46:35.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10666 sec 2024-03-28T08:46:36.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10667 sec 2024-03-28T08:46:37.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10668 sec 2024-03-28T08:46:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:38 smithi086 ceph-mon[35163]: pgmap v6130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:46:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 9997.969878 secs 2024-03-28T08:46:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:38 smithi159 ceph-mon[36109]: pgmap v6130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:46:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 9997.969878 secs 2024-03-28T08:46:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:38 smithi055 ceph-mon[31863]: pgmap v6130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:46:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 9997.969878 secs 2024-03-28T08:46:38.580 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10669 sec 2024-03-28T08:46:39.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10670 sec 2024-03-28T08:46:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:40 smithi086 ceph-mon[35163]: pgmap v6131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:40 smithi159 ceph-mon[36109]: pgmap v6131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:40 smithi055 ceph-mon[31863]: pgmap v6131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:40.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10671 sec 2024-03-28T08:46:41.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10672 sec 2024-03-28T08:46:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:42 smithi086 ceph-mon[35163]: pgmap v6132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:42 smithi159 ceph-mon[36109]: pgmap v6132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:42 smithi055 ceph-mon[31863]: pgmap v6132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:42.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10673 sec 2024-03-28T08:46:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10002.969945 secs 2024-03-28T08:46:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10002.969945 secs 2024-03-28T08:46:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10002.969945 secs 2024-03-28T08:46:43.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10674 sec 2024-03-28T08:46:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:44 smithi159 ceph-mon[36109]: pgmap v6133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:44 smithi055 ceph-mon[31863]: pgmap v6133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:44 smithi086 ceph-mon[35163]: pgmap v6133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:44.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10675 sec 2024-03-28T08:46:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:45 smithi055 ceph-mon[31863]: pgmap v6134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:45 smithi086 ceph-mon[35163]: pgmap v6134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:45 smithi159 ceph-mon[36109]: pgmap v6134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:45.581 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10676 sec 2024-03-28T08:46:46.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10677 sec 2024-03-28T08:46:47.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10678 sec 2024-03-28T08:46:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:48 smithi086 ceph-mon[35163]: pgmap v6135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10007.970066 secs 2024-03-28T08:46:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:48 smithi159 ceph-mon[36109]: pgmap v6135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10007.970066 secs 2024-03-28T08:46:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:48 smithi055 ceph-mon[31863]: pgmap v6135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10007.970066 secs 2024-03-28T08:46:48.582 INFO:tasks.workunit.client.0.smithi055.stdout: 1 cleanup 10679 sec 2024-03-28T08:46:48.970 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-03-28T08:46:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:50 smithi086 ceph-mon[35163]: pgmap v6136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:50 smithi159 ceph-mon[36109]: pgmap v6136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:50 smithi055 ceph-mon[31863]: pgmap v6136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:52 smithi086 ceph-mon[35163]: pgmap v6137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:52 smithi159 ceph-mon[36109]: pgmap v6137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:52 smithi055 ceph-mon[31863]: pgmap v6137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10012.970187 secs 2024-03-28T08:46:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10012.970187 secs 2024-03-28T08:46:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10012.970187 secs 2024-03-28T08:46:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:54 smithi086 ceph-mon[35163]: pgmap v6138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:54 smithi159 ceph-mon[36109]: pgmap v6138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:54 smithi055 ceph-mon[31863]: pgmap v6138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:55 smithi159 ceph-mon[36109]: pgmap v6139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:55 smithi055 ceph-mon[31863]: pgmap v6139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:55 smithi086 ceph-mon[35163]: pgmap v6139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:46:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:58 smithi086 ceph-mon[35163]: pgmap v6140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:46:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10017.970306 secs 2024-03-28T08:46:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:58 smithi159 ceph-mon[36109]: pgmap v6140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:46:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10017.970306 secs 2024-03-28T08:46:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:58 smithi055 ceph-mon[31863]: pgmap v6140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:46:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:46:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10017.970306 secs 2024-03-28T08:47:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:00 smithi086 ceph-mon[35163]: pgmap v6141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:00 smithi159 ceph-mon[36109]: pgmap v6141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:00 smithi055 ceph-mon[31863]: pgmap v6141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:02 smithi086 ceph-mon[35163]: pgmap v6142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:02 smithi159 ceph-mon[36109]: pgmap v6142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:02 smithi055 ceph-mon[31863]: pgmap v6142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10022.970430 secs 2024-03-28T08:47:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10022.970430 secs 2024-03-28T08:47:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10022.970430 secs 2024-03-28T08:47:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:04 smithi086 ceph-mon[35163]: pgmap v6143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:04 smithi159 ceph-mon[36109]: pgmap v6143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:04 smithi055 ceph-mon[31863]: pgmap v6143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:05 smithi055 ceph-mon[31863]: pgmap v6144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:05 smithi086 ceph-mon[35163]: pgmap v6144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:05 smithi159 ceph-mon[36109]: pgmap v6144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:08 smithi086 ceph-mon[35163]: pgmap v6145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10027.970591 secs 2024-03-28T08:47:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:08 smithi159 ceph-mon[36109]: pgmap v6145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10027.970591 secs 2024-03-28T08:47:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:08 smithi055 ceph-mon[31863]: pgmap v6145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10027.970591 secs 2024-03-28T08:47:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:10 smithi086 ceph-mon[35163]: pgmap v6146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:10 smithi159 ceph-mon[36109]: pgmap v6146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:10 smithi055 ceph-mon[31863]: pgmap v6146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:12 smithi086 ceph-mon[35163]: pgmap v6147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:12 smithi159 ceph-mon[36109]: pgmap v6147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:12 smithi055 ceph-mon[31863]: pgmap v6147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10032.970711 secs 2024-03-28T08:47:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10032.970711 secs 2024-03-28T08:47:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10032.970711 secs 2024-03-28T08:47:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:14 smithi086 ceph-mon[35163]: pgmap v6148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:14 smithi159 ceph-mon[36109]: pgmap v6148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:14 smithi055 ceph-mon[31863]: pgmap v6148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:15 smithi055 ceph-mon[31863]: pgmap v6149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:15 smithi086 ceph-mon[35163]: pgmap v6149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:15 smithi159 ceph-mon[36109]: pgmap v6149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:18 smithi086 ceph-mon[35163]: pgmap v6150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10037.970794 secs 2024-03-28T08:47:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:18 smithi159 ceph-mon[36109]: pgmap v6150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10037.970794 secs 2024-03-28T08:47:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:18 smithi055 ceph-mon[31863]: pgmap v6150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10037.970794 secs 2024-03-28T08:47:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:20 smithi086 ceph-mon[35163]: pgmap v6151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:20 smithi159 ceph-mon[36109]: pgmap v6151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:20 smithi055 ceph-mon[31863]: pgmap v6151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:22 smithi086 ceph-mon[35163]: pgmap v6152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:22 smithi159 ceph-mon[36109]: pgmap v6152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:22 smithi055 ceph-mon[31863]: pgmap v6152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10042.970922 secs 2024-03-28T08:47:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10042.970922 secs 2024-03-28T08:47:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10042.970922 secs 2024-03-28T08:47:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:24 smithi055 ceph-mon[31863]: pgmap v6153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:24 smithi086 ceph-mon[35163]: pgmap v6153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:24 smithi159 ceph-mon[36109]: pgmap v6153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:25 smithi055 ceph-mon[31863]: pgmap v6154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:25 smithi086 ceph-mon[35163]: pgmap v6154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:25 smithi159 ceph-mon[36109]: pgmap v6154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:28 smithi086 ceph-mon[35163]: pgmap v6155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:47:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10047.970992 secs 2024-03-28T08:47:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:28 smithi159 ceph-mon[36109]: pgmap v6155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:47:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10047.970992 secs 2024-03-28T08:47:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:28 smithi055 ceph-mon[31863]: pgmap v6155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:47:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10047.970992 secs 2024-03-28T08:47:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:47:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:47:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:47:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:47:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:47:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:47:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:47:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:47:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:47:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:30 smithi055 ceph-mon[31863]: pgmap v6156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:30 smithi055 ceph-mon[31863]: pgmap v6157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:30 smithi086 ceph-mon[35163]: pgmap v6156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:30 smithi086 ceph-mon[35163]: pgmap v6157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:30 smithi159 ceph-mon[36109]: pgmap v6156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:30 smithi159 ceph-mon[36109]: pgmap v6157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:31 smithi055 ceph-mon[31863]: pgmap v6158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:31 smithi086 ceph-mon[35163]: pgmap v6158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:31 smithi159 ceph-mon[36109]: pgmap v6158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10052.971076 secs 2024-03-28T08:47:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:33 smithi055 ceph-mon[31863]: pgmap v6159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10052.971076 secs 2024-03-28T08:47:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:33 smithi086 ceph-mon[35163]: pgmap v6159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10052.971076 secs 2024-03-28T08:47:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:33 smithi159 ceph-mon[36109]: pgmap v6159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:35 smithi055 ceph-mon[31863]: pgmap v6160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:35 smithi086 ceph-mon[35163]: pgmap v6160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:35 smithi159 ceph-mon[36109]: pgmap v6160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:37 smithi055 ceph-mon[31863]: pgmap v6161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:37 smithi086 ceph-mon[35163]: pgmap v6161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:37 smithi159 ceph-mon[36109]: pgmap v6161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:47:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10057.971141 secs 2024-03-28T08:47:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10057.971141 secs 2024-03-28T08:47:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10057.971141 secs 2024-03-28T08:47:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:39 smithi086 ceph-mon[35163]: pgmap v6162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:47:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:39 smithi159 ceph-mon[36109]: pgmap v6162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:47:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:39 smithi055 ceph-mon[31863]: pgmap v6162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:47:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:41 smithi086 ceph-mon[35163]: pgmap v6163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:41 smithi159 ceph-mon[36109]: pgmap v6163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:41 smithi055 ceph-mon[31863]: pgmap v6163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10062.971260 secs 2024-03-28T08:47:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:43 smithi086 ceph-mon[35163]: pgmap v6164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10062.971260 secs 2024-03-28T08:47:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:43 smithi159 ceph-mon[36109]: pgmap v6164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10062.971260 secs 2024-03-28T08:47:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:43 smithi055 ceph-mon[31863]: pgmap v6164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:45 smithi086 ceph-mon[35163]: pgmap v6165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:45 smithi159 ceph-mon[36109]: pgmap v6165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:45 smithi055 ceph-mon[31863]: pgmap v6165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:47 smithi086 ceph-mon[35163]: pgmap v6166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:47 smithi159 ceph-mon[36109]: pgmap v6166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:47 smithi055 ceph-mon[31863]: pgmap v6166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:48.971 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-03-28T08:47:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10067.971392 secs 2024-03-28T08:47:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10067.971392 secs 2024-03-28T08:47:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10067.971392 secs 2024-03-28T08:47:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:49 smithi086 ceph-mon[35163]: pgmap v6167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:49 smithi159 ceph-mon[36109]: pgmap v6167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:50.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:49 smithi055 ceph-mon[31863]: pgmap v6167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:51 smithi086 ceph-mon[35163]: pgmap v6168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:51 smithi159 ceph-mon[36109]: pgmap v6168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:51 smithi055 ceph-mon[31863]: pgmap v6168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10072.971514 secs 2024-03-28T08:47:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10072.971514 secs 2024-03-28T08:47:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10072.971514 secs 2024-03-28T08:47:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:53 smithi086 ceph-mon[35163]: pgmap v6169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:53 smithi159 ceph-mon[36109]: pgmap v6169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:53 smithi055 ceph-mon[31863]: pgmap v6169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:55 smithi086 ceph-mon[35163]: pgmap v6170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:55 smithi159 ceph-mon[36109]: pgmap v6170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:55 smithi055 ceph-mon[31863]: pgmap v6170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:47:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:57 smithi086 ceph-mon[35163]: pgmap v6171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10077.971589 secs 2024-03-28T08:47:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:57 smithi159 ceph-mon[36109]: pgmap v6171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10077.971589 secs 2024-03-28T08:47:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:57 smithi055 ceph-mon[31863]: pgmap v6171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:47:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10077.971589 secs 2024-03-28T08:48:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:47:59 smithi086 ceph-mon[35163]: pgmap v6172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:47:59 smithi159 ceph-mon[36109]: pgmap v6172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:47:59 smithi055 ceph-mon[31863]: pgmap v6172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:01 smithi086 ceph-mon[35163]: pgmap v6173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:01 smithi159 ceph-mon[36109]: pgmap v6173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:01 smithi055 ceph-mon[31863]: pgmap v6173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10082.971650 secs 2024-03-28T08:48:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10082.971650 secs 2024-03-28T08:48:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10082.971650 secs 2024-03-28T08:48:04.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:04 smithi055 ceph-mon[31863]: pgmap v6174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:04 smithi086 ceph-mon[35163]: pgmap v6174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:04 smithi159 ceph-mon[36109]: pgmap v6174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:06 smithi086 ceph-mon[35163]: pgmap v6175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:06 smithi159 ceph-mon[36109]: pgmap v6175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:06 smithi055 ceph-mon[31863]: pgmap v6175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:08 smithi086 ceph-mon[35163]: pgmap v6176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10087.971807 secs 2024-03-28T08:48:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:08 smithi159 ceph-mon[36109]: pgmap v6176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10087.971807 secs 2024-03-28T08:48:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:08 smithi055 ceph-mon[31863]: pgmap v6176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10087.971807 secs 2024-03-28T08:48:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:10 smithi086 ceph-mon[35163]: pgmap v6177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:10 smithi159 ceph-mon[36109]: pgmap v6177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:10 smithi055 ceph-mon[31863]: pgmap v6177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:12 smithi086 ceph-mon[35163]: pgmap v6178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:12 smithi159 ceph-mon[36109]: pgmap v6178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:12 smithi055 ceph-mon[31863]: pgmap v6178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10092.971871 secs 2024-03-28T08:48:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10092.971871 secs 2024-03-28T08:48:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10092.971871 secs 2024-03-28T08:48:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:14 smithi086 ceph-mon[35163]: pgmap v6179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:14 smithi159 ceph-mon[36109]: pgmap v6179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:14 smithi055 ceph-mon[31863]: pgmap v6179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:16 smithi086 ceph-mon[35163]: pgmap v6180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:48:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:16 smithi159 ceph-mon[36109]: pgmap v6180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:48:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:16 smithi055 ceph-mon[31863]: pgmap v6180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:48:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:18 smithi086 ceph-mon[35163]: pgmap v6181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10097.971957 secs 2024-03-28T08:48:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:18 smithi159 ceph-mon[36109]: pgmap v6181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10097.971957 secs 2024-03-28T08:48:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:18 smithi055 ceph-mon[31863]: pgmap v6181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10097.971957 secs 2024-03-28T08:48:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:20 smithi055 ceph-mon[31863]: pgmap v6182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:20 smithi086 ceph-mon[35163]: pgmap v6182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:20 smithi159 ceph-mon[36109]: pgmap v6182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:22 smithi055 ceph-mon[31863]: pgmap v6183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:22 smithi086 ceph-mon[35163]: pgmap v6183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:22 smithi159 ceph-mon[36109]: pgmap v6183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10102.972045 secs 2024-03-28T08:48:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:23 smithi055 ceph-mon[31863]: pgmap v6184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:23.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10102.972045 secs 2024-03-28T08:48:23.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:23 smithi159 ceph-mon[36109]: pgmap v6184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10102.972045 secs 2024-03-28T08:48:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:23 smithi086 ceph-mon[35163]: pgmap v6184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:25 smithi086 ceph-mon[35163]: pgmap v6185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:25 smithi159 ceph-mon[36109]: pgmap v6185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:25 smithi055 ceph-mon[31863]: pgmap v6185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:27 smithi086 ceph-mon[35163]: pgmap v6186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:27 smithi159 ceph-mon[36109]: pgmap v6186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:27 smithi055 ceph-mon[31863]: pgmap v6186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10107.972185 secs 2024-03-28T08:48:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10107.972185 secs 2024-03-28T08:48:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10107.972185 secs 2024-03-28T08:48:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:29 smithi086 ceph-mon[35163]: pgmap v6187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:48:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:29 smithi159 ceph-mon[36109]: pgmap v6187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:48:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:29 smithi055 ceph-mon[31863]: pgmap v6187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:48:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:48:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:48:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:48:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:48:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:48:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:48:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:48:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:48:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:48:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:31 smithi086 ceph-mon[35163]: pgmap v6188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:31 smithi086 ceph-mon[35163]: pgmap v6189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:31 smithi159 ceph-mon[36109]: pgmap v6188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:31 smithi159 ceph-mon[36109]: pgmap v6189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:31 smithi055 ceph-mon[31863]: pgmap v6188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:31 smithi055 ceph-mon[31863]: pgmap v6189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:34.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10112.972250 secs 2024-03-28T08:48:34.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:33 smithi055 ceph-mon[31863]: pgmap v6190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:48:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10112.972250 secs 2024-03-28T08:48:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:33 smithi086 ceph-mon[35163]: pgmap v6190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:48:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10112.972250 secs 2024-03-28T08:48:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:33 smithi159 ceph-mon[36109]: pgmap v6190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:48:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:35 smithi086 ceph-mon[35163]: pgmap v6191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:35 smithi159 ceph-mon[36109]: pgmap v6191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:35 smithi055 ceph-mon[31863]: pgmap v6191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:37 smithi086 ceph-mon[35163]: pgmap v6192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10117.972314 secs 2024-03-28T08:48:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:37 smithi159 ceph-mon[36109]: pgmap v6192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10117.972314 secs 2024-03-28T08:48:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:37 smithi055 ceph-mon[31863]: pgmap v6192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10117.972314 secs 2024-03-28T08:48:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:39 smithi086 ceph-mon[35163]: pgmap v6193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:39 smithi159 ceph-mon[36109]: pgmap v6193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:39 smithi055 ceph-mon[31863]: pgmap v6193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:48:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:41 smithi086 ceph-mon[35163]: pgmap v6194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:41 smithi159 ceph-mon[36109]: pgmap v6194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:41 smithi055 ceph-mon[31863]: pgmap v6194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10122.972417 secs 2024-03-28T08:48:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10122.972417 secs 2024-03-28T08:48:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10122.972417 secs 2024-03-28T08:48:44.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:43 smithi086 ceph-mon[35163]: pgmap v6195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:43 smithi159 ceph-mon[36109]: pgmap v6195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:43 smithi055 ceph-mon[31863]: pgmap v6195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:45 smithi086 ceph-mon[35163]: pgmap v6196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:45 smithi159 ceph-mon[36109]: pgmap v6196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:45 smithi055 ceph-mon[31863]: pgmap v6196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:47 smithi086 ceph-mon[35163]: pgmap v6197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10127.972481 secs 2024-03-28T08:48:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:47 smithi159 ceph-mon[36109]: pgmap v6197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10127.972481 secs 2024-03-28T08:48:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:47 smithi055 ceph-mon[31863]: pgmap v6197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10127.972481 secs 2024-03-28T08:48:48.972 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-03-28T08:48:48.973 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-03-28T08:48:48.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-28T08:48:50.047 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi055 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-03-28T08:48:50.275 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ede4755989c34f12a8e4d39b15dc2413 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi055 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-03-28T08:48:50.278 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-28T08:48:50.288 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-28T08:48:50.288 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: 2024-03-28T08:48:50.294 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-28T08:48:50.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T08:48:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:49 smithi086 ceph-mon[35163]: pgmap v6198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:49 smithi159 ceph-mon[36109]: pgmap v6198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:49 smithi055 ceph-mon[31863]: pgmap v6198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:48:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 -- 172.21.15.55:0/2884398569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 msgr2=0x7fb548109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 --2- 172.21.15.55:0/2884398569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb548109af0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb540009ca0 tx=0x7fb54002c100 comp rx=0 tx=0).stop 2024-03-28T08:48:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 -- 172.21.15.55:0/2884398569 shutdown_connections 2024-03-28T08:48:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 --2- 172.21.15.55:0/2884398569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb548109af0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 --2- 172.21.15.55:0/2884398569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 0x7fb548102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 --2- 172.21.15.55:0/2884398569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb548101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 -- 172.21.15.55:0/2884398569 >> 172.21.15.55:0/2884398569 conn(0x7fb5480fcc80 msgr2=0x7fb5480ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:50.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 -- 172.21.15.55:0/2884398569 shutdown_connections 2024-03-28T08:48:50.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.541+0000 7fb54fe00640 1 -- 172.21.15.55:0/2884398569 wait complete. 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.542+0000 7fb54fe00640 1 Processor -- start 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.542+0000 7fb54fe00640 1 -- start start 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb5481978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 0x7fb548197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54810d1e0 con 0x7fb548103260 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54810d060 con 0x7fb5481016b0 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54fe00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54810d360 con 0x7fb5481028a0 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59552/0 (socket says 172.21.15.55:59552) 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54de00640 1 -- 172.21.15.55:0/1195991920 learned_addr learned my addr 172.21.15.55:0/1195991920 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54d400640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb5481978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.543+0000 7fb54ca00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 0x7fb548197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 -- 172.21.15.55:0/1195991920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 msgr2=0x7fb548197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 0x7fb548197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 -- 172.21.15.55:0/1195991920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 msgr2=0x7fb5481978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb5481978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 -- 172.21.15.55:0/1195991920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54819f500 con 0x7fb548103260 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54d400640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb5481978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54de00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb540032520 tx=0x7fb540034880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540039040 con 0x7fb548103260 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fb540044070 con 0x7fb548103260 2024-03-28T08:48:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400043c0 con 0x7fb548103260 2024-03-28T08:48:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54819f790 con 0x7fb548103260 2024-03-28T08:48:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.544+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54819fc30 con 0x7fb548103260 2024-03-28T08:48:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.546+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5481089f0 con 0x7fb548103260 2024-03-28T08:48:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.547+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fb540004560 con 0x7fb548103260 2024-03-28T08:48:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.549+0000 7fb546000640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 0x7fb5300a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.549+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7fb5400f20a0 con 0x7fb548103260 2024-03-28T08:48:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.549+0000 7fb54d400640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 0x7fb5300a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.550+0000 7fb54d400640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 0x7fb5300a4d40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0058c0 tx=0x7fb53c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:50.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.553+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fb5400333a0 con 0x7fb548103260 2024-03-28T08:48:50.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.761+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb548062340 con 0x7fb548103260 2024-03-28T08:48:50.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.766+0000 7fb546000640 1 -- 172.21.15.55:0/1195991920 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+28505 (secure 0 0 0) 0x7fb5400be1c0 con 0x7fb548103260 2024-03-28T08:48:50.767 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T08:48:50.767 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":137,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:59:55.505273+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6835/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6834/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6835/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6834/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6837/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.55:6834/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.55:6836/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.55:6835/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6837/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6836/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6839/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.55:6838/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.159:6833/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.159:6838/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.86:6836/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.55:6835/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.159:6839/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6837/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:6838/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.159:6832/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.86:6837/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6838/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6836/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.159:6838/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.55:6834/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6836/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.159:6838/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.86:6836/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6832/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6832/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.86:6837/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6837/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.159:6834/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.86:6837/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.159:6833/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6839/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.55:6841/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.86:6837/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6834/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.86:6836/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6841/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.159:6834/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.55:6837/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.159:6835/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.86:6836/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6839/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.55:6839/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.86:6836/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.159:6832/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.159:6838/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.159:6834/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.159:6835/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.159:6833/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.55:6837/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.159:6835/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.159:6834/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6836/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.86:6837/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6835/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6839/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6838/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.159:6832/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6833/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6834/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.55:6840/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.159:6839/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.159:6832/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.159:6833/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6841/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.55:6838/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6841/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.55:6839/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6834/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6840/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.159:6833/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.55:6839/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.55:6840/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.159:6839/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:6836/1204847109":"2024-03-29T05:56:41.647274+0000","172.21.15.55:6841/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6838/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.55:6838/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6839/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.55:6836/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.55:6837/1204847109":"2024-03-29T05:56:41.647274+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T08:48:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.768+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 msgr2=0x7fb5300a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.768+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 0x7fb5300a4d40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0058c0 tx=0x7fb53c005850 comp rx=0 tx=0).stop 2024-03-28T08:48:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.768+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 msgr2=0x7fb54819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:50.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.768+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb540032520 tx=0x7fb540034880 comp rx=0 tx=0).stop 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 shutdown_connections 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fb5300a2880 0x7fb5300a4d40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb548103260 0x7fb54819ee90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5481028a0 0x7fb548197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 --2- 172.21.15.55:0/1195991920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5481016b0 0x7fb5481978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 >> 172.21.15.55:0/1195991920 conn(0x7fb5480fcc80 msgr2=0x7fb548105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 shutdown_connections 2024-03-28T08:48:50.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:50.769+0000 7fb54fe00640 1 -- 172.21.15.55:0/1195991920 wait complete. 2024-03-28T08:48:50.789 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T08:48:50.790 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T08:48:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 -- 172.21.15.55:0/3015114701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c104930 msgr2=0x7f017c106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 --2- 172.21.15.55:0/3015114701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c104930 0x7f017c106d20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0168009900 tx=0x7f016802bc30 comp rx=0 tx=0).stop 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 -- 172.21.15.55:0/3015114701 shutdown_connections 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 --2- 172.21.15.55:0/3015114701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c107260 0x7f017c1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 --2- 172.21.15.55:0/3015114701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c104930 0x7f017c106d20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 --2- 172.21.15.55:0/3015114701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f017c102000 0x7f017c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 -- 172.21.15.55:0/3015114701 >> 172.21.15.55:0/3015114701 conn(0x7f017c0fba10 msgr2=0x7f017c0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 -- 172.21.15.55:0/3015114701 shutdown_connections 2024-03-28T08:48:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.016+0000 7f0182e00640 1 -- 172.21.15.55:0/3015114701 wait complete. 2024-03-28T08:48:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.017+0000 7f0182e00640 1 Processor -- start 2024-03-28T08:48:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.017+0000 7f0182e00640 1 -- start start 2024-03-28T08:48:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c104930 0x7f017c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f017c107260 0x7f017c1a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c10d150 con 0x7f017c102000 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c10cfd0 con 0x7f017c104930 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0182e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c10d2d0 con 0x7f017c107260 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59572/0 (socket says 172.21.15.55:59572) 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 -- 172.21.15.55:0/3849209251 learned_addr learned my addr 172.21.15.55:0/3849209251 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181000640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c104930 0x7f017c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 -- 172.21.15.55:0/3849209251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f017c107260 msgr2=0x7f017c1a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f017c107260 0x7f017c1a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 -- 172.21.15.55:0/3849209251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c104930 msgr2=0x7f017c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c104930 0x7f017c199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.018+0000 7f0181a00640 1 -- 172.21.15.55:0/3849209251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c1a1670 con 0x7f017c102000 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f0181a00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f017000b4a0 tx=0x7f017000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170014070 con 0x7f017c102000 2024-03-28T08:48:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0170010ac0 con 0x7f017c102000 2024-03-28T08:48:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c1a1960 con 0x7f017c102000 2024-03-28T08:48:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170017c30 con 0x7f017c102000 2024-03-28T08:48:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.019+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c1a1f30 con 0x7f017c102000 2024-03-28T08:48:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.020+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c108d90 con 0x7f017c102000 2024-03-28T08:48:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.022+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f0170017070 con 0x7f017c102000 2024-03-28T08:48:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.023+0000 7f017a000640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 0x7f01640a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.023+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f01700cf180 con 0x7f017c102000 2024-03-28T08:48:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.024+0000 7f0181000640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 0x7f01640a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.024+0000 7f0181000640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 0x7f01640a4cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0168036040 tx=0x7f0168005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.028+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f017009b2a0 con 0x7f017c102000 2024-03-28T08:48:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:51 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1195991920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:48:51.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.222+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f017c0622a0 con 0x7f017c102000 2024-03-28T08:48:51.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.223+0000 7f017a000640 1 -- 172.21.15.55:0/3849209251 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f017009aba0 con 0x7f017c102000 2024-03-28T08:48:51.224 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 msgr2=0x7f01640a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 0x7f01640a4cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0168036040 tx=0x7f0168005fd0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 msgr2=0x7f017c199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f017000b4a0 tx=0x7f017000b960 comp rx=0 tx=0).stop 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 shutdown_connections 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f01640a2800 0x7f01640a4cc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f017c107260 0x7f017c1a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f017c104930 0x7f017c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 --2- 172.21.15.55:0/3849209251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f017c102000 0x7f017c199a50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 >> 172.21.15.55:0/3849209251 conn(0x7f017c0fba10 msgr2=0x7f017c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:51.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 shutdown_connections 2024-03-28T08:48:51.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.226+0000 7f0182e00640 1 -- 172.21.15.55:0/3849209251 wait complete. 2024-03-28T08:48:51.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T08:48:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:51 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1195991920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:48:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:51 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1195991920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:48:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.466+0000 7f0332e00640 1 -- 172.21.15.55:0/2850048939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c104990 msgr2=0x7f032c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.466+0000 7f0332e00640 1 --2- 172.21.15.55:0/2850048939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c104990 0x7f032c104e10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0318009900 tx=0x7f031802bc30 comp rx=0 tx=0).stop 2024-03-28T08:48:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 -- 172.21.15.55:0/2850048939 shutdown_connections 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 --2- 172.21.15.55:0/2850048939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c105350 0x7f032c10bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 --2- 172.21.15.55:0/2850048939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c104990 0x7f032c104e10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 --2- 172.21.15.55:0/2850048939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 0x7f032c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 -- 172.21.15.55:0/2850048939 >> 172.21.15.55:0/2850048939 conn(0x7f032c0fed10 msgr2=0x7f032c101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 -- 172.21.15.55:0/2850048939 shutdown_connections 2024-03-28T08:48:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.467+0000 7f0332e00640 1 -- 172.21.15.55:0/2850048939 wait complete. 2024-03-28T08:48:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 Processor -- start 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 -- start start 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 0x7f032c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c104990 0x7f032c199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c10f2b0 con 0x7f032c105350 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c10f130 con 0x7f032c1037a0 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c10f430 con 0x7f032c104990 2024-03-28T08:48:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.468+0000 7f0332400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59596/0 (socket says 172.21.15.55:59596) 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 -- 172.21.15.55:0/2724414538 learned_addr learned my addr 172.21.15.55:0/2724414538 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0331a00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 0x7f032c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0331000640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c104990 0x7f032c199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 -- 172.21.15.55:0/2724414538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c104990 msgr2=0x7f032c199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c104990 0x7f032c199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 -- 172.21.15.55:0/2724414538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 msgr2=0x7f032c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 0x7f032c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 -- 172.21.15.55:0/2724414538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c1a1620 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.469+0000 7f0332400640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f032400d950 tx=0x7f032400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.470+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324017030 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.470+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f0324004020 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.470+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c1a1910 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.470+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324003b20 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.470+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c1a1e60 con 0x7f032c105350 2024-03-28T08:48:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.471+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c10ab80 con 0x7f032c105350 2024-03-28T08:48:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.474+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f032401a070 con 0x7f032c105350 2024-03-28T08:48:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.476+0000 7f032a000640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 0x7f03140a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.476+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f03240cf510 con 0x7f032c105350 2024-03-28T08:48:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.476+0000 7f0331a00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 0x7f03140a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.477+0000 7f0331a00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 0x7f03140a4d40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f032c1047f0 tx=0x7f0320009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.479+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f0324021070 con 0x7f032c105350 2024-03-28T08:48:51.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.681+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f032c02d200 con 0x7f032c105350 2024-03-28T08:48:51.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.682+0000 7f032a000640 1 -- 172.21.15.55:0/2724414538 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f032409b6b0 con 0x7f032c105350 2024-03-28T08:48:51.682 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T08:48:51.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.684+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 msgr2=0x7f03140a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.684+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 0x7f03140a4d40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f032c1047f0 tx=0x7f0320009500 comp rx=0 tx=0).stop 2024-03-28T08:48:51.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.684+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 msgr2=0x7f032c1a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.684+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f032400d950 tx=0x7f032400de10 comp rx=0 tx=0).stop 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 shutdown_connections 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f03140a2880 0x7f03140a4d40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032c105350 0x7f032c1a0fb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032c104990 0x7f032c199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 --2- 172.21.15.55:0/2724414538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f032c1037a0 0x7f032c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 >> 172.21.15.55:0/2724414538 conn(0x7f032c0fed10 msgr2=0x7f032c107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 shutdown_connections 2024-03-28T08:48:51.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.685+0000 7f0332e00640 1 -- 172.21.15.55:0/2724414538 wait complete. 2024-03-28T08:48:51.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T08:48:51.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 -- 172.21.15.55:0/45458650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa108105490 msgr2=0x7fa10810bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 --2- 172.21.15.55:0/45458650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa108105490 0x7fa10810bd20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa100009be0 tx=0x7fa10002bef0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 -- 172.21.15.55:0/45458650 shutdown_connections 2024-03-28T08:48:51.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 --2- 172.21.15.55:0/45458650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa108105490 0x7fa10810bd20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 --2- 172.21.15.55:0/45458650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 0x7fa108104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 --2- 172.21.15.55:0/45458650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1081038e0 0x7fa108103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 -- 172.21.15.55:0/45458650 >> 172.21.15.55:0/45458650 conn(0x7fa1080fee50 msgr2=0x7fa108101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.924+0000 7fa10ce00640 1 -- 172.21.15.55:0/45458650 shutdown_connections 2024-03-28T08:48:51.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.925+0000 7fa10ce00640 1 -- 172.21.15.55:0/45458650 wait complete. 2024-03-28T08:48:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.925+0000 7fa10ce00640 1 Processor -- start 2024-03-28T08:48:51.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 -- start start 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1081038e0 0x7fa108199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 0x7fa10819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10810f460 con 0x7fa108105490 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10810f2e0 con 0x7fa1081038e0 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa10ce00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10810f5e0 con 0x7fa108104ad0 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa106800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa106800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59618/0 (socket says 172.21.15.55:59618) 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.926+0000 7fa106800640 1 -- 172.21.15.55:0/2890876604 learned_addr learned my addr 172.21.15.55:0/2890876604 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa105e00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1081038e0 0x7fa108199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa0fd400640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 0x7fa10819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 -- 172.21.15.55:0/2890876604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 msgr2=0x7fa10819a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 0x7fa10819a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 -- 172.21.15.55:0/2890876604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1081038e0 msgr2=0x7fa108199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1081038e0 0x7fa108199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 -- 172.21.15.55:0/2890876604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1081a16f0 con 0x7fa108105490 2024-03-28T08:48:51.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.927+0000 7fa106800640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa100034fd0 tx=0x7fa100033c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.928+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100043020 con 0x7fa108105490 2024-03-28T08:48:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.928+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fa100003e20 con 0x7fa108105490 2024-03-28T08:48:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.928+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100034430 con 0x7fa108105490 2024-03-28T08:48:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.928+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1081a1980 con 0x7fa108105490 2024-03-28T08:48:51.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.928+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1081a1f20 con 0x7fa108105490 2024-03-28T08:48:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.929+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10810ad20 con 0x7fa108105490 2024-03-28T08:48:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.931+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fa100046020 con 0x7fa108105490 2024-03-28T08:48:51.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.932+0000 7fa0ff400640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 0x7fa0ec0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.932+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7fa1000f2090 con 0x7fa108105490 2024-03-28T08:48:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.933+0000 7fa105e00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 0x7fa0ec0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:51.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.933+0000 7fa105e00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 0x7fa0ec0a4d40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa108104930 tx=0x7fa0f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:51.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:51.937+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fa10004d020 con 0x7fa108105490 2024-03-28T08:48:52.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.139+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1080622a0 con 0x7fa108105490 2024-03-28T08:48:52.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.140+0000 7fa0ff400640 1 -- 172.21.15.55:0/2890876604 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa10003d3b0 con 0x7fa108105490 2024-03-28T08:48:52.141 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T08:48:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 msgr2=0x7fa0ec0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 0x7fa0ec0a4d40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa108104930 tx=0x7fa0f8009260 comp rx=0 tx=0).stop 2024-03-28T08:48:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 msgr2=0x7fa1081a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa100034fd0 tx=0x7fa100033c40 comp rx=0 tx=0).stop 2024-03-28T08:48:52.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 shutdown_connections 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fa0ec0a2880 0x7fa0ec0a4d40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa108105490 0x7fa1081a1080 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa108104ad0 0x7fa10819a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 --2- 172.21.15.55:0/2890876604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1081038e0 0x7fa108199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.143+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 >> 172.21.15.55:0/2890876604 conn(0x7fa1080fee50 msgr2=0x7fa108107ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.144+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 shutdown_connections 2024-03-28T08:48:52.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.144+0000 7fa10ce00640 1 -- 172.21.15.55:0/2890876604 wait complete. 2024-03-28T08:48:52.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-28T08:48:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:52 smithi086 ceph-mon[35163]: pgmap v6199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:52 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3849209251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:52 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2724414538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:52 smithi159 ceph-mon[36109]: pgmap v6199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:52 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3849209251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:52 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2724414538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:52 smithi055 ceph-mon[31863]: pgmap v6199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:48:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:52 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3849209251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:52 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2724414538' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:48:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 -- 172.21.15.55:0/1547168103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 msgr2=0x7fcaac1023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 --2- 172.21.15.55:0/1547168103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac1023e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009900 tx=0x7fca9c02bc30 comp rx=0 tx=0).stop 2024-03-28T08:48:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 -- 172.21.15.55:0/1547168103 shutdown_connections 2024-03-28T08:48:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 --2- 172.21.15.55:0/1547168103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac1052d0 0x7fcaac105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 --2- 172.21.15.55:0/1547168103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 0x7fcaac104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 --2- 172.21.15.55:0/1547168103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac1023e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 -- 172.21.15.55:0/1547168103 >> 172.21.15.55:0/1547168103 conn(0x7fcaac0fbbd0 msgr2=0x7fcaac0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 -- 172.21.15.55:0/1547168103 shutdown_connections 2024-03-28T08:48:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.388+0000 7fcab1a00640 1 -- 172.21.15.55:0/1547168103 wait complete. 2024-03-28T08:48:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 Processor -- start 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 -- start start 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 0x7fcaac19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac1052d0 0x7fcaac1a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac1137f0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac113670 con 0x7fcaac102920 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.389+0000 7fcab1a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac113970 con 0x7fcaac1052d0 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59628/0 (socket says 172.21.15.55:59628) 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 -- 172.21.15.55:0/3581908449 learned_addr learned my addr 172.21.15.55:0/3581908449 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaa3e00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 0x7fcaac19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 -- 172.21.15.55:0/3581908449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac1052d0 msgr2=0x7fcaac1a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac1052d0 0x7fcaac1a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 -- 172.21.15.55:0/3581908449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 msgr2=0x7fcaac19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 0x7fcaac19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 -- 172.21.15.55:0/3581908449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac1a5b10 con 0x7fcaac0fffb0 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.390+0000 7fcaaaa00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.391+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c043020 con 0x7fcaac0fffb0 2024-03-28T08:48:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.391+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fca9c004aa0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.391+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c003c60 con 0x7fcaac0fffb0 2024-03-28T08:48:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.391+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac1a5da0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.391+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac1a6260 con 0x7fcaac0fffb0 2024-03-28T08:48:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.392+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0fd6c0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.394+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fca9c046020 con 0x7fcaac0fffb0 2024-03-28T08:48:52.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.395+0000 7fcaa3400640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 0x7fca900a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:52.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.396+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7fca9c0f1e90 con 0x7fcaac0fffb0 2024-03-28T08:48:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.396+0000 7fcaa3e00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 0x7fca900a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.396+0000 7fcaa3e00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 0x7fca900a4cc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca94005d00 tx=0x7fca94005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.399+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fca9c04d020 con 0x7fcaac0fffb0 2024-03-28T08:48:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.656+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fcaac0623a0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.686+0000 7fcaa3400640 1 -- 172.21.15.55:0/3581908449 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+739831 (secure 0 0 0) 0x7fca9c0bdfb0 con 0x7fcaac0fffb0 2024-03-28T08:48:52.704 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T08:48:52.704 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-03-28T08:48:52.704 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 18, 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: "active_gid": 14152, 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: "active_name": "x", 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: "active_addrs": { 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: "addrvec": [ 2024-03-28T08:48:52.705 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.706 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v2", 2024-03-28T08:48:52.706 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:6800", 2024-03-28T08:48:52.706 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3012677107 2024-03-28T08:48:52.706 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.706 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:6801", 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3012677107 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:52.707 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.708 INFO:teuthology.orchestra.run.smithi055.stdout: "active_addr": "172.21.15.55:6801/3012677107", 2024-03-28T08:48:52.708 INFO:teuthology.orchestra.run.smithi055.stdout: "active_change": "2024-03-28T05:33:17.649494+0000", 2024-03-28T08:48:52.708 INFO:teuthology.orchestra.run.smithi055.stdout: "active_mgr_features": 4540701547738038271, 2024-03-28T08:48:52.708 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-03-28T08:48:52.708 INFO:teuthology.orchestra.run.smithi055.stdout: "standbys": [ 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 24112, 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "z", 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr_features": 4540701547738038271, 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: "available_modules": [ 2024-03-28T08:48:52.709 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.710 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "alerts", 2024-03-28T08:48:52.710 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:52.710 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:52.710 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:52.710 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:52.711 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How frequently to reexamine health status", 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.712 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.713 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.714 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.714 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.714 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.714 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.714 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.715 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.716 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.717 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.718 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.718 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.718 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.718 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.718 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.719 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.720 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.720 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:52.720 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.720 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.720 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.721 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.722 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.722 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.722 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.722 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.722 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.723 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.724 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.725 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.725 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.725 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.725 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_destination": { 2024-03-28T08:48:52.725 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_destination", 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.726 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email address to send alerts to", 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.727 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.728 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_from_name": { 2024-03-28T08:48:52.728 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_from_name", 2024-03-28T08:48:52.728 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.728 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.728 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "Ceph", 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email From: name", 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.729 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_host": { 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_host", 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.730 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.731 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.731 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.731 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.731 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.731 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP server", 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_password": { 2024-03-28T08:48:52.732 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_password", 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.733 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Password to authenticate with", 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_port": { 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_port", 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.735 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "465", 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP port", 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.736 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_sender": { 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_sender", 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.737 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP envelope sender", 2024-03-28T08:48:52.738 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.739 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.739 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.739 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.739 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_ssl": { 2024-03-28T08:48:52.739 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_ssl", 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.740 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.741 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_user": { 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_user", 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.742 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "User to authenticate as", 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.743 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "balancer", 2024-03-28T08:48:52.744 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "active": { 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "active", 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically balance PGs across cluster", 2024-03-28T08:48:52.746 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_time": { 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_time", 2024-03-28T08:48:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0000", 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.748 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "beginning time of day to automatically balance", 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_weekday": { 2024-03-28T08:48:52.749 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_weekday", 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:52.750 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.751 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_max_iterations": { 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_max_iterations", 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "25", 2024-03-28T08:48:52.752 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "250", 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.753 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_metrics": { 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_metrics", 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.754 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "pgs,objects,bytes", 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-28T08:48:52.755 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_step": { 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_step", 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:52.756 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.5", 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0.001", 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "0.999", 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.757 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "aggressiveness of optimization", 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "end_time": { 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_time", 2024-03-28T08:48:52.758 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2359", 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.759 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ending time of day to automatically balance", 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "end_weekday": { 2024-03-28T08:48:52.760 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_weekday", 2024-03-28T08:48:52.761 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:52.761 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.761 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.761 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:52.761 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.762 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.763 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.764 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.765 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.766 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.767 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.768 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.769 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.770 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.771 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.772 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "min_score": { 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_score", 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.773 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.774 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.775 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "upmap", 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "crush-compat", 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "none", 2024-03-28T08:48:52.776 INFO:teuthology.orchestra.run.smithi055.stdout: "read", 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap", 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap-read" 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Balancer mode", 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.777 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_ids": { 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_ids", 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.778 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-28T08:48:52.779 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.780 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.781 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_deviation": { 2024-03-28T08:48:52.782 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_deviation", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.783 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_optimizations": { 2024-03-28T08:48:52.784 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_optimizations", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.785 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.786 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm", 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_down_multiplier": { 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_down_multiplier", 2024-03-28T08:48:52.787 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.788 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_refresh_rate": { 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_refresh_rate", 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.789 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "20", 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.790 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_starting_port": { 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_starting_port", 2024-03-28T08:48:52.791 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4721", 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.792 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_ptrace": { 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_ptrace", 2024-03-28T08:48:52.793 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.794 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_interval": { 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_interval", 2024-03-28T08:48:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.796 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_memory_target_ratio": { 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_memory_target_ratio", 2024-03-28T08:48:52.797 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.7", 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.798 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm_log_destination": { 2024-03-28T08:48:52.799 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm_log_destination", 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.800 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "file", 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "file,syslog", 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "syslog" 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-28T08:48:52.801 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: "cgroups_split": { 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cgroups_split", 2024-03-28T08:48:52.802 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-28T08:48:52.803 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: "config_checks_enabled": { 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_checks_enabled", 2024-03-28T08:48:52.804 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-28T08:48:52.805 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "config_dashboard": { 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_dashboard", 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.806 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_alertmanager": { 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_alertmanager", 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.808 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.809 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_base": { 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_base", 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.810 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Container image name, without the tag", 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.811 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_elasticsearch": { 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_elasticsearch", 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-28T08:48:52.812 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "elasticsearch container image", 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.813 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_grafana": { 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_grafana", 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.814 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.815 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_haproxy": { 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_haproxy", 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.816 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "HAproxy container image", 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.817 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_agent": { 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_agent", 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.818 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger agent container image", 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.819 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_collector": { 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_collector", 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.820 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger collector container image", 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.821 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_query": { 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_query", 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-28T08:48:52.822 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.823 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.823 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.823 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger query container image", 2024-03-28T08:48:52.823 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.823 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.825 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.825 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.825 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_keepalived": { 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_keepalived", 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.826 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Keepalived container image", 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_loki": { 2024-03-28T08:48:52.827 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_loki", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Loki container image", 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_node_exporter": { 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_node_exporter", 2024-03-28T08:48:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_nvmeof": { 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_nvmeof", 2024-03-28T08:48:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Nvme-of container image", 2024-03-28T08:48:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_prometheus": { 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_prometheus", 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_promtail": { 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_promtail", 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.835 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Promtail container image", 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.836 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_snmp_gateway": { 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_snmp_gateway", 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.837 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SNMP Gateway container image", 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: "container_init": { 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_init", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.839 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Run podman/docker with `--init`", 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "daemon_cache_timeout": { 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "daemon_cache_timeout", 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.840 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.841 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-28T08:48:52.842 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.842 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.842 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.842 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "default_cephadm_command_timeout": { 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_cephadm_command_timeout", 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "900", 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.843 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "default_registry": { 2024-03-28T08:48:52.844 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_registry", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.845 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "device_cache_timeout": { 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_cache_timeout", 2024-03-28T08:48:52.846 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1800", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache device inventory", 2024-03-28T08:48:52.847 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "device_enhanced_scan": { 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_enhanced_scan", 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.848 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.849 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "facts_cache_timeout": { 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "facts_cache_timeout", 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:52.850 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache host facts data", 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.851 INFO:teuthology.orchestra.run.smithi055.stdout: "host_check_interval": { 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "host_check_interval", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.852 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to perform a host check", 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "hw_monitoring": { 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hw_monitoring", 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.853 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-28T08:48:52.854 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "inventory_list_all": { 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "inventory_list_all", 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.855 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.856 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.857 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.858 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "log_refresh_metadata": { 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_refresh_metadata", 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.859 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.860 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.861 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.862 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.864 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.865 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.866 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.867 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.868 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "*", 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.869 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "max_count_per_host": { 2024-03-28T08:48:52.870 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_count_per_host", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.871 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of daemons per service per host", 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "max_osd_draining_count": { 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_osd_draining_count", 2024-03-28T08:48:52.872 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-28T08:48:52.873 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "migration_current": { 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "migration_current", 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.874 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "internal - do not modify", 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.875 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "root", 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.876 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm-package", 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "root" 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "mode for remote execution of cephadm", 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.877 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "oob_default_addr": { 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "oob_default_addr", 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "169.254.1.1", 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.878 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "prometheus_alerts_path": { 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus_alerts_path", 2024-03-28T08:48:52.879 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-28T08:48:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_insecure": { 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_insecure", 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.881 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.882 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_password": { 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_password", 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.883 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_url": { 2024-03-28T08:48:52.884 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_url", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_username": { 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_username", 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.886 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.887 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "secure_monitoring_stack": { 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "secure_monitoring_stack", 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.888 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.889 INFO:teuthology.orchestra.run.smithi055.stdout: "service_discovery_port": { 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "service_discovery_port", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8765", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.890 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "cephadm service discovery port", 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "ssh_config_file": { 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssh_config_file", 2024-03-28T08:48:52.891 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-28T08:48:52.892 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "use_agent": { 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_agent", 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.893 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.894 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "use_repo_digest": { 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_repo_digest", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.895 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_failed_host_check": { 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_failed_host_check", 2024-03-28T08:48:52.896 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if the host check fails", 2024-03-28T08:48:52.897 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_daemons": { 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_daemons", 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.898 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.899 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_hosts": { 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_hosts", 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.900 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.901 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crash", 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:52.902 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.903 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.904 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.905 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.906 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.908 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.909 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.910 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "retain_interval": { 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retain_interval", 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "31536000", 2024-03-28T08:48:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.912 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_recent_interval": { 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_recent_interval", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1209600", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.913 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dashboard", 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.915 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.916 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_HOST": { 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.917 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-28T08:48:52.918 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.919 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_ENABLED": { 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_ENABLED", 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.920 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.921 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.922 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.923 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "ENABLE_BROWSABLE_API": { 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.924 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-28T08:48:52.925 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.926 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.927 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.928 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.929 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-28T08:48:52.930 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.931 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.932 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.933 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.934 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.935 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.936 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.937 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.938 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_PASSWORD": { 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:52.939 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-28T08:48:52.940 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.941 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_URL": { 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_URL", 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.942 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.943 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_USERNAME": { 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-28T08:48:52.945 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.946 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.947 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.948 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.949 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.950 INFO:teuthology.orchestra.run.smithi055.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.951 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "MULTICLUSTER_CONFIG": { 2024-03-28T08:48:52.952 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "{}", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.953 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_HOST": { 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.954 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.955 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.956 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.957 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.958 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-28T08:48:52.959 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.960 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.961 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.962 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.963 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-28T08:48:52.964 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.965 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.966 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.967 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.968 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_ENABLED": { 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-28T08:48:52.969 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.970 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.971 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.972 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.974 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.975 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.976 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "45", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.977 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ACCESS_KEY": { 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.978 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.979 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.980 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SECRET_KEY": { 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-28T08:48:52.981 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.982 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SSL_VERIFY": { 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.983 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.984 INFO:teuthology.orchestra.run.smithi055.stdout: "UNSAFE_TLS_v1_2": { 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.985 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-28T08:48:52.986 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.987 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.988 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.989 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.990 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "cross_origin_url": { 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cross_origin_url", 2024-03-28T08:48:52.991 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.992 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "crt_file": { 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crt_file", 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.993 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.994 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "debug": { 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "debug", 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.995 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable/disable debug options", 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "jwt_token_ttl": { 2024-03-28T08:48:52.996 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "jwt_token_ttl", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "28800", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.997 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:52.998 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:52.999 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.000 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.001 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.002 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.003 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.004 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.005 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.006 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.007 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "motd": { 2024-03-28T08:48:53.008 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "motd", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.009 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "The message of the day", 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect_resolve_ip_addr": { 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "redirect_resolve_ip_addr", 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.010 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.011 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:53.012 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.013 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8080", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.014 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.015 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl_server_port": { 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl_server_port", 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8443", 2024-03-28T08:48:53.017 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.018 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "redirect", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.019 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect" 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.020 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:53.021 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.022 INFO:teuthology.orchestra.run.smithi055.stdout: "url_prefix": { 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url_prefix", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.023 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.024 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "devicehealth", 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_monitoring": { 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_monitoring", 2024-03-28T08:48:53.025 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.026 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "monitor device health metrics", 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.027 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.028 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.029 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.030 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.031 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.032 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.033 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.034 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.035 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "mark_out_threshold": { 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mark_out_threshold", 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2419200", 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.037 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_name": { 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_name", 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "device_health_metrics", 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.038 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "retention_period": { 2024-03-28T08:48:53.039 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retention_period", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15552000", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain device health metrics", 2024-03-28T08:48:53.040 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_frequency": { 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_frequency", 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.041 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.042 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "self_heal": { 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "self_heal", 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.043 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.044 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.045 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and check device health", 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_threshold": { 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_threshold", 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.046 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7257600", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.047 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "diskprediction_local", 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.048 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.049 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.050 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.051 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.052 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.053 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.054 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.055 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.056 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "predict_interval": { 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predict_interval", 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.057 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.058 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "predictor_model": { 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predictor_model", 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "prophetstor", 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.059 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.060 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.061 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "influx", 2024-03-28T08:48:53.062 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": false, 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "influxdb python module not found", 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "batch_size": { 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "batch_size", 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.063 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5000", 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.064 INFO:teuthology.orchestra.run.smithi055.stdout: "database": { 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "database", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "ceph", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.065 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": { 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hostname", 2024-03-28T08:48:53.066 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server hostname", 2024-03-28T08:48:53.067 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.068 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "30", 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "5", 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.069 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.070 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.071 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.072 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.073 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.074 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.075 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.076 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.077 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "password": { 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "password", 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.078 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "password of InfluxDB server user", 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.079 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "port": { 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "port", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8086", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.080 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server port", 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:53.081 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "false", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:53.082 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "threads": { 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threads", 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.083 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "32", 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.084 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "username": { 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "username", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.085 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "username of InfluxDB server user", 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "verify_ssl": { 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "verify_ssl", 2024-03-28T08:48:53.086 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "true", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:53.087 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "insights", 2024-03-28T08:48:53.088 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.089 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.090 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.091 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.092 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.093 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.094 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.095 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.096 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.097 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "iostat", 2024-03-28T08:48:53.098 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.099 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.100 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.101 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.102 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.103 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.104 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.105 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.106 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.107 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "k8sevents", 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_event_retention_days": { 2024-03-28T08:48:53.108 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ceph_event_retention_days", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-28T08:48:53.109 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "config_check_secs": { 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_check_secs", 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.110 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "10", 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.111 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.112 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.113 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.114 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.115 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.116 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.117 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.118 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.119 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.120 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "localpool", 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "failure_domain": { 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "failure_domain", 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.121 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "host", 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "failure domain for any created local pool", 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.122 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.123 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.124 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.125 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.126 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.127 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.128 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.129 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.130 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "min_size": { 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_size", 2024-03-28T08:48:53.131 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default min_size for any created local pool", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-28T08:48:53.132 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "num_rep": { 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "num_rep", 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.133 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3", 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default replica count for any created local pool", 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.134 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_num": { 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_num", 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "128", 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.135 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default pg_num for any created local pool", 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "prefix": { 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prefix", 2024-03-28T08:48:53.136 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.137 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name prefix for any created local pool", 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "subtree": { 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "subtree", 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.138 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "rack", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.139 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mds_autoscaler", 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.140 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.141 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.142 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.143 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.144 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.145 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.146 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.147 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.148 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.149 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirroring", 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.150 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.151 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.152 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.153 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.154 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.155 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.156 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.157 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.158 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "nfs", 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.159 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.160 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.161 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.162 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.163 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.164 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.165 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.166 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.167 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "fail_fs": { 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "fail_fs", 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.171 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.172 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.173 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.174 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.175 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.176 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.177 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.178 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator": { 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.179 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm", 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "rook", 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: "test_orchestrator" 2024-03-28T08:48:53.180 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Orchestrator backend", 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.181 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_perf_query", 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.182 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.183 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.184 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.185 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.186 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.187 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.188 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.189 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_support", 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.191 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.192 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.193 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.194 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.195 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.196 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.197 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.198 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.199 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.200 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_autoscaler", 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.202 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.203 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.204 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.205 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.206 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.207 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.208 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.209 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.210 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.211 INFO:teuthology.orchestra.run.smithi055.stdout: "threshold": { 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threshold", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1.0", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.212 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "scaling threshold", 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.213 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "progress", 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_pg_recovery_event": { 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_pg_recovery_event", 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.214 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.215 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.216 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.217 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.218 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.219 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.220 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.221 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.222 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.223 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.224 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.225 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "max_completed_events": { 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_completed_events", 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "50", 2024-03-28T08:48:53.226 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "number of past completed events to remember", 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.227 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.228 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long the module is going to sleep", 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus", 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "cache": { 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cache", 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.230 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.231 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "exclude_perf_counters": { 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "exclude_perf_counters", 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.232 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.233 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.235 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.236 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.237 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.238 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.239 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.240 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.241 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools": { 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools", 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.242 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.243 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "300", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.244 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_interval": { 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_interval", 2024-03-28T08:48:53.245 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15.0", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.246 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.247 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.248 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "9283", 2024-03-28T08:48:53.249 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.250 INFO:teuthology.orchestra.run.smithi055.stdout: "stale_cache_strategy": { 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stale_cache_strategy", 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "log", 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.251 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:53.252 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "default", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "default", 2024-03-28T08:48:53.253 INFO:teuthology.orchestra.run.smithi055.stdout: "error" 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:53.254 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:53.255 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.256 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_support", 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.257 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.258 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.259 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.260 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.261 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.262 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.263 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.264 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_snap_create": { 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_snap_create", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.266 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mirror_snapshot_schedule": { 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirror_snapshot_schedule", 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.267 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.268 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "trash_purge_schedule": { 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "trash_purge_schedule", 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.269 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.270 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "restful", 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.271 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_auth": { 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_auth", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.272 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.273 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.274 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.275 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.275 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.275 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.275 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.275 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.276 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.277 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.278 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.279 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.281 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.282 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.284 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:53.285 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.286 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rgw", 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.287 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.288 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.289 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.290 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.291 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.292 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.293 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.294 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.295 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.296 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rook", 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.297 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.298 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.299 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.300 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.301 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.302 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.303 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.305 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "storage_class": { 2024-03-28T08:48:53.306 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "storage_class", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "local", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-28T08:48:53.307 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "selftest", 2024-03-28T08:48:53.308 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.309 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.310 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.311 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.312 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.313 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.314 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.315 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "roption1": { 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption1", 2024-03-28T08:48:53.317 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.318 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "roption2": { 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption2", 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.319 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "xyz", 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.320 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption1": { 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption1", 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.321 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.322 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption2": { 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption2", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.323 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption3": { 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption3", 2024-03-28T08:48:53.324 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.325 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption4": { 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption4", 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.326 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.327 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption5": { 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption5", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.328 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption6": { 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption6", 2024-03-28T08:48:53.329 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.330 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption7": { 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption7", 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.331 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "42", 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.332 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "testkey": { 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testkey", 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.333 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "testlkey": { 2024-03-28T08:48:53.334 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testlkey", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.335 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "testnewline": { 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testnewline", 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.336 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.337 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snap_schedule", 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.338 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_m_granularity": { 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_m_granularity", 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.339 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow minute scheduled snapshots", 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "dump_on_update": { 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dump_on_update", 2024-03-28T08:48:53.340 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "dump database to debug log on update", 2024-03-28T08:48:53.341 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.342 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.344 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.345 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.346 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.347 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.348 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.349 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.350 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stats", 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.351 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.352 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.353 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.354 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.355 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.356 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.357 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.358 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.359 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "status", 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.360 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.361 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.362 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.363 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.364 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.365 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.366 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.367 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.368 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telegraf", 2024-03-28T08:48:53.369 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "address": { 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "address", 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.370 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.371 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15", 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.372 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.374 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.375 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.376 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.377 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.378 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.379 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.380 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.381 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telemetry", 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.382 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_basic": { 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_basic", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.383 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_crash": { 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_crash", 2024-03-28T08:48:53.384 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-28T08:48:53.385 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_device": { 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_device", 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.386 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.387 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_ident": { 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_ident", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.388 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_perf": { 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_perf", 2024-03-28T08:48:53.389 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-28T08:48:53.390 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "contact": { 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "contact", 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.391 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.392 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "description": { 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "description", 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.393 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "device_url": { 2024-03-28T08:48:53.394 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_url", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.395 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "24", 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "8", 2024-03-28T08:48:53.398 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "last_opt_revision": { 2024-03-28T08:48:53.399 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "last_opt_revision", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.400 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard": { 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard", 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.401 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.402 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard_description": { 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard_description", 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.403 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.404 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.405 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.406 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.408 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.409 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.410 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.411 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.412 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "organization": { 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "organization", 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.413 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.414 INFO:teuthology.orchestra.run.smithi055.stdout: "proxy": { 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "proxy", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.415 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "url": { 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url", 2024-03-28T08:48:53.416 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.417 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.418 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "test_orchestrator", 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.419 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.420 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.421 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.422 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.423 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.424 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.425 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.426 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.427 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.428 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "volumes", 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.429 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.430 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.431 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.432 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.433 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.434 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.435 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.436 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.437 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_clones": { 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_clones", 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.438 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.439 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "periodic_async_work": { 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "periodic_async_work", 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.440 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Periodically check for async work", 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_delay": { 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_delay", 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.442 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.443 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_no_wait": { 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_no_wait", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.444 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.445 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix", 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "discovery_interval": { 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "discovery_interval", 2024-03-28T08:48:53.446 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "100", 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.447 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "identifier": { 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "identifier", 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.448 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.449 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.450 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.451 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.452 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.453 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.454 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.455 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.456 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.457 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.458 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.459 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_host": { 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_host", 2024-03-28T08:48:53.460 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.461 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_port": { 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_port", 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.462 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10051", 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.463 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_sender": { 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_sender", 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.464 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.465 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 34109, 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "y", 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr_features": 4540701547738038271, 2024-03-28T08:48:53.466 INFO:teuthology.orchestra.run.smithi055.stdout: "available_modules": [ 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "alerts", 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.467 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How frequently to reexamine health status", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.468 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.469 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.470 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.471 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.472 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.473 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.474 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.475 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.476 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_destination": { 2024-03-28T08:48:53.477 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_destination", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.478 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email address to send alerts to", 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_from_name": { 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_from_name", 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.479 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "Ceph", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email From: name", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.480 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_host": { 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_host", 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.481 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP server", 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.482 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_password": { 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_password", 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Password to authenticate with", 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_port": { 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_port", 2024-03-28T08:48:53.484 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "465", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP port", 2024-03-28T08:48:53.485 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_sender": { 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_sender", 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.486 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP envelope sender", 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.487 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_ssl": { 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_ssl", 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.488 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_user": { 2024-03-28T08:48:53.489 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_user", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.490 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "User to authenticate as", 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.491 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "balancer", 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "active": { 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "active", 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.492 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically balance PGs across cluster", 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.493 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_time": { 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_time", 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0000", 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.494 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "beginning time of day to automatically balance", 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_weekday": { 2024-03-28T08:48:53.495 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_weekday", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-28T08:48:53.496 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_max_iterations": { 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_max_iterations", 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.497 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "25", 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "250", 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_metrics": { 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_metrics", 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "pgs,objects,bytes", 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.499 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_step": { 2024-03-28T08:48:53.500 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_step", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.5", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0.001", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "0.999", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "aggressiveness of optimization", 2024-03-28T08:48:53.501 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "end_time": { 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_time", 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.502 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2359", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ending time of day to automatically balance", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.503 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "end_weekday": { 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_weekday", 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:53.504 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.505 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.506 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.507 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.508 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.509 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.510 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.511 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.512 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.513 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "min_score": { 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_score", 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.514 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.515 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "upmap", 2024-03-28T08:48:53.516 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "crush-compat", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "none", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "read", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap", 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap-read" 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.517 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Balancer mode", 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_ids": { 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_ids", 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.518 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.519 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.520 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.521 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_deviation": { 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_deviation", 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:53.522 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_optimizations": { 2024-03-28T08:48:53.523 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_optimizations", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-28T08:48:53.524 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm", 2024-03-28T08:48:53.525 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_down_multiplier": { 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_down_multiplier", 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.526 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.527 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_refresh_rate": { 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_refresh_rate", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "20", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.528 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_starting_port": { 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_starting_port", 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.529 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4721", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.530 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_ptrace": { 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_ptrace", 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.531 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.532 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_interval": { 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_interval", 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.533 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.534 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_memory_target_ratio": { 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_memory_target_ratio", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.7", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.535 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm_log_destination": { 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm_log_destination", 2024-03-28T08:48:53.536 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "file", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "file,syslog", 2024-03-28T08:48:53.537 INFO:teuthology.orchestra.run.smithi055.stdout: "syslog" 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.538 INFO:teuthology.orchestra.run.smithi055.stdout: "cgroups_split": { 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cgroups_split", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.539 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "config_checks_enabled": { 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_checks_enabled", 2024-03-28T08:48:53.540 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.541 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "config_dashboard": { 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_dashboard", 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.542 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.543 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_alertmanager": { 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_alertmanager", 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.544 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.545 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_base": { 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_base", 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.546 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Container image name, without the tag", 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_elasticsearch": { 2024-03-28T08:48:53.547 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_elasticsearch", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "elasticsearch container image", 2024-03-28T08:48:53.548 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_grafana": { 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_grafana", 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.549 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.550 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_haproxy": { 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_haproxy", 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-28T08:48:53.551 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "HAproxy container image", 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.552 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_agent": { 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_agent", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.553 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger agent container image", 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_collector": { 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_collector", 2024-03-28T08:48:53.554 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger collector container image", 2024-03-28T08:48:53.555 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_query": { 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_query", 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.556 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger query container image", 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.557 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_keepalived": { 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_keepalived", 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-28T08:48:53.558 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Keepalived container image", 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.559 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_loki": { 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_loki", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.560 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Loki container image", 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_node_exporter": { 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_node_exporter", 2024-03-28T08:48:53.561 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:53.562 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_nvmeof": { 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_nvmeof", 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.563 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Nvme-of container image", 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.564 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_prometheus": { 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_prometheus", 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.565 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.566 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_promtail": { 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_promtail", 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.567 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Promtail container image", 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_snmp_gateway": { 2024-03-28T08:48:53.568 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_snmp_gateway", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.569 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SNMP Gateway container image", 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "container_init": { 2024-03-28T08:48:53.570 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_init", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.571 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Run podman/docker with `--init`", 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "daemon_cache_timeout": { 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "daemon_cache_timeout", 2024-03-28T08:48:53.572 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.573 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "default_cephadm_command_timeout": { 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_cephadm_command_timeout", 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.574 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "900", 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.575 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "default_registry": { 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_registry", 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io", 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.576 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "device_cache_timeout": { 2024-03-28T08:48:53.577 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_cache_timeout", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1800", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.578 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache device inventory", 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "device_enhanced_scan": { 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_enhanced_scan", 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.579 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.580 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "facts_cache_timeout": { 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "facts_cache_timeout", 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.581 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache host facts data", 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.582 INFO:teuthology.orchestra.run.smithi055.stdout: "host_check_interval": { 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "host_check_interval", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.583 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to perform a host check", 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "hw_monitoring": { 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hw_monitoring", 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.584 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.585 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "inventory_list_all": { 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "inventory_list_all", 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.586 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.587 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.588 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.589 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "log_refresh_metadata": { 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_refresh_metadata", 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.590 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.591 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.592 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.594 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.595 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.596 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.597 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.598 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.599 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "*", 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.600 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "max_count_per_host": { 2024-03-28T08:48:53.601 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_count_per_host", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.602 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of daemons per service per host", 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "max_osd_draining_count": { 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_osd_draining_count", 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "migration_current": { 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "migration_current", 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.605 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "internal - do not modify", 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.606 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "root", 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.607 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm-package", 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "root" 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "mode for remote execution of cephadm", 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.608 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "oob_default_addr": { 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "oob_default_addr", 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.609 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "169.254.1.1", 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.610 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "prometheus_alerts_path": { 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus_alerts_path", 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.611 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.612 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_insecure": { 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_insecure", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.613 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_password": { 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_password", 2024-03-28T08:48:53.614 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-28T08:48:53.615 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_url": { 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_url", 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.616 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.617 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_username": { 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_username", 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.618 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.619 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "secure_monitoring_stack": { 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "secure_monitoring_stack", 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.620 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "service_discovery_port": { 2024-03-28T08:48:53.621 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "service_discovery_port", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8765", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.622 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "cephadm service discovery port", 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "ssh_config_file": { 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssh_config_file", 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.623 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.624 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "use_agent": { 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_agent", 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.626 INFO:teuthology.orchestra.run.smithi055.stdout: "use_repo_digest": { 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_repo_digest", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.627 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_failed_host_check": { 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_failed_host_check", 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.628 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if the host check fails", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.629 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_daemons": { 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_daemons", 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.630 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.631 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_hosts": { 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_hosts", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.632 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.633 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crash", 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.634 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.635 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.636 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.637 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.638 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.639 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.640 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.641 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.642 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "retain_interval": { 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retain_interval", 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "31536000", 2024-03-28T08:48:53.643 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.644 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_recent_interval": { 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_recent_interval", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1209600", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.645 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.646 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dashboard", 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.647 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.648 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_HOST": { 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.649 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-28T08:48:53.650 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.651 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_ENABLED": { 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_ENABLED", 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.652 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.653 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.654 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "ENABLE_BROWSABLE_API": { 2024-03-28T08:48:53.655 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.656 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.657 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.658 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.659 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-28T08:48:53.660 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.661 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-28T08:48:53.662 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.663 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.664 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.666 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-28T08:48:53.667 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.668 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.669 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.670 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_PASSWORD": { 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:53.671 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.672 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.673 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_URL": { 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_URL", 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.674 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.675 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_USERNAME": { 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.676 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.677 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.678 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-28T08:48:53.679 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.680 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.681 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.682 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.683 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "MULTICLUSTER_CONFIG": { 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-28T08:48:53.684 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "{}", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.685 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_HOST": { 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.686 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.687 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.688 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-28T08:48:53.689 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.690 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.691 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.692 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.693 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.694 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.695 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.696 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.697 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.698 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.699 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.700 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_ENABLED": { 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.701 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.702 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.703 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.704 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.705 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-28T08:48:53.706 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.707 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.708 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "45", 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.709 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ACCESS_KEY": { 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.710 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-28T08:48:53.711 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.712 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SECRET_KEY": { 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.713 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.714 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SSL_VERIFY": { 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "UNSAFE_TLS_v1_2": { 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-28T08:48:53.716 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.717 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.718 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.719 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.720 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-28T08:48:53.721 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.722 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "cross_origin_url": { 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cross_origin_url", 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.723 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.724 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "crt_file": { 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crt_file", 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.725 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "debug": { 2024-03-28T08:48:53.726 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "debug", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.727 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable/disable debug options", 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "jwt_token_ttl": { 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "jwt_token_ttl", 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.728 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "28800", 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.729 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.730 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.731 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.735 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.736 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.737 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.738 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.739 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "motd": { 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "motd", 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.740 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "The message of the day", 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.741 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect_resolve_ip_addr": { 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "redirect_resolve_ip_addr", 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.742 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.743 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.744 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.745 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8080", 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.746 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.747 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl_server_port": { 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl_server_port", 2024-03-28T08:48:53.748 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8443", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.749 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.750 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "redirect", 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect" 2024-03-28T08:48:53.751 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:53.752 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.753 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "url_prefix": { 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url_prefix", 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.754 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.755 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "devicehealth", 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.756 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_monitoring": { 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_monitoring", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.757 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "monitor device health metrics", 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.758 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.759 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.760 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.761 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.762 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.763 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.764 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.766 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "mark_out_threshold": { 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mark_out_threshold", 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.767 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2419200", 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.768 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_name": { 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_name", 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "device_health_metrics", 2024-03-28T08:48:53.769 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.770 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.770 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.770 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-28T08:48:53.770 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.770 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.771 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.771 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.771 INFO:teuthology.orchestra.run.smithi055.stdout: "retention_period": { 2024-03-28T08:48:53.771 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retention_period", 2024-03-28T08:48:53.772 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.772 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.772 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.772 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15552000", 2024-03-28T08:48:53.773 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.773 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.773 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain device health metrics", 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_frequency": { 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_frequency", 2024-03-28T08:48:53.774 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.775 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "self_heal": { 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "self_heal", 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.776 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.777 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.778 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and check device health", 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_threshold": { 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_threshold", 2024-03-28T08:48:53.779 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7257600", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.780 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "diskprediction_local", 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.781 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.782 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.783 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.784 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.785 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.786 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.787 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.788 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.789 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "predict_interval": { 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predict_interval", 2024-03-28T08:48:53.790 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.791 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "predictor_model": { 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predictor_model", 2024-03-28T08:48:53.792 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "prophetstor", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.793 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.794 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "influx", 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": false, 2024-03-28T08:48:53.796 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "influxdb python module not found", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "batch_size": { 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "batch_size", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5000", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.797 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.798 INFO:teuthology.orchestra.run.smithi055.stdout: "database": { 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "database", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "ceph", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.799 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.800 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": { 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hostname", 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.801 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server hostname", 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:53.802 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "30", 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "5", 2024-03-28T08:48:53.803 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.804 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.805 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.806 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.806 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.806 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.806 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.806 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.807 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.808 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.809 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.810 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.811 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.812 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "password": { 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "password", 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.813 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "password of InfluxDB server user", 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.814 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "port": { 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "port", 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8086", 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server port", 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:53.816 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "false", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.817 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "threads": { 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threads", 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.818 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "32", 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "username": { 2024-03-28T08:48:53.819 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "username", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "username of InfluxDB server user", 2024-03-28T08:48:53.820 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "verify_ssl": { 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "verify_ssl", 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "true", 2024-03-28T08:48:53.821 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.822 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "insights", 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.823 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.824 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.825 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.826 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.827 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.828 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.829 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.830 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "iostat", 2024-03-28T08:48:53.831 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.832 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.833 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.834 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.836 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.837 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.838 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.839 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "k8sevents", 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_event_retention_days": { 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ceph_event_retention_days", 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.840 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7", 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.841 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "config_check_secs": { 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_check_secs", 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "10", 2024-03-28T08:48:53.842 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.844 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.845 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.846 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.847 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.848 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.849 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.850 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "localpool", 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.851 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "failure_domain": { 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "failure_domain", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "host", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.852 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "failure domain for any created local pool", 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.853 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.854 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.855 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.856 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.857 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.858 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.859 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.860 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "min_size": { 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_size", 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.861 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default min_size for any created local pool", 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "num_rep": { 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "num_rep", 2024-03-28T08:48:53.862 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default replica count for any created local pool", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.863 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_num": { 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_num", 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "128", 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.864 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default pg_num for any created local pool", 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.865 INFO:teuthology.orchestra.run.smithi055.stdout: "prefix": { 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prefix", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.866 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name prefix for any created local pool", 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "subtree": { 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "subtree", 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.867 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "rack", 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.868 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mds_autoscaler", 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.869 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.870 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.871 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.872 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.873 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.874 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.875 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.876 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirroring", 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.879 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.880 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.881 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.882 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.883 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.884 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.885 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "nfs", 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.886 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.887 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.888 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.889 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.890 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.891 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.892 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.893 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "fail_fs": { 2024-03-28T08:48:53.894 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "fail_fs", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-28T08:48:53.895 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.896 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.897 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.898 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.899 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.900 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.901 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.902 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.903 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator": { 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.904 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm", 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "rook", 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "test_orchestrator" 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Orchestrator backend", 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_perf_query", 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.906 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.907 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.908 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.908 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.908 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.908 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.908 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.909 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.910 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.911 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.912 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.913 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.914 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_support", 2024-03-28T08:48:53.915 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.916 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.917 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.918 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.919 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.920 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.921 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.922 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.923 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_autoscaler", 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.924 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.925 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.927 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.928 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.929 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.930 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.931 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.932 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.933 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "threshold": { 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threshold", 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.934 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1.0", 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "scaling threshold", 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.935 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "progress", 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_pg_recovery_event": { 2024-03-28T08:48:53.936 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_pg_recovery_event", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.937 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.938 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.939 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.940 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.941 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.942 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.943 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.944 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.945 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.946 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "max_completed_events": { 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_completed_events", 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.947 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "50", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "number of past completed events to remember", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.948 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.949 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long the module is going to sleep", 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.950 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus", 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "cache": { 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cache", 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.951 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.952 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "exclude_perf_counters": { 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "exclude_perf_counters", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.953 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.955 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.956 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.957 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.958 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.959 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.960 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.961 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools": { 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools", 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.962 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-28T08:48:53.963 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "300", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.964 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_interval": { 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_interval", 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.965 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15.0", 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.966 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-28T08:48:53.967 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.968 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "9283", 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "stale_cache_strategy": { 2024-03-28T08:48:53.969 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stale_cache_strategy", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "log", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.970 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.971 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "default", 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "default", 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "error" 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.972 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.973 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.974 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_support", 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.975 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.976 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.977 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.978 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.979 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.980 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.981 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.982 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_snap_create": { 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_snap_create", 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:53.983 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "mirror_snapshot_schedule": { 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirror_snapshot_schedule", 2024-03-28T08:48:53.984 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.985 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "trash_purge_schedule": { 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "trash_purge_schedule", 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.986 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:53.987 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "restful", 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_auth": { 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_auth", 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.988 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.989 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.990 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.991 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.992 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:53.993 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.994 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:53.995 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:53.996 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.997 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:53.998 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:53.999 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.000 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.001 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rgw", 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.002 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.003 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.004 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.005 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.006 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.007 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.008 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.009 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rook", 2024-03-28T08:48:54.010 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.011 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.012 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.013 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.014 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.016 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.017 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "storage_class": { 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "storage_class", 2024-03-28T08:48:54.018 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "local", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.019 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "selftest", 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.020 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.021 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.022 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.023 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.024 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.025 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.026 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.027 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "roption1": { 2024-03-28T08:48:54.028 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption1", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.029 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "roption2": { 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption2", 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.030 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "xyz", 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.031 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption1": { 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption1", 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.032 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption2": { 2024-03-28T08:48:54.033 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption2", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.034 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption3": { 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption3", 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.035 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.036 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption4": { 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption4", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.037 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption5": { 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption5", 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.038 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.039 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption6": { 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption6", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.040 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption7": { 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption7", 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.041 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "42", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.042 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "testkey": { 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testkey", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.043 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "testlkey": { 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testlkey", 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.044 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.045 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "testnewline": { 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testnewline", 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.046 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.047 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snap_schedule", 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_m_granularity": { 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_m_granularity", 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.048 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow minute scheduled snapshots", 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "dump_on_update": { 2024-03-28T08:48:54.049 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dump_on_update", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "dump database to debug log on update", 2024-03-28T08:48:54.050 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.051 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.052 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.053 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.054 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.055 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.056 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.057 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.058 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stats", 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.059 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.060 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.061 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.062 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.063 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.064 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.065 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.066 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.067 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "status", 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.068 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.069 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.070 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.071 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.072 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.073 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.074 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.075 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telegraf", 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.076 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "address": { 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "address", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.077 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.078 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.079 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.080 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.081 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.083 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.084 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.085 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.086 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.087 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telemetry", 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_basic": { 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_basic", 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.088 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.089 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_crash": { 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_crash", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.090 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_device": { 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_device", 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.091 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.092 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_ident": { 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_ident", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.093 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_perf": { 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_perf", 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.094 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.095 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "contact": { 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "contact", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.096 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "description": { 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "description", 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.097 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.098 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "device_url": { 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_url", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.099 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.100 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.101 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "24", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "8", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.102 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "last_opt_revision": { 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "last_opt_revision", 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.103 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1", 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.104 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard": { 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.105 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard_description": { 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard_description", 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.106 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.107 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.108 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.109 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.110 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.111 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.112 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.113 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.114 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "organization": { 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "organization", 2024-03-28T08:48:54.115 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.116 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "proxy": { 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "proxy", 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.117 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "url": { 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url", 2024-03-28T08:48:54.118 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.119 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "test_orchestrator", 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.120 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.121 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.122 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.123 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.124 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.125 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.126 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.127 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.128 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "volumes", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.129 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.130 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.131 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.132 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.133 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.134 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.135 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_clones": { 2024-03-28T08:48:54.136 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_clones", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.137 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "periodic_async_work": { 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "periodic_async_work", 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.138 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Periodically check for async work", 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_delay": { 2024-03-28T08:48:54.139 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_delay", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.140 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_no_wait": { 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_no_wait", 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.141 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.142 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix", 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "discovery_interval": { 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "discovery_interval", 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.143 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "100", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.144 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "identifier": { 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "identifier", 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.145 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.146 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.147 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.148 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.149 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.150 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.151 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.152 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.153 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.154 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_host": { 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_host", 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.155 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.156 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_port": { 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_port", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10051", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.157 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_sender": { 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_sender", 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.158 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.159 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm", 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: "dashboard", 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-03-28T08:48:54.160 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "available_modules": [ 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "alerts", 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.161 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How frequently to reexamine health status", 2024-03-28T08:48:54.162 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.165 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.166 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.167 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.168 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.169 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.170 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_destination": { 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_destination", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.171 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email address to send alerts to", 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_from_name": { 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_from_name", 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.172 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "Ceph", 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Email From: name", 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.173 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_host": { 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_host", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.174 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP server", 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_password": { 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_password", 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.175 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Password to authenticate with", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.176 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_port": { 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_port", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "465", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.177 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP port", 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_sender": { 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_sender", 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.178 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SMTP envelope sender", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.179 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_ssl": { 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_ssl", 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.180 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "smtp_user": { 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "smtp_user", 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.181 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "User to authenticate as", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.182 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "balancer", 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.183 INFO:teuthology.orchestra.run.smithi055.stdout: "active": { 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "active", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically balance PGs across cluster", 2024-03-28T08:48:54.184 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_time": { 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_time", 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.185 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0000", 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "beginning time of day to automatically balance", 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.186 INFO:teuthology.orchestra.run.smithi055.stdout: "begin_weekday": { 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "begin_weekday", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.187 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_max_iterations": { 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_max_iterations", 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.188 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "25", 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "250", 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.189 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_metrics": { 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_metrics", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "pgs,objects,bytes", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.190 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "crush_compat_step": { 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crush_compat_step", 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.191 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.5", 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0.001", 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "0.999", 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "aggressiveness of optimization", 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.192 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "end_time": { 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_time", 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2359", 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.193 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ending time of day to automatically balance", 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "end_weekday": { 2024-03-28T08:48:54.194 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "end_weekday", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "0", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "6", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-28T08:48:54.195 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.196 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.197 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.198 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.199 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.200 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.201 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.202 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.203 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "min_score": { 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_score", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.204 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.205 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "upmap", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "crush-compat", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "none", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "read", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap", 2024-03-28T08:48:54.206 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap-read" 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Balancer mode", 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_ids": { 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_ids", 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.207 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.208 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.209 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_deviation": { 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_deviation", 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.210 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-28T08:48:54.211 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "upmap_max_optimizations": { 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "upmap_max_optimizations", 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.212 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.213 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm", 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_down_multiplier": { 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_down_multiplier", 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.214 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.215 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_refresh_rate": { 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_refresh_rate", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "20", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.216 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "agent_starting_port": { 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "agent_starting_port", 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.217 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4721", 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.218 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_ptrace": { 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_ptrace", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.219 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_interval": { 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_interval", 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.220 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.221 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "autotune_memory_target_ratio": { 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "autotune_memory_target_ratio", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0.7", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.222 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm_log_destination": { 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephadm_log_destination", 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.223 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "file", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "file,syslog", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "syslog" 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-28T08:48:54.224 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "cgroups_split": { 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cgroups_split", 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.225 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "config_checks_enabled": { 2024-03-28T08:48:54.226 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_checks_enabled", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-28T08:48:54.227 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "config_dashboard": { 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_dashboard", 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.228 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_alertmanager": { 2024-03-28T08:48:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_alertmanager", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:54.230 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_base": { 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_base", 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-28T08:48:54.231 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Container image name, without the tag", 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_elasticsearch": { 2024-03-28T08:48:54.232 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_elasticsearch", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "elasticsearch container image", 2024-03-28T08:48:54.233 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_grafana": { 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_grafana", 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.234 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.235 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_haproxy": { 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_haproxy", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "HAproxy container image", 2024-03-28T08:48:54.236 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_agent": { 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_agent", 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.237 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger agent container image", 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.238 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_collector": { 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_collector", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger collector container image", 2024-03-28T08:48:54.239 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_jaeger_query": { 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_jaeger_query", 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.240 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Jaeger query container image", 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.241 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_keepalived": { 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_keepalived", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.242 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Keepalived container image", 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_loki": { 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_loki", 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.243 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Loki container image", 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.244 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_node_exporter": { 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_node_exporter", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:54.245 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_nvmeof": { 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_nvmeof", 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.246 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Nvme-of container image", 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.247 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_prometheus": { 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_prometheus", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Prometheus container image", 2024-03-28T08:48:54.248 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_promtail": { 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_promtail", 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.249 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Promtail container image", 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.250 INFO:teuthology.orchestra.run.smithi055.stdout: "container_image_snmp_gateway": { 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_image_snmp_gateway", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "SNMP Gateway container image", 2024-03-28T08:48:54.251 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "container_init": { 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "container_init", 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.252 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Run podman/docker with `--init`", 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "daemon_cache_timeout": { 2024-03-28T08:48:54.253 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "daemon_cache_timeout", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-28T08:48:54.254 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "default_cephadm_command_timeout": { 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_cephadm_command_timeout", 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.255 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "900", 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "default_registry": { 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "default_registry", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "docker.io", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.257 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "device_cache_timeout": { 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_cache_timeout", 2024-03-28T08:48:54.258 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1800", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache device inventory", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.259 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "device_enhanced_scan": { 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_enhanced_scan", 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.260 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.261 INFO:teuthology.orchestra.run.smithi055.stdout: "facts_cache_timeout": { 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "facts_cache_timeout", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "seconds to cache host facts data", 2024-03-28T08:48:54.262 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "host_check_interval": { 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "host_check_interval", 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.263 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to perform a host check", 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.264 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "hw_monitoring": { 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hw_monitoring", 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.265 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.266 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "inventory_list_all": { 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "inventory_list_all", 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.267 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.268 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.269 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.270 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "log_refresh_metadata": { 2024-03-28T08:48:54.271 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_refresh_metadata", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.272 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.273 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-28T08:48:54.274 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.275 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.276 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.277 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.278 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.279 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-28T08:48:54.280 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "*", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-28T08:48:54.281 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "max_count_per_host": { 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_count_per_host", 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.282 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of daemons per service per host", 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.283 INFO:teuthology.orchestra.run.smithi055.stdout: "max_osd_draining_count": { 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_osd_draining_count", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.284 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "migration_current": { 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "migration_current", 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.285 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "internal - do not modify", 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.286 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": { 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mode", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "root", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.287 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm-package", 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "root" 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "mode for remote execution of cephadm", 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.288 INFO:teuthology.orchestra.run.smithi055.stdout: "oob_default_addr": { 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "oob_default_addr", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "169.254.1.1", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.289 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "prometheus_alerts_path": { 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus_alerts_path", 2024-03-28T08:48:54.290 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.291 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_insecure": { 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_insecure", 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.292 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_password": { 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_password", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.294 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_url": { 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_url", 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.295 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.296 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "registry_username": { 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "registry_username", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "secure_monitoring_stack": { 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "secure_monitoring_stack", 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.298 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.299 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "service_discovery_port": { 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "service_discovery_port", 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.300 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8765", 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "cephadm service discovery port", 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.301 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "ssh_config_file": { 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssh_config_file", 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.302 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.303 INFO:teuthology.orchestra.run.smithi055.stdout: "use_agent": { 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_agent", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.304 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "use_repo_digest": { 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "use_repo_digest", 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.305 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.306 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_failed_host_check": { 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_failed_host_check", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.307 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if the host check fails", 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_daemons": { 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_daemons", 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.308 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.309 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_on_stray_hosts": { 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_on_stray_hosts", 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.310 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.311 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crash", 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.312 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.313 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.314 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.315 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.316 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.317 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.318 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.319 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "retain_interval": { 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retain_interval", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "31536000", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.320 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_recent_interval": { 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_recent_interval", 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.321 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1209600", 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.322 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dashboard", 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-28T08:48:54.323 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.324 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_HOST": { 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.325 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.326 INFO:teuthology.orchestra.run.smithi055.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.327 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_ENABLED": { 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_ENABLED", 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.328 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.329 INFO:teuthology.orchestra.run.smithi055.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.330 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "ENABLE_BROWSABLE_API": { 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.331 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-28T08:48:54.332 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.333 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.334 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.335 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.336 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.337 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-28T08:48:54.338 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.339 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.340 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-28T08:48:54.341 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.342 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.343 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_PASSWORD": { 2024-03-28T08:48:54.344 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.345 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.346 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_URL": { 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_URL", 2024-03-28T08:48:54.347 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.348 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_API_USERNAME": { 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.349 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-28T08:48:54.350 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.351 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.352 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-28T08:48:54.353 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.354 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.355 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "MULTICLUSTER_CONFIG": { 2024-03-28T08:48:54.356 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "{}", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.357 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_HOST": { 2024-03-28T08:48:54.358 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.359 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-28T08:48:54.360 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.361 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.362 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.363 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.364 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.365 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.366 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.367 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-28T08:48:54.368 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.369 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.370 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.370 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.370 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.370 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.370 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.371 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.372 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.373 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_ENABLED": { 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.374 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.375 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.376 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.377 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.378 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8", 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.379 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-28T08:48:54.380 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "45", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.381 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ACCESS_KEY": { 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.382 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.383 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "admin", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.384 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SECRET_KEY": { 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.385 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.386 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "RGW_API_SSL_VERIFY": { 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.387 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "UNSAFE_TLS_v1_2": { 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.388 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.389 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.390 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-28T08:48:54.391 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.392 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.393 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "cross_origin_url": { 2024-03-28T08:48:54.394 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cross_origin_url", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.395 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "crt_file": { 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "crt_file", 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.396 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "debug": { 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "debug", 2024-03-28T08:48:54.397 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Enable/disable debug options", 2024-03-28T08:48:54.398 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "jwt_token_ttl": { 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "jwt_token_ttl", 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.399 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "28800", 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.400 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.401 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.402 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.403 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.404 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.405 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.406 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.407 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.408 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.409 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "motd": { 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "motd", 2024-03-28T08:48:54.410 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "The message of the day", 2024-03-28T08:48:54.411 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect_resolve_ip_addr": { 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "redirect_resolve_ip_addr", 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.412 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.413 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.414 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.415 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8080", 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.416 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.417 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl_server_port": { 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl_server_port", 2024-03-28T08:48:54.418 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8443", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.419 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.420 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "redirect", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "redirect" 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.421 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.422 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.423 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "url_prefix": { 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url_prefix", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.424 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.425 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "devicehealth", 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_monitoring": { 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_monitoring", 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.426 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "monitor device health metrics", 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.427 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.428 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.429 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.430 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.431 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.432 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.433 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.434 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "mark_out_threshold": { 2024-03-28T08:48:54.435 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mark_out_threshold", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "2419200", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-28T08:48:54.436 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "pool_name": { 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pool_name", 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.437 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "device_health_metrics", 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.438 INFO:teuthology.orchestra.run.smithi055.stdout: "retention_period": { 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "retention_period", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15552000", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.439 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long to retain device health metrics", 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_frequency": { 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_frequency", 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.440 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-28T08:48:54.441 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "self_heal": { 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "self_heal", 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.442 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.443 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.444 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how frequently to wake up and check device health", 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "warn_threshold": { 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "warn_threshold", 2024-03-28T08:48:54.445 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7257600", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.446 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "diskprediction_local", 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.447 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.448 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.449 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.450 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.451 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.452 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.453 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.454 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.455 INFO:teuthology.orchestra.run.smithi055.stdout: "predict_interval": { 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predict_interval", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "86400", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.456 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "predictor_model": { 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "predictor_model", 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.457 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "prophetstor", 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.458 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "600", 2024-03-28T08:48:54.459 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.460 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "influx", 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": false, 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "influxdb python module not found", 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "batch_size": { 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "batch_size", 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.461 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5000", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.462 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "database": { 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "database", 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "ceph", 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.463 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": { 2024-03-28T08:48:54.464 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "hostname", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server hostname", 2024-03-28T08:48:54.465 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.466 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "30", 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "5", 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.467 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.468 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.469 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.470 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.471 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.472 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.473 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.474 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "password": { 2024-03-28T08:48:54.475 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "password", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "password of InfluxDB server user", 2024-03-28T08:48:54.476 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "port": { 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "port", 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "8086", 2024-03-28T08:48:54.477 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "InfluxDB server port", 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "ssl": { 2024-03-28T08:48:54.478 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ssl", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "false", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.479 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "threads": { 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threads", 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.480 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "32", 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.481 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "username": { 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "username", 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.482 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "username of InfluxDB server user", 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "verify_ssl": { 2024-03-28T08:48:54.483 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "verify_ssl", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "true", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-28T08:48:54.484 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "insights", 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.485 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.486 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.487 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.488 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.490 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.491 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.493 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "iostat", 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.494 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.495 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.496 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.497 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.498 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.499 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.500 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.501 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "k8sevents", 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_event_retention_days": { 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ceph_event_retention_days", 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.503 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "7", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.504 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "config_check_secs": { 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "config_check_secs", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "10", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.505 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.506 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.507 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.508 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.509 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.510 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.511 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.512 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.513 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "localpool", 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.514 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "failure_domain": { 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "failure_domain", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "host", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.515 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "failure domain for any created local pool", 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.516 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.517 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.518 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.519 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.520 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.521 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.522 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.523 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "min_size": { 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "min_size", 2024-03-28T08:48:54.524 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default min_size for any created local pool", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-28T08:48:54.525 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "num_rep": { 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "num_rep", 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3", 2024-03-28T08:48:54.526 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default replica count for any created local pool", 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_num": { 2024-03-28T08:48:54.527 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_num", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "128", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "default pg_num for any created local pool", 2024-03-28T08:48:54.528 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "prefix": { 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prefix", 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.529 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "name prefix for any created local pool", 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "subtree": { 2024-03-28T08:48:54.530 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "subtree", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "rack", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-28T08:48:54.531 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mds_autoscaler", 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.532 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.533 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.534 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.535 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.536 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.537 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.538 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.539 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.540 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirroring", 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.541 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.542 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.543 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.544 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.545 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.546 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.547 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.548 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.549 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "nfs", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.550 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.551 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.552 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.553 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.554 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.555 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.556 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.557 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "fail_fs": { 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "fail_fs", 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.558 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.559 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.560 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.561 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.562 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.563 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.564 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.565 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.566 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator": { 2024-03-28T08:48:54.567 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "orchestrator", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "cephadm", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "rook", 2024-03-28T08:48:54.568 INFO:teuthology.orchestra.run.smithi055.stdout: "test_orchestrator" 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Orchestrator backend", 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.569 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_perf_query", 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.570 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.571 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.572 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.573 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.574 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.575 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.576 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.577 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "osd_support", 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.578 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.579 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.580 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.581 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.582 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.583 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.584 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.585 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "pg_autoscaler", 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.586 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.587 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.588 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.589 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.590 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.591 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.592 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.593 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:54.594 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.595 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "threshold": { 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "threshold", 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "3.0", 2024-03-28T08:48:54.596 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1.0", 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "scaling threshold", 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.597 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "progress", 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_pg_recovery_event": { 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_pg_recovery_event", 2024-03-28T08:48:54.598 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.599 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.600 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.601 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.602 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.603 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.604 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.605 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.606 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.607 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.608 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "max_completed_events": { 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_completed_events", 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "50", 2024-03-28T08:48:54.609 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "number of past completed events to remember", 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "sleep_interval": { 2024-03-28T08:48:54.610 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sleep_interval", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "5", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "how long the module is going to sleep", 2024-03-28T08:48:54.611 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "prometheus", 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.612 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "cache": { 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cache", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.613 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "exclude_perf_counters": { 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "exclude_perf_counters", 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.614 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.615 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.616 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.617 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.618 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.619 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.620 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.621 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.622 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools": { 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.624 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.625 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "300", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.626 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "scrape_interval": { 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "scrape_interval", 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15.0", 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.627 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.628 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "::", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.629 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "9283", 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.630 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "stale_cache_strategy": { 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stale_cache_strategy", 2024-03-28T08:48:54.631 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "log", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.632 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_behaviour": { 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_behaviour", 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "default", 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.633 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "default", 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "error" 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.634 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "standby_error_status_code": { 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "standby_error_status_code", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "500", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "400", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "599", 2024-03-28T08:48:54.635 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.636 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_support", 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.638 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.639 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.640 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.641 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.642 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.643 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.644 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_snap_create": { 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_snap_create", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.645 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "mirror_snapshot_schedule": { 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "mirror_snapshot_schedule", 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.646 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.647 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "trash_purge_schedule": { 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "trash_purge_schedule", 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.648 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.649 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "restful", 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "enable_auth": { 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enable_auth", 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.650 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.651 INFO:teuthology.orchestra.run.smithi055.stdout: "key_file": { 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "key_file", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.652 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.653 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.654 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.655 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.656 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.658 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.659 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "server_addr": { 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_addr", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "server_port": { 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "server_port", 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rgw", 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.667 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.668 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.669 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.670 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.671 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rook", 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.672 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.673 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.674 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.675 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.676 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.677 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.678 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.679 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.680 INFO:teuthology.orchestra.run.smithi055.stdout: "storage_class": { 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "storage_class", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "local", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.681 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.682 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "selftest", 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.683 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.684 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.685 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.686 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.687 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.688 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.689 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.690 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "roption1": { 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption1", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.691 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "roption2": { 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "roption2", 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.692 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "xyz", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.693 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption1": { 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption1", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.694 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption2": { 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption2", 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.695 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.696 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption3": { 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption3", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "float", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.697 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption4": { 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption4", 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.698 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.699 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption5": { 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption5", 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.700 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.701 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption6": { 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption6", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.702 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "rwoption7": { 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rwoption7", 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.703 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "1", 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "42", 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.704 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "testkey": { 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testkey", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.705 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "testlkey": { 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testlkey", 2024-03-28T08:48:54.706 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "testnewline": { 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "testnewline", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.708 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.709 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snap_schedule", 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "allow_m_granularity": { 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "allow_m_granularity", 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.710 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "allow minute scheduled snapshots", 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.711 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "dump_on_update": { 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "dump_on_update", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.712 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "dump database to debug log on update", 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.713 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.714 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.715 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.716 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.717 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.718 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.719 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.720 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "stats", 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.721 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.722 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.723 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.724 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.725 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.726 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.727 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.728 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.729 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "status", 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.730 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.731 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.732 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.733 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.734 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.735 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.736 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telegraf", 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "address": { 2024-03-28T08:48:54.738 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "address", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.739 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "15", 2024-03-28T08:48:54.740 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.741 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.742 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.743 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.744 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.745 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.746 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.747 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.748 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.749 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "telemetry", 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_basic": { 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_basic", 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.750 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.751 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_crash": { 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_crash", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.752 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_device": { 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_device", 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.753 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.754 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_ident": { 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_ident", 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.755 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "channel_perf": { 2024-03-28T08:48:54.756 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "channel_perf", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.757 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "contact": { 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "contact", 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.758 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.759 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "description": { 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "description", 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.760 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "device_url": { 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "device_url", 2024-03-28T08:48:54.761 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.762 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "enabled": { 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "enabled", 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.763 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.764 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "24", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "8", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.765 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "last_opt_revision": { 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "last_opt_revision", 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "1", 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.766 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard": { 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard", 2024-03-28T08:48:54.767 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.768 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "leaderboard_description": { 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "leaderboard_description", 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.769 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.770 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.771 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.772 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.773 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.774 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.775 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.776 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.777 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "organization": { 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "organization", 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.778 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.779 INFO:teuthology.orchestra.run.smithi055.stdout: "proxy": { 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "proxy", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.780 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "url": { 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "url", 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.781 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.782 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "test_orchestrator", 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.783 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.784 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.785 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.786 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.787 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.789 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.790 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.791 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "volumes", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.792 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.793 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.794 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.795 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.796 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.797 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.798 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.799 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "max_concurrent_clones": { 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "max_concurrent_clones", 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "4", 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.800 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "periodic_async_work": { 2024-03-28T08:48:54.801 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "periodic_async_work", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Periodically check for async work", 2024-03-28T08:48:54.802 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_delay": { 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_delay", 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.803 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "0", 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.804 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "snapshot_clone_no_wait": { 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "snapshot_clone_no_wait", 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "True", 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.805 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.806 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix", 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "can_run": true, 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "error_string": "", 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "module_options": { 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "discovery_interval": { 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "discovery_interval", 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "uint", 2024-03-28T08:48:54.807 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "100", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.808 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "identifier": { 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "identifier", 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.809 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.810 INFO:teuthology.orchestra.run.smithi055.stdout: "interval": { 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "interval", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "secs", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "60", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.811 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "log_level": { 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_level", 2024-03-28T08:48:54.812 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.813 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.814 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster": { 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.815 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_cluster_level": { 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_cluster_level", 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.816 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "info", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [ 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "critical", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "debug", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "error", 2024-03-28T08:48:54.817 INFO:teuthology.orchestra.run.smithi055.stdout: "info", 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "warning" 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.818 INFO:teuthology.orchestra.run.smithi055.stdout: "log_to_file": { 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "log_to_file", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "bool", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 1, 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "False", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.819 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_host": { 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_host", 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.820 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "", 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.821 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_port": { 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_port", 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "int", 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "10051", 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.822 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "zabbix_sender": { 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "zabbix_sender", 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "str", 2024-03-28T08:48:54.823 INFO:teuthology.orchestra.run.smithi055.stdout: "level": "advanced", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "flags": 0, 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "min": "", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "max": "", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "enum_allowed": [], 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "desc": "", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "long_desc": "", 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "tags": [], 2024-03-28T08:48:54.824 INFO:teuthology.orchestra.run.smithi055.stdout: "see_also": [] 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: "dashboard": "https://172.21.15.55:8443/" 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: "always_on_modules": { 2024-03-28T08:48:54.825 INFO:teuthology.orchestra.run.smithi055.stdout: "octopus": [ 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "balancer", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "devicehealth", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_autoscaler", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "progress", 2024-03-28T08:48:54.826 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_support", 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "status", 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "telemetry", 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "volumes" 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "pacific": [ 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "balancer", 2024-03-28T08:48:54.827 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "devicehealth", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_autoscaler", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "progress", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_support", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "status", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "telemetry", 2024-03-28T08:48:54.828 INFO:teuthology.orchestra.run.smithi055.stdout: "volumes" 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "quincy": [ 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "balancer", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "devicehealth", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_autoscaler", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "progress", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_support", 2024-03-28T08:48:54.829 INFO:teuthology.orchestra.run.smithi055.stdout: "status", 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "telemetry", 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "volumes" 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "reef": [ 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "balancer", 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "devicehealth", 2024-03-28T08:48:54.830 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_autoscaler", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "progress", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_support", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "status", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "telemetry", 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "volumes" 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "squid": [ 2024-03-28T08:48:54.831 INFO:teuthology.orchestra.run.smithi055.stdout: "balancer", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "crash", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "devicehealth", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "orchestrator", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "pg_autoscaler", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "progress", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "rbd_support", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "status", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "telemetry", 2024-03-28T08:48:54.832 INFO:teuthology.orchestra.run.smithi055.stdout: "volumes" 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: "last_failure_osd_epoch": 3, 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: "active_clients": [ 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "devicehealth", 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: "addrvec": [ 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.833 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v2", 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:0", 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 4121171523 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "libcephsqlite", 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: "addrvec": [ 2024-03-28T08:48:54.834 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v2", 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:0", 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2922956381 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "rbd_support", 2024-03-28T08:48:54.835 INFO:teuthology.orchestra.run.smithi055.stdout: "addrvec": [ 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v2", 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:0", 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 3375569098 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "volumes", 2024-03-28T08:48:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: "addrvec": [ 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v2", 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "172.21.15.55:0", 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2879029074 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-03-28T08:48:54.837 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-03-28T08:48:54.839 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:53 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2890876604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:48:54.839 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10132.972606 secs 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:53 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3581908449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:54 smithi159 ceph-mon[36109]: pgmap v6200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:53 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2890876604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10132.972606 secs 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:53 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3581908449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-28T08:48:54.840 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:54 smithi086 ceph-mon[35163]: pgmap v6200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 msgr2=0x7fca900a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 0x7fca900a4cc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca94005d00 tx=0x7fca94005c50 comp rx=0 tx=0).stop 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 msgr2=0x7fcaac19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c0042f0 comp rx=0 tx=0).stop 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 shutdown_connections 2024-03-28T08:48:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fca900a2800 0x7fca900a4cc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcaac1052d0 0x7fcaac1a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcaac102920 0x7fcaac19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 --2- 172.21.15.55:0/3581908449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaac0fffb0 0x7fcaac19def0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 >> 172.21.15.55:0/3581908449 conn(0x7fcaac0fbbd0 msgr2=0x7fcaac1032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 shutdown_connections 2024-03-28T08:48:54.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:52.700+0000 7fcab1a00640 1 -- 172.21.15.55:0/3581908449 wait complete. 2024-03-28T08:48:54.849 DEBUG:tasks.check_counter:Getting stats from a 2024-03-28T08:48:54.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-28T08:48:54.850 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:53 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2890876604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:48:54.850 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10132.972606 secs 2024-03-28T08:48:54.850 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:53 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3581908449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-28T08:48:54.850 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:54 smithi055 ceph-mon[31863]: pgmap v6200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:48:55.334 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/5f86a62c-ecc4-11ee-95d0-87774f69a715/mon.a/config 2024-03-28T08:48:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:56 smithi055 ceph-mon[31863]: pgmap v6201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:56 smithi086 ceph-mon[35163]: pgmap v6201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:56 smithi159 ceph-mon[36109]: pgmap v6201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-03-28T08:48:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:58 smithi086 ceph-mon[35163]: pgmap v6202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:48:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10137.972728 secs 2024-03-28T08:48:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:58 smithi159 ceph-mon[36109]: pgmap v6202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:48:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10137.972728 secs 2024-03-28T08:48:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:58 smithi055 ceph-mon[31863]: pgmap v6202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:48:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:48:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10137.972728 secs 2024-03-28T08:48:58.536 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-28T08:48:58.536 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/check_counter.py", line 84, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph_manager.py", line 1875, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3be9a5c9bc793e11e2800a8c0c696e8b46742033 shell --fsid 5f86a62c-ecc4-11ee-95d0-87774f69a715 -- ceph daemon mds.a perf dump' 2024-03-28T08:48:58.543 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-28T08:48:58.554 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-28T08:48:58.554 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T08:48:58.554 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T08:48:58.612 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T08:48:58.612 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T08:48:58.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T08:48:58.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 -- 172.21.15.55:0/833536076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 msgr2=0x7f87c4101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:58.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 --2- 172.21.15.55:0/833536076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4101920 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009900 tx=0x7f87b402bc30 comp rx=0 tx=0).stop 2024-03-28T08:48:58.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 -- 172.21.15.55:0/833536076 shutdown_connections 2024-03-28T08:48:58.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 --2- 172.21.15.55:0/833536076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41030b0 0x7f87c4109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:58.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 --2- 172.21.15.55:0/833536076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41026f0 0x7f87c4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:58.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 --2- 172.21.15.55:0/833536076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4101920 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:58.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 -- 172.21.15.55:0/833536076 >> 172.21.15.55:0/833536076 conn(0x7f87c40fca70 msgr2=0x7f87c40feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:58.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 -- 172.21.15.55:0/833536076 shutdown_connections 2024-03-28T08:48:58.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.907+0000 7f87c3200640 1 -- 172.21.15.55:0/833536076 wait complete. 2024-03-28T08:48:58.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.908+0000 7f87c3200640 1 Processor -- start 2024-03-28T08:48:58.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.908+0000 7f87c3200640 1 -- start start 2024-03-28T08:48:58.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41026f0 0x7f87c4199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41030b0 0x7f87c41a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c410d060 con 0x7f87c4101500 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c410cee0 con 0x7f87c41026f0 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c3200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c410d1e0 con 0x7f87c41030b0 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59334/0 (socket says 172.21.15.55:59334) 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 -- 172.21.15.55:0/1478948784 learned_addr learned my addr 172.21.15.55:0/1478948784 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:58.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1400640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41026f0 0x7f87c4199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c2800640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41030b0 0x7f87c41a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 -- 172.21.15.55:0/1478948784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41030b0 msgr2=0x7f87c41a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41030b0 0x7f87c41a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 -- 172.21.15.55:0/1478948784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41026f0 msgr2=0x7f87c4199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41026f0 0x7f87c4199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.909+0000 7f87c1e00640 1 -- 172.21.15.55:0/1478948784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c41a1590 con 0x7f87c4101500 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87c1e00640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f87b4000c00 tx=0x7f87b40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4043020 con 0x7f87c4101500 2024-03-28T08:48:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f87b40044c0 con 0x7f87c4101500 2024-03-28T08:48:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c41a1820 con 0x7f87c4101500 2024-03-28T08:48:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4003c90 con 0x7f87c4101500 2024-03-28T08:48:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.910+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41a1d70 con 0x7f87c4101500 2024-03-28T08:48:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.911+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c41a1f70 con 0x7f87c4101500 2024-03-28T08:48:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.913+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f87b4046020 con 0x7f87c4101500 2024-03-28T08:48:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.914+0000 7f87baa00640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 0x7f87a80a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.915+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f87b40f1ca0 con 0x7f87c4101500 2024-03-28T08:48:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.915+0000 7f87c1400640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 0x7f87a80a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.915+0000 7f87c1400640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 0x7f87a80a4cc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f87c419ae80 tx=0x7f87b000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:58.919+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f87b404d020 con 0x7f87c4101500 2024-03-28T08:48:59.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.126+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87c41a21e0 con 0x7f87c4101500 2024-03-28T08:48:59.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.131+0000 7f87baa00640 1 -- 172.21.15.55:0/1478948784 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+28505 (secure 0 0 0) 0x7f87b40bddc0 con 0x7f87c4101500 2024-03-28T08:48:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T08:48:59.133 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":137,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:59:55.505273+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6835/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6834/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6835/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6834/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6837/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.55:6834/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.55:6836/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.55:6835/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6837/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6836/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6839/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.55:6838/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.159:6833/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.159:6838/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.86:6836/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.55:6835/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.159:6839/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6837/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:6838/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.159:6832/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.86:6837/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6838/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6836/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.159:6838/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.55:6834/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6836/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.159:6838/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.86:6836/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6832/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6832/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.86:6837/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6837/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.159:6834/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.86:6837/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.159:6833/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6839/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.55:6841/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.86:6837/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6834/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.86:6836/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6841/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.159:6834/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.55:6837/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.159:6835/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.86:6836/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6839/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.55:6839/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.86:6836/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.159:6832/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.159:6838/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.159:6834/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.159:6835/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.159:6833/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.55:6837/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.159:6835/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.159:6834/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6836/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.86:6837/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6835/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6839/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6838/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.159:6832/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6833/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6834/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.55:6840/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.159:6839/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.159:6832/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.159:6833/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6841/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.55:6838/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6841/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.55:6839/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6834/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6840/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.159:6833/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.55:6839/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.55:6840/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.159:6839/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:6836/1204847109":"2024-03-29T05:56:41.647274+0000","172.21.15.55:6841/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6838/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.55:6838/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6839/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.55:6836/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.55:6837/1204847109":"2024-03-29T05:56:41.647274+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T08:48:59.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.134+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 msgr2=0x7f87a80a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.134+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 0x7f87a80a4cc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f87c419ae80 tx=0x7f87b000b390 comp rx=0 tx=0).stop 2024-03-28T08:48:59.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.134+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 msgr2=0x7f87c4199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.134+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f87b4000c00 tx=0x7f87b40040c0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 shutdown_connections 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f87a80a2800 0x7f87a80a4cc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87c41030b0 0x7f87c41a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87c41026f0 0x7f87c4199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 --2- 172.21.15.55:0/1478948784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87c4101500 0x7f87c4199970 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 >> 172.21.15.55:0/1478948784 conn(0x7f87c40fca70 msgr2=0x7f87c4107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 shutdown_connections 2024-03-28T08:48:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.135+0000 7f87c3200640 1 -- 172.21.15.55:0/1478948784 wait complete. 2024-03-28T08:48:59.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T08:48:59.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T08:48:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 -- 172.21.15.55:0/763505994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618105350 msgr2=0x7f761810bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 --2- 172.21.15.55:0/763505994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618105350 0x7f761810bbe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7610009ca0 tx=0x7f761002c0f0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 -- 172.21.15.55:0/763505994 shutdown_connections 2024-03-28T08:48:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 --2- 172.21.15.55:0/763505994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618105350 0x7f761810bbe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 --2- 172.21.15.55:0/763505994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618104990 0x7f7618104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 --2- 172.21.15.55:0/763505994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 0x7f7618103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 -- 172.21.15.55:0/763505994 >> 172.21.15.55:0/763505994 conn(0x7f76180fed10 msgr2=0x7f7618101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 -- 172.21.15.55:0/763505994 shutdown_connections 2024-03-28T08:48:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.381+0000 7f7617e00640 1 -- 172.21.15.55:0/763505994 wait complete. 2024-03-28T08:48:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.382+0000 7f7617e00640 1 Processor -- start 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.382+0000 7f7617e00640 1 -- start start 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 0x7f7618199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618105350 0x7f76181a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761810f2d0 con 0x7f7618104990 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761810f150 con 0x7f76181037a0 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761810f450 con 0x7f7618105350 2024-03-28T08:48:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59350/0 (socket says 172.21.15.55:59350) 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 -- 172.21.15.55:0/703071422 learned_addr learned my addr 172.21.15.55:0/703071422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616a00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 0x7f7618199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7617400640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618105350 0x7f76181a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 -- 172.21.15.55:0/703071422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618105350 msgr2=0x7f76181a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618105350 0x7f76181a0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 -- 172.21.15.55:0/703071422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 msgr2=0x7f7618199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 0x7f7618199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.383+0000 7f7616000640 1 -- 172.21.15.55:0/703071422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76181a15b0 con 0x7f7618104990 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f7616000640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f760400d770 tx=0x7f760400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604017070 con 0x7f7618104990 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f76040054d0 con 0x7f7618104990 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604004cf0 con 0x7f7618104990 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76181a18a0 con 0x7f7618104990 2024-03-28T08:48:59.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.384+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76181a1df0 con 0x7f7618104990 2024-03-28T08:48:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.385+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761810ab90 con 0x7f7618104990 2024-03-28T08:48:59.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.388+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f7604004e90 con 0x7f7618104990 2024-03-28T08:48:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.389+0000 7f760f400640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 0x7f75fc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.389+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f76040cf3f0 con 0x7f7618104990 2024-03-28T08:48:59.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.390+0000 7f7616a00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 0x7f75fc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.390+0000 7f7616a00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 0x7f75fc0a4d40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7608005d00 tx=0x7f7608005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:59.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.394+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f760409b510 con 0x7f7618104990 2024-03-28T08:48:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.598+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76180622a0 con 0x7f7618104990 2024-03-28T08:48:59.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.599+0000 7f760f400640 1 -- 172.21.15.55:0/703071422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f760409ae10 con 0x7f7618104990 2024-03-28T08:48:59.600 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T08:48:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 msgr2=0x7f75fc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 0x7f75fc0a4d40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7608005d00 tx=0x7f7608005c50 comp rx=0 tx=0).stop 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 msgr2=0x7f7618199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f760400d770 tx=0x7f760400dc30 comp rx=0 tx=0).stop 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 shutdown_connections 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f75fc0a2880 0x7f75fc0a4d40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7618105350 0x7f76181a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7618104990 0x7f7618199ed0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 --2- 172.21.15.55:0/703071422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76181037a0 0x7f7618199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.602+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 >> 172.21.15.55:0/703071422 conn(0x7f76180fed10 msgr2=0x7f7618107d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.603+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 shutdown_connections 2024-03-28T08:48:59.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.603+0000 7f7617e00640 1 -- 172.21.15.55:0/703071422 wait complete. 2024-03-28T08:48:59.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T08:48:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 -- 172.21.15.55:0/3919644109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 msgr2=0x7f16c8112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3919644109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c8112310 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009ca0 tx=0x7f16c002c100 comp rx=0 tx=0).stop 2024-03-28T08:48:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 -- 172.21.15.55:0/3919644109 shutdown_connections 2024-03-28T08:48:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3919644109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c8112310 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3919644109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3919644109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c8108ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.854+0000 7f16cfa00640 1 -- 172.21.15.55:0/3919644109 >> 172.21.15.55:0/3919644109 conn(0x7f16c806e8a0 msgr2=0x7f16c8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:48:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.855+0000 7f16cfa00640 1 -- 172.21.15.55:0/3919644109 shutdown_connections 2024-03-28T08:48:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.855+0000 7f16cfa00640 1 -- 172.21.15.55:0/3919644109 wait complete. 2024-03-28T08:48:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.855+0000 7f16cfa00640 1 Processor -- start 2024-03-28T08:48:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 -- start start 2024-03-28T08:48:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c81a2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c81a2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8115a10 con 0x7f16c810ff20 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8115890 con 0x7f16c81086a0 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cfa00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8115b90 con 0x7f16c8109000 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cda00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cda00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59380/0 (socket says 172.21.15.55:59380) 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cda00640 1 -- 172.21.15.55:0/3396399341 learned_addr learned my addr 172.21.15.55:0/3396399341 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:48:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.856+0000 7f16cd000640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c81a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16c7e00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c81a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 -- 172.21.15.55:0/3396399341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 msgr2=0x7f16c81a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c81a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 -- 172.21.15.55:0/3396399341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 msgr2=0x7f16c81a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c81a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:48:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 -- 172.21.15.55:0/3396399341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c81a9f70 con 0x7f16c810ff20 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cd000640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c81a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16c7e00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c81a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cda00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16c0032520 tx=0x7f16c0034880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0039040 con 0x7f16c810ff20 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c81aa200 con 0x7f16c810ff20 2024-03-28T08:48:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f16c0044070 con 0x7f16c810ff20 2024-03-28T08:48:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.857+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00043c0 con 0x7f16c810ff20 2024-03-28T08:48:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.858+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81aa770 con 0x7f16c810ff20 2024-03-28T08:48:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.859+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c81aaa90 con 0x7f16c810ff20 2024-03-28T08:48:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.862+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f16c0004560 con 0x7f16c810ff20 2024-03-28T08:48:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.863+0000 7f16c5600640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 0x7f16b00a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:48:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.864+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f16c00f27e0 con 0x7f16c810ff20 2024-03-28T08:48:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.864+0000 7f16cd000640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 0x7f16b00a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:48:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.864+0000 7f16cd000640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 0x7f16b00a4cc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0058c0 tx=0x7f16bc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:48:59.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:48:59.866+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f16c0051330 con 0x7f16c810ff20 2024-03-28T08:49:00.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.068+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c81aac60 con 0x7f16c810ff20 2024-03-28T08:49:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.069+0000 7f16c5600640 1 -- 172.21.15.55:0/3396399341 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16c00be900 con 0x7f16c810ff20 2024-03-28T08:49:00.070 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T08:49:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.071+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 msgr2=0x7f16b00a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.071+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 0x7f16b00a4cc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0058c0 tx=0x7f16bc005850 comp rx=0 tx=0).stop 2024-03-28T08:49:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.071+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 msgr2=0x7f16c81a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.071+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16c0032520 tx=0x7f16c0034880 comp rx=0 tx=0).stop 2024-03-28T08:49:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 shutdown_connections 2024-03-28T08:49:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f16b00a2800 0x7f16b00a4cc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16c810ff20 0x7f16c81a9900 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16c8109000 0x7f16c81a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 --2- 172.21.15.55:0/3396399341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16c81086a0 0x7f16c81a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 >> 172.21.15.55:0/3396399341 conn(0x7f16c806e8a0 msgr2=0x7f16c8070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 shutdown_connections 2024-03-28T08:49:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.072+0000 7f16cfa00640 1 -- 172.21.15.55:0/3396399341 wait complete. 2024-03-28T08:49:00.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T08:49:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:00 smithi086 ceph-mon[35163]: pgmap v6203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:00 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1478948784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:00 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/703071422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:00 smithi159 ceph-mon[36109]: pgmap v6203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:00 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1478948784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:00 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/703071422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 -- 172.21.15.55:0/959038975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 msgr2=0x7f860c109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 --2- 172.21.15.55:0/959038975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c109af0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8604009ca0 tx=0x7f860402c0f0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 -- 172.21.15.55:0/959038975 shutdown_connections 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 --2- 172.21.15.55:0/959038975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c109af0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 --2- 172.21.15.55:0/959038975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1028a0 0x7f860c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 --2- 172.21.15.55:0/959038975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1016b0 0x7f860c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 -- 172.21.15.55:0/959038975 >> 172.21.15.55:0/959038975 conn(0x7f860c0fcc40 msgr2=0x7f860c0ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 -- 172.21.15.55:0/959038975 shutdown_connections 2024-03-28T08:49:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.323+0000 7f8612c00640 1 -- 172.21.15.55:0/959038975 wait complete. 2024-03-28T08:49:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.324+0000 7f8612c00640 1 Processor -- start 2024-03-28T08:49:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.324+0000 7f8612c00640 1 -- start start 2024-03-28T08:49:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.324+0000 7f8612c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 0x7f860c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.324+0000 7f8612c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1028a0 0x7f860c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.324+0000 7f8612c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8612c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c10d1e0 con 0x7f860c103260 2024-03-28T08:49:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8612c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c10d060 con 0x7f860c1028a0 2024-03-28T08:49:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8612c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c10d360 con 0x7f860c1016b0 2024-03-28T08:49:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59394/0 (socket says 172.21.15.55:59394) 2024-03-28T08:49:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 -- 172.21.15.55:0/1888927111 learned_addr learned my addr 172.21.15.55:0/1888927111 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f860b400640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1028a0 0x7f860c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f860be00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 0x7f860c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 -- 172.21.15.55:0/1888927111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 msgr2=0x7f860c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 0x7f860c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 -- 172.21.15.55:0/1888927111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1028a0 msgr2=0x7f860c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1028a0 0x7f860c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f8610c00640 1 -- 172.21.15.55:0/1888927111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c1a1710 con 0x7f860c103260 2024-03-28T08:49:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.325+0000 7f860be00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 0x7f860c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T08:49:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8610c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8604032380 tx=0x7f8604032820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604041020 con 0x7f860c103260 2024-03-28T08:49:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f8604003e20 con 0x7f860c103260 2024-03-28T08:49:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604039040 con 0x7f860c103260 2024-03-28T08:49:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c1a19a0 con 0x7f860c103260 2024-03-28T08:49:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.326+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c1a1e40 con 0x7f860c103260 2024-03-28T08:49:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.328+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c1a2070 con 0x7f860c103260 2024-03-28T08:49:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.329+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f8604044020 con 0x7f860c103260 2024-03-28T08:49:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.331+0000 7f8608c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 0x7f85f00a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.331+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f86040f1cc0 con 0x7f860c103260 2024-03-28T08:49:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.331+0000 7f860be00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 0x7f85f00a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.332+0000 7f860be00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 0x7f85f00a4d40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f860c102700 tx=0x7f85fc005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:00.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.336+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f86040f8080 con 0x7f860c103260 2024-03-28T08:49:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:00 smithi055 ceph-mon[31863]: pgmap v6203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:00 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1478948784' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:00 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/703071422' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.542+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f860c1a2240 con 0x7f860c103260 2024-03-28T08:49:00.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.543+0000 7f8608c00640 1 -- 172.21.15.55:0/1888927111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f860404b020 con 0x7f860c103260 2024-03-28T08:49:00.544 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T08:49:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.545+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 msgr2=0x7f85f00a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.545+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 0x7f85f00a4d40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f860c102700 tx=0x7f85fc005e70 comp rx=0 tx=0).stop 2024-03-28T08:49:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.545+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 msgr2=0x7f860c1a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.545+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8604032380 tx=0x7f8604032820 comp rx=0 tx=0).stop 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 shutdown_connections 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f85f00a2880 0x7f85f00a4d40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c103260 0x7f860c1a10a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f860c1028a0 0x7f860c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 --2- 172.21.15.55:0/1888927111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f860c1016b0 0x7f860c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 >> 172.21.15.55:0/1888927111 conn(0x7f860c0fcc40 msgr2=0x7f860c0738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 shutdown_connections 2024-03-28T08:49:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.546+0000 7f8612c00640 1 -- 172.21.15.55:0/1888927111 wait complete. 2024-03-28T08:49:00.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T08:49:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 -- 172.21.15.55:0/3306325671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8108db0 msgr2=0x7f80d8109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 --2- 172.21.15.55:0/3306325671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8108db0 0x7f80d8109230 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009900 tx=0x7f80c402bc30 comp rx=0 tx=0).stop 2024-03-28T08:49:00.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 -- 172.21.15.55:0/3306325671 shutdown_connections 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 --2- 172.21.15.55:0/3306325671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8109770 0x7f80d8110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 --2- 172.21.15.55:0/3306325671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8108db0 0x7f80d8109230 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 --2- 172.21.15.55:0/3306325671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8107bc0 0x7f80d8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 -- 172.21.15.55:0/3306325671 >> 172.21.15.55:0/3306325671 conn(0x7f80d8076b70 msgr2=0x7f80d8078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 -- 172.21.15.55:0/3306325671 shutdown_connections 2024-03-28T08:49:00.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.794+0000 7f80d7e00640 1 -- 172.21.15.55:0/3306325671 wait complete. 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.795+0000 7f80d7e00640 1 Processor -- start 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 -- start start 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8108db0 0x7f80d819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8109770 0x7f80d81a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8113740 con 0x7f80d8107bc0 2024-03-28T08:49:00.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d81135c0 con 0x7f80d8108db0 2024-03-28T08:49:00.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d7e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d81138c0 con 0x7f80d8109770 2024-03-28T08:49:00.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59408/0 (socket says 172.21.15.55:59408) 2024-03-28T08:49:00.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d6a00640 1 -- 172.21.15.55:0/1301387727 learned_addr learned my addr 172.21.15.55:0/1301387727 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:00.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.796+0000 7f80d6000640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8108db0 0x7f80d819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d7400640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8109770 0x7f80d81a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 -- 172.21.15.55:0/1301387727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8109770 msgr2=0x7f80d81a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8109770 0x7f80d81a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 -- 172.21.15.55:0/1301387727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8108db0 msgr2=0x7f80d819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8108db0 0x7f80d819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 -- 172.21.15.55:0/1301387727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d81a5a00 con 0x7f80d8107bc0 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.797+0000 7f80d6a00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f80c800ccb0 tx=0x7f80c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.798+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8004b20 con 0x7f80d8107bc0 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.798+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f80c8003e40 con 0x7f80d8107bc0 2024-03-28T08:49:00.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.798+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d81a5cf0 con 0x7f80d8107bc0 2024-03-28T08:49:00.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.798+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80047e0 con 0x7f80d8107bc0 2024-03-28T08:49:00.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.798+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d81a61c0 con 0x7f80d8107bc0 2024-03-28T08:49:00.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.799+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d810ef60 con 0x7f80d8107bc0 2024-03-28T08:49:00.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.801+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f80c8003990 con 0x7f80d8107bc0 2024-03-28T08:49:00.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.802+0000 7f80cf400640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 0x7f80bc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:00.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.802+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f80c80cfa70 con 0x7f80d8107bc0 2024-03-28T08:49:00.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.802+0000 7f80d6000640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 0x7f80bc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:00.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.803+0000 7f80d6000640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 0x7f80bc0a4d40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80c402c7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:00.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:00.806+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f80c8014030 con 0x7f80d8107bc0 2024-03-28T08:49:01.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.021+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80d802d070 con 0x7f80d8107bc0 2024-03-28T08:49:01.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.023+0000 7f80cf400640 1 -- 172.21.15.55:0/1301387727 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 100 entries v137) v1 ==== 82+0+6083 (secure 0 0 0) 0x7f80c809bb90 con 0x7f80d8107bc0 2024-03-28T08:49:01.024 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/1393918936 2024-03-29T05:59:55.505242+0000 2024-03-28T08:49:01.024 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/1613176231 2024-03-29T05:59:15.134581+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/1613176231 2024-03-29T05:59:15.134581+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/612434037 2024-03-29T05:58:42.146469+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/612434037 2024-03-29T05:58:42.146469+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3622495211 2024-03-29T05:58:25.699033+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/2204223481 2024-03-29T05:58:09.627653+0000 2024-03-28T08:49:01.025 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/1908001929 2024-03-29T05:57:52.663538+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/204524138 2024-03-29T05:57:35.896589+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3187967134 2024-03-29T05:57:20.139153+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/3187967134 2024-03-29T05:57:20.139153+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/373679931 2024-03-29T05:57:03.277162+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/373679931 2024-03-29T05:57:03.277162+0000 2024-03-28T08:49:01.026 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/3865980537 2024-03-29T05:50:41.370316+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/4249379957 2024-03-29T05:49:48.003701+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/215888931 2024-03-29T05:49:25.367679+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/2204223481 2024-03-29T05:58:09.627653+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/1455322102 2024-03-29T05:49:09.295859+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/640673760 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:01.027 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/415139496 2024-03-29T05:48:53.084870+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/2066892795 2024-03-29T05:55:13.906711+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/3865980537 2024-03-29T05:50:41.370316+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2438181589 2024-03-29T05:47:46.823328+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2069525720 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/3145512970 2024-03-29T05:48:04.092781+0000 2024-03-28T08:49:01.028 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3421643402 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2356259151 2024-03-29T05:50:08.016835+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/611553321 2024-03-29T05:48:36.542237+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/1393918936 2024-03-29T05:59:55.505242+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/3622495211 2024-03-29T05:58:25.699033+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/1455322102 2024-03-29T05:49:09.295859+0000 2024-03-28T08:49:01.029 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/415139496 2024-03-29T05:48:53.084870+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2319770671 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1851388624 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/351988265 2024-03-29T05:53:33.150793+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/860110821 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/3136791569 2024-03-29T05:51:14.074868+0000 2024-03-28T08:49:01.030 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2422548949 2024-03-29T05:47:14.354410+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/1908001929 2024-03-29T05:57:52.663538+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1849732168 2024-03-29T05:51:30.315374+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/215888931 2024-03-29T05:49:25.367679+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/1562439147 2024-03-29T05:51:46.567552+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1408496281 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:01.031 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2536988057 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/4249379957 2024-03-29T05:49:48.003701+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/2380583821 2024-03-29T05:54:23.997298+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2356259151 2024-03-29T05:50:08.016835+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2069525720 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/721766197 2024-03-29T05:50:24.358116+0000 2024-03-28T08:49:01.032 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2422548949 2024-03-29T05:47:14.354410+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/983243293 2024-03-29T05:56:08.242610+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/959210508 2024-03-29T05:53:13.137279+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/389513488 2024-03-29T05:59:38.374141+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/959210508 2024-03-29T05:53:13.137279+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2686345738 2024-03-29T05:48:20.408882+0000 2024-03-28T08:49:01.033 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/673238495 2024-03-29T05:47:30.299684+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/476442511 2024-03-29T05:55:47.120521+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2438181589 2024-03-29T05:47:46.823328+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/1562439147 2024-03-29T05:51:46.567552+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/673238495 2024-03-29T05:47:30.299684+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1656241990 2024-03-29T05:50:57.811131+0000 2024-03-28T08:49:01.034 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1656241990 2024-03-29T05:50:57.811131+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/2897824953 2024-03-29T05:52:36.808933+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/2380583821 2024-03-29T05:54:23.997298+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/721766197 2024-03-29T05:50:24.358116+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/3136791569 2024-03-29T05:51:14.074868+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/2126098721 2024-03-29T05:58:58.664827+0000 2024-03-28T08:49:01.035 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1849732168 2024-03-29T05:51:30.315374+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1144708102 2024-03-29T05:52:03.782565+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/389513488 2024-03-29T05:59:38.374141+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2686345738 2024-03-29T05:48:20.408882+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1144708102 2024-03-29T05:52:03.782565+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/849759534 2024-03-29T05:54:06.906981+0000 2024-03-28T08:49:01.036 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/2251649856 2024-03-29T05:56:24.660056+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/1541753039 2024-03-29T05:52:20.296761+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/1541753039 2024-03-29T05:52:20.296761+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/2897824953 2024-03-29T05:52:36.808933+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/983243293 2024-03-29T05:56:08.242610+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/3684039614 2024-03-29T05:53:49.841501+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/611553321 2024-03-29T05:48:36.542237+0000 2024-03-28T08:49:01.037 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/2520990924 2024-03-29T05:52:54.087844+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/351988265 2024-03-29T05:53:33.150793+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/3684039614 2024-03-29T05:53:49.841501+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/4269934474 2024-03-29T05:54:40.648366+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/923726251 2024-03-29T05:54:57.121998+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/4269934474 2024-03-29T05:54:40.648366+0000 2024-03-28T08:49:01.038 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/204524138 2024-03-29T05:57:35.896589+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/923726251 2024-03-29T05:54:57.121998+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/2520990924 2024-03-29T05:52:54.087844+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/2066892795 2024-03-29T05:55:13.906711+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/1567549774 2024-03-29T05:55:30.389450+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/3145512970 2024-03-29T05:48:04.092781+0000 2024-03-28T08:49:01.039 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/1204847109 2024-03-29T05:56:41.647274+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/1567549774 2024-03-29T05:55:30.389450+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/860110821 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/476442511 2024-03-29T05:55:47.120521+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/849759534 2024-03-29T05:54:06.906981+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/2251649856 2024-03-29T05:56:24.660056+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/2126098721 2024-03-29T05:58:58.664827+0000 2024-03-28T08:49:01.040 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/1204847109 2024-03-29T05:56:41.647274+0000 2024-03-28T08:49:01.042 INFO:teuthology.orchestra.run.smithi055.stderr:listed 100 entries 2024-03-28T08:49:01.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.025+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 msgr2=0x7f80bc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.025+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 0x7f80bc0a4d40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f80c4000c00 tx=0x7f80c402c7e0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.025+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 msgr2=0x7f80d819dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.025+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f80c800ccb0 tx=0x7f80c800a620 comp rx=0 tx=0).stop 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 shutdown_connections 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f80bc0a2880 0x7f80bc0a4d40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8109770 0x7f80d81a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80d8108db0 0x7f80d819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 --2- 172.21.15.55:0/1301387727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d8107bc0 0x7f80d819dde0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 >> 172.21.15.55:0/1301387727 conn(0x7f80d8076b70 msgr2=0x7f80d810c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:01.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 shutdown_connections 2024-03-28T08:49:01.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.026+0000 7f80d7e00640 1 -- 172.21.15.55:0/1301387727 wait complete. 2024-03-28T08:49:01.046 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-03-28T08:49:01.046 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T08:49:01.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T08:49:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3396399341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1888927111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:01 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1301387727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3396399341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1888927111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:01 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1301387727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:01.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.328+0000 7fc1f7e00640 1 -- 172.21.15.55:0/2919476418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 msgr2=0x7fc1f8104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.328+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/2919476418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8104d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009860 tx=0x7fc1e002bb70 comp rx=0 tx=0).stop 2024-03-28T08:49:01.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 -- 172.21.15.55:0/2919476418 shutdown_connections 2024-03-28T08:49:01.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/2919476418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/2919476418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8104d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/2919476418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 -- 172.21.15.55:0/2919476418 >> 172.21.15.55:0/2919476418 conn(0x7fc1f80fec80 msgr2=0x7fc1f81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:01.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 -- 172.21.15.55:0/2919476418 shutdown_connections 2024-03-28T08:49:01.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.329+0000 7fc1f7e00640 1 -- 172.21.15.55:0/2919476418 wait complete. 2024-03-28T08:49:01.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.330+0000 7fc1f7e00640 1 Processor -- start 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.330+0000 7fc1f7e00640 1 -- start start 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f81a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f810f200 con 0x7fc1f81036f0 2024-03-28T08:49:01.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f810f080 con 0x7fc1f81048e0 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f810f380 con 0x7fc1f81052a0 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59424/0 (socket says 172.21.15.55:59424) 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 -- 172.21.15.55:0/1900989030 learned_addr learned my addr 172.21.15.55:0/1900989030 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1ee000640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f7400640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f81a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 -- 172.21.15.55:0/1900989030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 msgr2=0x7fc1f81a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f81a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.331+0000 7fc1f6a00640 1 -- 172.21.15.55:0/1900989030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 msgr2=0x7fc1f8199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1f6a00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1f6a00640 1 -- 172.21.15.55:0/1900989030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f81a1520 con 0x7fc1f81036f0 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1ee000640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1f7400640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f81a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T08:49:01.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1f6a00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800e9a0 tx=0x7fc1e800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:01.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800cd80 con 0x7fc1f81036f0 2024-03-28T08:49:01.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fc1e80108e0 con 0x7fc1f81036f0 2024-03-28T08:49:01.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8018950 con 0x7fc1f81036f0 2024-03-28T08:49:01.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.332+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f81a1810 con 0x7fc1f81036f0 2024-03-28T08:49:01.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.333+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f81a1ce0 con 0x7fc1f81036f0 2024-03-28T08:49:01.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.334+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f810aa80 con 0x7fc1f81036f0 2024-03-28T08:49:01.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.336+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fc1e8010a90 con 0x7fc1f81036f0 2024-03-28T08:49:01.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.337+0000 7fc1fca00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 0x7fc1dc0a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.337+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7fc1e80cfe40 con 0x7fc1f81036f0 2024-03-28T08:49:01.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.337+0000 7fc1ee000640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 0x7fc1dc0a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.338+0000 7fc1ee000640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 0x7fc1dc0a4d40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e0034980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:01.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.341+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fc1e8053740 con 0x7fc1f81036f0 2024-03-28T08:49:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3396399341' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1888927111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:01 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1301387727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:01.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.552+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1f80622a0 con 0x7fc1f81036f0 2024-03-28T08:49:01.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.558+0000 7fc1fca00640 1 -- 172.21.15.55:0/1900989030 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+28505 (secure 0 0 0) 0x7fc1e809bf60 con 0x7fc1f81036f0 2024-03-28T08:49:01.559 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-03-28T08:49:01.559 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":137,"fsid":"5f86a62c-ecc4-11ee-95d0-87774f69a715","created":"2024-03-28T05:32:10.226265+0000","modified":"2024-03-28T05:59:55.505273+0000","last_up_change":"2024-03-28T05:41:48.706768+0000","last_in_change":"2024-03-28T05:41:22.585324+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T05:36:36.393985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T05:42:50.556064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T05:42:51.632765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df00632e-7830-42bc-8e05-74ae3fbbdb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6803","nonce":2006201392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6805","nonce":2006201392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6809","nonce":2006201392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2006201392},{"type":"v1","addr":"172.21.15.55:6807","nonce":2006201392}]},"public_addr":"172.21.15.55:6803/2006201392","cluster_addr":"172.21.15.55:6805/2006201392","heartbeat_back_addr":"172.21.15.55:6809/2006201392","heartbeat_front_addr":"172.21.15.55:6807/2006201392","state":["exists","up"]},{"osd":1,"uuid":"7cbaa230-33bb-4f8a-aed7-0bdabfeaa815","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6801","nonce":2855371338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6803","nonce":2855371338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6807","nonce":2855371338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":2855371338},{"type":"v1","addr":"172.21.15.86:6805","nonce":2855371338}]},"public_addr":"172.21.15.86:6801/2855371338","cluster_addr":"172.21.15.86:6803/2855371338","heartbeat_back_addr":"172.21.15.86:6807/2855371338","heartbeat_front_addr":"172.21.15.86:6805/2855371338","state":["exists","up"]},{"osd":2,"uuid":"65e1186a-cbc9-429b-ba19-135a705d8a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6801","nonce":1186747066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6803","nonce":1186747066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6807","nonce":1186747066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1186747066},{"type":"v1","addr":"172.21.15.159:6805","nonce":1186747066}]},"public_addr":"172.21.15.159:6801/1186747066","cluster_addr":"172.21.15.159:6803/1186747066","heartbeat_back_addr":"172.21.15.159:6807/1186747066","heartbeat_front_addr":"172.21.15.159:6805/1186747066","state":["exists","up"]},{"osd":3,"uuid":"d7fdfb8b-c726-4cb0-9d81-c96524ccbd17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6811","nonce":680016669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6813","nonce":680016669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6817","nonce":680016669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":680016669},{"type":"v1","addr":"172.21.15.55:6815","nonce":680016669}]},"public_addr":"172.21.15.55:6811/680016669","cluster_addr":"172.21.15.55:6813/680016669","heartbeat_back_addr":"172.21.15.55:6817/680016669","heartbeat_front_addr":"172.21.15.55:6815/680016669","state":["exists","up"]},{"osd":4,"uuid":"d81c2c4b-5f5f-4b51-ab13-740a305476a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6809","nonce":3228408788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6811","nonce":3228408788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6815","nonce":3228408788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3228408788},{"type":"v1","addr":"172.21.15.86:6813","nonce":3228408788}]},"public_addr":"172.21.15.86:6809/3228408788","cluster_addr":"172.21.15.86:6811/3228408788","heartbeat_back_addr":"172.21.15.86:6815/3228408788","heartbeat_front_addr":"172.21.15.86:6813/3228408788","state":["exists","up"]},{"osd":5,"uuid":"db884aaf-8559-4c28-a521-57ee113e3107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6809","nonce":2204866007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6811","nonce":2204866007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6815","nonce":2204866007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2204866007},{"type":"v1","addr":"172.21.15.159:6813","nonce":2204866007}]},"public_addr":"172.21.15.159:6809/2204866007","cluster_addr":"172.21.15.159:6811/2204866007","heartbeat_back_addr":"172.21.15.159:6815/2204866007","heartbeat_front_addr":"172.21.15.159:6813/2204866007","state":["exists","up"]},{"osd":6,"uuid":"f026158b-3c5a-4fc7-866c-86f5adc9d2f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6819","nonce":3781986926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6821","nonce":3781986926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6825","nonce":3781986926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":3781986926},{"type":"v1","addr":"172.21.15.55:6823","nonce":3781986926}]},"public_addr":"172.21.15.55:6819/3781986926","cluster_addr":"172.21.15.55:6821/3781986926","heartbeat_back_addr":"172.21.15.55:6825/3781986926","heartbeat_front_addr":"172.21.15.55:6823/3781986926","state":["exists","up"]},{"osd":7,"uuid":"625d939c-a761-46ea-96b0-ad1f45d0889b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6817","nonce":3390667682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6819","nonce":3390667682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6823","nonce":3390667682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3390667682},{"type":"v1","addr":"172.21.15.86:6821","nonce":3390667682}]},"public_addr":"172.21.15.86:6817/3390667682","cluster_addr":"172.21.15.86:6819/3390667682","heartbeat_back_addr":"172.21.15.86:6823/3390667682","heartbeat_front_addr":"172.21.15.86:6821/3390667682","state":["exists","up"]},{"osd":8,"uuid":"f3778672-12bc-4c1a-a1a8-d26e981911e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6817","nonce":4245320261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6819","nonce":4245320261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6823","nonce":4245320261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4245320261},{"type":"v1","addr":"172.21.15.159:6821","nonce":4245320261}]},"public_addr":"172.21.15.159:6817/4245320261","cluster_addr":"172.21.15.159:6819/4245320261","heartbeat_back_addr":"172.21.15.159:6823/4245320261","heartbeat_front_addr":"172.21.15.159:6821/4245320261","state":["exists","up"]},{"osd":9,"uuid":"ffea7a53-4b7a-4d50-a690-3ec6a3dc005c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6827","nonce":443330436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6829","nonce":443330436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6833","nonce":443330436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":443330436},{"type":"v1","addr":"172.21.15.55:6831","nonce":443330436}]},"public_addr":"172.21.15.55:6827/443330436","cluster_addr":"172.21.15.55:6829/443330436","heartbeat_back_addr":"172.21.15.55:6833/443330436","heartbeat_front_addr":"172.21.15.55:6831/443330436","state":["exists","up"]},{"osd":10,"uuid":"f7d7d35b-4f51-49d7-9fa8-d558f915ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6825","nonce":3742760056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6827","nonce":3742760056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6831","nonce":3742760056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3742760056},{"type":"v1","addr":"172.21.15.86:6829","nonce":3742760056}]},"public_addr":"172.21.15.86:6825/3742760056","cluster_addr":"172.21.15.86:6827/3742760056","heartbeat_back_addr":"172.21.15.86:6831/3742760056","heartbeat_front_addr":"172.21.15.86:6829/3742760056","state":["exists","up"]},{"osd":11,"uuid":"238c21e2-0ee8-479f-a68a-22758a71cf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":85,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6825","nonce":535297782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6827","nonce":535297782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6831","nonce":535297782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":535297782},{"type":"v1","addr":"172.21.15.159:6829","nonce":535297782}]},"public_addr":"172.21.15.159:6825/535297782","cluster_addr":"172.21.15.159:6827/535297782","heartbeat_back_addr":"172.21.15.159:6831/535297782","heartbeat_front_addr":"172.21.15.159:6829/535297782","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:24.604058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:35:58.883837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:36:31.458580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:08.724676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:37:43.012287+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:16.191926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:38:51.357713+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:25.645273+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:39:59.068469+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:40:34.588674+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:10.477778+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T05:41:45.617853+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6835/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6834/1613176231":"2024-03-29T05:59:15.134581+0000","172.21.15.55:6835/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6834/612434037":"2024-03-29T05:58:42.146469+0000","172.21.15.55:6837/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.55:6834/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.55:6836/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.55:6835/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6837/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6836/3187967134":"2024-03-29T05:57:20.139153+0000","172.21.15.55:6839/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.55:6838/373679931":"2024-03-29T05:57:03.277162+0000","172.21.15.159:6833/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.159:6838/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.86:6836/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.55:6835/2204223481":"2024-03-29T05:58:09.627653+0000","172.21.15.159:6839/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.55:0/640673760":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6837/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:6838/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.159:6832/3865980537":"2024-03-29T05:50:41.370316+0000","172.21.15.86:6837/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.55:6801/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6838/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:0/3421643402":"2024-03-29T05:33:17.649133+0000","172.21.15.86:6836/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.159:6838/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.55:6834/1393918936":"2024-03-29T05:59:55.505242+0000","172.21.15.55:6836/3622495211":"2024-03-29T05:58:25.699033+0000","172.21.15.159:6838/1455322102":"2024-03-29T05:49:09.295859+0000","172.21.15.86:6836/415139496":"2024-03-29T05:48:53.084870+0000","172.21.15.55:0/2319770671":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/1851388624":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6832/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6801/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6832/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.86:6837/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6837/1908001929":"2024-03-29T05:57:52.663538+0000","172.21.15.159:6834/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.86:6837/215888931":"2024-03-29T05:49:25.367679+0000","172.21.15.159:6833/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.55:0/1408496281":"2024-03-29T05:32:43.443255+0000","172.21.15.55:0/2536988057":"2024-03-29T05:32:43.443255+0000","172.21.15.159:6839/4249379957":"2024-03-29T05:49:48.003701+0000","172.21.15.55:6841/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.86:6837/2356259151":"2024-03-29T05:50:08.016835+0000","172.21.15.55:6800/2069525720":"2024-03-29T05:33:17.649133+0000","172.21.15.159:6834/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.86:6836/2422548949":"2024-03-29T05:47:14.354410+0000","172.21.15.55:6841/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.159:6834/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.55:6837/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.159:6835/959210508":"2024-03-29T05:53:13.137279+0000","172.21.15.86:6836/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6839/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.55:6839/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.86:6836/2438181589":"2024-03-29T05:47:46.823328+0000","172.21.15.159:6832/1562439147":"2024-03-29T05:51:46.567552+0000","172.21.15.159:6838/673238495":"2024-03-29T05:47:30.299684+0000","172.21.15.159:6834/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/1656241990":"2024-03-29T05:50:57.811131+0000","172.21.15.159:6835/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/2380583821":"2024-03-29T05:54:23.997298+0000","172.21.15.159:6835/721766197":"2024-03-29T05:50:24.358116+0000","172.21.15.159:6833/3136791569":"2024-03-29T05:51:14.074868+0000","172.21.15.55:6837/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.159:6835/1849732168":"2024-03-29T05:51:30.315374+0000","172.21.15.159:6834/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6836/389513488":"2024-03-29T05:59:38.374141+0000","172.21.15.86:6837/2686345738":"2024-03-29T05:48:20.408882+0000","172.21.15.159:6835/1144708102":"2024-03-29T05:52:03.782565+0000","172.21.15.55:6839/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6838/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.159:6832/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6833/1541753039":"2024-03-29T05:52:20.296761+0000","172.21.15.159:6834/2897824953":"2024-03-29T05:52:36.808933+0000","172.21.15.55:6840/983243293":"2024-03-29T05:56:08.242610+0000","172.21.15.55:6840/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.159:6839/611553321":"2024-03-29T05:48:36.542237+0000","172.21.15.159:6832/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.159:6833/351988265":"2024-03-29T05:53:33.150793+0000","172.21.15.55:6841/3684039614":"2024-03-29T05:53:49.841501+0000","172.21.15.55:6838/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6841/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.55:6839/4269934474":"2024-03-29T05:54:40.648366+0000","172.21.15.55:6834/204524138":"2024-03-29T05:57:35.896589+0000","172.21.15.55:6840/923726251":"2024-03-29T05:54:57.121998+0000","172.21.15.159:6833/2520990924":"2024-03-29T05:52:54.087844+0000","172.21.15.55:6839/2066892795":"2024-03-29T05:55:13.906711+0000","172.21.15.55:6840/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.159:6839/3145512970":"2024-03-29T05:48:04.092781+0000","172.21.15.55:6836/1204847109":"2024-03-29T05:56:41.647274+0000","172.21.15.55:6841/1567549774":"2024-03-29T05:55:30.389450+0000","172.21.15.55:6800/860110821":"2024-03-29T05:32:43.443255+0000","172.21.15.55:6838/476442511":"2024-03-29T05:55:47.120521+0000","172.21.15.55:6838/849759534":"2024-03-29T05:54:06.906981+0000","172.21.15.55:6839/2251649856":"2024-03-29T05:56:24.660056+0000","172.21.15.55:6836/2126098721":"2024-03-29T05:58:58.664827+0000","172.21.15.55:6837/1204847109":"2024-03-29T05:56:41.647274+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T08:49:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 msgr2=0x7fc1dc0a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 0x7fc1dc0a4d40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e0034980 comp rx=0 tx=0).stop 2024-03-28T08:49:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 msgr2=0x7fc1f8199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800e9a0 tx=0x7fc1e800ee60 comp rx=0 tx=0).stop 2024-03-28T08:49:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 shutdown_connections 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fc1dc0a2880 0x7fc1dc0a4d40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1f81052a0 0x7fc1f81a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1f81048e0 0x7fc1f8199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 --2- 172.21.15.55:0/1900989030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f81036f0 0x7fc1f8199900 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 >> 172.21.15.55:0/1900989030 conn(0x7fc1f80fec80 msgr2=0x7fc1f8107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 shutdown_connections 2024-03-28T08:49:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.561+0000 7fc1f7e00640 1 -- 172.21.15.55:0/1900989030 wait complete. 2024-03-28T08:49:01.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T05:36:36.393985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T05:42:50.556064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T05:42:51.632765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T08:49:01.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T08:49:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 -- 172.21.15.55:0/246167780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 msgr2=0x7f3f98103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/246167780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98103d00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009900 tx=0x7f3f8802bc30 comp rx=0 tx=0).stop 2024-03-28T08:49:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 -- 172.21.15.55:0/246167780 shutdown_connections 2024-03-28T08:49:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/246167780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98105490 0x7f3f9810bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/246167780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98104ad0 0x7f3f98104f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/246167780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98103d00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 -- 172.21.15.55:0/246167780 >> 172.21.15.55:0/246167780 conn(0x7f3f980fee50 msgr2=0x7f3f98101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 -- 172.21.15.55:0/246167780 shutdown_connections 2024-03-28T08:49:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.809+0000 7f3f9cc00640 1 -- 172.21.15.55:0/246167780 wait complete. 2024-03-28T08:49:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.810+0000 7f3f9cc00640 1 Processor -- start 2024-03-28T08:49:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.810+0000 7f3f9cc00640 1 -- start start 2024-03-28T08:49:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98104ad0 0x7f3f9819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 0x7f3f981a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9810f430 con 0x7f3f981038e0 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9810f2b0 con 0x7f3f98105490 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f9cc00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9810f5b0 con 0x7f3f98104ad0 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59442/0 (socket says 172.21.15.55:59442) 2024-03-28T08:49:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 -- 172.21.15.55:0/4172366274 learned_addr learned my addr 172.21.15.55:0/4172366274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f96800640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 0x7f3f981a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f8d400640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98104ad0 0x7f3f9819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 -- 172.21.15.55:0/4172366274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98104ad0 msgr2=0x7f3f9819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98104ad0 0x7f3f9819a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 -- 172.21.15.55:0/4172366274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 msgr2=0x7f3f981a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 0x7f3f981a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f95e00640 1 -- 172.21.15.55:0/4172366274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f981a1730 con 0x7f3f981038e0 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.811+0000 7f3f96800640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 0x7f3f981a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f95e00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f88000c00 tx=0x7f3f880040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88043020 con 0x7f3f981038e0 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f981a19c0 con 0x7f3f981038e0 2024-03-28T08:49:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f3f880044c0 con 0x7f3f981038e0 2024-03-28T08:49:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88003c60 con 0x7f3f981038e0 2024-03-28T08:49:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.812+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f981a1f10 con 0x7f3f981038e0 2024-03-28T08:49:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.814+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f980688e0 con 0x7f3f981038e0 2024-03-28T08:49:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.816+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f3f88046020 con 0x7f3f981038e0 2024-03-28T08:49:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.817+0000 7f3f8f400640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 0x7f3f7c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.817+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f3f880f1d00 con 0x7f3f981038e0 2024-03-28T08:49:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.817+0000 7f3f8d400640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 0x7f3f7c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:01.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.818+0000 7f3f8d400640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 0x7f3f7c0a4cc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3f800095f0 tx=0x7f3f80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:01.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:01.821+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f3f8804d020 con 0x7f3f981038e0 2024-03-28T08:49:02.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.023+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f980622f0 con 0x7f3f981038e0 2024-03-28T08:49:02.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.024+0000 7f3f8f400640 1 -- 172.21.15.55:0/4172366274 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f880bde20 con 0x7f3f981038e0 2024-03-28T08:49:02.025 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 msgr2=0x7f3f7c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 0x7f3f7c0a4cc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3f800095f0 tx=0x7f3f80005f90 comp rx=0 tx=0).stop 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 msgr2=0x7f3f98199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3f88000c00 tx=0x7f3f880040c0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 shutdown_connections 2024-03-28T08:49:02.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f3f7c0a2800 0x7f3f7c0a4cc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f98105490 0x7f3f981a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f98104ad0 0x7f3f9819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 --2- 172.21.15.55:0/4172366274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f981038e0 0x7f3f98199b10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 >> 172.21.15.55:0/4172366274 conn(0x7f3f980fee50 msgr2=0x7f3f98107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 shutdown_connections 2024-03-28T08:49:02.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.027+0000 7f3f9cc00640 1 -- 172.21.15.55:0/4172366274 wait complete. 2024-03-28T08:49:02.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T08:49:02.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 -- 172.21.15.55:0/762551591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c0ffdf0 msgr2=0x7f9e6c100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 --2- 172.21.15.55:0/762551591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c0ffdf0 0x7f9e6c100210 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009900 tx=0x7f9e5c02bc50 comp rx=0 tx=0).stop 2024-03-28T08:49:02.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 -- 172.21.15.55:0/762551591 shutdown_connections 2024-03-28T08:49:02.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 --2- 172.21.15.55:0/762551591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c1010f0 0x7f9e6c101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 --2- 172.21.15.55:0/762551591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c100750 0x7f9e6c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 --2- 172.21.15.55:0/762551591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c0ffdf0 0x7f9e6c100210 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 -- 172.21.15.55:0/762551591 >> 172.21.15.55:0/762551591 conn(0x7f9e6c0fba10 msgr2=0x7f9e6c0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:02.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 -- 172.21.15.55:0/762551591 shutdown_connections 2024-03-28T08:49:02.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.278+0000 7f9e72200640 1 -- 172.21.15.55:0/762551591 wait complete. 2024-03-28T08:49:02.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.279+0000 7f9e72200640 1 Processor -- start 2024-03-28T08:49:02.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 -- start start 2024-03-28T08:49:02.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100750 0x7f9e6c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c1010f0 0x7f9e6c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c10f2f0 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c10f170 con 0x7f9e6c1010f0 2024-03-28T08:49:02.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e72200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c10f470 con 0x7f9e6c100750 2024-03-28T08:49:02.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e71800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e71800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59452/0 (socket says 172.21.15.55:59452) 2024-03-28T08:49:02.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e71800640 1 -- 172.21.15.55:0/684301988 learned_addr learned my addr 172.21.15.55:0/684301988 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.280+0000 7f9e70e00640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100750 0x7f9e6c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e63e00640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c1010f0 0x7f9e6c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 -- 172.21.15.55:0/684301988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100750 msgr2=0x7f9e6c199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100750 0x7f9e6c199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 -- 172.21.15.55:0/684301988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c1010f0 msgr2=0x7f9e6c19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c1010f0 0x7f9e6c19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 -- 172.21.15.55:0/684301988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c1a1c60 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.281+0000 7f9e71800640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400b970 tx=0x7f9e6400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:02.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.282+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64019070 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.282+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f9e64014440 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.282+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c1a1f50 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.282+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e640075d0 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.282+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c1a23e0 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.283+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c10ae70 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.286+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f9e6401c070 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.288+0000 7f9e6a000640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 0x7f9e4c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.288+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f9e640cef10 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.288+0000 7f9e70e00640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 0x7f9e4c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.289+0000 7f9e70e00640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 0x7f9e4c0a4cc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005ab0 tx=0x7f9e5c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:02.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.293+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f9e6409aae0 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:02 smithi086 ceph-mon[35163]: pgmap v6204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/1900989030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:02 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/4172366274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:02 smithi159 ceph-mon[36109]: pgmap v6204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/1900989030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:02 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/4172366274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:02 smithi055 ceph-mon[31863]: pgmap v6204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/1900989030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-28T08:49:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:02 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/4172366274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-28T08:49:02.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.497+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e6c02d2c0 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.498+0000 7f9e6a000640 1 -- 172.21.15.55:0/684301988 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e6409eb80 con 0x7f9e6c19f1d0 2024-03-28T08:49:02.499 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-03-28T08:49:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.500+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 msgr2=0x7f9e4c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.500+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 0x7f9e4c0a4cc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005ab0 tx=0x7f9e5c000bc0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 msgr2=0x7f9e6c1a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400b970 tx=0x7f9e6400be30 comp rx=0 tx=0).stop 2024-03-28T08:49:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 shutdown_connections 2024-03-28T08:49:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f9e4c0a2800 0x7f9e4c0a4cc0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e6c19f1d0 0x7f9e6c1a15c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e6c1010f0 0x7f9e6c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 --2- 172.21.15.55:0/684301988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c100750 0x7f9e6c199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 >> 172.21.15.55:0/684301988 conn(0x7f9e6c0fba10 msgr2=0x7f9e6c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 shutdown_connections 2024-03-28T08:49:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.501+0000 7f9e72200640 1 -- 172.21.15.55:0/684301988 wait complete. 2024-03-28T08:49:02.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T08:49:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 -- 172.21.15.55:0/638047459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 msgr2=0x7f6040110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 --2- 172.21.15.55:0/638047459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f6040110000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6038009ca0 tx=0x7f603802c100 comp rx=0 tx=0).stop 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 -- 172.21.15.55:0/638047459 shutdown_connections 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 --2- 172.21.15.55:0/638047459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f6040110000 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 --2- 172.21.15.55:0/638047459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 0x7f6040109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 --2- 172.21.15.55:0/638047459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 0x7f6040107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 -- 172.21.15.55:0/638047459 >> 172.21.15.55:0/638047459 conn(0x7f6040076b70 msgr2=0x7f6040078f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 -- 172.21.15.55:0/638047459 shutdown_connections 2024-03-28T08:49:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.754+0000 7f6044c00640 1 -- 172.21.15.55:0/638047459 wait complete. 2024-03-28T08:49:02.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.755+0000 7f6044c00640 1 Processor -- start 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.755+0000 7f6044c00640 1 -- start start 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 0x7f604019dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 0x7f604019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60401136d0 con 0x7f6040109770 2024-03-28T08:49:02.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040113550 con 0x7f6040107bc0 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6044c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040113850 con 0x7f6040108db0 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f603fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f603fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59472/0 (socket says 172.21.15.55:59472) 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f603fe00640 1 -- 172.21.15.55:0/3267951957 learned_addr learned my addr 172.21.15.55:0/3267951957 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f603f400640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 0x7f604019dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.756+0000 7f6036a00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 0x7f604019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 -- 172.21.15.55:0/3267951957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 msgr2=0x7f604019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 0x7f604019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 -- 172.21.15.55:0/3267951957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 msgr2=0x7f604019dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 0x7f604019dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 -- 172.21.15.55:0/3267951957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60401a58d0 con 0x7f6040109770 2024-03-28T08:49:02.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603fe00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f603802c710 tx=0x7f6038035d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038039040 con 0x7f6040109770 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7f6038044070 con 0x7f6040109770 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60401a5b60 con 0x7f6040109770 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.757+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038004530 con 0x7f6040109770 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.758+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60401a60a0 con 0x7f6040109770 2024-03-28T08:49:02.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.759+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604010eee0 con 0x7f6040109770 2024-03-28T08:49:02.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.761+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7f60380327c0 con 0x7f6040109770 2024-03-28T08:49:02.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.763+0000 7f603cc00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 0x7f60240a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:02.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.763+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7f60380f2010 con 0x7f6040109770 2024-03-28T08:49:02.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.763+0000 7f603f400640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 0x7f60240a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:02.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.764+0000 7f603f400640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 0x7f60240a4d40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f604019eb60 tx=0x7f603000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.767+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7f60380be190 con 0x7f6040109770 2024-03-28T08:49:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.972+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60400622a0 con 0x7f6040109770 2024-03-28T08:49:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.973+0000 7f603cc00640 1 -- 172.21.15.55:0/3267951957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60380bda90 con 0x7f6040109770 2024-03-28T08:49:02.974 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-03-28T08:49:02.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 msgr2=0x7f60240a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 0x7f60240a4d40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f604019eb60 tx=0x7f603000b410 comp rx=0 tx=0).stop 2024-03-28T08:49:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 msgr2=0x7f60401a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f603802c710 tx=0x7f6038035d60 comp rx=0 tx=0).stop 2024-03-28T08:49:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 shutdown_connections 2024-03-28T08:49:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7f60240a2880 0x7f60240a4d40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6040109770 0x7f60401a5230 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6040108db0 0x7f604019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 --2- 172.21.15.55:0/3267951957 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6040107bc0 0x7f604019dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.976+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 >> 172.21.15.55:0/3267951957 conn(0x7f6040076b70 msgr2=0x7f604010c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.977+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 shutdown_connections 2024-03-28T08:49:02.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:02.977+0000 7f6044c00640 1 -- 172.21.15.55:0/3267951957 wait complete. 2024-03-28T08:49:02.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T08:49:03.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 -- 172.21.15.55:0/713159719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40104930 msgr2=0x7fda40106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:03.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 --2- 172.21.15.55:0/713159719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40104930 0x7fda40106d20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009900 tx=0x7fda2c02bc30 comp rx=0 tx=0).stop 2024-03-28T08:49:03.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 -- 172.21.15.55:0/713159719 shutdown_connections 2024-03-28T08:49:03.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 --2- 172.21.15.55:0/713159719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40107260 0x7fda401096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 --2- 172.21.15.55:0/713159719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40104930 0x7fda40106d20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 --2- 172.21.15.55:0/713159719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40102000 0x7fda401043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 -- 172.21.15.55:0/713159719 >> 172.21.15.55:0/713159719 conn(0x7fda400fba10 msgr2=0x7fda400fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:03.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 -- 172.21.15.55:0/713159719 shutdown_connections 2024-03-28T08:49:03.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.219+0000 7fda46600640 1 -- 172.21.15.55:0/713159719 wait complete. 2024-03-28T08:49:03.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.220+0000 7fda46600640 1 Processor -- start 2024-03-28T08:49:03.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.220+0000 7fda46600640 1 -- start start 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40102000 0x7fda40199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40104930 0x7fda40199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4010d0c0 con 0x7fda40107260 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4010cf40 con 0x7fda40102000 2024-03-28T08:49:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda46600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4010d240 con 0x7fda40104930 2024-03-28T08:49:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda45c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda45c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59486/0 (socket says 172.21.15.55:59486) 2024-03-28T08:49:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda45c00640 1 -- 172.21.15.55:0/2647720967 learned_addr learned my addr 172.21.15.55:0/2647720967 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-03-28T08:49:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda45200640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40102000 0x7fda40199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.221+0000 7fda3fe00640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40104930 0x7fda40199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 -- 172.21.15.55:0/2647720967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40104930 msgr2=0x7fda40199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40104930 0x7fda40199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 -- 172.21.15.55:0/2647720967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40102000 msgr2=0x7fda40199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40102000 0x7fda40199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 -- 172.21.15.55:0/2647720967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda401a1620 con 0x7fda40107260 2024-03-28T08:49:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda45c00640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fda3800e970 tx=0x7fda3800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:03.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800ccc0 con 0x7fda40107260 2024-03-28T08:49:03.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(26 keys) v1 ==== 1102+0+0 (secure 0 0 0) 0x7fda3800ce60 con 0x7fda40107260 2024-03-28T08:49:03.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38010430 con 0x7fda40107260 2024-03-28T08:49:03.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda401a1910 con 0x7fda40107260 2024-03-28T08:49:03.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.222+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda401a1de0 con 0x7fda40107260 2024-03-28T08:49:03.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.224+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda40108db0 con 0x7fda40107260 2024-03-28T08:49:03.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.225+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 137290+0+0 (secure 0 0 0) 0x7fda38004ff0 con 0x7fda40107260 2024-03-28T08:49:03.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.227+0000 7fda3d600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 0x7fda240a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T08:49:03.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.227+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 12110+0+0 (secure 0 0 0) 0x7fda380cfe20 con 0x7fda40107260 2024-03-28T08:49:03.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.227+0000 7fda45200640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 0x7fda240a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T08:49:03.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.228+0000 7fda45200640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 0x7fda240a4d40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda30005fd0 tx=0x7fda30009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T08:49:03.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.231+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186149 (secure 0 0 0) 0x7fda3809bf40 con 0x7fda40107260 2024-03-28T08:49:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/684301988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10142.972795 secs 2024-03-28T08:49:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:03 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/3267951957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.446+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda4002d070 con 0x7fda40107260 2024-03-28T08:49:03.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.447+0000 7fda3d600640 1 -- 172.21.15.55:0/2647720967 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 100 entries v137) v1 ==== 82+0+6083 (secure 0 0 0) 0x7fda3809b840 con 0x7fda40107260 2024-03-28T08:49:03.448 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/1393918936 2024-03-29T05:59:55.505242+0000 2024-03-28T08:49:03.448 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/1613176231 2024-03-29T05:59:15.134581+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/1613176231 2024-03-29T05:59:15.134581+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/612434037 2024-03-29T05:58:42.146469+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/612434037 2024-03-29T05:58:42.146469+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3622495211 2024-03-29T05:58:25.699033+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/2204223481 2024-03-29T05:58:09.627653+0000 2024-03-28T08:49:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/1908001929 2024-03-29T05:57:52.663538+0000 2024-03-28T08:49:03.450 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/204524138 2024-03-29T05:57:35.896589+0000 2024-03-28T08:49:03.450 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/3187967134 2024-03-29T05:57:20.139153+0000 2024-03-28T08:49:03.450 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/3187967134 2024-03-29T05:57:20.139153+0000 2024-03-28T08:49:03.450 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/373679931 2024-03-29T05:57:03.277162+0000 2024-03-28T08:49:03.450 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/373679931 2024-03-29T05:57:03.277162+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/3865980537 2024-03-29T05:50:41.370316+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/4249379957 2024-03-29T05:49:48.003701+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/215888931 2024-03-29T05:49:25.367679+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/2204223481 2024-03-29T05:58:09.627653+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/1455322102 2024-03-29T05:49:09.295859+0000 2024-03-28T08:49:03.451 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/640673760 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/415139496 2024-03-29T05:48:53.084870+0000 2024-03-28T08:49:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/2066892795 2024-03-29T05:55:13.906711+0000 2024-03-28T08:49:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/3865980537 2024-03-29T05:50:41.370316+0000 2024-03-28T08:49:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2438181589 2024-03-29T05:47:46.823328+0000 2024-03-28T08:49:03.452 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/2069525720 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/3145512970 2024-03-29T05:48:04.092781+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/3421643402 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2356259151 2024-03-29T05:50:08.016835+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/611553321 2024-03-29T05:48:36.542237+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/1393918936 2024-03-29T05:59:55.505242+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/3622495211 2024-03-29T05:58:25.699033+0000 2024-03-28T08:49:03.453 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/1455322102 2024-03-29T05:49:09.295859+0000 2024-03-28T08:49:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/415139496 2024-03-29T05:48:53.084870+0000 2024-03-28T08:49:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2319770671 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1851388624 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/351988265 2024-03-29T05:53:33.150793+0000 2024-03-28T08:49:03.454 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6801/860110821 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/3136791569 2024-03-29T05:51:14.074868+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2422548949 2024-03-29T05:47:14.354410+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/1908001929 2024-03-29T05:57:52.663538+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1849732168 2024-03-29T05:51:30.315374+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/215888931 2024-03-29T05:49:25.367679+0000 2024-03-28T08:49:03.455 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/1562439147 2024-03-29T05:51:46.567552+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/1408496281 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:0/2536988057 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/4249379957 2024-03-29T05:49:48.003701+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/2380583821 2024-03-29T05:54:23.997298+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2356259151 2024-03-29T05:50:08.016835+0000 2024-03-28T08:49:03.456 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/2069525720 2024-03-29T05:33:17.649133+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/721766197 2024-03-29T05:50:24.358116+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2422548949 2024-03-29T05:47:14.354410+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/983243293 2024-03-29T05:56:08.242610+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/959210508 2024-03-29T05:53:13.137279+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/389513488 2024-03-29T05:59:38.374141+0000 2024-03-28T08:49:03.457 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/959210508 2024-03-29T05:53:13.137279+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2686345738 2024-03-29T05:48:20.408882+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/673238495 2024-03-29T05:47:30.299684+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/476442511 2024-03-29T05:55:47.120521+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6836/2438181589 2024-03-29T05:47:46.823328+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/1562439147 2024-03-29T05:51:46.567552+0000 2024-03-28T08:49:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6838/673238495 2024-03-29T05:47:30.299684+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1656241990 2024-03-29T05:50:57.811131+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1656241990 2024-03-29T05:50:57.811131+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/2897824953 2024-03-29T05:52:36.808933+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/2380583821 2024-03-29T05:54:23.997298+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/721766197 2024-03-29T05:50:24.358116+0000 2024-03-28T08:49:03.459 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/3136791569 2024-03-29T05:51:14.074868+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/2126098721 2024-03-29T05:58:58.664827+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1849732168 2024-03-29T05:51:30.315374+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/1144708102 2024-03-29T05:52:03.782565+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/389513488 2024-03-29T05:59:38.374141+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.86:6837/2686345738 2024-03-29T05:48:20.408882+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6835/1144708102 2024-03-29T05:52:03.782565+0000 2024-03-28T08:49:03.460 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/849759534 2024-03-29T05:54:06.906981+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/2251649856 2024-03-29T05:56:24.660056+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/1541753039 2024-03-29T05:52:20.296761+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/1541753039 2024-03-29T05:52:20.296761+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6834/2897824953 2024-03-29T05:52:36.808933+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/983243293 2024-03-29T05:56:08.242610+0000 2024-03-28T08:49:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/3684039614 2024-03-29T05:53:49.841501+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/611553321 2024-03-29T05:48:36.542237+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6832/2520990924 2024-03-29T05:52:54.087844+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/351988265 2024-03-29T05:53:33.150793+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/3684039614 2024-03-29T05:53:49.841501+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/4269934474 2024-03-29T05:54:40.648366+0000 2024-03-28T08:49:03.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/923726251 2024-03-29T05:54:57.121998+0000 2024-03-28T08:49:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/4269934474 2024-03-29T05:54:40.648366+0000 2024-03-28T08:49:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/204524138 2024-03-29T05:57:35.896589+0000 2024-03-28T08:49:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/923726251 2024-03-29T05:54:57.121998+0000 2024-03-28T08:49:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6833/2520990924 2024-03-29T05:52:54.087844+0000 2024-03-28T08:49:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/2066892795 2024-03-29T05:55:13.906711+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6840/1567549774 2024-03-29T05:55:30.389450+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.159:6839/3145512970 2024-03-29T05:48:04.092781+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/1204847109 2024-03-29T05:56:41.647274+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6841/1567549774 2024-03-29T05:55:30.389450+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6800/860110821 2024-03-29T05:32:43.443255+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/476442511 2024-03-29T05:55:47.120521+0000 2024-03-28T08:49:03.464 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6838/849759534 2024-03-29T05:54:06.906981+0000 2024-03-28T08:49:03.465 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6839/2251649856 2024-03-29T05:56:24.660056+0000 2024-03-28T08:49:03.465 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6836/2126098721 2024-03-29T05:58:58.664827+0000 2024-03-28T08:49:03.465 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6837/1204847109 2024-03-29T05:56:41.647274+0000 2024-03-28T08:49:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:listed 100 entries 2024-03-28T08:49:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.450+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 msgr2=0x7fda240a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:03.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.450+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 0x7fda240a4d40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda30005fd0 tx=0x7fda30009680 comp rx=0 tx=0).stop 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.450+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 msgr2=0x7fda401a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.450+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fda3800e970 tx=0x7fda3800ed70 comp rx=0 tx=0).stop 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 shutdown_connections 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:6800/3012677107,v1:172.21.15.55:6801/3012677107] conn(0x7fda240a2880 0x7fda240a4d40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda40107260 0x7fda401a0fb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda40104930 0x7fda40199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 --2- 172.21.15.55:0/2647720967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda40102000 0x7fda40199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T08:49:03.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 >> 172.21.15.55:0/2647720967 conn(0x7fda400fba10 msgr2=0x7fda40101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T08:49:03.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 shutdown_connections 2024-03-28T08:49:03.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-03-28T08:49:03.451+0000 7fda46600640 1 -- 172.21.15.55:0/2647720967 wait complete. 2024-03-28T08:49:03.470 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-03-28T08:49:03.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T08:49:03.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-28T08:49:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2024-03-28T08:49:03.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T08:49:03.568 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi055.front.sepia.ceph.com, aborting... 2024-03-28T08:49:03.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T08:49:03.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-03-28T08:49:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/684301988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10142.972795 secs 2024-03-28T08:49:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:03 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/3267951957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/684301988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-28T08:49:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10142.972795 secs 2024-03-28T08:49:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:03 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/3267951957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-28T08:49:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:04 smithi055 ceph-mon[31863]: pgmap v6205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:49:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:04 smithi055 ceph-mon[31863]: from='client.? 172.21.15.55:0/2647720967' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:04 smithi086 ceph-mon[35163]: pgmap v6205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:49:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:04 smithi086 ceph-mon[35163]: from='client.? 172.21.15.55:0/2647720967' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:04 smithi159 ceph-mon[36109]: pgmap v6205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:49:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:04 smithi159 ceph-mon[36109]: from='client.? 172.21.15.55:0/2647720967' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-28T08:49:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:05 smithi086 ceph-mon[35163]: pgmap v6206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:05 smithi159 ceph-mon[36109]: pgmap v6206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:05 smithi055 ceph-mon[31863]: pgmap v6206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:07 smithi086 ceph-mon[35163]: pgmap v6207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:07 smithi159 ceph-mon[36109]: pgmap v6207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:07 smithi055 ceph-mon[31863]: pgmap v6207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10147.972861 secs 2024-03-28T08:49:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10147.972861 secs 2024-03-28T08:49:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10147.972861 secs 2024-03-28T08:49:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:09 smithi086 ceph-mon[35163]: pgmap v6208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:09 smithi159 ceph-mon[36109]: pgmap v6208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:09 smithi055 ceph-mon[31863]: pgmap v6208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:11 smithi086 ceph-mon[35163]: pgmap v6209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:11 smithi159 ceph-mon[36109]: pgmap v6209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:11 smithi055 ceph-mon[31863]: pgmap v6209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10152.972927 secs 2024-03-28T08:49:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:13 smithi086 ceph-mon[35163]: pgmap v6210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10152.972927 secs 2024-03-28T08:49:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:13 smithi159 ceph-mon[36109]: pgmap v6210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10152.972927 secs 2024-03-28T08:49:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:13 smithi055 ceph-mon[31863]: pgmap v6210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:15 smithi086 ceph-mon[35163]: pgmap v6211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:15 smithi159 ceph-mon[36109]: pgmap v6211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:15 smithi055 ceph-mon[31863]: pgmap v6211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:17 smithi086 ceph-mon[35163]: pgmap v6212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:17 smithi159 ceph-mon[36109]: pgmap v6212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:17 smithi055 ceph-mon[31863]: pgmap v6212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10157.973002 secs 2024-03-28T08:49:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10157.973002 secs 2024-03-28T08:49:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10157.973002 secs 2024-03-28T08:49:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:19 smithi086 ceph-mon[35163]: pgmap v6213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:19 smithi159 ceph-mon[36109]: pgmap v6213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:19 smithi055 ceph-mon[31863]: pgmap v6213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:21 smithi086 ceph-mon[35163]: pgmap v6214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:21 smithi159 ceph-mon[36109]: pgmap v6214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:21 smithi055 ceph-mon[31863]: pgmap v6214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10162.973124 secs 2024-03-28T08:49:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:23 smithi086 ceph-mon[35163]: pgmap v6215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10162.973124 secs 2024-03-28T08:49:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:23 smithi159 ceph-mon[36109]: pgmap v6215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10162.973124 secs 2024-03-28T08:49:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:23 smithi055 ceph-mon[31863]: pgmap v6215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:25 smithi086 ceph-mon[35163]: pgmap v6216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:25 smithi159 ceph-mon[36109]: pgmap v6216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:25 smithi055 ceph-mon[31863]: pgmap v6216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:27 smithi086 ceph-mon[35163]: pgmap v6217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:27 smithi159 ceph-mon[36109]: pgmap v6217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:27 smithi055 ceph-mon[31863]: pgmap v6217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10167.973209 secs 2024-03-28T08:49:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10167.973209 secs 2024-03-28T08:49:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10167.973209 secs 2024-03-28T08:49:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:29 smithi086 ceph-mon[35163]: pgmap v6218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:29 smithi159 ceph-mon[36109]: pgmap v6218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:29 smithi055 ceph-mon[31863]: pgmap v6218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:31 smithi055 ceph-mon[31863]: pgmap v6219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:49:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:31 smithi086 ceph-mon[35163]: pgmap v6219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:49:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:31 smithi159 ceph-mon[36109]: pgmap v6219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:49:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:49:33.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:49:33.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:49:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:49:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:49:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:49:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:49:33.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:49:33.323 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:49:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:49:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:49:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:49:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:49:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: pgmap v6220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: pgmap v6221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:34.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10172.973330 secs 2024-03-28T08:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:49:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:49:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: pgmap v6220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: pgmap v6221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10172.973330 secs 2024-03-28T08:49:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: pgmap v6220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:34.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: pgmap v6221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:34.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10172.973330 secs 2024-03-28T08:49:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:35 smithi055 ceph-mon[31863]: pgmap v6222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:35 smithi086 ceph-mon[35163]: pgmap v6222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:35 smithi159 ceph-mon[36109]: pgmap v6222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:37 smithi055 ceph-mon[31863]: pgmap v6223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:37 smithi086 ceph-mon[35163]: pgmap v6223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:37 smithi159 ceph-mon[36109]: pgmap v6223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10177.973417 secs 2024-03-28T08:49:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10177.973417 secs 2024-03-28T08:49:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10177.973417 secs 2024-03-28T08:49:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:39 smithi086 ceph-mon[35163]: pgmap v6224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:39 smithi159 ceph-mon[36109]: pgmap v6224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:39 smithi055 ceph-mon[31863]: pgmap v6224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:41 smithi086 ceph-mon[35163]: pgmap v6225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:41 smithi159 ceph-mon[36109]: pgmap v6225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:41 smithi055 ceph-mon[31863]: pgmap v6225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:49:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:43 smithi086 ceph-mon[35163]: pgmap v6226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10182.973480 secs 2024-03-28T08:49:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:43 smithi159 ceph-mon[36109]: pgmap v6226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10182.973480 secs 2024-03-28T08:49:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:43 smithi055 ceph-mon[31863]: pgmap v6226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:49:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10182.973480 secs 2024-03-28T08:49:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:45 smithi086 ceph-mon[35163]: pgmap v6227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:45 smithi159 ceph-mon[36109]: pgmap v6227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:45 smithi055 ceph-mon[31863]: pgmap v6227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:47 smithi086 ceph-mon[35163]: pgmap v6228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:47 smithi159 ceph-mon[36109]: pgmap v6228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:47 smithi055 ceph-mon[31863]: pgmap v6228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10187.973545 secs 2024-03-28T08:49:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10187.973545 secs 2024-03-28T08:49:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10187.973545 secs 2024-03-28T08:49:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:49 smithi086 ceph-mon[35163]: pgmap v6229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:49 smithi159 ceph-mon[36109]: pgmap v6229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:49 smithi055 ceph-mon[31863]: pgmap v6229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:51 smithi086 ceph-mon[35163]: pgmap v6230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:51 smithi159 ceph-mon[36109]: pgmap v6230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:51 smithi055 ceph-mon[31863]: pgmap v6230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:49:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10192.973612 secs 2024-03-28T08:49:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10192.973612 secs 2024-03-28T08:49:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10192.973612 secs 2024-03-28T08:49:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:53 smithi086 ceph-mon[35163]: pgmap v6231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:53 smithi159 ceph-mon[36109]: pgmap v6231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:53 smithi055 ceph-mon[31863]: pgmap v6231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:49:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:55 smithi086 ceph-mon[35163]: pgmap v6232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:55 smithi159 ceph-mon[36109]: pgmap v6232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:55 smithi055 ceph-mon[31863]: pgmap v6232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:57 smithi086 ceph-mon[35163]: pgmap v6233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10197.973678 secs 2024-03-28T08:49:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:57 smithi159 ceph-mon[36109]: pgmap v6233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10197.973678 secs 2024-03-28T08:49:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:57 smithi055 ceph-mon[31863]: pgmap v6233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:49:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10197.973678 secs 2024-03-28T08:50:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:49:59 smithi086 ceph-mon[35163]: pgmap v6234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:49:59 smithi159 ceph-mon[36109]: pgmap v6234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:49:59 smithi055 ceph-mon[31863]: pgmap v6234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:50:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:50:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T08:50:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:01 smithi086 ceph-mon[35163]: pgmap v6235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:01 smithi159 ceph-mon[36109]: pgmap v6235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:01 smithi055 ceph-mon[31863]: pgmap v6235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10202.973746 secs 2024-03-28T08:50:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10202.973746 secs 2024-03-28T08:50:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10202.973746 secs 2024-03-28T08:50:04.278 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:04 smithi055 ceph-mon[31863]: pgmap v6236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:04 smithi086 ceph-mon[35163]: pgmap v6236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:04 smithi159 ceph-mon[36109]: pgmap v6236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:06 smithi086 ceph-mon[35163]: pgmap v6237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:06 smithi159 ceph-mon[36109]: pgmap v6237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:06 smithi055 ceph-mon[31863]: pgmap v6237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:08 smithi086 ceph-mon[35163]: pgmap v6238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10207.973816 secs 2024-03-28T08:50:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:08 smithi159 ceph-mon[36109]: pgmap v6238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10207.973816 secs 2024-03-28T08:50:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:08 smithi055 ceph-mon[31863]: pgmap v6238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10207.973816 secs 2024-03-28T08:50:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:10 smithi086 ceph-mon[35163]: pgmap v6239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:10 smithi159 ceph-mon[36109]: pgmap v6239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:10 smithi055 ceph-mon[31863]: pgmap v6239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:12 smithi086 ceph-mon[35163]: pgmap v6240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:12 smithi159 ceph-mon[36109]: pgmap v6240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:12 smithi055 ceph-mon[31863]: pgmap v6240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10212.973937 secs 2024-03-28T08:50:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10212.973937 secs 2024-03-28T08:50:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10212.973937 secs 2024-03-28T08:50:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:14 smithi086 ceph-mon[35163]: pgmap v6241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:14 smithi159 ceph-mon[36109]: pgmap v6241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:14 smithi055 ceph-mon[31863]: pgmap v6241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:16 smithi055 ceph-mon[31863]: pgmap v6242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:16 smithi086 ceph-mon[35163]: pgmap v6242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:16 smithi159 ceph-mon[36109]: pgmap v6242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:18 smithi055 ceph-mon[31863]: pgmap v6243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:18.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10217.974059 secs 2024-03-28T08:50:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:18 smithi086 ceph-mon[35163]: pgmap v6243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10217.974059 secs 2024-03-28T08:50:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:18 smithi159 ceph-mon[36109]: pgmap v6243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10217.974059 secs 2024-03-28T08:50:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:20 smithi055 ceph-mon[31863]: pgmap v6244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:20 smithi086 ceph-mon[35163]: pgmap v6244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:20 smithi159 ceph-mon[36109]: pgmap v6244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:22 smithi055 ceph-mon[31863]: pgmap v6245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:22 smithi086 ceph-mon[35163]: pgmap v6245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:22 smithi159 ceph-mon[36109]: pgmap v6245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:23 smithi055 ceph-mon[31863]: pgmap v6246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10222.974182 secs 2024-03-28T08:50:23.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:23 smithi159 ceph-mon[36109]: pgmap v6246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:23.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10222.974182 secs 2024-03-28T08:50:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:23 smithi086 ceph-mon[35163]: pgmap v6246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10222.974182 secs 2024-03-28T08:50:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:25 smithi086 ceph-mon[35163]: pgmap v6247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:25 smithi159 ceph-mon[36109]: pgmap v6247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:25 smithi055 ceph-mon[31863]: pgmap v6247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:27 smithi159 ceph-mon[36109]: pgmap v6248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:27 smithi086 ceph-mon[35163]: pgmap v6248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:27 smithi055 ceph-mon[31863]: pgmap v6248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10227.974272 secs 2024-03-28T08:50:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10227.974272 secs 2024-03-28T08:50:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10227.974272 secs 2024-03-28T08:50:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:29 smithi086 ceph-mon[35163]: pgmap v6249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:29 smithi159 ceph-mon[36109]: pgmap v6249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:29 smithi055 ceph-mon[31863]: pgmap v6249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:31 smithi086 ceph-mon[35163]: pgmap v6250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:31 smithi159 ceph-mon[36109]: pgmap v6250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:31 smithi055 ceph-mon[31863]: pgmap v6250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:33 smithi086 ceph-mon[35163]: pgmap v6251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10232.974394 secs 2024-03-28T08:50:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:50:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:33 smithi159 ceph-mon[36109]: pgmap v6251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10232.974394 secs 2024-03-28T08:50:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:50:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:33 smithi055 ceph-mon[31863]: pgmap v6251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10232.974394 secs 2024-03-28T08:50:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:50:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.801 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.801 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:50:34.801 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:50:34.801 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:50:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:50:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:50:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:50:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:50:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:50:34.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:50:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:35 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:50:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:35 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:50:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:35 smithi086 ceph-mon[35163]: pgmap v6252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:35 smithi086 ceph-mon[35163]: pgmap v6253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:35 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:50:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:35 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:50:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:35 smithi159 ceph-mon[36109]: pgmap v6252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:35 smithi159 ceph-mon[36109]: pgmap v6253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:35 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T08:50:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:35 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T08:50:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:35 smithi055 ceph-mon[31863]: pgmap v6252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:35 smithi055 ceph-mon[31863]: pgmap v6253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:37 smithi086 ceph-mon[35163]: pgmap v6254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:37 smithi159 ceph-mon[36109]: pgmap v6254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:37 smithi055 ceph-mon[31863]: pgmap v6254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10237.974463 secs 2024-03-28T08:50:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10237.974463 secs 2024-03-28T08:50:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10237.974463 secs 2024-03-28T08:50:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:39 smithi086 ceph-mon[35163]: pgmap v6255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:39 smithi159 ceph-mon[36109]: pgmap v6255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:39 smithi055 ceph-mon[31863]: pgmap v6255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:41 smithi055 ceph-mon[31863]: pgmap v6256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:41 smithi086 ceph-mon[35163]: pgmap v6256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:41 smithi159 ceph-mon[36109]: pgmap v6256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:43 smithi055 ceph-mon[31863]: pgmap v6257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10242.974526 secs 2024-03-28T08:50:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:43 smithi086 ceph-mon[35163]: pgmap v6257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10242.974526 secs 2024-03-28T08:50:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:43 smithi159 ceph-mon[36109]: pgmap v6257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:50:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10242.974526 secs 2024-03-28T08:50:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:45 smithi055 ceph-mon[31863]: pgmap v6258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:50:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:45 smithi086 ceph-mon[35163]: pgmap v6258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:50:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:45 smithi159 ceph-mon[36109]: pgmap v6258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:50:47.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:47 smithi086 ceph-mon[35163]: pgmap v6259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:47 smithi055 ceph-mon[31863]: pgmap v6259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:47 smithi159 ceph-mon[36109]: pgmap v6259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10247.974592 secs 2024-03-28T08:50:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10247.974592 secs 2024-03-28T08:50:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10247.974592 secs 2024-03-28T08:50:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:49 smithi055 ceph-mon[31863]: pgmap v6260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:49 smithi086 ceph-mon[35163]: pgmap v6260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:49 smithi159 ceph-mon[36109]: pgmap v6260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:51 smithi055 ceph-mon[31863]: pgmap v6261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:51 smithi086 ceph-mon[35163]: pgmap v6261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:51 smithi159 ceph-mon[36109]: pgmap v6261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:50:53.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:53 smithi159 ceph-mon[36109]: pgmap v6262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:53.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10252.974679 secs 2024-03-28T08:50:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:53 smithi055 ceph-mon[31863]: pgmap v6262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10252.974679 secs 2024-03-28T08:50:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:53 smithi086 ceph-mon[35163]: pgmap v6262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:50:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10252.974679 secs 2024-03-28T08:50:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:55 smithi086 ceph-mon[35163]: pgmap v6263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:55 smithi159 ceph-mon[36109]: pgmap v6263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:55 smithi055 ceph-mon[31863]: pgmap v6263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:57 smithi086 ceph-mon[35163]: pgmap v6264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:57 smithi159 ceph-mon[36109]: pgmap v6264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:57 smithi055 ceph-mon[31863]: pgmap v6264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:50:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10257.974747 secs 2024-03-28T08:50:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10257.974747 secs 2024-03-28T08:50:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10257.974747 secs 2024-03-28T08:51:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:50:59 smithi086 ceph-mon[35163]: pgmap v6265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:50:59 smithi159 ceph-mon[36109]: pgmap v6265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:50:59 smithi055 ceph-mon[31863]: pgmap v6265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:01 smithi086 ceph-mon[35163]: pgmap v6266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:01 smithi159 ceph-mon[36109]: pgmap v6266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:01 smithi055 ceph-mon[31863]: pgmap v6266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:03 smithi086 ceph-mon[35163]: pgmap v6267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10262.974815 secs 2024-03-28T08:51:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:03 smithi159 ceph-mon[36109]: pgmap v6267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10262.974815 secs 2024-03-28T08:51:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:03 smithi055 ceph-mon[31863]: pgmap v6267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:04.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10262.974815 secs 2024-03-28T08:51:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:05 smithi086 ceph-mon[35163]: pgmap v6268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:05 smithi159 ceph-mon[36109]: pgmap v6268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:05 smithi055 ceph-mon[31863]: pgmap v6268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:07 smithi086 ceph-mon[35163]: pgmap v6269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:07 smithi159 ceph-mon[36109]: pgmap v6269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:07 smithi055 ceph-mon[31863]: pgmap v6269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10267.974910 secs 2024-03-28T08:51:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10267.974910 secs 2024-03-28T08:51:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10267.974910 secs 2024-03-28T08:51:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:09 smithi086 ceph-mon[35163]: pgmap v6270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:09 smithi159 ceph-mon[36109]: pgmap v6270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:09 smithi055 ceph-mon[31863]: pgmap v6270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:11 smithi086 ceph-mon[35163]: pgmap v6271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:11 smithi159 ceph-mon[36109]: pgmap v6271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:11 smithi055 ceph-mon[31863]: pgmap v6271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:13 smithi086 ceph-mon[35163]: pgmap v6272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10272.975034 secs 2024-03-28T08:51:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:13 smithi159 ceph-mon[36109]: pgmap v6272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10272.975034 secs 2024-03-28T08:51:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:13 smithi055 ceph-mon[31863]: pgmap v6272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10272.975034 secs 2024-03-28T08:51:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:15 smithi086 ceph-mon[35163]: pgmap v6273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:15 smithi159 ceph-mon[36109]: pgmap v6273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:15 smithi055 ceph-mon[31863]: pgmap v6273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:17 smithi086 ceph-mon[35163]: pgmap v6274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:17 smithi159 ceph-mon[36109]: pgmap v6274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:17 smithi055 ceph-mon[31863]: pgmap v6274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10277.975113 secs 2024-03-28T08:51:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10277.975113 secs 2024-03-28T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10277.975113 secs 2024-03-28T08:51:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:19 smithi086 ceph-mon[35163]: pgmap v6275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:19 smithi159 ceph-mon[36109]: pgmap v6275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:19 smithi055 ceph-mon[31863]: pgmap v6275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:21 smithi086 ceph-mon[35163]: pgmap v6276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:21 smithi159 ceph-mon[36109]: pgmap v6276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:21 smithi055 ceph-mon[31863]: pgmap v6276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:23 smithi086 ceph-mon[35163]: pgmap v6277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10282.975174 secs 2024-03-28T08:51:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:23 smithi159 ceph-mon[36109]: pgmap v6277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10282.975174 secs 2024-03-28T08:51:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:23 smithi055 ceph-mon[31863]: pgmap v6277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10282.975174 secs 2024-03-28T08:51:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:25 smithi086 ceph-mon[35163]: pgmap v6278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:25 smithi159 ceph-mon[36109]: pgmap v6278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:25 smithi055 ceph-mon[31863]: pgmap v6278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:27 smithi086 ceph-mon[35163]: pgmap v6279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:27 smithi159 ceph-mon[36109]: pgmap v6279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:27 smithi055 ceph-mon[31863]: pgmap v6279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10287.975241 secs 2024-03-28T08:51:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10287.975241 secs 2024-03-28T08:51:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10287.975241 secs 2024-03-28T08:51:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:29 smithi086 ceph-mon[35163]: pgmap v6280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:29 smithi159 ceph-mon[36109]: pgmap v6280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:29 smithi055 ceph-mon[31863]: pgmap v6280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:31 smithi159 ceph-mon[36109]: pgmap v6281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:31 smithi055 ceph-mon[31863]: pgmap v6281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:31 smithi086 ceph-mon[35163]: pgmap v6281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:51:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:33 smithi055 ceph-mon[31863]: pgmap v6282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:34.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10292.975305 secs 2024-03-28T08:51:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:33 smithi086 ceph-mon[35163]: pgmap v6282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10292.975305 secs 2024-03-28T08:51:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:33 smithi159 ceph-mon[36109]: pgmap v6282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10292.975305 secs 2024-03-28T08:51:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:51:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:51:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:51:36.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:35 smithi055 ceph-mon[31863]: pgmap v6283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:35 smithi086 ceph-mon[35163]: pgmap v6283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:35 smithi159 ceph-mon[36109]: pgmap v6283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:51:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:51:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:36 smithi055 ceph-mon[31863]: pgmap v6284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:36 smithi055 ceph-mon[31863]: pgmap v6285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:36 smithi086 ceph-mon[35163]: pgmap v6284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:36 smithi086 ceph-mon[35163]: pgmap v6285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:51:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:51:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:51:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:36 smithi159 ceph-mon[36109]: pgmap v6284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:36 smithi159 ceph-mon[36109]: pgmap v6285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:51:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10297.975429 secs 2024-03-28T08:51:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10297.975429 secs 2024-03-28T08:51:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10297.975429 secs 2024-03-28T08:51:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:39 smithi086 ceph-mon[35163]: pgmap v6286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:39 smithi159 ceph-mon[36109]: pgmap v6286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:39 smithi055 ceph-mon[31863]: pgmap v6286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:41 smithi055 ceph-mon[31863]: pgmap v6287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:51:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:41 smithi086 ceph-mon[35163]: pgmap v6287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:51:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:41 smithi159 ceph-mon[36109]: pgmap v6287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:51:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:43 smithi055 ceph-mon[31863]: pgmap v6288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10302.975515 secs 2024-03-28T08:51:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:43 smithi086 ceph-mon[35163]: pgmap v6288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10302.975515 secs 2024-03-28T08:51:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:43 smithi159 ceph-mon[36109]: pgmap v6288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10302.975515 secs 2024-03-28T08:51:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:45 smithi055 ceph-mon[31863]: pgmap v6289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:45 smithi086 ceph-mon[35163]: pgmap v6289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:45 smithi159 ceph-mon[36109]: pgmap v6289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:47.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:47 smithi086 ceph-mon[35163]: pgmap v6290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:51:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:47 smithi055 ceph-mon[31863]: pgmap v6290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:51:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:47 smithi159 ceph-mon[36109]: pgmap v6290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:51:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10307.975638 secs 2024-03-28T08:51:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:48 smithi086 ceph-mon[35163]: pgmap v6291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10307.975638 secs 2024-03-28T08:51:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:48 smithi159 ceph-mon[36109]: pgmap v6291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10307.975638 secs 2024-03-28T08:51:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:48 smithi055 ceph-mon[31863]: pgmap v6291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:51 smithi055 ceph-mon[31863]: pgmap v6292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:51 smithi086 ceph-mon[35163]: pgmap v6292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:51 smithi159 ceph-mon[36109]: pgmap v6292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:51:53.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:53 smithi159 ceph-mon[36109]: pgmap v6293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:53.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10312.975721 secs 2024-03-28T08:51:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:53 smithi055 ceph-mon[31863]: pgmap v6293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10312.975721 secs 2024-03-28T08:51:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:53 smithi086 ceph-mon[35163]: pgmap v6293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10312.975721 secs 2024-03-28T08:51:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:55 smithi055 ceph-mon[31863]: pgmap v6294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:55 smithi086 ceph-mon[35163]: pgmap v6294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:55 smithi159 ceph-mon[36109]: pgmap v6294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:56 smithi086 ceph-mon[35163]: pgmap v6295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:56 smithi159 ceph-mon[36109]: pgmap v6295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:56 smithi055 ceph-mon[31863]: pgmap v6295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10317.975794 secs 2024-03-28T08:51:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10317.975794 secs 2024-03-28T08:51:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10317.975794 secs 2024-03-28T08:51:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:51:59 smithi086 ceph-mon[35163]: pgmap v6296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:51:59 smithi159 ceph-mon[36109]: pgmap v6296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:51:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:51:59 smithi055 ceph-mon[31863]: pgmap v6296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:01 smithi055 ceph-mon[31863]: pgmap v6297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:01 smithi086 ceph-mon[35163]: pgmap v6297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:01 smithi159 ceph-mon[36109]: pgmap v6297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:03 smithi055 ceph-mon[31863]: pgmap v6298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10322.975884 secs 2024-03-28T08:52:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:03 smithi086 ceph-mon[35163]: pgmap v6298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10322.975884 secs 2024-03-28T08:52:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:03 smithi159 ceph-mon[36109]: pgmap v6298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10322.975884 secs 2024-03-28T08:52:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:04 smithi086 ceph-mon[35163]: pgmap v6299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:04 smithi159 ceph-mon[36109]: pgmap v6299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:04 smithi055 ceph-mon[31863]: pgmap v6299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:07 smithi055 ceph-mon[31863]: pgmap v6300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:07 smithi086 ceph-mon[35163]: pgmap v6300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:07 smithi159 ceph-mon[36109]: pgmap v6300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10327.975965 secs 2024-03-28T08:52:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10327.975965 secs 2024-03-28T08:52:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10327.975965 secs 2024-03-28T08:52:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:09 smithi086 ceph-mon[35163]: pgmap v6301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:09 smithi159 ceph-mon[36109]: pgmap v6301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:09 smithi055 ceph-mon[31863]: pgmap v6301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:10 smithi086 ceph-mon[35163]: pgmap v6302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:10 smithi159 ceph-mon[36109]: pgmap v6302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:10 smithi055 ceph-mon[31863]: pgmap v6302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:13 smithi055 ceph-mon[31863]: pgmap v6303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10332.976042 secs 2024-03-28T08:52:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:13 smithi086 ceph-mon[35163]: pgmap v6303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10332.976042 secs 2024-03-28T08:52:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:13 smithi159 ceph-mon[36109]: pgmap v6303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10332.976042 secs 2024-03-28T08:52:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:15 smithi086 ceph-mon[35163]: pgmap v6304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:15 smithi159 ceph-mon[36109]: pgmap v6304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:15 smithi055 ceph-mon[31863]: pgmap v6304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:16 smithi086 ceph-mon[35163]: pgmap v6305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:16 smithi159 ceph-mon[36109]: pgmap v6305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:16 smithi055 ceph-mon[31863]: pgmap v6305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10337.976122 secs 2024-03-28T08:52:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10337.976122 secs 2024-03-28T08:52:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10337.976122 secs 2024-03-28T08:52:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:19 smithi086 ceph-mon[35163]: pgmap v6306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:19 smithi159 ceph-mon[36109]: pgmap v6306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:19 smithi055 ceph-mon[31863]: pgmap v6306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:20 smithi055 ceph-mon[31863]: pgmap v6307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:20 smithi086 ceph-mon[35163]: pgmap v6307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:20 smithi159 ceph-mon[36109]: pgmap v6307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:23 smithi086 ceph-mon[35163]: pgmap v6308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10342.976187 secs 2024-03-28T08:52:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:23 smithi159 ceph-mon[36109]: pgmap v6308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10342.976187 secs 2024-03-28T08:52:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:23 smithi055 ceph-mon[31863]: pgmap v6308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10342.976187 secs 2024-03-28T08:52:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:24 smithi086 ceph-mon[35163]: pgmap v6309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:24 smithi159 ceph-mon[36109]: pgmap v6309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:24 smithi055 ceph-mon[31863]: pgmap v6309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:27 smithi086 ceph-mon[35163]: pgmap v6310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:27 smithi159 ceph-mon[36109]: pgmap v6310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:27 smithi055 ceph-mon[31863]: pgmap v6310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10347.976254 secs 2024-03-28T08:52:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10347.976254 secs 2024-03-28T08:52:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10347.976254 secs 2024-03-28T08:52:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:29 smithi086 ceph-mon[35163]: pgmap v6311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:29 smithi159 ceph-mon[36109]: pgmap v6311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:29 smithi055 ceph-mon[31863]: pgmap v6311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:30 smithi086 ceph-mon[35163]: pgmap v6312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:30 smithi159 ceph-mon[36109]: pgmap v6312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:30 smithi055 ceph-mon[31863]: pgmap v6312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:33 smithi086 ceph-mon[35163]: pgmap v6313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10352.976372 secs 2024-03-28T08:52:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:33 smithi159 ceph-mon[36109]: pgmap v6313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10352.976372 secs 2024-03-28T08:52:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:33 smithi055 ceph-mon[31863]: pgmap v6313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10352.976372 secs 2024-03-28T08:52:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:34 smithi086 ceph-mon[35163]: pgmap v6314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:34 smithi159 ceph-mon[36109]: pgmap v6314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:34 smithi055 ceph-mon[31863]: pgmap v6314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:37 smithi086 ceph-mon[35163]: pgmap v6315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:52:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:37 smithi159 ceph-mon[36109]: pgmap v6315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:52:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:37 smithi055 ceph-mon[31863]: pgmap v6315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:52:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10357.976444 secs 2024-03-28T08:52:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:38 smithi086 ceph-mon[35163]: pgmap v6316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10357.976444 secs 2024-03-28T08:52:38.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:38 smithi159 ceph-mon[36109]: pgmap v6316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10357.976444 secs 2024-03-28T08:52:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:38 smithi055 ceph-mon[31863]: pgmap v6316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:52:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:52:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:39 smithi086 ceph-mon[35163]: pgmap v6317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:52:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:39 smithi086 ceph-mon[35163]: pgmap v6318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:52:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:52:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:39 smithi159 ceph-mon[36109]: pgmap v6317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:52:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:39 smithi159 ceph-mon[36109]: pgmap v6318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:52:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:52:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:39 smithi055 ceph-mon[31863]: pgmap v6317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:52:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:39 smithi055 ceph-mon[31863]: pgmap v6318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:52:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:41 smithi086 ceph-mon[35163]: pgmap v6319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:41 smithi159 ceph-mon[36109]: pgmap v6319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:41 smithi055 ceph-mon[31863]: pgmap v6319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:52:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10362.976561 secs 2024-03-28T08:52:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:43 smithi086 ceph-mon[35163]: pgmap v6320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10362.976561 secs 2024-03-28T08:52:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:43 smithi159 ceph-mon[36109]: pgmap v6320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10362.976561 secs 2024-03-28T08:52:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:43 smithi055 ceph-mon[31863]: pgmap v6320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:45 smithi055 ceph-mon[31863]: pgmap v6321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:45 smithi086 ceph-mon[35163]: pgmap v6321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:45 smithi159 ceph-mon[36109]: pgmap v6321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:48.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:47 smithi086 ceph-mon[35163]: pgmap v6322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:47 smithi055 ceph-mon[31863]: pgmap v6322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:47 smithi159 ceph-mon[36109]: pgmap v6322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10367.976683 secs 2024-03-28T08:52:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10367.976683 secs 2024-03-28T08:52:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10367.976683 secs 2024-03-28T08:52:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:49 smithi055 ceph-mon[31863]: pgmap v6323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:49 smithi086 ceph-mon[35163]: pgmap v6323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:52:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:49 smithi159 ceph-mon[36109]: pgmap v6323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:52:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:51 smithi055 ceph-mon[31863]: pgmap v6324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:52:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:51 smithi086 ceph-mon[35163]: pgmap v6324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:52:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:51 smithi159 ceph-mon[36109]: pgmap v6324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:52:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10372.976762 secs 2024-03-28T08:52:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:53 smithi086 ceph-mon[35163]: pgmap v6325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10372.976762 secs 2024-03-28T08:52:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:53 smithi159 ceph-mon[36109]: pgmap v6325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10372.976762 secs 2024-03-28T08:52:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:53 smithi055 ceph-mon[31863]: pgmap v6325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:52:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:55 smithi086 ceph-mon[35163]: pgmap v6326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:55 smithi159 ceph-mon[36109]: pgmap v6326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:55 smithi055 ceph-mon[31863]: pgmap v6326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:57 smithi086 ceph-mon[35163]: pgmap v6327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:57 smithi159 ceph-mon[36109]: pgmap v6327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:57 smithi055 ceph-mon[31863]: pgmap v6327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:52:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10377.976861 secs 2024-03-28T08:52:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10377.976861 secs 2024-03-28T08:52:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10377.976861 secs 2024-03-28T08:53:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:52:59 smithi086 ceph-mon[35163]: pgmap v6328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:52:59 smithi159 ceph-mon[36109]: pgmap v6328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:52:59 smithi055 ceph-mon[31863]: pgmap v6328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:01 smithi086 ceph-mon[35163]: pgmap v6329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:01 smithi159 ceph-mon[36109]: pgmap v6329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:01 smithi055 ceph-mon[31863]: pgmap v6329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10382.976939 secs 2024-03-28T08:53:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:03 smithi086 ceph-mon[35163]: pgmap v6330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10382.976939 secs 2024-03-28T08:53:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:03 smithi159 ceph-mon[36109]: pgmap v6330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10382.976939 secs 2024-03-28T08:53:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:03 smithi055 ceph-mon[31863]: pgmap v6330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:05 smithi086 ceph-mon[35163]: pgmap v6331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:05 smithi159 ceph-mon[36109]: pgmap v6331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:05 smithi055 ceph-mon[31863]: pgmap v6331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:07 smithi086 ceph-mon[35163]: pgmap v6332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:07 smithi159 ceph-mon[36109]: pgmap v6332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:07 smithi055 ceph-mon[31863]: pgmap v6332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10387.977060 secs 2024-03-28T08:53:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10387.977060 secs 2024-03-28T08:53:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10387.977060 secs 2024-03-28T08:53:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:09 smithi086 ceph-mon[35163]: pgmap v6333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:09 smithi159 ceph-mon[36109]: pgmap v6333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:09 smithi055 ceph-mon[31863]: pgmap v6333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:11 smithi086 ceph-mon[35163]: pgmap v6334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:11 smithi159 ceph-mon[36109]: pgmap v6334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:11 smithi055 ceph-mon[31863]: pgmap v6334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10392.977130 secs 2024-03-28T08:53:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:13 smithi086 ceph-mon[35163]: pgmap v6335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10392.977130 secs 2024-03-28T08:53:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:13 smithi159 ceph-mon[36109]: pgmap v6335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10392.977130 secs 2024-03-28T08:53:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:13 smithi055 ceph-mon[31863]: pgmap v6335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:15 smithi086 ceph-mon[35163]: pgmap v6336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:15 smithi159 ceph-mon[36109]: pgmap v6336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:15 smithi055 ceph-mon[31863]: pgmap v6336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:17 smithi055 ceph-mon[31863]: pgmap v6337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:17 smithi086 ceph-mon[35163]: pgmap v6337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:17 smithi159 ceph-mon[36109]: pgmap v6337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10397.977209 secs 2024-03-28T08:53:19.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10397.977209 secs 2024-03-28T08:53:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10397.977209 secs 2024-03-28T08:53:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:19 smithi055 ceph-mon[31863]: pgmap v6338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:19 smithi086 ceph-mon[35163]: pgmap v6338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:19 smithi159 ceph-mon[36109]: pgmap v6338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:21 smithi055 ceph-mon[31863]: pgmap v6339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:21 smithi086 ceph-mon[35163]: pgmap v6339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:21 smithi159 ceph-mon[36109]: pgmap v6339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:24.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10402.977296 secs 2024-03-28T08:53:24.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:23 smithi159 ceph-mon[36109]: pgmap v6340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10402.977296 secs 2024-03-28T08:53:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:23 smithi055 ceph-mon[31863]: pgmap v6340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10402.977296 secs 2024-03-28T08:53:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:23 smithi086 ceph-mon[35163]: pgmap v6340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:25 smithi055 ceph-mon[31863]: pgmap v6341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:25 smithi086 ceph-mon[35163]: pgmap v6341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:25 smithi159 ceph-mon[36109]: pgmap v6341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:27 smithi055 ceph-mon[31863]: pgmap v6342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:27 smithi086 ceph-mon[35163]: pgmap v6342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:27 smithi159 ceph-mon[36109]: pgmap v6342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10407.977413 secs 2024-03-28T08:53:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10407.977413 secs 2024-03-28T08:53:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10407.977413 secs 2024-03-28T08:53:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:29 smithi086 ceph-mon[35163]: pgmap v6343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:29 smithi159 ceph-mon[36109]: pgmap v6343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:29 smithi055 ceph-mon[31863]: pgmap v6343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:31 smithi086 ceph-mon[35163]: pgmap v6344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:31 smithi159 ceph-mon[36109]: pgmap v6344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:31 smithi055 ceph-mon[31863]: pgmap v6344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10412.977536 secs 2024-03-28T08:53:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:33 smithi086 ceph-mon[35163]: pgmap v6345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10412.977536 secs 2024-03-28T08:53:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:33 smithi159 ceph-mon[36109]: pgmap v6345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10412.977536 secs 2024-03-28T08:53:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:33 smithi055 ceph-mon[31863]: pgmap v6345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:35 smithi086 ceph-mon[35163]: pgmap v6346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:35 smithi159 ceph-mon[36109]: pgmap v6346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:35 smithi055 ceph-mon[31863]: pgmap v6346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:38.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:37 smithi055 ceph-mon[31863]: pgmap v6347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:37 smithi086 ceph-mon[35163]: pgmap v6347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:37 smithi159 ceph-mon[36109]: pgmap v6347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10417.977655 secs 2024-03-28T08:53:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10417.977655 secs 2024-03-28T08:53:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10417.977655 secs 2024-03-28T08:53:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:39 smithi086 ceph-mon[35163]: pgmap v6348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:53:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:39 smithi159 ceph-mon[36109]: pgmap v6348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:53:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:39 smithi055 ceph-mon[31863]: pgmap v6348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:53:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:41.449 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:41.449 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:42 smithi055 ceph-mon[31863]: pgmap v6349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:42 smithi086 ceph-mon[35163]: pgmap v6349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:42 smithi159 ceph-mon[36109]: pgmap v6349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:53:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10422.977684 secs 2024-03-28T08:53:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10422.977684 secs 2024-03-28T08:53:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10422.977684 secs 2024-03-28T08:53:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:44 smithi086 ceph-mon[35163]: pgmap v6350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:44 smithi159 ceph-mon[36109]: pgmap v6350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:44 smithi055 ceph-mon[31863]: pgmap v6350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:46 smithi086 ceph-mon[35163]: pgmap v6351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:53:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:53:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:46 smithi159 ceph-mon[36109]: pgmap v6351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:53:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:53:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:46 smithi055 ceph-mon[31863]: pgmap v6351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:53:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:53:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:53:46.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:53:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:47 smithi086 ceph-mon[35163]: pgmap v6352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:53:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:47 smithi086 ceph-mon[35163]: pgmap v6353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:53:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:47 smithi159 ceph-mon[36109]: pgmap v6352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:53:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:47 smithi159 ceph-mon[36109]: pgmap v6353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:53:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:47 smithi055 ceph-mon[31863]: pgmap v6352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T08:53:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:47 smithi055 ceph-mon[31863]: pgmap v6353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T08:53:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:48 smithi086 ceph-mon[35163]: pgmap v6354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10427.977808 secs 2024-03-28T08:53:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:48 smithi159 ceph-mon[36109]: pgmap v6354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10427.977808 secs 2024-03-28T08:53:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:48 smithi055 ceph-mon[31863]: pgmap v6354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:53:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10427.977808 secs 2024-03-28T08:53:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:50 smithi086 ceph-mon[35163]: pgmap v6355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:53:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:50 smithi159 ceph-mon[36109]: pgmap v6355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:53:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:50 smithi055 ceph-mon[31863]: pgmap v6355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T08:53:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:52 smithi086 ceph-mon[35163]: pgmap v6356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:52 smithi159 ceph-mon[36109]: pgmap v6356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:52 smithi055 ceph-mon[31863]: pgmap v6356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10432.977845 secs 2024-03-28T08:53:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10432.977845 secs 2024-03-28T08:53:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10432.977845 secs 2024-03-28T08:53:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:54 smithi086 ceph-mon[35163]: pgmap v6357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:54 smithi159 ceph-mon[36109]: pgmap v6357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:54 smithi055 ceph-mon[31863]: pgmap v6357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T08:53:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:56 smithi086 ceph-mon[35163]: pgmap v6358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:53:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:56 smithi159 ceph-mon[36109]: pgmap v6358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:53:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:56 smithi055 ceph-mon[31863]: pgmap v6358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T08:53:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:58 smithi086 ceph-mon[35163]: pgmap v6359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:53:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:53:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10437.977931 secs 2024-03-28T08:53:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:58 smithi159 ceph-mon[36109]: pgmap v6359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:53:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:53:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10437.977931 secs 2024-03-28T08:53:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:58 smithi055 ceph-mon[31863]: pgmap v6359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:53:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:53:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10437.977931 secs 2024-03-28T08:54:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:00 smithi086 ceph-mon[35163]: pgmap v6360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:00 smithi159 ceph-mon[36109]: pgmap v6360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:00 smithi055 ceph-mon[31863]: pgmap v6360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:02 smithi086 ceph-mon[35163]: pgmap v6361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:02 smithi159 ceph-mon[36109]: pgmap v6361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:02 smithi055 ceph-mon[31863]: pgmap v6361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:54:03.578 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-03-28T08:54:03.586 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-03-28T08:54:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10442.977997 secs 2024-03-28T08:54:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10442.977997 secs 2024-03-28T08:54:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10442.977997 secs 2024-03-28T08:54:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:04 smithi086 ceph-mon[35163]: pgmap v6362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:04 smithi159 ceph-mon[36109]: pgmap v6362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:04 smithi055 ceph-mon[31863]: pgmap v6362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:06 smithi086 ceph-mon[35163]: pgmap v6363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:06 smithi159 ceph-mon[36109]: pgmap v6363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:06 smithi055 ceph-mon[31863]: pgmap v6363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:08 smithi086 ceph-mon[35163]: pgmap v6364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10447.978062 secs 2024-03-28T08:54:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:08 smithi159 ceph-mon[36109]: pgmap v6364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10447.978062 secs 2024-03-28T08:54:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:08 smithi055 ceph-mon[31863]: pgmap v6364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10447.978062 secs 2024-03-28T08:54:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:10 smithi086 ceph-mon[35163]: pgmap v6365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:10 smithi159 ceph-mon[36109]: pgmap v6365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:10 smithi055 ceph-mon[31863]: pgmap v6365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:12 smithi086 ceph-mon[35163]: pgmap v6366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:12 smithi159 ceph-mon[36109]: pgmap v6366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:12 smithi055 ceph-mon[31863]: pgmap v6366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10452.978148 secs 2024-03-28T08:54:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10452.978148 secs 2024-03-28T08:54:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10452.978148 secs 2024-03-28T08:54:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:14 smithi055 ceph-mon[31863]: pgmap v6367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:14 smithi086 ceph-mon[35163]: pgmap v6367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:14 smithi159 ceph-mon[36109]: pgmap v6367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:16 smithi086 ceph-mon[35163]: pgmap v6368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:16 smithi159 ceph-mon[36109]: pgmap v6368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:16 smithi055 ceph-mon[31863]: pgmap v6368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:18 smithi086 ceph-mon[35163]: pgmap v6369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10457.978214 secs 2024-03-28T08:54:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:18 smithi159 ceph-mon[36109]: pgmap v6369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10457.978214 secs 2024-03-28T08:54:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:18 smithi055 ceph-mon[31863]: pgmap v6369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10457.978214 secs 2024-03-28T08:54:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:20 smithi086 ceph-mon[35163]: pgmap v6370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:20 smithi159 ceph-mon[36109]: pgmap v6370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:20 smithi055 ceph-mon[31863]: pgmap v6370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:22 smithi086 ceph-mon[35163]: pgmap v6371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:22 smithi159 ceph-mon[36109]: pgmap v6371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:22 smithi055 ceph-mon[31863]: pgmap v6371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10462.978336 secs 2024-03-28T08:54:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10462.978336 secs 2024-03-28T08:54:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10462.978336 secs 2024-03-28T08:54:24.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:24 smithi159 ceph-mon[36109]: pgmap v6372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:24 smithi086 ceph-mon[35163]: pgmap v6372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:24 smithi055 ceph-mon[31863]: pgmap v6372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:26 smithi086 ceph-mon[35163]: pgmap v6373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:26 smithi159 ceph-mon[36109]: pgmap v6373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:26 smithi055 ceph-mon[31863]: pgmap v6373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:28 smithi086 ceph-mon[35163]: pgmap v6374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10467.978459 secs 2024-03-28T08:54:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:28 smithi159 ceph-mon[36109]: pgmap v6374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10467.978459 secs 2024-03-28T08:54:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:28 smithi055 ceph-mon[31863]: pgmap v6374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10467.978459 secs 2024-03-28T08:54:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:30 smithi086 ceph-mon[35163]: pgmap v6375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:30 smithi159 ceph-mon[36109]: pgmap v6375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:30 smithi055 ceph-mon[31863]: pgmap v6375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:32 smithi086 ceph-mon[35163]: pgmap v6376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:32 smithi159 ceph-mon[36109]: pgmap v6376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:32 smithi055 ceph-mon[31863]: pgmap v6376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10472.978582 secs 2024-03-28T08:54:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10472.978582 secs 2024-03-28T08:54:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10472.978582 secs 2024-03-28T08:54:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:34 smithi086 ceph-mon[35163]: pgmap v6377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:34 smithi159 ceph-mon[36109]: pgmap v6377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:34 smithi055 ceph-mon[31863]: pgmap v6377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:36 smithi086 ceph-mon[35163]: pgmap v6378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:36 smithi159 ceph-mon[36109]: pgmap v6378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:36 smithi055 ceph-mon[31863]: pgmap v6378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:38 smithi086 ceph-mon[35163]: pgmap v6379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10477.978655 secs 2024-03-28T08:54:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:38 smithi159 ceph-mon[36109]: pgmap v6379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10477.978655 secs 2024-03-28T08:54:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:38 smithi055 ceph-mon[31863]: pgmap v6379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10477.978655 secs 2024-03-28T08:54:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:40 smithi086 ceph-mon[35163]: pgmap v6380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:40 smithi159 ceph-mon[36109]: pgmap v6380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:40 smithi055 ceph-mon[31863]: pgmap v6380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:42 smithi086 ceph-mon[35163]: pgmap v6381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:42 smithi159 ceph-mon[36109]: pgmap v6381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:42 smithi055 ceph-mon[31863]: pgmap v6381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10482.978805 secs 2024-03-28T08:54:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10482.978805 secs 2024-03-28T08:54:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10482.978805 secs 2024-03-28T08:54:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:44 smithi086 ceph-mon[35163]: pgmap v6382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:44 smithi159 ceph-mon[36109]: pgmap v6382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:44 smithi055 ceph-mon[31863]: pgmap v6382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:46 smithi086 ceph-mon[35163]: pgmap v6383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:54:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:46 smithi159 ceph-mon[36109]: pgmap v6383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:54:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:46 smithi055 ceph-mon[31863]: pgmap v6383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:54:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:54:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:54:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:54:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:47 smithi086 ceph-mon[35163]: pgmap v6384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:47 smithi086 ceph-mon[35163]: pgmap v6385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:54:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:54:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:54:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:47 smithi159 ceph-mon[36109]: pgmap v6384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:47 smithi159 ceph-mon[36109]: pgmap v6385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:54:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:54:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:54:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:47 smithi055 ceph-mon[31863]: pgmap v6384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:54:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:47 smithi055 ceph-mon[31863]: pgmap v6385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:54:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10487.978837 secs 2024-03-28T08:54:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10487.978837 secs 2024-03-28T08:54:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10487.978837 secs 2024-03-28T08:54:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:49 smithi055 ceph-mon[31863]: pgmap v6386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:49 smithi086 ceph-mon[35163]: pgmap v6386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:49 smithi159 ceph-mon[36109]: pgmap v6386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:51 smithi086 ceph-mon[35163]: pgmap v6387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:51 smithi159 ceph-mon[36109]: pgmap v6387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:51 smithi055 ceph-mon[31863]: pgmap v6387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10492.978913 secs 2024-03-28T08:54:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10492.978913 secs 2024-03-28T08:54:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10492.978913 secs 2024-03-28T08:54:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:54 smithi086 ceph-mon[35163]: pgmap v6388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:54 smithi159 ceph-mon[36109]: pgmap v6388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:54 smithi055 ceph-mon[31863]: pgmap v6388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:55 smithi086 ceph-mon[35163]: pgmap v6389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:54:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:55 smithi159 ceph-mon[36109]: pgmap v6389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:54:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:55 smithi055 ceph-mon[31863]: pgmap v6389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:54:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:57 smithi086 ceph-mon[35163]: pgmap v6390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:54:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:57 smithi159 ceph-mon[36109]: pgmap v6390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:54:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:57 smithi055 ceph-mon[31863]: pgmap v6390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:54:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10497.979005 secs 2024-03-28T08:54:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10497.979005 secs 2024-03-28T08:54:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10497.979005 secs 2024-03-28T08:54:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:54:59 smithi086 ceph-mon[35163]: pgmap v6391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:54:59 smithi159 ceph-mon[36109]: pgmap v6391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:54:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:54:59 smithi055 ceph-mon[31863]: pgmap v6391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:01 smithi086 ceph-mon[35163]: pgmap v6392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:01 smithi159 ceph-mon[36109]: pgmap v6392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:01 smithi055 ceph-mon[31863]: pgmap v6392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10502.979071 secs 2024-03-28T08:55:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10502.979071 secs 2024-03-28T08:55:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10502.979071 secs 2024-03-28T08:55:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:04 smithi086 ceph-mon[35163]: pgmap v6393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:04 smithi159 ceph-mon[36109]: pgmap v6393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:04 smithi055 ceph-mon[31863]: pgmap v6393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:05 smithi086 ceph-mon[35163]: pgmap v6394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:05 smithi159 ceph-mon[36109]: pgmap v6394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:05 smithi055 ceph-mon[31863]: pgmap v6394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:07 smithi086 ceph-mon[35163]: pgmap v6395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:07 smithi159 ceph-mon[36109]: pgmap v6395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:07 smithi055 ceph-mon[31863]: pgmap v6395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:08.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10507.979146 secs 2024-03-28T08:55:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10507.979146 secs 2024-03-28T08:55:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10507.979146 secs 2024-03-28T08:55:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:09 smithi086 ceph-mon[35163]: pgmap v6396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:09 smithi159 ceph-mon[36109]: pgmap v6396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:09 smithi055 ceph-mon[31863]: pgmap v6396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:11 smithi086 ceph-mon[35163]: pgmap v6397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:11 smithi159 ceph-mon[36109]: pgmap v6397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:11 smithi055 ceph-mon[31863]: pgmap v6397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10512.979222 secs 2024-03-28T08:55:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10512.979222 secs 2024-03-28T08:55:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10512.979222 secs 2024-03-28T08:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:14 smithi086 ceph-mon[35163]: pgmap v6398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:14 smithi159 ceph-mon[36109]: pgmap v6398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:14 smithi055 ceph-mon[31863]: pgmap v6398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:15 smithi086 ceph-mon[35163]: pgmap v6399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:15 smithi159 ceph-mon[36109]: pgmap v6399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:15 smithi055 ceph-mon[31863]: pgmap v6399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:17 smithi086 ceph-mon[35163]: pgmap v6400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:17 smithi159 ceph-mon[36109]: pgmap v6400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:17 smithi055 ceph-mon[31863]: pgmap v6400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10517.979286 secs 2024-03-28T08:55:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10517.979286 secs 2024-03-28T08:55:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10517.979286 secs 2024-03-28T08:55:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:19 smithi086 ceph-mon[35163]: pgmap v6401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:19 smithi159 ceph-mon[36109]: pgmap v6401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:19 smithi055 ceph-mon[31863]: pgmap v6401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:21 smithi086 ceph-mon[35163]: pgmap v6402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:21 smithi159 ceph-mon[36109]: pgmap v6402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:21 smithi055 ceph-mon[31863]: pgmap v6402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10522.979411 secs 2024-03-28T08:55:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10522.979411 secs 2024-03-28T08:55:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10522.979411 secs 2024-03-28T08:55:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:24 smithi086 ceph-mon[35163]: pgmap v6403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:24 smithi159 ceph-mon[36109]: pgmap v6403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:24 smithi055 ceph-mon[31863]: pgmap v6403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:25 smithi086 ceph-mon[35163]: pgmap v6404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:25 smithi159 ceph-mon[36109]: pgmap v6404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:25 smithi055 ceph-mon[31863]: pgmap v6404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:27 smithi086 ceph-mon[35163]: pgmap v6405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:27 smithi159 ceph-mon[36109]: pgmap v6405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:27 smithi055 ceph-mon[31863]: pgmap v6405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10527.979534 secs 2024-03-28T08:55:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10527.979534 secs 2024-03-28T08:55:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10527.979534 secs 2024-03-28T08:55:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:29 smithi086 ceph-mon[35163]: pgmap v6406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:29 smithi159 ceph-mon[36109]: pgmap v6406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:29 smithi055 ceph-mon[31863]: pgmap v6406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:31 smithi086 ceph-mon[35163]: pgmap v6407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:31 smithi159 ceph-mon[36109]: pgmap v6407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:31 smithi055 ceph-mon[31863]: pgmap v6407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10532.979624 secs 2024-03-28T08:55:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10532.979624 secs 2024-03-28T08:55:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10532.979624 secs 2024-03-28T08:55:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:34 smithi086 ceph-mon[35163]: pgmap v6408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:34 smithi159 ceph-mon[36109]: pgmap v6408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:34 smithi055 ceph-mon[31863]: pgmap v6408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:35 smithi086 ceph-mon[35163]: pgmap v6409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:35 smithi159 ceph-mon[36109]: pgmap v6409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:35 smithi055 ceph-mon[31863]: pgmap v6409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:37 smithi086 ceph-mon[35163]: pgmap v6410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:37 smithi159 ceph-mon[36109]: pgmap v6410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:37 smithi055 ceph-mon[31863]: pgmap v6410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:38.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10537.979747 secs 2024-03-28T08:55:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10537.979747 secs 2024-03-28T08:55:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10537.979747 secs 2024-03-28T08:55:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:39 smithi086 ceph-mon[35163]: pgmap v6411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:39 smithi159 ceph-mon[36109]: pgmap v6411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:39 smithi055 ceph-mon[31863]: pgmap v6411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:42 smithi086 ceph-mon[35163]: pgmap v6412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:42 smithi159 ceph-mon[36109]: pgmap v6412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:42 smithi055 ceph-mon[31863]: pgmap v6412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10542.979871 secs 2024-03-28T08:55:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10542.979871 secs 2024-03-28T08:55:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10542.979871 secs 2024-03-28T08:55:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:44 smithi086 ceph-mon[35163]: pgmap v6413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:44 smithi159 ceph-mon[36109]: pgmap v6413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:44 smithi055 ceph-mon[31863]: pgmap v6413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:46 smithi086 ceph-mon[35163]: pgmap v6414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:46 smithi159 ceph-mon[36109]: pgmap v6414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:46 smithi055 ceph-mon[31863]: pgmap v6414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:55:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:48 smithi086 ceph-mon[35163]: pgmap v6415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:55:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10547.979992 secs 2024-03-28T08:55:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:48 smithi159 ceph-mon[36109]: pgmap v6415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:55:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10547.979992 secs 2024-03-28T08:55:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:48 smithi055 ceph-mon[31863]: pgmap v6415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:55:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10547.979992 secs 2024-03-28T08:55:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:55:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:55:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:49 smithi086 ceph-mon[35163]: pgmap v6416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:49 smithi086 ceph-mon[35163]: pgmap v6417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:55:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:55:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:55:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:49 smithi159 ceph-mon[36109]: pgmap v6416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:49 smithi159 ceph-mon[36109]: pgmap v6417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:55:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:55:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:55:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:49 smithi055 ceph-mon[31863]: pgmap v6416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:49 smithi055 ceph-mon[31863]: pgmap v6417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:49.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:55:52.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:51 smithi086 ceph-mon[35163]: pgmap v6418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:51 smithi159 ceph-mon[36109]: pgmap v6418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:51 smithi055 ceph-mon[31863]: pgmap v6418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10552.980017 secs 2024-03-28T08:55:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:53 smithi086 ceph-mon[35163]: pgmap v6419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10552.980017 secs 2024-03-28T08:55:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:53 smithi159 ceph-mon[36109]: pgmap v6419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10552.980017 secs 2024-03-28T08:55:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:53 smithi055 ceph-mon[31863]: pgmap v6419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:55 smithi086 ceph-mon[35163]: pgmap v6420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:55 smithi159 ceph-mon[36109]: pgmap v6420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:55 smithi055 ceph-mon[31863]: pgmap v6420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:57 smithi086 ceph-mon[35163]: pgmap v6421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:57 smithi159 ceph-mon[36109]: pgmap v6421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:57 smithi055 ceph-mon[31863]: pgmap v6421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:55:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10557.980083 secs 2024-03-28T08:55:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10557.980083 secs 2024-03-28T08:55:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10557.980083 secs 2024-03-28T08:56:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:55:59 smithi086 ceph-mon[35163]: pgmap v6422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:55:59 smithi159 ceph-mon[36109]: pgmap v6422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:55:59 smithi055 ceph-mon[31863]: pgmap v6422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:01 smithi086 ceph-mon[35163]: pgmap v6423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:01 smithi159 ceph-mon[36109]: pgmap v6423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:01 smithi055 ceph-mon[31863]: pgmap v6423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10562.980173 secs 2024-03-28T08:56:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10562.980173 secs 2024-03-28T08:56:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10562.980173 secs 2024-03-28T08:56:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:04 smithi086 ceph-mon[35163]: pgmap v6424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:04 smithi159 ceph-mon[36109]: pgmap v6424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:04 smithi055 ceph-mon[31863]: pgmap v6424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:06 smithi086 ceph-mon[35163]: pgmap v6425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:06 smithi159 ceph-mon[36109]: pgmap v6425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:06 smithi055 ceph-mon[31863]: pgmap v6425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:08 smithi086 ceph-mon[35163]: pgmap v6426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10567.980293 secs 2024-03-28T08:56:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:08 smithi159 ceph-mon[36109]: pgmap v6426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10567.980293 secs 2024-03-28T08:56:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:08 smithi055 ceph-mon[31863]: pgmap v6426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10567.980293 secs 2024-03-28T08:56:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:10 smithi055 ceph-mon[31863]: pgmap v6427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:10 smithi086 ceph-mon[35163]: pgmap v6427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:10 smithi159 ceph-mon[36109]: pgmap v6427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:12 smithi055 ceph-mon[31863]: pgmap v6428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:12 smithi086 ceph-mon[35163]: pgmap v6428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:12 smithi159 ceph-mon[36109]: pgmap v6428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10572.980414 secs 2024-03-28T08:56:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10572.980414 secs 2024-03-28T08:56:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10572.980414 secs 2024-03-28T08:56:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:14 smithi055 ceph-mon[31863]: pgmap v6429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:14 smithi086 ceph-mon[35163]: pgmap v6429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:14 smithi159 ceph-mon[36109]: pgmap v6429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:16 smithi055 ceph-mon[31863]: pgmap v6430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:16 smithi086 ceph-mon[35163]: pgmap v6430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:16 smithi159 ceph-mon[36109]: pgmap v6430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:18 smithi055 ceph-mon[31863]: pgmap v6431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10577.980444 secs 2024-03-28T08:56:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:18 smithi086 ceph-mon[35163]: pgmap v6431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10577.980444 secs 2024-03-28T08:56:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:18 smithi159 ceph-mon[36109]: pgmap v6431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10577.980444 secs 2024-03-28T08:56:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:20 smithi086 ceph-mon[35163]: pgmap v6432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:20 smithi159 ceph-mon[36109]: pgmap v6432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:20 smithi055 ceph-mon[31863]: pgmap v6432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:22 smithi086 ceph-mon[35163]: pgmap v6433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:22 smithi159 ceph-mon[36109]: pgmap v6433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:22 smithi055 ceph-mon[31863]: pgmap v6433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10582.980967 secs 2024-03-28T08:56:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10582.980967 secs 2024-03-28T08:56:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10582.980967 secs 2024-03-28T08:56:24.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:24 smithi159 ceph-mon[36109]: pgmap v6434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:24 smithi086 ceph-mon[35163]: pgmap v6434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:24 smithi055 ceph-mon[31863]: pgmap v6434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:26 smithi086 ceph-mon[35163]: pgmap v6435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:56:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:26 smithi159 ceph-mon[36109]: pgmap v6435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:56:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:26 smithi055 ceph-mon[31863]: pgmap v6435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:56:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:28 smithi086 ceph-mon[35163]: pgmap v6436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10587.981093 secs 2024-03-28T08:56:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:28 smithi159 ceph-mon[36109]: pgmap v6436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10587.981093 secs 2024-03-28T08:56:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:28 smithi055 ceph-mon[31863]: pgmap v6436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10587.981093 secs 2024-03-28T08:56:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:30 smithi086 ceph-mon[35163]: pgmap v6437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:30 smithi159 ceph-mon[36109]: pgmap v6437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:30 smithi055 ceph-mon[31863]: pgmap v6437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:31 smithi086 ceph-mon[35163]: pgmap v6438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:31 smithi159 ceph-mon[36109]: pgmap v6438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:31 smithi055 ceph-mon[31863]: pgmap v6438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10592.981218 secs 2024-03-28T08:56:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:33 smithi086 ceph-mon[35163]: pgmap v6439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10592.981218 secs 2024-03-28T08:56:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:33 smithi159 ceph-mon[36109]: pgmap v6439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10592.981218 secs 2024-03-28T08:56:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:33 smithi055 ceph-mon[31863]: pgmap v6439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:35 smithi086 ceph-mon[35163]: pgmap v6440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:35 smithi159 ceph-mon[36109]: pgmap v6440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:35 smithi055 ceph-mon[31863]: pgmap v6440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:37 smithi086 ceph-mon[35163]: pgmap v6441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:37 smithi159 ceph-mon[36109]: pgmap v6441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:37 smithi055 ceph-mon[31863]: pgmap v6441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10597.981343 secs 2024-03-28T08:56:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10597.981343 secs 2024-03-28T08:56:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10597.981343 secs 2024-03-28T08:56:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:40 smithi086 ceph-mon[35163]: pgmap v6442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:40 smithi159 ceph-mon[36109]: pgmap v6442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:40 smithi055 ceph-mon[31863]: pgmap v6442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:42 smithi086 ceph-mon[35163]: pgmap v6443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:42 smithi159 ceph-mon[36109]: pgmap v6443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:42 smithi055 ceph-mon[31863]: pgmap v6443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10602.981460 secs 2024-03-28T08:56:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10602.981460 secs 2024-03-28T08:56:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10602.981460 secs 2024-03-28T08:56:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:44 smithi086 ceph-mon[35163]: pgmap v6444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:44 smithi159 ceph-mon[36109]: pgmap v6444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:44 smithi055 ceph-mon[31863]: pgmap v6444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:46 smithi086 ceph-mon[35163]: pgmap v6445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:46 smithi159 ceph-mon[36109]: pgmap v6445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:46 smithi055 ceph-mon[31863]: pgmap v6445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:56:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:48 smithi086 ceph-mon[35163]: pgmap v6446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10607.981589 secs 2024-03-28T08:56:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:48 smithi159 ceph-mon[36109]: pgmap v6446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10607.981589 secs 2024-03-28T08:56:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:48 smithi055 ceph-mon[31863]: pgmap v6446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10607.981589 secs 2024-03-28T08:56:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:50 smithi086 ceph-mon[35163]: pgmap v6447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:56:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:50 smithi159 ceph-mon[36109]: pgmap v6447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:56:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:50 smithi055 ceph-mon[31863]: pgmap v6447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:56:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:56:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:56:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:56:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:56:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:56:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:56:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:56:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:56:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:56:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:56:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:52 smithi055 ceph-mon[31863]: pgmap v6448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:56:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:52 smithi055 ceph-mon[31863]: pgmap v6449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:52 smithi086 ceph-mon[35163]: pgmap v6448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:56:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:52 smithi086 ceph-mon[35163]: pgmap v6449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:52 smithi159 ceph-mon[36109]: pgmap v6448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:56:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:52 smithi159 ceph-mon[36109]: pgmap v6449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10612.981671 secs 2024-03-28T08:56:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10612.981671 secs 2024-03-28T08:56:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10612.981671 secs 2024-03-28T08:56:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:54 smithi055 ceph-mon[31863]: pgmap v6450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T08:56:54.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:54 smithi159 ceph-mon[36109]: pgmap v6450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T08:56:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:54 smithi086 ceph-mon[35163]: pgmap v6450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T08:56:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:56 smithi055 ceph-mon[31863]: pgmap v6451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:56 smithi086 ceph-mon[35163]: pgmap v6451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:56 smithi159 ceph-mon[36109]: pgmap v6451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:58 smithi055 ceph-mon[31863]: pgmap v6452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:56:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10617.981826 secs 2024-03-28T08:56:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:58 smithi086 ceph-mon[35163]: pgmap v6452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:56:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10617.981826 secs 2024-03-28T08:56:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:58 smithi159 ceph-mon[36109]: pgmap v6452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:56:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:56:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10617.981826 secs 2024-03-28T08:57:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:00 smithi055 ceph-mon[31863]: pgmap v6453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:00 smithi086 ceph-mon[35163]: pgmap v6453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:00 smithi159 ceph-mon[36109]: pgmap v6453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:02 smithi055 ceph-mon[31863]: pgmap v6454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:02 smithi086 ceph-mon[35163]: pgmap v6454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:02 smithi159 ceph-mon[36109]: pgmap v6454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:57:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10622.981949 secs 2024-03-28T08:57:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10622.981949 secs 2024-03-28T08:57:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10622.981949 secs 2024-03-28T08:57:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:04 smithi086 ceph-mon[35163]: pgmap v6455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:04 smithi159 ceph-mon[36109]: pgmap v6455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:04 smithi055 ceph-mon[31863]: pgmap v6455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:06 smithi086 ceph-mon[35163]: pgmap v6456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:06 smithi159 ceph-mon[36109]: pgmap v6456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:06 smithi055 ceph-mon[31863]: pgmap v6456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:08.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:08 smithi055 ceph-mon[31863]: pgmap v6457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:08.427 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10627.982064 secs 2024-03-28T08:57:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:08 smithi086 ceph-mon[35163]: pgmap v6457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10627.982064 secs 2024-03-28T08:57:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:08 smithi159 ceph-mon[36109]: pgmap v6457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10627.982064 secs 2024-03-28T08:57:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:10 smithi086 ceph-mon[35163]: pgmap v6458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:10 smithi159 ceph-mon[36109]: pgmap v6458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:10 smithi055 ceph-mon[31863]: pgmap v6458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:12 smithi086 ceph-mon[35163]: pgmap v6459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:12 smithi159 ceph-mon[36109]: pgmap v6459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:12 smithi055 ceph-mon[31863]: pgmap v6459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10632.982156 secs 2024-03-28T08:57:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10632.982156 secs 2024-03-28T08:57:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10632.982156 secs 2024-03-28T08:57:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:14 smithi086 ceph-mon[35163]: pgmap v6460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:14 smithi159 ceph-mon[36109]: pgmap v6460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:14 smithi055 ceph-mon[31863]: pgmap v6460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:16 smithi086 ceph-mon[35163]: pgmap v6461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:16 smithi159 ceph-mon[36109]: pgmap v6461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:16 smithi055 ceph-mon[31863]: pgmap v6461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:18 smithi086 ceph-mon[35163]: pgmap v6462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10637.982291 secs 2024-03-28T08:57:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:18 smithi159 ceph-mon[36109]: pgmap v6462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10637.982291 secs 2024-03-28T08:57:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:18 smithi055 ceph-mon[31863]: pgmap v6462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10637.982291 secs 2024-03-28T08:57:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:20 smithi086 ceph-mon[35163]: pgmap v6463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:20 smithi159 ceph-mon[36109]: pgmap v6463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:20 smithi055 ceph-mon[31863]: pgmap v6463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:22 smithi086 ceph-mon[35163]: pgmap v6464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:22 smithi159 ceph-mon[36109]: pgmap v6464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:22 smithi055 ceph-mon[31863]: pgmap v6464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10642.982415 secs 2024-03-28T08:57:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:23 smithi086 ceph-mon[35163]: pgmap v6465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10642.982415 secs 2024-03-28T08:57:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:23 smithi159 ceph-mon[36109]: pgmap v6465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10642.982415 secs 2024-03-28T08:57:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:23 smithi055 ceph-mon[31863]: pgmap v6465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:25 smithi086 ceph-mon[35163]: pgmap v6466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:25 smithi159 ceph-mon[36109]: pgmap v6466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:25 smithi055 ceph-mon[31863]: pgmap v6466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:27 smithi086 ceph-mon[35163]: pgmap v6467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:27 smithi159 ceph-mon[36109]: pgmap v6467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:27 smithi055 ceph-mon[31863]: pgmap v6467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10647.982545 secs 2024-03-28T08:57:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10647.982545 secs 2024-03-28T08:57:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10647.982545 secs 2024-03-28T08:57:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:29 smithi055 ceph-mon[31863]: pgmap v6468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:29 smithi086 ceph-mon[35163]: pgmap v6468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:29 smithi159 ceph-mon[36109]: pgmap v6468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:31 smithi055 ceph-mon[31863]: pgmap v6469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:31 smithi086 ceph-mon[35163]: pgmap v6469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:31 smithi159 ceph-mon[36109]: pgmap v6469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10652.982610 secs 2024-03-28T08:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:33 smithi055 ceph-mon[31863]: pgmap v6470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10652.982610 secs 2024-03-28T08:57:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:33 smithi086 ceph-mon[35163]: pgmap v6470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10652.982610 secs 2024-03-28T08:57:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:33 smithi159 ceph-mon[36109]: pgmap v6470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:35 smithi055 ceph-mon[31863]: pgmap v6471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:35 smithi086 ceph-mon[35163]: pgmap v6471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:35 smithi159 ceph-mon[36109]: pgmap v6471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:37 smithi055 ceph-mon[31863]: pgmap v6472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:37 smithi086 ceph-mon[35163]: pgmap v6472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:37 smithi159 ceph-mon[36109]: pgmap v6472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10657.982703 secs 2024-03-28T08:57:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10657.982703 secs 2024-03-28T08:57:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10657.982703 secs 2024-03-28T08:57:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:39 smithi055 ceph-mon[31863]: pgmap v6473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:39 smithi086 ceph-mon[35163]: pgmap v6473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:39 smithi159 ceph-mon[36109]: pgmap v6473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:41 smithi086 ceph-mon[35163]: pgmap v6474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:41 smithi159 ceph-mon[36109]: pgmap v6474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:41 smithi055 ceph-mon[31863]: pgmap v6474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10662.982825 secs 2024-03-28T08:57:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:43 smithi086 ceph-mon[35163]: pgmap v6475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10662.982825 secs 2024-03-28T08:57:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:43 smithi159 ceph-mon[36109]: pgmap v6475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10662.982825 secs 2024-03-28T08:57:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:43 smithi055 ceph-mon[31863]: pgmap v6475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:45 smithi086 ceph-mon[35163]: pgmap v6476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:45 smithi159 ceph-mon[36109]: pgmap v6476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:45 smithi055 ceph-mon[31863]: pgmap v6476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:47 smithi086 ceph-mon[35163]: pgmap v6477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:47 smithi159 ceph-mon[36109]: pgmap v6477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:47 smithi055 ceph-mon[31863]: pgmap v6477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10667.982975 secs 2024-03-28T08:57:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10667.982975 secs 2024-03-28T08:57:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10667.982975 secs 2024-03-28T08:57:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:49 smithi086 ceph-mon[35163]: pgmap v6478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:49 smithi159 ceph-mon[36109]: pgmap v6478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:49 smithi055 ceph-mon[31863]: pgmap v6478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:51 smithi086 ceph-mon[35163]: pgmap v6479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:57:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:51 smithi159 ceph-mon[36109]: pgmap v6479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:57:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:51 smithi055 ceph-mon[31863]: pgmap v6479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:57:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:57:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:57:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:57:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:57:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:57:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:57:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:57:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:57:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:57:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:57:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:53 smithi086 ceph-mon[35163]: pgmap v6480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:53 smithi086 ceph-mon[35163]: pgmap v6481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10672.983046 secs 2024-03-28T08:57:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:53 smithi159 ceph-mon[36109]: pgmap v6480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:53 smithi159 ceph-mon[36109]: pgmap v6481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10672.983046 secs 2024-03-28T08:57:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:53 smithi055 ceph-mon[31863]: pgmap v6480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:57:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:53 smithi055 ceph-mon[31863]: pgmap v6481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10672.983046 secs 2024-03-28T08:57:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:55 smithi086 ceph-mon[35163]: pgmap v6482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:55 smithi159 ceph-mon[36109]: pgmap v6482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:55 smithi055 ceph-mon[31863]: pgmap v6482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:57 smithi086 ceph-mon[35163]: pgmap v6483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:57 smithi159 ceph-mon[36109]: pgmap v6483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:57 smithi055 ceph-mon[31863]: pgmap v6483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:57:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10677.983133 secs 2024-03-28T08:57:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10677.983133 secs 2024-03-28T08:57:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10677.983133 secs 2024-03-28T08:58:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:57:59 smithi086 ceph-mon[35163]: pgmap v6484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:57:59 smithi159 ceph-mon[36109]: pgmap v6484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:57:59 smithi055 ceph-mon[31863]: pgmap v6484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:01 smithi086 ceph-mon[35163]: pgmap v6485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:01 smithi159 ceph-mon[36109]: pgmap v6485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:01 smithi055 ceph-mon[31863]: pgmap v6485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:03 smithi086 ceph-mon[35163]: pgmap v6486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:58:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10682.983199 secs 2024-03-28T08:58:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:03 smithi159 ceph-mon[36109]: pgmap v6486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:58:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10682.983199 secs 2024-03-28T08:58:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:03 smithi055 ceph-mon[31863]: pgmap v6486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:58:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10682.983199 secs 2024-03-28T08:58:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:05 smithi086 ceph-mon[35163]: pgmap v6487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:05 smithi159 ceph-mon[36109]: pgmap v6487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:05 smithi055 ceph-mon[31863]: pgmap v6487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:07 smithi086 ceph-mon[35163]: pgmap v6488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:07 smithi159 ceph-mon[36109]: pgmap v6488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:07 smithi055 ceph-mon[31863]: pgmap v6488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:09.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10687.983312 secs 2024-03-28T08:58:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10687.983312 secs 2024-03-28T08:58:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10687.983312 secs 2024-03-28T08:58:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:10 smithi086 ceph-mon[35163]: pgmap v6489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:10 smithi159 ceph-mon[36109]: pgmap v6489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:10 smithi055 ceph-mon[31863]: pgmap v6489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:12 smithi086 ceph-mon[35163]: pgmap v6490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:12 smithi159 ceph-mon[36109]: pgmap v6490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:12 smithi055 ceph-mon[31863]: pgmap v6490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10692.983438 secs 2024-03-28T08:58:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10692.983438 secs 2024-03-28T08:58:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10692.983438 secs 2024-03-28T08:58:14.259 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:14 smithi055 ceph-mon[31863]: pgmap v6491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:14 smithi086 ceph-mon[35163]: pgmap v6491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:14 smithi159 ceph-mon[36109]: pgmap v6491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:16 smithi086 ceph-mon[35163]: pgmap v6492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:16 smithi159 ceph-mon[36109]: pgmap v6492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:16 smithi055 ceph-mon[31863]: pgmap v6492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:18 smithi055 ceph-mon[31863]: pgmap v6493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10697.983503 secs 2024-03-28T08:58:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:18 smithi086 ceph-mon[35163]: pgmap v6493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10697.983503 secs 2024-03-28T08:58:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:18 smithi159 ceph-mon[36109]: pgmap v6493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10697.983503 secs 2024-03-28T08:58:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:20 smithi055 ceph-mon[31863]: pgmap v6494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:20 smithi086 ceph-mon[35163]: pgmap v6494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:20 smithi159 ceph-mon[36109]: pgmap v6494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:22.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:22 smithi086 ceph-mon[35163]: pgmap v6495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:22 smithi055 ceph-mon[31863]: pgmap v6495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:22 smithi159 ceph-mon[36109]: pgmap v6495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10702.983572 secs 2024-03-28T08:58:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10702.983572 secs 2024-03-28T08:58:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10702.983572 secs 2024-03-28T08:58:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:24 smithi055 ceph-mon[31863]: pgmap v6496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:24 smithi086 ceph-mon[35163]: pgmap v6496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:24 smithi159 ceph-mon[36109]: pgmap v6496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:26.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:26 smithi159 ceph-mon[36109]: pgmap v6497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:26 smithi055 ceph-mon[31863]: pgmap v6497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:26 smithi086 ceph-mon[35163]: pgmap v6497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:28 smithi086 ceph-mon[35163]: pgmap v6498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10707.983639 secs 2024-03-28T08:58:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:28 smithi159 ceph-mon[36109]: pgmap v6498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10707.983639 secs 2024-03-28T08:58:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:28 smithi055 ceph-mon[31863]: pgmap v6498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10707.983639 secs 2024-03-28T08:58:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:30 smithi086 ceph-mon[35163]: pgmap v6499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:30 smithi159 ceph-mon[36109]: pgmap v6499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:30 smithi055 ceph-mon[31863]: pgmap v6499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:32 smithi086 ceph-mon[35163]: pgmap v6500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:32 smithi159 ceph-mon[36109]: pgmap v6500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:32 smithi055 ceph-mon[31863]: pgmap v6500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10712.983766 secs 2024-03-28T08:58:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10712.983766 secs 2024-03-28T08:58:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10712.983766 secs 2024-03-28T08:58:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:34 smithi086 ceph-mon[35163]: pgmap v6501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:34 smithi159 ceph-mon[36109]: pgmap v6501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:34 smithi055 ceph-mon[31863]: pgmap v6501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:36 smithi086 ceph-mon[35163]: pgmap v6502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:36 smithi159 ceph-mon[36109]: pgmap v6502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:36 smithi055 ceph-mon[31863]: pgmap v6502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:38 smithi086 ceph-mon[35163]: pgmap v6503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10717.983826 secs 2024-03-28T08:58:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:38 smithi159 ceph-mon[36109]: pgmap v6503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10717.983826 secs 2024-03-28T08:58:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:38 smithi055 ceph-mon[31863]: pgmap v6503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10717.983826 secs 2024-03-28T08:58:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:40 smithi086 ceph-mon[35163]: pgmap v6504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:40 smithi159 ceph-mon[36109]: pgmap v6504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:40 smithi055 ceph-mon[31863]: pgmap v6504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:42 smithi086 ceph-mon[35163]: pgmap v6505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:42 smithi159 ceph-mon[36109]: pgmap v6505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:42 smithi055 ceph-mon[31863]: pgmap v6505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10722.983948 secs 2024-03-28T08:58:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10722.983948 secs 2024-03-28T08:58:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10722.983948 secs 2024-03-28T08:58:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:44 smithi086 ceph-mon[35163]: pgmap v6506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:44 smithi159 ceph-mon[36109]: pgmap v6506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:44 smithi055 ceph-mon[31863]: pgmap v6506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:46 smithi086 ceph-mon[35163]: pgmap v6507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:46 smithi159 ceph-mon[36109]: pgmap v6507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:46 smithi055 ceph-mon[31863]: pgmap v6507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:47 smithi086 ceph-mon[35163]: pgmap v6508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:47 smithi159 ceph-mon[36109]: pgmap v6508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:47 smithi055 ceph-mon[31863]: pgmap v6508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10727.984071 secs 2024-03-28T08:58:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10727.984071 secs 2024-03-28T08:58:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10727.984071 secs 2024-03-28T08:58:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:49 smithi086 ceph-mon[35163]: pgmap v6509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:49 smithi159 ceph-mon[36109]: pgmap v6509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:49 smithi055 ceph-mon[31863]: pgmap v6509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:51 smithi086 ceph-mon[35163]: pgmap v6510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:51 smithi159 ceph-mon[36109]: pgmap v6510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:51 smithi055 ceph-mon[31863]: pgmap v6510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T08:58:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:53 smithi055 ceph-mon[31863]: pgmap v6511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10732.984152 secs 2024-03-28T08:58:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:58:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:53 smithi086 ceph-mon[35163]: pgmap v6511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10732.984152 secs 2024-03-28T08:58:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:58:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:53 smithi159 ceph-mon[36109]: pgmap v6511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:58:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10732.984152 secs 2024-03-28T08:58:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:58:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:58:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:58:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:58:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:58:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:58:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:58:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:58:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:58:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:58:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:55 smithi055 ceph-mon[31863]: pgmap v6512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:55 smithi055 ceph-mon[31863]: pgmap v6513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:55 smithi086 ceph-mon[35163]: pgmap v6512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:55 smithi086 ceph-mon[35163]: pgmap v6513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:55 smithi159 ceph-mon[36109]: pgmap v6512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:55 smithi159 ceph-mon[36109]: pgmap v6513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:57.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:57 smithi159 ceph-mon[36109]: pgmap v6514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:57 smithi055 ceph-mon[31863]: pgmap v6514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:57 smithi086 ceph-mon[35163]: pgmap v6514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:58:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10737.984276 secs 2024-03-28T08:58:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10737.984276 secs 2024-03-28T08:58:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10737.984276 secs 2024-03-28T08:58:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:58:59 smithi055 ceph-mon[31863]: pgmap v6515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:58:59 smithi086 ceph-mon[35163]: pgmap v6515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:58:59 smithi159 ceph-mon[36109]: pgmap v6515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:01 smithi086 ceph-mon[35163]: pgmap v6516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:59:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:01 smithi159 ceph-mon[36109]: pgmap v6516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:59:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:01 smithi055 ceph-mon[31863]: pgmap v6516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T08:59:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:03 smithi086 ceph-mon[35163]: pgmap v6517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10742.984342 secs 2024-03-28T08:59:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:03 smithi159 ceph-mon[36109]: pgmap v6517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10742.984342 secs 2024-03-28T08:59:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:03 smithi055 ceph-mon[31863]: pgmap v6517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10742.984342 secs 2024-03-28T08:59:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:05 smithi086 ceph-mon[35163]: pgmap v6518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:59:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:05 smithi159 ceph-mon[36109]: pgmap v6518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:59:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:05 smithi055 ceph-mon[31863]: pgmap v6518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T08:59:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:07 smithi086 ceph-mon[35163]: pgmap v6519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:07 smithi159 ceph-mon[36109]: pgmap v6519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:07 smithi055 ceph-mon[31863]: pgmap v6519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10747.984410 secs 2024-03-28T08:59:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10747.984410 secs 2024-03-28T08:59:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10747.984410 secs 2024-03-28T08:59:10.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:09 smithi055 ceph-mon[31863]: pgmap v6520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:09 smithi086 ceph-mon[35163]: pgmap v6520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:09 smithi159 ceph-mon[36109]: pgmap v6520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:11 smithi086 ceph-mon[35163]: pgmap v6521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:11 smithi159 ceph-mon[36109]: pgmap v6521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:11 smithi055 ceph-mon[31863]: pgmap v6521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:13 smithi086 ceph-mon[35163]: pgmap v6522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10752.984531 secs 2024-03-28T08:59:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:13 smithi159 ceph-mon[36109]: pgmap v6522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10752.984531 secs 2024-03-28T08:59:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:13 smithi055 ceph-mon[31863]: pgmap v6522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10752.984531 secs 2024-03-28T08:59:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:15 smithi086 ceph-mon[35163]: pgmap v6523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:15 smithi159 ceph-mon[36109]: pgmap v6523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:15 smithi055 ceph-mon[31863]: pgmap v6523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:17 smithi086 ceph-mon[35163]: pgmap v6524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:17 smithi159 ceph-mon[36109]: pgmap v6524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:17 smithi055 ceph-mon[31863]: pgmap v6524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10757.984654 secs 2024-03-28T08:59:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10757.984654 secs 2024-03-28T08:59:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10757.984654 secs 2024-03-28T08:59:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:19 smithi086 ceph-mon[35163]: pgmap v6525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:19 smithi159 ceph-mon[36109]: pgmap v6525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:19 smithi055 ceph-mon[31863]: pgmap v6525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:21 smithi086 ceph-mon[35163]: pgmap v6526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:21 smithi159 ceph-mon[36109]: pgmap v6526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:21 smithi055 ceph-mon[31863]: pgmap v6526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:23 smithi086 ceph-mon[35163]: pgmap v6527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10762.984806 secs 2024-03-28T08:59:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:23 smithi159 ceph-mon[36109]: pgmap v6527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10762.984806 secs 2024-03-28T08:59:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:23 smithi055 ceph-mon[31863]: pgmap v6527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10762.984806 secs 2024-03-28T08:59:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:25 smithi086 ceph-mon[35163]: pgmap v6528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:25 smithi159 ceph-mon[36109]: pgmap v6528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:25 smithi055 ceph-mon[31863]: pgmap v6528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:27 smithi086 ceph-mon[35163]: pgmap v6529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:27 smithi159 ceph-mon[36109]: pgmap v6529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:27 smithi055 ceph-mon[31863]: pgmap v6529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10767.984871 secs 2024-03-28T08:59:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10767.984871 secs 2024-03-28T08:59:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10767.984871 secs 2024-03-28T08:59:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:29 smithi086 ceph-mon[35163]: pgmap v6530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:29 smithi159 ceph-mon[36109]: pgmap v6530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:29 smithi055 ceph-mon[31863]: pgmap v6530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:31 smithi086 ceph-mon[35163]: pgmap v6531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:31 smithi159 ceph-mon[36109]: pgmap v6531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:31 smithi055 ceph-mon[31863]: pgmap v6531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:33 smithi086 ceph-mon[35163]: pgmap v6532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10772.984947 secs 2024-03-28T08:59:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:33 smithi159 ceph-mon[36109]: pgmap v6532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10772.984947 secs 2024-03-28T08:59:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:33 smithi055 ceph-mon[31863]: pgmap v6532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10772.984947 secs 2024-03-28T08:59:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:35 smithi086 ceph-mon[35163]: pgmap v6533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:35 smithi159 ceph-mon[36109]: pgmap v6533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:35 smithi055 ceph-mon[31863]: pgmap v6533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:37 smithi086 ceph-mon[35163]: pgmap v6534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:37 smithi159 ceph-mon[36109]: pgmap v6534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:37 smithi055 ceph-mon[31863]: pgmap v6534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10777.985012 secs 2024-03-28T08:59:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10777.985012 secs 2024-03-28T08:59:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10777.985012 secs 2024-03-28T08:59:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:39 smithi086 ceph-mon[35163]: pgmap v6535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:39 smithi159 ceph-mon[36109]: pgmap v6535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:39 smithi055 ceph-mon[31863]: pgmap v6535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:41 smithi086 ceph-mon[35163]: pgmap v6536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:59:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:41 smithi159 ceph-mon[36109]: pgmap v6536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:59:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:41 smithi055 ceph-mon[31863]: pgmap v6536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T08:59:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:43 smithi055 ceph-mon[31863]: pgmap v6537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10782.985105 secs 2024-03-28T08:59:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:43 smithi086 ceph-mon[35163]: pgmap v6537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10782.985105 secs 2024-03-28T08:59:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:43 smithi159 ceph-mon[36109]: pgmap v6537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10782.985105 secs 2024-03-28T08:59:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:45 smithi055 ceph-mon[31863]: pgmap v6538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:45 smithi086 ceph-mon[35163]: pgmap v6538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:45 smithi159 ceph-mon[36109]: pgmap v6538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:47 smithi055 ceph-mon[31863]: pgmap v6539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:47 smithi086 ceph-mon[35163]: pgmap v6539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:47 smithi159 ceph-mon[36109]: pgmap v6539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10787.985171 secs 2024-03-28T08:59:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10787.985171 secs 2024-03-28T08:59:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10787.985171 secs 2024-03-28T08:59:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:49 smithi055 ceph-mon[31863]: pgmap v6540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:49 smithi086 ceph-mon[35163]: pgmap v6540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:49 smithi159 ceph-mon[36109]: pgmap v6540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:51 smithi086 ceph-mon[35163]: pgmap v6541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:51 smithi159 ceph-mon[36109]: pgmap v6541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:51 smithi055 ceph-mon[31863]: pgmap v6541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T08:59:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:53 smithi086 ceph-mon[35163]: pgmap v6542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10792.985291 secs 2024-03-28T08:59:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:53 smithi159 ceph-mon[36109]: pgmap v6542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10792.985291 secs 2024-03-28T08:59:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:53 smithi055 ceph-mon[31863]: pgmap v6542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10792.985291 secs 2024-03-28T08:59:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:59:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:59:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T08:59:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:55 smithi086 ceph-mon[35163]: pgmap v6543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:55 smithi159 ceph-mon[36109]: pgmap v6543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:55 smithi055 ceph-mon[31863]: pgmap v6543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:57.223 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.223 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.224 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:59:57.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:59:57.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:59:57.225 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:59:57.226 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:59:57.226 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:59:57.226 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: pgmap v6544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:57.226 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: pgmap v6545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:57.226 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:59:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:59:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: pgmap v6544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: pgmap v6545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T08:59:57.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T08:59:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: pgmap v6544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T08:59:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: pgmap v6545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:57.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T08:59:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10797.985366 secs 2024-03-28T08:59:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10797.985366 secs 2024-03-28T08:59:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10797.985366 secs 2024-03-28T08:59:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 08:59:59 smithi055 ceph-mon[31863]: pgmap v6546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 08:59:59 smithi086 ceph-mon[35163]: pgmap v6546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T08:59:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 08:59:59 smithi159 ceph-mon[36109]: pgmap v6546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:00:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:00:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:00:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:01 smithi055 ceph-mon[31863]: pgmap v6547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:01 smithi086 ceph-mon[35163]: pgmap v6547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:01 smithi159 ceph-mon[36109]: pgmap v6547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:03 smithi086 ceph-mon[35163]: pgmap v6548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10802.985489 secs 2024-03-28T09:00:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:03 smithi159 ceph-mon[36109]: pgmap v6548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10802.985489 secs 2024-03-28T09:00:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:03 smithi055 ceph-mon[31863]: pgmap v6548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10802.985489 secs 2024-03-28T09:00:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:05 smithi086 ceph-mon[35163]: pgmap v6549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:05.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:05 smithi159 ceph-mon[36109]: pgmap v6549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:05 smithi055 ceph-mon[31863]: pgmap v6549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:00:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:07 smithi086 ceph-mon[35163]: pgmap v6550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:00:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:07 smithi159 ceph-mon[36109]: pgmap v6550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:00:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:07 smithi055 ceph-mon[31863]: pgmap v6550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:00:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10807.985614 secs 2024-03-28T09:00:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10807.985614 secs 2024-03-28T09:00:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10807.985614 secs 2024-03-28T09:00:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:09 smithi086 ceph-mon[35163]: pgmap v6551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:09 smithi159 ceph-mon[36109]: pgmap v6551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:09 smithi055 ceph-mon[31863]: pgmap v6551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:11 smithi086 ceph-mon[35163]: pgmap v6552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:11 smithi159 ceph-mon[36109]: pgmap v6552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:11 smithi055 ceph-mon[31863]: pgmap v6552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:13 smithi086 ceph-mon[35163]: pgmap v6553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10812.985740 secs 2024-03-28T09:00:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:13 smithi159 ceph-mon[36109]: pgmap v6553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10812.985740 secs 2024-03-28T09:00:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:13 smithi055 ceph-mon[31863]: pgmap v6553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10812.985740 secs 2024-03-28T09:00:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:14 smithi086 ceph-mon[35163]: pgmap v6554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:14 smithi159 ceph-mon[36109]: pgmap v6554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:14 smithi055 ceph-mon[31863]: pgmap v6554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:17 smithi086 ceph-mon[35163]: pgmap v6555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:17 smithi159 ceph-mon[36109]: pgmap v6555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:17 smithi055 ceph-mon[31863]: pgmap v6555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10817.985850 secs 2024-03-28T09:00:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10817.985850 secs 2024-03-28T09:00:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10817.985850 secs 2024-03-28T09:00:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:19 smithi086 ceph-mon[35163]: pgmap v6556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:19 smithi159 ceph-mon[36109]: pgmap v6556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:19 smithi055 ceph-mon[31863]: pgmap v6556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:20 smithi086 ceph-mon[35163]: pgmap v6557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:20 smithi159 ceph-mon[36109]: pgmap v6557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:20 smithi055 ceph-mon[31863]: pgmap v6557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:23 smithi086 ceph-mon[35163]: pgmap v6558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10822.985970 secs 2024-03-28T09:00:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:23 smithi159 ceph-mon[36109]: pgmap v6558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10822.985970 secs 2024-03-28T09:00:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:23 smithi055 ceph-mon[31863]: pgmap v6558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10822.985970 secs 2024-03-28T09:00:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:25 smithi086 ceph-mon[35163]: pgmap v6559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:25 smithi159 ceph-mon[36109]: pgmap v6559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:25 smithi055 ceph-mon[31863]: pgmap v6559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:27 smithi086 ceph-mon[35163]: pgmap v6560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:27 smithi159 ceph-mon[36109]: pgmap v6560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:27 smithi055 ceph-mon[31863]: pgmap v6560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10827.986093 secs 2024-03-28T09:00:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10827.986093 secs 2024-03-28T09:00:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10827.986093 secs 2024-03-28T09:00:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:29 smithi086 ceph-mon[35163]: pgmap v6561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:29 smithi159 ceph-mon[36109]: pgmap v6561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:29 smithi055 ceph-mon[31863]: pgmap v6561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:30 smithi086 ceph-mon[35163]: pgmap v6562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:30 smithi159 ceph-mon[36109]: pgmap v6562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:30 smithi055 ceph-mon[31863]: pgmap v6562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:33 smithi086 ceph-mon[35163]: pgmap v6563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10832.986216 secs 2024-03-28T09:00:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:33 smithi159 ceph-mon[36109]: pgmap v6563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10832.986216 secs 2024-03-28T09:00:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:33 smithi055 ceph-mon[31863]: pgmap v6563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10832.986216 secs 2024-03-28T09:00:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:35 smithi086 ceph-mon[35163]: pgmap v6564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:35 smithi159 ceph-mon[36109]: pgmap v6564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:35 smithi055 ceph-mon[31863]: pgmap v6564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:37 smithi086 ceph-mon[35163]: pgmap v6565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:37 smithi159 ceph-mon[36109]: pgmap v6565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:37 smithi055 ceph-mon[31863]: pgmap v6565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10837.986349 secs 2024-03-28T09:00:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10837.986349 secs 2024-03-28T09:00:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10837.986349 secs 2024-03-28T09:00:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:39 smithi086 ceph-mon[35163]: pgmap v6566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:39 smithi159 ceph-mon[36109]: pgmap v6566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:39 smithi055 ceph-mon[31863]: pgmap v6566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:41 smithi086 ceph-mon[35163]: pgmap v6567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:41 smithi159 ceph-mon[36109]: pgmap v6567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:41 smithi055 ceph-mon[31863]: pgmap v6567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:43 smithi086 ceph-mon[35163]: pgmap v6568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10842.986473 secs 2024-03-28T09:00:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:43 smithi159 ceph-mon[36109]: pgmap v6568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10842.986473 secs 2024-03-28T09:00:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:43 smithi055 ceph-mon[31863]: pgmap v6568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10842.986473 secs 2024-03-28T09:00:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:44 smithi055 ceph-mon[31863]: pgmap v6569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:44 smithi086 ceph-mon[35163]: pgmap v6569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:44 smithi159 ceph-mon[36109]: pgmap v6569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:47 smithi086 ceph-mon[35163]: pgmap v6570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:47 smithi159 ceph-mon[36109]: pgmap v6570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:47 smithi055 ceph-mon[31863]: pgmap v6570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10847.986600 secs 2024-03-28T09:00:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10847.986600 secs 2024-03-28T09:00:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10847.986600 secs 2024-03-28T09:00:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:49 smithi086 ceph-mon[35163]: pgmap v6571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:49 smithi159 ceph-mon[36109]: pgmap v6571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:49 smithi055 ceph-mon[31863]: pgmap v6571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:51 smithi086 ceph-mon[35163]: pgmap v6572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:51 smithi159 ceph-mon[36109]: pgmap v6572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:51 smithi055 ceph-mon[31863]: pgmap v6572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:53.531 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:53 smithi055 ceph-mon[31863]: pgmap v6573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:53.531 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10852.986667 secs 2024-03-28T09:00:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:53 smithi086 ceph-mon[35163]: pgmap v6573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10852.986667 secs 2024-03-28T09:00:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:53 smithi159 ceph-mon[36109]: pgmap v6573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10852.986667 secs 2024-03-28T09:00:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:54 smithi086 ceph-mon[35163]: pgmap v6574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:54 smithi159 ceph-mon[36109]: pgmap v6574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:54 smithi055 ceph-mon[31863]: pgmap v6574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:57 smithi086 ceph-mon[35163]: pgmap v6575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:00:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:57 smithi159 ceph-mon[36109]: pgmap v6575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:00:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:57 smithi055 ceph-mon[31863]: pgmap v6575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:00:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:00:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10857.986741 secs 2024-03-28T09:00:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:00:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:00:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10857.986741 secs 2024-03-28T09:00:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:00:58.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:00:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10857.986741 secs 2024-03-28T09:00:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:00:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:00:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:00:58.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:00:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:59 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:00:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:59 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:00:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:59 smithi086 ceph-mon[35163]: pgmap v6576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:00:59 smithi086 ceph-mon[35163]: pgmap v6577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:00:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:59 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:00:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:59 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:00:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:59 smithi159 ceph-mon[36109]: pgmap v6576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:00:59 smithi159 ceph-mon[36109]: pgmap v6577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:00:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:59 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:00:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:59 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:00:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:59 smithi055 ceph-mon[31863]: pgmap v6576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:00:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:00:59 smithi055 ceph-mon[31863]: pgmap v6577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:01:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:01 smithi086 ceph-mon[35163]: pgmap v6578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:01 smithi159 ceph-mon[36109]: pgmap v6578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:01 smithi055 ceph-mon[31863]: pgmap v6578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:03 smithi086 ceph-mon[35163]: pgmap v6579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10862.986867 secs 2024-03-28T09:01:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:03 smithi159 ceph-mon[36109]: pgmap v6579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10862.986867 secs 2024-03-28T09:01:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:03 smithi055 ceph-mon[31863]: pgmap v6579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10862.986867 secs 2024-03-28T09:01:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:04 smithi086 ceph-mon[35163]: pgmap v6580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:04 smithi159 ceph-mon[36109]: pgmap v6580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:04 smithi055 ceph-mon[31863]: pgmap v6580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:06 smithi086 ceph-mon[35163]: pgmap v6581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:01:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:06 smithi159 ceph-mon[36109]: pgmap v6581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:01:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:06 smithi055 ceph-mon[31863]: pgmap v6581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:01:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10867.986954 secs 2024-03-28T09:01:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:08 smithi086 ceph-mon[35163]: pgmap v6582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:01:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10867.986954 secs 2024-03-28T09:01:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:08 smithi159 ceph-mon[36109]: pgmap v6582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:01:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10867.986954 secs 2024-03-28T09:01:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:08 smithi055 ceph-mon[31863]: pgmap v6582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:01:11.177 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:10 smithi055 ceph-mon[31863]: pgmap v6583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:10 smithi086 ceph-mon[35163]: pgmap v6583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:10 smithi159 ceph-mon[36109]: pgmap v6583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:12 smithi086 ceph-mon[35163]: pgmap v6584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:12 smithi159 ceph-mon[36109]: pgmap v6584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:12 smithi055 ceph-mon[31863]: pgmap v6584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10872.987039 secs 2024-03-28T09:01:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10872.987039 secs 2024-03-28T09:01:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10872.987039 secs 2024-03-28T09:01:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:14 smithi086 ceph-mon[35163]: pgmap v6585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:14 smithi159 ceph-mon[36109]: pgmap v6585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:14 smithi055 ceph-mon[31863]: pgmap v6585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:16 smithi086 ceph-mon[35163]: pgmap v6586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:16 smithi159 ceph-mon[36109]: pgmap v6586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:16 smithi055 ceph-mon[31863]: pgmap v6586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10877.987159 secs 2024-03-28T09:01:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:18 smithi086 ceph-mon[35163]: pgmap v6587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10877.987159 secs 2024-03-28T09:01:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:18 smithi159 ceph-mon[36109]: pgmap v6587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10877.987159 secs 2024-03-28T09:01:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:18 smithi055 ceph-mon[31863]: pgmap v6587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:20 smithi086 ceph-mon[35163]: pgmap v6588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:20 smithi159 ceph-mon[36109]: pgmap v6588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:20 smithi055 ceph-mon[31863]: pgmap v6588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:22 smithi086 ceph-mon[35163]: pgmap v6589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:22 smithi159 ceph-mon[36109]: pgmap v6589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:22 smithi055 ceph-mon[31863]: pgmap v6589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10882.987253 secs 2024-03-28T09:01:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10882.987253 secs 2024-03-28T09:01:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10882.987253 secs 2024-03-28T09:01:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:25 smithi086 ceph-mon[35163]: pgmap v6590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:25 smithi159 ceph-mon[36109]: pgmap v6590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:25 smithi055 ceph-mon[31863]: pgmap v6590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:27 smithi086 ceph-mon[35163]: pgmap v6591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:27 smithi159 ceph-mon[36109]: pgmap v6591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:27 smithi055 ceph-mon[31863]: pgmap v6591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10887.987375 secs 2024-03-28T09:01:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:29 smithi086 ceph-mon[35163]: pgmap v6592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10887.987375 secs 2024-03-28T09:01:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:29 smithi159 ceph-mon[36109]: pgmap v6592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10887.987375 secs 2024-03-28T09:01:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:29 smithi055 ceph-mon[31863]: pgmap v6592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:31 smithi086 ceph-mon[35163]: pgmap v6593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:31 smithi159 ceph-mon[36109]: pgmap v6593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:31 smithi055 ceph-mon[31863]: pgmap v6593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:33 smithi086 ceph-mon[35163]: pgmap v6594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:33 smithi159 ceph-mon[36109]: pgmap v6594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:33 smithi055 ceph-mon[31863]: pgmap v6594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10892.987453 secs 2024-03-28T09:01:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10892.987453 secs 2024-03-28T09:01:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10892.987453 secs 2024-03-28T09:01:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:35 smithi086 ceph-mon[35163]: pgmap v6595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:35 smithi159 ceph-mon[36109]: pgmap v6595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:35 smithi055 ceph-mon[31863]: pgmap v6595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:37 smithi086 ceph-mon[35163]: pgmap v6596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:37 smithi159 ceph-mon[36109]: pgmap v6596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:37 smithi055 ceph-mon[31863]: pgmap v6596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10897.987577 secs 2024-03-28T09:01:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10897.987577 secs 2024-03-28T09:01:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10897.987577 secs 2024-03-28T09:01:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:39 smithi055 ceph-mon[31863]: pgmap v6597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:39 smithi086 ceph-mon[35163]: pgmap v6597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:39 smithi159 ceph-mon[36109]: pgmap v6597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:41 smithi055 ceph-mon[31863]: pgmap v6598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:41 smithi086 ceph-mon[35163]: pgmap v6598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:41 smithi159 ceph-mon[36109]: pgmap v6598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:43 smithi055 ceph-mon[31863]: pgmap v6599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10902.987702 secs 2024-03-28T09:01:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:43 smithi086 ceph-mon[35163]: pgmap v6599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10902.987702 secs 2024-03-28T09:01:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:43 smithi159 ceph-mon[36109]: pgmap v6599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10902.987702 secs 2024-03-28T09:01:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:45 smithi055 ceph-mon[31863]: pgmap v6600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:45 smithi086 ceph-mon[35163]: pgmap v6600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:45 smithi159 ceph-mon[36109]: pgmap v6600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:47 smithi055 ceph-mon[31863]: pgmap v6601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:47 smithi086 ceph-mon[35163]: pgmap v6601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:47 smithi159 ceph-mon[36109]: pgmap v6601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10907.987833 secs 2024-03-28T09:01:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10907.987833 secs 2024-03-28T09:01:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10907.987833 secs 2024-03-28T09:01:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:49 smithi086 ceph-mon[35163]: pgmap v6602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:49 smithi159 ceph-mon[36109]: pgmap v6602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:49 smithi055 ceph-mon[31863]: pgmap v6602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:01:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:51 smithi086 ceph-mon[35163]: pgmap v6603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:51 smithi159 ceph-mon[36109]: pgmap v6603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:51 smithi055 ceph-mon[31863]: pgmap v6603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:53 smithi086 ceph-mon[35163]: pgmap v6604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10912.987956 secs 2024-03-28T09:01:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:53 smithi159 ceph-mon[36109]: pgmap v6604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10912.987956 secs 2024-03-28T09:01:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:53 smithi055 ceph-mon[31863]: pgmap v6604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10912.987956 secs 2024-03-28T09:01:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:55 smithi086 ceph-mon[35163]: pgmap v6605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:55 smithi159 ceph-mon[36109]: pgmap v6605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:55 smithi055 ceph-mon[31863]: pgmap v6605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:57 smithi086 ceph-mon[35163]: pgmap v6606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:57 smithi159 ceph-mon[36109]: pgmap v6606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:57 smithi055 ceph-mon[31863]: pgmap v6606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10917.988077 secs 2024-03-28T09:01:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10917.988077 secs 2024-03-28T09:01:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10917.988077 secs 2024-03-28T09:01:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:59 smithi086 ceph-mon[35163]: pgmap v6607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:01:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:01:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:59 smithi159 ceph-mon[36109]: pgmap v6607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:01:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:01:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:59 smithi055 ceph-mon[31863]: pgmap v6607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:01:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:01:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:02:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:02:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:02:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:02:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:02:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:02:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:02:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:02:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:02:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:02:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:01 smithi086 ceph-mon[35163]: pgmap v6608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:01 smithi086 ceph-mon[35163]: pgmap v6609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:01 smithi159 ceph-mon[36109]: pgmap v6608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:01 smithi159 ceph-mon[36109]: pgmap v6609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:01 smithi055 ceph-mon[31863]: pgmap v6608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:01 smithi055 ceph-mon[31863]: pgmap v6609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:03 smithi086 ceph-mon[35163]: pgmap v6610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10922.988194 secs 2024-03-28T09:02:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:03 smithi159 ceph-mon[36109]: pgmap v6610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10922.988194 secs 2024-03-28T09:02:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:03 smithi055 ceph-mon[31863]: pgmap v6610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10922.988194 secs 2024-03-28T09:02:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:05 smithi086 ceph-mon[35163]: pgmap v6611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:05 smithi159 ceph-mon[36109]: pgmap v6611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:05 smithi055 ceph-mon[31863]: pgmap v6611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:02:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:07 smithi086 ceph-mon[35163]: pgmap v6612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:07 smithi159 ceph-mon[36109]: pgmap v6612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:07 smithi055 ceph-mon[31863]: pgmap v6612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10927.988318 secs 2024-03-28T09:02:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10927.988318 secs 2024-03-28T09:02:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10927.988318 secs 2024-03-28T09:02:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:09 smithi086 ceph-mon[35163]: pgmap v6613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:02:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:09 smithi159 ceph-mon[36109]: pgmap v6613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:02:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:09 smithi055 ceph-mon[31863]: pgmap v6613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:02:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:11 smithi086 ceph-mon[35163]: pgmap v6614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:11 smithi159 ceph-mon[36109]: pgmap v6614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:11 smithi055 ceph-mon[31863]: pgmap v6614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:02:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:13 smithi086 ceph-mon[35163]: pgmap v6615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10932.988434 secs 2024-03-28T09:02:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:13 smithi159 ceph-mon[36109]: pgmap v6615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10932.988434 secs 2024-03-28T09:02:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:13 smithi055 ceph-mon[31863]: pgmap v6615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10932.988434 secs 2024-03-28T09:02:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:15 smithi086 ceph-mon[35163]: pgmap v6616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:15 smithi159 ceph-mon[36109]: pgmap v6616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:15 smithi055 ceph-mon[31863]: pgmap v6616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:17 smithi086 ceph-mon[35163]: pgmap v6617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:17 smithi159 ceph-mon[36109]: pgmap v6617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:17 smithi055 ceph-mon[31863]: pgmap v6617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10937.988559 secs 2024-03-28T09:02:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10937.988559 secs 2024-03-28T09:02:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10937.988559 secs 2024-03-28T09:02:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:19 smithi086 ceph-mon[35163]: pgmap v6618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:19 smithi159 ceph-mon[36109]: pgmap v6618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:19 smithi055 ceph-mon[31863]: pgmap v6618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:20 smithi086 ceph-mon[35163]: pgmap v6619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:20 smithi159 ceph-mon[36109]: pgmap v6619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:20 smithi055 ceph-mon[31863]: pgmap v6619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:22 smithi086 ceph-mon[35163]: pgmap v6620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:22 smithi159 ceph-mon[36109]: pgmap v6620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:22 smithi055 ceph-mon[31863]: pgmap v6620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10942.988631 secs 2024-03-28T09:02:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10942.988631 secs 2024-03-28T09:02:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10942.988631 secs 2024-03-28T09:02:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:24 smithi086 ceph-mon[35163]: pgmap v6621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:24 smithi159 ceph-mon[36109]: pgmap v6621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:24 smithi055 ceph-mon[31863]: pgmap v6621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:26 smithi086 ceph-mon[35163]: pgmap v6622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:26 smithi159 ceph-mon[36109]: pgmap v6622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:26 smithi055 ceph-mon[31863]: pgmap v6622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10947.988752 secs 2024-03-28T09:02:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:28 smithi086 ceph-mon[35163]: pgmap v6623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10947.988752 secs 2024-03-28T09:02:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:28 smithi159 ceph-mon[36109]: pgmap v6623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10947.988752 secs 2024-03-28T09:02:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:28 smithi055 ceph-mon[31863]: pgmap v6623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:30 smithi086 ceph-mon[35163]: pgmap v6624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:30 smithi159 ceph-mon[36109]: pgmap v6624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:30 smithi055 ceph-mon[31863]: pgmap v6624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:32 smithi086 ceph-mon[35163]: pgmap v6625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:32 smithi159 ceph-mon[36109]: pgmap v6625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:32 smithi055 ceph-mon[31863]: pgmap v6625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10952.988875 secs 2024-03-28T09:02:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10952.988875 secs 2024-03-28T09:02:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10952.988875 secs 2024-03-28T09:02:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:34 smithi086 ceph-mon[35163]: pgmap v6626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:34 smithi159 ceph-mon[36109]: pgmap v6626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:34 smithi055 ceph-mon[31863]: pgmap v6626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:36 smithi086 ceph-mon[35163]: pgmap v6627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:36 smithi159 ceph-mon[36109]: pgmap v6627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:36 smithi055 ceph-mon[31863]: pgmap v6627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10957.988993 secs 2024-03-28T09:02:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:38 smithi086 ceph-mon[35163]: pgmap v6628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10957.988993 secs 2024-03-28T09:02:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:38 smithi159 ceph-mon[36109]: pgmap v6628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10957.988993 secs 2024-03-28T09:02:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:38 smithi055 ceph-mon[31863]: pgmap v6628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:40 smithi086 ceph-mon[35163]: pgmap v6629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:40 smithi159 ceph-mon[36109]: pgmap v6629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:40 smithi055 ceph-mon[31863]: pgmap v6629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:42 smithi086 ceph-mon[35163]: pgmap v6630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:42 smithi159 ceph-mon[36109]: pgmap v6630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:42 smithi055 ceph-mon[31863]: pgmap v6630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10962.989117 secs 2024-03-28T09:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10962.989117 secs 2024-03-28T09:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10962.989117 secs 2024-03-28T09:02:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:44 smithi055 ceph-mon[31863]: pgmap v6631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:44 smithi086 ceph-mon[35163]: pgmap v6631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:44 smithi159 ceph-mon[36109]: pgmap v6631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:46 smithi055 ceph-mon[31863]: pgmap v6632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:46 smithi086 ceph-mon[35163]: pgmap v6632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:46 smithi159 ceph-mon[36109]: pgmap v6632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10967.989234 secs 2024-03-28T09:02:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:48 smithi055 ceph-mon[31863]: pgmap v6633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10967.989234 secs 2024-03-28T09:02:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:48 smithi086 ceph-mon[35163]: pgmap v6633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10967.989234 secs 2024-03-28T09:02:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:48 smithi159 ceph-mon[36109]: pgmap v6633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:50 smithi055 ceph-mon[31863]: pgmap v6634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:50 smithi086 ceph-mon[35163]: pgmap v6634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:50 smithi159 ceph-mon[36109]: pgmap v6634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:52 smithi055 ceph-mon[31863]: pgmap v6635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:52 smithi086 ceph-mon[35163]: pgmap v6635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:52 smithi159 ceph-mon[36109]: pgmap v6635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10972.989358 secs 2024-03-28T09:02:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10972.989358 secs 2024-03-28T09:02:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10972.989358 secs 2024-03-28T09:02:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:54 smithi086 ceph-mon[35163]: pgmap v6636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:54 smithi159 ceph-mon[36109]: pgmap v6636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:54 smithi055 ceph-mon[31863]: pgmap v6636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:02:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:56 smithi086 ceph-mon[35163]: pgmap v6637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:56 smithi159 ceph-mon[36109]: pgmap v6637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:56 smithi055 ceph-mon[31863]: pgmap v6637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:02:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10977.989477 secs 2024-03-28T09:02:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:02:58 smithi086 ceph-mon[35163]: pgmap v6638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10977.989477 secs 2024-03-28T09:02:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:02:58 smithi159 ceph-mon[36109]: pgmap v6638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:02:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10977.989477 secs 2024-03-28T09:02:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:02:58 smithi055 ceph-mon[31863]: pgmap v6638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:00 smithi086 ceph-mon[35163]: pgmap v6639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:03:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:00 smithi159 ceph-mon[36109]: pgmap v6639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:03:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:00 smithi055 ceph-mon[31863]: pgmap v6639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:03:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:03 smithi055 ceph-mon[31863]: pgmap v6640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:03:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:03:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:03.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10982.989597 secs 2024-03-28T09:03:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:03 smithi086 ceph-mon[35163]: pgmap v6640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:03:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:03:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10982.989597 secs 2024-03-28T09:03:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:03 smithi159 ceph-mon[36109]: pgmap v6640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:03:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:03:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:03:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10982.989597 secs 2024-03-28T09:03:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:04 smithi055 ceph-mon[31863]: pgmap v6641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:03:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:04 smithi055 ceph-mon[31863]: pgmap v6642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:04 smithi086 ceph-mon[35163]: pgmap v6641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:03:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:04 smithi086 ceph-mon[35163]: pgmap v6642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:04 smithi159 ceph-mon[36109]: pgmap v6641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:03:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:04 smithi159 ceph-mon[36109]: pgmap v6642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:06 smithi055 ceph-mon[31863]: pgmap v6643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:03:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:06 smithi086 ceph-mon[35163]: pgmap v6643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:03:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:06 smithi159 ceph-mon[36109]: pgmap v6643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:03:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:08 smithi055 ceph-mon[31863]: pgmap v6644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10987.989661 secs 2024-03-28T09:03:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:08 smithi086 ceph-mon[35163]: pgmap v6644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10987.989661 secs 2024-03-28T09:03:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:08 smithi159 ceph-mon[36109]: pgmap v6644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10987.989661 secs 2024-03-28T09:03:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:10 smithi055 ceph-mon[31863]: pgmap v6645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:10 smithi086 ceph-mon[35163]: pgmap v6645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:10 smithi159 ceph-mon[36109]: pgmap v6645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:12 smithi086 ceph-mon[35163]: pgmap v6646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:12 smithi159 ceph-mon[36109]: pgmap v6646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:12 smithi055 ceph-mon[31863]: pgmap v6646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:03:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10992.989749 secs 2024-03-28T09:03:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10992.989749 secs 2024-03-28T09:03:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10992.989749 secs 2024-03-28T09:03:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:14 smithi086 ceph-mon[35163]: pgmap v6647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:14 smithi159 ceph-mon[36109]: pgmap v6647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:14 smithi055 ceph-mon[31863]: pgmap v6647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:16 smithi086 ceph-mon[35163]: pgmap v6648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:16 smithi159 ceph-mon[36109]: pgmap v6648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:16 smithi055 ceph-mon[31863]: pgmap v6648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:18 smithi086 ceph-mon[35163]: pgmap v6649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 10997.989871 secs 2024-03-28T09:03:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:18 smithi159 ceph-mon[36109]: pgmap v6649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 10997.989871 secs 2024-03-28T09:03:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:18 smithi055 ceph-mon[31863]: pgmap v6649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 10997.989871 secs 2024-03-28T09:03:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:20 smithi086 ceph-mon[35163]: pgmap v6650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:20 smithi159 ceph-mon[36109]: pgmap v6650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:20 smithi055 ceph-mon[31863]: pgmap v6650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:22 smithi086 ceph-mon[35163]: pgmap v6651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:22 smithi159 ceph-mon[36109]: pgmap v6651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:22 smithi055 ceph-mon[31863]: pgmap v6651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11002.989944 secs 2024-03-28T09:03:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11002.989944 secs 2024-03-28T09:03:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11002.989944 secs 2024-03-28T09:03:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:24 smithi086 ceph-mon[35163]: pgmap v6652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:24 smithi159 ceph-mon[36109]: pgmap v6652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:24 smithi055 ceph-mon[31863]: pgmap v6652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:26 smithi086 ceph-mon[35163]: pgmap v6653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:26 smithi159 ceph-mon[36109]: pgmap v6653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:26 smithi055 ceph-mon[31863]: pgmap v6653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:28 smithi086 ceph-mon[35163]: pgmap v6654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11007.990025 secs 2024-03-28T09:03:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:28 smithi159 ceph-mon[36109]: pgmap v6654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11007.990025 secs 2024-03-28T09:03:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:28 smithi055 ceph-mon[31863]: pgmap v6654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11007.990025 secs 2024-03-28T09:03:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:30 smithi086 ceph-mon[35163]: pgmap v6655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:30 smithi159 ceph-mon[36109]: pgmap v6655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:30 smithi055 ceph-mon[31863]: pgmap v6655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:32 smithi086 ceph-mon[35163]: pgmap v6656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:32 smithi159 ceph-mon[36109]: pgmap v6656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:32 smithi055 ceph-mon[31863]: pgmap v6656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11012.990105 secs 2024-03-28T09:03:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11012.990105 secs 2024-03-28T09:03:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11012.990105 secs 2024-03-28T09:03:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:34 smithi086 ceph-mon[35163]: pgmap v6657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:34 smithi159 ceph-mon[36109]: pgmap v6657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:34 smithi055 ceph-mon[31863]: pgmap v6657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:36 smithi086 ceph-mon[35163]: pgmap v6658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:36 smithi159 ceph-mon[36109]: pgmap v6658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:36 smithi055 ceph-mon[31863]: pgmap v6658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:38 smithi086 ceph-mon[35163]: pgmap v6659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11017.990175 secs 2024-03-28T09:03:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:38 smithi159 ceph-mon[36109]: pgmap v6659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11017.990175 secs 2024-03-28T09:03:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:38 smithi055 ceph-mon[31863]: pgmap v6659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11017.990175 secs 2024-03-28T09:03:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:40 smithi086 ceph-mon[35163]: pgmap v6660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:40 smithi159 ceph-mon[36109]: pgmap v6660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:40 smithi055 ceph-mon[31863]: pgmap v6660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:42 smithi086 ceph-mon[35163]: pgmap v6661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:42 smithi159 ceph-mon[36109]: pgmap v6661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:42 smithi055 ceph-mon[31863]: pgmap v6661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:03:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11022.990299 secs 2024-03-28T09:03:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11022.990299 secs 2024-03-28T09:03:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11022.990299 secs 2024-03-28T09:03:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:44 smithi086 ceph-mon[35163]: pgmap v6662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:44 smithi159 ceph-mon[36109]: pgmap v6662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:44 smithi055 ceph-mon[31863]: pgmap v6662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:03:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:45 smithi086 ceph-mon[35163]: pgmap v6663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:45 smithi159 ceph-mon[36109]: pgmap v6663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:45 smithi055 ceph-mon[31863]: pgmap v6663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:47 smithi086 ceph-mon[35163]: pgmap v6664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:47 smithi159 ceph-mon[36109]: pgmap v6664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:47 smithi055 ceph-mon[31863]: pgmap v6664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11027.990424 secs 2024-03-28T09:03:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11027.990424 secs 2024-03-28T09:03:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11027.990424 secs 2024-03-28T09:03:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:49 smithi086 ceph-mon[35163]: pgmap v6665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:49 smithi159 ceph-mon[36109]: pgmap v6665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:49 smithi055 ceph-mon[31863]: pgmap v6665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:51 smithi086 ceph-mon[35163]: pgmap v6666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:51 smithi159 ceph-mon[36109]: pgmap v6666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:51 smithi055 ceph-mon[31863]: pgmap v6666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:03:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:53 smithi086 ceph-mon[35163]: pgmap v6667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:03:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11032.990497 secs 2024-03-28T09:03:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:53 smithi159 ceph-mon[36109]: pgmap v6667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:03:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11032.990497 secs 2024-03-28T09:03:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:53 smithi055 ceph-mon[31863]: pgmap v6667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:03:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11032.990497 secs 2024-03-28T09:03:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:55 smithi086 ceph-mon[35163]: pgmap v6668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:03:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:55 smithi159 ceph-mon[36109]: pgmap v6668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:03:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:55 smithi055 ceph-mon[31863]: pgmap v6668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:03:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:57 smithi086 ceph-mon[35163]: pgmap v6669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:57 smithi159 ceph-mon[36109]: pgmap v6669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:57 smithi055 ceph-mon[31863]: pgmap v6669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11037.990619 secs 2024-03-28T09:03:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11037.990619 secs 2024-03-28T09:03:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11037.990619 secs 2024-03-28T09:03:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:03:59 smithi086 ceph-mon[35163]: pgmap v6670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:03:59 smithi159 ceph-mon[36109]: pgmap v6670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:03:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:03:59 smithi055 ceph-mon[31863]: pgmap v6670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:01 smithi055 ceph-mon[31863]: pgmap v6671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:04:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:01 smithi086 ceph-mon[35163]: pgmap v6671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:04:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:01 smithi159 ceph-mon[36109]: pgmap v6671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:04:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:03 smithi055 ceph-mon[31863]: pgmap v6672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11042.990739 secs 2024-03-28T09:04:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:04:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:03 smithi086 ceph-mon[35163]: pgmap v6672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11042.990739 secs 2024-03-28T09:04:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:04:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:03 smithi159 ceph-mon[36109]: pgmap v6672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11042.990739 secs 2024-03-28T09:04:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:05.056 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:05 smithi086 ceph-mon[35163]: pgmap v6673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:05 smithi159 ceph-mon[36109]: pgmap v6673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:05 smithi055 ceph-mon[31863]: pgmap v6673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:07 smithi055 ceph-mon[31863]: pgmap v6674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:07 smithi086 ceph-mon[35163]: pgmap v6674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:07 smithi159 ceph-mon[36109]: pgmap v6674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11047.990810 secs 2024-03-28T09:04:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11047.990810 secs 2024-03-28T09:04:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11047.990810 secs 2024-03-28T09:04:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: pgmap v6675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:04:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:04:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: pgmap v6676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:04:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: pgmap v6677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:04:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: pgmap v6675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:04:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:04:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: pgmap v6676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:04:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: pgmap v6677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:04:10.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: pgmap v6675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:04:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:04:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: pgmap v6676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:04:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: pgmap v6677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:04:10.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:04:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:12 smithi055 ceph-mon[31863]: pgmap v6678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:12 smithi086 ceph-mon[35163]: pgmap v6678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:12 smithi159 ceph-mon[36109]: pgmap v6678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11052.990855 secs 2024-03-28T09:04:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11052.990855 secs 2024-03-28T09:04:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11052.990855 secs 2024-03-28T09:04:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:14 smithi055 ceph-mon[31863]: pgmap v6679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:14 smithi086 ceph-mon[35163]: pgmap v6679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:14 smithi159 ceph-mon[36109]: pgmap v6679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:04:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:16 smithi055 ceph-mon[31863]: pgmap v6680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:16 smithi086 ceph-mon[35163]: pgmap v6680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:16 smithi159 ceph-mon[36109]: pgmap v6680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:18 smithi055 ceph-mon[31863]: pgmap v6681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11057.990940 secs 2024-03-28T09:04:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:18 smithi086 ceph-mon[35163]: pgmap v6681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11057.990940 secs 2024-03-28T09:04:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:18 smithi159 ceph-mon[36109]: pgmap v6681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11057.990940 secs 2024-03-28T09:04:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:20 smithi086 ceph-mon[35163]: pgmap v6682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:04:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:20 smithi159 ceph-mon[36109]: pgmap v6682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:04:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:20 smithi055 ceph-mon[31863]: pgmap v6682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:04:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:22 smithi086 ceph-mon[35163]: pgmap v6683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:22 smithi159 ceph-mon[36109]: pgmap v6683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:22 smithi055 ceph-mon[31863]: pgmap v6683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11062.990979 secs 2024-03-28T09:04:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11062.990979 secs 2024-03-28T09:04:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11062.990979 secs 2024-03-28T09:04:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:24 smithi055 ceph-mon[31863]: pgmap v6684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:24 smithi086 ceph-mon[35163]: pgmap v6684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:24 smithi159 ceph-mon[36109]: pgmap v6684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:26 smithi086 ceph-mon[35163]: pgmap v6685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:26 smithi159 ceph-mon[36109]: pgmap v6685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:26 smithi055 ceph-mon[31863]: pgmap v6685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:28 smithi086 ceph-mon[35163]: pgmap v6686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11067.991036 secs 2024-03-28T09:04:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:28 smithi159 ceph-mon[36109]: pgmap v6686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11067.991036 secs 2024-03-28T09:04:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:28 smithi055 ceph-mon[31863]: pgmap v6686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11067.991036 secs 2024-03-28T09:04:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:30 smithi086 ceph-mon[35163]: pgmap v6687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:30 smithi159 ceph-mon[36109]: pgmap v6687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:30 smithi055 ceph-mon[31863]: pgmap v6687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:32 smithi086 ceph-mon[35163]: pgmap v6688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:32 smithi159 ceph-mon[36109]: pgmap v6688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:32 smithi055 ceph-mon[31863]: pgmap v6688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11072.991112 secs 2024-03-28T09:04:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11072.991112 secs 2024-03-28T09:04:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11072.991112 secs 2024-03-28T09:04:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:34 smithi159 ceph-mon[36109]: pgmap v6689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:34 smithi086 ceph-mon[35163]: pgmap v6689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:34 smithi055 ceph-mon[31863]: pgmap v6689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:36 smithi086 ceph-mon[35163]: pgmap v6690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:36 smithi159 ceph-mon[36109]: pgmap v6690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:36 smithi055 ceph-mon[31863]: pgmap v6690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:38 smithi086 ceph-mon[35163]: pgmap v6691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11077.991156 secs 2024-03-28T09:04:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:38 smithi159 ceph-mon[36109]: pgmap v6691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11077.991156 secs 2024-03-28T09:04:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:38 smithi055 ceph-mon[31863]: pgmap v6691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11077.991156 secs 2024-03-28T09:04:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:40 smithi086 ceph-mon[35163]: pgmap v6692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:40 smithi159 ceph-mon[36109]: pgmap v6692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:40 smithi055 ceph-mon[31863]: pgmap v6692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:42 smithi086 ceph-mon[35163]: pgmap v6693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:42 smithi159 ceph-mon[36109]: pgmap v6693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:42 smithi055 ceph-mon[31863]: pgmap v6693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11082.991242 secs 2024-03-28T09:04:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11082.991242 secs 2024-03-28T09:04:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11082.991242 secs 2024-03-28T09:04:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:44 smithi086 ceph-mon[35163]: pgmap v6694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:44 smithi159 ceph-mon[36109]: pgmap v6694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:44 smithi055 ceph-mon[31863]: pgmap v6694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:46 smithi086 ceph-mon[35163]: pgmap v6695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:46 smithi159 ceph-mon[36109]: pgmap v6695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:46 smithi055 ceph-mon[31863]: pgmap v6695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:47 smithi055 ceph-mon[31863]: pgmap v6696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:47 smithi086 ceph-mon[35163]: pgmap v6696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:47 smithi159 ceph-mon[36109]: pgmap v6696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11087.991316 secs 2024-03-28T09:04:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11087.991316 secs 2024-03-28T09:04:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11087.991316 secs 2024-03-28T09:04:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:49 smithi055 ceph-mon[31863]: pgmap v6697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:49 smithi086 ceph-mon[35163]: pgmap v6697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:49 smithi159 ceph-mon[36109]: pgmap v6697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:52 smithi055 ceph-mon[31863]: pgmap v6698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:52 smithi086 ceph-mon[35163]: pgmap v6698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:52 smithi159 ceph-mon[36109]: pgmap v6698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11092.991370 secs 2024-03-28T09:04:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11092.991370 secs 2024-03-28T09:04:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11092.991370 secs 2024-03-28T09:04:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:54 smithi055 ceph-mon[31863]: pgmap v6699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:54 smithi086 ceph-mon[35163]: pgmap v6699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:54 smithi159 ceph-mon[36109]: pgmap v6699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:56 smithi086 ceph-mon[35163]: pgmap v6700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:56 smithi159 ceph-mon[36109]: pgmap v6700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:56 smithi055 ceph-mon[31863]: pgmap v6700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:04:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:58 smithi086 ceph-mon[35163]: pgmap v6701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11097.991506 secs 2024-03-28T09:04:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:58 smithi159 ceph-mon[36109]: pgmap v6701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11097.991506 secs 2024-03-28T09:04:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:58 smithi055 ceph-mon[31863]: pgmap v6701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:04:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11097.991506 secs 2024-03-28T09:05:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:00 smithi086 ceph-mon[35163]: pgmap v6702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:00 smithi159 ceph-mon[36109]: pgmap v6702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:00 smithi055 ceph-mon[31863]: pgmap v6702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:02 smithi086 ceph-mon[35163]: pgmap v6703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:02 smithi159 ceph-mon[36109]: pgmap v6703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:02 smithi055 ceph-mon[31863]: pgmap v6703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11102.991640 secs 2024-03-28T09:05:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11102.991640 secs 2024-03-28T09:05:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11102.991640 secs 2024-03-28T09:05:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:04 smithi086 ceph-mon[35163]: pgmap v6704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:04 smithi159 ceph-mon[36109]: pgmap v6704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:04 smithi055 ceph-mon[31863]: pgmap v6704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:06 smithi086 ceph-mon[35163]: pgmap v6705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:06 smithi159 ceph-mon[36109]: pgmap v6705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:06 smithi055 ceph-mon[31863]: pgmap v6705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:08 smithi086 ceph-mon[35163]: pgmap v6706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11107.991707 secs 2024-03-28T09:05:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:08 smithi159 ceph-mon[36109]: pgmap v6706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11107.991707 secs 2024-03-28T09:05:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:08 smithi055 ceph-mon[31863]: pgmap v6706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11107.991707 secs 2024-03-28T09:05:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:10 smithi086 ceph-mon[35163]: pgmap v6707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:05:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:10 smithi159 ceph-mon[36109]: pgmap v6707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:05:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:10 smithi055 ceph-mon[31863]: pgmap v6707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:05:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:05:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:05:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:05:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:05:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:05:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:05:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:05:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:05:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:05:12.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:12 smithi055 ceph-mon[31863]: pgmap v6708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:12.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:12 smithi055 ceph-mon[31863]: pgmap v6709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:12 smithi086 ceph-mon[35163]: pgmap v6708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:12 smithi086 ceph-mon[35163]: pgmap v6709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:12 smithi159 ceph-mon[36109]: pgmap v6708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:12 smithi159 ceph-mon[36109]: pgmap v6709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11112.991834 secs 2024-03-28T09:05:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11112.991834 secs 2024-03-28T09:05:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11112.991834 secs 2024-03-28T09:05:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:14 smithi086 ceph-mon[35163]: pgmap v6710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:05:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:14 smithi159 ceph-mon[36109]: pgmap v6710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:05:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:14 smithi055 ceph-mon[31863]: pgmap v6710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:05:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:16 smithi086 ceph-mon[35163]: pgmap v6711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:16 smithi159 ceph-mon[36109]: pgmap v6711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:16 smithi055 ceph-mon[31863]: pgmap v6711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:18 smithi086 ceph-mon[35163]: pgmap v6712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11117.991970 secs 2024-03-28T09:05:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:18 smithi159 ceph-mon[36109]: pgmap v6712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11117.991970 secs 2024-03-28T09:05:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:18 smithi055 ceph-mon[31863]: pgmap v6712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11117.991970 secs 2024-03-28T09:05:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:20 smithi086 ceph-mon[35163]: pgmap v6713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:20 smithi159 ceph-mon[36109]: pgmap v6713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:20 smithi055 ceph-mon[31863]: pgmap v6713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:22 smithi086 ceph-mon[35163]: pgmap v6714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:05:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:22 smithi159 ceph-mon[36109]: pgmap v6714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:05:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:22 smithi055 ceph-mon[31863]: pgmap v6714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:05:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11122.992063 secs 2024-03-28T09:05:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11122.992063 secs 2024-03-28T09:05:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11122.992063 secs 2024-03-28T09:05:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:24 smithi086 ceph-mon[35163]: pgmap v6715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:05:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:24 smithi159 ceph-mon[36109]: pgmap v6715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:05:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:24 smithi055 ceph-mon[31863]: pgmap v6715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:05:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:26 smithi086 ceph-mon[35163]: pgmap v6716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:26 smithi159 ceph-mon[36109]: pgmap v6716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:26 smithi055 ceph-mon[31863]: pgmap v6716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:28 smithi086 ceph-mon[35163]: pgmap v6717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11127.992183 secs 2024-03-28T09:05:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:28 smithi159 ceph-mon[36109]: pgmap v6717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11127.992183 secs 2024-03-28T09:05:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:28 smithi055 ceph-mon[31863]: pgmap v6717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11127.992183 secs 2024-03-28T09:05:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:29 smithi086 ceph-mon[35163]: pgmap v6718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:29 smithi159 ceph-mon[36109]: pgmap v6718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:29 smithi055 ceph-mon[31863]: pgmap v6718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:05:32.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:31 smithi086 ceph-mon[35163]: pgmap v6719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:32.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:31 smithi159 ceph-mon[36109]: pgmap v6719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:31 smithi055 ceph-mon[31863]: pgmap v6719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:05:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11132.992260 secs 2024-03-28T09:05:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:33 smithi086 ceph-mon[35163]: pgmap v6720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11132.992260 secs 2024-03-28T09:05:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:33 smithi159 ceph-mon[36109]: pgmap v6720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11132.992260 secs 2024-03-28T09:05:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:33 smithi055 ceph-mon[31863]: pgmap v6720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:35 smithi086 ceph-mon[35163]: pgmap v6721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:35 smithi159 ceph-mon[36109]: pgmap v6721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:35 smithi055 ceph-mon[31863]: pgmap v6721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:37 smithi086 ceph-mon[35163]: pgmap v6722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:37 smithi159 ceph-mon[36109]: pgmap v6722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:37 smithi055 ceph-mon[31863]: pgmap v6722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11137.992344 secs 2024-03-28T09:05:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11137.992344 secs 2024-03-28T09:05:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11137.992344 secs 2024-03-28T09:05:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:39 smithi086 ceph-mon[35163]: pgmap v6723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:39 smithi159 ceph-mon[36109]: pgmap v6723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:39 smithi055 ceph-mon[31863]: pgmap v6723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:41 smithi086 ceph-mon[35163]: pgmap v6724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:41 smithi159 ceph-mon[36109]: pgmap v6724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:41 smithi055 ceph-mon[31863]: pgmap v6724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11142.992423 secs 2024-03-28T09:05:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:43 smithi086 ceph-mon[35163]: pgmap v6725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11142.992423 secs 2024-03-28T09:05:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:43 smithi159 ceph-mon[36109]: pgmap v6725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11142.992423 secs 2024-03-28T09:05:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:43 smithi055 ceph-mon[31863]: pgmap v6725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:45 smithi086 ceph-mon[35163]: pgmap v6726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:45 smithi159 ceph-mon[36109]: pgmap v6726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:45 smithi055 ceph-mon[31863]: pgmap v6726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:47 smithi086 ceph-mon[35163]: pgmap v6727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:47 smithi159 ceph-mon[36109]: pgmap v6727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:47 smithi055 ceph-mon[31863]: pgmap v6727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11147.992520 secs 2024-03-28T09:05:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11147.992520 secs 2024-03-28T09:05:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11147.992520 secs 2024-03-28T09:05:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:50 smithi086 ceph-mon[35163]: pgmap v6728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:50 smithi159 ceph-mon[36109]: pgmap v6728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:50 smithi055 ceph-mon[31863]: pgmap v6728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:52 smithi086 ceph-mon[35163]: pgmap v6729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:52 smithi159 ceph-mon[36109]: pgmap v6729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:52 smithi055 ceph-mon[31863]: pgmap v6729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:05:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11152.992619 secs 2024-03-28T09:05:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:54 smithi086 ceph-mon[35163]: pgmap v6730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11152.992619 secs 2024-03-28T09:05:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:54 smithi159 ceph-mon[36109]: pgmap v6730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11152.992619 secs 2024-03-28T09:05:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:54 smithi055 ceph-mon[31863]: pgmap v6730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:05:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:56 smithi086 ceph-mon[35163]: pgmap v6731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:56 smithi159 ceph-mon[36109]: pgmap v6731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:56 smithi055 ceph-mon[31863]: pgmap v6731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:58 smithi086 ceph-mon[35163]: pgmap v6732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:58 smithi159 ceph-mon[36109]: pgmap v6732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:58 smithi055 ceph-mon[31863]: pgmap v6732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:05:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:05:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11157.992692 secs 2024-03-28T09:05:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:05:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11157.992692 secs 2024-03-28T09:05:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:05:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11157.992692 secs 2024-03-28T09:06:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:00 smithi086 ceph-mon[35163]: pgmap v6733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:00 smithi159 ceph-mon[36109]: pgmap v6733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:00 smithi055 ceph-mon[31863]: pgmap v6733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:02 smithi086 ceph-mon[35163]: pgmap v6734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:02 smithi159 ceph-mon[36109]: pgmap v6734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:02 smithi055 ceph-mon[31863]: pgmap v6734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11162.992816 secs 2024-03-28T09:06:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:04 smithi159 ceph-mon[36109]: pgmap v6735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11162.992816 secs 2024-03-28T09:06:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:04 smithi055 ceph-mon[31863]: pgmap v6735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11162.992816 secs 2024-03-28T09:06:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:04 smithi086 ceph-mon[35163]: pgmap v6735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:06 smithi055 ceph-mon[31863]: pgmap v6736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:06 smithi086 ceph-mon[35163]: pgmap v6736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:06 smithi159 ceph-mon[36109]: pgmap v6736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:08 smithi055 ceph-mon[31863]: pgmap v6737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11167.992900 secs 2024-03-28T09:06:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:08 smithi086 ceph-mon[35163]: pgmap v6737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11167.992900 secs 2024-03-28T09:06:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:08 smithi159 ceph-mon[36109]: pgmap v6737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11167.992900 secs 2024-03-28T09:06:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:10 smithi055 ceph-mon[31863]: pgmap v6738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:10 smithi086 ceph-mon[35163]: pgmap v6738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:10 smithi159 ceph-mon[36109]: pgmap v6738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:12 smithi055 ceph-mon[31863]: pgmap v6739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:06:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:12 smithi086 ceph-mon[35163]: pgmap v6739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:06:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:12 smithi159 ceph-mon[36109]: pgmap v6739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:06:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11172.992978 secs 2024-03-28T09:06:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11172.992978 secs 2024-03-28T09:06:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11172.992978 secs 2024-03-28T09:06:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: pgmap v6740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:06:14.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: pgmap v6740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:06:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:06:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: pgmap v6740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:06:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:06:14.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:06:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:15 smithi055 ceph-mon[31863]: pgmap v6741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:15 smithi055 ceph-mon[31863]: pgmap v6742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:15 smithi086 ceph-mon[35163]: pgmap v6741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:15 smithi086 ceph-mon[35163]: pgmap v6742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:15 smithi159 ceph-mon[36109]: pgmap v6741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:15 smithi159 ceph-mon[36109]: pgmap v6742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:17 smithi055 ceph-mon[31863]: pgmap v6743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:17 smithi086 ceph-mon[35163]: pgmap v6743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:17 smithi159 ceph-mon[36109]: pgmap v6743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11177.993042 secs 2024-03-28T09:06:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11177.993042 secs 2024-03-28T09:06:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11177.993042 secs 2024-03-28T09:06:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:19 smithi086 ceph-mon[35163]: pgmap v6744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:19 smithi159 ceph-mon[36109]: pgmap v6744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:19 smithi055 ceph-mon[31863]: pgmap v6744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:21 smithi086 ceph-mon[35163]: pgmap v6745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:06:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:21 smithi159 ceph-mon[36109]: pgmap v6745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:06:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:21 smithi055 ceph-mon[31863]: pgmap v6745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T09:06:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:23 smithi086 ceph-mon[35163]: pgmap v6746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11182.993110 secs 2024-03-28T09:06:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:23 smithi159 ceph-mon[36109]: pgmap v6746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11182.993110 secs 2024-03-28T09:06:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:23 smithi055 ceph-mon[31863]: pgmap v6746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:06:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11182.993110 secs 2024-03-28T09:06:25.521 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:25 smithi055 ceph-mon[31863]: pgmap v6747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:06:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:25 smithi086 ceph-mon[35163]: pgmap v6747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:06:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:25 smithi159 ceph-mon[36109]: pgmap v6747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:06:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:27 smithi086 ceph-mon[35163]: pgmap v6748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:27 smithi159 ceph-mon[36109]: pgmap v6748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:27 smithi055 ceph-mon[31863]: pgmap v6748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11187.993175 secs 2024-03-28T09:06:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11187.993175 secs 2024-03-28T09:06:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11187.993175 secs 2024-03-28T09:06:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:29 smithi086 ceph-mon[35163]: pgmap v6749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:29 smithi159 ceph-mon[36109]: pgmap v6749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:29 smithi055 ceph-mon[31863]: pgmap v6749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:31 smithi086 ceph-mon[35163]: pgmap v6750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:31 smithi159 ceph-mon[36109]: pgmap v6750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:31 smithi055 ceph-mon[31863]: pgmap v6750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:33 smithi086 ceph-mon[35163]: pgmap v6751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11192.993241 secs 2024-03-28T09:06:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:33 smithi159 ceph-mon[36109]: pgmap v6751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11192.993241 secs 2024-03-28T09:06:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:33 smithi055 ceph-mon[31863]: pgmap v6751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11192.993241 secs 2024-03-28T09:06:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:35 smithi086 ceph-mon[35163]: pgmap v6752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:35 smithi159 ceph-mon[36109]: pgmap v6752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:35 smithi055 ceph-mon[31863]: pgmap v6752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:37 smithi086 ceph-mon[35163]: pgmap v6753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:37 smithi159 ceph-mon[36109]: pgmap v6753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:37 smithi055 ceph-mon[31863]: pgmap v6753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11197.993356 secs 2024-03-28T09:06:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11197.993356 secs 2024-03-28T09:06:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11197.993356 secs 2024-03-28T09:06:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:39 smithi086 ceph-mon[35163]: pgmap v6754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:39 smithi159 ceph-mon[36109]: pgmap v6754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:39 smithi055 ceph-mon[31863]: pgmap v6754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:41 smithi086 ceph-mon[35163]: pgmap v6755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:41 smithi159 ceph-mon[36109]: pgmap v6755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:41 smithi055 ceph-mon[31863]: pgmap v6755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:43 smithi086 ceph-mon[35163]: pgmap v6756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11202.993423 secs 2024-03-28T09:06:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:43 smithi159 ceph-mon[36109]: pgmap v6756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11202.993423 secs 2024-03-28T09:06:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:43 smithi055 ceph-mon[31863]: pgmap v6756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11202.993423 secs 2024-03-28T09:06:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:45 smithi086 ceph-mon[35163]: pgmap v6757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:45 smithi159 ceph-mon[36109]: pgmap v6757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:45 smithi055 ceph-mon[31863]: pgmap v6757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:47 smithi086 ceph-mon[35163]: pgmap v6758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:47 smithi159 ceph-mon[36109]: pgmap v6758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:47 smithi055 ceph-mon[31863]: pgmap v6758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11207.993545 secs 2024-03-28T09:06:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11207.993545 secs 2024-03-28T09:06:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11207.993545 secs 2024-03-28T09:06:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:49 smithi086 ceph-mon[35163]: pgmap v6759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:49 smithi159 ceph-mon[36109]: pgmap v6759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:49 smithi055 ceph-mon[31863]: pgmap v6759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:51 smithi086 ceph-mon[35163]: pgmap v6760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:51 smithi159 ceph-mon[36109]: pgmap v6760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:51 smithi055 ceph-mon[31863]: pgmap v6760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:53 smithi086 ceph-mon[35163]: pgmap v6761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11212.993665 secs 2024-03-28T09:06:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:53 smithi159 ceph-mon[36109]: pgmap v6761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11212.993665 secs 2024-03-28T09:06:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:53 smithi055 ceph-mon[31863]: pgmap v6761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11212.993665 secs 2024-03-28T09:06:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:55 smithi086 ceph-mon[35163]: pgmap v6762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:55 smithi159 ceph-mon[36109]: pgmap v6762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:55 smithi055 ceph-mon[31863]: pgmap v6762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:57 smithi086 ceph-mon[35163]: pgmap v6763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:57 smithi159 ceph-mon[36109]: pgmap v6763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:57 smithi055 ceph-mon[31863]: pgmap v6763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:06:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11217.993751 secs 2024-03-28T09:06:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11217.993751 secs 2024-03-28T09:06:58.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11217.993751 secs 2024-03-28T09:06:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:06:59 smithi086 ceph-mon[35163]: pgmap v6764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:06:59 smithi159 ceph-mon[36109]: pgmap v6764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:06:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:06:59 smithi055 ceph-mon[31863]: pgmap v6764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:00 smithi055 ceph-mon[31863]: pgmap v6765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:00 smithi086 ceph-mon[35163]: pgmap v6765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:00 smithi159 ceph-mon[36109]: pgmap v6765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:02 smithi055 ceph-mon[31863]: pgmap v6766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:02 smithi086 ceph-mon[35163]: pgmap v6766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:02 smithi159 ceph-mon[36109]: pgmap v6766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:03.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11222.993860 secs 2024-03-28T09:07:03.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11222.993860 secs 2024-03-28T09:07:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11222.993860 secs 2024-03-28T09:07:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:04 smithi086 ceph-mon[35163]: pgmap v6767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:04 smithi159 ceph-mon[36109]: pgmap v6767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:04 smithi055 ceph-mon[31863]: pgmap v6767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:06 smithi086 ceph-mon[35163]: pgmap v6768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:06 smithi159 ceph-mon[36109]: pgmap v6768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:06 smithi055 ceph-mon[31863]: pgmap v6768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:08 smithi086 ceph-mon[35163]: pgmap v6769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11227.993945 secs 2024-03-28T09:07:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:08 smithi159 ceph-mon[36109]: pgmap v6769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11227.993945 secs 2024-03-28T09:07:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:08 smithi055 ceph-mon[31863]: pgmap v6769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11227.993945 secs 2024-03-28T09:07:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:10 smithi086 ceph-mon[35163]: pgmap v6770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:10 smithi159 ceph-mon[36109]: pgmap v6770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:10 smithi055 ceph-mon[31863]: pgmap v6770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:12 smithi086 ceph-mon[35163]: pgmap v6771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:12 smithi159 ceph-mon[36109]: pgmap v6771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:12 smithi055 ceph-mon[31863]: pgmap v6771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:14.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11232.994025 secs 2024-03-28T09:07:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11232.994025 secs 2024-03-28T09:07:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11232.994025 secs 2024-03-28T09:07:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:14 smithi086 ceph-mon[35163]: pgmap v6772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:07:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:14 smithi159 ceph-mon[36109]: pgmap v6772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:07:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:14 smithi055 ceph-mon[31863]: pgmap v6772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:07:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: pgmap v6773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:07:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:07:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: pgmap v6774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T09:07:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: pgmap v6775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: pgmap v6773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: pgmap v6774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T09:07:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: pgmap v6775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:17.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: pgmap v6773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:07:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:07:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:07:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: pgmap v6774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T09:07:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: pgmap v6775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:17.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:07:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11237.994052 secs 2024-03-28T09:07:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11237.994052 secs 2024-03-28T09:07:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11237.994052 secs 2024-03-28T09:07:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:19 smithi086 ceph-mon[35163]: pgmap v6776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:19 smithi159 ceph-mon[36109]: pgmap v6776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:19 smithi055 ceph-mon[31863]: pgmap v6776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T09:07:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:21 smithi086 ceph-mon[35163]: pgmap v6777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:21.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:21 smithi159 ceph-mon[36109]: pgmap v6777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:21 smithi055 ceph-mon[31863]: pgmap v6777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:23 smithi086 ceph-mon[35163]: pgmap v6778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11242.994143 secs 2024-03-28T09:07:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:23 smithi159 ceph-mon[36109]: pgmap v6778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11242.994143 secs 2024-03-28T09:07:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:23 smithi055 ceph-mon[31863]: pgmap v6778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:07:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11242.994143 secs 2024-03-28T09:07:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:25 smithi086 ceph-mon[35163]: pgmap v6779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:07:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:25 smithi159 ceph-mon[36109]: pgmap v6779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:07:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:25 smithi055 ceph-mon[31863]: pgmap v6779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:07:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:27 smithi086 ceph-mon[35163]: pgmap v6780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:07:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:27 smithi159 ceph-mon[36109]: pgmap v6780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:07:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:27 smithi055 ceph-mon[31863]: pgmap v6780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:07:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11247.994259 secs 2024-03-28T09:07:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11247.994259 secs 2024-03-28T09:07:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11247.994259 secs 2024-03-28T09:07:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:29 smithi086 ceph-mon[35163]: pgmap v6781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:29 smithi159 ceph-mon[36109]: pgmap v6781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:29 smithi055 ceph-mon[31863]: pgmap v6781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:31 smithi086 ceph-mon[35163]: pgmap v6782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:31 smithi159 ceph-mon[36109]: pgmap v6782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:31 smithi055 ceph-mon[31863]: pgmap v6782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:33 smithi086 ceph-mon[35163]: pgmap v6783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11252.994332 secs 2024-03-28T09:07:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:33 smithi159 ceph-mon[36109]: pgmap v6783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11252.994332 secs 2024-03-28T09:07:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:33 smithi055 ceph-mon[31863]: pgmap v6783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11252.994332 secs 2024-03-28T09:07:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:35 smithi086 ceph-mon[35163]: pgmap v6784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:35 smithi159 ceph-mon[36109]: pgmap v6784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:35 smithi055 ceph-mon[31863]: pgmap v6784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:37 smithi086 ceph-mon[35163]: pgmap v6785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:37 smithi159 ceph-mon[36109]: pgmap v6785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:37 smithi055 ceph-mon[31863]: pgmap v6785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11257.994453 secs 2024-03-28T09:07:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11257.994453 secs 2024-03-28T09:07:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11257.994453 secs 2024-03-28T09:07:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:39 smithi086 ceph-mon[35163]: pgmap v6786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:39 smithi159 ceph-mon[36109]: pgmap v6786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:39 smithi055 ceph-mon[31863]: pgmap v6786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:41 smithi086 ceph-mon[35163]: pgmap v6787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:41 smithi159 ceph-mon[36109]: pgmap v6787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:41 smithi055 ceph-mon[31863]: pgmap v6787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:43 smithi086 ceph-mon[35163]: pgmap v6788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11262.994512 secs 2024-03-28T09:07:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:43 smithi159 ceph-mon[36109]: pgmap v6788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11262.994512 secs 2024-03-28T09:07:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:43 smithi055 ceph-mon[31863]: pgmap v6788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11262.994512 secs 2024-03-28T09:07:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:45 smithi086 ceph-mon[35163]: pgmap v6789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:45 smithi159 ceph-mon[36109]: pgmap v6789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:45 smithi055 ceph-mon[31863]: pgmap v6789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:47 smithi086 ceph-mon[35163]: pgmap v6790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:47 smithi159 ceph-mon[36109]: pgmap v6790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:47 smithi055 ceph-mon[31863]: pgmap v6790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11267.994589 secs 2024-03-28T09:07:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11267.994589 secs 2024-03-28T09:07:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11267.994589 secs 2024-03-28T09:07:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:49 smithi086 ceph-mon[35163]: pgmap v6791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:49 smithi159 ceph-mon[36109]: pgmap v6791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:49 smithi055 ceph-mon[31863]: pgmap v6791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:51 smithi086 ceph-mon[35163]: pgmap v6792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:51 smithi159 ceph-mon[36109]: pgmap v6792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:51 smithi055 ceph-mon[31863]: pgmap v6792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:07:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:53 smithi086 ceph-mon[35163]: pgmap v6793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11272.994665 secs 2024-03-28T09:07:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:53 smithi159 ceph-mon[36109]: pgmap v6793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11272.994665 secs 2024-03-28T09:07:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:53 smithi055 ceph-mon[31863]: pgmap v6793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11272.994665 secs 2024-03-28T09:07:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:55 smithi086 ceph-mon[35163]: pgmap v6794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:55 smithi159 ceph-mon[36109]: pgmap v6794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:55 smithi055 ceph-mon[31863]: pgmap v6794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:57 smithi086 ceph-mon[35163]: pgmap v6795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:57 smithi159 ceph-mon[36109]: pgmap v6795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:57 smithi055 ceph-mon[31863]: pgmap v6795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11277.994739 secs 2024-03-28T09:07:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11277.994739 secs 2024-03-28T09:07:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11277.994739 secs 2024-03-28T09:07:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:07:59 smithi086 ceph-mon[35163]: pgmap v6796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:07:59 smithi159 ceph-mon[36109]: pgmap v6796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:07:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:07:59 smithi055 ceph-mon[31863]: pgmap v6796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:01 smithi159 ceph-mon[36109]: pgmap v6797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:01 smithi055 ceph-mon[31863]: pgmap v6797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:01 smithi086 ceph-mon[35163]: pgmap v6797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:03.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:03 smithi086 ceph-mon[35163]: pgmap v6798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:03.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11282.994807 secs 2024-03-28T09:08:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:03 smithi055 ceph-mon[31863]: pgmap v6798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11282.994807 secs 2024-03-28T09:08:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:03 smithi159 ceph-mon[36109]: pgmap v6798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11282.994807 secs 2024-03-28T09:08:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:04 smithi055 ceph-mon[31863]: pgmap v6799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:04 smithi086 ceph-mon[35163]: pgmap v6799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:04 smithi159 ceph-mon[36109]: pgmap v6799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:07 smithi086 ceph-mon[35163]: pgmap v6800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:07 smithi159 ceph-mon[36109]: pgmap v6800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:07 smithi055 ceph-mon[31863]: pgmap v6800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11287.994927 secs 2024-03-28T09:08:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11287.994927 secs 2024-03-28T09:08:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11287.994927 secs 2024-03-28T09:08:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:09 smithi086 ceph-mon[35163]: pgmap v6801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:09 smithi159 ceph-mon[36109]: pgmap v6801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:09 smithi055 ceph-mon[31863]: pgmap v6801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:11 smithi086 ceph-mon[35163]: pgmap v6802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:11 smithi159 ceph-mon[36109]: pgmap v6802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:11 smithi055 ceph-mon[31863]: pgmap v6802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:13 smithi086 ceph-mon[35163]: pgmap v6803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11292.995003 secs 2024-03-28T09:08:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:13 smithi159 ceph-mon[36109]: pgmap v6803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11292.995003 secs 2024-03-28T09:08:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:13 smithi055 ceph-mon[31863]: pgmap v6803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11292.995003 secs 2024-03-28T09:08:15.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:15 smithi055 ceph-mon[31863]: pgmap v6804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:15 smithi086 ceph-mon[35163]: pgmap v6804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:15 smithi159 ceph-mon[36109]: pgmap v6804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:17 smithi086 ceph-mon[35163]: pgmap v6805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:08:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:17 smithi159 ceph-mon[36109]: pgmap v6805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:08:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:17 smithi055 ceph-mon[31863]: pgmap v6805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:08:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11297.995069 secs 2024-03-28T09:08:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:08:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:08:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:08:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11297.995069 secs 2024-03-28T09:08:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:08:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:08:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:08:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11297.995069 secs 2024-03-28T09:08:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:08:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:08:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:08:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:19 smithi086 ceph-mon[35163]: pgmap v6806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:19 smithi086 ceph-mon[35163]: pgmap v6807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:08:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:19 smithi159 ceph-mon[36109]: pgmap v6806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:19 smithi159 ceph-mon[36109]: pgmap v6807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:08:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:19 smithi055 ceph-mon[31863]: pgmap v6806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:19.649 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:19 smithi055 ceph-mon[31863]: pgmap v6807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:08:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:21 smithi086 ceph-mon[35163]: pgmap v6808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:21 smithi159 ceph-mon[36109]: pgmap v6808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:21 smithi055 ceph-mon[31863]: pgmap v6808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:23 smithi086 ceph-mon[35163]: pgmap v6809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11302.995135 secs 2024-03-28T09:08:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:23 smithi159 ceph-mon[36109]: pgmap v6809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11302.995135 secs 2024-03-28T09:08:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:23 smithi055 ceph-mon[31863]: pgmap v6809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11302.995135 secs 2024-03-28T09:08:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:25 smithi086 ceph-mon[35163]: pgmap v6810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:25 smithi159 ceph-mon[36109]: pgmap v6810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:25 smithi055 ceph-mon[31863]: pgmap v6810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:27 smithi086 ceph-mon[35163]: pgmap v6811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:27 smithi159 ceph-mon[36109]: pgmap v6811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:27 smithi055 ceph-mon[31863]: pgmap v6811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:08:28.490 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11307.995199 secs 2024-03-28T09:08:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11307.995199 secs 2024-03-28T09:08:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11307.995199 secs 2024-03-28T09:08:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:29 smithi086 ceph-mon[35163]: pgmap v6812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:08:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:29 smithi159 ceph-mon[36109]: pgmap v6812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:08:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:29 smithi055 ceph-mon[31863]: pgmap v6812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:08:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:31 smithi086 ceph-mon[35163]: pgmap v6813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:31 smithi159 ceph-mon[36109]: pgmap v6813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:31 smithi055 ceph-mon[31863]: pgmap v6813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:33 smithi086 ceph-mon[35163]: pgmap v6814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11312.995324 secs 2024-03-28T09:08:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:33 smithi159 ceph-mon[36109]: pgmap v6814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11312.995324 secs 2024-03-28T09:08:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:33 smithi055 ceph-mon[31863]: pgmap v6814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11312.995324 secs 2024-03-28T09:08:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:35 smithi086 ceph-mon[35163]: pgmap v6815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:35 smithi159 ceph-mon[36109]: pgmap v6815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:35 smithi055 ceph-mon[31863]: pgmap v6815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:37 smithi086 ceph-mon[35163]: pgmap v6816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:37 smithi159 ceph-mon[36109]: pgmap v6816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:37 smithi055 ceph-mon[31863]: pgmap v6816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11317.995402 secs 2024-03-28T09:08:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11317.995402 secs 2024-03-28T09:08:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11317.995402 secs 2024-03-28T09:08:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:39 smithi086 ceph-mon[35163]: pgmap v6817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:39 smithi159 ceph-mon[36109]: pgmap v6817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:39 smithi055 ceph-mon[31863]: pgmap v6817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:41 smithi086 ceph-mon[35163]: pgmap v6818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:41 smithi159 ceph-mon[36109]: pgmap v6818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:41 smithi055 ceph-mon[31863]: pgmap v6818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:43 smithi086 ceph-mon[35163]: pgmap v6819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11322.995530 secs 2024-03-28T09:08:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:43 smithi159 ceph-mon[36109]: pgmap v6819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11322.995530 secs 2024-03-28T09:08:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:43 smithi055 ceph-mon[31863]: pgmap v6819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11322.995530 secs 2024-03-28T09:08:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:45 smithi086 ceph-mon[35163]: pgmap v6820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:45 smithi159 ceph-mon[36109]: pgmap v6820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:45 smithi055 ceph-mon[31863]: pgmap v6820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:47 smithi086 ceph-mon[35163]: pgmap v6821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:47 smithi159 ceph-mon[36109]: pgmap v6821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:47 smithi055 ceph-mon[31863]: pgmap v6821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11327.995652 secs 2024-03-28T09:08:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11327.995652 secs 2024-03-28T09:08:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11327.995652 secs 2024-03-28T09:08:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:49 smithi055 ceph-mon[31863]: pgmap v6822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:49 smithi086 ceph-mon[35163]: pgmap v6822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:49 smithi159 ceph-mon[36109]: pgmap v6822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:51 smithi055 ceph-mon[31863]: pgmap v6823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:51 smithi086 ceph-mon[35163]: pgmap v6823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:51 smithi159 ceph-mon[36109]: pgmap v6823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:52 smithi086 ceph-mon[35163]: pgmap v6824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:52 smithi159 ceph-mon[36109]: pgmap v6824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:52 smithi055 ceph-mon[31863]: pgmap v6824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11332.995814 secs 2024-03-28T09:08:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11332.995814 secs 2024-03-28T09:08:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11332.995814 secs 2024-03-28T09:08:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:54 smithi086 ceph-mon[35163]: pgmap v6825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:54 smithi159 ceph-mon[36109]: pgmap v6825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:54 smithi055 ceph-mon[31863]: pgmap v6825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:56 smithi086 ceph-mon[35163]: pgmap v6826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:56 smithi159 ceph-mon[36109]: pgmap v6826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:56 smithi055 ceph-mon[31863]: pgmap v6826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:08:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11337.995843 secs 2024-03-28T09:08:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:08:58 smithi086 ceph-mon[35163]: pgmap v6827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11337.995843 secs 2024-03-28T09:08:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:08:58 smithi159 ceph-mon[36109]: pgmap v6827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:08:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11337.995843 secs 2024-03-28T09:08:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:08:58 smithi055 ceph-mon[31863]: pgmap v6827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:00 smithi086 ceph-mon[35163]: pgmap v6828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:00 smithi159 ceph-mon[36109]: pgmap v6828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:00 smithi055 ceph-mon[31863]: pgmap v6828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:02 smithi086 ceph-mon[35163]: pgmap v6829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:02 smithi159 ceph-mon[36109]: pgmap v6829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:02 smithi055 ceph-mon[31863]: pgmap v6829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11342.995936 secs 2024-03-28T09:09:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11342.995936 secs 2024-03-28T09:09:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11342.995936 secs 2024-03-28T09:09:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:04 smithi086 ceph-mon[35163]: pgmap v6830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:04 smithi159 ceph-mon[36109]: pgmap v6830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:04 smithi055 ceph-mon[31863]: pgmap v6830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:06 smithi086 ceph-mon[35163]: pgmap v6831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:06 smithi159 ceph-mon[36109]: pgmap v6831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:06 smithi055 ceph-mon[31863]: pgmap v6831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11347.996021 secs 2024-03-28T09:09:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:08 smithi086 ceph-mon[35163]: pgmap v6832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11347.996021 secs 2024-03-28T09:09:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:09 smithi159 ceph-mon[36109]: pgmap v6832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11347.996021 secs 2024-03-28T09:09:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:08 smithi055 ceph-mon[31863]: pgmap v6832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:11 smithi086 ceph-mon[35163]: pgmap v6833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:11 smithi159 ceph-mon[36109]: pgmap v6833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:11 smithi055 ceph-mon[31863]: pgmap v6833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:13 smithi086 ceph-mon[35163]: pgmap v6834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:13 smithi159 ceph-mon[36109]: pgmap v6834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:13 smithi055 ceph-mon[31863]: pgmap v6834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11352.996142 secs 2024-03-28T09:09:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11352.996142 secs 2024-03-28T09:09:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11352.996142 secs 2024-03-28T09:09:15.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:15 smithi055 ceph-mon[31863]: pgmap v6835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:15 smithi086 ceph-mon[35163]: pgmap v6835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:15 smithi159 ceph-mon[36109]: pgmap v6835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:17 smithi086 ceph-mon[35163]: pgmap v6836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:17 smithi159 ceph-mon[36109]: pgmap v6836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:17 smithi055 ceph-mon[31863]: pgmap v6836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11357.996261 secs 2024-03-28T09:09:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:19 smithi086 ceph-mon[35163]: pgmap v6837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:09:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11357.996261 secs 2024-03-28T09:09:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:19 smithi159 ceph-mon[36109]: pgmap v6837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:09:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11357.996261 secs 2024-03-28T09:09:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:19 smithi055 ceph-mon[31863]: pgmap v6837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:09:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:09:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:09:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:09:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:09:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:09:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:09:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:09:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:09:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:09:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:21 smithi086 ceph-mon[35163]: pgmap v6838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:21 smithi086 ceph-mon[35163]: pgmap v6839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:21 smithi159 ceph-mon[36109]: pgmap v6838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:21 smithi159 ceph-mon[36109]: pgmap v6839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:21 smithi055 ceph-mon[31863]: pgmap v6838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:21 smithi055 ceph-mon[31863]: pgmap v6839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:23 smithi086 ceph-mon[35163]: pgmap v6840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:23.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:23 smithi159 ceph-mon[36109]: pgmap v6840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:23 smithi055 ceph-mon[31863]: pgmap v6840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11362.996337 secs 2024-03-28T09:09:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11362.996337 secs 2024-03-28T09:09:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11362.996337 secs 2024-03-28T09:09:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:25 smithi055 ceph-mon[31863]: pgmap v6841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:25 smithi086 ceph-mon[35163]: pgmap v6841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:25 smithi159 ceph-mon[36109]: pgmap v6841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:27 smithi055 ceph-mon[31863]: pgmap v6842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:27 smithi086 ceph-mon[35163]: pgmap v6842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:27 smithi159 ceph-mon[36109]: pgmap v6842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:29 smithi055 ceph-mon[31863]: pgmap v6843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:29.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11367.996460 secs 2024-03-28T09:09:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:29 smithi086 ceph-mon[35163]: pgmap v6843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11367.996460 secs 2024-03-28T09:09:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:29 smithi159 ceph-mon[36109]: pgmap v6843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11367.996460 secs 2024-03-28T09:09:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:31 smithi055 ceph-mon[31863]: pgmap v6844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:09:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:31 smithi086 ceph-mon[35163]: pgmap v6844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:09:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:31 smithi159 ceph-mon[36109]: pgmap v6844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:09:33.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:33 smithi086 ceph-mon[35163]: pgmap v6845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:33.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:33 smithi159 ceph-mon[36109]: pgmap v6845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:33 smithi055 ceph-mon[31863]: pgmap v6845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11372.996530 secs 2024-03-28T09:09:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11372.996530 secs 2024-03-28T09:09:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11372.996530 secs 2024-03-28T09:09:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:35 smithi055 ceph-mon[31863]: pgmap v6846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:35 smithi086 ceph-mon[35163]: pgmap v6846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:35 smithi159 ceph-mon[36109]: pgmap v6846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:09:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:37 smithi086 ceph-mon[35163]: pgmap v6847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:37 smithi159 ceph-mon[36109]: pgmap v6847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:37 smithi055 ceph-mon[31863]: pgmap v6847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:09:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11377.996652 secs 2024-03-28T09:09:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11377.996652 secs 2024-03-28T09:09:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11377.996652 secs 2024-03-28T09:09:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:39 smithi086 ceph-mon[35163]: pgmap v6848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:39 smithi159 ceph-mon[36109]: pgmap v6848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:39 smithi055 ceph-mon[31863]: pgmap v6848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:41 smithi086 ceph-mon[35163]: pgmap v6849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:41 smithi159 ceph-mon[36109]: pgmap v6849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:41 smithi055 ceph-mon[31863]: pgmap v6849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:43 smithi086 ceph-mon[35163]: pgmap v6850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11382.996726 secs 2024-03-28T09:09:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:43 smithi159 ceph-mon[36109]: pgmap v6850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11382.996726 secs 2024-03-28T09:09:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:43 smithi055 ceph-mon[31863]: pgmap v6850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11382.996726 secs 2024-03-28T09:09:45.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:45 smithi055 ceph-mon[31863]: pgmap v6851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:45 smithi086 ceph-mon[35163]: pgmap v6851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:45 smithi159 ceph-mon[36109]: pgmap v6851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:47 smithi086 ceph-mon[35163]: pgmap v6852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:47 smithi159 ceph-mon[36109]: pgmap v6852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:47 smithi055 ceph-mon[31863]: pgmap v6852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11387.996807 secs 2024-03-28T09:09:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11387.996807 secs 2024-03-28T09:09:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11387.996807 secs 2024-03-28T09:09:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:49 smithi086 ceph-mon[35163]: pgmap v6853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:49 smithi159 ceph-mon[36109]: pgmap v6853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:49 smithi055 ceph-mon[31863]: pgmap v6853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:51 smithi086 ceph-mon[35163]: pgmap v6854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:51 smithi159 ceph-mon[36109]: pgmap v6854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:51 smithi055 ceph-mon[31863]: pgmap v6854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:53 smithi086 ceph-mon[35163]: pgmap v6855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11392.996895 secs 2024-03-28T09:09:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:53 smithi159 ceph-mon[36109]: pgmap v6855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11392.996895 secs 2024-03-28T09:09:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:53 smithi055 ceph-mon[31863]: pgmap v6855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11392.996895 secs 2024-03-28T09:09:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:55 smithi086 ceph-mon[35163]: pgmap v6856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:55.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:55 smithi159 ceph-mon[36109]: pgmap v6856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:55 smithi055 ceph-mon[31863]: pgmap v6856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:09:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:57 smithi086 ceph-mon[35163]: pgmap v6857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:57 smithi159 ceph-mon[36109]: pgmap v6857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:57 smithi055 ceph-mon[31863]: pgmap v6857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:09:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11397.997013 secs 2024-03-28T09:09:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11397.997013 secs 2024-03-28T09:09:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11397.997013 secs 2024-03-28T09:09:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:09:59 smithi086 ceph-mon[35163]: pgmap v6858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:09:59 smithi159 ceph-mon[36109]: pgmap v6858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:09:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:09:59 smithi055 ceph-mon[31863]: pgmap v6858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:10:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:10:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:10:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:01 smithi086 ceph-mon[35163]: pgmap v6859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:01 smithi159 ceph-mon[36109]: pgmap v6859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:01 smithi055 ceph-mon[31863]: pgmap v6859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:03 smithi086 ceph-mon[35163]: pgmap v6860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11402.997109 secs 2024-03-28T09:10:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:03 smithi159 ceph-mon[36109]: pgmap v6860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11402.997109 secs 2024-03-28T09:10:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:03 smithi055 ceph-mon[31863]: pgmap v6860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11402.997109 secs 2024-03-28T09:10:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:05 smithi086 ceph-mon[35163]: pgmap v6861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:05 smithi159 ceph-mon[36109]: pgmap v6861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:05 smithi055 ceph-mon[31863]: pgmap v6861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:07 smithi086 ceph-mon[35163]: pgmap v6862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:07 smithi159 ceph-mon[36109]: pgmap v6862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:07 smithi055 ceph-mon[31863]: pgmap v6862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11407.997197 secs 2024-03-28T09:10:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11407.997197 secs 2024-03-28T09:10:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11407.997197 secs 2024-03-28T09:10:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:09 smithi086 ceph-mon[35163]: pgmap v6863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:09 smithi159 ceph-mon[36109]: pgmap v6863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:09 smithi055 ceph-mon[31863]: pgmap v6863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:11 smithi055 ceph-mon[31863]: pgmap v6864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:11 smithi086 ceph-mon[35163]: pgmap v6864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:11 smithi159 ceph-mon[36109]: pgmap v6864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:13 smithi055 ceph-mon[31863]: pgmap v6865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11412.997319 secs 2024-03-28T09:10:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:13 smithi086 ceph-mon[35163]: pgmap v6865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11412.997319 secs 2024-03-28T09:10:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:13 smithi159 ceph-mon[36109]: pgmap v6865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11412.997319 secs 2024-03-28T09:10:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:15 smithi055 ceph-mon[31863]: pgmap v6866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:15 smithi086 ceph-mon[35163]: pgmap v6866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:15 smithi159 ceph-mon[36109]: pgmap v6866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:17 smithi055 ceph-mon[31863]: pgmap v6867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:17 smithi086 ceph-mon[35163]: pgmap v6867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:17 smithi159 ceph-mon[36109]: pgmap v6867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11417.997442 secs 2024-03-28T09:10:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11417.997442 secs 2024-03-28T09:10:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11417.997442 secs 2024-03-28T09:10:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:19 smithi055 ceph-mon[31863]: pgmap v6868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:19 smithi086 ceph-mon[35163]: pgmap v6868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:19 smithi159 ceph-mon[36109]: pgmap v6868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:20 smithi055 ceph-mon[31863]: pgmap v6869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:10:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:20 smithi086 ceph-mon[35163]: pgmap v6869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:10:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:20 smithi159 ceph-mon[36109]: pgmap v6869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:10:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:21.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:10:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: pgmap v6870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: pgmap v6871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:10:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: pgmap v6870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: pgmap v6871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:10:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:10:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:10:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:10:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:10:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:10:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:10:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: pgmap v6870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: pgmap v6871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:10:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11422.997565 secs 2024-03-28T09:10:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11422.997565 secs 2024-03-28T09:10:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11422.997565 secs 2024-03-28T09:10:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:24 smithi086 ceph-mon[35163]: pgmap v6872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:24 smithi159 ceph-mon[36109]: pgmap v6872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:24 smithi055 ceph-mon[31863]: pgmap v6872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:26 smithi086 ceph-mon[35163]: pgmap v6873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:26 smithi159 ceph-mon[36109]: pgmap v6873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:26 smithi055 ceph-mon[31863]: pgmap v6873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:28 smithi086 ceph-mon[35163]: pgmap v6874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11427.997630 secs 2024-03-28T09:10:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:28 smithi159 ceph-mon[36109]: pgmap v6874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11427.997630 secs 2024-03-28T09:10:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:28 smithi055 ceph-mon[31863]: pgmap v6874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11427.997630 secs 2024-03-28T09:10:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:30 smithi086 ceph-mon[35163]: pgmap v6875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:30 smithi159 ceph-mon[36109]: pgmap v6875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:30 smithi055 ceph-mon[31863]: pgmap v6875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:10:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:32 smithi086 ceph-mon[35163]: pgmap v6876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:10:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:32 smithi159 ceph-mon[36109]: pgmap v6876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:10:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:32 smithi055 ceph-mon[31863]: pgmap v6876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:10:33.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11432.997699 secs 2024-03-28T09:10:33.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11432.997699 secs 2024-03-28T09:10:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11432.997699 secs 2024-03-28T09:10:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:34 smithi086 ceph-mon[35163]: pgmap v6877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:34 smithi159 ceph-mon[36109]: pgmap v6877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:34 smithi055 ceph-mon[31863]: pgmap v6877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:36 smithi086 ceph-mon[35163]: pgmap v6878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:36 smithi159 ceph-mon[36109]: pgmap v6878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:36 smithi055 ceph-mon[31863]: pgmap v6878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:38 smithi086 ceph-mon[35163]: pgmap v6879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11437.997762 secs 2024-03-28T09:10:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:38 smithi159 ceph-mon[36109]: pgmap v6879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11437.997762 secs 2024-03-28T09:10:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:38 smithi055 ceph-mon[31863]: pgmap v6879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11437.997762 secs 2024-03-28T09:10:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:40 smithi086 ceph-mon[35163]: pgmap v6880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:40 smithi159 ceph-mon[36109]: pgmap v6880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:40 smithi055 ceph-mon[31863]: pgmap v6880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:42 smithi086 ceph-mon[35163]: pgmap v6881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:42 smithi159 ceph-mon[36109]: pgmap v6881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:42 smithi055 ceph-mon[31863]: pgmap v6881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11442.997829 secs 2024-03-28T09:10:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11442.997829 secs 2024-03-28T09:10:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11442.997829 secs 2024-03-28T09:10:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:44 smithi086 ceph-mon[35163]: pgmap v6882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:44 smithi159 ceph-mon[36109]: pgmap v6882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:44 smithi055 ceph-mon[31863]: pgmap v6882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:46 smithi086 ceph-mon[35163]: pgmap v6883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:46 smithi159 ceph-mon[36109]: pgmap v6883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:46 smithi055 ceph-mon[31863]: pgmap v6883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:48 smithi086 ceph-mon[35163]: pgmap v6884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11447.997895 secs 2024-03-28T09:10:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:48 smithi159 ceph-mon[36109]: pgmap v6884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11447.997895 secs 2024-03-28T09:10:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:48 smithi055 ceph-mon[31863]: pgmap v6884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11447.997895 secs 2024-03-28T09:10:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:50 smithi086 ceph-mon[35163]: pgmap v6885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:50 smithi159 ceph-mon[36109]: pgmap v6885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:50 smithi055 ceph-mon[31863]: pgmap v6885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:52 smithi086 ceph-mon[35163]: pgmap v6886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:52 smithi159 ceph-mon[36109]: pgmap v6886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:52 smithi055 ceph-mon[31863]: pgmap v6886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11452.997975 secs 2024-03-28T09:10:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11452.997975 secs 2024-03-28T09:10:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11452.997975 secs 2024-03-28T09:10:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:54 smithi086 ceph-mon[35163]: pgmap v6887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:54 smithi159 ceph-mon[36109]: pgmap v6887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:54 smithi055 ceph-mon[31863]: pgmap v6887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:10:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:56 smithi086 ceph-mon[35163]: pgmap v6888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:56 smithi159 ceph-mon[36109]: pgmap v6888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:56 smithi055 ceph-mon[31863]: pgmap v6888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:10:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:58 smithi086 ceph-mon[35163]: pgmap v6889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:10:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11457.998098 secs 2024-03-28T09:10:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:58 smithi159 ceph-mon[36109]: pgmap v6889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:10:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11457.998098 secs 2024-03-28T09:10:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:58 smithi055 ceph-mon[31863]: pgmap v6889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:10:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:10:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11457.998098 secs 2024-03-28T09:11:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:00 smithi055 ceph-mon[31863]: pgmap v6890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:00 smithi086 ceph-mon[35163]: pgmap v6890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:00 smithi159 ceph-mon[36109]: pgmap v6890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:02 smithi055 ceph-mon[31863]: pgmap v6891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:02 smithi086 ceph-mon[35163]: pgmap v6891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:02 smithi159 ceph-mon[36109]: pgmap v6891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11462.998165 secs 2024-03-28T09:11:03.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11462.998165 secs 2024-03-28T09:11:03.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11462.998165 secs 2024-03-28T09:11:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:04 smithi055 ceph-mon[31863]: pgmap v6892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:04 smithi086 ceph-mon[35163]: pgmap v6892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:04 smithi159 ceph-mon[36109]: pgmap v6892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:06 smithi055 ceph-mon[31863]: pgmap v6893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:11:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:06 smithi086 ceph-mon[35163]: pgmap v6893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:11:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:06 smithi159 ceph-mon[36109]: pgmap v6893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:11:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:08 smithi055 ceph-mon[31863]: pgmap v6894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11467.998231 secs 2024-03-28T09:11:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:08 smithi086 ceph-mon[35163]: pgmap v6894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11467.998231 secs 2024-03-28T09:11:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:08 smithi159 ceph-mon[36109]: pgmap v6894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11467.998231 secs 2024-03-28T09:11:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:10 smithi055 ceph-mon[31863]: pgmap v6895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:10 smithi086 ceph-mon[35163]: pgmap v6895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:10 smithi159 ceph-mon[36109]: pgmap v6895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:12 smithi086 ceph-mon[35163]: pgmap v6896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:12 smithi159 ceph-mon[36109]: pgmap v6896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:12 smithi055 ceph-mon[31863]: pgmap v6896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11472.998297 secs 2024-03-28T09:11:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11472.998297 secs 2024-03-28T09:11:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11472.998297 secs 2024-03-28T09:11:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:14 smithi086 ceph-mon[35163]: pgmap v6897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:14 smithi159 ceph-mon[36109]: pgmap v6897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:14 smithi055 ceph-mon[31863]: pgmap v6897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:16.925 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:16 smithi055 ceph-mon[31863]: pgmap v6898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:16 smithi086 ceph-mon[35163]: pgmap v6898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:16 smithi159 ceph-mon[36109]: pgmap v6898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:18 smithi086 ceph-mon[35163]: pgmap v6899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11477.998418 secs 2024-03-28T09:11:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:18 smithi159 ceph-mon[36109]: pgmap v6899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11477.998418 secs 2024-03-28T09:11:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:18 smithi055 ceph-mon[31863]: pgmap v6899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11477.998418 secs 2024-03-28T09:11:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:20 smithi086 ceph-mon[35163]: pgmap v6900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:11:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:20 smithi159 ceph-mon[36109]: pgmap v6900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:11:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:20 smithi055 ceph-mon[31863]: pgmap v6900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:11:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:22 smithi086 ceph-mon[35163]: pgmap v6901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:11:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:22 smithi159 ceph-mon[36109]: pgmap v6901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:11:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:22 smithi055 ceph-mon[31863]: pgmap v6901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:11:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11482.998487 secs 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:11:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:11:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: pgmap v6902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: pgmap v6903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:11:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11482.998487 secs 2024-03-28T09:11:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: pgmap v6902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: pgmap v6903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:11:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11482.998487 secs 2024-03-28T09:11:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: pgmap v6902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: pgmap v6903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:11:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:26 smithi086 ceph-mon[35163]: pgmap v6904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:26 smithi159 ceph-mon[36109]: pgmap v6904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:26 smithi055 ceph-mon[31863]: pgmap v6904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:11:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:28 smithi086 ceph-mon[35163]: pgmap v6905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11487.998613 secs 2024-03-28T09:11:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:28 smithi159 ceph-mon[36109]: pgmap v6905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11487.998613 secs 2024-03-28T09:11:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:28 smithi055 ceph-mon[31863]: pgmap v6905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11487.998613 secs 2024-03-28T09:11:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:30 smithi086 ceph-mon[35163]: pgmap v6906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:30 smithi159 ceph-mon[36109]: pgmap v6906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:30 smithi055 ceph-mon[31863]: pgmap v6906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:32 smithi086 ceph-mon[35163]: pgmap v6907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:32 smithi159 ceph-mon[36109]: pgmap v6907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:32 smithi055 ceph-mon[31863]: pgmap v6907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:33.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11492.998736 secs 2024-03-28T09:11:33.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11492.998736 secs 2024-03-28T09:11:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11492.998736 secs 2024-03-28T09:11:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:34 smithi086 ceph-mon[35163]: pgmap v6908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:34 smithi159 ceph-mon[36109]: pgmap v6908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:34 smithi055 ceph-mon[31863]: pgmap v6908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:11:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:36 smithi086 ceph-mon[35163]: pgmap v6909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:36 smithi159 ceph-mon[36109]: pgmap v6909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:36 smithi055 ceph-mon[31863]: pgmap v6909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:38 smithi086 ceph-mon[35163]: pgmap v6910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11497.998867 secs 2024-03-28T09:11:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:38 smithi159 ceph-mon[36109]: pgmap v6910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11497.998867 secs 2024-03-28T09:11:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:38 smithi055 ceph-mon[31863]: pgmap v6910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11497.998867 secs 2024-03-28T09:11:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:40 smithi086 ceph-mon[35163]: pgmap v6911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:40 smithi159 ceph-mon[36109]: pgmap v6911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:40 smithi055 ceph-mon[31863]: pgmap v6911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:42 smithi086 ceph-mon[35163]: pgmap v6912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:42 smithi159 ceph-mon[36109]: pgmap v6912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:42 smithi055 ceph-mon[31863]: pgmap v6912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11502.998988 secs 2024-03-28T09:11:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11502.998988 secs 2024-03-28T09:11:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11502.998988 secs 2024-03-28T09:11:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:44 smithi086 ceph-mon[35163]: pgmap v6913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:44 smithi159 ceph-mon[36109]: pgmap v6913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:44 smithi055 ceph-mon[31863]: pgmap v6913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:46 smithi086 ceph-mon[35163]: pgmap v6914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:46 smithi159 ceph-mon[36109]: pgmap v6914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:46 smithi055 ceph-mon[31863]: pgmap v6914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:48 smithi086 ceph-mon[35163]: pgmap v6915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11507.999079 secs 2024-03-28T09:11:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:48 smithi159 ceph-mon[36109]: pgmap v6915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11507.999079 secs 2024-03-28T09:11:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:48 smithi055 ceph-mon[31863]: pgmap v6915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11507.999079 secs 2024-03-28T09:11:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:50 smithi086 ceph-mon[35163]: pgmap v6916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:50 smithi159 ceph-mon[36109]: pgmap v6916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:50 smithi055 ceph-mon[31863]: pgmap v6916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:52 smithi086 ceph-mon[35163]: pgmap v6917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:52 smithi159 ceph-mon[36109]: pgmap v6917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:52 smithi055 ceph-mon[31863]: pgmap v6917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11512.999172 secs 2024-03-28T09:11:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11512.999172 secs 2024-03-28T09:11:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11512.999172 secs 2024-03-28T09:11:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:54 smithi086 ceph-mon[35163]: pgmap v6918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:54 smithi159 ceph-mon[36109]: pgmap v6918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:54 smithi055 ceph-mon[31863]: pgmap v6918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:56 smithi086 ceph-mon[35163]: pgmap v6919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:56 smithi159 ceph-mon[36109]: pgmap v6919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:56 smithi055 ceph-mon[31863]: pgmap v6919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:11:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:58 smithi086 ceph-mon[35163]: pgmap v6920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:11:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11517.999237 secs 2024-03-28T09:11:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:58 smithi159 ceph-mon[36109]: pgmap v6920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:11:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11517.999237 secs 2024-03-28T09:11:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:58 smithi055 ceph-mon[31863]: pgmap v6920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:11:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:11:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11517.999237 secs 2024-03-28T09:12:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:00 smithi086 ceph-mon[35163]: pgmap v6921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:00 smithi159 ceph-mon[36109]: pgmap v6921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:00 smithi055 ceph-mon[31863]: pgmap v6921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:02 smithi086 ceph-mon[35163]: pgmap v6922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:02 smithi159 ceph-mon[36109]: pgmap v6922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:02 smithi055 ceph-mon[31863]: pgmap v6922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:03 smithi086 ceph-mon[35163]: 1 slow requests, 1 included below; oldest blocked for > 11522.999304 secs 2024-03-28T09:12:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:03 smithi086 ceph-mon[35163]: slow request 11522.999304 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T09:12:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:03 smithi159 ceph-mon[36109]: 1 slow requests, 1 included below; oldest blocked for > 11522.999304 secs 2024-03-28T09:12:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:03 smithi159 ceph-mon[36109]: slow request 11522.999304 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T09:12:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:03 smithi055 ceph-mon[31863]: 1 slow requests, 1 included below; oldest blocked for > 11522.999304 secs 2024-03-28T09:12:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:03 smithi055 ceph-mon[31863]: slow request 11522.999304 seconds old, received at 2024-03-28T05:59:59.593593+0000: peer_request:client.15270:2544 currently acquired locks 2024-03-28T09:12:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:04 smithi086 ceph-mon[35163]: pgmap v6923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:04 smithi159 ceph-mon[36109]: pgmap v6923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:04 smithi055 ceph-mon[31863]: pgmap v6923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:06 smithi086 ceph-mon[35163]: pgmap v6924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:06 smithi159 ceph-mon[36109]: pgmap v6924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:06 smithi055 ceph-mon[31863]: pgmap v6924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:08 smithi055 ceph-mon[31863]: pgmap v6925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11527.999370 secs 2024-03-28T09:12:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:08 smithi086 ceph-mon[35163]: pgmap v6925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11527.999370 secs 2024-03-28T09:12:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:08 smithi159 ceph-mon[36109]: pgmap v6925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11527.999370 secs 2024-03-28T09:12:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:10 smithi055 ceph-mon[31863]: pgmap v6926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:10 smithi086 ceph-mon[35163]: pgmap v6926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:10 smithi159 ceph-mon[36109]: pgmap v6926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:12 smithi055 ceph-mon[31863]: pgmap v6927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:12 smithi086 ceph-mon[35163]: pgmap v6927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:12 smithi159 ceph-mon[36109]: pgmap v6927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11532.999451 secs 2024-03-28T09:12:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11532.999451 secs 2024-03-28T09:12:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11532.999451 secs 2024-03-28T09:12:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:14 smithi055 ceph-mon[31863]: pgmap v6928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:14 smithi086 ceph-mon[35163]: pgmap v6928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:14 smithi159 ceph-mon[36109]: pgmap v6928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:16 smithi055 ceph-mon[31863]: pgmap v6929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:16 smithi086 ceph-mon[35163]: pgmap v6929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:16 smithi159 ceph-mon[36109]: pgmap v6929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:18 smithi055 ceph-mon[31863]: pgmap v6930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11537.999549 secs 2024-03-28T09:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:18 smithi086 ceph-mon[35163]: pgmap v6930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11537.999549 secs 2024-03-28T09:12:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:18 smithi159 ceph-mon[36109]: pgmap v6930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11537.999549 secs 2024-03-28T09:12:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:20 smithi055 ceph-mon[31863]: pgmap v6931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:20 smithi086 ceph-mon[35163]: pgmap v6931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:20 smithi159 ceph-mon[36109]: pgmap v6931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:22 smithi086 ceph-mon[35163]: pgmap v6932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:22 smithi159 ceph-mon[36109]: pgmap v6932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:22 smithi055 ceph-mon[31863]: pgmap v6932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11542.999629 secs 2024-03-28T09:12:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11542.999629 secs 2024-03-28T09:12:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11542.999629 secs 2024-03-28T09:12:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:24 smithi086 ceph-mon[35163]: pgmap v6933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:12:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:24 smithi159 ceph-mon[36109]: pgmap v6933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:12:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:24 smithi055 ceph-mon[31863]: pgmap v6933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:12:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:12:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:12:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:25 smithi086 ceph-mon[35163]: pgmap v6934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:25 smithi086 ceph-mon[35163]: pgmap v6935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:12:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:12:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:12:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:25 smithi159 ceph-mon[36109]: pgmap v6934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:25 smithi159 ceph-mon[36109]: pgmap v6935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:12:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:12:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:12:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:25 smithi055 ceph-mon[31863]: pgmap v6934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:25 smithi055 ceph-mon[31863]: pgmap v6935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:12:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:27 smithi086 ceph-mon[35163]: pgmap v6936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:27 smithi159 ceph-mon[36109]: pgmap v6936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:27 smithi055 ceph-mon[31863]: pgmap v6936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11547.999694 secs 2024-03-28T09:12:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11547.999694 secs 2024-03-28T09:12:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11547.999694 secs 2024-03-28T09:12:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:29 smithi086 ceph-mon[35163]: pgmap v6937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:29 smithi159 ceph-mon[36109]: pgmap v6937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:29 smithi055 ceph-mon[31863]: pgmap v6937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:31 smithi086 ceph-mon[35163]: pgmap v6938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:31 smithi159 ceph-mon[36109]: pgmap v6938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:31 smithi055 ceph-mon[31863]: pgmap v6938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11552.999774 secs 2024-03-28T09:12:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:33 smithi086 ceph-mon[35163]: pgmap v6939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11552.999774 secs 2024-03-28T09:12:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:33 smithi159 ceph-mon[36109]: pgmap v6939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11552.999774 secs 2024-03-28T09:12:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:33 smithi055 ceph-mon[31863]: pgmap v6939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:35 smithi086 ceph-mon[35163]: pgmap v6940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:12:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:35 smithi159 ceph-mon[36109]: pgmap v6940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:12:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:35 smithi055 ceph-mon[31863]: pgmap v6940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:12:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:37 smithi086 ceph-mon[35163]: pgmap v6941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:37 smithi159 ceph-mon[36109]: pgmap v6941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:37 smithi055 ceph-mon[31863]: pgmap v6941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11557.999893 secs 2024-03-28T09:12:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11557.999893 secs 2024-03-28T09:12:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11557.999893 secs 2024-03-28T09:12:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:39 smithi086 ceph-mon[35163]: pgmap v6942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:39 smithi159 ceph-mon[36109]: pgmap v6942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:39 smithi055 ceph-mon[31863]: pgmap v6942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:41 smithi086 ceph-mon[35163]: pgmap v6943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:41 smithi159 ceph-mon[36109]: pgmap v6943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:41 smithi055 ceph-mon[31863]: pgmap v6943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11562.999984 secs 2024-03-28T09:12:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:43 smithi086 ceph-mon[35163]: pgmap v6944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11562.999984 secs 2024-03-28T09:12:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:43 smithi159 ceph-mon[36109]: pgmap v6944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11562.999984 secs 2024-03-28T09:12:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:43 smithi055 ceph-mon[31863]: pgmap v6944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:45 smithi086 ceph-mon[35163]: pgmap v6945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:45 smithi159 ceph-mon[36109]: pgmap v6945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:45 smithi055 ceph-mon[31863]: pgmap v6945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:47 smithi086 ceph-mon[35163]: pgmap v6946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:47 smithi159 ceph-mon[36109]: pgmap v6946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:47 smithi055 ceph-mon[31863]: pgmap v6946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11568.000104 secs 2024-03-28T09:12:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11568.000104 secs 2024-03-28T09:12:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11568.000104 secs 2024-03-28T09:12:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:50 smithi086 ceph-mon[35163]: pgmap v6947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:50 smithi159 ceph-mon[36109]: pgmap v6947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:50 smithi055 ceph-mon[31863]: pgmap v6947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:52 smithi086 ceph-mon[35163]: pgmap v6948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:52 smithi159 ceph-mon[36109]: pgmap v6948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:52 smithi055 ceph-mon[31863]: pgmap v6948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11573.000229 secs 2024-03-28T09:12:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:54 smithi086 ceph-mon[35163]: pgmap v6949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11573.000229 secs 2024-03-28T09:12:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:54 smithi159 ceph-mon[36109]: pgmap v6949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11573.000229 secs 2024-03-28T09:12:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:54 smithi055 ceph-mon[31863]: pgmap v6949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:56 smithi086 ceph-mon[35163]: pgmap v6950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:56 smithi159 ceph-mon[36109]: pgmap v6950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:56 smithi055 ceph-mon[31863]: pgmap v6950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:12:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:58 smithi086 ceph-mon[35163]: pgmap v6951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:58 smithi159 ceph-mon[36109]: pgmap v6951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:58 smithi055 ceph-mon[31863]: pgmap v6951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:12:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:12:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11578.000354 secs 2024-03-28T09:12:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:12:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11578.000354 secs 2024-03-28T09:12:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:12:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11578.000354 secs 2024-03-28T09:13:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:00 smithi086 ceph-mon[35163]: pgmap v6952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:00 smithi159 ceph-mon[36109]: pgmap v6952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:00 smithi055 ceph-mon[31863]: pgmap v6952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:02 smithi086 ceph-mon[35163]: pgmap v6953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:02 smithi159 ceph-mon[36109]: pgmap v6953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:02 smithi055 ceph-mon[31863]: pgmap v6953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11583.000479 secs 2024-03-28T09:13:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:04 smithi055 ceph-mon[31863]: pgmap v6954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11583.000479 secs 2024-03-28T09:13:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:04 smithi086 ceph-mon[35163]: pgmap v6954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11583.000479 secs 2024-03-28T09:13:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:04 smithi159 ceph-mon[36109]: pgmap v6954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:06 smithi055 ceph-mon[31863]: pgmap v6955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:06 smithi086 ceph-mon[35163]: pgmap v6955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:06 smithi159 ceph-mon[36109]: pgmap v6955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:08 smithi055 ceph-mon[31863]: pgmap v6956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:08 smithi086 ceph-mon[35163]: pgmap v6956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:08 smithi159 ceph-mon[36109]: pgmap v6956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11588.000599 secs 2024-03-28T09:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11588.000599 secs 2024-03-28T09:13:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11588.000599 secs 2024-03-28T09:13:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:10 smithi055 ceph-mon[31863]: pgmap v6957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:10 smithi086 ceph-mon[35163]: pgmap v6957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:10 smithi159 ceph-mon[36109]: pgmap v6957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:12 smithi055 ceph-mon[31863]: pgmap v6958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:12 smithi086 ceph-mon[35163]: pgmap v6958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:12 smithi159 ceph-mon[36109]: pgmap v6958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11593.000723 secs 2024-03-28T09:13:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:14 smithi055 ceph-mon[31863]: pgmap v6959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11593.000723 secs 2024-03-28T09:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:14 smithi086 ceph-mon[35163]: pgmap v6959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11593.000723 secs 2024-03-28T09:13:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:14 smithi159 ceph-mon[36109]: pgmap v6959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:16 smithi086 ceph-mon[35163]: pgmap v6960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:16 smithi159 ceph-mon[36109]: pgmap v6960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:16 smithi055 ceph-mon[31863]: pgmap v6960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:18 smithi086 ceph-mon[35163]: pgmap v6961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:18 smithi159 ceph-mon[36109]: pgmap v6961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:18 smithi055 ceph-mon[31863]: pgmap v6961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11598.000853 secs 2024-03-28T09:13:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11598.000853 secs 2024-03-28T09:13:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11598.000853 secs 2024-03-28T09:13:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:20 smithi086 ceph-mon[35163]: pgmap v6962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:20 smithi159 ceph-mon[36109]: pgmap v6962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:20 smithi055 ceph-mon[31863]: pgmap v6962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:22 smithi086 ceph-mon[35163]: pgmap v6963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:22 smithi159 ceph-mon[36109]: pgmap v6963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:22 smithi055 ceph-mon[31863]: pgmap v6963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11603.000950 secs 2024-03-28T09:13:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11603.000950 secs 2024-03-28T09:13:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11603.000950 secs 2024-03-28T09:13:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:24 smithi086 ceph-mon[35163]: pgmap v6964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:24 smithi159 ceph-mon[36109]: pgmap v6964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:24 smithi055 ceph-mon[31863]: pgmap v6964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:26 smithi086 ceph-mon[35163]: pgmap v6965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:13:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:26 smithi159 ceph-mon[36109]: pgmap v6965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:13:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:26 smithi055 ceph-mon[31863]: pgmap v6965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:13:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:28.551 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:28 smithi086 ceph-mon[35163]: pgmap v6966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:28.552 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11608.000979 secs 2024-03-28T09:13:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:28 smithi159 ceph-mon[36109]: pgmap v6966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11608.000979 secs 2024-03-28T09:13:28.574 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:28 smithi055 ceph-mon[31863]: pgmap v6966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:28.574 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11608.000979 secs 2024-03-28T09:13:30.342 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:30 smithi055 ceph-mon[31863]: pgmap v6967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:30 smithi086 ceph-mon[35163]: pgmap v6967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:30 smithi159 ceph-mon[36109]: pgmap v6967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:32 smithi086 ceph-mon[35163]: pgmap v6968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:32 smithi159 ceph-mon[36109]: pgmap v6968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:32 smithi055 ceph-mon[31863]: pgmap v6968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11613.001070 secs 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:13:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: pgmap v6969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: pgmap v6970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11613.001070 secs 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: pgmap v6969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: pgmap v6970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:33.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11613.001070 secs 2024-03-28T09:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: pgmap v6969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: pgmap v6970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:33.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:13:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:35 smithi086 ceph-mon[35163]: pgmap v6971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:35 smithi159 ceph-mon[36109]: pgmap v6971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:35 smithi055 ceph-mon[31863]: pgmap v6971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:37 smithi086 ceph-mon[35163]: pgmap v6972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:37 smithi159 ceph-mon[36109]: pgmap v6972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:37 smithi055 ceph-mon[31863]: pgmap v6972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11618.001124 secs 2024-03-28T09:13:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11618.001124 secs 2024-03-28T09:13:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11618.001124 secs 2024-03-28T09:13:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:39 smithi086 ceph-mon[35163]: pgmap v6973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:39 smithi159 ceph-mon[36109]: pgmap v6973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:39 smithi055 ceph-mon[31863]: pgmap v6973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:41 smithi086 ceph-mon[35163]: pgmap v6974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:41 smithi159 ceph-mon[36109]: pgmap v6974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:41 smithi055 ceph-mon[31863]: pgmap v6974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:13:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11623.001247 secs 2024-03-28T09:13:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:43 smithi086 ceph-mon[35163]: pgmap v6975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:13:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11623.001247 secs 2024-03-28T09:13:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:43 smithi159 ceph-mon[36109]: pgmap v6975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:13:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11623.001247 secs 2024-03-28T09:13:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:43 smithi055 ceph-mon[31863]: pgmap v6975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:13:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:45 smithi086 ceph-mon[35163]: pgmap v6976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:45 smithi159 ceph-mon[36109]: pgmap v6976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:45 smithi055 ceph-mon[31863]: pgmap v6976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:47 smithi086 ceph-mon[35163]: pgmap v6977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:47 smithi159 ceph-mon[36109]: pgmap v6977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:47 smithi055 ceph-mon[31863]: pgmap v6977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11628.001372 secs 2024-03-28T09:13:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11628.001372 secs 2024-03-28T09:13:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11628.001372 secs 2024-03-28T09:13:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:49 smithi086 ceph-mon[35163]: pgmap v6978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:49 smithi159 ceph-mon[36109]: pgmap v6978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:49 smithi055 ceph-mon[31863]: pgmap v6978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:51 smithi086 ceph-mon[35163]: pgmap v6979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:51 smithi159 ceph-mon[36109]: pgmap v6979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:51 smithi055 ceph-mon[31863]: pgmap v6979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11633.001496 secs 2024-03-28T09:13:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:54 smithi086 ceph-mon[35163]: pgmap v6980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11633.001496 secs 2024-03-28T09:13:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:54 smithi159 ceph-mon[36109]: pgmap v6980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11633.001496 secs 2024-03-28T09:13:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:54 smithi055 ceph-mon[31863]: pgmap v6980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:56 smithi086 ceph-mon[35163]: pgmap v6981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:56 smithi159 ceph-mon[36109]: pgmap v6981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:56 smithi055 ceph-mon[31863]: pgmap v6981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:13:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:58 smithi086 ceph-mon[35163]: pgmap v6982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:58 smithi159 ceph-mon[36109]: pgmap v6982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:58 smithi055 ceph-mon[31863]: pgmap v6982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:13:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:13:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11638.001622 secs 2024-03-28T09:13:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:13:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11638.001622 secs 2024-03-28T09:13:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:13:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11638.001622 secs 2024-03-28T09:14:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:00 smithi086 ceph-mon[35163]: pgmap v6983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:00 smithi159 ceph-mon[36109]: pgmap v6983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:00 smithi055 ceph-mon[31863]: pgmap v6983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:02 smithi086 ceph-mon[35163]: pgmap v6984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:02 smithi159 ceph-mon[36109]: pgmap v6984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:02 smithi055 ceph-mon[31863]: pgmap v6984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11643.001745 secs 2024-03-28T09:14:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:04 smithi086 ceph-mon[35163]: pgmap v6985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11643.001745 secs 2024-03-28T09:14:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:04 smithi159 ceph-mon[36109]: pgmap v6985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11643.001745 secs 2024-03-28T09:14:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:04 smithi055 ceph-mon[31863]: pgmap v6985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:06 smithi159 ceph-mon[36109]: pgmap v6986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:06 smithi055 ceph-mon[31863]: pgmap v6986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:06 smithi086 ceph-mon[35163]: pgmap v6986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:08 smithi055 ceph-mon[31863]: pgmap v6987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:08 smithi086 ceph-mon[35163]: pgmap v6987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:08 smithi159 ceph-mon[36109]: pgmap v6987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11648.001838 secs 2024-03-28T09:14:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11648.001838 secs 2024-03-28T09:14:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11648.001838 secs 2024-03-28T09:14:10.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:10 smithi055 ceph-mon[31863]: pgmap v6988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:10 smithi086 ceph-mon[35163]: pgmap v6988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:10 smithi159 ceph-mon[36109]: pgmap v6988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:12 smithi055 ceph-mon[31863]: pgmap v6989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:12 smithi086 ceph-mon[35163]: pgmap v6989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:12 smithi159 ceph-mon[36109]: pgmap v6989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11653.001868 secs 2024-03-28T09:14:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:14 smithi055 ceph-mon[31863]: pgmap v6990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11653.001868 secs 2024-03-28T09:14:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:14 smithi086 ceph-mon[35163]: pgmap v6990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11653.001868 secs 2024-03-28T09:14:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:14 smithi159 ceph-mon[36109]: pgmap v6990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:16 smithi055 ceph-mon[31863]: pgmap v6991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:16 smithi086 ceph-mon[35163]: pgmap v6991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:16 smithi159 ceph-mon[36109]: pgmap v6991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:18 smithi055 ceph-mon[31863]: pgmap v6992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:18 smithi086 ceph-mon[35163]: pgmap v6992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:18 smithi159 ceph-mon[36109]: pgmap v6992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11658.001995 secs 2024-03-28T09:14:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11658.001995 secs 2024-03-28T09:14:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11658.001995 secs 2024-03-28T09:14:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:20 smithi086 ceph-mon[35163]: pgmap v6993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:20 smithi159 ceph-mon[36109]: pgmap v6993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:20 smithi055 ceph-mon[31863]: pgmap v6993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:22 smithi086 ceph-mon[35163]: pgmap v6994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:22 smithi159 ceph-mon[36109]: pgmap v6994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:22 smithi055 ceph-mon[31863]: pgmap v6994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11663.002120 secs 2024-03-28T09:14:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:24 smithi086 ceph-mon[35163]: pgmap v6995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11663.002120 secs 2024-03-28T09:14:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:24 smithi159 ceph-mon[36109]: pgmap v6995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11663.002120 secs 2024-03-28T09:14:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:24 smithi055 ceph-mon[31863]: pgmap v6995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:26 smithi086 ceph-mon[35163]: pgmap v6996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:26 smithi159 ceph-mon[36109]: pgmap v6996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:26 smithi055 ceph-mon[31863]: pgmap v6996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:28 smithi086 ceph-mon[35163]: pgmap v6997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11668.002186 secs 2024-03-28T09:14:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:28 smithi159 ceph-mon[36109]: pgmap v6997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11668.002186 secs 2024-03-28T09:14:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:28 smithi055 ceph-mon[31863]: pgmap v6997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:28.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11668.002186 secs 2024-03-28T09:14:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:30 smithi086 ceph-mon[35163]: pgmap v6998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:30 smithi159 ceph-mon[36109]: pgmap v6998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:30 smithi055 ceph-mon[31863]: pgmap v6998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:32 smithi086 ceph-mon[35163]: pgmap v6999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:32 smithi159 ceph-mon[36109]: pgmap v6999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:32 smithi055 ceph-mon[31863]: pgmap v6999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11673.002253 secs 2024-03-28T09:14:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:14:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11673.002253 secs 2024-03-28T09:14:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:14:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11673.002253 secs 2024-03-28T09:14:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:14:34.724 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:34 smithi086 ceph-mon[35163]: pgmap v7000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:34.725 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:34.725 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:34 smithi055 ceph-mon[31863]: pgmap v7000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:34.800 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:34 smithi159 ceph-mon[36109]: pgmap v7000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:35 smithi086 ceph-mon[35163]: pgmap v7001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:35 smithi159 ceph-mon[36109]: pgmap v7001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:35 smithi055 ceph-mon[31863]: pgmap v7001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:37.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:37.621 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:37.622 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:37.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: pgmap v7002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11678.002372 secs 2024-03-28T09:14:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: pgmap v7002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11678.002372 secs 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.648 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: pgmap v7002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11678.002372 secs 2024-03-28T09:14:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:40.548 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:40 smithi159 ceph-mon[36109]: pgmap v7003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:40 smithi055 ceph-mon[31863]: pgmap v7003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:40 smithi086 ceph-mon[35163]: pgmap v7003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:42 smithi055 ceph-mon[31863]: pgmap v7004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:42 smithi086 ceph-mon[35163]: pgmap v7004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:42 smithi159 ceph-mon[36109]: pgmap v7004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11683.002473 secs 2024-03-28T09:14:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11683.002473 secs 2024-03-28T09:14:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11683.002473 secs 2024-03-28T09:14:44.516 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:44 smithi159 ceph-mon[36109]: pgmap v7005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:44 smithi055 ceph-mon[31863]: pgmap v7005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:44 smithi086 ceph-mon[35163]: pgmap v7005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: pgmap v7006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: pgmap v7007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:14:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:14:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: pgmap v7006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: pgmap v7007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:14:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:14:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: pgmap v7006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:14:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: pgmap v7007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:46.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:14:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:47 smithi086 ceph-mon[35163]: pgmap v7008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:47 smithi159 ceph-mon[36109]: pgmap v7008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:47 smithi055 ceph-mon[31863]: pgmap v7008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11688.002597 secs 2024-03-28T09:14:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11688.002597 secs 2024-03-28T09:14:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11688.002597 secs 2024-03-28T09:14:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:49 smithi086 ceph-mon[35163]: pgmap v7009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:49 smithi159 ceph-mon[36109]: pgmap v7009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:49 smithi055 ceph-mon[31863]: pgmap v7009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:51 smithi086 ceph-mon[35163]: pgmap v7010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:14:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:51 smithi159 ceph-mon[36109]: pgmap v7010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:14:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:51 smithi055 ceph-mon[31863]: pgmap v7010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:14:53.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11693.002721 secs 2024-03-28T09:14:53.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:53 smithi159 ceph-mon[36109]: pgmap v7011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:14:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11693.002721 secs 2024-03-28T09:14:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:53 smithi086 ceph-mon[35163]: pgmap v7011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:14:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11693.002721 secs 2024-03-28T09:14:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:53 smithi055 ceph-mon[31863]: pgmap v7011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:14:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:55 smithi086 ceph-mon[35163]: pgmap v7012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:14:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:55 smithi159 ceph-mon[36109]: pgmap v7012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:14:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:55 smithi055 ceph-mon[31863]: pgmap v7012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:14:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:57 smithi086 ceph-mon[35163]: pgmap v7013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:57 smithi159 ceph-mon[36109]: pgmap v7013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:57 smithi055 ceph-mon[31863]: pgmap v7013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:14:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11698.002841 secs 2024-03-28T09:14:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11698.002841 secs 2024-03-28T09:14:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11698.002841 secs 2024-03-28T09:15:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:14:59 smithi086 ceph-mon[35163]: pgmap v7014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:14:59 smithi159 ceph-mon[36109]: pgmap v7014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:14:59 smithi055 ceph-mon[31863]: pgmap v7014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:01 smithi086 ceph-mon[35163]: pgmap v7015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:01 smithi159 ceph-mon[36109]: pgmap v7015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:01 smithi055 ceph-mon[31863]: pgmap v7015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11703.002930 secs 2024-03-28T09:15:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:03 smithi086 ceph-mon[35163]: pgmap v7016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11703.002930 secs 2024-03-28T09:15:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:03 smithi159 ceph-mon[36109]: pgmap v7016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11703.002930 secs 2024-03-28T09:15:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:03 smithi055 ceph-mon[31863]: pgmap v7016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:05 smithi086 ceph-mon[35163]: pgmap v7017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:05 smithi159 ceph-mon[36109]: pgmap v7017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:05 smithi055 ceph-mon[31863]: pgmap v7017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:07 smithi086 ceph-mon[35163]: pgmap v7018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:07 smithi159 ceph-mon[36109]: pgmap v7018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:07 smithi055 ceph-mon[31863]: pgmap v7018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11708.002996 secs 2024-03-28T09:15:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11708.002996 secs 2024-03-28T09:15:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11708.002996 secs 2024-03-28T09:15:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:09 smithi086 ceph-mon[35163]: pgmap v7019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:09 smithi159 ceph-mon[36109]: pgmap v7019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:09 smithi055 ceph-mon[31863]: pgmap v7019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:11 smithi086 ceph-mon[35163]: pgmap v7020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:11 smithi159 ceph-mon[36109]: pgmap v7020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:11 smithi055 ceph-mon[31863]: pgmap v7020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11713.003079 secs 2024-03-28T09:15:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:13 smithi055 ceph-mon[31863]: pgmap v7021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:15:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11713.003079 secs 2024-03-28T09:15:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:13 smithi086 ceph-mon[35163]: pgmap v7021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:15:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11713.003079 secs 2024-03-28T09:15:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:13 smithi159 ceph-mon[36109]: pgmap v7021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:15:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:15 smithi055 ceph-mon[31863]: pgmap v7022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:15 smithi086 ceph-mon[35163]: pgmap v7022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:15 smithi159 ceph-mon[36109]: pgmap v7022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:17 smithi055 ceph-mon[31863]: pgmap v7023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:17 smithi086 ceph-mon[35163]: pgmap v7023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:17 smithi159 ceph-mon[36109]: pgmap v7023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11718.003200 secs 2024-03-28T09:15:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11718.003200 secs 2024-03-28T09:15:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11718.003200 secs 2024-03-28T09:15:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:19 smithi055 ceph-mon[31863]: pgmap v7024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:19 smithi086 ceph-mon[35163]: pgmap v7024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:19 smithi159 ceph-mon[36109]: pgmap v7024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:21 smithi055 ceph-mon[31863]: pgmap v7025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:21 smithi086 ceph-mon[35163]: pgmap v7025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:21 smithi159 ceph-mon[36109]: pgmap v7025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11723.003279 secs 2024-03-28T09:15:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:23 smithi055 ceph-mon[31863]: pgmap v7026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11723.003279 secs 2024-03-28T09:15:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:23 smithi086 ceph-mon[35163]: pgmap v7026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11723.003279 secs 2024-03-28T09:15:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:23 smithi159 ceph-mon[36109]: pgmap v7026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:25 smithi055 ceph-mon[31863]: pgmap v7027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:25 smithi086 ceph-mon[35163]: pgmap v7027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:25 smithi159 ceph-mon[36109]: pgmap v7027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:27 smithi086 ceph-mon[35163]: pgmap v7028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:27 smithi159 ceph-mon[36109]: pgmap v7028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:27 smithi055 ceph-mon[31863]: pgmap v7028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11728.003351 secs 2024-03-28T09:15:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11728.003351 secs 2024-03-28T09:15:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11728.003351 secs 2024-03-28T09:15:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:29 smithi086 ceph-mon[35163]: pgmap v7029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:29 smithi159 ceph-mon[36109]: pgmap v7029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:29 smithi055 ceph-mon[31863]: pgmap v7029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:31 smithi086 ceph-mon[35163]: pgmap v7030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:31 smithi159 ceph-mon[36109]: pgmap v7030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:31 smithi055 ceph-mon[31863]: pgmap v7030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11733.003438 secs 2024-03-28T09:15:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:33 smithi086 ceph-mon[35163]: pgmap v7031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11733.003438 secs 2024-03-28T09:15:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:33 smithi159 ceph-mon[36109]: pgmap v7031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11733.003438 secs 2024-03-28T09:15:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:33 smithi055 ceph-mon[31863]: pgmap v7031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:35 smithi086 ceph-mon[35163]: pgmap v7032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:35 smithi159 ceph-mon[36109]: pgmap v7032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:35 smithi055 ceph-mon[31863]: pgmap v7032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:37 smithi086 ceph-mon[35163]: pgmap v7033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:37 smithi159 ceph-mon[36109]: pgmap v7033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:37 smithi055 ceph-mon[31863]: pgmap v7033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11738.003561 secs 2024-03-28T09:15:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11738.003561 secs 2024-03-28T09:15:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11738.003561 secs 2024-03-28T09:15:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:39 smithi086 ceph-mon[35163]: pgmap v7034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:39 smithi159 ceph-mon[36109]: pgmap v7034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:39 smithi055 ceph-mon[31863]: pgmap v7034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:41 smithi086 ceph-mon[35163]: pgmap v7035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:41 smithi159 ceph-mon[36109]: pgmap v7035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:41 smithi055 ceph-mon[31863]: pgmap v7035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:15:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11743.003632 secs 2024-03-28T09:15:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:43 smithi086 ceph-mon[35163]: pgmap v7036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11743.003632 secs 2024-03-28T09:15:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:43 smithi159 ceph-mon[36109]: pgmap v7036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11743.003632 secs 2024-03-28T09:15:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:43 smithi055 ceph-mon[31863]: pgmap v7036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:15:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:45 smithi086 ceph-mon[35163]: pgmap v7037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:15:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:45 smithi159 ceph-mon[36109]: pgmap v7037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:15:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:45 smithi055 ceph-mon[31863]: pgmap v7037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:15:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:15:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:15:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:15:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:15:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:15:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:15:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:15:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:15:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:15:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:47 smithi086 ceph-mon[35163]: pgmap v7038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:47 smithi086 ceph-mon[35163]: pgmap v7039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:47 smithi159 ceph-mon[36109]: pgmap v7038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:47 smithi159 ceph-mon[36109]: pgmap v7039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:47 smithi055 ceph-mon[31863]: pgmap v7038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:15:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:47 smithi055 ceph-mon[31863]: pgmap v7039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:49.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11748.003755 secs 2024-03-28T09:15:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11748.003755 secs 2024-03-28T09:15:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11748.003755 secs 2024-03-28T09:15:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:49 smithi086 ceph-mon[35163]: pgmap v7040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:49 smithi159 ceph-mon[36109]: pgmap v7040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:49 smithi055 ceph-mon[31863]: pgmap v7040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:52 smithi086 ceph-mon[35163]: pgmap v7041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:52 smithi159 ceph-mon[36109]: pgmap v7041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:52 smithi055 ceph-mon[31863]: pgmap v7041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:54 smithi086 ceph-mon[35163]: pgmap v7042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11753.003863 secs 2024-03-28T09:15:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:54 smithi159 ceph-mon[36109]: pgmap v7042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11753.003863 secs 2024-03-28T09:15:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:54 smithi055 ceph-mon[31863]: pgmap v7042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11753.003863 secs 2024-03-28T09:15:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:56 smithi086 ceph-mon[35163]: pgmap v7043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:56 smithi159 ceph-mon[36109]: pgmap v7043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:56 smithi055 ceph-mon[31863]: pgmap v7043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:15:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:58 smithi086 ceph-mon[35163]: pgmap v7044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:58 smithi159 ceph-mon[36109]: pgmap v7044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:58 smithi055 ceph-mon[31863]: pgmap v7044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:15:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:15:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11758.003912 secs 2024-03-28T09:15:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:15:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11758.003912 secs 2024-03-28T09:15:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:15:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11758.003912 secs 2024-03-28T09:16:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:00 smithi086 ceph-mon[35163]: pgmap v7045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:00 smithi159 ceph-mon[36109]: pgmap v7045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:00 smithi055 ceph-mon[31863]: pgmap v7045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:02 smithi086 ceph-mon[35163]: pgmap v7046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:02 smithi159 ceph-mon[36109]: pgmap v7046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:02 smithi055 ceph-mon[31863]: pgmap v7046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:04 smithi086 ceph-mon[35163]: pgmap v7047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11763.003998 secs 2024-03-28T09:16:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:04 smithi159 ceph-mon[36109]: pgmap v7047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11763.003998 secs 2024-03-28T09:16:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:04 smithi055 ceph-mon[31863]: pgmap v7047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11763.003998 secs 2024-03-28T09:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:06 smithi086 ceph-mon[35163]: pgmap v7048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:06 smithi159 ceph-mon[36109]: pgmap v7048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:06 smithi055 ceph-mon[31863]: pgmap v7048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:08 smithi159 ceph-mon[36109]: pgmap v7049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:08 smithi055 ceph-mon[31863]: pgmap v7049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:08 smithi086 ceph-mon[35163]: pgmap v7049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11768.004088 secs 2024-03-28T09:16:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11768.004088 secs 2024-03-28T09:16:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11768.004088 secs 2024-03-28T09:16:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:10 smithi055 ceph-mon[31863]: pgmap v7050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:10 smithi086 ceph-mon[35163]: pgmap v7050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:10 smithi159 ceph-mon[36109]: pgmap v7050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:12 smithi055 ceph-mon[31863]: pgmap v7051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:12 smithi086 ceph-mon[35163]: pgmap v7051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:12 smithi159 ceph-mon[36109]: pgmap v7051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:14 smithi055 ceph-mon[31863]: pgmap v7052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11773.004152 secs 2024-03-28T09:16:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:14 smithi086 ceph-mon[35163]: pgmap v7052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11773.004152 secs 2024-03-28T09:16:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:14 smithi159 ceph-mon[36109]: pgmap v7052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11773.004152 secs 2024-03-28T09:16:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:16 smithi055 ceph-mon[31863]: pgmap v7053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:16 smithi086 ceph-mon[35163]: pgmap v7053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:16 smithi159 ceph-mon[36109]: pgmap v7053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:18 smithi055 ceph-mon[31863]: pgmap v7054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:18 smithi086 ceph-mon[35163]: pgmap v7054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:18 smithi159 ceph-mon[36109]: pgmap v7054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11778.004274 secs 2024-03-28T09:16:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11778.004274 secs 2024-03-28T09:16:19.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11778.004274 secs 2024-03-28T09:16:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:20 smithi086 ceph-mon[35163]: pgmap v7055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:20 smithi159 ceph-mon[36109]: pgmap v7055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:20 smithi055 ceph-mon[31863]: pgmap v7055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:21 smithi086 ceph-mon[35163]: pgmap v7056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:21 smithi159 ceph-mon[36109]: pgmap v7056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:21 smithi055 ceph-mon[31863]: pgmap v7056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:23 smithi055 ceph-mon[31863]: pgmap v7057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11783.004395 secs 2024-03-28T09:16:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:23 smithi086 ceph-mon[35163]: pgmap v7057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11783.004395 secs 2024-03-28T09:16:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:23 smithi159 ceph-mon[36109]: pgmap v7057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11783.004395 secs 2024-03-28T09:16:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:25 smithi055 ceph-mon[31863]: pgmap v7058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:25 smithi086 ceph-mon[35163]: pgmap v7058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:25 smithi159 ceph-mon[36109]: pgmap v7058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:27 smithi055 ceph-mon[31863]: pgmap v7059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:27 smithi086 ceph-mon[35163]: pgmap v7059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:27 smithi159 ceph-mon[36109]: pgmap v7059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11788.004516 secs 2024-03-28T09:16:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11788.004516 secs 2024-03-28T09:16:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11788.004516 secs 2024-03-28T09:16:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:29 smithi055 ceph-mon[31863]: pgmap v7060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:29 smithi086 ceph-mon[35163]: pgmap v7060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:29 smithi159 ceph-mon[36109]: pgmap v7060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:31 smithi055 ceph-mon[31863]: pgmap v7061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:31 smithi086 ceph-mon[35163]: pgmap v7061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:31 smithi159 ceph-mon[36109]: pgmap v7061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:33 smithi055 ceph-mon[31863]: pgmap v7062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11793.004630 secs 2024-03-28T09:16:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:33 smithi086 ceph-mon[35163]: pgmap v7062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11793.004630 secs 2024-03-28T09:16:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:33 smithi159 ceph-mon[36109]: pgmap v7062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11793.004630 secs 2024-03-28T09:16:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:35 smithi086 ceph-mon[35163]: pgmap v7063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:35 smithi159 ceph-mon[36109]: pgmap v7063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:35 smithi055 ceph-mon[31863]: pgmap v7063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:37 smithi086 ceph-mon[35163]: pgmap v7064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:37 smithi159 ceph-mon[36109]: pgmap v7064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:37 smithi055 ceph-mon[31863]: pgmap v7064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:38.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11798.004710 secs 2024-03-28T09:16:38.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11798.004710 secs 2024-03-28T09:16:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11798.004710 secs 2024-03-28T09:16:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:39 smithi086 ceph-mon[35163]: pgmap v7065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:39 smithi159 ceph-mon[36109]: pgmap v7065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:39 smithi055 ceph-mon[31863]: pgmap v7065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:16:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:41 smithi086 ceph-mon[35163]: pgmap v7066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:41 smithi159 ceph-mon[36109]: pgmap v7066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:41 smithi055 ceph-mon[31863]: pgmap v7066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:16:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:43 smithi086 ceph-mon[35163]: pgmap v7067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11803.004749 secs 2024-03-28T09:16:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:43 smithi159 ceph-mon[36109]: pgmap v7067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11803.004749 secs 2024-03-28T09:16:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:43 smithi055 ceph-mon[31863]: pgmap v7067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:16:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11803.004749 secs 2024-03-28T09:16:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:45 smithi086 ceph-mon[35163]: pgmap v7068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:45 smithi159 ceph-mon[36109]: pgmap v7068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:45 smithi055 ceph-mon[31863]: pgmap v7068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:47 smithi086 ceph-mon[35163]: pgmap v7069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:16:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:47 smithi159 ceph-mon[36109]: pgmap v7069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:16:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:47 smithi055 ceph-mon[31863]: pgmap v7069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:48.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:16:49.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11808.004821 secs 2024-03-28T09:16:49.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:16:49.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:16:49.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: pgmap v7070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:49.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: pgmap v7071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:49.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:16:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11808.004821 secs 2024-03-28T09:16:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:16:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:16:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: pgmap v7070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: pgmap v7071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:16:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11808.004821 secs 2024-03-28T09:16:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:16:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:16:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: pgmap v7070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: pgmap v7071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:49.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:16:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:51 smithi055 ceph-mon[31863]: pgmap v7072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:51 smithi086 ceph-mon[35163]: pgmap v7072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:51 smithi159 ceph-mon[36109]: pgmap v7072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:53 smithi055 ceph-mon[31863]: pgmap v7073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11813.004942 secs 2024-03-28T09:16:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:53 smithi086 ceph-mon[35163]: pgmap v7073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11813.004942 secs 2024-03-28T09:16:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:53 smithi159 ceph-mon[36109]: pgmap v7073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:16:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11813.004942 secs 2024-03-28T09:16:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:55 smithi055 ceph-mon[31863]: pgmap v7074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:55 smithi086 ceph-mon[35163]: pgmap v7074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:55 smithi159 ceph-mon[36109]: pgmap v7074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:57 smithi055 ceph-mon[31863]: pgmap v7075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:57 smithi086 ceph-mon[35163]: pgmap v7075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:57 smithi159 ceph-mon[36109]: pgmap v7075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:16:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11818.005006 secs 2024-03-28T09:16:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11818.005006 secs 2024-03-28T09:16:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11818.005006 secs 2024-03-28T09:16:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:16:59 smithi086 ceph-mon[35163]: pgmap v7076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:16:59 smithi159 ceph-mon[36109]: pgmap v7076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:16:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:16:59 smithi055 ceph-mon[31863]: pgmap v7076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:17:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:01 smithi086 ceph-mon[35163]: pgmap v7077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:01 smithi159 ceph-mon[36109]: pgmap v7077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:01 smithi055 ceph-mon[31863]: pgmap v7077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:03 smithi086 ceph-mon[35163]: pgmap v7078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11823.005083 secs 2024-03-28T09:17:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:03 smithi159 ceph-mon[36109]: pgmap v7078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11823.005083 secs 2024-03-28T09:17:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:03 smithi055 ceph-mon[31863]: pgmap v7078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11823.005083 secs 2024-03-28T09:17:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:05 smithi086 ceph-mon[35163]: pgmap v7079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:05 smithi159 ceph-mon[36109]: pgmap v7079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:05 smithi055 ceph-mon[31863]: pgmap v7079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:07 smithi086 ceph-mon[35163]: pgmap v7080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:07 smithi159 ceph-mon[36109]: pgmap v7080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:07 smithi055 ceph-mon[31863]: pgmap v7080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11828.005196 secs 2024-03-28T09:17:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11828.005196 secs 2024-03-28T09:17:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11828.005196 secs 2024-03-28T09:17:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:09 smithi086 ceph-mon[35163]: pgmap v7081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:09 smithi159 ceph-mon[36109]: pgmap v7081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:09 smithi055 ceph-mon[31863]: pgmap v7081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:11 smithi086 ceph-mon[35163]: pgmap v7082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:11 smithi159 ceph-mon[36109]: pgmap v7082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:11 smithi055 ceph-mon[31863]: pgmap v7082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:13 smithi086 ceph-mon[35163]: pgmap v7083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11833.005322 secs 2024-03-28T09:17:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:13 smithi159 ceph-mon[36109]: pgmap v7083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11833.005322 secs 2024-03-28T09:17:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:13 smithi055 ceph-mon[31863]: pgmap v7083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11833.005322 secs 2024-03-28T09:17:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:15 smithi086 ceph-mon[35163]: pgmap v7084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:15 smithi159 ceph-mon[36109]: pgmap v7084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:15 smithi055 ceph-mon[31863]: pgmap v7084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:17 smithi086 ceph-mon[35163]: pgmap v7085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:17 smithi159 ceph-mon[36109]: pgmap v7085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:17 smithi055 ceph-mon[31863]: pgmap v7085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11838.005401 secs 2024-03-28T09:17:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:18 smithi086 ceph-mon[35163]: pgmap v7086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11838.005401 secs 2024-03-28T09:17:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:18 smithi159 ceph-mon[36109]: pgmap v7086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11838.005401 secs 2024-03-28T09:17:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:18 smithi055 ceph-mon[31863]: pgmap v7086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:21 smithi055 ceph-mon[31863]: pgmap v7087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:21 smithi086 ceph-mon[35163]: pgmap v7087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:21 smithi159 ceph-mon[36109]: pgmap v7087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:23 smithi055 ceph-mon[31863]: pgmap v7088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11843.005498 secs 2024-03-28T09:17:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:23 smithi086 ceph-mon[35163]: pgmap v7088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11843.005498 secs 2024-03-28T09:17:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:23 smithi159 ceph-mon[36109]: pgmap v7088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11843.005498 secs 2024-03-28T09:17:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:25 smithi055 ceph-mon[31863]: pgmap v7089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:25 smithi086 ceph-mon[35163]: pgmap v7089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:25 smithi159 ceph-mon[36109]: pgmap v7089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:27 smithi086 ceph-mon[35163]: pgmap v7090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:27 smithi159 ceph-mon[36109]: pgmap v7090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:27 smithi055 ceph-mon[31863]: pgmap v7090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11848.005583 secs 2024-03-28T09:17:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11848.005583 secs 2024-03-28T09:17:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11848.005583 secs 2024-03-28T09:17:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:29 smithi086 ceph-mon[35163]: pgmap v7091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:29 smithi159 ceph-mon[36109]: pgmap v7091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:29 smithi055 ceph-mon[31863]: pgmap v7091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:31 smithi086 ceph-mon[35163]: pgmap v7092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:31 smithi159 ceph-mon[36109]: pgmap v7092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:31 smithi055 ceph-mon[31863]: pgmap v7092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:33 smithi086 ceph-mon[35163]: pgmap v7093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11853.005709 secs 2024-03-28T09:17:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:33 smithi159 ceph-mon[36109]: pgmap v7093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11853.005709 secs 2024-03-28T09:17:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:33 smithi055 ceph-mon[31863]: pgmap v7093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11853.005709 secs 2024-03-28T09:17:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:35 smithi086 ceph-mon[35163]: pgmap v7094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:35 smithi159 ceph-mon[36109]: pgmap v7094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:35 smithi055 ceph-mon[31863]: pgmap v7094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:37 smithi086 ceph-mon[35163]: pgmap v7095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:37 smithi159 ceph-mon[36109]: pgmap v7095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:37 smithi055 ceph-mon[31863]: pgmap v7095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:38.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11858.005837 secs 2024-03-28T09:17:38.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11858.005837 secs 2024-03-28T09:17:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11858.005837 secs 2024-03-28T09:17:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:39 smithi086 ceph-mon[35163]: pgmap v7096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:39 smithi159 ceph-mon[36109]: pgmap v7096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:39 smithi055 ceph-mon[31863]: pgmap v7096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:41 smithi086 ceph-mon[35163]: pgmap v7097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:41 smithi159 ceph-mon[36109]: pgmap v7097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:41 smithi055 ceph-mon[31863]: pgmap v7097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:17:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:42 smithi086 ceph-mon[35163]: pgmap v7098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:42 smithi159 ceph-mon[36109]: pgmap v7098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:42 smithi055 ceph-mon[31863]: pgmap v7098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11863.005959 secs 2024-03-28T09:17:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11863.005959 secs 2024-03-28T09:17:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11863.005959 secs 2024-03-28T09:17:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:44 smithi086 ceph-mon[35163]: pgmap v7099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:44 smithi159 ceph-mon[36109]: pgmap v7099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:44 smithi055 ceph-mon[31863]: pgmap v7099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:47 smithi055 ceph-mon[31863]: pgmap v7100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:47 smithi086 ceph-mon[35163]: pgmap v7100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:47 smithi159 ceph-mon[36109]: pgmap v7100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11868.006081 secs 2024-03-28T09:17:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11868.006081 secs 2024-03-28T09:17:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11868.006081 secs 2024-03-28T09:17:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:49 smithi086 ceph-mon[35163]: pgmap v7101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:17:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:49 smithi159 ceph-mon[36109]: pgmap v7101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:17:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:49 smithi055 ceph-mon[31863]: pgmap v7101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:17:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:17:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:17:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:17:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:17:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:17:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:17:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:17:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:17:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:17:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:17:51.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:51 smithi055 ceph-mon[31863]: pgmap v7102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:51.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:51 smithi055 ceph-mon[31863]: pgmap v7103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:17:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:51 smithi086 ceph-mon[35163]: pgmap v7102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:51 smithi086 ceph-mon[35163]: pgmap v7103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:17:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:51 smithi159 ceph-mon[36109]: pgmap v7102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:17:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:51 smithi159 ceph-mon[36109]: pgmap v7103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:17:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:53 smithi086 ceph-mon[35163]: pgmap v7104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11873.006185 secs 2024-03-28T09:17:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:53 smithi159 ceph-mon[36109]: pgmap v7104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11873.006185 secs 2024-03-28T09:17:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:53 smithi055 ceph-mon[31863]: pgmap v7104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11873.006185 secs 2024-03-28T09:17:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:55 smithi086 ceph-mon[35163]: pgmap v7105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:55 smithi159 ceph-mon[36109]: pgmap v7105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:55 smithi055 ceph-mon[31863]: pgmap v7105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:57 smithi086 ceph-mon[35163]: pgmap v7106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:57.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:57 smithi159 ceph-mon[36109]: pgmap v7106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:57 smithi055 ceph-mon[31863]: pgmap v7106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11878.006281 secs 2024-03-28T09:17:58.826 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11878.006281 secs 2024-03-28T09:17:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11878.006281 secs 2024-03-28T09:17:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:17:59 smithi086 ceph-mon[35163]: pgmap v7107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:17:59 smithi159 ceph-mon[36109]: pgmap v7107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:17:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:17:59 smithi055 ceph-mon[31863]: pgmap v7107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:01 smithi086 ceph-mon[35163]: pgmap v7108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:18:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:01 smithi159 ceph-mon[36109]: pgmap v7108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:18:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:01 smithi055 ceph-mon[31863]: pgmap v7108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:18:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:03 smithi086 ceph-mon[35163]: pgmap v7109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11883.006414 secs 2024-03-28T09:18:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:03 smithi159 ceph-mon[36109]: pgmap v7109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11883.006414 secs 2024-03-28T09:18:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:03 smithi055 ceph-mon[31863]: pgmap v7109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11883.006414 secs 2024-03-28T09:18:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:04 smithi086 ceph-mon[35163]: pgmap v7110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:04 smithi159 ceph-mon[36109]: pgmap v7110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:04 smithi055 ceph-mon[31863]: pgmap v7110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:07 smithi086 ceph-mon[35163]: pgmap v7111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:07 smithi159 ceph-mon[36109]: pgmap v7111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:07 smithi055 ceph-mon[31863]: pgmap v7111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11888.006494 secs 2024-03-28T09:18:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:09 smithi086 ceph-mon[35163]: pgmap v7112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11888.006494 secs 2024-03-28T09:18:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:09 smithi159 ceph-mon[36109]: pgmap v7112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11888.006494 secs 2024-03-28T09:18:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:09 smithi055 ceph-mon[31863]: pgmap v7112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:11 smithi086 ceph-mon[35163]: pgmap v7113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:11 smithi159 ceph-mon[36109]: pgmap v7113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:11 smithi055 ceph-mon[31863]: pgmap v7113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:13 smithi086 ceph-mon[35163]: pgmap v7114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:13 smithi159 ceph-mon[36109]: pgmap v7114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:13 smithi055 ceph-mon[31863]: pgmap v7114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11893.006544 secs 2024-03-28T09:18:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11893.006544 secs 2024-03-28T09:18:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11893.006544 secs 2024-03-28T09:18:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:15 smithi086 ceph-mon[35163]: pgmap v7115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:15 smithi159 ceph-mon[36109]: pgmap v7115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:15 smithi055 ceph-mon[31863]: pgmap v7115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:17 smithi086 ceph-mon[35163]: pgmap v7116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:17 smithi159 ceph-mon[36109]: pgmap v7116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:17 smithi055 ceph-mon[31863]: pgmap v7116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11898.006668 secs 2024-03-28T09:18:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11898.006668 secs 2024-03-28T09:18:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11898.006668 secs 2024-03-28T09:18:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:19 smithi086 ceph-mon[35163]: pgmap v7117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:19 smithi159 ceph-mon[36109]: pgmap v7117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:19 smithi055 ceph-mon[31863]: pgmap v7117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:21 smithi086 ceph-mon[35163]: pgmap v7118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:21 smithi159 ceph-mon[36109]: pgmap v7118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:21 smithi055 ceph-mon[31863]: pgmap v7118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:23 smithi086 ceph-mon[35163]: pgmap v7119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11903.006831 secs 2024-03-28T09:18:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:23 smithi159 ceph-mon[36109]: pgmap v7119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11903.006831 secs 2024-03-28T09:18:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:23 smithi055 ceph-mon[31863]: pgmap v7119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11903.006831 secs 2024-03-28T09:18:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:25 smithi086 ceph-mon[35163]: pgmap v7120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:25 smithi159 ceph-mon[36109]: pgmap v7120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:25 smithi055 ceph-mon[31863]: pgmap v7120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:27 smithi086 ceph-mon[35163]: pgmap v7121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:27 smithi159 ceph-mon[36109]: pgmap v7121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:27 smithi055 ceph-mon[31863]: pgmap v7121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11908.006910 secs 2024-03-28T09:18:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11908.006910 secs 2024-03-28T09:18:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11908.006910 secs 2024-03-28T09:18:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:29 smithi086 ceph-mon[35163]: pgmap v7122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:29 smithi159 ceph-mon[36109]: pgmap v7122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:29 smithi055 ceph-mon[31863]: pgmap v7122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:31 smithi086 ceph-mon[35163]: pgmap v7123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:31 smithi159 ceph-mon[36109]: pgmap v7123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:31 smithi055 ceph-mon[31863]: pgmap v7123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:33 smithi086 ceph-mon[35163]: pgmap v7124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11913.006978 secs 2024-03-28T09:18:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:33 smithi159 ceph-mon[36109]: pgmap v7124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11913.006978 secs 2024-03-28T09:18:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:33 smithi055 ceph-mon[31863]: pgmap v7124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11913.006978 secs 2024-03-28T09:18:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:35 smithi086 ceph-mon[35163]: pgmap v7125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:35 smithi159 ceph-mon[36109]: pgmap v7125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:35 smithi055 ceph-mon[31863]: pgmap v7125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:37 smithi086 ceph-mon[35163]: pgmap v7126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:37 smithi159 ceph-mon[36109]: pgmap v7126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:37 smithi055 ceph-mon[31863]: pgmap v7126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11918.007059 secs 2024-03-28T09:18:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11918.007059 secs 2024-03-28T09:18:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11918.007059 secs 2024-03-28T09:18:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:39 smithi086 ceph-mon[35163]: pgmap v7127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:39 smithi159 ceph-mon[36109]: pgmap v7127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:39 smithi055 ceph-mon[31863]: pgmap v7127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:41 smithi086 ceph-mon[35163]: pgmap v7128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:41 smithi159 ceph-mon[36109]: pgmap v7128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:41 smithi055 ceph-mon[31863]: pgmap v7128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:43 smithi055 ceph-mon[31863]: pgmap v7129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11923.007146 secs 2024-03-28T09:18:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:43 smithi086 ceph-mon[35163]: pgmap v7129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11923.007146 secs 2024-03-28T09:18:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:43 smithi159 ceph-mon[36109]: pgmap v7129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11923.007146 secs 2024-03-28T09:18:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:45 smithi055 ceph-mon[31863]: pgmap v7130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:45 smithi086 ceph-mon[35163]: pgmap v7130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:45 smithi159 ceph-mon[36109]: pgmap v7130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:47.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:47 smithi055 ceph-mon[31863]: pgmap v7131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:47 smithi086 ceph-mon[35163]: pgmap v7131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:47 smithi159 ceph-mon[36109]: pgmap v7131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11928.007215 secs 2024-03-28T09:18:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11928.007215 secs 2024-03-28T09:18:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11928.007215 secs 2024-03-28T09:18:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:49 smithi055 ceph-mon[31863]: pgmap v7132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:49 smithi086 ceph-mon[35163]: pgmap v7132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:49 smithi159 ceph-mon[36109]: pgmap v7132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:51 smithi055 ceph-mon[31863]: pgmap v7133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:18:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:51 smithi086 ceph-mon[35163]: pgmap v7133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:18:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:51 smithi159 ceph-mon[36109]: pgmap v7133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:18:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:18:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:18:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:18:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:18:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:18:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:18:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:18:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:18:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:18:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:18:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:53 smithi086 ceph-mon[35163]: pgmap v7134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:53 smithi086 ceph-mon[35163]: pgmap v7135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11933.007343 secs 2024-03-28T09:18:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:53 smithi159 ceph-mon[36109]: pgmap v7134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:53 smithi159 ceph-mon[36109]: pgmap v7135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11933.007343 secs 2024-03-28T09:18:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:53 smithi055 ceph-mon[31863]: pgmap v7134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:18:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:53 smithi055 ceph-mon[31863]: pgmap v7135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11933.007343 secs 2024-03-28T09:18:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:55 smithi086 ceph-mon[35163]: pgmap v7136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:55 smithi159 ceph-mon[36109]: pgmap v7136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:55 smithi055 ceph-mon[31863]: pgmap v7136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:57 smithi086 ceph-mon[35163]: pgmap v7137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:57 smithi159 ceph-mon[36109]: pgmap v7137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:57 smithi055 ceph-mon[31863]: pgmap v7137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11938.007465 secs 2024-03-28T09:18:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11938.007465 secs 2024-03-28T09:18:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11938.007465 secs 2024-03-28T09:18:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:18:59 smithi086 ceph-mon[35163]: pgmap v7138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:18:59 smithi159 ceph-mon[36109]: pgmap v7138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:18:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:18:59 smithi055 ceph-mon[31863]: pgmap v7138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:01 smithi086 ceph-mon[35163]: pgmap v7139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:01 smithi159 ceph-mon[36109]: pgmap v7139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:01 smithi055 ceph-mon[31863]: pgmap v7139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:03 smithi086 ceph-mon[35163]: pgmap v7140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11943.007590 secs 2024-03-28T09:19:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:03 smithi159 ceph-mon[36109]: pgmap v7140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11943.007590 secs 2024-03-28T09:19:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:03 smithi055 ceph-mon[31863]: pgmap v7140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11943.007590 secs 2024-03-28T09:19:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:05 smithi086 ceph-mon[35163]: pgmap v7141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:05 smithi159 ceph-mon[36109]: pgmap v7141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:05 smithi055 ceph-mon[31863]: pgmap v7141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:07 smithi086 ceph-mon[35163]: pgmap v7142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:07 smithi159 ceph-mon[36109]: pgmap v7142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:07 smithi055 ceph-mon[31863]: pgmap v7142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11948.007715 secs 2024-03-28T09:19:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11948.007715 secs 2024-03-28T09:19:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11948.007715 secs 2024-03-28T09:19:09.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:09 smithi086 ceph-mon[35163]: pgmap v7143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:09.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:09 smithi159 ceph-mon[36109]: pgmap v7143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:09 smithi055 ceph-mon[31863]: pgmap v7143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:11 smithi086 ceph-mon[35163]: pgmap v7144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:11 smithi159 ceph-mon[36109]: pgmap v7144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:11 smithi055 ceph-mon[31863]: pgmap v7144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:13 smithi086 ceph-mon[35163]: pgmap v7145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11953.007823 secs 2024-03-28T09:19:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:13 smithi159 ceph-mon[36109]: pgmap v7145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11953.007823 secs 2024-03-28T09:19:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:13 smithi055 ceph-mon[31863]: pgmap v7145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11953.007823 secs 2024-03-28T09:19:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:14 smithi086 ceph-mon[35163]: pgmap v7146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:14 smithi159 ceph-mon[36109]: pgmap v7146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:14 smithi055 ceph-mon[31863]: pgmap v7146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:17 smithi086 ceph-mon[35163]: pgmap v7147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:17 smithi159 ceph-mon[36109]: pgmap v7147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:17 smithi055 ceph-mon[31863]: pgmap v7147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11958.007944 secs 2024-03-28T09:19:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:19 smithi086 ceph-mon[35163]: pgmap v7148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11958.007944 secs 2024-03-28T09:19:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:19 smithi159 ceph-mon[36109]: pgmap v7148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11958.007944 secs 2024-03-28T09:19:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:19 smithi055 ceph-mon[31863]: pgmap v7148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:21 smithi086 ceph-mon[35163]: pgmap v7149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:21 smithi159 ceph-mon[36109]: pgmap v7149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:21 smithi055 ceph-mon[31863]: pgmap v7149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:23 smithi086 ceph-mon[35163]: pgmap v7150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:23 smithi159 ceph-mon[36109]: pgmap v7150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:23 smithi055 ceph-mon[31863]: pgmap v7150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11963.008066 secs 2024-03-28T09:19:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11963.008066 secs 2024-03-28T09:19:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11963.008066 secs 2024-03-28T09:19:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:25 smithi086 ceph-mon[35163]: pgmap v7151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:25 smithi159 ceph-mon[36109]: pgmap v7151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:25 smithi055 ceph-mon[31863]: pgmap v7151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:27 smithi086 ceph-mon[35163]: pgmap v7152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:27 smithi159 ceph-mon[36109]: pgmap v7152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:27 smithi055 ceph-mon[31863]: pgmap v7152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11968.008187 secs 2024-03-28T09:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:29 smithi086 ceph-mon[35163]: pgmap v7153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11968.008187 secs 2024-03-28T09:19:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:29 smithi159 ceph-mon[36109]: pgmap v7153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11968.008187 secs 2024-03-28T09:19:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:29 smithi055 ceph-mon[31863]: pgmap v7153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:31 smithi055 ceph-mon[31863]: pgmap v7154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:31 smithi086 ceph-mon[35163]: pgmap v7154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:31 smithi159 ceph-mon[36109]: pgmap v7154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:33 smithi055 ceph-mon[31863]: pgmap v7155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:33 smithi086 ceph-mon[35163]: pgmap v7155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:33 smithi159 ceph-mon[36109]: pgmap v7155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11973.008308 secs 2024-03-28T09:19:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11973.008308 secs 2024-03-28T09:19:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11973.008308 secs 2024-03-28T09:19:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:35 smithi055 ceph-mon[31863]: pgmap v7156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:35 smithi086 ceph-mon[35163]: pgmap v7156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:35 smithi159 ceph-mon[36109]: pgmap v7156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:37 smithi055 ceph-mon[31863]: pgmap v7157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:37 smithi086 ceph-mon[35163]: pgmap v7157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:37 smithi159 ceph-mon[36109]: pgmap v7157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:39.369 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11978.008432 secs 2024-03-28T09:19:39.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:39 smithi086 ceph-mon[35163]: pgmap v7158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:39.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11978.008432 secs 2024-03-28T09:19:39.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:39 smithi159 ceph-mon[36109]: pgmap v7158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11978.008432 secs 2024-03-28T09:19:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:39 smithi055 ceph-mon[31863]: pgmap v7158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:41 smithi055 ceph-mon[31863]: pgmap v7159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:41 smithi086 ceph-mon[35163]: pgmap v7159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:41 smithi159 ceph-mon[36109]: pgmap v7159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:43 smithi055 ceph-mon[31863]: pgmap v7160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:43 smithi086 ceph-mon[35163]: pgmap v7160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:43 smithi159 ceph-mon[36109]: pgmap v7160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11983.008556 secs 2024-03-28T09:19:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11983.008556 secs 2024-03-28T09:19:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11983.008556 secs 2024-03-28T09:19:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:45 smithi086 ceph-mon[35163]: pgmap v7161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:45 smithi159 ceph-mon[36109]: pgmap v7161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:45 smithi055 ceph-mon[31863]: pgmap v7161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:47 smithi086 ceph-mon[35163]: pgmap v7162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:47 smithi159 ceph-mon[36109]: pgmap v7162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:47 smithi055 ceph-mon[31863]: pgmap v7162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11988.008677 secs 2024-03-28T09:19:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:49 smithi086 ceph-mon[35163]: pgmap v7163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11988.008677 secs 2024-03-28T09:19:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:49 smithi159 ceph-mon[36109]: pgmap v7163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11988.008677 secs 2024-03-28T09:19:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:49 smithi055 ceph-mon[31863]: pgmap v7163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:51.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:51 smithi055 ceph-mon[31863]: pgmap v7164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:51 smithi086 ceph-mon[35163]: pgmap v7164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:51 smithi159 ceph-mon[36109]: pgmap v7164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:19:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:53 smithi086 ceph-mon[35163]: pgmap v7165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:19:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:53 smithi159 ceph-mon[36109]: pgmap v7165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:19:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:53 smithi055 ceph-mon[31863]: pgmap v7165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:19:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11993.008769 secs 2024-03-28T09:19:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:19:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:19:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:19:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11993.008769 secs 2024-03-28T09:19:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:19:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:19:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:19:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11993.008769 secs 2024-03-28T09:19:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:19:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:19:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:19:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:55 smithi086 ceph-mon[35163]: pgmap v7166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:55 smithi086 ceph-mon[35163]: pgmap v7167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:55 smithi159 ceph-mon[36109]: pgmap v7166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:55 smithi159 ceph-mon[36109]: pgmap v7167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:55 smithi055 ceph-mon[31863]: pgmap v7166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:19:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:55 smithi055 ceph-mon[31863]: pgmap v7167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:19:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:57 smithi086 ceph-mon[35163]: pgmap v7168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:57 smithi159 ceph-mon[36109]: pgmap v7168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:57 smithi055 ceph-mon[31863]: pgmap v7168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:19:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 11998.008878 secs 2024-03-28T09:19:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:19:59 smithi086 ceph-mon[35163]: pgmap v7169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:19:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 11998.008878 secs 2024-03-28T09:19:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:19:59 smithi159 ceph-mon[36109]: pgmap v7169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:19:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 11998.008878 secs 2024-03-28T09:19:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:19:59 smithi055 ceph-mon[31863]: pgmap v7169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:20:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:20:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:20:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:20:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:01 smithi086 ceph-mon[35163]: pgmap v7170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:01 smithi159 ceph-mon[36109]: pgmap v7170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:01 smithi055 ceph-mon[31863]: pgmap v7170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:03 smithi086 ceph-mon[35163]: pgmap v7171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12003.008957 secs 2024-03-28T09:20:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:03 smithi159 ceph-mon[36109]: pgmap v7171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12003.008957 secs 2024-03-28T09:20:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:03 smithi055 ceph-mon[31863]: pgmap v7171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12003.008957 secs 2024-03-28T09:20:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:05 smithi086 ceph-mon[35163]: pgmap v7172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:05 smithi159 ceph-mon[36109]: pgmap v7172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:05 smithi055 ceph-mon[31863]: pgmap v7172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:07 smithi086 ceph-mon[35163]: pgmap v7173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:07 smithi159 ceph-mon[36109]: pgmap v7173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:07 smithi055 ceph-mon[31863]: pgmap v7173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12008.009074 secs 2024-03-28T09:20:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12008.009074 secs 2024-03-28T09:20:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12008.009074 secs 2024-03-28T09:20:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:09 smithi086 ceph-mon[35163]: pgmap v7174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:09 smithi159 ceph-mon[36109]: pgmap v7174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:09 smithi055 ceph-mon[31863]: pgmap v7174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:11 smithi086 ceph-mon[35163]: pgmap v7175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:11 smithi159 ceph-mon[36109]: pgmap v7175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:11 smithi055 ceph-mon[31863]: pgmap v7175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:13 smithi086 ceph-mon[35163]: pgmap v7176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12013.009189 secs 2024-03-28T09:20:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:13 smithi159 ceph-mon[36109]: pgmap v7176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12013.009189 secs 2024-03-28T09:20:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:13 smithi055 ceph-mon[31863]: pgmap v7176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12013.009189 secs 2024-03-28T09:20:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:15 smithi086 ceph-mon[35163]: pgmap v7177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:15 smithi159 ceph-mon[36109]: pgmap v7177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:15 smithi055 ceph-mon[31863]: pgmap v7177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:17 smithi086 ceph-mon[35163]: pgmap v7178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:17 smithi159 ceph-mon[36109]: pgmap v7178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:17 smithi055 ceph-mon[31863]: pgmap v7178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12018.009310 secs 2024-03-28T09:20:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12018.009310 secs 2024-03-28T09:20:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12018.009310 secs 2024-03-28T09:20:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:19 smithi086 ceph-mon[35163]: pgmap v7179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:19 smithi159 ceph-mon[36109]: pgmap v7179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:19 smithi055 ceph-mon[31863]: pgmap v7179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:21 smithi086 ceph-mon[35163]: pgmap v7180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:21 smithi159 ceph-mon[36109]: pgmap v7180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:21 smithi055 ceph-mon[31863]: pgmap v7180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:23 smithi086 ceph-mon[35163]: pgmap v7181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12023.009375 secs 2024-03-28T09:20:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:23 smithi159 ceph-mon[36109]: pgmap v7181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12023.009375 secs 2024-03-28T09:20:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:23 smithi055 ceph-mon[31863]: pgmap v7181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12023.009375 secs 2024-03-28T09:20:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:25 smithi055 ceph-mon[31863]: pgmap v7182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:25 smithi086 ceph-mon[35163]: pgmap v7182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:25 smithi159 ceph-mon[36109]: pgmap v7182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:27 smithi159 ceph-mon[36109]: pgmap v7183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:27 smithi055 ceph-mon[31863]: pgmap v7183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:27 smithi086 ceph-mon[35163]: pgmap v7183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:20:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12028.009494 secs 2024-03-28T09:20:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12028.009494 secs 2024-03-28T09:20:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12028.009494 secs 2024-03-28T09:20:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:29 smithi055 ceph-mon[31863]: pgmap v7184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:29 smithi086 ceph-mon[35163]: pgmap v7184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:29 smithi159 ceph-mon[36109]: pgmap v7184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:31 smithi055 ceph-mon[31863]: pgmap v7185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:31 smithi086 ceph-mon[35163]: pgmap v7185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:31 smithi159 ceph-mon[36109]: pgmap v7185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:33 smithi055 ceph-mon[31863]: pgmap v7186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12033.009613 secs 2024-03-28T09:20:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:33 smithi086 ceph-mon[35163]: pgmap v7186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12033.009613 secs 2024-03-28T09:20:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:33 smithi159 ceph-mon[36109]: pgmap v7186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12033.009613 secs 2024-03-28T09:20:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:35 smithi055 ceph-mon[31863]: pgmap v7187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:35 smithi086 ceph-mon[35163]: pgmap v7187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:35 smithi159 ceph-mon[36109]: pgmap v7187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:37 smithi086 ceph-mon[35163]: pgmap v7188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:37 smithi159 ceph-mon[36109]: pgmap v7188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:37 smithi055 ceph-mon[31863]: pgmap v7188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12038.009719 secs 2024-03-28T09:20:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12038.009719 secs 2024-03-28T09:20:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12038.009719 secs 2024-03-28T09:20:39.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:39 smithi086 ceph-mon[35163]: pgmap v7189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:39.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:39 smithi159 ceph-mon[36109]: pgmap v7189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:39 smithi055 ceph-mon[31863]: pgmap v7189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:20:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:41 smithi086 ceph-mon[35163]: pgmap v7190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:41 smithi159 ceph-mon[36109]: pgmap v7190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:41 smithi055 ceph-mon[31863]: pgmap v7190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:43 smithi086 ceph-mon[35163]: pgmap v7191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12043.009803 secs 2024-03-28T09:20:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:43 smithi159 ceph-mon[36109]: pgmap v7191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12043.009803 secs 2024-03-28T09:20:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:43 smithi055 ceph-mon[31863]: pgmap v7191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12043.009803 secs 2024-03-28T09:20:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:45 smithi086 ceph-mon[35163]: pgmap v7192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:45 smithi159 ceph-mon[36109]: pgmap v7192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:45 smithi055 ceph-mon[31863]: pgmap v7192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:20:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:47 smithi086 ceph-mon[35163]: pgmap v7193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:47 smithi159 ceph-mon[36109]: pgmap v7193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:47 smithi055 ceph-mon[31863]: pgmap v7193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12048.009893 secs 2024-03-28T09:20:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12048.009893 secs 2024-03-28T09:20:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12048.009893 secs 2024-03-28T09:20:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:49 smithi086 ceph-mon[35163]: pgmap v7194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:20:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:49 smithi159 ceph-mon[36109]: pgmap v7194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:20:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:49 smithi055 ceph-mon[31863]: pgmap v7194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:20:51.703 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:51 smithi055 ceph-mon[31863]: pgmap v7195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:51 smithi086 ceph-mon[35163]: pgmap v7195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:51 smithi159 ceph-mon[36109]: pgmap v7195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:53 smithi055 ceph-mon[31863]: pgmap v7196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12053.009974 secs 2024-03-28T09:20:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:53 smithi086 ceph-mon[35163]: pgmap v7196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12053.009974 secs 2024-03-28T09:20:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:53 smithi159 ceph-mon[36109]: pgmap v7196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12053.009974 secs 2024-03-28T09:20:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:20:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:20:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:20:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:55 smithi086 ceph-mon[35163]: pgmap v7197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:55 smithi159 ceph-mon[36109]: pgmap v7197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:55 smithi055 ceph-mon[31863]: pgmap v7197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:20:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:20:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:20:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:20:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:20:56.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:20:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:20:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:20:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:20:56.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:20:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:20:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:20:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:20:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:20:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: pgmap v7198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:57 smithi086 ceph-mon[35163]: pgmap v7199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: pgmap v7198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:57 smithi159 ceph-mon[36109]: pgmap v7199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:20:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:20:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:20:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:20:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: pgmap v7198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:57.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:57 smithi055 ceph-mon[31863]: pgmap v7199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:20:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12058.010062 secs 2024-03-28T09:20:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12058.010062 secs 2024-03-28T09:20:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12058.010062 secs 2024-03-28T09:20:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:20:59 smithi086 ceph-mon[35163]: pgmap v7200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:20:59 smithi159 ceph-mon[36109]: pgmap v7200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:20:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:20:59 smithi055 ceph-mon[31863]: pgmap v7200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:00 smithi086 ceph-mon[35163]: pgmap v7201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:00 smithi159 ceph-mon[36109]: pgmap v7201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:00 smithi055 ceph-mon[31863]: pgmap v7201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:02 smithi086 ceph-mon[35163]: pgmap v7202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:02 smithi159 ceph-mon[36109]: pgmap v7202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:02 smithi055 ceph-mon[31863]: pgmap v7202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12063.010178 secs 2024-03-28T09:21:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12063.010178 secs 2024-03-28T09:21:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12063.010178 secs 2024-03-28T09:21:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:04 smithi086 ceph-mon[35163]: pgmap v7203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:04 smithi159 ceph-mon[36109]: pgmap v7203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:04 smithi055 ceph-mon[31863]: pgmap v7203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:06 smithi086 ceph-mon[35163]: pgmap v7204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:21:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:06 smithi159 ceph-mon[36109]: pgmap v7204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:21:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:06 smithi055 ceph-mon[31863]: pgmap v7204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:21:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:08 smithi086 ceph-mon[35163]: pgmap v7205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12068.010301 secs 2024-03-28T09:21:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:08 smithi159 ceph-mon[36109]: pgmap v7205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12068.010301 secs 2024-03-28T09:21:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:08 smithi055 ceph-mon[31863]: pgmap v7205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12068.010301 secs 2024-03-28T09:21:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:10 smithi086 ceph-mon[35163]: pgmap v7206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:10 smithi159 ceph-mon[36109]: pgmap v7206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:10 smithi055 ceph-mon[31863]: pgmap v7206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:12 smithi086 ceph-mon[35163]: pgmap v7207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:12 smithi159 ceph-mon[36109]: pgmap v7207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:12 smithi055 ceph-mon[31863]: pgmap v7207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12073.010417 secs 2024-03-28T09:21:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12073.010417 secs 2024-03-28T09:21:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12073.010417 secs 2024-03-28T09:21:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:14 smithi086 ceph-mon[35163]: pgmap v7208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:14 smithi159 ceph-mon[36109]: pgmap v7208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:14 smithi055 ceph-mon[31863]: pgmap v7208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:16 smithi086 ceph-mon[35163]: pgmap v7209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:16 smithi159 ceph-mon[36109]: pgmap v7209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:16 smithi055 ceph-mon[31863]: pgmap v7209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:18 smithi086 ceph-mon[35163]: pgmap v7210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12078.010482 secs 2024-03-28T09:21:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:18 smithi159 ceph-mon[36109]: pgmap v7210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12078.010482 secs 2024-03-28T09:21:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:18 smithi055 ceph-mon[31863]: pgmap v7210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12078.010482 secs 2024-03-28T09:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:20 smithi086 ceph-mon[35163]: pgmap v7211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:20 smithi159 ceph-mon[36109]: pgmap v7211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:20 smithi055 ceph-mon[31863]: pgmap v7211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:22 smithi086 ceph-mon[35163]: pgmap v7212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:22 smithi159 ceph-mon[36109]: pgmap v7212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:23.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:22 smithi055 ceph-mon[31863]: pgmap v7212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12083.010603 secs 2024-03-28T09:21:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12083.010603 secs 2024-03-28T09:21:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12083.010603 secs 2024-03-28T09:21:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:24 smithi086 ceph-mon[35163]: pgmap v7213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:24 smithi159 ceph-mon[36109]: pgmap v7213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:24 smithi055 ceph-mon[31863]: pgmap v7213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:26 smithi086 ceph-mon[35163]: pgmap v7214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:26 smithi159 ceph-mon[36109]: pgmap v7214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:26 smithi055 ceph-mon[31863]: pgmap v7214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:28 smithi086 ceph-mon[35163]: pgmap v7215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12088.010680 secs 2024-03-28T09:21:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:28 smithi159 ceph-mon[36109]: pgmap v7215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12088.010680 secs 2024-03-28T09:21:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:28 smithi055 ceph-mon[31863]: pgmap v7215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12088.010680 secs 2024-03-28T09:21:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:30 smithi086 ceph-mon[35163]: pgmap v7216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:30 smithi159 ceph-mon[36109]: pgmap v7216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:30 smithi055 ceph-mon[31863]: pgmap v7216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:32 smithi086 ceph-mon[35163]: pgmap v7217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:32 smithi159 ceph-mon[36109]: pgmap v7217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:32 smithi055 ceph-mon[31863]: pgmap v7217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12093.010752 secs 2024-03-28T09:21:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12093.010752 secs 2024-03-28T09:21:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12093.010752 secs 2024-03-28T09:21:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:34 smithi086 ceph-mon[35163]: pgmap v7218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:34 smithi159 ceph-mon[36109]: pgmap v7218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:34 smithi055 ceph-mon[31863]: pgmap v7218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:36 smithi086 ceph-mon[35163]: pgmap v7219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:36 smithi159 ceph-mon[36109]: pgmap v7219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:36 smithi055 ceph-mon[31863]: pgmap v7219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:38 smithi055 ceph-mon[31863]: pgmap v7220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12098.010838 secs 2024-03-28T09:21:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:38 smithi086 ceph-mon[35163]: pgmap v7220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12098.010838 secs 2024-03-28T09:21:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:38 smithi159 ceph-mon[36109]: pgmap v7220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12098.010838 secs 2024-03-28T09:21:41.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:40 smithi086 ceph-mon[35163]: pgmap v7221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:41.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:40 smithi159 ceph-mon[36109]: pgmap v7221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:40 smithi055 ceph-mon[31863]: pgmap v7221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:42 smithi055 ceph-mon[31863]: pgmap v7222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:42 smithi086 ceph-mon[35163]: pgmap v7222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:42 smithi159 ceph-mon[36109]: pgmap v7222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12103.010953 secs 2024-03-28T09:21:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12103.010953 secs 2024-03-28T09:21:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12103.010953 secs 2024-03-28T09:21:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:44 smithi055 ceph-mon[31863]: pgmap v7223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:44 smithi086 ceph-mon[35163]: pgmap v7223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:44 smithi159 ceph-mon[36109]: pgmap v7223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:46 smithi055 ceph-mon[31863]: pgmap v7224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:46 smithi086 ceph-mon[35163]: pgmap v7224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:46 smithi159 ceph-mon[36109]: pgmap v7224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12108.011077 secs 2024-03-28T09:21:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:48 smithi055 ceph-mon[31863]: pgmap v7225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12108.011077 secs 2024-03-28T09:21:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:48 smithi086 ceph-mon[35163]: pgmap v7225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12108.011077 secs 2024-03-28T09:21:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:48 smithi159 ceph-mon[36109]: pgmap v7225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:50 smithi086 ceph-mon[35163]: pgmap v7226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:50 smithi159 ceph-mon[36109]: pgmap v7226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:50 smithi055 ceph-mon[31863]: pgmap v7226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:53.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:52 smithi055 ceph-mon[31863]: pgmap v7227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:52 smithi086 ceph-mon[35163]: pgmap v7227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:52 smithi159 ceph-mon[36109]: pgmap v7227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12113.011198 secs 2024-03-28T09:21:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12113.011198 secs 2024-03-28T09:21:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12113.011198 secs 2024-03-28T09:21:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:54 smithi086 ceph-mon[35163]: pgmap v7228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:54 smithi159 ceph-mon[36109]: pgmap v7228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:54 smithi055 ceph-mon[31863]: pgmap v7228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:21:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:56 smithi086 ceph-mon[35163]: pgmap v7229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:21:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:56 smithi159 ceph-mon[36109]: pgmap v7229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:21:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:56 smithi055 ceph-mon[31863]: pgmap v7229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:21:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:21:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:21:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: pgmap v7230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: pgmap v7231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: pgmap v7230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:58.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: pgmap v7231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:58.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:21:58.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: pgmap v7230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:21:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: pgmap v7231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:21:58.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:21:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12118.011258 secs 2024-03-28T09:21:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12118.011258 secs 2024-03-28T09:21:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12118.011258 secs 2024-03-28T09:22:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:21:59 smithi086 ceph-mon[35163]: pgmap v7232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:21:59 smithi159 ceph-mon[36109]: pgmap v7232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:21:59 smithi055 ceph-mon[31863]: pgmap v7232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:02 smithi086 ceph-mon[35163]: pgmap v7233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:02 smithi159 ceph-mon[36109]: pgmap v7233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:02 smithi055 ceph-mon[31863]: pgmap v7233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12123.011338 secs 2024-03-28T09:22:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12123.011338 secs 2024-03-28T09:22:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12123.011338 secs 2024-03-28T09:22:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:04 smithi086 ceph-mon[35163]: pgmap v7234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:04 smithi159 ceph-mon[36109]: pgmap v7234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:04 smithi055 ceph-mon[31863]: pgmap v7234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:06 smithi086 ceph-mon[35163]: pgmap v7235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:06 smithi159 ceph-mon[36109]: pgmap v7235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:06 smithi055 ceph-mon[31863]: pgmap v7235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:22:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:08 smithi086 ceph-mon[35163]: pgmap v7236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:22:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12128.011421 secs 2024-03-28T09:22:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:08 smithi159 ceph-mon[36109]: pgmap v7236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:22:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12128.011421 secs 2024-03-28T09:22:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:08 smithi055 ceph-mon[31863]: pgmap v7236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:22:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12128.011421 secs 2024-03-28T09:22:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:10 smithi086 ceph-mon[35163]: pgmap v7237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:10 smithi159 ceph-mon[36109]: pgmap v7237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:10 smithi055 ceph-mon[31863]: pgmap v7237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:12 smithi086 ceph-mon[35163]: pgmap v7238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:12 smithi159 ceph-mon[36109]: pgmap v7238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:12 smithi055 ceph-mon[31863]: pgmap v7238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12133.011494 secs 2024-03-28T09:22:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12133.011494 secs 2024-03-28T09:22:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12133.011494 secs 2024-03-28T09:22:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:14 smithi086 ceph-mon[35163]: pgmap v7239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:14 smithi159 ceph-mon[36109]: pgmap v7239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:14 smithi055 ceph-mon[31863]: pgmap v7239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:15 smithi086 ceph-mon[35163]: pgmap v7240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:15 smithi159 ceph-mon[36109]: pgmap v7240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:15 smithi055 ceph-mon[31863]: pgmap v7240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:18 smithi086 ceph-mon[35163]: pgmap v7241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12138.011614 secs 2024-03-28T09:22:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:18 smithi159 ceph-mon[36109]: pgmap v7241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12138.011614 secs 2024-03-28T09:22:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:18 smithi055 ceph-mon[31863]: pgmap v7241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12138.011614 secs 2024-03-28T09:22:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:20 smithi086 ceph-mon[35163]: pgmap v7242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:20 smithi159 ceph-mon[36109]: pgmap v7242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:20 smithi055 ceph-mon[31863]: pgmap v7242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:22 smithi086 ceph-mon[35163]: pgmap v7243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:22 smithi159 ceph-mon[36109]: pgmap v7243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:22 smithi055 ceph-mon[31863]: pgmap v7243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:23.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12143.011680 secs 2024-03-28T09:22:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12143.011680 secs 2024-03-28T09:22:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12143.011680 secs 2024-03-28T09:22:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:24 smithi086 ceph-mon[35163]: pgmap v7244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:24 smithi159 ceph-mon[36109]: pgmap v7244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:24 smithi055 ceph-mon[31863]: pgmap v7244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:26 smithi086 ceph-mon[35163]: pgmap v7245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:26 smithi159 ceph-mon[36109]: pgmap v7245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:26 smithi055 ceph-mon[31863]: pgmap v7245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:28 smithi086 ceph-mon[35163]: pgmap v7246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12148.011828 secs 2024-03-28T09:22:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:28 smithi159 ceph-mon[36109]: pgmap v7246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12148.011828 secs 2024-03-28T09:22:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:28 smithi055 ceph-mon[31863]: pgmap v7246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12148.011828 secs 2024-03-28T09:22:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:29 smithi086 ceph-mon[35163]: pgmap v7247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:29 smithi159 ceph-mon[36109]: pgmap v7247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:29 smithi055 ceph-mon[31863]: pgmap v7247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:32 smithi086 ceph-mon[35163]: pgmap v7248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:32 smithi159 ceph-mon[36109]: pgmap v7248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:32 smithi055 ceph-mon[31863]: pgmap v7248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12153.011918 secs 2024-03-28T09:22:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12153.011918 secs 2024-03-28T09:22:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12153.011918 secs 2024-03-28T09:22:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:34 smithi086 ceph-mon[35163]: pgmap v7249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:34 smithi159 ceph-mon[36109]: pgmap v7249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:34 smithi055 ceph-mon[31863]: pgmap v7249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:36 smithi086 ceph-mon[35163]: pgmap v7250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:36 smithi159 ceph-mon[36109]: pgmap v7250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:36 smithi055 ceph-mon[31863]: pgmap v7250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:38 smithi086 ceph-mon[35163]: pgmap v7251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12158.011986 secs 2024-03-28T09:22:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:38 smithi159 ceph-mon[36109]: pgmap v7251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12158.011986 secs 2024-03-28T09:22:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:38 smithi055 ceph-mon[31863]: pgmap v7251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12158.011986 secs 2024-03-28T09:22:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:39 smithi086 ceph-mon[35163]: pgmap v7252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:39 smithi159 ceph-mon[36109]: pgmap v7252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:39 smithi055 ceph-mon[31863]: pgmap v7252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:42 smithi086 ceph-mon[35163]: pgmap v7253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:42 smithi159 ceph-mon[36109]: pgmap v7253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:42 smithi055 ceph-mon[31863]: pgmap v7253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12163.012054 secs 2024-03-28T09:22:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12163.012054 secs 2024-03-28T09:22:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12163.012054 secs 2024-03-28T09:22:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:44 smithi086 ceph-mon[35163]: pgmap v7254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:44 smithi159 ceph-mon[36109]: pgmap v7254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:44 smithi055 ceph-mon[31863]: pgmap v7254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:46 smithi086 ceph-mon[35163]: pgmap v7255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:46 smithi159 ceph-mon[36109]: pgmap v7255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:46 smithi055 ceph-mon[31863]: pgmap v7255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:48 smithi086 ceph-mon[35163]: pgmap v7256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12168.012115 secs 2024-03-28T09:22:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:48 smithi159 ceph-mon[36109]: pgmap v7256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12168.012115 secs 2024-03-28T09:22:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:48 smithi055 ceph-mon[31863]: pgmap v7256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12168.012115 secs 2024-03-28T09:22:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:49 smithi086 ceph-mon[35163]: pgmap v7257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:49 smithi159 ceph-mon[36109]: pgmap v7257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:49 smithi055 ceph-mon[31863]: pgmap v7257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:52 smithi086 ceph-mon[35163]: pgmap v7258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:52 smithi159 ceph-mon[36109]: pgmap v7258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:52 smithi055 ceph-mon[31863]: pgmap v7258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:53.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12173.012234 secs 2024-03-28T09:22:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12173.012234 secs 2024-03-28T09:22:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12173.012234 secs 2024-03-28T09:22:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:54 smithi086 ceph-mon[35163]: pgmap v7259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:54 smithi159 ceph-mon[36109]: pgmap v7259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:54 smithi055 ceph-mon[31863]: pgmap v7259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:56 smithi086 ceph-mon[35163]: pgmap v7260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:56 smithi159 ceph-mon[36109]: pgmap v7260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:56 smithi055 ceph-mon[31863]: pgmap v7260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:22:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:57 smithi086 ceph-mon[35163]: pgmap v7261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:57 smithi159 ceph-mon[36109]: pgmap v7261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:57 smithi055 ceph-mon[31863]: pgmap v7261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:22:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12178.012265 secs 2024-03-28T09:22:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:22:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12178.012265 secs 2024-03-28T09:22:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:22:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12178.012265 secs 2024-03-28T09:22:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:22:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:22:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:22:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:59 smithi086 ceph-mon[35163]: pgmap v7262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:59 smithi086 ceph-mon[35163]: pgmap v7263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:22:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:22:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:22:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:22:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:59 smithi159 ceph-mon[36109]: pgmap v7262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:59 smithi159 ceph-mon[36109]: pgmap v7263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:22:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:22:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:22:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:22:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:59 smithi055 ceph-mon[31863]: pgmap v7262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:59 smithi055 ceph-mon[31863]: pgmap v7263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:22:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:22:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:23:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:02 smithi086 ceph-mon[35163]: pgmap v7264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:02 smithi159 ceph-mon[36109]: pgmap v7264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:02 smithi055 ceph-mon[31863]: pgmap v7264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12183.012350 secs 2024-03-28T09:23:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:04 smithi086 ceph-mon[35163]: pgmap v7265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12183.012350 secs 2024-03-28T09:23:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:04 smithi159 ceph-mon[36109]: pgmap v7265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12183.012350 secs 2024-03-28T09:23:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:04 smithi055 ceph-mon[31863]: pgmap v7265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:06 smithi086 ceph-mon[35163]: pgmap v7266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:23:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:06 smithi159 ceph-mon[36109]: pgmap v7266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:23:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:06 smithi055 ceph-mon[31863]: pgmap v7266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:23:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:08 smithi086 ceph-mon[35163]: pgmap v7267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:08 smithi159 ceph-mon[36109]: pgmap v7267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:08 smithi055 ceph-mon[31863]: pgmap v7267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12188.012438 secs 2024-03-28T09:23:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12188.012438 secs 2024-03-28T09:23:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12188.012438 secs 2024-03-28T09:23:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:10 smithi086 ceph-mon[35163]: pgmap v7268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:23:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:10 smithi159 ceph-mon[36109]: pgmap v7268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:23:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:10 smithi055 ceph-mon[31863]: pgmap v7268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:23:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:12 smithi086 ceph-mon[35163]: pgmap v7269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:12 smithi159 ceph-mon[36109]: pgmap v7269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:12 smithi055 ceph-mon[31863]: pgmap v7269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12193.012558 secs 2024-03-28T09:23:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:14 smithi086 ceph-mon[35163]: pgmap v7270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12193.012558 secs 2024-03-28T09:23:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:14 smithi159 ceph-mon[36109]: pgmap v7270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12193.012558 secs 2024-03-28T09:23:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:14 smithi055 ceph-mon[31863]: pgmap v7270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:16 smithi086 ceph-mon[35163]: pgmap v7271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:16 smithi159 ceph-mon[36109]: pgmap v7271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:16 smithi055 ceph-mon[31863]: pgmap v7271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:18 smithi086 ceph-mon[35163]: pgmap v7272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12198.012678 secs 2024-03-28T09:23:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:18 smithi159 ceph-mon[36109]: pgmap v7272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12198.012678 secs 2024-03-28T09:23:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:18 smithi055 ceph-mon[31863]: pgmap v7272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12198.012678 secs 2024-03-28T09:23:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:20 smithi086 ceph-mon[35163]: pgmap v7273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:20 smithi159 ceph-mon[36109]: pgmap v7273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:20 smithi055 ceph-mon[31863]: pgmap v7273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:21 smithi086 ceph-mon[35163]: pgmap v7274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:21 smithi159 ceph-mon[36109]: pgmap v7274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:21 smithi055 ceph-mon[31863]: pgmap v7274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12203.012755 secs 2024-03-28T09:23:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:24 smithi086 ceph-mon[35163]: pgmap v7275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12203.012755 secs 2024-03-28T09:23:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:24 smithi159 ceph-mon[36109]: pgmap v7275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12203.012755 secs 2024-03-28T09:23:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:24 smithi055 ceph-mon[31863]: pgmap v7275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:26 smithi086 ceph-mon[35163]: pgmap v7276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:26 smithi159 ceph-mon[36109]: pgmap v7276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:26.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:26 smithi055 ceph-mon[31863]: pgmap v7276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:28 smithi086 ceph-mon[35163]: pgmap v7277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:28 smithi159 ceph-mon[36109]: pgmap v7277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:28 smithi055 ceph-mon[31863]: pgmap v7277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12208.012821 secs 2024-03-28T09:23:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12208.012821 secs 2024-03-28T09:23:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12208.012821 secs 2024-03-28T09:23:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:30 smithi086 ceph-mon[35163]: pgmap v7278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:30 smithi159 ceph-mon[36109]: pgmap v7278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:30 smithi055 ceph-mon[31863]: pgmap v7278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:32 smithi086 ceph-mon[35163]: pgmap v7279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:32 smithi159 ceph-mon[36109]: pgmap v7279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:32 smithi055 ceph-mon[31863]: pgmap v7279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12213.012944 secs 2024-03-28T09:23:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:34 smithi086 ceph-mon[35163]: pgmap v7280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12213.012944 secs 2024-03-28T09:23:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:34 smithi159 ceph-mon[36109]: pgmap v7280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12213.012944 secs 2024-03-28T09:23:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:34 smithi055 ceph-mon[31863]: pgmap v7280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:36 smithi086 ceph-mon[35163]: pgmap v7281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:36 smithi159 ceph-mon[36109]: pgmap v7281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:36.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:36 smithi055 ceph-mon[31863]: pgmap v7281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:38 smithi086 ceph-mon[35163]: pgmap v7282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12218.013036 secs 2024-03-28T09:23:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:38 smithi159 ceph-mon[36109]: pgmap v7282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12218.013036 secs 2024-03-28T09:23:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:38 smithi055 ceph-mon[31863]: pgmap v7282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12218.013036 secs 2024-03-28T09:23:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:40 smithi086 ceph-mon[35163]: pgmap v7283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:40 smithi159 ceph-mon[36109]: pgmap v7283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:40 smithi055 ceph-mon[31863]: pgmap v7283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:42 smithi086 ceph-mon[35163]: pgmap v7284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:42 smithi159 ceph-mon[36109]: pgmap v7284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:42 smithi055 ceph-mon[31863]: pgmap v7284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12223.013113 secs 2024-03-28T09:23:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12223.013113 secs 2024-03-28T09:23:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12223.013113 secs 2024-03-28T09:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:44 smithi086 ceph-mon[35163]: pgmap v7285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:44 smithi159 ceph-mon[36109]: pgmap v7285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:44 smithi055 ceph-mon[31863]: pgmap v7285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:46 smithi086 ceph-mon[35163]: pgmap v7286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:46 smithi159 ceph-mon[36109]: pgmap v7286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:46 smithi055 ceph-mon[31863]: pgmap v7286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:48 smithi086 ceph-mon[35163]: pgmap v7287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12228.013236 secs 2024-03-28T09:23:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:48 smithi159 ceph-mon[36109]: pgmap v7287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12228.013236 secs 2024-03-28T09:23:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:48 smithi055 ceph-mon[31863]: pgmap v7287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12228.013236 secs 2024-03-28T09:23:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:50 smithi086 ceph-mon[35163]: pgmap v7288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:50 smithi159 ceph-mon[36109]: pgmap v7288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:50.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:50 smithi055 ceph-mon[31863]: pgmap v7288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:52 smithi159 ceph-mon[36109]: pgmap v7289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:52 smithi055 ceph-mon[31863]: pgmap v7289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:52 smithi086 ceph-mon[35163]: pgmap v7289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12233.013360 secs 2024-03-28T09:23:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12233.013360 secs 2024-03-28T09:23:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12233.013360 secs 2024-03-28T09:23:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:54 smithi055 ceph-mon[31863]: pgmap v7290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:54 smithi086 ceph-mon[35163]: pgmap v7290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:54 smithi159 ceph-mon[36109]: pgmap v7290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:56 smithi055 ceph-mon[31863]: pgmap v7291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:56 smithi086 ceph-mon[35163]: pgmap v7291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:56 smithi159 ceph-mon[36109]: pgmap v7291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:23:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:58 smithi055 ceph-mon[31863]: pgmap v7292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:23:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12238.013433 secs 2024-03-28T09:23:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:58 smithi086 ceph-mon[35163]: pgmap v7292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:23:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12238.013433 secs 2024-03-28T09:23:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:58 smithi159 ceph-mon[36109]: pgmap v7292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:23:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:23:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12238.013433 secs 2024-03-28T09:24:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:00 smithi055 ceph-mon[31863]: pgmap v7293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:24:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:00 smithi086 ceph-mon[35163]: pgmap v7293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:24:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:00 smithi159 ceph-mon[36109]: pgmap v7293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:24:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:02 smithi086 ceph-mon[35163]: pgmap v7294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:24:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:24:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:02 smithi159 ceph-mon[36109]: pgmap v7294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:24:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:24:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:02 smithi055 ceph-mon[31863]: pgmap v7294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:24:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:24:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:24:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:03 smithi086 ceph-mon[35163]: pgmap v7295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:03 smithi086 ceph-mon[35163]: pgmap v7296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12243.013552 secs 2024-03-28T09:24:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:03 smithi159 ceph-mon[36109]: pgmap v7295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:03 smithi159 ceph-mon[36109]: pgmap v7296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12243.013552 secs 2024-03-28T09:24:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:03 smithi055 ceph-mon[31863]: pgmap v7295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:03 smithi055 ceph-mon[31863]: pgmap v7296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12243.013552 secs 2024-03-28T09:24:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:05 smithi086 ceph-mon[35163]: pgmap v7297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:05 smithi159 ceph-mon[36109]: pgmap v7297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:05 smithi055 ceph-mon[31863]: pgmap v7297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:07 smithi086 ceph-mon[35163]: pgmap v7298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:07 smithi159 ceph-mon[36109]: pgmap v7298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:07 smithi055 ceph-mon[31863]: pgmap v7298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:24:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12248.013674 secs 2024-03-28T09:24:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12248.013674 secs 2024-03-28T09:24:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12248.013674 secs 2024-03-28T09:24:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:09 smithi086 ceph-mon[35163]: pgmap v7299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:24:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:09 smithi159 ceph-mon[36109]: pgmap v7299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:24:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:09 smithi055 ceph-mon[31863]: pgmap v7299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:24:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:10 smithi086 ceph-mon[35163]: pgmap v7300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:24:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:10 smithi159 ceph-mon[36109]: pgmap v7300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:24:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:10 smithi055 ceph-mon[31863]: pgmap v7300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:24:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:12 smithi086 ceph-mon[35163]: pgmap v7301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:12 smithi159 ceph-mon[36109]: pgmap v7301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:12 smithi055 ceph-mon[31863]: pgmap v7301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:24:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12253.013745 secs 2024-03-28T09:24:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12253.013745 secs 2024-03-28T09:24:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12253.013745 secs 2024-03-28T09:24:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:14 smithi086 ceph-mon[35163]: pgmap v7302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:14 smithi159 ceph-mon[36109]: pgmap v7302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:14 smithi055 ceph-mon[31863]: pgmap v7302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:16 smithi086 ceph-mon[35163]: pgmap v7303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:16 smithi159 ceph-mon[36109]: pgmap v7303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:16 smithi055 ceph-mon[31863]: pgmap v7303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12258.013815 secs 2024-03-28T09:24:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:18 smithi086 ceph-mon[35163]: pgmap v7304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12258.013815 secs 2024-03-28T09:24:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:18 smithi159 ceph-mon[36109]: pgmap v7304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12258.013815 secs 2024-03-28T09:24:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:18 smithi055 ceph-mon[31863]: pgmap v7304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:24:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:20 smithi086 ceph-mon[35163]: pgmap v7305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:20 smithi159 ceph-mon[36109]: pgmap v7305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:20 smithi055 ceph-mon[31863]: pgmap v7305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:22 smithi086 ceph-mon[35163]: pgmap v7306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:22 smithi159 ceph-mon[36109]: pgmap v7306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:23.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:22 smithi055 ceph-mon[31863]: pgmap v7306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:24.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12263.013882 secs 2024-03-28T09:24:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12263.013882 secs 2024-03-28T09:24:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12263.013882 secs 2024-03-28T09:24:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:24 smithi086 ceph-mon[35163]: pgmap v7307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:24 smithi159 ceph-mon[36109]: pgmap v7307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:24 smithi055 ceph-mon[31863]: pgmap v7307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:26 smithi086 ceph-mon[35163]: pgmap v7308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:26 smithi159 ceph-mon[36109]: pgmap v7308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:26 smithi055 ceph-mon[31863]: pgmap v7308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12268.013950 secs 2024-03-28T09:24:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:28 smithi086 ceph-mon[35163]: pgmap v7309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12268.013950 secs 2024-03-28T09:24:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:28 smithi159 ceph-mon[36109]: pgmap v7309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12268.013950 secs 2024-03-28T09:24:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:28 smithi055 ceph-mon[31863]: pgmap v7309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:30 smithi086 ceph-mon[35163]: pgmap v7310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:30 smithi159 ceph-mon[36109]: pgmap v7310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:30 smithi055 ceph-mon[31863]: pgmap v7310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:32 smithi086 ceph-mon[35163]: pgmap v7311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:32 smithi159 ceph-mon[36109]: pgmap v7311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:32 smithi055 ceph-mon[31863]: pgmap v7311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12273.014016 secs 2024-03-28T09:24:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12273.014016 secs 2024-03-28T09:24:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12273.014016 secs 2024-03-28T09:24:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:35 smithi086 ceph-mon[35163]: pgmap v7312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:35 smithi159 ceph-mon[36109]: pgmap v7312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:35 smithi055 ceph-mon[31863]: pgmap v7312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:37 smithi086 ceph-mon[35163]: pgmap v7313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:37 smithi159 ceph-mon[36109]: pgmap v7313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:37 smithi055 ceph-mon[31863]: pgmap v7313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12278.014097 secs 2024-03-28T09:24:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:39 smithi086 ceph-mon[35163]: pgmap v7314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12278.014097 secs 2024-03-28T09:24:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:39 smithi159 ceph-mon[36109]: pgmap v7314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12278.014097 secs 2024-03-28T09:24:39.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:39 smithi055 ceph-mon[31863]: pgmap v7314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:41 smithi086 ceph-mon[35163]: pgmap v7315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:41 smithi159 ceph-mon[36109]: pgmap v7315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:41 smithi055 ceph-mon[31863]: pgmap v7315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:43 smithi086 ceph-mon[35163]: pgmap v7316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:43 smithi159 ceph-mon[36109]: pgmap v7316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:43 smithi055 ceph-mon[31863]: pgmap v7316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12283.014220 secs 2024-03-28T09:24:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12283.014220 secs 2024-03-28T09:24:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12283.014220 secs 2024-03-28T09:24:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:45 smithi055 ceph-mon[31863]: pgmap v7317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:45 smithi086 ceph-mon[35163]: pgmap v7317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:45 smithi159 ceph-mon[36109]: pgmap v7317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:47 smithi055 ceph-mon[31863]: pgmap v7318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:47 smithi086 ceph-mon[35163]: pgmap v7318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:47 smithi159 ceph-mon[36109]: pgmap v7318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12288.015334 secs 2024-03-28T09:24:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:49 smithi055 ceph-mon[31863]: pgmap v7319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12288.015334 secs 2024-03-28T09:24:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:49 smithi086 ceph-mon[35163]: pgmap v7319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12288.015334 secs 2024-03-28T09:24:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:49 smithi159 ceph-mon[36109]: pgmap v7319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:51 smithi055 ceph-mon[31863]: pgmap v7320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:51 smithi086 ceph-mon[35163]: pgmap v7320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:51 smithi159 ceph-mon[36109]: pgmap v7320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:24:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:53 smithi055 ceph-mon[31863]: pgmap v7321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:53 smithi086 ceph-mon[35163]: pgmap v7321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:53 smithi159 ceph-mon[36109]: pgmap v7321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12293.015457 secs 2024-03-28T09:24:54.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12293.015457 secs 2024-03-28T09:24:54.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12293.015457 secs 2024-03-28T09:24:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:55 smithi055 ceph-mon[31863]: pgmap v7322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:55 smithi086 ceph-mon[35163]: pgmap v7322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:55 smithi159 ceph-mon[36109]: pgmap v7322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:57 smithi086 ceph-mon[35163]: pgmap v7323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:57 smithi159 ceph-mon[36109]: pgmap v7323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:57 smithi055 ceph-mon[31863]: pgmap v7323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12298.015585 secs 2024-03-28T09:24:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:24:59 smithi086 ceph-mon[35163]: pgmap v7324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12298.015585 secs 2024-03-28T09:24:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:24:59 smithi159 ceph-mon[36109]: pgmap v7324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:24:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12298.015585 secs 2024-03-28T09:24:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:24:59 smithi055 ceph-mon[31863]: pgmap v7324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:01 smithi086 ceph-mon[35163]: pgmap v7325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:01 smithi159 ceph-mon[36109]: pgmap v7325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:01 smithi055 ceph-mon[31863]: pgmap v7325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:03.528 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:03 smithi086 ceph-mon[35163]: pgmap v7326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:03.528 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:25:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:03 smithi159 ceph-mon[36109]: pgmap v7326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:25:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:03 smithi055 ceph-mon[31863]: pgmap v7326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:25:04.514 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12303.015712 secs 2024-03-28T09:25:04.514 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:04.514 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12303.015712 secs 2024-03-28T09:25:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12303.015712 secs 2024-03-28T09:25:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:05 smithi086 ceph-mon[35163]: pgmap v7327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:05 smithi159 ceph-mon[36109]: pgmap v7327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:05 smithi055 ceph-mon[31863]: pgmap v7327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:07 smithi086 ceph-mon[35163]: pgmap v7328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:07 smithi159 ceph-mon[36109]: pgmap v7328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:07 smithi055 ceph-mon[31863]: pgmap v7328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12308.015838 secs 2024-03-28T09:25:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12308.015838 secs 2024-03-28T09:25:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12308.015838 secs 2024-03-28T09:25:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: pgmap v7329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:25:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:25:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: pgmap v7330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:25:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: pgmap v7331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: pgmap v7329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:25:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:25:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: pgmap v7330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:25:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: pgmap v7331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: pgmap v7329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: pgmap v7330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: pgmap v7331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:25:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:11 smithi086 ceph-mon[35163]: pgmap v7332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:11 smithi159 ceph-mon[36109]: pgmap v7332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:11 smithi055 ceph-mon[31863]: pgmap v7332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:25:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:13 smithi086 ceph-mon[35163]: pgmap v7333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12313.015927 secs 2024-03-28T09:25:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:13 smithi159 ceph-mon[36109]: pgmap v7333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12313.015927 secs 2024-03-28T09:25:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:13 smithi055 ceph-mon[31863]: pgmap v7333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12313.015927 secs 2024-03-28T09:25:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:15 smithi086 ceph-mon[35163]: pgmap v7334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:15 smithi159 ceph-mon[36109]: pgmap v7334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:15 smithi055 ceph-mon[31863]: pgmap v7334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:17 smithi086 ceph-mon[35163]: pgmap v7335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:17 smithi159 ceph-mon[36109]: pgmap v7335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:17 smithi055 ceph-mon[31863]: pgmap v7335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:25:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12318.016050 secs 2024-03-28T09:25:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12318.016050 secs 2024-03-28T09:25:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12318.016050 secs 2024-03-28T09:25:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:19 smithi086 ceph-mon[35163]: pgmap v7336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:25:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:19 smithi159 ceph-mon[36109]: pgmap v7336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:25:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:19 smithi055 ceph-mon[31863]: pgmap v7336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:25:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:21 smithi086 ceph-mon[35163]: pgmap v7337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:21 smithi159 ceph-mon[36109]: pgmap v7337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:21 smithi055 ceph-mon[31863]: pgmap v7337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:23 smithi086 ceph-mon[35163]: pgmap v7338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12323.016131 secs 2024-03-28T09:25:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:23 smithi159 ceph-mon[36109]: pgmap v7338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12323.016131 secs 2024-03-28T09:25:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:23 smithi055 ceph-mon[31863]: pgmap v7338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12323.016131 secs 2024-03-28T09:25:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:25 smithi086 ceph-mon[35163]: pgmap v7339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:25 smithi159 ceph-mon[36109]: pgmap v7339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:25.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:25 smithi055 ceph-mon[31863]: pgmap v7339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:27 smithi086 ceph-mon[35163]: pgmap v7340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:27 smithi159 ceph-mon[36109]: pgmap v7340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:27 smithi055 ceph-mon[31863]: pgmap v7340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12328.016248 secs 2024-03-28T09:25:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12328.016248 secs 2024-03-28T09:25:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12328.016248 secs 2024-03-28T09:25:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:29 smithi086 ceph-mon[35163]: pgmap v7341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:29 smithi159 ceph-mon[36109]: pgmap v7341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:29 smithi055 ceph-mon[31863]: pgmap v7341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:31 smithi086 ceph-mon[35163]: pgmap v7342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:31 smithi159 ceph-mon[36109]: pgmap v7342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:31 smithi055 ceph-mon[31863]: pgmap v7342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:33 smithi086 ceph-mon[35163]: pgmap v7343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12333.016371 secs 2024-03-28T09:25:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:33 smithi159 ceph-mon[36109]: pgmap v7343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12333.016371 secs 2024-03-28T09:25:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:33 smithi055 ceph-mon[31863]: pgmap v7343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12333.016371 secs 2024-03-28T09:25:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:34 smithi055 ceph-mon[31863]: pgmap v7344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:34 smithi086 ceph-mon[35163]: pgmap v7344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:34 smithi159 ceph-mon[36109]: pgmap v7344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:37 smithi086 ceph-mon[35163]: pgmap v7345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:37 smithi159 ceph-mon[36109]: pgmap v7345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:37 smithi055 ceph-mon[31863]: pgmap v7345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12338.016491 secs 2024-03-28T09:25:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12338.016491 secs 2024-03-28T09:25:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12338.016491 secs 2024-03-28T09:25:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:39 smithi086 ceph-mon[35163]: pgmap v7346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:39 smithi159 ceph-mon[36109]: pgmap v7346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:39 smithi055 ceph-mon[31863]: pgmap v7346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:41 smithi086 ceph-mon[35163]: pgmap v7347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:41 smithi159 ceph-mon[36109]: pgmap v7347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:41 smithi055 ceph-mon[31863]: pgmap v7347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:43 smithi086 ceph-mon[35163]: pgmap v7348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12343.016568 secs 2024-03-28T09:25:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:43 smithi159 ceph-mon[36109]: pgmap v7348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12343.016568 secs 2024-03-28T09:25:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:43 smithi055 ceph-mon[31863]: pgmap v7348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12343.016568 secs 2024-03-28T09:25:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:45 smithi086 ceph-mon[35163]: pgmap v7349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:45 smithi159 ceph-mon[36109]: pgmap v7349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:45 smithi055 ceph-mon[31863]: pgmap v7349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:47 smithi086 ceph-mon[35163]: pgmap v7350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:47 smithi159 ceph-mon[36109]: pgmap v7350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:47 smithi055 ceph-mon[31863]: pgmap v7350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12348.016649 secs 2024-03-28T09:25:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12348.016649 secs 2024-03-28T09:25:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12348.016649 secs 2024-03-28T09:25:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:49 smithi086 ceph-mon[35163]: pgmap v7351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:49 smithi159 ceph-mon[36109]: pgmap v7351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:49 smithi055 ceph-mon[31863]: pgmap v7351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:51 smithi086 ceph-mon[35163]: pgmap v7352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:51 smithi159 ceph-mon[36109]: pgmap v7352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:51 smithi055 ceph-mon[31863]: pgmap v7352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:25:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:53 smithi086 ceph-mon[35163]: pgmap v7353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12353.016719 secs 2024-03-28T09:25:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:53 smithi159 ceph-mon[36109]: pgmap v7353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12353.016719 secs 2024-03-28T09:25:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:53 smithi055 ceph-mon[31863]: pgmap v7353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:25:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12353.016719 secs 2024-03-28T09:25:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:55 smithi086 ceph-mon[35163]: pgmap v7354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:55 smithi159 ceph-mon[36109]: pgmap v7354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:55 smithi055 ceph-mon[31863]: pgmap v7354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:57 smithi086 ceph-mon[35163]: pgmap v7355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:57 smithi159 ceph-mon[36109]: pgmap v7355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:57 smithi055 ceph-mon[31863]: pgmap v7355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12358.016843 secs 2024-03-28T09:25:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12358.016843 secs 2024-03-28T09:25:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12358.016843 secs 2024-03-28T09:25:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:25:59 smithi086 ceph-mon[35163]: pgmap v7356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:25:59 smithi159 ceph-mon[36109]: pgmap v7356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:25:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:25:59 smithi055 ceph-mon[31863]: pgmap v7356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:00.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:00 smithi055 ceph-mon[31863]: pgmap v7357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:26:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:00 smithi086 ceph-mon[35163]: pgmap v7357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:26:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:00 smithi159 ceph-mon[36109]: pgmap v7357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:26:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:03 smithi086 ceph-mon[35163]: pgmap v7358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12363.016927 secs 2024-03-28T09:26:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:03 smithi159 ceph-mon[36109]: pgmap v7358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12363.016927 secs 2024-03-28T09:26:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:03 smithi055 ceph-mon[31863]: pgmap v7358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12363.016927 secs 2024-03-28T09:26:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:05 smithi086 ceph-mon[35163]: pgmap v7359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:05 smithi159 ceph-mon[36109]: pgmap v7359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:05 smithi055 ceph-mon[31863]: pgmap v7359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:07 smithi086 ceph-mon[35163]: pgmap v7360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:07 smithi159 ceph-mon[36109]: pgmap v7360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:07 smithi055 ceph-mon[31863]: pgmap v7360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12368.016987 secs 2024-03-28T09:26:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12368.016987 secs 2024-03-28T09:26:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12368.016987 secs 2024-03-28T09:26:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:09 smithi086 ceph-mon[35163]: pgmap v7361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:26:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:09 smithi159 ceph-mon[36109]: pgmap v7361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:26:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:09 smithi055 ceph-mon[31863]: pgmap v7361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:26:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:26:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:26:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:26:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:26:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:26:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:26:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:26:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:26:10.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:26:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:11 smithi086 ceph-mon[35163]: pgmap v7362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:11 smithi159 ceph-mon[36109]: pgmap v7362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:11 smithi055 ceph-mon[31863]: pgmap v7362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:13 smithi086 ceph-mon[35163]: pgmap v7363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12373.017054 secs 2024-03-28T09:26:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:13 smithi159 ceph-mon[36109]: pgmap v7363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12373.017054 secs 2024-03-28T09:26:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:13 smithi055 ceph-mon[31863]: pgmap v7363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12373.017054 secs 2024-03-28T09:26:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:15 smithi086 ceph-mon[35163]: pgmap v7364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:15 smithi159 ceph-mon[36109]: pgmap v7364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:15 smithi055 ceph-mon[31863]: pgmap v7364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:17 smithi086 ceph-mon[35163]: pgmap v7365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:17 smithi159 ceph-mon[36109]: pgmap v7365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:17 smithi055 ceph-mon[31863]: pgmap v7365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12378.017119 secs 2024-03-28T09:26:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12378.017119 secs 2024-03-28T09:26:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12378.017119 secs 2024-03-28T09:26:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:19 smithi055 ceph-mon[31863]: pgmap v7366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:19 smithi086 ceph-mon[35163]: pgmap v7366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:19 smithi159 ceph-mon[36109]: pgmap v7366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:20 smithi055 ceph-mon[31863]: pgmap v7367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:20 smithi086 ceph-mon[35163]: pgmap v7367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:20 smithi159 ceph-mon[36109]: pgmap v7367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:23 smithi086 ceph-mon[35163]: pgmap v7368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12383.017204 secs 2024-03-28T09:26:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:23 smithi159 ceph-mon[36109]: pgmap v7368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12383.017204 secs 2024-03-28T09:26:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:23 smithi055 ceph-mon[31863]: pgmap v7368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12383.017204 secs 2024-03-28T09:26:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:25 smithi086 ceph-mon[35163]: pgmap v7369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:25 smithi159 ceph-mon[36109]: pgmap v7369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:25 smithi055 ceph-mon[31863]: pgmap v7369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:27 smithi086 ceph-mon[35163]: pgmap v7370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:27 smithi159 ceph-mon[36109]: pgmap v7370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:27 smithi055 ceph-mon[31863]: pgmap v7370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12388.017324 secs 2024-03-28T09:26:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12388.017324 secs 2024-03-28T09:26:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12388.017324 secs 2024-03-28T09:26:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:29 smithi086 ceph-mon[35163]: pgmap v7371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:29 smithi159 ceph-mon[36109]: pgmap v7371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:29 smithi055 ceph-mon[31863]: pgmap v7371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:31 smithi086 ceph-mon[35163]: pgmap v7372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:31 smithi159 ceph-mon[36109]: pgmap v7372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:31 smithi055 ceph-mon[31863]: pgmap v7372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:33 smithi055 ceph-mon[31863]: pgmap v7373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:33.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12393.017443 secs 2024-03-28T09:26:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:33 smithi086 ceph-mon[35163]: pgmap v7373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12393.017443 secs 2024-03-28T09:26:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:33 smithi159 ceph-mon[36109]: pgmap v7373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12393.017443 secs 2024-03-28T09:26:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:35 smithi055 ceph-mon[31863]: pgmap v7374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:35 smithi086 ceph-mon[35163]: pgmap v7374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:35 smithi159 ceph-mon[36109]: pgmap v7374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:37 smithi055 ceph-mon[31863]: pgmap v7375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:37 smithi086 ceph-mon[35163]: pgmap v7375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:37 smithi159 ceph-mon[36109]: pgmap v7375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12398.017564 secs 2024-03-28T09:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12398.017564 secs 2024-03-28T09:26:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12398.017564 secs 2024-03-28T09:26:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:39 smithi055 ceph-mon[31863]: pgmap v7376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:39 smithi086 ceph-mon[35163]: pgmap v7376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:39 smithi159 ceph-mon[36109]: pgmap v7376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:41 smithi055 ceph-mon[31863]: pgmap v7377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:26:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:41 smithi086 ceph-mon[35163]: pgmap v7377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:26:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:41 smithi159 ceph-mon[36109]: pgmap v7377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:26:43.624 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:43 smithi159 ceph-mon[36109]: pgmap v7378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:43.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12403.017680 secs 2024-03-28T09:26:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:43 smithi086 ceph-mon[35163]: pgmap v7378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12403.017680 secs 2024-03-28T09:26:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:43 smithi055 ceph-mon[31863]: pgmap v7378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:26:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12403.017680 secs 2024-03-28T09:26:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:45 smithi086 ceph-mon[35163]: pgmap v7379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:45 smithi159 ceph-mon[36109]: pgmap v7379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:45 smithi055 ceph-mon[31863]: pgmap v7379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:47 smithi086 ceph-mon[35163]: pgmap v7380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:47 smithi159 ceph-mon[36109]: pgmap v7380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:47 smithi055 ceph-mon[31863]: pgmap v7380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12408.017804 secs 2024-03-28T09:26:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12408.017804 secs 2024-03-28T09:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12408.017804 secs 2024-03-28T09:26:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:49 smithi086 ceph-mon[35163]: pgmap v7381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:49 smithi159 ceph-mon[36109]: pgmap v7381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:49 smithi055 ceph-mon[31863]: pgmap v7381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:51 smithi086 ceph-mon[35163]: pgmap v7382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:51 smithi159 ceph-mon[36109]: pgmap v7382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:51 smithi055 ceph-mon[31863]: pgmap v7382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:26:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:53 smithi086 ceph-mon[35163]: pgmap v7383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12413.017868 secs 2024-03-28T09:26:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:53 smithi159 ceph-mon[36109]: pgmap v7383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12413.017868 secs 2024-03-28T09:26:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:53 smithi055 ceph-mon[31863]: pgmap v7383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12413.017868 secs 2024-03-28T09:26:55.675 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:55 smithi055 ceph-mon[31863]: pgmap v7384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:55 smithi086 ceph-mon[35163]: pgmap v7384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:55 smithi159 ceph-mon[36109]: pgmap v7384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:57 smithi086 ceph-mon[35163]: pgmap v7385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:57 smithi159 ceph-mon[36109]: pgmap v7385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:57 smithi055 ceph-mon[31863]: pgmap v7385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12418.017932 secs 2024-03-28T09:26:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12418.017932 secs 2024-03-28T09:26:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12418.017932 secs 2024-03-28T09:26:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:26:59 smithi086 ceph-mon[35163]: pgmap v7386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:26:59 smithi159 ceph-mon[36109]: pgmap v7386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:26:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:26:59 smithi055 ceph-mon[31863]: pgmap v7386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:01 smithi086 ceph-mon[35163]: pgmap v7387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:01 smithi159 ceph-mon[36109]: pgmap v7387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:01 smithi055 ceph-mon[31863]: pgmap v7387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:03 smithi086 ceph-mon[35163]: pgmap v7388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12423.018055 secs 2024-03-28T09:27:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:03 smithi159 ceph-mon[36109]: pgmap v7388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12423.018055 secs 2024-03-28T09:27:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:03 smithi055 ceph-mon[31863]: pgmap v7388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12423.018055 secs 2024-03-28T09:27:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:05 smithi086 ceph-mon[35163]: pgmap v7389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:05 smithi159 ceph-mon[36109]: pgmap v7389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:05 smithi055 ceph-mon[31863]: pgmap v7389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:07 smithi086 ceph-mon[35163]: pgmap v7390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:07 smithi159 ceph-mon[36109]: pgmap v7390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:07 smithi055 ceph-mon[31863]: pgmap v7390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12428.018125 secs 2024-03-28T09:27:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12428.018125 secs 2024-03-28T09:27:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12428.018125 secs 2024-03-28T09:27:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:09 smithi086 ceph-mon[35163]: pgmap v7391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:09 smithi159 ceph-mon[36109]: pgmap v7391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:09 smithi055 ceph-mon[31863]: pgmap v7391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:11 smithi086 ceph-mon[35163]: pgmap v7392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:27:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:11 smithi159 ceph-mon[36109]: pgmap v7392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:27:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:11 smithi055 ceph-mon[31863]: pgmap v7392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:27:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:27:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:27:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:27:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:27:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:27:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:27:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:27:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:27:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:27:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:13 smithi086 ceph-mon[35163]: pgmap v7393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:13 smithi086 ceph-mon[35163]: pgmap v7394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12433.018190 secs 2024-03-28T09:27:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:13 smithi159 ceph-mon[36109]: pgmap v7393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:13 smithi159 ceph-mon[36109]: pgmap v7394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12433.018190 secs 2024-03-28T09:27:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:13 smithi055 ceph-mon[31863]: pgmap v7393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:13 smithi055 ceph-mon[31863]: pgmap v7394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12433.018190 secs 2024-03-28T09:27:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:15 smithi086 ceph-mon[35163]: pgmap v7395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:15 smithi159 ceph-mon[36109]: pgmap v7395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:15 smithi055 ceph-mon[31863]: pgmap v7395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:17 smithi086 ceph-mon[35163]: pgmap v7396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:17 smithi159 ceph-mon[36109]: pgmap v7396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:17 smithi055 ceph-mon[31863]: pgmap v7396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12438.018255 secs 2024-03-28T09:27:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12438.018255 secs 2024-03-28T09:27:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12438.018255 secs 2024-03-28T09:27:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:19 smithi086 ceph-mon[35163]: pgmap v7397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:19 smithi159 ceph-mon[36109]: pgmap v7397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:19 smithi055 ceph-mon[31863]: pgmap v7397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:21 smithi086 ceph-mon[35163]: pgmap v7398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:21 smithi159 ceph-mon[36109]: pgmap v7398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:21 smithi055 ceph-mon[31863]: pgmap v7398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:27:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:23 smithi086 ceph-mon[35163]: pgmap v7399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:27:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12443.018341 secs 2024-03-28T09:27:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:23 smithi159 ceph-mon[36109]: pgmap v7399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:27:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12443.018341 secs 2024-03-28T09:27:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:23 smithi055 ceph-mon[31863]: pgmap v7399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:27:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12443.018341 secs 2024-03-28T09:27:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:25 smithi159 ceph-mon[36109]: pgmap v7400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:25 smithi055 ceph-mon[31863]: pgmap v7400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:25 smithi086 ceph-mon[35163]: pgmap v7400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:27 smithi055 ceph-mon[31863]: pgmap v7401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:27 smithi086 ceph-mon[35163]: pgmap v7401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:27 smithi159 ceph-mon[36109]: pgmap v7401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12448.018428 secs 2024-03-28T09:27:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12448.018428 secs 2024-03-28T09:27:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12448.018428 secs 2024-03-28T09:27:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:29 smithi055 ceph-mon[31863]: pgmap v7402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:29 smithi086 ceph-mon[35163]: pgmap v7402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:29 smithi159 ceph-mon[36109]: pgmap v7402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:30 smithi055 ceph-mon[31863]: pgmap v7403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:30 smithi086 ceph-mon[35163]: pgmap v7403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:30 smithi159 ceph-mon[36109]: pgmap v7403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:33 smithi055 ceph-mon[31863]: pgmap v7404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:33 smithi086 ceph-mon[35163]: pgmap v7404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:33 smithi159 ceph-mon[36109]: pgmap v7404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12453.018548 secs 2024-03-28T09:27:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12453.018548 secs 2024-03-28T09:27:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12453.018548 secs 2024-03-28T09:27:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:35 smithi055 ceph-mon[31863]: pgmap v7405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:35 smithi086 ceph-mon[35163]: pgmap v7405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:35 smithi159 ceph-mon[36109]: pgmap v7405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:37 smithi086 ceph-mon[35163]: pgmap v7406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:37 smithi159 ceph-mon[36109]: pgmap v7406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:37 smithi055 ceph-mon[31863]: pgmap v7406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12458.018673 secs 2024-03-28T09:27:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:39 smithi086 ceph-mon[35163]: pgmap v7407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12458.018673 secs 2024-03-28T09:27:39.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:39 smithi159 ceph-mon[36109]: pgmap v7407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12458.018673 secs 2024-03-28T09:27:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:39 smithi055 ceph-mon[31863]: pgmap v7407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:41 smithi086 ceph-mon[35163]: pgmap v7408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:41 smithi159 ceph-mon[36109]: pgmap v7408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:41 smithi055 ceph-mon[31863]: pgmap v7408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:43 smithi086 ceph-mon[35163]: pgmap v7409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:43 smithi159 ceph-mon[36109]: pgmap v7409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:43 smithi055 ceph-mon[31863]: pgmap v7409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12463.018806 secs 2024-03-28T09:27:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12463.018806 secs 2024-03-28T09:27:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12463.018806 secs 2024-03-28T09:27:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:45 smithi086 ceph-mon[35163]: pgmap v7410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:45 smithi159 ceph-mon[36109]: pgmap v7410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:45 smithi055 ceph-mon[31863]: pgmap v7410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:47 smithi086 ceph-mon[35163]: pgmap v7411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:47 smithi159 ceph-mon[36109]: pgmap v7411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:47 smithi055 ceph-mon[31863]: pgmap v7411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12468.018925 secs 2024-03-28T09:27:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:49 smithi086 ceph-mon[35163]: pgmap v7412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12468.018925 secs 2024-03-28T09:27:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:49 smithi159 ceph-mon[36109]: pgmap v7412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12468.018925 secs 2024-03-28T09:27:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:49 smithi055 ceph-mon[31863]: pgmap v7412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:51 smithi086 ceph-mon[35163]: pgmap v7413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:51 smithi159 ceph-mon[36109]: pgmap v7413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:51 smithi055 ceph-mon[31863]: pgmap v7413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:27:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:53 smithi086 ceph-mon[35163]: pgmap v7414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:53 smithi159 ceph-mon[36109]: pgmap v7414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:53 smithi055 ceph-mon[31863]: pgmap v7414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12473.019041 secs 2024-03-28T09:27:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12473.019041 secs 2024-03-28T09:27:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12473.019041 secs 2024-03-28T09:27:55.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:55 smithi055 ceph-mon[31863]: pgmap v7415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:55 smithi086 ceph-mon[35163]: pgmap v7415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:55 smithi159 ceph-mon[36109]: pgmap v7415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:57 smithi086 ceph-mon[35163]: pgmap v7416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:57 smithi159 ceph-mon[36109]: pgmap v7416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:57 smithi055 ceph-mon[31863]: pgmap v7416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12478.019128 secs 2024-03-28T09:27:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:27:59 smithi086 ceph-mon[35163]: pgmap v7417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12478.019128 secs 2024-03-28T09:27:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:27:59 smithi159 ceph-mon[36109]: pgmap v7417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:27:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12478.019128 secs 2024-03-28T09:27:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:27:59 smithi055 ceph-mon[31863]: pgmap v7417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:01 smithi086 ceph-mon[35163]: pgmap v7418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:01 smithi159 ceph-mon[36109]: pgmap v7418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:01 smithi055 ceph-mon[31863]: pgmap v7418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:03 smithi086 ceph-mon[35163]: pgmap v7419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:03 smithi159 ceph-mon[36109]: pgmap v7419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:03 smithi055 ceph-mon[31863]: pgmap v7419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12483.019251 secs 2024-03-28T09:28:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12483.019251 secs 2024-03-28T09:28:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12483.019251 secs 2024-03-28T09:28:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:05 smithi086 ceph-mon[35163]: pgmap v7420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:05 smithi159 ceph-mon[36109]: pgmap v7420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:05 smithi055 ceph-mon[31863]: pgmap v7420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:06 smithi086 ceph-mon[35163]: pgmap v7421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:06 smithi159 ceph-mon[36109]: pgmap v7421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:06 smithi055 ceph-mon[31863]: pgmap v7421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12488.019313 secs 2024-03-28T09:28:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:09 smithi086 ceph-mon[35163]: pgmap v7422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12488.019313 secs 2024-03-28T09:28:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:09 smithi159 ceph-mon[36109]: pgmap v7422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12488.019313 secs 2024-03-28T09:28:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:09 smithi055 ceph-mon[31863]: pgmap v7422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:11 smithi086 ceph-mon[35163]: pgmap v7423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:11 smithi159 ceph-mon[36109]: pgmap v7423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:11 smithi055 ceph-mon[31863]: pgmap v7423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:13 smithi086 ceph-mon[35163]: pgmap v7424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:28:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:13 smithi159 ceph-mon[36109]: pgmap v7424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:28:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:13 smithi055 ceph-mon[31863]: pgmap v7424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:28:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12493.019380 secs 2024-03-28T09:28:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:28:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:28:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:28:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12493.019380 secs 2024-03-28T09:28:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:28:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:28:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:28:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12493.019380 secs 2024-03-28T09:28:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:28:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:28:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:28:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:15 smithi086 ceph-mon[35163]: pgmap v7425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:15 smithi086 ceph-mon[35163]: pgmap v7426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:15 smithi159 ceph-mon[36109]: pgmap v7425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:15 smithi159 ceph-mon[36109]: pgmap v7426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:15 smithi055 ceph-mon[31863]: pgmap v7425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:15 smithi055 ceph-mon[31863]: pgmap v7426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:17 smithi086 ceph-mon[35163]: pgmap v7427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:17 smithi159 ceph-mon[36109]: pgmap v7427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:17 smithi055 ceph-mon[31863]: pgmap v7427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12498.019445 secs 2024-03-28T09:28:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:19 smithi086 ceph-mon[35163]: pgmap v7428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12498.019445 secs 2024-03-28T09:28:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:19 smithi159 ceph-mon[36109]: pgmap v7428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12498.019445 secs 2024-03-28T09:28:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:19 smithi055 ceph-mon[31863]: pgmap v7428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:21 smithi086 ceph-mon[35163]: pgmap v7429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:21 smithi159 ceph-mon[36109]: pgmap v7429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:21 smithi055 ceph-mon[31863]: pgmap v7429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:23 smithi086 ceph-mon[35163]: pgmap v7430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:23 smithi159 ceph-mon[36109]: pgmap v7430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:23 smithi055 ceph-mon[31863]: pgmap v7430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:28:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12503.019510 secs 2024-03-28T09:28:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12503.019510 secs 2024-03-28T09:28:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12503.019510 secs 2024-03-28T09:28:25.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:25 smithi055 ceph-mon[31863]: pgmap v7431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:28:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:25 smithi086 ceph-mon[35163]: pgmap v7431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:28:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:25 smithi159 ceph-mon[36109]: pgmap v7431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:28:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:27 smithi086 ceph-mon[35163]: pgmap v7432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:27 smithi159 ceph-mon[36109]: pgmap v7432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:27 smithi055 ceph-mon[31863]: pgmap v7432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12508.019592 secs 2024-03-28T09:28:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:29 smithi086 ceph-mon[35163]: pgmap v7433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12508.019592 secs 2024-03-28T09:28:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:29 smithi159 ceph-mon[36109]: pgmap v7433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12508.019592 secs 2024-03-28T09:28:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:29 smithi055 ceph-mon[31863]: pgmap v7433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:31 smithi086 ceph-mon[35163]: pgmap v7434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:31.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:31 smithi159 ceph-mon[36109]: pgmap v7434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:31 smithi055 ceph-mon[31863]: pgmap v7434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:33 smithi086 ceph-mon[35163]: pgmap v7435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:33 smithi159 ceph-mon[36109]: pgmap v7435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:33 smithi055 ceph-mon[31863]: pgmap v7435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12513.019669 secs 2024-03-28T09:28:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12513.019669 secs 2024-03-28T09:28:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12513.019669 secs 2024-03-28T09:28:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:35 smithi086 ceph-mon[35163]: pgmap v7436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:35 smithi159 ceph-mon[36109]: pgmap v7436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:35 smithi055 ceph-mon[31863]: pgmap v7436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:37 smithi086 ceph-mon[35163]: pgmap v7437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:37 smithi159 ceph-mon[36109]: pgmap v7437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:37 smithi055 ceph-mon[31863]: pgmap v7437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12518.019734 secs 2024-03-28T09:28:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:39 smithi086 ceph-mon[35163]: pgmap v7438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12518.019734 secs 2024-03-28T09:28:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:39 smithi159 ceph-mon[36109]: pgmap v7438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12518.019734 secs 2024-03-28T09:28:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:39 smithi055 ceph-mon[31863]: pgmap v7438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:41 smithi086 ceph-mon[35163]: pgmap v7439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:41 smithi159 ceph-mon[36109]: pgmap v7439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:41 smithi055 ceph-mon[31863]: pgmap v7439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:43 smithi086 ceph-mon[35163]: pgmap v7440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:43 smithi159 ceph-mon[36109]: pgmap v7440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:43 smithi055 ceph-mon[31863]: pgmap v7440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12523.019860 secs 2024-03-28T09:28:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12523.019860 secs 2024-03-28T09:28:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12523.019860 secs 2024-03-28T09:28:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:45 smithi086 ceph-mon[35163]: pgmap v7441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:45 smithi159 ceph-mon[36109]: pgmap v7441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:45 smithi055 ceph-mon[31863]: pgmap v7441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:47 smithi086 ceph-mon[35163]: pgmap v7442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:47 smithi159 ceph-mon[36109]: pgmap v7442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:47 smithi055 ceph-mon[31863]: pgmap v7442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12528.019948 secs 2024-03-28T09:28:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12528.019948 secs 2024-03-28T09:28:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12528.019948 secs 2024-03-28T09:28:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:49 smithi055 ceph-mon[31863]: pgmap v7443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:49 smithi086 ceph-mon[35163]: pgmap v7443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:49 smithi159 ceph-mon[36109]: pgmap v7443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:51 smithi055 ceph-mon[31863]: pgmap v7444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:51 smithi086 ceph-mon[35163]: pgmap v7444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:51 smithi159 ceph-mon[36109]: pgmap v7444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:28:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:53 smithi055 ceph-mon[31863]: pgmap v7445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12533.020035 secs 2024-03-28T09:28:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:53 smithi086 ceph-mon[35163]: pgmap v7445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12533.020035 secs 2024-03-28T09:28:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:53 smithi159 ceph-mon[36109]: pgmap v7445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12533.020035 secs 2024-03-28T09:28:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:55 smithi055 ceph-mon[31863]: pgmap v7446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:55 smithi086 ceph-mon[35163]: pgmap v7446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:55 smithi159 ceph-mon[36109]: pgmap v7446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:57 smithi055 ceph-mon[31863]: pgmap v7447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:57 smithi086 ceph-mon[35163]: pgmap v7447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:57 smithi159 ceph-mon[36109]: pgmap v7447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12538.020112 secs 2024-03-28T09:28:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12538.020112 secs 2024-03-28T09:28:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12538.020112 secs 2024-03-28T09:28:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:28:59 smithi086 ceph-mon[35163]: pgmap v7448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:28:59 smithi159 ceph-mon[36109]: pgmap v7448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:28:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:28:59 smithi055 ceph-mon[31863]: pgmap v7448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:01 smithi086 ceph-mon[35163]: pgmap v7449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:01 smithi159 ceph-mon[36109]: pgmap v7449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:01 smithi055 ceph-mon[31863]: pgmap v7449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:03 smithi086 ceph-mon[35163]: pgmap v7450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12543.020234 secs 2024-03-28T09:29:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:03 smithi159 ceph-mon[36109]: pgmap v7450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:03.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12543.020234 secs 2024-03-28T09:29:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:03 smithi055 ceph-mon[31863]: pgmap v7450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12543.020234 secs 2024-03-28T09:29:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:05 smithi086 ceph-mon[35163]: pgmap v7451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:05 smithi159 ceph-mon[36109]: pgmap v7451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:05 smithi055 ceph-mon[31863]: pgmap v7451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:07 smithi086 ceph-mon[35163]: pgmap v7452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:07 smithi159 ceph-mon[36109]: pgmap v7452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:07 smithi055 ceph-mon[31863]: pgmap v7452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12548.020358 secs 2024-03-28T09:29:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12548.020358 secs 2024-03-28T09:29:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12548.020358 secs 2024-03-28T09:29:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:09 smithi086 ceph-mon[35163]: pgmap v7453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:09 smithi159 ceph-mon[36109]: pgmap v7453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:09 smithi055 ceph-mon[31863]: pgmap v7453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:11 smithi086 ceph-mon[35163]: pgmap v7454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:11 smithi159 ceph-mon[36109]: pgmap v7454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:11 smithi055 ceph-mon[31863]: pgmap v7454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:13 smithi086 ceph-mon[35163]: pgmap v7455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12553.020445 secs 2024-03-28T09:29:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:13 smithi159 ceph-mon[36109]: pgmap v7455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12553.020445 secs 2024-03-28T09:29:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:13 smithi055 ceph-mon[31863]: pgmap v7455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12553.020445 secs 2024-03-28T09:29:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:29:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:29:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:29:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:15 smithi086 ceph-mon[35163]: pgmap v7456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:15 smithi159 ceph-mon[36109]: pgmap v7456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:15 smithi055 ceph-mon[31863]: pgmap v7456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:29:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:29:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:29:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:29:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:29:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:29:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:29:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:29:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:29:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:17 smithi086 ceph-mon[35163]: pgmap v7457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:17 smithi086 ceph-mon[35163]: pgmap v7458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:17 smithi159 ceph-mon[36109]: pgmap v7457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:17 smithi159 ceph-mon[36109]: pgmap v7458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:17 smithi055 ceph-mon[31863]: pgmap v7457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:17 smithi055 ceph-mon[31863]: pgmap v7458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12558.020566 secs 2024-03-28T09:29:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12558.020566 secs 2024-03-28T09:29:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12558.020566 secs 2024-03-28T09:29:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:19 smithi086 ceph-mon[35163]: pgmap v7459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:29:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:19 smithi159 ceph-mon[36109]: pgmap v7459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:29:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:19 smithi055 ceph-mon[31863]: pgmap v7459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:29:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:21 smithi086 ceph-mon[35163]: pgmap v7460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:21 smithi159 ceph-mon[36109]: pgmap v7460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:21 smithi055 ceph-mon[31863]: pgmap v7460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:23 smithi086 ceph-mon[35163]: pgmap v7461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12563.020645 secs 2024-03-28T09:29:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:23 smithi159 ceph-mon[36109]: pgmap v7461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12563.020645 secs 2024-03-28T09:29:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:23 smithi055 ceph-mon[31863]: pgmap v7461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:23.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12563.020645 secs 2024-03-28T09:29:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:25 smithi086 ceph-mon[35163]: pgmap v7462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:25 smithi159 ceph-mon[36109]: pgmap v7462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:25 smithi055 ceph-mon[31863]: pgmap v7462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:27 smithi086 ceph-mon[35163]: pgmap v7463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:29:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:27 smithi159 ceph-mon[36109]: pgmap v7463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:29:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:27 smithi055 ceph-mon[31863]: pgmap v7463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:29:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12568.020768 secs 2024-03-28T09:29:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12568.020768 secs 2024-03-28T09:29:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12568.020768 secs 2024-03-28T09:29:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:29 smithi086 ceph-mon[35163]: pgmap v7464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:29 smithi159 ceph-mon[36109]: pgmap v7464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:29 smithi055 ceph-mon[31863]: pgmap v7464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:31 smithi086 ceph-mon[35163]: pgmap v7465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:31 smithi159 ceph-mon[36109]: pgmap v7465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:31 smithi055 ceph-mon[31863]: pgmap v7465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:33 smithi086 ceph-mon[35163]: pgmap v7466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12573.020848 secs 2024-03-28T09:29:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:33 smithi159 ceph-mon[36109]: pgmap v7466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12573.020848 secs 2024-03-28T09:29:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:33 smithi055 ceph-mon[31863]: pgmap v7466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12573.020848 secs 2024-03-28T09:29:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:35 smithi055 ceph-mon[31863]: pgmap v7467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:35 smithi086 ceph-mon[35163]: pgmap v7467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:35 smithi159 ceph-mon[36109]: pgmap v7467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:37 smithi055 ceph-mon[31863]: pgmap v7468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:37 smithi086 ceph-mon[35163]: pgmap v7468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:37 smithi159 ceph-mon[36109]: pgmap v7468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12578.020972 secs 2024-03-28T09:29:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12578.020972 secs 2024-03-28T09:29:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12578.020972 secs 2024-03-28T09:29:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:39 smithi055 ceph-mon[31863]: pgmap v7469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:39 smithi086 ceph-mon[35163]: pgmap v7469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:39 smithi159 ceph-mon[36109]: pgmap v7469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:41 smithi055 ceph-mon[31863]: pgmap v7470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:41 smithi086 ceph-mon[35163]: pgmap v7470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:41 smithi159 ceph-mon[36109]: pgmap v7470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:42 smithi055 ceph-mon[31863]: pgmap v7471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:42 smithi086 ceph-mon[35163]: pgmap v7471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:42 smithi159 ceph-mon[36109]: pgmap v7471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12583.021052 secs 2024-03-28T09:29:43.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12583.021052 secs 2024-03-28T09:29:43.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12583.021052 secs 2024-03-28T09:29:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:44 smithi086 ceph-mon[35163]: pgmap v7472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:44 smithi159 ceph-mon[36109]: pgmap v7472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:44 smithi055 ceph-mon[31863]: pgmap v7472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:46 smithi086 ceph-mon[35163]: pgmap v7473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:46 smithi159 ceph-mon[36109]: pgmap v7473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:46 smithi055 ceph-mon[31863]: pgmap v7473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12588.021185 secs 2024-03-28T09:29:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:48 smithi086 ceph-mon[35163]: pgmap v7474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12588.021185 secs 2024-03-28T09:29:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:48 smithi159 ceph-mon[36109]: pgmap v7474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12588.021185 secs 2024-03-28T09:29:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:48 smithi055 ceph-mon[31863]: pgmap v7474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:50 smithi086 ceph-mon[35163]: pgmap v7475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:50 smithi159 ceph-mon[36109]: pgmap v7475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:50 smithi055 ceph-mon[31863]: pgmap v7475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:52 smithi086 ceph-mon[35163]: pgmap v7476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:52 smithi159 ceph-mon[36109]: pgmap v7476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:52 smithi055 ceph-mon[31863]: pgmap v7476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12593.021249 secs 2024-03-28T09:29:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12593.021249 secs 2024-03-28T09:29:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12593.021249 secs 2024-03-28T09:29:55.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:54 smithi055 ceph-mon[31863]: pgmap v7477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:54 smithi086 ceph-mon[35163]: pgmap v7477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:54 smithi159 ceph-mon[36109]: pgmap v7477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:29:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:56 smithi086 ceph-mon[35163]: pgmap v7478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:56 smithi159 ceph-mon[36109]: pgmap v7478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:56 smithi055 ceph-mon[31863]: pgmap v7478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:29:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12598.021315 secs 2024-03-28T09:29:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:29:58 smithi086 ceph-mon[35163]: pgmap v7479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12598.021315 secs 2024-03-28T09:29:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:29:58 smithi159 ceph-mon[36109]: pgmap v7479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:29:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12598.021315 secs 2024-03-28T09:29:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:29:58 smithi055 ceph-mon[31863]: pgmap v7479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:00 smithi086 ceph-mon[35163]: pgmap v7480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:30:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:00 smithi159 ceph-mon[36109]: pgmap v7480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:30:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:00 smithi055 ceph-mon[31863]: pgmap v7480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:30:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:02 smithi086 ceph-mon[35163]: pgmap v7481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:02 smithi159 ceph-mon[36109]: pgmap v7481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:02 smithi055 ceph-mon[31863]: pgmap v7481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12603.021432 secs 2024-03-28T09:30:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12603.021432 secs 2024-03-28T09:30:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12603.021432 secs 2024-03-28T09:30:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:04 smithi086 ceph-mon[35163]: pgmap v7482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:04 smithi159 ceph-mon[36109]: pgmap v7482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:04 smithi055 ceph-mon[31863]: pgmap v7482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:06 smithi159 ceph-mon[36109]: pgmap v7483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:06 smithi055 ceph-mon[31863]: pgmap v7483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:06 smithi086 ceph-mon[35163]: pgmap v7483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12608.021550 secs 2024-03-28T09:30:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:08 smithi055 ceph-mon[31863]: pgmap v7484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12608.021550 secs 2024-03-28T09:30:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:08 smithi086 ceph-mon[35163]: pgmap v7484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12608.021550 secs 2024-03-28T09:30:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:08 smithi159 ceph-mon[36109]: pgmap v7484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:10 smithi055 ceph-mon[31863]: pgmap v7485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:10 smithi086 ceph-mon[35163]: pgmap v7485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:10 smithi159 ceph-mon[36109]: pgmap v7485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:13.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:12 smithi086 ceph-mon[35163]: pgmap v7486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:13.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:12 smithi159 ceph-mon[36109]: pgmap v7486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:12 smithi055 ceph-mon[31863]: pgmap v7486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12613.021615 secs 2024-03-28T09:30:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12613.021615 secs 2024-03-28T09:30:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12613.021615 secs 2024-03-28T09:30:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:14 smithi055 ceph-mon[31863]: pgmap v7487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:14 smithi086 ceph-mon[35163]: pgmap v7487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:14 smithi159 ceph-mon[36109]: pgmap v7487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:16 smithi055 ceph-mon[31863]: pgmap v7488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:17.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:30:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:16 smithi086 ceph-mon[35163]: pgmap v7488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:30:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:16 smithi159 ceph-mon[36109]: pgmap v7488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:30:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:30:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:30:18.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:17 smithi055 ceph-mon[31863]: pgmap v7489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:18.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:17 smithi055 ceph-mon[31863]: pgmap v7490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:18.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:30:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:30:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:30:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:17 smithi086 ceph-mon[35163]: pgmap v7489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:17 smithi086 ceph-mon[35163]: pgmap v7490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:17 smithi159 ceph-mon[36109]: pgmap v7489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:17 smithi159 ceph-mon[36109]: pgmap v7490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:30:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12618.021722 secs 2024-03-28T09:30:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12618.021722 secs 2024-03-28T09:30:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12618.021722 secs 2024-03-28T09:30:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:19 smithi086 ceph-mon[35163]: pgmap v7491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:19 smithi159 ceph-mon[36109]: pgmap v7491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:19 smithi055 ceph-mon[31863]: pgmap v7491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:22 smithi086 ceph-mon[35163]: pgmap v7492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:22 smithi159 ceph-mon[36109]: pgmap v7492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:22 smithi055 ceph-mon[31863]: pgmap v7492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12623.021828 secs 2024-03-28T09:30:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12623.021828 secs 2024-03-28T09:30:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12623.021828 secs 2024-03-28T09:30:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:24 smithi086 ceph-mon[35163]: pgmap v7493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:24 smithi159 ceph-mon[36109]: pgmap v7493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:24 smithi055 ceph-mon[31863]: pgmap v7493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:26 smithi086 ceph-mon[35163]: pgmap v7494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:26 smithi159 ceph-mon[36109]: pgmap v7494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:26 smithi055 ceph-mon[31863]: pgmap v7494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:30:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:28 smithi086 ceph-mon[35163]: pgmap v7495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:30:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12628.021872 secs 2024-03-28T09:30:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:28 smithi159 ceph-mon[36109]: pgmap v7495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:30:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12628.021872 secs 2024-03-28T09:30:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:28 smithi055 ceph-mon[31863]: pgmap v7495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:30:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12628.021872 secs 2024-03-28T09:30:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:30 smithi086 ceph-mon[35163]: pgmap v7496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:30 smithi159 ceph-mon[36109]: pgmap v7496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:30 smithi055 ceph-mon[31863]: pgmap v7496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:32 smithi055 ceph-mon[31863]: pgmap v7497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:32 smithi086 ceph-mon[35163]: pgmap v7497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:32 smithi159 ceph-mon[36109]: pgmap v7497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12633.021962 secs 2024-03-28T09:30:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12633.021962 secs 2024-03-28T09:30:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12633.021962 secs 2024-03-28T09:30:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:34 smithi055 ceph-mon[31863]: pgmap v7498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:34 smithi086 ceph-mon[35163]: pgmap v7498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:34 smithi159 ceph-mon[36109]: pgmap v7498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:36 smithi055 ceph-mon[31863]: pgmap v7499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:36 smithi086 ceph-mon[35163]: pgmap v7499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:36 smithi159 ceph-mon[36109]: pgmap v7499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:38 smithi055 ceph-mon[31863]: pgmap v7500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12638.022084 secs 2024-03-28T09:30:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:38 smithi086 ceph-mon[35163]: pgmap v7500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12638.022084 secs 2024-03-28T09:30:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:38 smithi159 ceph-mon[36109]: pgmap v7500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12638.022084 secs 2024-03-28T09:30:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:40 smithi055 ceph-mon[31863]: pgmap v7501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:40 smithi086 ceph-mon[35163]: pgmap v7501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:40 smithi159 ceph-mon[36109]: pgmap v7501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:41 smithi086 ceph-mon[35163]: pgmap v7502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:41 smithi159 ceph-mon[36109]: pgmap v7502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:41 smithi055 ceph-mon[31863]: pgmap v7502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12643.022207 secs 2024-03-28T09:30:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12643.022207 secs 2024-03-28T09:30:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12643.022207 secs 2024-03-28T09:30:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:44 smithi055 ceph-mon[31863]: pgmap v7503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:44 smithi086 ceph-mon[35163]: pgmap v7503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:44 smithi159 ceph-mon[36109]: pgmap v7503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:46 smithi086 ceph-mon[35163]: pgmap v7504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:46 smithi159 ceph-mon[36109]: pgmap v7504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:46 smithi055 ceph-mon[31863]: pgmap v7504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:48 smithi086 ceph-mon[35163]: pgmap v7505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12648.022326 secs 2024-03-28T09:30:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:48 smithi159 ceph-mon[36109]: pgmap v7505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12648.022326 secs 2024-03-28T09:30:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:48 smithi055 ceph-mon[31863]: pgmap v7505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12648.022326 secs 2024-03-28T09:30:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:50 smithi086 ceph-mon[35163]: pgmap v7506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:50 smithi159 ceph-mon[36109]: pgmap v7506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:50 smithi055 ceph-mon[31863]: pgmap v7506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:52 smithi086 ceph-mon[35163]: pgmap v7507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:52 smithi159 ceph-mon[36109]: pgmap v7507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:52 smithi055 ceph-mon[31863]: pgmap v7507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12653.022449 secs 2024-03-28T09:30:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12653.022449 secs 2024-03-28T09:30:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12653.022449 secs 2024-03-28T09:30:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:54 smithi159 ceph-mon[36109]: pgmap v7508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:54 smithi055 ceph-mon[31863]: pgmap v7508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:54 smithi086 ceph-mon[35163]: pgmap v7508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:30:56.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:56 smithi159 ceph-mon[36109]: pgmap v7509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:56 smithi055 ceph-mon[31863]: pgmap v7509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:56 smithi086 ceph-mon[35163]: pgmap v7509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:30:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:58 smithi055 ceph-mon[31863]: pgmap v7510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:58.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:30:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12658.022568 secs 2024-03-28T09:30:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:58 smithi086 ceph-mon[35163]: pgmap v7510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:30:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12658.022568 secs 2024-03-28T09:30:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:58 smithi159 ceph-mon[36109]: pgmap v7510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:30:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:30:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12658.022568 secs 2024-03-28T09:31:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:00 smithi055 ceph-mon[31863]: pgmap v7511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:00 smithi086 ceph-mon[35163]: pgmap v7511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:00 smithi159 ceph-mon[36109]: pgmap v7511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:02 smithi055 ceph-mon[31863]: pgmap v7512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:02 smithi086 ceph-mon[35163]: pgmap v7512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:02 smithi159 ceph-mon[36109]: pgmap v7512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12663.022646 secs 2024-03-28T09:31:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12663.022646 secs 2024-03-28T09:31:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12663.022646 secs 2024-03-28T09:31:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:04 smithi055 ceph-mon[31863]: pgmap v7513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:04 smithi086 ceph-mon[35163]: pgmap v7513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:04 smithi159 ceph-mon[36109]: pgmap v7513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:06 smithi055 ceph-mon[31863]: pgmap v7514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:06 smithi086 ceph-mon[35163]: pgmap v7514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:06 smithi159 ceph-mon[36109]: pgmap v7514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:08 smithi055 ceph-mon[31863]: pgmap v7515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12668.022760 secs 2024-03-28T09:31:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:08 smithi086 ceph-mon[35163]: pgmap v7515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12668.022760 secs 2024-03-28T09:31:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:08 smithi159 ceph-mon[36109]: pgmap v7515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12668.022760 secs 2024-03-28T09:31:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:09 smithi086 ceph-mon[35163]: pgmap v7516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:09 smithi159 ceph-mon[36109]: pgmap v7516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:09 smithi055 ceph-mon[31863]: pgmap v7516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:12 smithi086 ceph-mon[35163]: pgmap v7517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:12 smithi159 ceph-mon[36109]: pgmap v7517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:12 smithi055 ceph-mon[31863]: pgmap v7517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12673.022805 secs 2024-03-28T09:31:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12673.022805 secs 2024-03-28T09:31:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12673.022805 secs 2024-03-28T09:31:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:14 smithi086 ceph-mon[35163]: pgmap v7518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:14 smithi159 ceph-mon[36109]: pgmap v7518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:14 smithi055 ceph-mon[31863]: pgmap v7518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:16 smithi086 ceph-mon[35163]: pgmap v7519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:16 smithi159 ceph-mon[36109]: pgmap v7519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:16 smithi055 ceph-mon[31863]: pgmap v7519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:31:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:18 smithi159 ceph-mon[36109]: pgmap v7520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12678.022918 secs 2024-03-28T09:31:18.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:31:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:18 smithi055 ceph-mon[31863]: pgmap v7520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12678.022918 secs 2024-03-28T09:31:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:31:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:18 smithi086 ceph-mon[35163]: pgmap v7520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12678.022918 secs 2024-03-28T09:31:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:31:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:31:19.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:31:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:31:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:31:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:31:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:31:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:31:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:31:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:31:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:31:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:31:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:31:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:31:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: pgmap v7521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:20 smithi055 ceph-mon[31863]: pgmap v7522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:31:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:31:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:31:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:31:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: pgmap v7521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:20 smithi086 ceph-mon[35163]: pgmap v7522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: pgmap v7521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:20 smithi159 ceph-mon[36109]: pgmap v7522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:22 smithi055 ceph-mon[31863]: pgmap v7523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:22 smithi086 ceph-mon[35163]: pgmap v7523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:22 smithi159 ceph-mon[36109]: pgmap v7523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12683.022985 secs 2024-03-28T09:31:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12683.022985 secs 2024-03-28T09:31:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12683.022985 secs 2024-03-28T09:31:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:24 smithi055 ceph-mon[31863]: pgmap v7524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:24 smithi086 ceph-mon[35163]: pgmap v7524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:24 smithi159 ceph-mon[36109]: pgmap v7524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:26 smithi055 ceph-mon[31863]: pgmap v7525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:31:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:26 smithi086 ceph-mon[35163]: pgmap v7525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:31:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:26 smithi159 ceph-mon[36109]: pgmap v7525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:31:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:28 smithi055 ceph-mon[31863]: pgmap v7526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:28.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12688.023050 secs 2024-03-28T09:31:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:28 smithi086 ceph-mon[35163]: pgmap v7526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12688.023050 secs 2024-03-28T09:31:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:28 smithi159 ceph-mon[36109]: pgmap v7526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:31:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12688.023050 secs 2024-03-28T09:31:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:30 smithi086 ceph-mon[35163]: pgmap v7527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:30 smithi159 ceph-mon[36109]: pgmap v7527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:30 smithi055 ceph-mon[31863]: pgmap v7527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:31 smithi086 ceph-mon[35163]: pgmap v7528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:31 smithi159 ceph-mon[36109]: pgmap v7528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:31 smithi055 ceph-mon[31863]: pgmap v7528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12693.023168 secs 2024-03-28T09:31:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12693.023168 secs 2024-03-28T09:31:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12693.023168 secs 2024-03-28T09:31:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:34 smithi055 ceph-mon[31863]: pgmap v7529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:34 smithi086 ceph-mon[35163]: pgmap v7529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:34 smithi159 ceph-mon[36109]: pgmap v7529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:36 smithi055 ceph-mon[31863]: pgmap v7530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:31:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:36 smithi086 ceph-mon[35163]: pgmap v7530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:31:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:36 smithi159 ceph-mon[36109]: pgmap v7530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:31:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:38 smithi086 ceph-mon[35163]: pgmap v7531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12698.023245 secs 2024-03-28T09:31:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:38 smithi159 ceph-mon[36109]: pgmap v7531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12698.023245 secs 2024-03-28T09:31:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:38 smithi055 ceph-mon[31863]: pgmap v7531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12698.023245 secs 2024-03-28T09:31:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:40 smithi086 ceph-mon[35163]: pgmap v7532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:40 smithi159 ceph-mon[36109]: pgmap v7532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:40 smithi055 ceph-mon[31863]: pgmap v7532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:42 smithi086 ceph-mon[35163]: pgmap v7533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:42 smithi159 ceph-mon[36109]: pgmap v7533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:42 smithi055 ceph-mon[31863]: pgmap v7533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:43.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12703.023367 secs 2024-03-28T09:31:43.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12703.023367 secs 2024-03-28T09:31:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12703.023367 secs 2024-03-28T09:31:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:44 smithi086 ceph-mon[35163]: pgmap v7534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:44 smithi159 ceph-mon[36109]: pgmap v7534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:44 smithi055 ceph-mon[31863]: pgmap v7534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:31:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:46 smithi086 ceph-mon[35163]: pgmap v7535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:46 smithi159 ceph-mon[36109]: pgmap v7535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:46 smithi055 ceph-mon[31863]: pgmap v7535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:48 smithi086 ceph-mon[35163]: pgmap v7536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12708.023433 secs 2024-03-28T09:31:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:48 smithi159 ceph-mon[36109]: pgmap v7536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12708.023433 secs 2024-03-28T09:31:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:48 smithi055 ceph-mon[31863]: pgmap v7536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12708.023433 secs 2024-03-28T09:31:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:50 smithi086 ceph-mon[35163]: pgmap v7537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:50 smithi159 ceph-mon[36109]: pgmap v7537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:50 smithi055 ceph-mon[31863]: pgmap v7537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:52 smithi086 ceph-mon[35163]: pgmap v7538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:52 smithi159 ceph-mon[36109]: pgmap v7538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:52 smithi055 ceph-mon[31863]: pgmap v7538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12713.023506 secs 2024-03-28T09:31:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12713.023506 secs 2024-03-28T09:31:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12713.023506 secs 2024-03-28T09:31:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:54 smithi086 ceph-mon[35163]: pgmap v7539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:54 smithi159 ceph-mon[36109]: pgmap v7539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:54 smithi055 ceph-mon[31863]: pgmap v7539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:56 smithi086 ceph-mon[35163]: pgmap v7540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:56 smithi159 ceph-mon[36109]: pgmap v7540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:56 smithi055 ceph-mon[31863]: pgmap v7540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:31:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:58 smithi086 ceph-mon[35163]: pgmap v7541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12718.023625 secs 2024-03-28T09:31:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:58 smithi159 ceph-mon[36109]: pgmap v7541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12718.023625 secs 2024-03-28T09:31:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:58 smithi055 ceph-mon[31863]: pgmap v7541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:31:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12718.023625 secs 2024-03-28T09:32:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:00 smithi086 ceph-mon[35163]: pgmap v7542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:00 smithi159 ceph-mon[36109]: pgmap v7542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:00 smithi055 ceph-mon[31863]: pgmap v7542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:02 smithi086 ceph-mon[35163]: pgmap v7543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:02 smithi159 ceph-mon[36109]: pgmap v7543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:02 smithi055 ceph-mon[31863]: pgmap v7543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12723.023747 secs 2024-03-28T09:32:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12723.023747 secs 2024-03-28T09:32:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12723.023747 secs 2024-03-28T09:32:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:04 smithi086 ceph-mon[35163]: pgmap v7544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:04 smithi159 ceph-mon[36109]: pgmap v7544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:04 smithi055 ceph-mon[31863]: pgmap v7544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:06 smithi086 ceph-mon[35163]: pgmap v7545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:06 smithi159 ceph-mon[36109]: pgmap v7545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:06 smithi055 ceph-mon[31863]: pgmap v7545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:08 smithi086 ceph-mon[35163]: pgmap v7546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12728.023871 secs 2024-03-28T09:32:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:08 smithi159 ceph-mon[36109]: pgmap v7546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12728.023871 secs 2024-03-28T09:32:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:08 smithi055 ceph-mon[31863]: pgmap v7546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12728.023871 secs 2024-03-28T09:32:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:10 smithi086 ceph-mon[35163]: pgmap v7547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:10 smithi159 ceph-mon[36109]: pgmap v7547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:10 smithi055 ceph-mon[31863]: pgmap v7547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:12 smithi086 ceph-mon[35163]: pgmap v7548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:12 smithi159 ceph-mon[36109]: pgmap v7548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:12 smithi055 ceph-mon[31863]: pgmap v7548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12733.023953 secs 2024-03-28T09:32:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12733.023953 secs 2024-03-28T09:32:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12733.023953 secs 2024-03-28T09:32:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:14 smithi055 ceph-mon[31863]: pgmap v7549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:14 smithi086 ceph-mon[35163]: pgmap v7549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:14 smithi159 ceph-mon[36109]: pgmap v7549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:16 smithi055 ceph-mon[31863]: pgmap v7550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:16 smithi086 ceph-mon[35163]: pgmap v7550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:16 smithi159 ceph-mon[36109]: pgmap v7550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:18 smithi055 ceph-mon[31863]: pgmap v7551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12738.024019 secs 2024-03-28T09:32:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:18 smithi086 ceph-mon[35163]: pgmap v7551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12738.024019 secs 2024-03-28T09:32:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:18 smithi159 ceph-mon[36109]: pgmap v7551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12738.024019 secs 2024-03-28T09:32:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:20 smithi055 ceph-mon[31863]: pgmap v7552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:32:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:20 smithi086 ceph-mon[35163]: pgmap v7552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:32:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:20 smithi159 ceph-mon[36109]: pgmap v7552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:32:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:32:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:32:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:32:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:32:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:32:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:32:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:32:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:32:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:22 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:32:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:22 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:32:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:22 smithi055 ceph-mon[31863]: pgmap v7553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:22.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:22 smithi055 ceph-mon[31863]: pgmap v7554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:22 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:32:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:22 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:32:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:22 smithi086 ceph-mon[35163]: pgmap v7553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:22 smithi086 ceph-mon[35163]: pgmap v7554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:22 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:32:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:22 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:32:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:22 smithi159 ceph-mon[36109]: pgmap v7553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:22 smithi159 ceph-mon[36109]: pgmap v7554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12743.024140 secs 2024-03-28T09:32:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12743.024140 secs 2024-03-28T09:32:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12743.024140 secs 2024-03-28T09:32:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:24 smithi086 ceph-mon[35163]: pgmap v7555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:24 smithi159 ceph-mon[36109]: pgmap v7555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:24 smithi055 ceph-mon[31863]: pgmap v7555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:26.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:26 smithi055 ceph-mon[31863]: pgmap v7556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:26 smithi086 ceph-mon[35163]: pgmap v7556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:26 smithi159 ceph-mon[36109]: pgmap v7556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:32:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:28 smithi086 ceph-mon[35163]: pgmap v7557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12748.024263 secs 2024-03-28T09:32:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:28 smithi159 ceph-mon[36109]: pgmap v7557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12748.024263 secs 2024-03-28T09:32:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:28 smithi055 ceph-mon[31863]: pgmap v7557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12748.024263 secs 2024-03-28T09:32:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:29 smithi086 ceph-mon[35163]: pgmap v7558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:29 smithi159 ceph-mon[36109]: pgmap v7558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:30.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:29 smithi055 ceph-mon[31863]: pgmap v7558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:32:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:32 smithi086 ceph-mon[35163]: pgmap v7559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:32:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:32 smithi159 ceph-mon[36109]: pgmap v7559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:32:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:32 smithi055 ceph-mon[31863]: pgmap v7559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:32:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12753.024325 secs 2024-03-28T09:32:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:34 smithi086 ceph-mon[35163]: pgmap v7560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12753.024325 secs 2024-03-28T09:32:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:34 smithi159 ceph-mon[36109]: pgmap v7560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12753.024325 secs 2024-03-28T09:32:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:34 smithi055 ceph-mon[31863]: pgmap v7560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:36 smithi086 ceph-mon[35163]: pgmap v7561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:36 smithi159 ceph-mon[36109]: pgmap v7561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:36 smithi055 ceph-mon[31863]: pgmap v7561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:38 smithi086 ceph-mon[35163]: pgmap v7562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:38 smithi159 ceph-mon[36109]: pgmap v7562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:38 smithi055 ceph-mon[31863]: pgmap v7562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12758.024390 secs 2024-03-28T09:32:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12758.024390 secs 2024-03-28T09:32:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12758.024390 secs 2024-03-28T09:32:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:40 smithi086 ceph-mon[35163]: pgmap v7563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:40 smithi159 ceph-mon[36109]: pgmap v7563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:40 smithi055 ceph-mon[31863]: pgmap v7563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:42 smithi086 ceph-mon[35163]: pgmap v7564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:42.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:42 smithi159 ceph-mon[36109]: pgmap v7564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:42 smithi055 ceph-mon[31863]: pgmap v7564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12763.024456 secs 2024-03-28T09:32:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:44 smithi086 ceph-mon[35163]: pgmap v7565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12763.024456 secs 2024-03-28T09:32:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:44 smithi159 ceph-mon[36109]: pgmap v7565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12763.024456 secs 2024-03-28T09:32:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:44 smithi055 ceph-mon[31863]: pgmap v7565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:46 smithi086 ceph-mon[35163]: pgmap v7566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:46 smithi159 ceph-mon[36109]: pgmap v7566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:46.626 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:46 smithi055 ceph-mon[31863]: pgmap v7566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:48 smithi086 ceph-mon[35163]: pgmap v7567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:48 smithi159 ceph-mon[36109]: pgmap v7567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:48 smithi055 ceph-mon[31863]: pgmap v7567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12768.024555 secs 2024-03-28T09:32:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12768.024555 secs 2024-03-28T09:32:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12768.024555 secs 2024-03-28T09:32:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:50 smithi086 ceph-mon[35163]: pgmap v7568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:50 smithi159 ceph-mon[36109]: pgmap v7568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:50 smithi055 ceph-mon[31863]: pgmap v7568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:52 smithi086 ceph-mon[35163]: pgmap v7569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:52 smithi159 ceph-mon[36109]: pgmap v7569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:52 smithi055 ceph-mon[31863]: pgmap v7569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12773.024673 secs 2024-03-28T09:32:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:54 smithi086 ceph-mon[35163]: pgmap v7570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12773.024673 secs 2024-03-28T09:32:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:54 smithi159 ceph-mon[36109]: pgmap v7570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12773.024673 secs 2024-03-28T09:32:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:54 smithi055 ceph-mon[31863]: pgmap v7570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:56 smithi086 ceph-mon[35163]: pgmap v7571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:56 smithi159 ceph-mon[36109]: pgmap v7571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:56 smithi055 ceph-mon[31863]: pgmap v7571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:32:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:58 smithi086 ceph-mon[35163]: pgmap v7572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:58 smithi159 ceph-mon[36109]: pgmap v7572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:58 smithi055 ceph-mon[31863]: pgmap v7572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:32:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:32:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12778.024831 secs 2024-03-28T09:32:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:32:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12778.024831 secs 2024-03-28T09:32:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:32:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12778.024831 secs 2024-03-28T09:33:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:00 smithi086 ceph-mon[35163]: pgmap v7573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:00 smithi159 ceph-mon[36109]: pgmap v7573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:00 smithi055 ceph-mon[31863]: pgmap v7573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:02 smithi086 ceph-mon[35163]: pgmap v7574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:02 smithi159 ceph-mon[36109]: pgmap v7574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:02 smithi055 ceph-mon[31863]: pgmap v7574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12783.024896 secs 2024-03-28T09:33:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:04 smithi086 ceph-mon[35163]: pgmap v7575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12783.024896 secs 2024-03-28T09:33:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:04 smithi159 ceph-mon[36109]: pgmap v7575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12783.024896 secs 2024-03-28T09:33:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:04 smithi055 ceph-mon[31863]: pgmap v7575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:06 smithi086 ceph-mon[35163]: pgmap v7576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:06 smithi159 ceph-mon[36109]: pgmap v7576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:06 smithi055 ceph-mon[31863]: pgmap v7576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:08 smithi086 ceph-mon[35163]: pgmap v7577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:08 smithi159 ceph-mon[36109]: pgmap v7577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:08 smithi055 ceph-mon[31863]: pgmap v7577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12788.024929 secs 2024-03-28T09:33:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12788.024929 secs 2024-03-28T09:33:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12788.024929 secs 2024-03-28T09:33:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:10 smithi055 ceph-mon[31863]: pgmap v7578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:10 smithi086 ceph-mon[35163]: pgmap v7578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:10 smithi159 ceph-mon[36109]: pgmap v7578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:12 smithi055 ceph-mon[31863]: pgmap v7579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:12 smithi086 ceph-mon[35163]: pgmap v7579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:12 smithi159 ceph-mon[36109]: pgmap v7579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12793.025021 secs 2024-03-28T09:33:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12793.025021 secs 2024-03-28T09:33:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12793.025021 secs 2024-03-28T09:33:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:14 smithi055 ceph-mon[31863]: pgmap v7580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:14.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:14 smithi086 ceph-mon[35163]: pgmap v7580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:14.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:14 smithi159 ceph-mon[36109]: pgmap v7580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:16 smithi055 ceph-mon[31863]: pgmap v7581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:16 smithi086 ceph-mon[35163]: pgmap v7581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:16 smithi159 ceph-mon[36109]: pgmap v7581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:18 smithi055 ceph-mon[31863]: pgmap v7582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12798.025112 secs 2024-03-28T09:33:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:18 smithi086 ceph-mon[35163]: pgmap v7582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12798.025112 secs 2024-03-28T09:33:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:18 smithi159 ceph-mon[36109]: pgmap v7582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12798.025112 secs 2024-03-28T09:33:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:20 smithi086 ceph-mon[35163]: pgmap v7583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:20 smithi159 ceph-mon[36109]: pgmap v7583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:20 smithi055 ceph-mon[31863]: pgmap v7583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:22 smithi086 ceph-mon[35163]: pgmap v7584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:33:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:22 smithi159 ceph-mon[36109]: pgmap v7584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:33:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:22 smithi055 ceph-mon[31863]: pgmap v7584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:33:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12803.025213 secs 2024-03-28T09:33:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:33:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:33:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:33:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12803.025213 secs 2024-03-28T09:33:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:33:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:33:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:33:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12803.025213 secs 2024-03-28T09:33:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:33:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:33:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:33:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:24 smithi086 ceph-mon[35163]: pgmap v7585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:24 smithi086 ceph-mon[35163]: pgmap v7586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:24 smithi159 ceph-mon[36109]: pgmap v7585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:24 smithi159 ceph-mon[36109]: pgmap v7586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:24 smithi055 ceph-mon[31863]: pgmap v7585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:24 smithi055 ceph-mon[31863]: pgmap v7586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:26.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:26 smithi055 ceph-mon[31863]: pgmap v7587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:26 smithi086 ceph-mon[35163]: pgmap v7587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:26 smithi159 ceph-mon[36109]: pgmap v7587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:28 smithi086 ceph-mon[35163]: pgmap v7588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12808.025336 secs 2024-03-28T09:33:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:28 smithi159 ceph-mon[36109]: pgmap v7588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12808.025336 secs 2024-03-28T09:33:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:28 smithi055 ceph-mon[31863]: pgmap v7588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12808.025336 secs 2024-03-28T09:33:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:30 smithi086 ceph-mon[35163]: pgmap v7589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:30 smithi159 ceph-mon[36109]: pgmap v7589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:30 smithi055 ceph-mon[31863]: pgmap v7589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:32 smithi086 ceph-mon[35163]: pgmap v7590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:32 smithi159 ceph-mon[36109]: pgmap v7590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:32 smithi055 ceph-mon[31863]: pgmap v7590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:33:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12813.025460 secs 2024-03-28T09:33:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12813.025460 secs 2024-03-28T09:33:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12813.025460 secs 2024-03-28T09:33:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:34 smithi086 ceph-mon[35163]: pgmap v7591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:33:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:34 smithi159 ceph-mon[36109]: pgmap v7591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:33:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:34 smithi055 ceph-mon[31863]: pgmap v7591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:33:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:36 smithi086 ceph-mon[35163]: pgmap v7592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:36 smithi159 ceph-mon[36109]: pgmap v7592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:36 smithi055 ceph-mon[31863]: pgmap v7592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:38 smithi086 ceph-mon[35163]: pgmap v7593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12818.025562 secs 2024-03-28T09:33:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:38 smithi159 ceph-mon[36109]: pgmap v7593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12818.025562 secs 2024-03-28T09:33:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:38 smithi055 ceph-mon[31863]: pgmap v7593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12818.025562 secs 2024-03-28T09:33:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:40 smithi086 ceph-mon[35163]: pgmap v7594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:40 smithi159 ceph-mon[36109]: pgmap v7594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:40 smithi055 ceph-mon[31863]: pgmap v7594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:42 smithi086 ceph-mon[35163]: pgmap v7595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:42 smithi159 ceph-mon[36109]: pgmap v7595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:42 smithi055 ceph-mon[31863]: pgmap v7595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12823.025686 secs 2024-03-28T09:33:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12823.025686 secs 2024-03-28T09:33:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12823.025686 secs 2024-03-28T09:33:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:44 smithi086 ceph-mon[35163]: pgmap v7596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:44 smithi159 ceph-mon[36109]: pgmap v7596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:44 smithi055 ceph-mon[31863]: pgmap v7596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:46 smithi086 ceph-mon[35163]: pgmap v7597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:46 smithi159 ceph-mon[36109]: pgmap v7597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:46 smithi055 ceph-mon[31863]: pgmap v7597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:48 smithi086 ceph-mon[35163]: pgmap v7598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12828.025814 secs 2024-03-28T09:33:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:48 smithi159 ceph-mon[36109]: pgmap v7598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12828.025814 secs 2024-03-28T09:33:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:48 smithi055 ceph-mon[31863]: pgmap v7598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12828.025814 secs 2024-03-28T09:33:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:50 smithi086 ceph-mon[35163]: pgmap v7599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:50 smithi159 ceph-mon[36109]: pgmap v7599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:50 smithi055 ceph-mon[31863]: pgmap v7599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:52 smithi086 ceph-mon[35163]: pgmap v7600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:52 smithi159 ceph-mon[36109]: pgmap v7600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:52 smithi055 ceph-mon[31863]: pgmap v7600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12833.025878 secs 2024-03-28T09:33:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12833.025878 secs 2024-03-28T09:33:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12833.025878 secs 2024-03-28T09:33:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:54 smithi086 ceph-mon[35163]: pgmap v7601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:54 smithi159 ceph-mon[36109]: pgmap v7601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:54 smithi055 ceph-mon[31863]: pgmap v7601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:56 smithi086 ceph-mon[35163]: pgmap v7602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:56 smithi159 ceph-mon[36109]: pgmap v7602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:56.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:56 smithi055 ceph-mon[31863]: pgmap v7602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:33:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:58 smithi086 ceph-mon[35163]: pgmap v7603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12838.025970 secs 2024-03-28T09:33:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:58 smithi159 ceph-mon[36109]: pgmap v7603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12838.025970 secs 2024-03-28T09:33:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:58 smithi055 ceph-mon[31863]: pgmap v7603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:33:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12838.025970 secs 2024-03-28T09:34:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:00 smithi055 ceph-mon[31863]: pgmap v7604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:00 smithi086 ceph-mon[35163]: pgmap v7604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:00 smithi159 ceph-mon[36109]: pgmap v7604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:02.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:02 smithi055 ceph-mon[31863]: pgmap v7605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:02 smithi086 ceph-mon[35163]: pgmap v7605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:02 smithi159 ceph-mon[36109]: pgmap v7605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12843.026088 secs 2024-03-28T09:34:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12843.026088 secs 2024-03-28T09:34:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12843.026088 secs 2024-03-28T09:34:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:04 smithi055 ceph-mon[31863]: pgmap v7606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:04 smithi086 ceph-mon[35163]: pgmap v7606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:04 smithi159 ceph-mon[36109]: pgmap v7606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:06 smithi055 ceph-mon[31863]: pgmap v7607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:06 smithi086 ceph-mon[35163]: pgmap v7607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:06 smithi159 ceph-mon[36109]: pgmap v7607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:08 smithi055 ceph-mon[31863]: pgmap v7608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12848.026154 secs 2024-03-28T09:34:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:08 smithi086 ceph-mon[35163]: pgmap v7608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12848.026154 secs 2024-03-28T09:34:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:08 smithi159 ceph-mon[36109]: pgmap v7608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12848.026154 secs 2024-03-28T09:34:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:10 smithi055 ceph-mon[31863]: pgmap v7609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:10 smithi086 ceph-mon[35163]: pgmap v7609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:10 smithi159 ceph-mon[36109]: pgmap v7609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:12 smithi055 ceph-mon[31863]: pgmap v7610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:12 smithi086 ceph-mon[35163]: pgmap v7610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:12 smithi159 ceph-mon[36109]: pgmap v7610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12853.026220 secs 2024-03-28T09:34:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12853.026220 secs 2024-03-28T09:34:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12853.026220 secs 2024-03-28T09:34:14.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:14 smithi086 ceph-mon[35163]: pgmap v7611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:14.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:14 smithi159 ceph-mon[36109]: pgmap v7611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:14 smithi055 ceph-mon[31863]: pgmap v7611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:16 smithi086 ceph-mon[35163]: pgmap v7612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:16 smithi159 ceph-mon[36109]: pgmap v7612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:16 smithi055 ceph-mon[31863]: pgmap v7612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:18 smithi086 ceph-mon[35163]: pgmap v7613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12858.026301 secs 2024-03-28T09:34:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:18 smithi159 ceph-mon[36109]: pgmap v7613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12858.026301 secs 2024-03-28T09:34:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:18 smithi055 ceph-mon[31863]: pgmap v7613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12858.026301 secs 2024-03-28T09:34:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:20 smithi086 ceph-mon[35163]: pgmap v7614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:20 smithi159 ceph-mon[36109]: pgmap v7614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:20 smithi055 ceph-mon[31863]: pgmap v7614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:22 smithi086 ceph-mon[35163]: pgmap v7615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:22 smithi159 ceph-mon[36109]: pgmap v7615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:22 smithi055 ceph-mon[31863]: pgmap v7615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12863.026420 secs 2024-03-28T09:34:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:34:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12863.026420 secs 2024-03-28T09:34:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:34:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12863.026420 secs 2024-03-28T09:34:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:34:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:24 smithi086 ceph-mon[35163]: pgmap v7616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:24 smithi159 ceph-mon[36109]: pgmap v7616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:24 smithi055 ceph-mon[31863]: pgmap v7616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:25.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:26.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: pgmap v7617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:26.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:34:26.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:34:26.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: pgmap v7618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: pgmap v7619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.027 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: pgmap v7617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:34:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:34:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: pgmap v7618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: pgmap v7619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: pgmap v7617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:34:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:34:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: pgmap v7618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: pgmap v7619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:26.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:34:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:27 smithi086 ceph-mon[35163]: pgmap v7620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:27 smithi159 ceph-mon[36109]: pgmap v7620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:27 smithi055 ceph-mon[31863]: pgmap v7620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12868.026482 secs 2024-03-28T09:34:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12868.026482 secs 2024-03-28T09:34:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12868.026482 secs 2024-03-28T09:34:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:29 smithi086 ceph-mon[35163]: pgmap v7621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:29 smithi159 ceph-mon[36109]: pgmap v7621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:29 smithi055 ceph-mon[31863]: pgmap v7621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:31 smithi086 ceph-mon[35163]: pgmap v7622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:31 smithi159 ceph-mon[36109]: pgmap v7622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:31 smithi055 ceph-mon[31863]: pgmap v7622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12873.026555 secs 2024-03-28T09:34:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12873.026555 secs 2024-03-28T09:34:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12873.026555 secs 2024-03-28T09:34:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:34 smithi086 ceph-mon[35163]: pgmap v7623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:34 smithi159 ceph-mon[36109]: pgmap v7623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:34 smithi055 ceph-mon[31863]: pgmap v7623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:34:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:35 smithi086 ceph-mon[35163]: pgmap v7624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:34:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:35 smithi159 ceph-mon[36109]: pgmap v7624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:34:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:35 smithi055 ceph-mon[31863]: pgmap v7624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:34:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:37 smithi086 ceph-mon[35163]: pgmap v7625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:37 smithi159 ceph-mon[36109]: pgmap v7625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:37 smithi055 ceph-mon[31863]: pgmap v7625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12878.026625 secs 2024-03-28T09:34:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12878.026625 secs 2024-03-28T09:34:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12878.026625 secs 2024-03-28T09:34:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:39 smithi086 ceph-mon[35163]: pgmap v7626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:39 smithi159 ceph-mon[36109]: pgmap v7626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:39 smithi055 ceph-mon[31863]: pgmap v7626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:41 smithi086 ceph-mon[35163]: pgmap v7627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:41 smithi159 ceph-mon[36109]: pgmap v7627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:41 smithi055 ceph-mon[31863]: pgmap v7627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12883.026748 secs 2024-03-28T09:34:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12883.026748 secs 2024-03-28T09:34:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12883.026748 secs 2024-03-28T09:34:44.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:44 smithi086 ceph-mon[35163]: pgmap v7628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:44.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:44 smithi159 ceph-mon[36109]: pgmap v7628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:44 smithi055 ceph-mon[31863]: pgmap v7628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:45 smithi086 ceph-mon[35163]: pgmap v7629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:45 smithi159 ceph-mon[36109]: pgmap v7629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:45 smithi055 ceph-mon[31863]: pgmap v7629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:47 smithi086 ceph-mon[35163]: pgmap v7630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:47 smithi159 ceph-mon[36109]: pgmap v7630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:47 smithi055 ceph-mon[31863]: pgmap v7630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12888.026871 secs 2024-03-28T09:34:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12888.026871 secs 2024-03-28T09:34:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12888.026871 secs 2024-03-28T09:34:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:49 smithi086 ceph-mon[35163]: pgmap v7631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:49 smithi159 ceph-mon[36109]: pgmap v7631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:49 smithi055 ceph-mon[31863]: pgmap v7631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:52 smithi086 ceph-mon[35163]: pgmap v7632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:52 smithi159 ceph-mon[36109]: pgmap v7632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:52 smithi055 ceph-mon[31863]: pgmap v7632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12893.026945 secs 2024-03-28T09:34:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12893.026945 secs 2024-03-28T09:34:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12893.026945 secs 2024-03-28T09:34:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:54 smithi086 ceph-mon[35163]: pgmap v7633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:54 smithi159 ceph-mon[36109]: pgmap v7633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:54 smithi055 ceph-mon[31863]: pgmap v7633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:34:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:55 smithi086 ceph-mon[35163]: pgmap v7634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:55 smithi159 ceph-mon[36109]: pgmap v7634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:55 smithi055 ceph-mon[31863]: pgmap v7634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:34:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:57 smithi086 ceph-mon[35163]: pgmap v7635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:57 smithi159 ceph-mon[36109]: pgmap v7635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:57 smithi055 ceph-mon[31863]: pgmap v7635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:34:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12898.027025 secs 2024-03-28T09:34:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12898.027025 secs 2024-03-28T09:34:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12898.027025 secs 2024-03-28T09:35:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:34:59 smithi086 ceph-mon[35163]: pgmap v7636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:34:59 smithi159 ceph-mon[36109]: pgmap v7636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:34:59 smithi055 ceph-mon[31863]: pgmap v7636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:01 smithi086 ceph-mon[35163]: pgmap v7637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:01 smithi159 ceph-mon[36109]: pgmap v7637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:01 smithi055 ceph-mon[31863]: pgmap v7637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12903.027063 secs 2024-03-28T09:35:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12903.027063 secs 2024-03-28T09:35:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12903.027063 secs 2024-03-28T09:35:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:04 smithi086 ceph-mon[35163]: pgmap v7638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:04 smithi159 ceph-mon[36109]: pgmap v7638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:04 smithi055 ceph-mon[31863]: pgmap v7638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:05 smithi086 ceph-mon[35163]: pgmap v7639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:05 smithi159 ceph-mon[36109]: pgmap v7639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:05 smithi055 ceph-mon[31863]: pgmap v7639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:07 smithi086 ceph-mon[35163]: pgmap v7640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:07 smithi159 ceph-mon[36109]: pgmap v7640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:07 smithi055 ceph-mon[31863]: pgmap v7640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12908.027127 secs 2024-03-28T09:35:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12908.027127 secs 2024-03-28T09:35:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12908.027127 secs 2024-03-28T09:35:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:09 smithi086 ceph-mon[35163]: pgmap v7641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:09 smithi159 ceph-mon[36109]: pgmap v7641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:09 smithi055 ceph-mon[31863]: pgmap v7641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:11 smithi086 ceph-mon[35163]: pgmap v7642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:11 smithi159 ceph-mon[36109]: pgmap v7642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:11 smithi055 ceph-mon[31863]: pgmap v7642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12913.027192 secs 2024-03-28T09:35:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12913.027192 secs 2024-03-28T09:35:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12913.027192 secs 2024-03-28T09:35:14.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:14 smithi086 ceph-mon[35163]: pgmap v7643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:14.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:14 smithi159 ceph-mon[36109]: pgmap v7643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:14 smithi055 ceph-mon[31863]: pgmap v7643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:15 smithi086 ceph-mon[35163]: pgmap v7644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:16.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:15 smithi159 ceph-mon[36109]: pgmap v7644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:15 smithi055 ceph-mon[31863]: pgmap v7644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:17 smithi086 ceph-mon[35163]: pgmap v7645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:17 smithi159 ceph-mon[36109]: pgmap v7645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:17 smithi055 ceph-mon[31863]: pgmap v7645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12918.027257 secs 2024-03-28T09:35:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12918.027257 secs 2024-03-28T09:35:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12918.027257 secs 2024-03-28T09:35:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:19 smithi086 ceph-mon[35163]: pgmap v7646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:19 smithi159 ceph-mon[36109]: pgmap v7646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:19 smithi055 ceph-mon[31863]: pgmap v7646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:21 smithi086 ceph-mon[35163]: pgmap v7647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:21 smithi159 ceph-mon[36109]: pgmap v7647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:21 smithi055 ceph-mon[31863]: pgmap v7647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12923.027341 secs 2024-03-28T09:35:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12923.027341 secs 2024-03-28T09:35:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12923.027341 secs 2024-03-28T09:35:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:24 smithi086 ceph-mon[35163]: pgmap v7648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:24 smithi159 ceph-mon[36109]: pgmap v7648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:24 smithi055 ceph-mon[31863]: pgmap v7648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:25 smithi086 ceph-mon[35163]: pgmap v7649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:25 smithi159 ceph-mon[36109]: pgmap v7649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:25 smithi055 ceph-mon[31863]: pgmap v7649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:35:27.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:35:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:35:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:35:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:27 smithi086 ceph-mon[35163]: pgmap v7650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:27 smithi159 ceph-mon[36109]: pgmap v7650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:27 smithi055 ceph-mon[31863]: pgmap v7650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12928.027413 secs 2024-03-28T09:35:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12928.027413 secs 2024-03-28T09:35:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12928.027413 secs 2024-03-28T09:35:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:29 smithi086 ceph-mon[35163]: pgmap v7651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:29 smithi159 ceph-mon[36109]: pgmap v7651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:29 smithi055 ceph-mon[31863]: pgmap v7651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:31 smithi086 ceph-mon[35163]: pgmap v7652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:31 smithi159 ceph-mon[36109]: pgmap v7652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:31 smithi055 ceph-mon[31863]: pgmap v7652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:35:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:35:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:32 smithi055 ceph-mon[31863]: pgmap v7653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:35:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:32 smithi055 ceph-mon[31863]: pgmap v7654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:35:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:32 smithi086 ceph-mon[35163]: pgmap v7653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:35:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:32 smithi086 ceph-mon[35163]: pgmap v7654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:32 smithi159 ceph-mon[36109]: pgmap v7653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:35:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:32 smithi159 ceph-mon[36109]: pgmap v7654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:33.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:35:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12933.027536 secs 2024-03-28T09:35:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12933.027536 secs 2024-03-28T09:35:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12933.027536 secs 2024-03-28T09:35:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:34 smithi086 ceph-mon[35163]: pgmap v7655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:35:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:34 smithi159 ceph-mon[36109]: pgmap v7655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:35:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:34 smithi055 ceph-mon[31863]: pgmap v7655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:35:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:37 smithi086 ceph-mon[35163]: pgmap v7656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:37 smithi159 ceph-mon[36109]: pgmap v7656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:37 smithi055 ceph-mon[31863]: pgmap v7656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12938.027614 secs 2024-03-28T09:35:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:39 smithi086 ceph-mon[35163]: pgmap v7657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12938.027614 secs 2024-03-28T09:35:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:39 smithi159 ceph-mon[36109]: pgmap v7657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12938.027614 secs 2024-03-28T09:35:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:39 smithi055 ceph-mon[31863]: pgmap v7657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:35:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:41 smithi086 ceph-mon[35163]: pgmap v7658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:41 smithi159 ceph-mon[36109]: pgmap v7658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:41 smithi055 ceph-mon[31863]: pgmap v7658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:35:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:43 smithi086 ceph-mon[35163]: pgmap v7659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:35:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:43 smithi159 ceph-mon[36109]: pgmap v7659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:35:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:43 smithi055 ceph-mon[31863]: pgmap v7659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:35:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12943.027681 secs 2024-03-28T09:35:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12943.027681 secs 2024-03-28T09:35:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12943.027681 secs 2024-03-28T09:35:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:45 smithi086 ceph-mon[35163]: pgmap v7660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:45 smithi159 ceph-mon[36109]: pgmap v7660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:45 smithi055 ceph-mon[31863]: pgmap v7660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:47 smithi086 ceph-mon[35163]: pgmap v7661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:47 smithi159 ceph-mon[36109]: pgmap v7661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:47 smithi055 ceph-mon[31863]: pgmap v7661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12948.027764 secs 2024-03-28T09:35:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:49 smithi086 ceph-mon[35163]: pgmap v7662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12948.027764 secs 2024-03-28T09:35:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:49 smithi159 ceph-mon[36109]: pgmap v7662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12948.027764 secs 2024-03-28T09:35:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:49 smithi055 ceph-mon[31863]: pgmap v7662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:51 smithi086 ceph-mon[35163]: pgmap v7663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:51 smithi159 ceph-mon[36109]: pgmap v7663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:51 smithi055 ceph-mon[31863]: pgmap v7663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:35:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:53 smithi055 ceph-mon[31863]: pgmap v7664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:53 smithi086 ceph-mon[35163]: pgmap v7664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:53 smithi159 ceph-mon[36109]: pgmap v7664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12953.027892 secs 2024-03-28T09:35:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12953.027892 secs 2024-03-28T09:35:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12953.027892 secs 2024-03-28T09:35:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:55 smithi055 ceph-mon[31863]: pgmap v7665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:55 smithi086 ceph-mon[35163]: pgmap v7665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:55 smithi159 ceph-mon[36109]: pgmap v7665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:57 smithi055 ceph-mon[31863]: pgmap v7666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:57 smithi086 ceph-mon[35163]: pgmap v7666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:57 smithi159 ceph-mon[36109]: pgmap v7666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12958.028042 secs 2024-03-28T09:35:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12958.028042 secs 2024-03-28T09:35:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12958.028042 secs 2024-03-28T09:35:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:35:59 smithi086 ceph-mon[35163]: pgmap v7667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:35:59 smithi159 ceph-mon[36109]: pgmap v7667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:35:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:35:59 smithi055 ceph-mon[31863]: pgmap v7667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:01 smithi086 ceph-mon[35163]: pgmap v7668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:01 smithi159 ceph-mon[36109]: pgmap v7668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:01 smithi055 ceph-mon[31863]: pgmap v7668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:03 smithi086 ceph-mon[35163]: pgmap v7669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12963.028167 secs 2024-03-28T09:36:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:03 smithi159 ceph-mon[36109]: pgmap v7669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12963.028167 secs 2024-03-28T09:36:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:03 smithi055 ceph-mon[31863]: pgmap v7669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12963.028167 secs 2024-03-28T09:36:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:05 smithi086 ceph-mon[35163]: pgmap v7670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:05 smithi159 ceph-mon[36109]: pgmap v7670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:05 smithi055 ceph-mon[31863]: pgmap v7670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:07 smithi086 ceph-mon[35163]: pgmap v7671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:07 smithi159 ceph-mon[36109]: pgmap v7671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:07 smithi055 ceph-mon[31863]: pgmap v7671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12968.028233 secs 2024-03-28T09:36:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12968.028233 secs 2024-03-28T09:36:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12968.028233 secs 2024-03-28T09:36:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:09 smithi086 ceph-mon[35163]: pgmap v7672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:09 smithi159 ceph-mon[36109]: pgmap v7672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:09 smithi055 ceph-mon[31863]: pgmap v7672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:11 smithi086 ceph-mon[35163]: pgmap v7673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:11 smithi159 ceph-mon[36109]: pgmap v7673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:11 smithi055 ceph-mon[31863]: pgmap v7673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:13 smithi086 ceph-mon[35163]: pgmap v7674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12973.028354 secs 2024-03-28T09:36:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:13 smithi159 ceph-mon[36109]: pgmap v7674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12973.028354 secs 2024-03-28T09:36:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:13 smithi055 ceph-mon[31863]: pgmap v7674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12973.028354 secs 2024-03-28T09:36:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:15 smithi086 ceph-mon[35163]: pgmap v7675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:15 smithi159 ceph-mon[36109]: pgmap v7675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:15 smithi055 ceph-mon[31863]: pgmap v7675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:17 smithi086 ceph-mon[35163]: pgmap v7676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:17 smithi159 ceph-mon[36109]: pgmap v7676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:17 smithi055 ceph-mon[31863]: pgmap v7676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12978.028484 secs 2024-03-28T09:36:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12978.028484 secs 2024-03-28T09:36:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12978.028484 secs 2024-03-28T09:36:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:19 smithi086 ceph-mon[35163]: pgmap v7677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:19 smithi159 ceph-mon[36109]: pgmap v7677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:19 smithi055 ceph-mon[31863]: pgmap v7677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:21 smithi086 ceph-mon[35163]: pgmap v7678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:21 smithi159 ceph-mon[36109]: pgmap v7678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:21 smithi055 ceph-mon[31863]: pgmap v7678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:23 smithi086 ceph-mon[35163]: pgmap v7679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12983.028612 secs 2024-03-28T09:36:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:23 smithi159 ceph-mon[36109]: pgmap v7679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12983.028612 secs 2024-03-28T09:36:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:23 smithi055 ceph-mon[31863]: pgmap v7679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12983.028612 secs 2024-03-28T09:36:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:25 smithi086 ceph-mon[35163]: pgmap v7680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:25 smithi159 ceph-mon[36109]: pgmap v7680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:25 smithi055 ceph-mon[31863]: pgmap v7680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:27 smithi086 ceph-mon[35163]: pgmap v7681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:27 smithi159 ceph-mon[36109]: pgmap v7681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:27 smithi055 ceph-mon[31863]: pgmap v7681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12988.028728 secs 2024-03-28T09:36:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12988.028728 secs 2024-03-28T09:36:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12988.028728 secs 2024-03-28T09:36:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:29 smithi086 ceph-mon[35163]: pgmap v7682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:29 smithi159 ceph-mon[36109]: pgmap v7682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:29 smithi055 ceph-mon[31863]: pgmap v7682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:31 smithi086 ceph-mon[35163]: pgmap v7683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:31 smithi159 ceph-mon[36109]: pgmap v7683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:31 smithi055 ceph-mon[31863]: pgmap v7683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:33 smithi086 ceph-mon[35163]: pgmap v7684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12993.028815 secs 2024-03-28T09:36:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:36:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:33 smithi159 ceph-mon[36109]: pgmap v7684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12993.028815 secs 2024-03-28T09:36:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:36:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:33 smithi055 ceph-mon[31863]: pgmap v7684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12993.028815 secs 2024-03-28T09:36:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:36:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: pgmap v7685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:36:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:36:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: pgmap v7685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:36:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:36:36.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: pgmap v7685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:36:36.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:36:36.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:36:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:36 smithi086 ceph-mon[35163]: pgmap v7686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:36:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:36 smithi086 ceph-mon[35163]: pgmap v7687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:36 smithi159 ceph-mon[36109]: pgmap v7686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:36:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:36 smithi159 ceph-mon[36109]: pgmap v7687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:36 smithi055 ceph-mon[31863]: pgmap v7686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:36:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:36 smithi055 ceph-mon[31863]: pgmap v7687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:38 smithi086 ceph-mon[35163]: pgmap v7688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 12998.028894 secs 2024-03-28T09:36:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:38 smithi159 ceph-mon[36109]: pgmap v7688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 12998.028894 secs 2024-03-28T09:36:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:38 smithi055 ceph-mon[31863]: pgmap v7688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 12998.028894 secs 2024-03-28T09:36:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:40 smithi086 ceph-mon[35163]: pgmap v7689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:40 smithi159 ceph-mon[36109]: pgmap v7689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:40 smithi055 ceph-mon[31863]: pgmap v7689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:42 smithi086 ceph-mon[35163]: pgmap v7690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:42 smithi159 ceph-mon[36109]: pgmap v7690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:42 smithi055 ceph-mon[31863]: pgmap v7690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:36:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13003.029022 secs 2024-03-28T09:36:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13003.029022 secs 2024-03-28T09:36:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13003.029022 secs 2024-03-28T09:36:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:44 smithi086 ceph-mon[35163]: pgmap v7691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:44 smithi159 ceph-mon[36109]: pgmap v7691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:44 smithi055 ceph-mon[31863]: pgmap v7691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:46 smithi086 ceph-mon[35163]: pgmap v7692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:36:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:46 smithi159 ceph-mon[36109]: pgmap v7692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:36:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:46 smithi055 ceph-mon[31863]: pgmap v7692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:36:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:48 smithi086 ceph-mon[35163]: pgmap v7693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13008.029098 secs 2024-03-28T09:36:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:48 smithi159 ceph-mon[36109]: pgmap v7693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13008.029098 secs 2024-03-28T09:36:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:48 smithi055 ceph-mon[31863]: pgmap v7693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13008.029098 secs 2024-03-28T09:36:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:50 smithi086 ceph-mon[35163]: pgmap v7694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:50 smithi159 ceph-mon[36109]: pgmap v7694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:50 smithi055 ceph-mon[31863]: pgmap v7694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:51 smithi086 ceph-mon[35163]: pgmap v7695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:36:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:51 smithi159 ceph-mon[36109]: pgmap v7695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:36:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:51 smithi055 ceph-mon[31863]: pgmap v7695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:36:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13013.029178 secs 2024-03-28T09:36:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:53 smithi086 ceph-mon[35163]: pgmap v7696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13013.029178 secs 2024-03-28T09:36:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:53 smithi159 ceph-mon[36109]: pgmap v7696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13013.029178 secs 2024-03-28T09:36:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:53 smithi055 ceph-mon[31863]: pgmap v7696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:36:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:55 smithi086 ceph-mon[35163]: pgmap v7697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:55 smithi159 ceph-mon[36109]: pgmap v7697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:55 smithi055 ceph-mon[31863]: pgmap v7697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:58.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:57 smithi055 ceph-mon[31863]: pgmap v7698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:57 smithi086 ceph-mon[35163]: pgmap v7698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:57 smithi159 ceph-mon[36109]: pgmap v7698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:36:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13018.029249 secs 2024-03-28T09:36:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13018.029249 secs 2024-03-28T09:36:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13018.029249 secs 2024-03-28T09:37:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:36:59 smithi086 ceph-mon[35163]: pgmap v7699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:36:59 smithi159 ceph-mon[36109]: pgmap v7699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:36:59 smithi055 ceph-mon[31863]: pgmap v7699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:01 smithi086 ceph-mon[35163]: pgmap v7700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:01 smithi159 ceph-mon[36109]: pgmap v7700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:01 smithi055 ceph-mon[31863]: pgmap v7700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13023.029372 secs 2024-03-28T09:37:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:03 smithi086 ceph-mon[35163]: pgmap v7701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13023.029372 secs 2024-03-28T09:37:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:03 smithi159 ceph-mon[36109]: pgmap v7701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13023.029372 secs 2024-03-28T09:37:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:03 smithi055 ceph-mon[31863]: pgmap v7701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:05 smithi086 ceph-mon[35163]: pgmap v7702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:05 smithi159 ceph-mon[36109]: pgmap v7702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:05 smithi055 ceph-mon[31863]: pgmap v7702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:07 smithi086 ceph-mon[35163]: pgmap v7703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:07 smithi159 ceph-mon[36109]: pgmap v7703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:07 smithi055 ceph-mon[31863]: pgmap v7703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13028.029480 secs 2024-03-28T09:37:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13028.029480 secs 2024-03-28T09:37:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13028.029480 secs 2024-03-28T09:37:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:09 smithi086 ceph-mon[35163]: pgmap v7704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:09 smithi159 ceph-mon[36109]: pgmap v7704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:09 smithi055 ceph-mon[31863]: pgmap v7704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:11 smithi086 ceph-mon[35163]: pgmap v7705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:12.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:11 smithi159 ceph-mon[36109]: pgmap v7705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:11 smithi055 ceph-mon[31863]: pgmap v7705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13033.029562 secs 2024-03-28T09:37:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:13 smithi086 ceph-mon[35163]: pgmap v7706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13033.029562 secs 2024-03-28T09:37:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:13 smithi159 ceph-mon[36109]: pgmap v7706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13033.029562 secs 2024-03-28T09:37:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:13 smithi055 ceph-mon[31863]: pgmap v7706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:16 smithi086 ceph-mon[35163]: pgmap v7707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:16 smithi159 ceph-mon[36109]: pgmap v7707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:16 smithi055 ceph-mon[31863]: pgmap v7707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:18 smithi086 ceph-mon[35163]: pgmap v7708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:18 smithi159 ceph-mon[36109]: pgmap v7708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:18 smithi055 ceph-mon[31863]: pgmap v7708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13038.029627 secs 2024-03-28T09:37:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13038.029627 secs 2024-03-28T09:37:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13038.029627 secs 2024-03-28T09:37:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:20 smithi086 ceph-mon[35163]: pgmap v7709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:20 smithi159 ceph-mon[36109]: pgmap v7709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:20 smithi055 ceph-mon[31863]: pgmap v7709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:22 smithi086 ceph-mon[35163]: pgmap v7710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:22 smithi159 ceph-mon[36109]: pgmap v7710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:22 smithi055 ceph-mon[31863]: pgmap v7710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13043.029714 secs 2024-03-28T09:37:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:24 smithi086 ceph-mon[35163]: pgmap v7711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13043.029714 secs 2024-03-28T09:37:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:24 smithi159 ceph-mon[36109]: pgmap v7711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13043.029714 secs 2024-03-28T09:37:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:24 smithi055 ceph-mon[31863]: pgmap v7711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:26 smithi086 ceph-mon[35163]: pgmap v7712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:26 smithi159 ceph-mon[36109]: pgmap v7712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:26 smithi055 ceph-mon[31863]: pgmap v7712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:28 smithi086 ceph-mon[35163]: pgmap v7713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:28 smithi159 ceph-mon[36109]: pgmap v7713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:28 smithi055 ceph-mon[31863]: pgmap v7713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13048.029841 secs 2024-03-28T09:37:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13048.029841 secs 2024-03-28T09:37:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13048.029841 secs 2024-03-28T09:37:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:30 smithi055 ceph-mon[31863]: pgmap v7714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:30 smithi086 ceph-mon[35163]: pgmap v7714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:30 smithi159 ceph-mon[36109]: pgmap v7714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:32 smithi055 ceph-mon[31863]: pgmap v7715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:32 smithi086 ceph-mon[35163]: pgmap v7715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:32 smithi159 ceph-mon[36109]: pgmap v7715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:37:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13053.029965 secs 2024-03-28T09:37:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:34 smithi055 ceph-mon[31863]: pgmap v7716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13053.029965 secs 2024-03-28T09:37:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:34 smithi086 ceph-mon[35163]: pgmap v7716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13053.029965 secs 2024-03-28T09:37:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:34 smithi159 ceph-mon[36109]: pgmap v7716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:37:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:36 smithi055 ceph-mon[31863]: pgmap v7717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:37:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:36 smithi086 ceph-mon[35163]: pgmap v7717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:37:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:36 smithi159 ceph-mon[36109]: pgmap v7717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:37:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: pgmap v7718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:37:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: pgmap v7719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: pgmap v7720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13058.030047 secs 2024-03-28T09:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: pgmap v7718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:37:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:37:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: pgmap v7719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:37:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: pgmap v7720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:37:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13058.030047 secs 2024-03-28T09:37:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: pgmap v7718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:37:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:37:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: pgmap v7719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:37:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: pgmap v7720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:37:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:37:38.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13058.030047 secs 2024-03-28T09:37:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:40 smithi086 ceph-mon[35163]: pgmap v7721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:37:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:40 smithi159 ceph-mon[36109]: pgmap v7721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:37:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:40 smithi055 ceph-mon[31863]: pgmap v7721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T09:37:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:42 smithi086 ceph-mon[35163]: pgmap v7722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:42 smithi159 ceph-mon[36109]: pgmap v7722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:42 smithi055 ceph-mon[31863]: pgmap v7722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13063.030131 secs 2024-03-28T09:37:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13063.030131 secs 2024-03-28T09:37:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13063.030131 secs 2024-03-28T09:37:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:44 smithi086 ceph-mon[35163]: pgmap v7723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:44 smithi159 ceph-mon[36109]: pgmap v7723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:44 smithi055 ceph-mon[31863]: pgmap v7723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:46 smithi086 ceph-mon[35163]: pgmap v7724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:46 smithi159 ceph-mon[36109]: pgmap v7724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:46 smithi055 ceph-mon[31863]: pgmap v7724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:37:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:48 smithi086 ceph-mon[35163]: pgmap v7725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13068.030219 secs 2024-03-28T09:37:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:48 smithi159 ceph-mon[36109]: pgmap v7725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13068.030219 secs 2024-03-28T09:37:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:48 smithi055 ceph-mon[31863]: pgmap v7725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13068.030219 secs 2024-03-28T09:37:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:50 smithi086 ceph-mon[35163]: pgmap v7726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:50 smithi159 ceph-mon[36109]: pgmap v7726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:50 smithi055 ceph-mon[31863]: pgmap v7726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:52 smithi086 ceph-mon[35163]: pgmap v7727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:52 smithi159 ceph-mon[36109]: pgmap v7727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:52 smithi055 ceph-mon[31863]: pgmap v7727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13073.030286 secs 2024-03-28T09:37:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13073.030286 secs 2024-03-28T09:37:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13073.030286 secs 2024-03-28T09:37:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:54 smithi086 ceph-mon[35163]: pgmap v7728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:54 smithi159 ceph-mon[36109]: pgmap v7728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:54 smithi055 ceph-mon[31863]: pgmap v7728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:37:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:56 smithi055 ceph-mon[31863]: pgmap v7729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:56 smithi086 ceph-mon[35163]: pgmap v7729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:56 smithi159 ceph-mon[36109]: pgmap v7729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:37:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:58 smithi055 ceph-mon[31863]: pgmap v7730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:37:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:37:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13078.030358 secs 2024-03-28T09:37:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:58 smithi086 ceph-mon[35163]: pgmap v7730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:37:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:37:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13078.030358 secs 2024-03-28T09:37:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:58 smithi159 ceph-mon[36109]: pgmap v7730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:37:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:37:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13078.030358 secs 2024-03-28T09:38:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:00 smithi055 ceph-mon[31863]: pgmap v7731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:00 smithi086 ceph-mon[35163]: pgmap v7731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:00 smithi159 ceph-mon[36109]: pgmap v7731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:02 smithi055 ceph-mon[31863]: pgmap v7732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:02 smithi086 ceph-mon[35163]: pgmap v7732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:02 smithi159 ceph-mon[36109]: pgmap v7732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13083.030446 secs 2024-03-28T09:38:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13083.030446 secs 2024-03-28T09:38:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13083.030446 secs 2024-03-28T09:38:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:04 smithi055 ceph-mon[31863]: pgmap v7733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:04 smithi086 ceph-mon[35163]: pgmap v7733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:04 smithi159 ceph-mon[36109]: pgmap v7733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:38:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:06 smithi055 ceph-mon[31863]: pgmap v7734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:06 smithi086 ceph-mon[35163]: pgmap v7734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:06 smithi159 ceph-mon[36109]: pgmap v7734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:08 smithi055 ceph-mon[31863]: pgmap v7735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13088.030566 secs 2024-03-28T09:38:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:08 smithi086 ceph-mon[35163]: pgmap v7735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13088.030566 secs 2024-03-28T09:38:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:08 smithi159 ceph-mon[36109]: pgmap v7735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13088.030566 secs 2024-03-28T09:38:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:10 smithi086 ceph-mon[35163]: pgmap v7736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:10 smithi159 ceph-mon[36109]: pgmap v7736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:10 smithi055 ceph-mon[31863]: pgmap v7736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:12 smithi086 ceph-mon[35163]: pgmap v7737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:12 smithi159 ceph-mon[36109]: pgmap v7737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:12 smithi055 ceph-mon[31863]: pgmap v7737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13093.030629 secs 2024-03-28T09:38:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13093.030629 secs 2024-03-28T09:38:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13093.030629 secs 2024-03-28T09:38:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:14 smithi086 ceph-mon[35163]: pgmap v7738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:14 smithi159 ceph-mon[36109]: pgmap v7738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:14 smithi055 ceph-mon[31863]: pgmap v7738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:16 smithi086 ceph-mon[35163]: pgmap v7739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:16 smithi159 ceph-mon[36109]: pgmap v7739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:16 smithi055 ceph-mon[31863]: pgmap v7739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:18 smithi086 ceph-mon[35163]: pgmap v7740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13098.030743 secs 2024-03-28T09:38:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:18 smithi159 ceph-mon[36109]: pgmap v7740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13098.030743 secs 2024-03-28T09:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:18 smithi055 ceph-mon[31863]: pgmap v7740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13098.030743 secs 2024-03-28T09:38:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:20 smithi086 ceph-mon[35163]: pgmap v7741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:20 smithi159 ceph-mon[36109]: pgmap v7741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:20 smithi055 ceph-mon[31863]: pgmap v7741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:22 smithi086 ceph-mon[35163]: pgmap v7742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:22 smithi159 ceph-mon[36109]: pgmap v7742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:22 smithi055 ceph-mon[31863]: pgmap v7742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13103.030861 secs 2024-03-28T09:38:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13103.030861 secs 2024-03-28T09:38:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13103.030861 secs 2024-03-28T09:38:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:24 smithi086 ceph-mon[35163]: pgmap v7743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:24 smithi159 ceph-mon[36109]: pgmap v7743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:24 smithi055 ceph-mon[31863]: pgmap v7743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:26 smithi086 ceph-mon[35163]: pgmap v7744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:26 smithi159 ceph-mon[36109]: pgmap v7744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:26 smithi055 ceph-mon[31863]: pgmap v7744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:28.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:27 smithi055 ceph-mon[31863]: pgmap v7745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:27 smithi086 ceph-mon[35163]: pgmap v7745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:27 smithi159 ceph-mon[36109]: pgmap v7745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13108.030913 secs 2024-03-28T09:38:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13108.030913 secs 2024-03-28T09:38:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13108.030913 secs 2024-03-28T09:38:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:29 smithi086 ceph-mon[35163]: pgmap v7746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:29 smithi159 ceph-mon[36109]: pgmap v7746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:29 smithi055 ceph-mon[31863]: pgmap v7746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:32 smithi086 ceph-mon[35163]: pgmap v7747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:32 smithi159 ceph-mon[36109]: pgmap v7747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:32 smithi055 ceph-mon[31863]: pgmap v7747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13113.030999 secs 2024-03-28T09:38:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13113.030999 secs 2024-03-28T09:38:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13113.030999 secs 2024-03-28T09:38:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:34 smithi086 ceph-mon[35163]: pgmap v7748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:34 smithi159 ceph-mon[36109]: pgmap v7748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:34 smithi055 ceph-mon[31863]: pgmap v7748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:36 smithi086 ceph-mon[35163]: pgmap v7749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:36 smithi159 ceph-mon[36109]: pgmap v7749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:36 smithi055 ceph-mon[31863]: pgmap v7749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:38 smithi086 ceph-mon[35163]: pgmap v7750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13118.031091 secs 2024-03-28T09:38:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:38:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:38 smithi159 ceph-mon[36109]: pgmap v7750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13118.031091 secs 2024-03-28T09:38:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:38:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:38 smithi055 ceph-mon[31863]: pgmap v7750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:38:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13118.031091 secs 2024-03-28T09:38:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:38:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:38:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:38:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:38:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:38:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:38:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:38:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:38:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:38:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:38:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:40 smithi086 ceph-mon[35163]: pgmap v7751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:40 smithi086 ceph-mon[35163]: pgmap v7752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:40 smithi159 ceph-mon[36109]: pgmap v7751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:40 smithi159 ceph-mon[36109]: pgmap v7752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:40 smithi055 ceph-mon[31863]: pgmap v7751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:40 smithi055 ceph-mon[31863]: pgmap v7752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:42 smithi086 ceph-mon[35163]: pgmap v7753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:42 smithi159 ceph-mon[36109]: pgmap v7753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:42 smithi055 ceph-mon[31863]: pgmap v7753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13123.031213 secs 2024-03-28T09:38:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13123.031213 secs 2024-03-28T09:38:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13123.031213 secs 2024-03-28T09:38:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:44 smithi055 ceph-mon[31863]: pgmap v7754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:44 smithi086 ceph-mon[35163]: pgmap v7754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:44 smithi159 ceph-mon[36109]: pgmap v7754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:46.871 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:46 smithi086 ceph-mon[35163]: pgmap v7755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:38:46.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:46 smithi159 ceph-mon[36109]: pgmap v7755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:38:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:46 smithi055 ceph-mon[31863]: pgmap v7755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:38:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:48 smithi055 ceph-mon[31863]: pgmap v7756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13128.031278 secs 2024-03-28T09:38:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:48 smithi086 ceph-mon[35163]: pgmap v7756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13128.031278 secs 2024-03-28T09:38:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:48 smithi159 ceph-mon[36109]: pgmap v7756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13128.031278 secs 2024-03-28T09:38:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:50 smithi055 ceph-mon[31863]: pgmap v7757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:50 smithi086 ceph-mon[35163]: pgmap v7757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:50 smithi159 ceph-mon[36109]: pgmap v7757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:38:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:52 smithi055 ceph-mon[31863]: pgmap v7758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:52 smithi086 ceph-mon[35163]: pgmap v7758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:52 smithi159 ceph-mon[36109]: pgmap v7758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13133.031360 secs 2024-03-28T09:38:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13133.031360 secs 2024-03-28T09:38:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13133.031360 secs 2024-03-28T09:38:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:54 smithi086 ceph-mon[35163]: pgmap v7759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:54 smithi159 ceph-mon[36109]: pgmap v7759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:54 smithi055 ceph-mon[31863]: pgmap v7759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:56 smithi086 ceph-mon[35163]: pgmap v7760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:56 smithi159 ceph-mon[36109]: pgmap v7760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:56 smithi055 ceph-mon[31863]: pgmap v7760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:38:58.925 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:58 smithi055 ceph-mon[31863]: pgmap v7761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:58.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:38:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13138.031475 secs 2024-03-28T09:38:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:58 smithi086 ceph-mon[35163]: pgmap v7761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:38:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13138.031475 secs 2024-03-28T09:38:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:58 smithi159 ceph-mon[36109]: pgmap v7761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:38:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:38:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13138.031475 secs 2024-03-28T09:39:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:00 smithi086 ceph-mon[35163]: pgmap v7762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:00 smithi159 ceph-mon[36109]: pgmap v7762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:00 smithi055 ceph-mon[31863]: pgmap v7762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:02 smithi086 ceph-mon[35163]: pgmap v7763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:02 smithi159 ceph-mon[36109]: pgmap v7763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:02 smithi055 ceph-mon[31863]: pgmap v7763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13143.031597 secs 2024-03-28T09:39:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13143.031597 secs 2024-03-28T09:39:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13143.031597 secs 2024-03-28T09:39:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:04 smithi086 ceph-mon[35163]: pgmap v7764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:04 smithi159 ceph-mon[36109]: pgmap v7764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:04 smithi055 ceph-mon[31863]: pgmap v7764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:06 smithi086 ceph-mon[35163]: pgmap v7765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:06 smithi159 ceph-mon[36109]: pgmap v7765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:06 smithi055 ceph-mon[31863]: pgmap v7765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:08 smithi086 ceph-mon[35163]: pgmap v7766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:39:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13148.031719 secs 2024-03-28T09:39:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:08 smithi159 ceph-mon[36109]: pgmap v7766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:39:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13148.031719 secs 2024-03-28T09:39:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:08 smithi055 ceph-mon[31863]: pgmap v7766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:39:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13148.031719 secs 2024-03-28T09:39:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:10 smithi086 ceph-mon[35163]: pgmap v7767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:10 smithi159 ceph-mon[36109]: pgmap v7767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:10 smithi055 ceph-mon[31863]: pgmap v7767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:12 smithi086 ceph-mon[35163]: pgmap v7768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:12 smithi159 ceph-mon[36109]: pgmap v7768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:12 smithi055 ceph-mon[31863]: pgmap v7768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13153.031867 secs 2024-03-28T09:39:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13153.031867 secs 2024-03-28T09:39:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13153.031867 secs 2024-03-28T09:39:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:14 smithi086 ceph-mon[35163]: pgmap v7769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:14 smithi159 ceph-mon[36109]: pgmap v7769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:14 smithi055 ceph-mon[31863]: pgmap v7769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:16 smithi086 ceph-mon[35163]: pgmap v7770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:16 smithi159 ceph-mon[36109]: pgmap v7770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:16 smithi055 ceph-mon[31863]: pgmap v7770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:17 smithi086 ceph-mon[35163]: pgmap v7771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:17 smithi159 ceph-mon[36109]: pgmap v7771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:17 smithi055 ceph-mon[31863]: pgmap v7771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13158.031988 secs 2024-03-28T09:39:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13158.031988 secs 2024-03-28T09:39:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13158.031988 secs 2024-03-28T09:39:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:19 smithi086 ceph-mon[35163]: pgmap v7772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:19 smithi159 ceph-mon[36109]: pgmap v7772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:19 smithi055 ceph-mon[31863]: pgmap v7772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:22 smithi086 ceph-mon[35163]: pgmap v7773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:22 smithi159 ceph-mon[36109]: pgmap v7773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:22 smithi055 ceph-mon[31863]: pgmap v7773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13163.032106 secs 2024-03-28T09:39:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:24 smithi086 ceph-mon[35163]: pgmap v7774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13163.032106 secs 2024-03-28T09:39:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:24 smithi159 ceph-mon[36109]: pgmap v7774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13163.032106 secs 2024-03-28T09:39:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:24 smithi055 ceph-mon[31863]: pgmap v7774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:26 smithi086 ceph-mon[35163]: pgmap v7775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:26 smithi159 ceph-mon[36109]: pgmap v7775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:26 smithi055 ceph-mon[31863]: pgmap v7775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:28 smithi086 ceph-mon[35163]: pgmap v7776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:28 smithi159 ceph-mon[36109]: pgmap v7776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:28 smithi055 ceph-mon[31863]: pgmap v7776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13168.032179 secs 2024-03-28T09:39:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13168.032179 secs 2024-03-28T09:39:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13168.032179 secs 2024-03-28T09:39:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:30 smithi086 ceph-mon[35163]: pgmap v7777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:30 smithi159 ceph-mon[36109]: pgmap v7777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:30 smithi055 ceph-mon[31863]: pgmap v7777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:32 smithi086 ceph-mon[35163]: pgmap v7778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:32 smithi159 ceph-mon[36109]: pgmap v7778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:32 smithi055 ceph-mon[31863]: pgmap v7778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13173.032245 secs 2024-03-28T09:39:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:34 smithi086 ceph-mon[35163]: pgmap v7779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13173.032245 secs 2024-03-28T09:39:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:34 smithi159 ceph-mon[36109]: pgmap v7779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13173.032245 secs 2024-03-28T09:39:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:34 smithi055 ceph-mon[31863]: pgmap v7779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:36 smithi086 ceph-mon[35163]: pgmap v7780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:36 smithi159 ceph-mon[36109]: pgmap v7780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:36 smithi055 ceph-mon[31863]: pgmap v7780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:39:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:38 smithi086 ceph-mon[35163]: pgmap v7781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:38 smithi159 ceph-mon[36109]: pgmap v7781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:38 smithi055 ceph-mon[31863]: pgmap v7781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13178.033155 secs 2024-03-28T09:39:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13178.033155 secs 2024-03-28T09:39:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13178.033155 secs 2024-03-28T09:39:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:40 smithi086 ceph-mon[35163]: pgmap v7782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:39:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:40 smithi159 ceph-mon[36109]: pgmap v7782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:39:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:40 smithi055 ceph-mon[31863]: pgmap v7782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:39:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:39:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:39:41.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:39:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:39:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:39:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:39:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:39:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:39:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:39:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:42 smithi055 ceph-mon[31863]: pgmap v7783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:42 smithi055 ceph-mon[31863]: pgmap v7784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:42 smithi086 ceph-mon[35163]: pgmap v7783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:42 smithi086 ceph-mon[35163]: pgmap v7784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:42 smithi159 ceph-mon[36109]: pgmap v7783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:42 smithi159 ceph-mon[36109]: pgmap v7784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13183.033230 secs 2024-03-28T09:39:44.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:44 smithi055 ceph-mon[31863]: pgmap v7785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13183.033230 secs 2024-03-28T09:39:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:44 smithi086 ceph-mon[35163]: pgmap v7785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13183.033230 secs 2024-03-28T09:39:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:44 smithi159 ceph-mon[36109]: pgmap v7785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:46.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:46 smithi086 ceph-mon[35163]: pgmap v7786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:39:46.622 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:46 smithi159 ceph-mon[36109]: pgmap v7786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:39:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:46 smithi055 ceph-mon[31863]: pgmap v7786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:39:48.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:48 smithi055 ceph-mon[31863]: pgmap v7787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:48 smithi086 ceph-mon[35163]: pgmap v7787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:48 smithi159 ceph-mon[36109]: pgmap v7787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13188.033293 secs 2024-03-28T09:39:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13188.033293 secs 2024-03-28T09:39:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13188.033293 secs 2024-03-28T09:39:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:50 smithi055 ceph-mon[31863]: pgmap v7788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:50 smithi086 ceph-mon[35163]: pgmap v7788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:50 smithi159 ceph-mon[36109]: pgmap v7788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:39:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:52 smithi086 ceph-mon[35163]: pgmap v7789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:52 smithi159 ceph-mon[36109]: pgmap v7789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:52 smithi055 ceph-mon[31863]: pgmap v7789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:39:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13193.033359 secs 2024-03-28T09:39:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13193.033359 secs 2024-03-28T09:39:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13193.033359 secs 2024-03-28T09:39:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:54 smithi086 ceph-mon[35163]: pgmap v7790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:54 smithi159 ceph-mon[36109]: pgmap v7790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:54 smithi055 ceph-mon[31863]: pgmap v7790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:56 smithi086 ceph-mon[35163]: pgmap v7791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:56 smithi159 ceph-mon[36109]: pgmap v7791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:56 smithi055 ceph-mon[31863]: pgmap v7791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:39:58.674 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:58 smithi055 ceph-mon[31863]: pgmap v7792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:58.675 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:39:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13198.033483 secs 2024-03-28T09:39:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:58 smithi086 ceph-mon[35163]: pgmap v7792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:39:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13198.033483 secs 2024-03-28T09:39:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:58 smithi159 ceph-mon[36109]: pgmap v7792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:39:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:39:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13198.033483 secs 2024-03-28T09:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:00 smithi086 ceph-mon[35163]: pgmap v7793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:00 smithi159 ceph-mon[36109]: pgmap v7793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:00 smithi055 ceph-mon[31863]: pgmap v7793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:40:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:02 smithi086 ceph-mon[35163]: pgmap v7794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:02 smithi159 ceph-mon[36109]: pgmap v7794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:02 smithi055 ceph-mon[31863]: pgmap v7794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13203.033603 secs 2024-03-28T09:40:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13203.033603 secs 2024-03-28T09:40:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13203.033603 secs 2024-03-28T09:40:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:04 smithi086 ceph-mon[35163]: pgmap v7795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:04 smithi159 ceph-mon[36109]: pgmap v7795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:04 smithi055 ceph-mon[31863]: pgmap v7795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:06 smithi086 ceph-mon[35163]: pgmap v7796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:06 smithi159 ceph-mon[36109]: pgmap v7796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:06 smithi055 ceph-mon[31863]: pgmap v7796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:08 smithi086 ceph-mon[35163]: pgmap v7797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13208.033721 secs 2024-03-28T09:40:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:08 smithi159 ceph-mon[36109]: pgmap v7797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13208.033721 secs 2024-03-28T09:40:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:08 smithi055 ceph-mon[31863]: pgmap v7797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13208.033721 secs 2024-03-28T09:40:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:10 smithi086 ceph-mon[35163]: pgmap v7798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:10 smithi159 ceph-mon[36109]: pgmap v7798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:10 smithi055 ceph-mon[31863]: pgmap v7798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:12 smithi086 ceph-mon[35163]: pgmap v7799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:12 smithi159 ceph-mon[36109]: pgmap v7799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:12 smithi055 ceph-mon[31863]: pgmap v7799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13213.033845 secs 2024-03-28T09:40:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13213.033845 secs 2024-03-28T09:40:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13213.033845 secs 2024-03-28T09:40:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:14 smithi086 ceph-mon[35163]: pgmap v7800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:14 smithi159 ceph-mon[36109]: pgmap v7800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:14 smithi055 ceph-mon[31863]: pgmap v7800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:16 smithi086 ceph-mon[35163]: pgmap v7801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:16.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:16 smithi159 ceph-mon[36109]: pgmap v7801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:16 smithi055 ceph-mon[31863]: pgmap v7801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:18 smithi086 ceph-mon[35163]: pgmap v7802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13218.033931 secs 2024-03-28T09:40:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:18 smithi159 ceph-mon[36109]: pgmap v7802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13218.033931 secs 2024-03-28T09:40:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:18 smithi055 ceph-mon[31863]: pgmap v7802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13218.033931 secs 2024-03-28T09:40:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:20 smithi086 ceph-mon[35163]: pgmap v7803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:20 smithi159 ceph-mon[36109]: pgmap v7803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:20 smithi055 ceph-mon[31863]: pgmap v7803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:22 smithi086 ceph-mon[35163]: pgmap v7804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:22 smithi159 ceph-mon[36109]: pgmap v7804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:22 smithi055 ceph-mon[31863]: pgmap v7804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13223.034049 secs 2024-03-28T09:40:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13223.034049 secs 2024-03-28T09:40:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13223.034049 secs 2024-03-28T09:40:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:24 smithi086 ceph-mon[35163]: pgmap v7805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:24 smithi159 ceph-mon[36109]: pgmap v7805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:24 smithi055 ceph-mon[31863]: pgmap v7805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:26 smithi086 ceph-mon[35163]: pgmap v7806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:26.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:26 smithi159 ceph-mon[36109]: pgmap v7806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:26 smithi055 ceph-mon[31863]: pgmap v7806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:28 smithi086 ceph-mon[35163]: pgmap v7807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13228.034122 secs 2024-03-28T09:40:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:28 smithi159 ceph-mon[36109]: pgmap v7807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13228.034122 secs 2024-03-28T09:40:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:28 smithi055 ceph-mon[31863]: pgmap v7807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13228.034122 secs 2024-03-28T09:40:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:30 smithi086 ceph-mon[35163]: pgmap v7808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:30 smithi159 ceph-mon[36109]: pgmap v7808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:30 smithi055 ceph-mon[31863]: pgmap v7808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:32 smithi086 ceph-mon[35163]: pgmap v7809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:32 smithi159 ceph-mon[36109]: pgmap v7809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:32 smithi055 ceph-mon[31863]: pgmap v7809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13233.034240 secs 2024-03-28T09:40:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13233.034240 secs 2024-03-28T09:40:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13233.034240 secs 2024-03-28T09:40:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:34 smithi086 ceph-mon[35163]: pgmap v7810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:34 smithi159 ceph-mon[36109]: pgmap v7810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:34 smithi055 ceph-mon[31863]: pgmap v7810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:36 smithi086 ceph-mon[35163]: pgmap v7811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:36 smithi159 ceph-mon[36109]: pgmap v7811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:36 smithi055 ceph-mon[31863]: pgmap v7811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:38 smithi055 ceph-mon[31863]: pgmap v7812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13238.034349 secs 2024-03-28T09:40:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:38 smithi086 ceph-mon[35163]: pgmap v7812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13238.034349 secs 2024-03-28T09:40:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:38 smithi159 ceph-mon[36109]: pgmap v7812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13238.034349 secs 2024-03-28T09:40:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:40 smithi055 ceph-mon[31863]: pgmap v7813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:40 smithi086 ceph-mon[35163]: pgmap v7813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:40 smithi159 ceph-mon[36109]: pgmap v7813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:40:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:40:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:40:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:42 smithi055 ceph-mon[31863]: pgmap v7814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:42 smithi086 ceph-mon[35163]: pgmap v7814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:42 smithi159 ceph-mon[36109]: pgmap v7814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13243.034424 secs 2024-03-28T09:40:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:40:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:40:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:40:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13243.034424 secs 2024-03-28T09:40:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:40:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:40:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:40:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13243.034424 secs 2024-03-28T09:40:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:40:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:40:44.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:40:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:44 smithi055 ceph-mon[31863]: pgmap v7815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:44 smithi055 ceph-mon[31863]: pgmap v7816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:40:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:44 smithi086 ceph-mon[35163]: pgmap v7815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:44 smithi086 ceph-mon[35163]: pgmap v7816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:40:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:44 smithi159 ceph-mon[36109]: pgmap v7815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:40:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:44 smithi159 ceph-mon[36109]: pgmap v7816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:40:46.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:46 smithi086 ceph-mon[35163]: pgmap v7817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:46.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:46 smithi159 ceph-mon[36109]: pgmap v7817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:46 smithi055 ceph-mon[31863]: pgmap v7817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:48 smithi159 ceph-mon[36109]: pgmap v7818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13248.034540 secs 2024-03-28T09:40:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:48 smithi055 ceph-mon[31863]: pgmap v7818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13248.034540 secs 2024-03-28T09:40:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:48 smithi086 ceph-mon[35163]: pgmap v7818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13248.034540 secs 2024-03-28T09:40:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:50 smithi086 ceph-mon[35163]: pgmap v7819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:50 smithi159 ceph-mon[36109]: pgmap v7819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:50 smithi055 ceph-mon[31863]: pgmap v7819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:52 smithi086 ceph-mon[35163]: pgmap v7820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:52 smithi159 ceph-mon[36109]: pgmap v7820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:52 smithi055 ceph-mon[31863]: pgmap v7820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:40:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13253.034605 secs 2024-03-28T09:40:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13253.034605 secs 2024-03-28T09:40:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13253.034605 secs 2024-03-28T09:40:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:54 smithi086 ceph-mon[35163]: pgmap v7821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:40:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:54 smithi159 ceph-mon[36109]: pgmap v7821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:40:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:54 smithi055 ceph-mon[31863]: pgmap v7821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:40:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:56 smithi086 ceph-mon[35163]: pgmap v7822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:56 smithi159 ceph-mon[36109]: pgmap v7822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:56 smithi055 ceph-mon[31863]: pgmap v7822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:58.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:58 smithi055 ceph-mon[31863]: pgmap v7823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:58.927 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:40:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13258.034692 secs 2024-03-28T09:40:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:58 smithi086 ceph-mon[35163]: pgmap v7823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:40:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13258.034692 secs 2024-03-28T09:40:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:58 smithi159 ceph-mon[36109]: pgmap v7823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:40:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:40:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13258.034692 secs 2024-03-28T09:41:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:00 smithi086 ceph-mon[35163]: pgmap v7824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:00 smithi159 ceph-mon[36109]: pgmap v7824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:00 smithi055 ceph-mon[31863]: pgmap v7824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:02 smithi086 ceph-mon[35163]: pgmap v7825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:02 smithi159 ceph-mon[36109]: pgmap v7825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:02 smithi055 ceph-mon[31863]: pgmap v7825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13263.034754 secs 2024-03-28T09:41:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13263.034754 secs 2024-03-28T09:41:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13263.034754 secs 2024-03-28T09:41:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:04 smithi086 ceph-mon[35163]: pgmap v7826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:04 smithi159 ceph-mon[36109]: pgmap v7826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:04 smithi055 ceph-mon[31863]: pgmap v7826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:06 smithi086 ceph-mon[35163]: pgmap v7827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:06 smithi159 ceph-mon[36109]: pgmap v7827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:06 smithi055 ceph-mon[31863]: pgmap v7827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:08 smithi086 ceph-mon[35163]: pgmap v7828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13268.034842 secs 2024-03-28T09:41:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:08 smithi159 ceph-mon[36109]: pgmap v7828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13268.034842 secs 2024-03-28T09:41:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:08 smithi055 ceph-mon[31863]: pgmap v7828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13268.034842 secs 2024-03-28T09:41:11.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:10 smithi055 ceph-mon[31863]: pgmap v7829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:10 smithi086 ceph-mon[35163]: pgmap v7829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:10 smithi159 ceph-mon[36109]: pgmap v7829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:12 smithi086 ceph-mon[35163]: pgmap v7830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:12 smithi159 ceph-mon[36109]: pgmap v7830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:12 smithi055 ceph-mon[31863]: pgmap v7830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13273.034927 secs 2024-03-28T09:41:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13273.034927 secs 2024-03-28T09:41:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13273.034927 secs 2024-03-28T09:41:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:14 smithi086 ceph-mon[35163]: pgmap v7831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:14 smithi159 ceph-mon[36109]: pgmap v7831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:14 smithi055 ceph-mon[31863]: pgmap v7831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:16 smithi086 ceph-mon[35163]: pgmap v7832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:16 smithi159 ceph-mon[36109]: pgmap v7832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:16 smithi055 ceph-mon[31863]: pgmap v7832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:18 smithi086 ceph-mon[35163]: pgmap v7833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13278.035008 secs 2024-03-28T09:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:18 smithi159 ceph-mon[36109]: pgmap v7833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13278.035008 secs 2024-03-28T09:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:18 smithi055 ceph-mon[31863]: pgmap v7833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13278.035008 secs 2024-03-28T09:41:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:20 smithi086 ceph-mon[35163]: pgmap v7834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:20 smithi159 ceph-mon[36109]: pgmap v7834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:20 smithi055 ceph-mon[31863]: pgmap v7834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:21 smithi086 ceph-mon[35163]: pgmap v7835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:21 smithi159 ceph-mon[36109]: pgmap v7835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:21 smithi055 ceph-mon[31863]: pgmap v7835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13283.035099 secs 2024-03-28T09:41:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:23 smithi086 ceph-mon[35163]: pgmap v7836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13283.035099 secs 2024-03-28T09:41:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:23 smithi159 ceph-mon[36109]: pgmap v7836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13283.035099 secs 2024-03-28T09:41:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:23 smithi055 ceph-mon[31863]: pgmap v7836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:25 smithi086 ceph-mon[35163]: pgmap v7837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:25 smithi159 ceph-mon[36109]: pgmap v7837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:25 smithi055 ceph-mon[31863]: pgmap v7837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:27 smithi055 ceph-mon[31863]: pgmap v7838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:27 smithi086 ceph-mon[35163]: pgmap v7838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:27 smithi159 ceph-mon[36109]: pgmap v7838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13288.035186 secs 2024-03-28T09:41:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13288.035186 secs 2024-03-28T09:41:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13288.035186 secs 2024-03-28T09:41:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:29 smithi055 ceph-mon[31863]: pgmap v7839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:29 smithi086 ceph-mon[35163]: pgmap v7839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:29 smithi159 ceph-mon[36109]: pgmap v7839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:32 smithi055 ceph-mon[31863]: pgmap v7840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:32 smithi086 ceph-mon[35163]: pgmap v7840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:32 smithi159 ceph-mon[36109]: pgmap v7840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13293.035306 secs 2024-03-28T09:41:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:34 smithi055 ceph-mon[31863]: pgmap v7841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13293.035306 secs 2024-03-28T09:41:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:34 smithi086 ceph-mon[35163]: pgmap v7841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13293.035306 secs 2024-03-28T09:41:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:34 smithi159 ceph-mon[36109]: pgmap v7841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:36 smithi055 ceph-mon[31863]: pgmap v7842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:36 smithi086 ceph-mon[35163]: pgmap v7842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:36 smithi159 ceph-mon[36109]: pgmap v7842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:38 smithi086 ceph-mon[35163]: pgmap v7843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:38 smithi159 ceph-mon[36109]: pgmap v7843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:38 smithi055 ceph-mon[31863]: pgmap v7843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13298.035421 secs 2024-03-28T09:41:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13298.035421 secs 2024-03-28T09:41:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13298.035421 secs 2024-03-28T09:41:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:40 smithi086 ceph-mon[35163]: pgmap v7844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:40 smithi159 ceph-mon[36109]: pgmap v7844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:40 smithi055 ceph-mon[31863]: pgmap v7844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:42 smithi086 ceph-mon[35163]: pgmap v7845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:42 smithi159 ceph-mon[36109]: pgmap v7845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:42 smithi055 ceph-mon[31863]: pgmap v7845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13303.035495 secs 2024-03-28T09:41:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:41:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13303.035495 secs 2024-03-28T09:41:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:41:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13303.035495 secs 2024-03-28T09:41:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:41:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:44 smithi086 ceph-mon[35163]: pgmap v7846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:44 smithi159 ceph-mon[36109]: pgmap v7846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:44 smithi055 ceph-mon[31863]: pgmap v7846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:44.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: pgmap v7847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: pgmap v7848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:41:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:41:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:41:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:41:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:41:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:41:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:41:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: pgmap v7847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: pgmap v7848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:41:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:41:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:41:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: pgmap v7847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:41:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: pgmap v7848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:41:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:47 smithi086 ceph-mon[35163]: pgmap v7849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:47 smithi159 ceph-mon[36109]: pgmap v7849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:47 smithi055 ceph-mon[31863]: pgmap v7849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13308.035556 secs 2024-03-28T09:41:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13308.035556 secs 2024-03-28T09:41:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13308.035556 secs 2024-03-28T09:41:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:49 smithi086 ceph-mon[35163]: pgmap v7850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:49 smithi159 ceph-mon[36109]: pgmap v7850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:49 smithi055 ceph-mon[31863]: pgmap v7850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:41:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:51 smithi086 ceph-mon[35163]: pgmap v7851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:51 smithi159 ceph-mon[36109]: pgmap v7851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:51 smithi055 ceph-mon[31863]: pgmap v7851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:53 smithi086 ceph-mon[35163]: pgmap v7852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:41:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13313.035681 secs 2024-03-28T09:41:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:53 smithi159 ceph-mon[36109]: pgmap v7852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:41:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13313.035681 secs 2024-03-28T09:41:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:53 smithi055 ceph-mon[31863]: pgmap v7852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:41:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13313.035681 secs 2024-03-28T09:41:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:55 smithi086 ceph-mon[35163]: pgmap v7853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:55 smithi159 ceph-mon[36109]: pgmap v7853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:55 smithi055 ceph-mon[31863]: pgmap v7853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:41:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:57 smithi086 ceph-mon[35163]: pgmap v7854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:57 smithi159 ceph-mon[36109]: pgmap v7854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:57 smithi055 ceph-mon[31863]: pgmap v7854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:41:59.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13318.035809 secs 2024-03-28T09:41:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13318.035809 secs 2024-03-28T09:41:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13318.035809 secs 2024-03-28T09:42:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:41:59 smithi086 ceph-mon[35163]: pgmap v7855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:00.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:41:59 smithi159 ceph-mon[36109]: pgmap v7855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:41:59 smithi055 ceph-mon[31863]: pgmap v7855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:01 smithi086 ceph-mon[35163]: pgmap v7856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:01 smithi159 ceph-mon[36109]: pgmap v7856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:01 smithi055 ceph-mon[31863]: pgmap v7856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:03 smithi086 ceph-mon[35163]: pgmap v7857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:42:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13323.035869 secs 2024-03-28T09:42:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:03 smithi159 ceph-mon[36109]: pgmap v7857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:42:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13323.035869 secs 2024-03-28T09:42:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:03 smithi055 ceph-mon[31863]: pgmap v7857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:42:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13323.035869 secs 2024-03-28T09:42:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:05 smithi086 ceph-mon[35163]: pgmap v7858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:05 smithi159 ceph-mon[36109]: pgmap v7858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:05 smithi055 ceph-mon[31863]: pgmap v7858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:07 smithi086 ceph-mon[35163]: pgmap v7859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:07 smithi159 ceph-mon[36109]: pgmap v7859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:07 smithi055 ceph-mon[31863]: pgmap v7859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13328.035906 secs 2024-03-28T09:42:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13328.035906 secs 2024-03-28T09:42:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13328.035906 secs 2024-03-28T09:42:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:09 smithi086 ceph-mon[35163]: pgmap v7860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:09 smithi159 ceph-mon[36109]: pgmap v7860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:09 smithi055 ceph-mon[31863]: pgmap v7860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:10 smithi086 ceph-mon[35163]: pgmap v7861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:10 smithi159 ceph-mon[36109]: pgmap v7861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:10 smithi055 ceph-mon[31863]: pgmap v7861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:13 smithi086 ceph-mon[35163]: pgmap v7862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13333.035979 secs 2024-03-28T09:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:13 smithi159 ceph-mon[36109]: pgmap v7862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13333.035979 secs 2024-03-28T09:42:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:13 smithi055 ceph-mon[31863]: pgmap v7862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13333.035979 secs 2024-03-28T09:42:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:15 smithi086 ceph-mon[35163]: pgmap v7863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:15 smithi159 ceph-mon[36109]: pgmap v7863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:15 smithi055 ceph-mon[31863]: pgmap v7863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:17 smithi086 ceph-mon[35163]: pgmap v7864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:17 smithi159 ceph-mon[36109]: pgmap v7864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:17 smithi055 ceph-mon[31863]: pgmap v7864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:18.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13338.036057 secs 2024-03-28T09:42:18.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13338.036057 secs 2024-03-28T09:42:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13338.036057 secs 2024-03-28T09:42:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:19 smithi086 ceph-mon[35163]: pgmap v7865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:19 smithi159 ceph-mon[36109]: pgmap v7865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:19 smithi055 ceph-mon[31863]: pgmap v7865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:21 smithi086 ceph-mon[35163]: pgmap v7866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:21 smithi159 ceph-mon[36109]: pgmap v7866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:21 smithi055 ceph-mon[31863]: pgmap v7866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:23 smithi086 ceph-mon[35163]: pgmap v7867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13343.036148 secs 2024-03-28T09:42:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:23 smithi159 ceph-mon[36109]: pgmap v7867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13343.036148 secs 2024-03-28T09:42:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:23 smithi055 ceph-mon[31863]: pgmap v7867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13343.036148 secs 2024-03-28T09:42:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:25 smithi086 ceph-mon[35163]: pgmap v7868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:25 smithi159 ceph-mon[36109]: pgmap v7868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:25 smithi055 ceph-mon[31863]: pgmap v7868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:27 smithi086 ceph-mon[35163]: pgmap v7869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:27 smithi159 ceph-mon[36109]: pgmap v7869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:27 smithi055 ceph-mon[31863]: pgmap v7869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:29.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13348.036227 secs 2024-03-28T09:42:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13348.036227 secs 2024-03-28T09:42:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13348.036227 secs 2024-03-28T09:42:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:29 smithi086 ceph-mon[35163]: pgmap v7870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:29 smithi159 ceph-mon[36109]: pgmap v7870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:29 smithi055 ceph-mon[31863]: pgmap v7870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:31 smithi086 ceph-mon[35163]: pgmap v7871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:31 smithi159 ceph-mon[36109]: pgmap v7871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:31 smithi055 ceph-mon[31863]: pgmap v7871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:33 smithi086 ceph-mon[35163]: pgmap v7872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13353.036304 secs 2024-03-28T09:42:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:33 smithi159 ceph-mon[36109]: pgmap v7872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13353.036304 secs 2024-03-28T09:42:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:33 smithi055 ceph-mon[31863]: pgmap v7872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13353.036304 secs 2024-03-28T09:42:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:34 smithi055 ceph-mon[31863]: pgmap v7873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:34 smithi086 ceph-mon[35163]: pgmap v7873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:34 smithi159 ceph-mon[36109]: pgmap v7873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:37 smithi086 ceph-mon[35163]: pgmap v7874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:37 smithi159 ceph-mon[36109]: pgmap v7874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:37 smithi055 ceph-mon[31863]: pgmap v7874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13358.036370 secs 2024-03-28T09:42:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13358.036370 secs 2024-03-28T09:42:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13358.036370 secs 2024-03-28T09:42:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:39 smithi086 ceph-mon[35163]: pgmap v7875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:39 smithi159 ceph-mon[36109]: pgmap v7875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:39 smithi055 ceph-mon[31863]: pgmap v7875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:41 smithi086 ceph-mon[35163]: pgmap v7876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:41 smithi159 ceph-mon[36109]: pgmap v7876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:41 smithi055 ceph-mon[31863]: pgmap v7876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:42:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:43 smithi086 ceph-mon[35163]: pgmap v7877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13363.036435 secs 2024-03-28T09:42:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:43 smithi159 ceph-mon[36109]: pgmap v7877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13363.036435 secs 2024-03-28T09:42:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:43 smithi055 ceph-mon[31863]: pgmap v7877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:42:44.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13363.036435 secs 2024-03-28T09:42:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:45 smithi086 ceph-mon[35163]: pgmap v7878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:42:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:45 smithi159 ceph-mon[36109]: pgmap v7878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:42:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:45 smithi055 ceph-mon[31863]: pgmap v7878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:42:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:42:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:42:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:42:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:42:47.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:42:47.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:42:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:42:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:42:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:42:47.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:47 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:47 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:42:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:47 smithi086 ceph-mon[35163]: pgmap v7879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:47 smithi086 ceph-mon[35163]: pgmap v7880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:47 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:42:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:47 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:42:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:47 smithi159 ceph-mon[36109]: pgmap v7879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:47 smithi159 ceph-mon[36109]: pgmap v7880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:47 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:42:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:47 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:42:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:47 smithi055 ceph-mon[31863]: pgmap v7879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:47 smithi055 ceph-mon[31863]: pgmap v7880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13368.036556 secs 2024-03-28T09:42:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13368.036556 secs 2024-03-28T09:42:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13368.036556 secs 2024-03-28T09:42:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:49 smithi086 ceph-mon[35163]: pgmap v7881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:49 smithi159 ceph-mon[36109]: pgmap v7881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:49 smithi055 ceph-mon[31863]: pgmap v7881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:51 smithi086 ceph-mon[35163]: pgmap v7882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:51 smithi159 ceph-mon[36109]: pgmap v7882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:51 smithi055 ceph-mon[31863]: pgmap v7882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:53 smithi086 ceph-mon[35163]: pgmap v7883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13373.036676 secs 2024-03-28T09:42:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:53 smithi159 ceph-mon[36109]: pgmap v7883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13373.036676 secs 2024-03-28T09:42:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:53 smithi055 ceph-mon[31863]: pgmap v7883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13373.036676 secs 2024-03-28T09:42:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:55 smithi086 ceph-mon[35163]: pgmap v7884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:55 smithi159 ceph-mon[36109]: pgmap v7884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:55 smithi055 ceph-mon[31863]: pgmap v7884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:42:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:56 smithi055 ceph-mon[31863]: pgmap v7885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:56 smithi086 ceph-mon[35163]: pgmap v7885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:56 smithi159 ceph-mon[36109]: pgmap v7885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:42:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13378.036822 secs 2024-03-28T09:42:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13378.036822 secs 2024-03-28T09:42:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13378.036822 secs 2024-03-28T09:42:59.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:42:59 smithi055 ceph-mon[31863]: pgmap v7886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:42:59 smithi086 ceph-mon[35163]: pgmap v7886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:42:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:42:59 smithi159 ceph-mon[36109]: pgmap v7886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:01 smithi086 ceph-mon[35163]: pgmap v7887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:01 smithi159 ceph-mon[36109]: pgmap v7887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:01 smithi055 ceph-mon[31863]: pgmap v7887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:03 smithi086 ceph-mon[35163]: pgmap v7888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13383.036887 secs 2024-03-28T09:43:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:03 smithi159 ceph-mon[36109]: pgmap v7888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13383.036887 secs 2024-03-28T09:43:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:03 smithi055 ceph-mon[31863]: pgmap v7888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13383.036887 secs 2024-03-28T09:43:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:05 smithi086 ceph-mon[35163]: pgmap v7889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:05 smithi159 ceph-mon[36109]: pgmap v7889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:05 smithi055 ceph-mon[31863]: pgmap v7889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:07 smithi086 ceph-mon[35163]: pgmap v7890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:07 smithi159 ceph-mon[36109]: pgmap v7890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:07 smithi055 ceph-mon[31863]: pgmap v7890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13388.036976 secs 2024-03-28T09:43:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13388.036976 secs 2024-03-28T09:43:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13388.036976 secs 2024-03-28T09:43:09.827 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:09 smithi086 ceph-mon[35163]: pgmap v7891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:09.827 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:09 smithi159 ceph-mon[36109]: pgmap v7891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:09.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:09 smithi055 ceph-mon[31863]: pgmap v7891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:11 smithi086 ceph-mon[35163]: pgmap v7892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:11 smithi159 ceph-mon[36109]: pgmap v7892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:11 smithi055 ceph-mon[31863]: pgmap v7892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:13 smithi086 ceph-mon[35163]: pgmap v7893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13393.037040 secs 2024-03-28T09:43:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:13 smithi159 ceph-mon[36109]: pgmap v7893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13393.037040 secs 2024-03-28T09:43:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:13 smithi055 ceph-mon[31863]: pgmap v7893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13393.037040 secs 2024-03-28T09:43:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:15 smithi086 ceph-mon[35163]: pgmap v7894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:15 smithi159 ceph-mon[36109]: pgmap v7894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:15 smithi055 ceph-mon[31863]: pgmap v7894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:17 smithi086 ceph-mon[35163]: pgmap v7895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:17 smithi159 ceph-mon[36109]: pgmap v7895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:17 smithi055 ceph-mon[31863]: pgmap v7895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13398.037107 secs 2024-03-28T09:43:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13398.037107 secs 2024-03-28T09:43:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13398.037107 secs 2024-03-28T09:43:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:19 smithi086 ceph-mon[35163]: pgmap v7896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:19 smithi159 ceph-mon[36109]: pgmap v7896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:19 smithi055 ceph-mon[31863]: pgmap v7896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:21 smithi086 ceph-mon[35163]: pgmap v7897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:21.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:21 smithi159 ceph-mon[36109]: pgmap v7897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:21 smithi055 ceph-mon[31863]: pgmap v7897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:23 smithi086 ceph-mon[35163]: pgmap v7898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13403.037185 secs 2024-03-28T09:43:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:23 smithi159 ceph-mon[36109]: pgmap v7898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13403.037185 secs 2024-03-28T09:43:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:23 smithi055 ceph-mon[31863]: pgmap v7898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13403.037185 secs 2024-03-28T09:43:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:25 smithi055 ceph-mon[31863]: pgmap v7899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:25 smithi086 ceph-mon[35163]: pgmap v7899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:25 smithi159 ceph-mon[36109]: pgmap v7899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:27 smithi055 ceph-mon[31863]: pgmap v7900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:27 smithi086 ceph-mon[35163]: pgmap v7900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:27 smithi159 ceph-mon[36109]: pgmap v7900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13408.037253 secs 2024-03-28T09:43:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13408.037253 secs 2024-03-28T09:43:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13408.037253 secs 2024-03-28T09:43:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:29 smithi055 ceph-mon[31863]: pgmap v7901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:29 smithi086 ceph-mon[35163]: pgmap v7901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:29 smithi159 ceph-mon[36109]: pgmap v7901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:31 smithi055 ceph-mon[31863]: pgmap v7902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:31 smithi086 ceph-mon[35163]: pgmap v7902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:31 smithi159 ceph-mon[36109]: pgmap v7902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:33 smithi055 ceph-mon[31863]: pgmap v7903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13413.037320 secs 2024-03-28T09:43:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:33 smithi086 ceph-mon[35163]: pgmap v7903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13413.037320 secs 2024-03-28T09:43:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:33 smithi159 ceph-mon[36109]: pgmap v7903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13413.037320 secs 2024-03-28T09:43:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:35 smithi055 ceph-mon[31863]: pgmap v7904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:35 smithi086 ceph-mon[35163]: pgmap v7904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:35 smithi159 ceph-mon[36109]: pgmap v7904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:37 smithi055 ceph-mon[31863]: pgmap v7905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:37 smithi086 ceph-mon[35163]: pgmap v7905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:37 smithi159 ceph-mon[36109]: pgmap v7905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13418.037414 secs 2024-03-28T09:43:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13418.037414 secs 2024-03-28T09:43:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13418.037414 secs 2024-03-28T09:43:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:39 smithi086 ceph-mon[35163]: pgmap v7906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:39 smithi159 ceph-mon[36109]: pgmap v7906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:39 smithi055 ceph-mon[31863]: pgmap v7906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:41 smithi086 ceph-mon[35163]: pgmap v7907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:42.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:41 smithi159 ceph-mon[36109]: pgmap v7907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:41 smithi055 ceph-mon[31863]: pgmap v7907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:43 smithi086 ceph-mon[35163]: pgmap v7908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13423.037495 secs 2024-03-28T09:43:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:43 smithi159 ceph-mon[36109]: pgmap v7908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13423.037495 secs 2024-03-28T09:43:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:43 smithi055 ceph-mon[31863]: pgmap v7908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13423.037495 secs 2024-03-28T09:43:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:45 smithi086 ceph-mon[35163]: pgmap v7909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:45 smithi159 ceph-mon[36109]: pgmap v7909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:45 smithi055 ceph-mon[31863]: pgmap v7909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:47 smithi086 ceph-mon[35163]: pgmap v7910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:43:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:47 smithi159 ceph-mon[36109]: pgmap v7910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:43:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:47 smithi055 ceph-mon[31863]: pgmap v7910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:43:48.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13428.037525 secs 2024-03-28T09:43:48.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13428.037525 secs 2024-03-28T09:43:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13428.037525 secs 2024-03-28T09:43:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:49 smithi055 ceph-mon[31863]: pgmap v7911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:49 smithi086 ceph-mon[35163]: pgmap v7911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:49 smithi159 ceph-mon[36109]: pgmap v7911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:51.780 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:51 smithi086 ceph-mon[35163]: pgmap v7912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:51 smithi159 ceph-mon[36109]: pgmap v7912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:51 smithi055 ceph-mon[31863]: pgmap v7912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:43:53.833 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:53 smithi055 ceph-mon[31863]: pgmap v7913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:53.833 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13433.037651 secs 2024-03-28T09:43:53.833 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:53.833 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:53 smithi086 ceph-mon[35163]: pgmap v7913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13433.037651 secs 2024-03-28T09:43:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:53 smithi159 ceph-mon[36109]: pgmap v7913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:43:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13433.037651 secs 2024-03-28T09:43:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: pgmap v7914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: pgmap v7915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:43:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:43:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: pgmap v7914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:43:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: pgmap v7915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:55.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: pgmap v7914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: pgmap v7915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:55.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:43:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:57 smithi086 ceph-mon[35163]: pgmap v7916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:57 smithi159 ceph-mon[36109]: pgmap v7916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:57 smithi055 ceph-mon[31863]: pgmap v7916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13438.037725 secs 2024-03-28T09:43:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:43:59 smithi086 ceph-mon[35163]: pgmap v7917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13438.037725 secs 2024-03-28T09:43:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:43:59 smithi159 ceph-mon[36109]: pgmap v7917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:43:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13438.037725 secs 2024-03-28T09:43:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:43:59 smithi055 ceph-mon[31863]: pgmap v7917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:01 smithi086 ceph-mon[35163]: pgmap v7918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:01 smithi159 ceph-mon[36109]: pgmap v7918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:01 smithi055 ceph-mon[31863]: pgmap v7918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:03 smithi086 ceph-mon[35163]: pgmap v7919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:03 smithi159 ceph-mon[36109]: pgmap v7919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:03 smithi055 ceph-mon[31863]: pgmap v7919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13443.037802 secs 2024-03-28T09:44:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13443.037802 secs 2024-03-28T09:44:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13443.037802 secs 2024-03-28T09:44:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:05 smithi086 ceph-mon[35163]: pgmap v7920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:05 smithi159 ceph-mon[36109]: pgmap v7920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:05 smithi055 ceph-mon[31863]: pgmap v7920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:07 smithi055 ceph-mon[31863]: pgmap v7921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:07 smithi086 ceph-mon[35163]: pgmap v7921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:07 smithi159 ceph-mon[36109]: pgmap v7921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13448.037924 secs 2024-03-28T09:44:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:09 smithi055 ceph-mon[31863]: pgmap v7922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13448.037924 secs 2024-03-28T09:44:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:09 smithi086 ceph-mon[35163]: pgmap v7922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13448.037924 secs 2024-03-28T09:44:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:09 smithi159 ceph-mon[36109]: pgmap v7922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:11 smithi055 ceph-mon[31863]: pgmap v7923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:11 smithi086 ceph-mon[35163]: pgmap v7923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:11.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:11 smithi159 ceph-mon[36109]: pgmap v7923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:13 smithi055 ceph-mon[31863]: pgmap v7924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:13 smithi086 ceph-mon[35163]: pgmap v7924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:13 smithi159 ceph-mon[36109]: pgmap v7924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13453.038039 secs 2024-03-28T09:44:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13453.038039 secs 2024-03-28T09:44:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13453.038039 secs 2024-03-28T09:44:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:15 smithi055 ceph-mon[31863]: pgmap v7925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:15 smithi086 ceph-mon[35163]: pgmap v7925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:15 smithi159 ceph-mon[36109]: pgmap v7925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:17 smithi055 ceph-mon[31863]: pgmap v7926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:17 smithi086 ceph-mon[35163]: pgmap v7926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:17 smithi159 ceph-mon[36109]: pgmap v7926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:19.371 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13458.038119 secs 2024-03-28T09:44:19.372 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:19 smithi086 ceph-mon[35163]: pgmap v7927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:19.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13458.038119 secs 2024-03-28T09:44:19.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:19 smithi159 ceph-mon[36109]: pgmap v7927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13458.038119 secs 2024-03-28T09:44:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:19 smithi055 ceph-mon[31863]: pgmap v7927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:21 smithi086 ceph-mon[35163]: pgmap v7928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:21.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:21 smithi159 ceph-mon[36109]: pgmap v7928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:21 smithi055 ceph-mon[31863]: pgmap v7928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:23 smithi086 ceph-mon[35163]: pgmap v7929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13463.038145 secs 2024-03-28T09:44:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:23 smithi159 ceph-mon[36109]: pgmap v7929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13463.038145 secs 2024-03-28T09:44:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:23 smithi055 ceph-mon[31863]: pgmap v7929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13463.038145 secs 2024-03-28T09:44:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:25 smithi086 ceph-mon[35163]: pgmap v7930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:25 smithi159 ceph-mon[36109]: pgmap v7930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:25 smithi055 ceph-mon[31863]: pgmap v7930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:27 smithi086 ceph-mon[35163]: pgmap v7931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:27 smithi159 ceph-mon[36109]: pgmap v7931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:27 smithi055 ceph-mon[31863]: pgmap v7931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13468.038265 secs 2024-03-28T09:44:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13468.038265 secs 2024-03-28T09:44:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13468.038265 secs 2024-03-28T09:44:29.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:29 smithi055 ceph-mon[31863]: pgmap v7932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:29 smithi086 ceph-mon[35163]: pgmap v7932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:29 smithi159 ceph-mon[36109]: pgmap v7932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:31 smithi086 ceph-mon[35163]: pgmap v7933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:31 smithi159 ceph-mon[36109]: pgmap v7933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:31 smithi055 ceph-mon[31863]: pgmap v7933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:33 smithi086 ceph-mon[35163]: pgmap v7934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13473.038389 secs 2024-03-28T09:44:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:33 smithi159 ceph-mon[36109]: pgmap v7934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13473.038389 secs 2024-03-28T09:44:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:33 smithi055 ceph-mon[31863]: pgmap v7934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13473.038389 secs 2024-03-28T09:44:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:35 smithi086 ceph-mon[35163]: pgmap v7935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:35 smithi159 ceph-mon[36109]: pgmap v7935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:35 smithi055 ceph-mon[31863]: pgmap v7935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:37 smithi086 ceph-mon[35163]: pgmap v7936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:37 smithi159 ceph-mon[36109]: pgmap v7936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:37 smithi055 ceph-mon[31863]: pgmap v7936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13478.038508 secs 2024-03-28T09:44:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13478.038508 secs 2024-03-28T09:44:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13478.038508 secs 2024-03-28T09:44:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:39 smithi086 ceph-mon[35163]: pgmap v7937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:39 smithi159 ceph-mon[36109]: pgmap v7937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:39 smithi055 ceph-mon[31863]: pgmap v7937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:41 smithi086 ceph-mon[35163]: pgmap v7938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:41 smithi159 ceph-mon[36109]: pgmap v7938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:41 smithi055 ceph-mon[31863]: pgmap v7938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:44:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:43 smithi086 ceph-mon[35163]: pgmap v7939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13483.038572 secs 2024-03-28T09:44:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:43 smithi159 ceph-mon[36109]: pgmap v7939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13483.038572 secs 2024-03-28T09:44:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:43 smithi055 ceph-mon[31863]: pgmap v7939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13483.038572 secs 2024-03-28T09:44:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:45 smithi086 ceph-mon[35163]: pgmap v7940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:45 smithi159 ceph-mon[36109]: pgmap v7940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:45 smithi055 ceph-mon[31863]: pgmap v7940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:44:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:47 smithi086 ceph-mon[35163]: pgmap v7941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:47 smithi159 ceph-mon[36109]: pgmap v7941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:47 smithi055 ceph-mon[31863]: pgmap v7941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13488.038634 secs 2024-03-28T09:44:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13488.038634 secs 2024-03-28T09:44:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13488.038634 secs 2024-03-28T09:44:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:49 smithi055 ceph-mon[31863]: pgmap v7942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:49.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:49 smithi086 ceph-mon[35163]: pgmap v7942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:49.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:49 smithi159 ceph-mon[36109]: pgmap v7942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:51 smithi055 ceph-mon[31863]: pgmap v7943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:51 smithi086 ceph-mon[35163]: pgmap v7943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:51 smithi159 ceph-mon[36109]: pgmap v7943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:44:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:53 smithi055 ceph-mon[31863]: pgmap v7944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13493.038718 secs 2024-03-28T09:44:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:53 smithi086 ceph-mon[35163]: pgmap v7944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13493.038718 secs 2024-03-28T09:44:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:53 smithi159 ceph-mon[36109]: pgmap v7944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13493.038718 secs 2024-03-28T09:44:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:44:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:44:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:44:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:55 smithi055 ceph-mon[31863]: pgmap v7945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:55.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:55 smithi086 ceph-mon[35163]: pgmap v7945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:55 smithi159 ceph-mon[36109]: pgmap v7945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:44:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:57 smithi159 ceph-mon[36109]: pgmap v7946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:57 smithi055 ceph-mon[31863]: pgmap v7946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:57 smithi086 ceph-mon[35163]: pgmap v7946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:44:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13498.038810 secs 2024-03-28T09:44:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13498.038810 secs 2024-03-28T09:44:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13498.038810 secs 2024-03-28T09:45:00.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:44:59 smithi055 ceph-mon[31863]: pgmap v7947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:44:59 smithi086 ceph-mon[35163]: pgmap v7947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:44:59 smithi159 ceph-mon[36109]: pgmap v7947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:01.725 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: pgmap v7948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:01.726 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:01.726 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:01.726 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:45:01.727 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:45:01.727 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: pgmap v7948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:45:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:45:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: pgmap v7948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:45:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:45:02.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:02 smithi086 ceph-mon[35163]: pgmap v7949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:02 smithi086 ceph-mon[35163]: pgmap v7950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:02 smithi159 ceph-mon[36109]: pgmap v7949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:45:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:02 smithi159 ceph-mon[36109]: pgmap v7950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:02 smithi055 ceph-mon[31863]: pgmap v7949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:45:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:02 smithi055 ceph-mon[31863]: pgmap v7950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13503.038903 secs 2024-03-28T09:45:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13503.038903 secs 2024-03-28T09:45:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13503.038903 secs 2024-03-28T09:45:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:04 smithi086 ceph-mon[35163]: pgmap v7951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:04 smithi159 ceph-mon[36109]: pgmap v7951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:04 smithi055 ceph-mon[31863]: pgmap v7951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:06 smithi086 ceph-mon[35163]: pgmap v7952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:06 smithi159 ceph-mon[36109]: pgmap v7952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:06 smithi055 ceph-mon[31863]: pgmap v7952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:08 smithi086 ceph-mon[35163]: pgmap v7953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13508.038969 secs 2024-03-28T09:45:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:08 smithi159 ceph-mon[36109]: pgmap v7953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13508.038969 secs 2024-03-28T09:45:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:08 smithi055 ceph-mon[31863]: pgmap v7953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13508.038969 secs 2024-03-28T09:45:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:10 smithi086 ceph-mon[35163]: pgmap v7954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:10 smithi159 ceph-mon[36109]: pgmap v7954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:10 smithi055 ceph-mon[31863]: pgmap v7954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T09:45:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:12 smithi086 ceph-mon[35163]: pgmap v7955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:45:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:12 smithi159 ceph-mon[36109]: pgmap v7955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:45:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:12 smithi055 ceph-mon[31863]: pgmap v7955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:45:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13513.039062 secs 2024-03-28T09:45:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13513.039062 secs 2024-03-28T09:45:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13513.039062 secs 2024-03-28T09:45:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:14 smithi086 ceph-mon[35163]: pgmap v7956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:14 smithi159 ceph-mon[36109]: pgmap v7956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:14 smithi055 ceph-mon[31863]: pgmap v7956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:16 smithi086 ceph-mon[35163]: pgmap v7957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:16 smithi159 ceph-mon[36109]: pgmap v7957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:16 smithi055 ceph-mon[31863]: pgmap v7957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:18 smithi086 ceph-mon[35163]: pgmap v7958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13518.039127 secs 2024-03-28T09:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:18 smithi159 ceph-mon[36109]: pgmap v7958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13518.039127 secs 2024-03-28T09:45:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:18 smithi055 ceph-mon[31863]: pgmap v7958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13518.039127 secs 2024-03-28T09:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:20 smithi086 ceph-mon[35163]: pgmap v7959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:20 smithi159 ceph-mon[36109]: pgmap v7959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:20 smithi055 ceph-mon[31863]: pgmap v7959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:22 smithi159 ceph-mon[36109]: pgmap v7960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:22 smithi086 ceph-mon[35163]: pgmap v7960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:22 smithi055 ceph-mon[31863]: pgmap v7960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13523.039251 secs 2024-03-28T09:45:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13523.039251 secs 2024-03-28T09:45:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13523.039251 secs 2024-03-28T09:45:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:24 smithi086 ceph-mon[35163]: pgmap v7961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:24 smithi159 ceph-mon[36109]: pgmap v7961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:24 smithi055 ceph-mon[31863]: pgmap v7961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:26 smithi086 ceph-mon[35163]: pgmap v7962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:26 smithi159 ceph-mon[36109]: pgmap v7962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:26 smithi055 ceph-mon[31863]: pgmap v7962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:28 smithi086 ceph-mon[35163]: pgmap v7963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13528.039374 secs 2024-03-28T09:45:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:28 smithi159 ceph-mon[36109]: pgmap v7963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13528.039374 secs 2024-03-28T09:45:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:28 smithi055 ceph-mon[31863]: pgmap v7963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13528.039374 secs 2024-03-28T09:45:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:30 smithi086 ceph-mon[35163]: pgmap v7964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:30 smithi159 ceph-mon[36109]: pgmap v7964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:30 smithi055 ceph-mon[31863]: pgmap v7964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:32 smithi086 ceph-mon[35163]: pgmap v7965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:32 smithi159 ceph-mon[36109]: pgmap v7965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:32 smithi055 ceph-mon[31863]: pgmap v7965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13533.039495 secs 2024-03-28T09:45:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13533.039495 secs 2024-03-28T09:45:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13533.039495 secs 2024-03-28T09:45:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:34 smithi086 ceph-mon[35163]: pgmap v7966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:34 smithi159 ceph-mon[36109]: pgmap v7966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:34 smithi055 ceph-mon[31863]: pgmap v7966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:35 smithi055 ceph-mon[31863]: pgmap v7967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:35 smithi086 ceph-mon[35163]: pgmap v7967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:35 smithi159 ceph-mon[36109]: pgmap v7967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:38 smithi086 ceph-mon[35163]: pgmap v7968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:38 smithi159 ceph-mon[36109]: pgmap v7968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:38 smithi055 ceph-mon[31863]: pgmap v7968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13538.039617 secs 2024-03-28T09:45:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13538.039617 secs 2024-03-28T09:45:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13538.039617 secs 2024-03-28T09:45:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:40 smithi086 ceph-mon[35163]: pgmap v7969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:40 smithi159 ceph-mon[36109]: pgmap v7969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:40 smithi055 ceph-mon[31863]: pgmap v7969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:42 smithi086 ceph-mon[35163]: pgmap v7970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:42 smithi159 ceph-mon[36109]: pgmap v7970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:42 smithi055 ceph-mon[31863]: pgmap v7970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13543.039739 secs 2024-03-28T09:45:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:44 smithi055 ceph-mon[31863]: pgmap v7971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13543.039739 secs 2024-03-28T09:45:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:44 smithi086 ceph-mon[35163]: pgmap v7971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13543.039739 secs 2024-03-28T09:45:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:44 smithi159 ceph-mon[36109]: pgmap v7971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:46 smithi055 ceph-mon[31863]: pgmap v7972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:46 smithi086 ceph-mon[35163]: pgmap v7972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:46 smithi159 ceph-mon[36109]: pgmap v7972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:48 smithi055 ceph-mon[31863]: pgmap v7973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:48 smithi086 ceph-mon[35163]: pgmap v7973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:48 smithi159 ceph-mon[36109]: pgmap v7973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13548.039817 secs 2024-03-28T09:45:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13548.039817 secs 2024-03-28T09:45:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13548.039817 secs 2024-03-28T09:45:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:50 smithi055 ceph-mon[31863]: pgmap v7974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:50.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:50 smithi086 ceph-mon[35163]: pgmap v7974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:50.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:50 smithi159 ceph-mon[36109]: pgmap v7974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:52 smithi055 ceph-mon[31863]: pgmap v7975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:52 smithi086 ceph-mon[35163]: pgmap v7975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:52.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:52 smithi159 ceph-mon[36109]: pgmap v7975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13553.039904 secs 2024-03-28T09:45:54.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:54 smithi055 ceph-mon[31863]: pgmap v7976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13553.039904 secs 2024-03-28T09:45:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:54 smithi086 ceph-mon[35163]: pgmap v7976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13553.039904 secs 2024-03-28T09:45:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:54 smithi159 ceph-mon[36109]: pgmap v7976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:56 smithi086 ceph-mon[35163]: pgmap v7977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:56 smithi159 ceph-mon[36109]: pgmap v7977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:56 smithi055 ceph-mon[31863]: pgmap v7977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:58 smithi086 ceph-mon[35163]: pgmap v7978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:58 smithi159 ceph-mon[36109]: pgmap v7978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:58 smithi055 ceph-mon[31863]: pgmap v7978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:45:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:45:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13558.039986 secs 2024-03-28T09:45:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:45:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13558.039986 secs 2024-03-28T09:45:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:45:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13558.039986 secs 2024-03-28T09:46:00.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:00 smithi055 ceph-mon[31863]: pgmap v7979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:00 smithi086 ceph-mon[35163]: pgmap v7979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:00.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:00 smithi159 ceph-mon[36109]: pgmap v7979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:02 smithi086 ceph-mon[35163]: pgmap v7980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:46:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:02 smithi159 ceph-mon[36109]: pgmap v7980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:46:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:02 smithi055 ceph-mon[31863]: pgmap v7980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:46:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:03.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13563.040081 secs 2024-03-28T09:46:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:04 smithi055 ceph-mon[31863]: pgmap v7981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13563.040081 secs 2024-03-28T09:46:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:04 smithi086 ceph-mon[35163]: pgmap v7981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13563.040081 secs 2024-03-28T09:46:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:04 smithi159 ceph-mon[36109]: pgmap v7981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:05.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:06.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:06 smithi086 ceph-mon[35163]: pgmap v7982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:06 smithi159 ceph-mon[36109]: pgmap v7982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:06 smithi055 ceph-mon[31863]: pgmap v7982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:46:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:46:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:46:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:46:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:46:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:46:08.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:46:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:08 smithi086 ceph-mon[35163]: pgmap v7983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:08 smithi086 ceph-mon[35163]: pgmap v7984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:46:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:08 smithi086 ceph-mon[35163]: pgmap v7985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13568.040204 secs 2024-03-28T09:46:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:08 smithi159 ceph-mon[36109]: pgmap v7983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:08 smithi159 ceph-mon[36109]: pgmap v7984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:46:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:08 smithi159 ceph-mon[36109]: pgmap v7985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13568.040204 secs 2024-03-28T09:46:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:08 smithi055 ceph-mon[31863]: pgmap v7983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:08 smithi055 ceph-mon[31863]: pgmap v7984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:46:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:08 smithi055 ceph-mon[31863]: pgmap v7985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:09.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13568.040204 secs 2024-03-28T09:46:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:10 smithi086 ceph-mon[35163]: pgmap v7986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:10 smithi159 ceph-mon[36109]: pgmap v7986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:10 smithi055 ceph-mon[31863]: pgmap v7986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:12 smithi086 ceph-mon[35163]: pgmap v7987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:12 smithi159 ceph-mon[36109]: pgmap v7987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:12 smithi055 ceph-mon[31863]: pgmap v7987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T09:46:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13573.040279 secs 2024-03-28T09:46:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13573.040279 secs 2024-03-28T09:46:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13573.040279 secs 2024-03-28T09:46:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:14 smithi086 ceph-mon[35163]: pgmap v7988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:14 smithi159 ceph-mon[36109]: pgmap v7988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:14 smithi055 ceph-mon[31863]: pgmap v7988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:16 smithi086 ceph-mon[35163]: pgmap v7989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:16 smithi159 ceph-mon[36109]: pgmap v7989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:16 smithi055 ceph-mon[31863]: pgmap v7989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:46:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:18 smithi086 ceph-mon[35163]: pgmap v7990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:46:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13578.040329 secs 2024-03-28T09:46:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:18 smithi159 ceph-mon[36109]: pgmap v7990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:46:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13578.040329 secs 2024-03-28T09:46:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:18 smithi055 ceph-mon[31863]: pgmap v7990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:46:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13578.040329 secs 2024-03-28T09:46:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:20 smithi086 ceph-mon[35163]: pgmap v7991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:20 smithi159 ceph-mon[36109]: pgmap v7991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:20 smithi055 ceph-mon[31863]: pgmap v7991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:22.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:22 smithi159 ceph-mon[36109]: pgmap v7992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:22 smithi086 ceph-mon[35163]: pgmap v7992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:22 smithi055 ceph-mon[31863]: pgmap v7992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13583.040392 secs 2024-03-28T09:46:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13583.040392 secs 2024-03-28T09:46:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13583.040392 secs 2024-03-28T09:46:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:24 smithi086 ceph-mon[35163]: pgmap v7993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:24 smithi159 ceph-mon[36109]: pgmap v7993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:24 smithi055 ceph-mon[31863]: pgmap v7993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:26 smithi086 ceph-mon[35163]: pgmap v7994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:26 smithi159 ceph-mon[36109]: pgmap v7994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:26 smithi055 ceph-mon[31863]: pgmap v7994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:28 smithi086 ceph-mon[35163]: pgmap v7995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13588.040517 secs 2024-03-28T09:46:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:28 smithi159 ceph-mon[36109]: pgmap v7995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13588.040517 secs 2024-03-28T09:46:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:28 smithi055 ceph-mon[31863]: pgmap v7995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13588.040517 secs 2024-03-28T09:46:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:30 smithi086 ceph-mon[35163]: pgmap v7996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:30 smithi159 ceph-mon[36109]: pgmap v7996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:30 smithi055 ceph-mon[31863]: pgmap v7996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:32 smithi086 ceph-mon[35163]: pgmap v7997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:32 smithi159 ceph-mon[36109]: pgmap v7997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:32 smithi055 ceph-mon[31863]: pgmap v7997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13593.040601 secs 2024-03-28T09:46:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13593.040601 secs 2024-03-28T09:46:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13593.040601 secs 2024-03-28T09:46:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:34 smithi086 ceph-mon[35163]: pgmap v7998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:34 smithi159 ceph-mon[36109]: pgmap v7998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:34 smithi055 ceph-mon[31863]: pgmap v7998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:36 smithi086 ceph-mon[35163]: pgmap v7999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:36 smithi159 ceph-mon[36109]: pgmap v7999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:36 smithi055 ceph-mon[31863]: pgmap v7999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:38 smithi086 ceph-mon[35163]: pgmap v8000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13598.040725 secs 2024-03-28T09:46:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:38 smithi159 ceph-mon[36109]: pgmap v8000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:39.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13598.040725 secs 2024-03-28T09:46:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:38 smithi055 ceph-mon[31863]: pgmap v8000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13598.040725 secs 2024-03-28T09:46:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:40 smithi086 ceph-mon[35163]: pgmap v8001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:40 smithi159 ceph-mon[36109]: pgmap v8001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:40 smithi055 ceph-mon[31863]: pgmap v8001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:42 smithi086 ceph-mon[35163]: pgmap v8002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:42 smithi159 ceph-mon[36109]: pgmap v8002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:42 smithi055 ceph-mon[31863]: pgmap v8002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13603.040756 secs 2024-03-28T09:46:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13603.040756 secs 2024-03-28T09:46:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13603.040756 secs 2024-03-28T09:46:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:44 smithi086 ceph-mon[35163]: pgmap v8003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:44 smithi159 ceph-mon[36109]: pgmap v8003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:44 smithi055 ceph-mon[31863]: pgmap v8003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:45 smithi055 ceph-mon[31863]: pgmap v8004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:45 smithi086 ceph-mon[35163]: pgmap v8004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:45 smithi159 ceph-mon[36109]: pgmap v8004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:48 smithi055 ceph-mon[31863]: pgmap v8005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13608.040880 secs 2024-03-28T09:46:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:48 smithi086 ceph-mon[35163]: pgmap v8005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13608.040880 secs 2024-03-28T09:46:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:48 smithi159 ceph-mon[36109]: pgmap v8005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13608.040880 secs 2024-03-28T09:46:50.869 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:50 smithi086 ceph-mon[35163]: pgmap v8006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:50.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:50 smithi159 ceph-mon[36109]: pgmap v8006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:50 smithi055 ceph-mon[31863]: pgmap v8006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:52 smithi055 ceph-mon[31863]: pgmap v8007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:52 smithi086 ceph-mon[35163]: pgmap v8007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:52 smithi159 ceph-mon[36109]: pgmap v8007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13613.041001 secs 2024-03-28T09:46:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13613.041001 secs 2024-03-28T09:46:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13613.041001 secs 2024-03-28T09:46:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:54 smithi086 ceph-mon[35163]: pgmap v8008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:54 smithi159 ceph-mon[36109]: pgmap v8008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:54 smithi055 ceph-mon[31863]: pgmap v8008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:46:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:56 smithi086 ceph-mon[35163]: pgmap v8009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:56 smithi159 ceph-mon[36109]: pgmap v8009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:56 smithi055 ceph-mon[31863]: pgmap v8009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:46:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:58 smithi086 ceph-mon[35163]: pgmap v8010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:46:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13618.041123 secs 2024-03-28T09:46:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:58 smithi159 ceph-mon[36109]: pgmap v8010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:46:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13618.041123 secs 2024-03-28T09:46:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:58 smithi055 ceph-mon[31863]: pgmap v8010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:46:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:46:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13618.041123 secs 2024-03-28T09:47:00.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:00 smithi055 ceph-mon[31863]: pgmap v8011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:00 smithi086 ceph-mon[35163]: pgmap v8011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:00 smithi159 ceph-mon[36109]: pgmap v8011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:02 smithi086 ceph-mon[35163]: pgmap v8012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:02 smithi159 ceph-mon[36109]: pgmap v8012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:02 smithi055 ceph-mon[31863]: pgmap v8012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13623.041186 secs 2024-03-28T09:47:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13623.041186 secs 2024-03-28T09:47:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13623.041186 secs 2024-03-28T09:47:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:04 smithi086 ceph-mon[35163]: pgmap v8013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:04 smithi159 ceph-mon[36109]: pgmap v8013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:04 smithi055 ceph-mon[31863]: pgmap v8013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:06 smithi086 ceph-mon[35163]: pgmap v8014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:06 smithi159 ceph-mon[36109]: pgmap v8014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:06 smithi055 ceph-mon[31863]: pgmap v8014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:08 smithi086 ceph-mon[35163]: pgmap v8015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13628.041251 secs 2024-03-28T09:47:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:47:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:08 smithi159 ceph-mon[36109]: pgmap v8015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13628.041251 secs 2024-03-28T09:47:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:47:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:08 smithi055 ceph-mon[31863]: pgmap v8015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13628.041251 secs 2024-03-28T09:47:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:47:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:47:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:47:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:47:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:47:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:47:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:47:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:47:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:47:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:47:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:10 smithi086 ceph-mon[35163]: pgmap v8016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:10 smithi159 ceph-mon[36109]: pgmap v8016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:10 smithi055 ceph-mon[31863]: pgmap v8016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:12 smithi086 ceph-mon[35163]: pgmap v8017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:12 smithi159 ceph-mon[36109]: pgmap v8017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:12 smithi055 ceph-mon[31863]: pgmap v8017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13633.041316 secs 2024-03-28T09:47:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13633.041316 secs 2024-03-28T09:47:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13633.041316 secs 2024-03-28T09:47:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:14 smithi086 ceph-mon[35163]: pgmap v8018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:14 smithi159 ceph-mon[36109]: pgmap v8018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:14 smithi055 ceph-mon[31863]: pgmap v8018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:16 smithi086 ceph-mon[35163]: pgmap v8019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:16 smithi159 ceph-mon[36109]: pgmap v8019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:16 smithi055 ceph-mon[31863]: pgmap v8019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:18 smithi086 ceph-mon[35163]: pgmap v8020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13638.041394 secs 2024-03-28T09:47:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:18 smithi159 ceph-mon[36109]: pgmap v8020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13638.041394 secs 2024-03-28T09:47:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:18 smithi055 ceph-mon[31863]: pgmap v8020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13638.041394 secs 2024-03-28T09:47:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:20 smithi086 ceph-mon[35163]: pgmap v8021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:20 smithi159 ceph-mon[36109]: pgmap v8021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:20 smithi055 ceph-mon[31863]: pgmap v8021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:22 smithi086 ceph-mon[35163]: pgmap v8022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:22 smithi159 ceph-mon[36109]: pgmap v8022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:22 smithi055 ceph-mon[31863]: pgmap v8022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13643.041466 secs 2024-03-28T09:47:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13643.041466 secs 2024-03-28T09:47:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13643.041466 secs 2024-03-28T09:47:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:24 smithi086 ceph-mon[35163]: pgmap v8023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:24 smithi159 ceph-mon[36109]: pgmap v8023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:24 smithi055 ceph-mon[31863]: pgmap v8023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:26 smithi086 ceph-mon[35163]: pgmap v8024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:26 smithi159 ceph-mon[36109]: pgmap v8024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:26 smithi055 ceph-mon[31863]: pgmap v8024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:28 smithi086 ceph-mon[35163]: pgmap v8025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13648.041587 secs 2024-03-28T09:47:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:28 smithi159 ceph-mon[36109]: pgmap v8025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13648.041587 secs 2024-03-28T09:47:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:28 smithi055 ceph-mon[31863]: pgmap v8025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13648.041587 secs 2024-03-28T09:47:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:30 smithi086 ceph-mon[35163]: pgmap v8026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:30 smithi159 ceph-mon[36109]: pgmap v8026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:30 smithi055 ceph-mon[31863]: pgmap v8026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:32 smithi086 ceph-mon[35163]: pgmap v8027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:32 smithi159 ceph-mon[36109]: pgmap v8027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:32 smithi055 ceph-mon[31863]: pgmap v8027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13653.041652 secs 2024-03-28T09:47:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13653.041652 secs 2024-03-28T09:47:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13653.041652 secs 2024-03-28T09:47:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:34 smithi055 ceph-mon[31863]: pgmap v8028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:34 smithi086 ceph-mon[35163]: pgmap v8028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:34 smithi159 ceph-mon[36109]: pgmap v8028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:36 smithi055 ceph-mon[31863]: pgmap v8029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:36 smithi086 ceph-mon[35163]: pgmap v8029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:36 smithi159 ceph-mon[36109]: pgmap v8029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:37 smithi055 ceph-mon[31863]: pgmap v8030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:37 smithi086 ceph-mon[35163]: pgmap v8030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:37 smithi159 ceph-mon[36109]: pgmap v8030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13658.041797 secs 2024-03-28T09:47:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13658.041797 secs 2024-03-28T09:47:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13658.041797 secs 2024-03-28T09:47:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:39 smithi055 ceph-mon[31863]: pgmap v8031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:39 smithi086 ceph-mon[35163]: pgmap v8031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:39 smithi159 ceph-mon[36109]: pgmap v8031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:42 smithi086 ceph-mon[35163]: pgmap v8032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:42 smithi159 ceph-mon[36109]: pgmap v8032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:42 smithi055 ceph-mon[31863]: pgmap v8032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13663.041866 secs 2024-03-28T09:47:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:44 smithi086 ceph-mon[35163]: pgmap v8033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13663.041866 secs 2024-03-28T09:47:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:44 smithi159 ceph-mon[36109]: pgmap v8033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13663.041866 secs 2024-03-28T09:47:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:44 smithi055 ceph-mon[31863]: pgmap v8033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:46 smithi086 ceph-mon[35163]: pgmap v8034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:47:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:46 smithi159 ceph-mon[36109]: pgmap v8034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:47:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:46 smithi055 ceph-mon[31863]: pgmap v8034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:47:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:48 smithi086 ceph-mon[35163]: pgmap v8035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:47:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:48 smithi159 ceph-mon[36109]: pgmap v8035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:47:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:48 smithi055 ceph-mon[31863]: pgmap v8035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:47:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13668.041955 secs 2024-03-28T09:47:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13668.041955 secs 2024-03-28T09:47:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13668.041955 secs 2024-03-28T09:47:50.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:50 smithi086 ceph-mon[35163]: pgmap v8036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:50.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:50 smithi159 ceph-mon[36109]: pgmap v8036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:50 smithi055 ceph-mon[31863]: pgmap v8036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:52 smithi086 ceph-mon[35163]: pgmap v8037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:52 smithi159 ceph-mon[36109]: pgmap v8037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:52 smithi055 ceph-mon[31863]: pgmap v8037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:47:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13673.042043 secs 2024-03-28T09:47:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:54 smithi086 ceph-mon[35163]: pgmap v8038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13673.042043 secs 2024-03-28T09:47:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:54 smithi159 ceph-mon[36109]: pgmap v8038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13673.042043 secs 2024-03-28T09:47:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:54 smithi055 ceph-mon[31863]: pgmap v8038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:47:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:56 smithi086 ceph-mon[35163]: pgmap v8039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:56 smithi159 ceph-mon[36109]: pgmap v8039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:56 smithi055 ceph-mon[31863]: pgmap v8039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:47:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:58 smithi086 ceph-mon[35163]: pgmap v8040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:47:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13678.042121 secs 2024-03-28T09:47:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:58 smithi159 ceph-mon[36109]: pgmap v8040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:47:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13678.042121 secs 2024-03-28T09:47:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:58 smithi055 ceph-mon[31863]: pgmap v8040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:47:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:47:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13678.042121 secs 2024-03-28T09:48:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:00 smithi086 ceph-mon[35163]: pgmap v8041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:00 smithi159 ceph-mon[36109]: pgmap v8041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:00 smithi055 ceph-mon[31863]: pgmap v8041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:02 smithi086 ceph-mon[35163]: pgmap v8042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:02 smithi159 ceph-mon[36109]: pgmap v8042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:02 smithi055 ceph-mon[31863]: pgmap v8042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13683.042185 secs 2024-03-28T09:48:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13683.042185 secs 2024-03-28T09:48:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13683.042185 secs 2024-03-28T09:48:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:04 smithi086 ceph-mon[35163]: pgmap v8043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:04 smithi159 ceph-mon[36109]: pgmap v8043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:04 smithi055 ceph-mon[31863]: pgmap v8043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:06 smithi086 ceph-mon[35163]: pgmap v8044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:48:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:06 smithi159 ceph-mon[36109]: pgmap v8044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:48:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:06 smithi055 ceph-mon[31863]: pgmap v8044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:48:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:08 smithi086 ceph-mon[35163]: pgmap v8045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13688.042308 secs 2024-03-28T09:48:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:08 smithi159 ceph-mon[36109]: pgmap v8045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13688.042308 secs 2024-03-28T09:48:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:08 smithi055 ceph-mon[31863]: pgmap v8045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13688.042308 secs 2024-03-28T09:48:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:10 smithi086 ceph-mon[35163]: pgmap v8046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:48:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:10 smithi159 ceph-mon[36109]: pgmap v8046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:48:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:10 smithi055 ceph-mon[31863]: pgmap v8046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:48:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:48:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:48:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:48:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:48:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:48:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:48:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:48:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:48:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:48:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:12 smithi086 ceph-mon[35163]: pgmap v8047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:12 smithi086 ceph-mon[35163]: pgmap v8048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:12 smithi159 ceph-mon[36109]: pgmap v8047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:12 smithi159 ceph-mon[36109]: pgmap v8048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:12 smithi055 ceph-mon[31863]: pgmap v8047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:12 smithi055 ceph-mon[31863]: pgmap v8048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13693.042374 secs 2024-03-28T09:48:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13693.042374 secs 2024-03-28T09:48:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13693.042374 secs 2024-03-28T09:48:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:14 smithi086 ceph-mon[35163]: pgmap v8049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:14.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:14 smithi159 ceph-mon[36109]: pgmap v8049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:14 smithi055 ceph-mon[31863]: pgmap v8049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:16 smithi086 ceph-mon[35163]: pgmap v8050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:48:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:16 smithi159 ceph-mon[36109]: pgmap v8050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:48:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:16 smithi055 ceph-mon[31863]: pgmap v8050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:48:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:18 smithi055 ceph-mon[31863]: pgmap v8051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:18.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13698.042500 secs 2024-03-28T09:48:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:18 smithi086 ceph-mon[35163]: pgmap v8051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13698.042500 secs 2024-03-28T09:48:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:18 smithi159 ceph-mon[36109]: pgmap v8051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13698.042500 secs 2024-03-28T09:48:20.871 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:20 smithi086 ceph-mon[35163]: pgmap v8052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:20.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:20 smithi159 ceph-mon[36109]: pgmap v8052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:20 smithi055 ceph-mon[31863]: pgmap v8052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:48:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:22 smithi086 ceph-mon[35163]: pgmap v8053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:48:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:22 smithi159 ceph-mon[36109]: pgmap v8053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:48:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:22 smithi055 ceph-mon[31863]: pgmap v8053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:48:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13703.042621 secs 2024-03-28T09:48:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13703.042621 secs 2024-03-28T09:48:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13703.042621 secs 2024-03-28T09:48:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:24 smithi086 ceph-mon[35163]: pgmap v8054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:24 smithi159 ceph-mon[36109]: pgmap v8054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:24 smithi055 ceph-mon[31863]: pgmap v8054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:26 smithi086 ceph-mon[35163]: pgmap v8055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:26 smithi159 ceph-mon[36109]: pgmap v8055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:26 smithi055 ceph-mon[31863]: pgmap v8055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:28 smithi086 ceph-mon[35163]: pgmap v8056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13708.042696 secs 2024-03-28T09:48:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:28 smithi159 ceph-mon[36109]: pgmap v8056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13708.042696 secs 2024-03-28T09:48:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:28 smithi055 ceph-mon[31863]: pgmap v8056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13708.042696 secs 2024-03-28T09:48:30.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:30 smithi055 ceph-mon[31863]: pgmap v8057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:30 smithi086 ceph-mon[35163]: pgmap v8057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:30 smithi159 ceph-mon[36109]: pgmap v8057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:32 smithi086 ceph-mon[35163]: pgmap v8058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:32 smithi159 ceph-mon[36109]: pgmap v8058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:32 smithi055 ceph-mon[31863]: pgmap v8058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13713.042821 secs 2024-03-28T09:48:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13713.042821 secs 2024-03-28T09:48:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13713.042821 secs 2024-03-28T09:48:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:34 smithi086 ceph-mon[35163]: pgmap v8059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:34 smithi159 ceph-mon[36109]: pgmap v8059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:34 smithi055 ceph-mon[31863]: pgmap v8059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:36 smithi086 ceph-mon[35163]: pgmap v8060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:36 smithi159 ceph-mon[36109]: pgmap v8060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:36 smithi055 ceph-mon[31863]: pgmap v8060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:38 smithi086 ceph-mon[35163]: pgmap v8061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13718.042897 secs 2024-03-28T09:48:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:38 smithi159 ceph-mon[36109]: pgmap v8061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13718.042897 secs 2024-03-28T09:48:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:38 smithi055 ceph-mon[31863]: pgmap v8061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13718.042897 secs 2024-03-28T09:48:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:40 smithi086 ceph-mon[35163]: pgmap v8062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:40 smithi159 ceph-mon[36109]: pgmap v8062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:40 smithi055 ceph-mon[31863]: pgmap v8062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:42 smithi086 ceph-mon[35163]: pgmap v8063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:42 smithi159 ceph-mon[36109]: pgmap v8063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:42 smithi055 ceph-mon[31863]: pgmap v8063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13723.042963 secs 2024-03-28T09:48:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13723.042963 secs 2024-03-28T09:48:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13723.042963 secs 2024-03-28T09:48:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:44 smithi086 ceph-mon[35163]: pgmap v8064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:44 smithi159 ceph-mon[36109]: pgmap v8064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:44 smithi055 ceph-mon[31863]: pgmap v8064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:46 smithi086 ceph-mon[35163]: pgmap v8065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:46 smithi159 ceph-mon[36109]: pgmap v8065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:46 smithi055 ceph-mon[31863]: pgmap v8065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:48 smithi086 ceph-mon[35163]: pgmap v8066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13728.043028 secs 2024-03-28T09:48:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:48 smithi159 ceph-mon[36109]: pgmap v8066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13728.043028 secs 2024-03-28T09:48:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:48 smithi055 ceph-mon[31863]: pgmap v8066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13728.043028 secs 2024-03-28T09:48:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:50 smithi086 ceph-mon[35163]: pgmap v8067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:50 smithi159 ceph-mon[36109]: pgmap v8067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:50 smithi055 ceph-mon[31863]: pgmap v8067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:52 smithi086 ceph-mon[35163]: pgmap v8068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:52 smithi159 ceph-mon[36109]: pgmap v8068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:52 smithi055 ceph-mon[31863]: pgmap v8068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13733.043114 secs 2024-03-28T09:48:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13733.043114 secs 2024-03-28T09:48:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13733.043114 secs 2024-03-28T09:48:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:54 smithi086 ceph-mon[35163]: pgmap v8069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:54 smithi159 ceph-mon[36109]: pgmap v8069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:54 smithi055 ceph-mon[31863]: pgmap v8069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:56 smithi086 ceph-mon[35163]: pgmap v8070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:57.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:56 smithi159 ceph-mon[36109]: pgmap v8070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:56 smithi055 ceph-mon[31863]: pgmap v8070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:48:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:58 smithi086 ceph-mon[35163]: pgmap v8071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:48:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13738.043199 secs 2024-03-28T09:48:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:58 smithi159 ceph-mon[36109]: pgmap v8071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:48:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13738.043199 secs 2024-03-28T09:48:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:58 smithi055 ceph-mon[31863]: pgmap v8071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:48:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:48:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13738.043199 secs 2024-03-28T09:49:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:00 smithi055 ceph-mon[31863]: pgmap v8072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:00 smithi086 ceph-mon[35163]: pgmap v8072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:00 smithi159 ceph-mon[36109]: pgmap v8072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:02 smithi055 ceph-mon[31863]: pgmap v8073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:02 smithi086 ceph-mon[35163]: pgmap v8073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:02 smithi159 ceph-mon[36109]: pgmap v8073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13743.043282 secs 2024-03-28T09:49:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13743.043282 secs 2024-03-28T09:49:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13743.043282 secs 2024-03-28T09:49:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:04 smithi055 ceph-mon[31863]: pgmap v8074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:04 smithi086 ceph-mon[35163]: pgmap v8074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:04 smithi159 ceph-mon[36109]: pgmap v8074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:05 smithi086 ceph-mon[35163]: pgmap v8075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:05 smithi159 ceph-mon[36109]: pgmap v8075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:05 smithi055 ceph-mon[31863]: pgmap v8075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:08 smithi086 ceph-mon[35163]: pgmap v8076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:08 smithi159 ceph-mon[36109]: pgmap v8076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:08 smithi055 ceph-mon[31863]: pgmap v8076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13748.043405 secs 2024-03-28T09:49:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13748.043405 secs 2024-03-28T09:49:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13748.043405 secs 2024-03-28T09:49:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:10 smithi086 ceph-mon[35163]: pgmap v8077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:10 smithi159 ceph-mon[36109]: pgmap v8077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:10 smithi055 ceph-mon[31863]: pgmap v8077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:12 smithi086 ceph-mon[35163]: pgmap v8078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:49:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:12 smithi159 ceph-mon[36109]: pgmap v8078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:49:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:12 smithi055 ceph-mon[31863]: pgmap v8078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:49:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:49:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:49:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:49:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:49:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:49:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:49:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:49:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:49:13.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:49:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13753.043481 secs 2024-03-28T09:49:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:14 smithi086 ceph-mon[35163]: pgmap v8079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:14 smithi086 ceph-mon[35163]: pgmap v8080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13753.043481 secs 2024-03-28T09:49:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:14 smithi159 ceph-mon[36109]: pgmap v8079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:14 smithi159 ceph-mon[36109]: pgmap v8080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13753.043481 secs 2024-03-28T09:49:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:14 smithi055 ceph-mon[31863]: pgmap v8079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:14 smithi055 ceph-mon[31863]: pgmap v8080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:16 smithi086 ceph-mon[35163]: pgmap v8081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:16 smithi159 ceph-mon[36109]: pgmap v8081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:16 smithi055 ceph-mon[31863]: pgmap v8081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:18 smithi086 ceph-mon[35163]: pgmap v8082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:18 smithi159 ceph-mon[36109]: pgmap v8082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:18 smithi055 ceph-mon[31863]: pgmap v8082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13758.043605 secs 2024-03-28T09:49:19.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13758.043605 secs 2024-03-28T09:49:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13758.043605 secs 2024-03-28T09:49:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:20 smithi086 ceph-mon[35163]: pgmap v8083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:20 smithi159 ceph-mon[36109]: pgmap v8083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:20 smithi055 ceph-mon[31863]: pgmap v8083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:22 smithi086 ceph-mon[35163]: pgmap v8084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:22 smithi159 ceph-mon[36109]: pgmap v8084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:22 smithi055 ceph-mon[31863]: pgmap v8084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:49:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13763.043728 secs 2024-03-28T09:49:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:24 smithi086 ceph-mon[35163]: pgmap v8085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:49:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13763.043728 secs 2024-03-28T09:49:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:24 smithi159 ceph-mon[36109]: pgmap v8085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:49:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13763.043728 secs 2024-03-28T09:49:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:24 smithi055 ceph-mon[31863]: pgmap v8085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:49:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:26 smithi086 ceph-mon[35163]: pgmap v8086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:26 smithi159 ceph-mon[36109]: pgmap v8086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:26 smithi055 ceph-mon[31863]: pgmap v8086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:28 smithi055 ceph-mon[31863]: pgmap v8087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:28 smithi086 ceph-mon[35163]: pgmap v8087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:28 smithi159 ceph-mon[36109]: pgmap v8087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13768.043812 secs 2024-03-28T09:49:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13768.043812 secs 2024-03-28T09:49:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13768.043812 secs 2024-03-28T09:49:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:30 smithi055 ceph-mon[31863]: pgmap v8088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:30 smithi086 ceph-mon[35163]: pgmap v8088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:30 smithi159 ceph-mon[36109]: pgmap v8088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:32 smithi055 ceph-mon[31863]: pgmap v8089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:32 smithi086 ceph-mon[35163]: pgmap v8089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:32 smithi159 ceph-mon[36109]: pgmap v8089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13773.043880 secs 2024-03-28T09:49:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:34 smithi055 ceph-mon[31863]: pgmap v8090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13773.043880 secs 2024-03-28T09:49:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:34 smithi086 ceph-mon[35163]: pgmap v8090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13773.043880 secs 2024-03-28T09:49:34.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:34 smithi159 ceph-mon[36109]: pgmap v8090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:36 smithi055 ceph-mon[31863]: pgmap v8091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:36 smithi086 ceph-mon[35163]: pgmap v8091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:36 smithi159 ceph-mon[36109]: pgmap v8091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:38 smithi055 ceph-mon[31863]: pgmap v8092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:38 smithi086 ceph-mon[35163]: pgmap v8092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:38 smithi159 ceph-mon[36109]: pgmap v8092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13778.043963 secs 2024-03-28T09:49:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13778.043963 secs 2024-03-28T09:49:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13778.043963 secs 2024-03-28T09:49:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:40 smithi086 ceph-mon[35163]: pgmap v8093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:40 smithi159 ceph-mon[36109]: pgmap v8093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:40 smithi055 ceph-mon[31863]: pgmap v8093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:42 smithi086 ceph-mon[35163]: pgmap v8094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:42 smithi159 ceph-mon[36109]: pgmap v8094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:42 smithi055 ceph-mon[31863]: pgmap v8094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13783.044048 secs 2024-03-28T09:49:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:44 smithi086 ceph-mon[35163]: pgmap v8095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13783.044048 secs 2024-03-28T09:49:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:44 smithi159 ceph-mon[36109]: pgmap v8095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13783.044048 secs 2024-03-28T09:49:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:44 smithi055 ceph-mon[31863]: pgmap v8095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:46 smithi086 ceph-mon[35163]: pgmap v8096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:46 smithi159 ceph-mon[36109]: pgmap v8096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:46 smithi055 ceph-mon[31863]: pgmap v8096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:48 smithi086 ceph-mon[35163]: pgmap v8097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:48 smithi159 ceph-mon[36109]: pgmap v8097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:48 smithi055 ceph-mon[31863]: pgmap v8097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13788.044185 secs 2024-03-28T09:49:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13788.044185 secs 2024-03-28T09:49:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13788.044185 secs 2024-03-28T09:49:50.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:50 smithi086 ceph-mon[35163]: pgmap v8098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:50.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:50 smithi159 ceph-mon[36109]: pgmap v8098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:50 smithi055 ceph-mon[31863]: pgmap v8098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:52 smithi086 ceph-mon[35163]: pgmap v8099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:52.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:52 smithi159 ceph-mon[36109]: pgmap v8099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:52 smithi055 ceph-mon[31863]: pgmap v8099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13793.044307 secs 2024-03-28T09:49:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:54 smithi086 ceph-mon[35163]: pgmap v8100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13793.044307 secs 2024-03-28T09:49:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:54 smithi159 ceph-mon[36109]: pgmap v8100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13793.044307 secs 2024-03-28T09:49:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:54 smithi055 ceph-mon[31863]: pgmap v8100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:56 smithi086 ceph-mon[35163]: pgmap v8101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:56 smithi159 ceph-mon[36109]: pgmap v8101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:56 smithi055 ceph-mon[31863]: pgmap v8101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:49:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:58 smithi086 ceph-mon[35163]: pgmap v8102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:58 smithi159 ceph-mon[36109]: pgmap v8102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:58 smithi055 ceph-mon[31863]: pgmap v8102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:49:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:49:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13798.044428 secs 2024-03-28T09:49:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:49:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13798.044428 secs 2024-03-28T09:49:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:49:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13798.044428 secs 2024-03-28T09:50:00.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:00 smithi055 ceph-mon[31863]: pgmap v8103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:00.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:50:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:00 smithi086 ceph-mon[35163]: pgmap v8103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:50:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:00 smithi159 ceph-mon[36109]: pgmap v8103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T09:50:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:02 smithi086 ceph-mon[35163]: pgmap v8104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:02 smithi159 ceph-mon[36109]: pgmap v8104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:02 smithi055 ceph-mon[31863]: pgmap v8104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13803.044551 secs 2024-03-28T09:50:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13803.044551 secs 2024-03-28T09:50:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13803.044551 secs 2024-03-28T09:50:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:04 smithi086 ceph-mon[35163]: pgmap v8105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:04 smithi159 ceph-mon[36109]: pgmap v8105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:04 smithi055 ceph-mon[31863]: pgmap v8105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:06 smithi086 ceph-mon[35163]: pgmap v8106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:06 smithi159 ceph-mon[36109]: pgmap v8106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:06 smithi055 ceph-mon[31863]: pgmap v8106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:08 smithi086 ceph-mon[35163]: pgmap v8107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13808.044636 secs 2024-03-28T09:50:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:08 smithi159 ceph-mon[36109]: pgmap v8107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13808.044636 secs 2024-03-28T09:50:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:08 smithi055 ceph-mon[31863]: pgmap v8107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13808.044636 secs 2024-03-28T09:50:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:10 smithi086 ceph-mon[35163]: pgmap v8108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:10 smithi159 ceph-mon[36109]: pgmap v8108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:10 smithi055 ceph-mon[31863]: pgmap v8108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:12 smithi086 ceph-mon[35163]: pgmap v8109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:12 smithi159 ceph-mon[36109]: pgmap v8109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:12 smithi055 ceph-mon[31863]: pgmap v8109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13813.044714 secs 2024-03-28T09:50:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:50:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13813.044714 secs 2024-03-28T09:50:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:50:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13813.044714 secs 2024-03-28T09:50:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:50:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:14 smithi086 ceph-mon[35163]: pgmap v8110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:14 smithi159 ceph-mon[36109]: pgmap v8110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:14 smithi055 ceph-mon[31863]: pgmap v8110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:50:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:50:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:15 smithi086 ceph-mon[35163]: pgmap v8111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:15 smithi086 ceph-mon[35163]: pgmap v8112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:50:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:50:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:50:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:15 smithi159 ceph-mon[36109]: pgmap v8111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:15 smithi159 ceph-mon[36109]: pgmap v8112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:15.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:50:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:50:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:50:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:15 smithi055 ceph-mon[31863]: pgmap v8111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:15 smithi055 ceph-mon[31863]: pgmap v8112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:50:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:17 smithi055 ceph-mon[31863]: pgmap v8113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:17 smithi086 ceph-mon[35163]: pgmap v8113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:17 smithi159 ceph-mon[36109]: pgmap v8113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13818.044835 secs 2024-03-28T09:50:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13818.044835 secs 2024-03-28T09:50:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13818.044835 secs 2024-03-28T09:50:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:19 smithi055 ceph-mon[31863]: pgmap v8114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:20.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:19 smithi086 ceph-mon[35163]: pgmap v8114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:20.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:19 smithi159 ceph-mon[36109]: pgmap v8114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:20 smithi086 ceph-mon[35163]: pgmap v8115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:20 smithi159 ceph-mon[36109]: pgmap v8115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:20 smithi055 ceph-mon[31863]: pgmap v8115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13823.044919 secs 2024-03-28T09:50:24.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:23 smithi055 ceph-mon[31863]: pgmap v8116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13823.044919 secs 2024-03-28T09:50:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:23 smithi086 ceph-mon[35163]: pgmap v8116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13823.044919 secs 2024-03-28T09:50:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:23 smithi159 ceph-mon[36109]: pgmap v8116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:50:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:25 smithi055 ceph-mon[31863]: pgmap v8117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:50:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:25 smithi086 ceph-mon[35163]: pgmap v8117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:50:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:25 smithi159 ceph-mon[36109]: pgmap v8117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:50:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:27 smithi055 ceph-mon[31863]: pgmap v8118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:27 smithi086 ceph-mon[35163]: pgmap v8118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:27 smithi159 ceph-mon[36109]: pgmap v8118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13828.045041 secs 2024-03-28T09:50:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:28 smithi086 ceph-mon[35163]: pgmap v8119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13828.045041 secs 2024-03-28T09:50:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:28 smithi159 ceph-mon[36109]: pgmap v8119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13828.045041 secs 2024-03-28T09:50:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:28 smithi055 ceph-mon[31863]: pgmap v8119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:31 smithi055 ceph-mon[31863]: pgmap v8120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:31 smithi086 ceph-mon[35163]: pgmap v8120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:31 smithi159 ceph-mon[36109]: pgmap v8120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13833.045163 secs 2024-03-28T09:50:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:33 smithi055 ceph-mon[31863]: pgmap v8121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13833.045163 secs 2024-03-28T09:50:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:33 smithi086 ceph-mon[35163]: pgmap v8121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13833.045163 secs 2024-03-28T09:50:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:33 smithi159 ceph-mon[36109]: pgmap v8121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:34 smithi086 ceph-mon[35163]: pgmap v8122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:34 smithi159 ceph-mon[36109]: pgmap v8122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:34 smithi055 ceph-mon[31863]: pgmap v8122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:37 smithi055 ceph-mon[31863]: pgmap v8123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:37 smithi086 ceph-mon[35163]: pgmap v8123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:37 smithi159 ceph-mon[36109]: pgmap v8123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13838.045284 secs 2024-03-28T09:50:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13838.045284 secs 2024-03-28T09:50:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13838.045284 secs 2024-03-28T09:50:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:39 smithi086 ceph-mon[35163]: pgmap v8124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:39 smithi159 ceph-mon[36109]: pgmap v8124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:39 smithi055 ceph-mon[31863]: pgmap v8124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:40 smithi086 ceph-mon[35163]: pgmap v8125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:40 smithi159 ceph-mon[36109]: pgmap v8125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:40 smithi055 ceph-mon[31863]: pgmap v8125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13843.045403 secs 2024-03-28T09:50:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:43 smithi055 ceph-mon[31863]: pgmap v8126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13843.045403 secs 2024-03-28T09:50:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:43 smithi086 ceph-mon[35163]: pgmap v8126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13843.045403 secs 2024-03-28T09:50:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:43 smithi159 ceph-mon[36109]: pgmap v8126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:44 smithi086 ceph-mon[35163]: pgmap v8127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:44 smithi159 ceph-mon[36109]: pgmap v8127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:44 smithi055 ceph-mon[31863]: pgmap v8127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:47 smithi055 ceph-mon[31863]: pgmap v8128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:47 smithi086 ceph-mon[35163]: pgmap v8128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:47 smithi159 ceph-mon[36109]: pgmap v8128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13848.045525 secs 2024-03-28T09:50:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13848.045525 secs 2024-03-28T09:50:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13848.045525 secs 2024-03-28T09:50:50.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:49 smithi086 ceph-mon[35163]: pgmap v8129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:50.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:49 smithi159 ceph-mon[36109]: pgmap v8129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:49 smithi055 ceph-mon[31863]: pgmap v8129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:50 smithi086 ceph-mon[35163]: pgmap v8130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:50 smithi159 ceph-mon[36109]: pgmap v8130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:50 smithi055 ceph-mon[31863]: pgmap v8130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13853.045605 secs 2024-03-28T09:50:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:53 smithi055 ceph-mon[31863]: pgmap v8131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13853.045605 secs 2024-03-28T09:50:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:53 smithi086 ceph-mon[35163]: pgmap v8131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13853.045605 secs 2024-03-28T09:50:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:53 smithi159 ceph-mon[36109]: pgmap v8131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:54 smithi086 ceph-mon[35163]: pgmap v8132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:54 smithi159 ceph-mon[36109]: pgmap v8132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:54 smithi055 ceph-mon[31863]: pgmap v8132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:50:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:57 smithi055 ceph-mon[31863]: pgmap v8133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:57 smithi086 ceph-mon[35163]: pgmap v8133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:57 smithi159 ceph-mon[36109]: pgmap v8133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13858.045728 secs 2024-03-28T09:50:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:50:58 smithi086 ceph-mon[35163]: pgmap v8134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13858.045728 secs 2024-03-28T09:50:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:50:58 smithi159 ceph-mon[36109]: pgmap v8134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:50:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13858.045728 secs 2024-03-28T09:50:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:50:58 smithi055 ceph-mon[31863]: pgmap v8134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:02.096 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:01 smithi055 ceph-mon[31863]: pgmap v8135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:01 smithi086 ceph-mon[35163]: pgmap v8135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:01 smithi159 ceph-mon[36109]: pgmap v8135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:02 smithi086 ceph-mon[35163]: pgmap v8136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:02 smithi159 ceph-mon[36109]: pgmap v8136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:02 smithi055 ceph-mon[31863]: pgmap v8136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13863.045846 secs 2024-03-28T09:51:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13863.045846 secs 2024-03-28T09:51:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13863.045846 secs 2024-03-28T09:51:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:04 smithi086 ceph-mon[35163]: pgmap v8137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:04 smithi159 ceph-mon[36109]: pgmap v8137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:04 smithi055 ceph-mon[31863]: pgmap v8137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:06 smithi086 ceph-mon[35163]: pgmap v8138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:06 smithi159 ceph-mon[36109]: pgmap v8138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:06 smithi055 ceph-mon[31863]: pgmap v8138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13868.045931 secs 2024-03-28T09:51:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13868.045931 secs 2024-03-28T09:51:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13868.045931 secs 2024-03-28T09:51:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:09 smithi086 ceph-mon[35163]: pgmap v8139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:09 smithi159 ceph-mon[36109]: pgmap v8139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:09 smithi055 ceph-mon[31863]: pgmap v8139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:10 smithi086 ceph-mon[35163]: pgmap v8140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:10 smithi159 ceph-mon[36109]: pgmap v8140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:10 smithi055 ceph-mon[31863]: pgmap v8140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:12 smithi086 ceph-mon[35163]: pgmap v8141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:12 smithi159 ceph-mon[36109]: pgmap v8141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:12 smithi055 ceph-mon[31863]: pgmap v8141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13873.046050 secs 2024-03-28T09:51:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13873.046050 secs 2024-03-28T09:51:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13873.046050 secs 2024-03-28T09:51:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:14 smithi086 ceph-mon[35163]: pgmap v8142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:14 smithi159 ceph-mon[36109]: pgmap v8142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:14 smithi055 ceph-mon[31863]: pgmap v8142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:51:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:51:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:51:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:51:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:51:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:16 smithi086 ceph-mon[35163]: pgmap v8143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:16 smithi086 ceph-mon[35163]: pgmap v8144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:51:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:51:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:51:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:16 smithi159 ceph-mon[36109]: pgmap v8143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:16 smithi159 ceph-mon[36109]: pgmap v8144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:51:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:51:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:51:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:16 smithi055 ceph-mon[31863]: pgmap v8143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:16 smithi055 ceph-mon[31863]: pgmap v8144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:51:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13878.046113 secs 2024-03-28T09:51:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13878.046113 secs 2024-03-28T09:51:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13878.046113 secs 2024-03-28T09:51:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:19 smithi086 ceph-mon[35163]: pgmap v8145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:19 smithi159 ceph-mon[36109]: pgmap v8145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:19 smithi055 ceph-mon[31863]: pgmap v8145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:21 smithi055 ceph-mon[31863]: pgmap v8146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:21 smithi086 ceph-mon[35163]: pgmap v8146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:21 smithi159 ceph-mon[36109]: pgmap v8146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:23 smithi086 ceph-mon[35163]: pgmap v8147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:51:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13883.046235 secs 2024-03-28T09:51:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:23 smithi159 ceph-mon[36109]: pgmap v8147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:51:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13883.046235 secs 2024-03-28T09:51:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:23 smithi055 ceph-mon[31863]: pgmap v8147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:51:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13883.046235 secs 2024-03-28T09:51:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:25 smithi086 ceph-mon[35163]: pgmap v8148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:25 smithi159 ceph-mon[36109]: pgmap v8148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:25 smithi055 ceph-mon[31863]: pgmap v8148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:27 smithi086 ceph-mon[35163]: pgmap v8149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:51:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:27 smithi159 ceph-mon[36109]: pgmap v8149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:51:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:27 smithi055 ceph-mon[31863]: pgmap v8149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:51:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13888.046354 secs 2024-03-28T09:51:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13888.046354 secs 2024-03-28T09:51:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13888.046354 secs 2024-03-28T09:51:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:29 smithi086 ceph-mon[35163]: pgmap v8150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:29 smithi159 ceph-mon[36109]: pgmap v8150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:29 smithi055 ceph-mon[31863]: pgmap v8150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:31 smithi086 ceph-mon[35163]: pgmap v8151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:31 smithi159 ceph-mon[36109]: pgmap v8151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:31 smithi055 ceph-mon[31863]: pgmap v8151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:33 smithi086 ceph-mon[35163]: pgmap v8152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13893.046435 secs 2024-03-28T09:51:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:33 smithi159 ceph-mon[36109]: pgmap v8152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13893.046435 secs 2024-03-28T09:51:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:33 smithi055 ceph-mon[31863]: pgmap v8152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13893.046435 secs 2024-03-28T09:51:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:35 smithi086 ceph-mon[35163]: pgmap v8153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:35 smithi159 ceph-mon[36109]: pgmap v8153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:35 smithi055 ceph-mon[31863]: pgmap v8153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:37 smithi086 ceph-mon[35163]: pgmap v8154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:37 smithi159 ceph-mon[36109]: pgmap v8154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:37 smithi055 ceph-mon[31863]: pgmap v8154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13898.046496 secs 2024-03-28T09:51:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13898.046496 secs 2024-03-28T09:51:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13898.046496 secs 2024-03-28T09:51:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:39 smithi086 ceph-mon[35163]: pgmap v8155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:40.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:39 smithi159 ceph-mon[36109]: pgmap v8155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:39 smithi055 ceph-mon[31863]: pgmap v8155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:41 smithi086 ceph-mon[35163]: pgmap v8156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:41 smithi159 ceph-mon[36109]: pgmap v8156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:42.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:41 smithi055 ceph-mon[31863]: pgmap v8156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:43 smithi086 ceph-mon[35163]: pgmap v8157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13903.046558 secs 2024-03-28T09:51:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:43 smithi159 ceph-mon[36109]: pgmap v8157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13903.046558 secs 2024-03-28T09:51:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:43 smithi055 ceph-mon[31863]: pgmap v8157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13903.046558 secs 2024-03-28T09:51:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:45 smithi086 ceph-mon[35163]: pgmap v8158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:45 smithi159 ceph-mon[36109]: pgmap v8158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:45 smithi055 ceph-mon[31863]: pgmap v8158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:47 smithi086 ceph-mon[35163]: pgmap v8159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:47 smithi159 ceph-mon[36109]: pgmap v8159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:47 smithi055 ceph-mon[31863]: pgmap v8159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13908.046682 secs 2024-03-28T09:51:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13908.046682 secs 2024-03-28T09:51:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13908.046682 secs 2024-03-28T09:51:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:49 smithi055 ceph-mon[31863]: pgmap v8160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:49 smithi086 ceph-mon[35163]: pgmap v8160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:49 smithi159 ceph-mon[36109]: pgmap v8160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:52.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:51 smithi086 ceph-mon[35163]: pgmap v8161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:51 smithi055 ceph-mon[31863]: pgmap v8161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:52.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:51 smithi159 ceph-mon[36109]: pgmap v8161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:51:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:53 smithi055 ceph-mon[31863]: pgmap v8162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:54.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13913.046812 secs 2024-03-28T09:51:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:53 smithi086 ceph-mon[35163]: pgmap v8162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13913.046812 secs 2024-03-28T09:51:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:53 smithi159 ceph-mon[36109]: pgmap v8162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:51:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13913.046812 secs 2024-03-28T09:51:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:55 smithi055 ceph-mon[31863]: pgmap v8163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:55 smithi086 ceph-mon[35163]: pgmap v8163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:55 smithi159 ceph-mon[36109]: pgmap v8163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:57 smithi055 ceph-mon[31863]: pgmap v8164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:57 smithi086 ceph-mon[35163]: pgmap v8164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:57 smithi159 ceph-mon[36109]: pgmap v8164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:51:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13918.046888 secs 2024-03-28T09:51:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13918.046888 secs 2024-03-28T09:51:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13918.046888 secs 2024-03-28T09:52:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:51:59 smithi055 ceph-mon[31863]: pgmap v8165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:51:59 smithi086 ceph-mon[35163]: pgmap v8165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:51:59 smithi159 ceph-mon[36109]: pgmap v8165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:01 smithi086 ceph-mon[35163]: pgmap v8166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:02.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:01 smithi159 ceph-mon[36109]: pgmap v8166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:01 smithi055 ceph-mon[31863]: pgmap v8166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:04.177 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:03 smithi055 ceph-mon[31863]: pgmap v8167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:52:04.178 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13923.046974 secs 2024-03-28T09:52:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:03 smithi086 ceph-mon[35163]: pgmap v8167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:52:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13923.046974 secs 2024-03-28T09:52:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:03 smithi159 ceph-mon[36109]: pgmap v8167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:52:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13923.046974 secs 2024-03-28T09:52:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:04 smithi086 ceph-mon[35163]: pgmap v8168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:04 smithi159 ceph-mon[36109]: pgmap v8168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:04 smithi055 ceph-mon[31863]: pgmap v8168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:07 smithi086 ceph-mon[35163]: pgmap v8169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:08.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:07 smithi159 ceph-mon[36109]: pgmap v8169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:07 smithi055 ceph-mon[31863]: pgmap v8169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13928.047083 secs 2024-03-28T09:52:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13928.047083 secs 2024-03-28T09:52:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13928.047083 secs 2024-03-28T09:52:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:09 smithi086 ceph-mon[35163]: pgmap v8170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:09 smithi159 ceph-mon[36109]: pgmap v8170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:09 smithi055 ceph-mon[31863]: pgmap v8170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:11 smithi086 ceph-mon[35163]: pgmap v8171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:11 smithi159 ceph-mon[36109]: pgmap v8171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:11 smithi055 ceph-mon[31863]: pgmap v8171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:13 smithi086 ceph-mon[35163]: pgmap v8172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13933.047171 secs 2024-03-28T09:52:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:13 smithi159 ceph-mon[36109]: pgmap v8172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13933.047171 secs 2024-03-28T09:52:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:13 smithi055 ceph-mon[31863]: pgmap v8172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13933.047171 secs 2024-03-28T09:52:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:15 smithi086 ceph-mon[35163]: pgmap v8173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:15 smithi159 ceph-mon[36109]: pgmap v8173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:16.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:15 smithi055 ceph-mon[31863]: pgmap v8173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:17 smithi086 ceph-mon[35163]: pgmap v8174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:52:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:17 smithi159 ceph-mon[36109]: pgmap v8174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:52:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:17 smithi055 ceph-mon[31863]: pgmap v8174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:52:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13938.047265 secs 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13938.047265 secs 2024-03-28T09:52:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:52:19.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:52:19.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:52:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13938.047265 secs 2024-03-28T09:52:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:52:19.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:52:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:52:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:52:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: pgmap v8175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:19 smithi086 ceph-mon[35163]: pgmap v8176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:52:20.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:52:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:52:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: pgmap v8175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:20.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:19 smithi159 ceph-mon[36109]: pgmap v8176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: pgmap v8175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:19 smithi055 ceph-mon[31863]: pgmap v8176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:21 smithi086 ceph-mon[35163]: pgmap v8177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:21 smithi159 ceph-mon[36109]: pgmap v8177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:21 smithi055 ceph-mon[31863]: pgmap v8177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:23 smithi086 ceph-mon[35163]: pgmap v8178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13943.047335 secs 2024-03-28T09:52:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:23 smithi159 ceph-mon[36109]: pgmap v8178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13943.047335 secs 2024-03-28T09:52:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:23 smithi055 ceph-mon[31863]: pgmap v8178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13943.047335 secs 2024-03-28T09:52:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:25 smithi086 ceph-mon[35163]: pgmap v8179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:25 smithi159 ceph-mon[36109]: pgmap v8179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:25 smithi055 ceph-mon[31863]: pgmap v8179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:27 smithi086 ceph-mon[35163]: pgmap v8180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:27 smithi159 ceph-mon[36109]: pgmap v8180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:27 smithi055 ceph-mon[31863]: pgmap v8180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:52:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13948.047453 secs 2024-03-28T09:52:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13948.047453 secs 2024-03-28T09:52:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13948.047453 secs 2024-03-28T09:52:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:29 smithi086 ceph-mon[35163]: pgmap v8181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:29 smithi159 ceph-mon[36109]: pgmap v8181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:29 smithi055 ceph-mon[31863]: pgmap v8181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:52:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:31 smithi086 ceph-mon[35163]: pgmap v8182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:31 smithi159 ceph-mon[36109]: pgmap v8182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:32.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:31 smithi055 ceph-mon[31863]: pgmap v8182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:33 smithi086 ceph-mon[35163]: pgmap v8183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13953.047573 secs 2024-03-28T09:52:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:33 smithi159 ceph-mon[36109]: pgmap v8183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13953.047573 secs 2024-03-28T09:52:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:33 smithi055 ceph-mon[31863]: pgmap v8183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13953.047573 secs 2024-03-28T09:52:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:35 smithi055 ceph-mon[31863]: pgmap v8184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:35 smithi086 ceph-mon[35163]: pgmap v8184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:36.324 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:35 smithi159 ceph-mon[36109]: pgmap v8184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:37 smithi055 ceph-mon[31863]: pgmap v8185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:37 smithi086 ceph-mon[35163]: pgmap v8185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:37 smithi159 ceph-mon[36109]: pgmap v8185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13958.047657 secs 2024-03-28T09:52:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13958.047657 secs 2024-03-28T09:52:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13958.047657 secs 2024-03-28T09:52:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:39 smithi055 ceph-mon[31863]: pgmap v8186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:39 smithi086 ceph-mon[35163]: pgmap v8186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:39 smithi159 ceph-mon[36109]: pgmap v8186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:41 smithi055 ceph-mon[31863]: pgmap v8187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:41 smithi086 ceph-mon[35163]: pgmap v8187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:42.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:41 smithi159 ceph-mon[36109]: pgmap v8187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:43 smithi055 ceph-mon[31863]: pgmap v8188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13963.047744 secs 2024-03-28T09:52:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:43 smithi086 ceph-mon[35163]: pgmap v8188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13963.047744 secs 2024-03-28T09:52:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:43 smithi159 ceph-mon[36109]: pgmap v8188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13963.047744 secs 2024-03-28T09:52:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:45 smithi055 ceph-mon[31863]: pgmap v8189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:45 smithi086 ceph-mon[35163]: pgmap v8189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:45 smithi159 ceph-mon[36109]: pgmap v8189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:47 smithi055 ceph-mon[31863]: pgmap v8190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:47 smithi086 ceph-mon[35163]: pgmap v8190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:47 smithi159 ceph-mon[36109]: pgmap v8190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13968.047868 secs 2024-03-28T09:52:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13968.047868 secs 2024-03-28T09:52:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13968.047868 secs 2024-03-28T09:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:49 smithi086 ceph-mon[35163]: pgmap v8191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:49 smithi159 ceph-mon[36109]: pgmap v8191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:49 smithi055 ceph-mon[31863]: pgmap v8191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:51 smithi086 ceph-mon[35163]: pgmap v8192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:51 smithi159 ceph-mon[36109]: pgmap v8192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:51 smithi055 ceph-mon[31863]: pgmap v8192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:52:53.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:52 smithi086 ceph-mon[35163]: pgmap v8193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:53.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:52 smithi159 ceph-mon[36109]: pgmap v8193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:52 smithi055 ceph-mon[31863]: pgmap v8193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:52:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13973.047988 secs 2024-03-28T09:52:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13973.047988 secs 2024-03-28T09:52:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13973.047988 secs 2024-03-28T09:52:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:54 smithi086 ceph-mon[35163]: pgmap v8194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:54 smithi159 ceph-mon[36109]: pgmap v8194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:54 smithi055 ceph-mon[31863]: pgmap v8194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:57 smithi086 ceph-mon[35163]: pgmap v8195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:57 smithi159 ceph-mon[36109]: pgmap v8195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:57 smithi055 ceph-mon[31863]: pgmap v8195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13978.048083 secs 2024-03-28T09:52:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:52:59 smithi086 ceph-mon[35163]: pgmap v8196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13978.048083 secs 2024-03-28T09:52:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:52:59 smithi159 ceph-mon[36109]: pgmap v8196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:52:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13978.048083 secs 2024-03-28T09:52:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:52:59 smithi055 ceph-mon[31863]: pgmap v8196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:01 smithi086 ceph-mon[35163]: pgmap v8197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:01 smithi159 ceph-mon[36109]: pgmap v8197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:01 smithi055 ceph-mon[31863]: pgmap v8197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:03 smithi086 ceph-mon[35163]: pgmap v8198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13983.048176 secs 2024-03-28T09:53:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:03 smithi159 ceph-mon[36109]: pgmap v8198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13983.048176 secs 2024-03-28T09:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:03 smithi055 ceph-mon[31863]: pgmap v8198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13983.048176 secs 2024-03-28T09:53:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:05 smithi086 ceph-mon[35163]: pgmap v8199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:05 smithi159 ceph-mon[36109]: pgmap v8199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:05 smithi055 ceph-mon[31863]: pgmap v8199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:07 smithi086 ceph-mon[35163]: pgmap v8200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:07 smithi159 ceph-mon[36109]: pgmap v8200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:07 smithi055 ceph-mon[31863]: pgmap v8200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13988.048297 secs 2024-03-28T09:53:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13988.048297 secs 2024-03-28T09:53:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13988.048297 secs 2024-03-28T09:53:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:09 smithi086 ceph-mon[35163]: pgmap v8201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:09 smithi159 ceph-mon[36109]: pgmap v8201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:09 smithi055 ceph-mon[31863]: pgmap v8201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:11 smithi086 ceph-mon[35163]: pgmap v8202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:11 smithi159 ceph-mon[36109]: pgmap v8202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:11 smithi055 ceph-mon[31863]: pgmap v8202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:53:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:13 smithi086 ceph-mon[35163]: pgmap v8203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13993.048420 secs 2024-03-28T09:53:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:13 smithi159 ceph-mon[36109]: pgmap v8203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13993.048420 secs 2024-03-28T09:53:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:13 smithi055 ceph-mon[31863]: pgmap v8203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13993.048420 secs 2024-03-28T09:53:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:15 smithi086 ceph-mon[35163]: pgmap v8204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:15 smithi159 ceph-mon[36109]: pgmap v8204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:15 smithi055 ceph-mon[31863]: pgmap v8204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:17 smithi055 ceph-mon[31863]: pgmap v8205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:17 smithi086 ceph-mon[35163]: pgmap v8205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:18.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:17 smithi159 ceph-mon[36109]: pgmap v8205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 13998.048542 secs 2024-03-28T09:53:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 13998.048542 secs 2024-03-28T09:53:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 13998.048542 secs 2024-03-28T09:53:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:19 smithi055 ceph-mon[31863]: pgmap v8206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:53:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:19 smithi086 ceph-mon[35163]: pgmap v8206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:53:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:19 smithi159 ceph-mon[36109]: pgmap v8206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:53:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:53:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:53:20.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:53:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:53:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:53:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:53:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T09:53:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:53:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:53:21.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:53:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:21 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:53:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:21 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:53:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:21 smithi055 ceph-mon[31863]: pgmap v8207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:21.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:21 smithi055 ceph-mon[31863]: pgmap v8208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:53:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:21 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:53:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:21 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:53:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:21 smithi086 ceph-mon[35163]: pgmap v8207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:21 smithi086 ceph-mon[35163]: pgmap v8208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:53:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:21 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T09:53:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:21 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T09:53:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:21 smithi159 ceph-mon[36109]: pgmap v8207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:22.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:21 smithi159 ceph-mon[36109]: pgmap v8208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T09:53:23.871 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:23 smithi086 ceph-mon[35163]: pgmap v8209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:23.871 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14003.048663 secs 2024-03-28T09:53:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:23 smithi055 ceph-mon[31863]: pgmap v8209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14003.048663 secs 2024-03-28T09:53:23.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:23 smithi159 ceph-mon[36109]: pgmap v8209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:23.874 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14003.048663 secs 2024-03-28T09:53:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:25 smithi055 ceph-mon[31863]: pgmap v8210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:25 smithi086 ceph-mon[35163]: pgmap v8210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:25 smithi159 ceph-mon[36109]: pgmap v8210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:27 smithi086 ceph-mon[35163]: pgmap v8211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:27 smithi159 ceph-mon[36109]: pgmap v8211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:27 smithi055 ceph-mon[31863]: pgmap v8211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14008.048727 secs 2024-03-28T09:53:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14008.048727 secs 2024-03-28T09:53:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14008.048727 secs 2024-03-28T09:53:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:29 smithi086 ceph-mon[35163]: pgmap v8212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:30.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:29 smithi159 ceph-mon[36109]: pgmap v8212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:29 smithi055 ceph-mon[31863]: pgmap v8212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:31 smithi086 ceph-mon[35163]: pgmap v8213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:31 smithi159 ceph-mon[36109]: pgmap v8213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:31 smithi055 ceph-mon[31863]: pgmap v8213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:53:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:33 smithi086 ceph-mon[35163]: pgmap v8214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:53:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14013.048791 secs 2024-03-28T09:53:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:33 smithi159 ceph-mon[36109]: pgmap v8214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:53:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14013.048791 secs 2024-03-28T09:53:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:33 smithi055 ceph-mon[31863]: pgmap v8214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:53:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14013.048791 secs 2024-03-28T09:53:35.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:35 smithi055 ceph-mon[31863]: pgmap v8215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:35 smithi086 ceph-mon[35163]: pgmap v8215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:35 smithi159 ceph-mon[36109]: pgmap v8215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:37 smithi086 ceph-mon[35163]: pgmap v8216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:37 smithi159 ceph-mon[36109]: pgmap v8216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:37 smithi055 ceph-mon[31863]: pgmap v8216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14018.048865 secs 2024-03-28T09:53:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14018.048865 secs 2024-03-28T09:53:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14018.048865 secs 2024-03-28T09:53:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:39 smithi086 ceph-mon[35163]: pgmap v8217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:39 smithi159 ceph-mon[36109]: pgmap v8217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:39 smithi055 ceph-mon[31863]: pgmap v8217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:41 smithi086 ceph-mon[35163]: pgmap v8218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:41 smithi159 ceph-mon[36109]: pgmap v8218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:42.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:41 smithi055 ceph-mon[31863]: pgmap v8218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:43 smithi086 ceph-mon[35163]: pgmap v8219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14023.048985 secs 2024-03-28T09:53:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:43 smithi159 ceph-mon[36109]: pgmap v8219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14023.048985 secs 2024-03-28T09:53:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:43 smithi055 ceph-mon[31863]: pgmap v8219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14023.048985 secs 2024-03-28T09:53:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:45 smithi086 ceph-mon[35163]: pgmap v8220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:45 smithi159 ceph-mon[36109]: pgmap v8220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:45 smithi055 ceph-mon[31863]: pgmap v8220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:47 smithi086 ceph-mon[35163]: pgmap v8221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:47 smithi159 ceph-mon[36109]: pgmap v8221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:47 smithi055 ceph-mon[31863]: pgmap v8221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14028.049106 secs 2024-03-28T09:53:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14028.049106 secs 2024-03-28T09:53:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14028.049106 secs 2024-03-28T09:53:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:49 smithi086 ceph-mon[35163]: pgmap v8222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:49 smithi159 ceph-mon[36109]: pgmap v8222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:49 smithi055 ceph-mon[31863]: pgmap v8222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:51 smithi086 ceph-mon[35163]: pgmap v8223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:51 smithi159 ceph-mon[36109]: pgmap v8223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:51 smithi055 ceph-mon[31863]: pgmap v8223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:53:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:53 smithi086 ceph-mon[35163]: pgmap v8224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14033.049184 secs 2024-03-28T09:53:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:53 smithi159 ceph-mon[36109]: pgmap v8224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14033.049184 secs 2024-03-28T09:53:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:53 smithi055 ceph-mon[31863]: pgmap v8224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14033.049184 secs 2024-03-28T09:53:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:55 smithi086 ceph-mon[35163]: pgmap v8225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:56.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:55 smithi159 ceph-mon[36109]: pgmap v8225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:55 smithi055 ceph-mon[31863]: pgmap v8225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:57 smithi086 ceph-mon[35163]: pgmap v8226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:57 smithi159 ceph-mon[36109]: pgmap v8226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:57 smithi055 ceph-mon[31863]: pgmap v8226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:53:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14038.049250 secs 2024-03-28T09:53:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14038.049250 secs 2024-03-28T09:53:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14038.049250 secs 2024-03-28T09:54:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:53:59 smithi086 ceph-mon[35163]: pgmap v8227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:53:59 smithi159 ceph-mon[36109]: pgmap v8227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:53:59 smithi055 ceph-mon[31863]: pgmap v8227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:01 smithi086 ceph-mon[35163]: pgmap v8228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:01 smithi159 ceph-mon[36109]: pgmap v8228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:01 smithi055 ceph-mon[31863]: pgmap v8228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:03 smithi086 ceph-mon[35163]: pgmap v8229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14043.049337 secs 2024-03-28T09:54:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:03 smithi159 ceph-mon[36109]: pgmap v8229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14043.049337 secs 2024-03-28T09:54:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:03 smithi055 ceph-mon[31863]: pgmap v8229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14043.049337 secs 2024-03-28T09:54:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:05 smithi086 ceph-mon[35163]: pgmap v8230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:05 smithi159 ceph-mon[36109]: pgmap v8230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:05 smithi055 ceph-mon[31863]: pgmap v8230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:07 smithi055 ceph-mon[31863]: pgmap v8231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:07 smithi086 ceph-mon[35163]: pgmap v8231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:07 smithi159 ceph-mon[36109]: pgmap v8231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14048.049459 secs 2024-03-28T09:54:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14048.049459 secs 2024-03-28T09:54:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14048.049459 secs 2024-03-28T09:54:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:09 smithi055 ceph-mon[31863]: pgmap v8232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:09 smithi086 ceph-mon[35163]: pgmap v8232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:09 smithi159 ceph-mon[36109]: pgmap v8232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:11 smithi055 ceph-mon[31863]: pgmap v8233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:11 smithi086 ceph-mon[35163]: pgmap v8233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:11 smithi159 ceph-mon[36109]: pgmap v8233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:13 smithi055 ceph-mon[31863]: pgmap v8234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14053.049539 secs 2024-03-28T09:54:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:13 smithi086 ceph-mon[35163]: pgmap v8234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14053.049539 secs 2024-03-28T09:54:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:13 smithi159 ceph-mon[36109]: pgmap v8234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14053.049539 secs 2024-03-28T09:54:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:15 smithi055 ceph-mon[31863]: pgmap v8235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:15 smithi086 ceph-mon[35163]: pgmap v8235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:15 smithi159 ceph-mon[36109]: pgmap v8235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:17 smithi086 ceph-mon[35163]: pgmap v8236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:17 smithi159 ceph-mon[36109]: pgmap v8236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:17 smithi055 ceph-mon[31863]: pgmap v8236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14058.049609 secs 2024-03-28T09:54:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14058.049609 secs 2024-03-28T09:54:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14058.049609 secs 2024-03-28T09:54:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:19 smithi086 ceph-mon[35163]: pgmap v8237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:19 smithi159 ceph-mon[36109]: pgmap v8237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:19 smithi055 ceph-mon[31863]: pgmap v8237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:54:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:54:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:54:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:21 smithi086 ceph-mon[35163]: pgmap v8238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:21 smithi159 ceph-mon[36109]: pgmap v8238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:21 smithi055 ceph-mon[31863]: pgmap v8238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:23.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:54:23.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:54:23.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:54:23.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:54:23.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:54:23.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:54:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:54:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:54:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:54:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:23 smithi086 ceph-mon[35163]: pgmap v8239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:23 smithi086 ceph-mon[35163]: pgmap v8240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14063.049732 secs 2024-03-28T09:54:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:23 smithi159 ceph-mon[36109]: pgmap v8239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:23 smithi159 ceph-mon[36109]: pgmap v8240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14063.049732 secs 2024-03-28T09:54:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:23 smithi055 ceph-mon[31863]: pgmap v8239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:23 smithi055 ceph-mon[31863]: pgmap v8240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14063.049732 secs 2024-03-28T09:54:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:24 smithi086 ceph-mon[35163]: pgmap v8241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:24 smithi159 ceph-mon[36109]: pgmap v8241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:24 smithi055 ceph-mon[31863]: pgmap v8241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:27 smithi086 ceph-mon[35163]: pgmap v8242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:27 smithi159 ceph-mon[36109]: pgmap v8242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:27 smithi055 ceph-mon[31863]: pgmap v8242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14068.049812 secs 2024-03-28T09:54:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:29 smithi086 ceph-mon[35163]: pgmap v8243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14068.049812 secs 2024-03-28T09:54:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:29 smithi159 ceph-mon[36109]: pgmap v8243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14068.049812 secs 2024-03-28T09:54:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:29 smithi055 ceph-mon[31863]: pgmap v8243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:31 smithi086 ceph-mon[35163]: pgmap v8244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:31 smithi159 ceph-mon[36109]: pgmap v8244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:31 smithi055 ceph-mon[31863]: pgmap v8244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:54:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:33 smithi086 ceph-mon[35163]: pgmap v8245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:54:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:33 smithi159 ceph-mon[36109]: pgmap v8245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:54:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:33 smithi055 ceph-mon[31863]: pgmap v8245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:54:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14073.049889 secs 2024-03-28T09:54:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14073.049889 secs 2024-03-28T09:54:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14073.049889 secs 2024-03-28T09:54:35.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:35 smithi055 ceph-mon[31863]: pgmap v8246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:35 smithi086 ceph-mon[35163]: pgmap v8246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:35 smithi159 ceph-mon[36109]: pgmap v8246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:37 smithi086 ceph-mon[35163]: pgmap v8247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:37 smithi159 ceph-mon[36109]: pgmap v8247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:37 smithi055 ceph-mon[31863]: pgmap v8247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14078.049962 secs 2024-03-28T09:54:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:39 smithi086 ceph-mon[35163]: pgmap v8248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14078.049962 secs 2024-03-28T09:54:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:39 smithi159 ceph-mon[36109]: pgmap v8248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14078.049962 secs 2024-03-28T09:54:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:39 smithi055 ceph-mon[31863]: pgmap v8248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:41 smithi086 ceph-mon[35163]: pgmap v8249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:41 smithi159 ceph-mon[36109]: pgmap v8249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:41 smithi055 ceph-mon[31863]: pgmap v8249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:43 smithi086 ceph-mon[35163]: pgmap v8250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:43 smithi159 ceph-mon[36109]: pgmap v8250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:43 smithi055 ceph-mon[31863]: pgmap v8250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14083.050086 secs 2024-03-28T09:54:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14083.050086 secs 2024-03-28T09:54:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14083.050086 secs 2024-03-28T09:54:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:45 smithi086 ceph-mon[35163]: pgmap v8251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:45 smithi159 ceph-mon[36109]: pgmap v8251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:45 smithi055 ceph-mon[31863]: pgmap v8251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:47 smithi086 ceph-mon[35163]: pgmap v8252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:47 smithi159 ceph-mon[36109]: pgmap v8252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:47 smithi055 ceph-mon[31863]: pgmap v8252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14088.050172 secs 2024-03-28T09:54:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:49 smithi086 ceph-mon[35163]: pgmap v8253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14088.050172 secs 2024-03-28T09:54:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:49 smithi159 ceph-mon[36109]: pgmap v8253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14088.050172 secs 2024-03-28T09:54:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:49 smithi055 ceph-mon[31863]: pgmap v8253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:51 smithi086 ceph-mon[35163]: pgmap v8254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:51.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:51 smithi159 ceph-mon[36109]: pgmap v8254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:51 smithi055 ceph-mon[31863]: pgmap v8254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:54:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:53 smithi086 ceph-mon[35163]: pgmap v8255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:53 smithi159 ceph-mon[36109]: pgmap v8255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:53 smithi055 ceph-mon[31863]: pgmap v8255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14093.050239 secs 2024-03-28T09:54:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14093.050239 secs 2024-03-28T09:54:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14093.050239 secs 2024-03-28T09:54:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:55 smithi086 ceph-mon[35163]: pgmap v8256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:55 smithi159 ceph-mon[36109]: pgmap v8256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:55 smithi055 ceph-mon[31863]: pgmap v8256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:57 smithi086 ceph-mon[35163]: pgmap v8257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:57 smithi159 ceph-mon[36109]: pgmap v8257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:57 smithi055 ceph-mon[31863]: pgmap v8257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14098.050331 secs 2024-03-28T09:54:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:54:59 smithi086 ceph-mon[35163]: pgmap v8258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14098.050331 secs 2024-03-28T09:54:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:54:59 smithi159 ceph-mon[36109]: pgmap v8258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:54:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14098.050331 secs 2024-03-28T09:54:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:54:59 smithi055 ceph-mon[31863]: pgmap v8258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:01 smithi086 ceph-mon[35163]: pgmap v8259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:01 smithi159 ceph-mon[36109]: pgmap v8259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:01 smithi055 ceph-mon[31863]: pgmap v8259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:03 smithi086 ceph-mon[35163]: pgmap v8260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:03 smithi159 ceph-mon[36109]: pgmap v8260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:03 smithi055 ceph-mon[31863]: pgmap v8260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14103.050448 secs 2024-03-28T09:55:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14103.050448 secs 2024-03-28T09:55:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14103.050448 secs 2024-03-28T09:55:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:05 smithi086 ceph-mon[35163]: pgmap v8261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:05 smithi159 ceph-mon[36109]: pgmap v8261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:05 smithi055 ceph-mon[31863]: pgmap v8261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:07 smithi055 ceph-mon[31863]: pgmap v8262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:07 smithi086 ceph-mon[35163]: pgmap v8262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:07 smithi159 ceph-mon[36109]: pgmap v8262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14108.050536 secs 2024-03-28T09:55:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14108.050536 secs 2024-03-28T09:55:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14108.050536 secs 2024-03-28T09:55:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:09 smithi086 ceph-mon[35163]: pgmap v8263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:09 smithi159 ceph-mon[36109]: pgmap v8263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:09 smithi055 ceph-mon[31863]: pgmap v8263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:11 smithi086 ceph-mon[35163]: pgmap v8264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:11 smithi159 ceph-mon[36109]: pgmap v8264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:11 smithi055 ceph-mon[31863]: pgmap v8264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:13 smithi086 ceph-mon[35163]: pgmap v8265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14113.050646 secs 2024-03-28T09:55:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:13 smithi159 ceph-mon[36109]: pgmap v8265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14113.050646 secs 2024-03-28T09:55:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:13 smithi055 ceph-mon[31863]: pgmap v8265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14113.050646 secs 2024-03-28T09:55:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:15 smithi086 ceph-mon[35163]: pgmap v8266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:15 smithi159 ceph-mon[36109]: pgmap v8266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:15 smithi055 ceph-mon[31863]: pgmap v8266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:17 smithi086 ceph-mon[35163]: pgmap v8267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:17 smithi159 ceph-mon[36109]: pgmap v8267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:17 smithi055 ceph-mon[31863]: pgmap v8267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14118.050770 secs 2024-03-28T09:55:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14118.050770 secs 2024-03-28T09:55:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14118.050770 secs 2024-03-28T09:55:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:19 smithi086 ceph-mon[35163]: pgmap v8268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:19 smithi159 ceph-mon[36109]: pgmap v8268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:19 smithi055 ceph-mon[31863]: pgmap v8268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:21 smithi086 ceph-mon[35163]: pgmap v8269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:21 smithi159 ceph-mon[36109]: pgmap v8269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:21 smithi055 ceph-mon[31863]: pgmap v8269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:23.218 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:55:23.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:55:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:55:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: pgmap v8270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14123.050809 secs 2024-03-28T09:55:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: pgmap v8270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14123.050809 secs 2024-03-28T09:55:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: pgmap v8270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14123.050809 secs 2024-03-28T09:55:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:24.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: pgmap v8271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:55:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:55:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: pgmap v8272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:55:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: pgmap v8273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: pgmap v8271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:55:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:55:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: pgmap v8272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:55:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: pgmap v8273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:25.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: pgmap v8271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:55:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:55:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: pgmap v8272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:55:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: pgmap v8273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:25.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:55:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:27 smithi086 ceph-mon[35163]: pgmap v8274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:27 smithi159 ceph-mon[36109]: pgmap v8274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:27 smithi055 ceph-mon[31863]: pgmap v8274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14128.050900 secs 2024-03-28T09:55:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14128.050900 secs 2024-03-28T09:55:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14128.050900 secs 2024-03-28T09:55:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:29 smithi086 ceph-mon[35163]: pgmap v8275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:29 smithi159 ceph-mon[36109]: pgmap v8275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:29 smithi055 ceph-mon[31863]: pgmap v8275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:31 smithi086 ceph-mon[35163]: pgmap v8276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:31 smithi159 ceph-mon[36109]: pgmap v8276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:31 smithi055 ceph-mon[31863]: pgmap v8276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:32 smithi086 ceph-mon[35163]: pgmap v8277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:32 smithi159 ceph-mon[36109]: pgmap v8277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:32 smithi055 ceph-mon[31863]: pgmap v8277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:55:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14133.051017 secs 2024-03-28T09:55:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14133.051017 secs 2024-03-28T09:55:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14133.051017 secs 2024-03-28T09:55:35.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:34 smithi055 ceph-mon[31863]: pgmap v8278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:55:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:34 smithi086 ceph-mon[35163]: pgmap v8278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:55:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:34 smithi159 ceph-mon[36109]: pgmap v8278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:55:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:37 smithi086 ceph-mon[35163]: pgmap v8279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:37 smithi159 ceph-mon[36109]: pgmap v8279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:37 smithi055 ceph-mon[31863]: pgmap v8279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14138.051079 secs 2024-03-28T09:55:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14138.051079 secs 2024-03-28T09:55:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14138.051079 secs 2024-03-28T09:55:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:39 smithi086 ceph-mon[35163]: pgmap v8280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:39 smithi159 ceph-mon[36109]: pgmap v8280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:39 smithi055 ceph-mon[31863]: pgmap v8280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:41 smithi086 ceph-mon[35163]: pgmap v8281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:41 smithi159 ceph-mon[36109]: pgmap v8281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:41 smithi055 ceph-mon[31863]: pgmap v8281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:42 smithi086 ceph-mon[35163]: pgmap v8282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:42 smithi159 ceph-mon[36109]: pgmap v8282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:42 smithi055 ceph-mon[31863]: pgmap v8282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14143.051142 secs 2024-03-28T09:55:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14143.051142 secs 2024-03-28T09:55:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14143.051142 secs 2024-03-28T09:55:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:44 smithi086 ceph-mon[35163]: pgmap v8283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:44 smithi159 ceph-mon[36109]: pgmap v8283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:44 smithi055 ceph-mon[31863]: pgmap v8283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:47 smithi086 ceph-mon[35163]: pgmap v8284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:47 smithi159 ceph-mon[36109]: pgmap v8284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:47 smithi055 ceph-mon[31863]: pgmap v8284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14148.051215 secs 2024-03-28T09:55:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14148.051215 secs 2024-03-28T09:55:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14148.051215 secs 2024-03-28T09:55:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:49 smithi086 ceph-mon[35163]: pgmap v8285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:49 smithi159 ceph-mon[36109]: pgmap v8285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:49 smithi055 ceph-mon[31863]: pgmap v8285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:51 smithi086 ceph-mon[35163]: pgmap v8286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:51 smithi159 ceph-mon[36109]: pgmap v8286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:51 smithi055 ceph-mon[31863]: pgmap v8286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:52 smithi086 ceph-mon[35163]: pgmap v8287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:52 smithi159 ceph-mon[36109]: pgmap v8287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:52 smithi055 ceph-mon[31863]: pgmap v8287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14153.051277 secs 2024-03-28T09:55:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14153.051277 secs 2024-03-28T09:55:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14153.051277 secs 2024-03-28T09:55:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:55 smithi086 ceph-mon[35163]: pgmap v8288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:55 smithi159 ceph-mon[36109]: pgmap v8288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:55 smithi055 ceph-mon[31863]: pgmap v8288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:55:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:57 smithi086 ceph-mon[35163]: pgmap v8289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:57 smithi159 ceph-mon[36109]: pgmap v8289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:57 smithi055 ceph-mon[31863]: pgmap v8289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:55:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14158.051342 secs 2024-03-28T09:55:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14158.051342 secs 2024-03-28T09:55:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14158.051342 secs 2024-03-28T09:56:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:55:59 smithi086 ceph-mon[35163]: pgmap v8290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:55:59 smithi159 ceph-mon[36109]: pgmap v8290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:55:59 smithi055 ceph-mon[31863]: pgmap v8290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:01 smithi086 ceph-mon[35163]: pgmap v8291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:01 smithi159 ceph-mon[36109]: pgmap v8291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:01 smithi055 ceph-mon[31863]: pgmap v8291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:02 smithi086 ceph-mon[35163]: pgmap v8292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:02 smithi159 ceph-mon[36109]: pgmap v8292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:02 smithi055 ceph-mon[31863]: pgmap v8292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14163.051426 secs 2024-03-28T09:56:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14163.051426 secs 2024-03-28T09:56:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14163.051426 secs 2024-03-28T09:56:05.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:04 smithi055 ceph-mon[31863]: pgmap v8293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:04 smithi086 ceph-mon[35163]: pgmap v8293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:04 smithi159 ceph-mon[36109]: pgmap v8293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:07 smithi086 ceph-mon[35163]: pgmap v8294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:07 smithi159 ceph-mon[36109]: pgmap v8294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:07 smithi055 ceph-mon[31863]: pgmap v8294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14168.051461 secs 2024-03-28T09:56:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14168.051461 secs 2024-03-28T09:56:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14168.051461 secs 2024-03-28T09:56:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:09 smithi086 ceph-mon[35163]: pgmap v8295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:09 smithi159 ceph-mon[36109]: pgmap v8295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:09 smithi055 ceph-mon[31863]: pgmap v8295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:10 smithi086 ceph-mon[35163]: pgmap v8296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:10 smithi159 ceph-mon[36109]: pgmap v8296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:10 smithi055 ceph-mon[31863]: pgmap v8296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14173.051527 secs 2024-03-28T09:56:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:13 smithi086 ceph-mon[35163]: pgmap v8297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14173.051527 secs 2024-03-28T09:56:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:13 smithi159 ceph-mon[36109]: pgmap v8297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14173.051527 secs 2024-03-28T09:56:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:13 smithi055 ceph-mon[31863]: pgmap v8297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:15 smithi086 ceph-mon[35163]: pgmap v8298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:15 smithi159 ceph-mon[36109]: pgmap v8298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:15 smithi055 ceph-mon[31863]: pgmap v8298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:17 smithi086 ceph-mon[35163]: pgmap v8299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:17 smithi159 ceph-mon[36109]: pgmap v8299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:17 smithi055 ceph-mon[31863]: pgmap v8299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14178.051592 secs 2024-03-28T09:56:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14178.051592 secs 2024-03-28T09:56:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14178.051592 secs 2024-03-28T09:56:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:19 smithi086 ceph-mon[35163]: pgmap v8300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:19 smithi159 ceph-mon[36109]: pgmap v8300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:19 smithi055 ceph-mon[31863]: pgmap v8300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:20 smithi086 ceph-mon[35163]: pgmap v8301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:20 smithi159 ceph-mon[36109]: pgmap v8301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:20 smithi055 ceph-mon[31863]: pgmap v8301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14183.051672 secs 2024-03-28T09:56:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:23 smithi086 ceph-mon[35163]: pgmap v8302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14183.051672 secs 2024-03-28T09:56:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:23 smithi159 ceph-mon[36109]: pgmap v8302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14183.051672 secs 2024-03-28T09:56:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:23 smithi055 ceph-mon[31863]: pgmap v8302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:25 smithi086 ceph-mon[35163]: pgmap v8303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:56:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:25 smithi159 ceph-mon[36109]: pgmap v8303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:56:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:25 smithi055 ceph-mon[31863]: pgmap v8303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:56:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:27 smithi086 ceph-mon[35163]: pgmap v8304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:27 smithi159 ceph-mon[36109]: pgmap v8304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:27 smithi055 ceph-mon[31863]: pgmap v8304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14188.051751 secs 2024-03-28T09:56:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:29 smithi086 ceph-mon[35163]: pgmap v8305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14188.051751 secs 2024-03-28T09:56:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:29 smithi159 ceph-mon[36109]: pgmap v8305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14188.051751 secs 2024-03-28T09:56:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:29 smithi055 ceph-mon[31863]: pgmap v8305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:31 smithi086 ceph-mon[35163]: pgmap v8306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:31 smithi159 ceph-mon[36109]: pgmap v8306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:31 smithi055 ceph-mon[31863]: pgmap v8306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:56:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:56:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:32 smithi086 ceph-mon[35163]: pgmap v8307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:56:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:32 smithi086 ceph-mon[35163]: pgmap v8308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:56:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:56:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:32 smithi159 ceph-mon[36109]: pgmap v8307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:56:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:32 smithi159 ceph-mon[36109]: pgmap v8308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:32.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:56:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:56:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:32 smithi055 ceph-mon[31863]: pgmap v8307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:56:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:32 smithi055 ceph-mon[31863]: pgmap v8308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:56:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14193.051874 secs 2024-03-28T09:56:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14193.051874 secs 2024-03-28T09:56:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14193.051874 secs 2024-03-28T09:56:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:34 smithi055 ceph-mon[31863]: pgmap v8309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:56:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:34 smithi086 ceph-mon[35163]: pgmap v8309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:56:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:34 smithi159 ceph-mon[36109]: pgmap v8309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T09:56:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:36 smithi086 ceph-mon[35163]: pgmap v8310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T09:56:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:36 smithi159 ceph-mon[36109]: pgmap v8310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T09:56:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:36 smithi055 ceph-mon[31863]: pgmap v8310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T09:56:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14198.051911 secs 2024-03-28T09:56:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:38 smithi086 ceph-mon[35163]: pgmap v8311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14198.051911 secs 2024-03-28T09:56:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:38 smithi159 ceph-mon[36109]: pgmap v8311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14198.051911 secs 2024-03-28T09:56:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:38 smithi055 ceph-mon[31863]: pgmap v8311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:40 smithi086 ceph-mon[35163]: pgmap v8312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:40 smithi159 ceph-mon[36109]: pgmap v8312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:40 smithi055 ceph-mon[31863]: pgmap v8312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:42 smithi086 ceph-mon[35163]: pgmap v8313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:56:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:42 smithi159 ceph-mon[36109]: pgmap v8313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:56:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:42 smithi055 ceph-mon[31863]: pgmap v8313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:56:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14203.052030 secs 2024-03-28T09:56:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14203.052030 secs 2024-03-28T09:56:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14203.052030 secs 2024-03-28T09:56:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:44 smithi086 ceph-mon[35163]: pgmap v8314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:44 smithi159 ceph-mon[36109]: pgmap v8314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:44 smithi055 ceph-mon[31863]: pgmap v8314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:46 smithi086 ceph-mon[35163]: pgmap v8315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:46 smithi159 ceph-mon[36109]: pgmap v8315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:46 smithi055 ceph-mon[31863]: pgmap v8315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14208.052104 secs 2024-03-28T09:56:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:48 smithi086 ceph-mon[35163]: pgmap v8316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14208.052104 secs 2024-03-28T09:56:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:48 smithi159 ceph-mon[36109]: pgmap v8316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14208.052104 secs 2024-03-28T09:56:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:48 smithi055 ceph-mon[31863]: pgmap v8316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:50 smithi086 ceph-mon[35163]: pgmap v8317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:50 smithi159 ceph-mon[36109]: pgmap v8317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:50 smithi055 ceph-mon[31863]: pgmap v8317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:52 smithi086 ceph-mon[35163]: pgmap v8318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:52 smithi159 ceph-mon[36109]: pgmap v8318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:52 smithi055 ceph-mon[31863]: pgmap v8318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14213.052180 secs 2024-03-28T09:56:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14213.052180 secs 2024-03-28T09:56:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14213.052180 secs 2024-03-28T09:56:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:54 smithi055 ceph-mon[31863]: pgmap v8319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:55.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:54 smithi086 ceph-mon[35163]: pgmap v8319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:54 smithi159 ceph-mon[36109]: pgmap v8319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:56:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:56 smithi055 ceph-mon[31863]: pgmap v8320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:56 smithi086 ceph-mon[35163]: pgmap v8320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:56 smithi159 ceph-mon[36109]: pgmap v8320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:56:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14218.052304 secs 2024-03-28T09:56:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:56:58 smithi055 ceph-mon[31863]: pgmap v8321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14218.052304 secs 2024-03-28T09:56:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:56:58 smithi086 ceph-mon[35163]: pgmap v8321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:56:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14218.052304 secs 2024-03-28T09:56:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:56:58 smithi159 ceph-mon[36109]: pgmap v8321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:00 smithi055 ceph-mon[31863]: pgmap v8322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:00 smithi086 ceph-mon[35163]: pgmap v8322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:00 smithi159 ceph-mon[36109]: pgmap v8322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:02 smithi055 ceph-mon[31863]: pgmap v8323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:02 smithi086 ceph-mon[35163]: pgmap v8323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:02 smithi159 ceph-mon[36109]: pgmap v8323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14223.052423 secs 2024-03-28T09:57:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14223.052423 secs 2024-03-28T09:57:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14223.052423 secs 2024-03-28T09:57:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:04 smithi055 ceph-mon[31863]: pgmap v8324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:04 smithi086 ceph-mon[35163]: pgmap v8324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:04 smithi159 ceph-mon[36109]: pgmap v8324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:07.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:06 smithi159 ceph-mon[36109]: pgmap v8325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:06 smithi055 ceph-mon[31863]: pgmap v8325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:07.232 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:06 smithi086 ceph-mon[35163]: pgmap v8325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14228.052501 secs 2024-03-28T09:57:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:08 smithi086 ceph-mon[35163]: pgmap v8326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14228.052501 secs 2024-03-28T09:57:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:08 smithi159 ceph-mon[36109]: pgmap v8326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14228.052501 secs 2024-03-28T09:57:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:08 smithi055 ceph-mon[31863]: pgmap v8326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:10 smithi086 ceph-mon[35163]: pgmap v8327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:10 smithi159 ceph-mon[36109]: pgmap v8327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:10 smithi055 ceph-mon[31863]: pgmap v8327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:12 smithi086 ceph-mon[35163]: pgmap v8328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:12 smithi159 ceph-mon[36109]: pgmap v8328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:12 smithi055 ceph-mon[31863]: pgmap v8328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14233.052565 secs 2024-03-28T09:57:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14233.052565 secs 2024-03-28T09:57:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14233.052565 secs 2024-03-28T09:57:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:14 smithi086 ceph-mon[35163]: pgmap v8329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:14 smithi159 ceph-mon[36109]: pgmap v8329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:14 smithi055 ceph-mon[31863]: pgmap v8329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:16 smithi086 ceph-mon[35163]: pgmap v8330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:16 smithi159 ceph-mon[36109]: pgmap v8330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:16 smithi055 ceph-mon[31863]: pgmap v8330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14238.052630 secs 2024-03-28T09:57:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:18 smithi086 ceph-mon[35163]: pgmap v8331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14238.052630 secs 2024-03-28T09:57:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:18 smithi159 ceph-mon[36109]: pgmap v8331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14238.052630 secs 2024-03-28T09:57:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:18 smithi055 ceph-mon[31863]: pgmap v8331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:20 smithi086 ceph-mon[35163]: pgmap v8332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:20 smithi159 ceph-mon[36109]: pgmap v8332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:20 smithi055 ceph-mon[31863]: pgmap v8332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:22 smithi086 ceph-mon[35163]: pgmap v8333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:22 smithi159 ceph-mon[36109]: pgmap v8333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:22 smithi055 ceph-mon[31863]: pgmap v8333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:24.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14243.052701 secs 2024-03-28T09:57:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14243.052701 secs 2024-03-28T09:57:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14243.052701 secs 2024-03-28T09:57:25.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:24 smithi086 ceph-mon[35163]: pgmap v8334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:24 smithi159 ceph-mon[36109]: pgmap v8334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:24 smithi055 ceph-mon[31863]: pgmap v8334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:25 smithi086 ceph-mon[35163]: pgmap v8335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:25 smithi159 ceph-mon[36109]: pgmap v8335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:25 smithi055 ceph-mon[31863]: pgmap v8335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14248.052812 secs 2024-03-28T09:57:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:28 smithi086 ceph-mon[35163]: pgmap v8336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14248.052812 secs 2024-03-28T09:57:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:28 smithi159 ceph-mon[36109]: pgmap v8336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14248.052812 secs 2024-03-28T09:57:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:28 smithi055 ceph-mon[31863]: pgmap v8336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:30 smithi086 ceph-mon[35163]: pgmap v8337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:30 smithi159 ceph-mon[36109]: pgmap v8337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:30 smithi055 ceph-mon[31863]: pgmap v8337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:32 smithi086 ceph-mon[35163]: pgmap v8338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:57:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:32 smithi159 ceph-mon[36109]: pgmap v8338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:57:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:32 smithi055 ceph-mon[31863]: pgmap v8338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14253.052889 secs 2024-03-28T09:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:57:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:57:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14253.052889 secs 2024-03-28T09:57:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:57:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:57:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14253.052889 secs 2024-03-28T09:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:57:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:34 smithi086 ceph-mon[35163]: pgmap v8339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:34 smithi086 ceph-mon[35163]: pgmap v8340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:34 smithi159 ceph-mon[36109]: pgmap v8339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:34 smithi159 ceph-mon[36109]: pgmap v8340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:34 smithi055 ceph-mon[31863]: pgmap v8339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:34 smithi055 ceph-mon[31863]: pgmap v8340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:36 smithi086 ceph-mon[35163]: pgmap v8341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:36 smithi159 ceph-mon[36109]: pgmap v8341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:36 smithi055 ceph-mon[31863]: pgmap v8341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:38 smithi086 ceph-mon[35163]: pgmap v8342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14258.053008 secs 2024-03-28T09:57:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:38 smithi159 ceph-mon[36109]: pgmap v8342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14258.053008 secs 2024-03-28T09:57:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:38 smithi055 ceph-mon[31863]: pgmap v8342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14258.053008 secs 2024-03-28T09:57:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:40 smithi086 ceph-mon[35163]: pgmap v8343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:40 smithi159 ceph-mon[36109]: pgmap v8343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:40 smithi055 ceph-mon[31863]: pgmap v8343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:42 smithi086 ceph-mon[35163]: pgmap v8344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:42 smithi159 ceph-mon[36109]: pgmap v8344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:42 smithi055 ceph-mon[31863]: pgmap v8344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:57:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14263.053126 secs 2024-03-28T09:57:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14263.053126 secs 2024-03-28T09:57:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14263.053126 secs 2024-03-28T09:57:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:44 smithi055 ceph-mon[31863]: pgmap v8345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:57:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:44 smithi086 ceph-mon[35163]: pgmap v8345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:57:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:44 smithi159 ceph-mon[36109]: pgmap v8345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:57:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:46 smithi055 ceph-mon[31863]: pgmap v8346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:46 smithi086 ceph-mon[35163]: pgmap v8346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:46 smithi159 ceph-mon[36109]: pgmap v8346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:48 smithi055 ceph-mon[31863]: pgmap v8347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14268.053250 secs 2024-03-28T09:57:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:48 smithi086 ceph-mon[35163]: pgmap v8347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14268.053250 secs 2024-03-28T09:57:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:48 smithi159 ceph-mon[36109]: pgmap v8347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14268.053250 secs 2024-03-28T09:57:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:50 smithi055 ceph-mon[31863]: pgmap v8348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:50 smithi086 ceph-mon[35163]: pgmap v8348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:50 smithi159 ceph-mon[36109]: pgmap v8348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:52 smithi055 ceph-mon[31863]: pgmap v8349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:52 smithi086 ceph-mon[35163]: pgmap v8349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:52 smithi159 ceph-mon[36109]: pgmap v8349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:54.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14273.053313 secs 2024-03-28T09:57:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14273.053313 secs 2024-03-28T09:57:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14273.053313 secs 2024-03-28T09:57:55.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:54 smithi086 ceph-mon[35163]: pgmap v8350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:54 smithi159 ceph-mon[36109]: pgmap v8350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:54 smithi055 ceph-mon[31863]: pgmap v8350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:57:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:56 smithi086 ceph-mon[35163]: pgmap v8351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:56 smithi159 ceph-mon[36109]: pgmap v8351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:56 smithi055 ceph-mon[31863]: pgmap v8351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:57:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:58 smithi086 ceph-mon[35163]: pgmap v8352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:57:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14278.053437 secs 2024-03-28T09:57:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:58 smithi159 ceph-mon[36109]: pgmap v8352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:57:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14278.053437 secs 2024-03-28T09:57:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:58 smithi055 ceph-mon[31863]: pgmap v8352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:57:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:57:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14278.053437 secs 2024-03-28T09:58:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:00 smithi086 ceph-mon[35163]: pgmap v8353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:00 smithi159 ceph-mon[36109]: pgmap v8353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:00 smithi055 ceph-mon[31863]: pgmap v8353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:02 smithi086 ceph-mon[35163]: pgmap v8354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:02 smithi159 ceph-mon[36109]: pgmap v8354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:02 smithi055 ceph-mon[31863]: pgmap v8354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14283.053561 secs 2024-03-28T09:58:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14283.053561 secs 2024-03-28T09:58:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14283.053561 secs 2024-03-28T09:58:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:04 smithi086 ceph-mon[35163]: pgmap v8355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:04 smithi159 ceph-mon[36109]: pgmap v8355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:04 smithi055 ceph-mon[31863]: pgmap v8355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:06 smithi086 ceph-mon[35163]: pgmap v8356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:06 smithi159 ceph-mon[36109]: pgmap v8356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:06 smithi055 ceph-mon[31863]: pgmap v8356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:08 smithi086 ceph-mon[35163]: pgmap v8357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14288.053593 secs 2024-03-28T09:58:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:08 smithi159 ceph-mon[36109]: pgmap v8357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14288.053593 secs 2024-03-28T09:58:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:08 smithi055 ceph-mon[31863]: pgmap v8357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14288.053593 secs 2024-03-28T09:58:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:10 smithi086 ceph-mon[35163]: pgmap v8358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:10 smithi159 ceph-mon[36109]: pgmap v8358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:10 smithi055 ceph-mon[31863]: pgmap v8358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:12 smithi086 ceph-mon[35163]: pgmap v8359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:12 smithi159 ceph-mon[36109]: pgmap v8359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:12 smithi055 ceph-mon[31863]: pgmap v8359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14293.053659 secs 2024-03-28T09:58:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14293.053659 secs 2024-03-28T09:58:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14293.053659 secs 2024-03-28T09:58:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:14 smithi055 ceph-mon[31863]: pgmap v8360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:14 smithi086 ceph-mon[35163]: pgmap v8360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:14 smithi159 ceph-mon[36109]: pgmap v8360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:16.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:16 smithi055 ceph-mon[31863]: pgmap v8361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:16 smithi086 ceph-mon[35163]: pgmap v8361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:16 smithi159 ceph-mon[36109]: pgmap v8361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:18 smithi055 ceph-mon[31863]: pgmap v8362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14298.053734 secs 2024-03-28T09:58:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:18 smithi086 ceph-mon[35163]: pgmap v8362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14298.053734 secs 2024-03-28T09:58:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:18 smithi159 ceph-mon[36109]: pgmap v8362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14298.053734 secs 2024-03-28T09:58:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:20 smithi055 ceph-mon[31863]: pgmap v8363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:20 smithi086 ceph-mon[35163]: pgmap v8363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:20 smithi159 ceph-mon[36109]: pgmap v8363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:22 smithi055 ceph-mon[31863]: pgmap v8364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:22 smithi086 ceph-mon[35163]: pgmap v8364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:22 smithi159 ceph-mon[36109]: pgmap v8364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14303.053852 secs 2024-03-28T09:58:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14303.053852 secs 2024-03-28T09:58:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14303.053852 secs 2024-03-28T09:58:24.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:24 smithi159 ceph-mon[36109]: pgmap v8365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:24 smithi086 ceph-mon[35163]: pgmap v8365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:24 smithi055 ceph-mon[31863]: pgmap v8365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:26 smithi086 ceph-mon[35163]: pgmap v8366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:26 smithi159 ceph-mon[36109]: pgmap v8366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:26 smithi055 ceph-mon[31863]: pgmap v8366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T09:58:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:28 smithi086 ceph-mon[35163]: pgmap v8367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14308.053938 secs 2024-03-28T09:58:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:28 smithi159 ceph-mon[36109]: pgmap v8367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14308.053938 secs 2024-03-28T09:58:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:28 smithi055 ceph-mon[31863]: pgmap v8367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14308.053938 secs 2024-03-28T09:58:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:30 smithi086 ceph-mon[35163]: pgmap v8368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:30 smithi159 ceph-mon[36109]: pgmap v8368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:30 smithi055 ceph-mon[31863]: pgmap v8368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:32 smithi086 ceph-mon[35163]: pgmap v8369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:32 smithi159 ceph-mon[36109]: pgmap v8369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:32 smithi055 ceph-mon[31863]: pgmap v8369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14313.054052 secs 2024-03-28T09:58:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14313.054052 secs 2024-03-28T09:58:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14313.054052 secs 2024-03-28T09:58:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:34 smithi086 ceph-mon[35163]: pgmap v8370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:58:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:34 smithi159 ceph-mon[36109]: pgmap v8370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:58:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:34 smithi055 ceph-mon[31863]: pgmap v8370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:58:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:58:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:58:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:58:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:58:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:58:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:58:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:58:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:58:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:58:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:36 smithi086 ceph-mon[35163]: pgmap v8371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:36 smithi159 ceph-mon[36109]: pgmap v8371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:36 smithi055 ceph-mon[31863]: pgmap v8371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:38 smithi086 ceph-mon[35163]: pgmap v8372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14318.054177 secs 2024-03-28T09:58:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:38 smithi159 ceph-mon[36109]: pgmap v8372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14318.054177 secs 2024-03-28T09:58:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:38 smithi055 ceph-mon[31863]: pgmap v8372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14318.054177 secs 2024-03-28T09:58:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:40 smithi086 ceph-mon[35163]: pgmap v8373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:41.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:40 smithi159 ceph-mon[36109]: pgmap v8373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:40 smithi055 ceph-mon[31863]: pgmap v8373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:42 smithi086 ceph-mon[35163]: pgmap v8374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:42 smithi159 ceph-mon[36109]: pgmap v8374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:42 smithi055 ceph-mon[31863]: pgmap v8374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14323.054290 secs 2024-03-28T09:58:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14323.054290 secs 2024-03-28T09:58:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14323.054290 secs 2024-03-28T09:58:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:44 smithi086 ceph-mon[35163]: pgmap v8375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:44 smithi159 ceph-mon[36109]: pgmap v8375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:44 smithi055 ceph-mon[31863]: pgmap v8375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:46 smithi086 ceph-mon[35163]: pgmap v8376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:46 smithi159 ceph-mon[36109]: pgmap v8376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:46 smithi055 ceph-mon[31863]: pgmap v8376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:48 smithi086 ceph-mon[35163]: pgmap v8377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14328.054414 secs 2024-03-28T09:58:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:48 smithi159 ceph-mon[36109]: pgmap v8377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14328.054414 secs 2024-03-28T09:58:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:48 smithi055 ceph-mon[31863]: pgmap v8377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14328.054414 secs 2024-03-28T09:58:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:50 smithi086 ceph-mon[35163]: pgmap v8378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:50 smithi159 ceph-mon[36109]: pgmap v8378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:50 smithi055 ceph-mon[31863]: pgmap v8378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:52 smithi086 ceph-mon[35163]: pgmap v8379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:52 smithi159 ceph-mon[36109]: pgmap v8379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:52 smithi055 ceph-mon[31863]: pgmap v8379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14333.054536 secs 2024-03-28T09:58:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14333.054536 secs 2024-03-28T09:58:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14333.054536 secs 2024-03-28T09:58:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:54 smithi086 ceph-mon[35163]: pgmap v8380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:54 smithi159 ceph-mon[36109]: pgmap v8380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:54 smithi055 ceph-mon[31863]: pgmap v8380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:56 smithi086 ceph-mon[35163]: pgmap v8381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:56 smithi159 ceph-mon[36109]: pgmap v8381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:56 smithi055 ceph-mon[31863]: pgmap v8381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:58:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:58 smithi086 ceph-mon[35163]: pgmap v8382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:58:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14338.054661 secs 2024-03-28T09:58:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:58 smithi159 ceph-mon[36109]: pgmap v8382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:58:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14338.054661 secs 2024-03-28T09:58:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:58 smithi055 ceph-mon[31863]: pgmap v8382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:58:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:58:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14338.054661 secs 2024-03-28T09:59:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:00 smithi086 ceph-mon[35163]: pgmap v8383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:00 smithi159 ceph-mon[36109]: pgmap v8383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:00 smithi055 ceph-mon[31863]: pgmap v8383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:02 smithi086 ceph-mon[35163]: pgmap v8384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:02 smithi159 ceph-mon[36109]: pgmap v8384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:02 smithi055 ceph-mon[31863]: pgmap v8384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14343.054810 secs 2024-03-28T09:59:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14343.054810 secs 2024-03-28T09:59:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14343.054810 secs 2024-03-28T09:59:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:04 smithi086 ceph-mon[35163]: pgmap v8385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:04 smithi159 ceph-mon[36109]: pgmap v8385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:04 smithi055 ceph-mon[31863]: pgmap v8385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:06 smithi055 ceph-mon[31863]: pgmap v8386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:06 smithi086 ceph-mon[35163]: pgmap v8386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:06 smithi159 ceph-mon[36109]: pgmap v8386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:08 smithi055 ceph-mon[31863]: pgmap v8387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14348.054931 secs 2024-03-28T09:59:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:08 smithi086 ceph-mon[35163]: pgmap v8387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14348.054931 secs 2024-03-28T09:59:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:08 smithi159 ceph-mon[36109]: pgmap v8387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14348.054931 secs 2024-03-28T09:59:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:10 smithi055 ceph-mon[31863]: pgmap v8388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:10 smithi086 ceph-mon[35163]: pgmap v8388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:11.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:10 smithi159 ceph-mon[36109]: pgmap v8388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:12 smithi055 ceph-mon[31863]: pgmap v8389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:12 smithi086 ceph-mon[35163]: pgmap v8389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:12 smithi159 ceph-mon[36109]: pgmap v8389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14353.055050 secs 2024-03-28T09:59:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14353.055050 secs 2024-03-28T09:59:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14353.055050 secs 2024-03-28T09:59:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:14 smithi055 ceph-mon[31863]: pgmap v8390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:14 smithi086 ceph-mon[35163]: pgmap v8390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:14 smithi159 ceph-mon[36109]: pgmap v8390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:16 smithi055 ceph-mon[31863]: pgmap v8391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:16 smithi086 ceph-mon[35163]: pgmap v8391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:16 smithi159 ceph-mon[36109]: pgmap v8391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:18 smithi055 ceph-mon[31863]: pgmap v8392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14358.055141 secs 2024-03-28T09:59:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:18 smithi086 ceph-mon[35163]: pgmap v8392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14358.055141 secs 2024-03-28T09:59:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:18 smithi159 ceph-mon[36109]: pgmap v8392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14358.055141 secs 2024-03-28T09:59:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:20 smithi086 ceph-mon[35163]: pgmap v8393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:20 smithi159 ceph-mon[36109]: pgmap v8393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:20 smithi055 ceph-mon[31863]: pgmap v8393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:22 smithi086 ceph-mon[35163]: pgmap v8394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:22 smithi159 ceph-mon[36109]: pgmap v8394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:22 smithi055 ceph-mon[31863]: pgmap v8394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:24.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14363.055260 secs 2024-03-28T09:59:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14363.055260 secs 2024-03-28T09:59:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14363.055260 secs 2024-03-28T09:59:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:24 smithi086 ceph-mon[35163]: pgmap v8395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:24 smithi159 ceph-mon[36109]: pgmap v8395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:24 smithi055 ceph-mon[31863]: pgmap v8395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:26 smithi086 ceph-mon[35163]: pgmap v8396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:26 smithi159 ceph-mon[36109]: pgmap v8396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:26 smithi055 ceph-mon[31863]: pgmap v8396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:28 smithi086 ceph-mon[35163]: pgmap v8397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14368.055384 secs 2024-03-28T09:59:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:28 smithi159 ceph-mon[36109]: pgmap v8397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14368.055384 secs 2024-03-28T09:59:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:28 smithi055 ceph-mon[31863]: pgmap v8397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14368.055384 secs 2024-03-28T09:59:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:30 smithi086 ceph-mon[35163]: pgmap v8398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:30 smithi159 ceph-mon[36109]: pgmap v8398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:30 smithi055 ceph-mon[31863]: pgmap v8398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:32 smithi086 ceph-mon[35163]: pgmap v8399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:32 smithi159 ceph-mon[36109]: pgmap v8399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:32 smithi055 ceph-mon[31863]: pgmap v8399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14373.055447 secs 2024-03-28T09:59:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14373.055447 secs 2024-03-28T09:59:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14373.055447 secs 2024-03-28T09:59:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:34 smithi086 ceph-mon[35163]: pgmap v8400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:34 smithi159 ceph-mon[36109]: pgmap v8400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:34 smithi055 ceph-mon[31863]: pgmap v8400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:59:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:59:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T09:59:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:36 smithi086 ceph-mon[35163]: pgmap v8401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:36 smithi159 ceph-mon[36109]: pgmap v8401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:36 smithi055 ceph-mon[31863]: pgmap v8401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T09:59:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:59:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:59:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:59:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:59:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:59:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:59:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T09:59:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T09:59:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T09:59:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:38 smithi086 ceph-mon[35163]: pgmap v8402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:38 smithi086 ceph-mon[35163]: pgmap v8403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:59:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14378.055469 secs 2024-03-28T09:59:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:38 smithi159 ceph-mon[36109]: pgmap v8402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:38 smithi159 ceph-mon[36109]: pgmap v8403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:59:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14378.055469 secs 2024-03-28T09:59:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:38 smithi055 ceph-mon[31863]: pgmap v8402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:38 smithi055 ceph-mon[31863]: pgmap v8403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T09:59:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14378.055469 secs 2024-03-28T09:59:40.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:40 smithi055 ceph-mon[31863]: pgmap v8404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:40 smithi086 ceph-mon[35163]: pgmap v8404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:40 smithi159 ceph-mon[36109]: pgmap v8404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:42 smithi086 ceph-mon[35163]: pgmap v8405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:42 smithi159 ceph-mon[36109]: pgmap v8405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:42 smithi055 ceph-mon[31863]: pgmap v8405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14383.055555 secs 2024-03-28T09:59:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:44 smithi086 ceph-mon[35163]: pgmap v8406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14383.055555 secs 2024-03-28T09:59:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:44 smithi159 ceph-mon[36109]: pgmap v8406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14383.055555 secs 2024-03-28T09:59:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:44 smithi055 ceph-mon[31863]: pgmap v8406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:46 smithi086 ceph-mon[35163]: pgmap v8407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:46 smithi159 ceph-mon[36109]: pgmap v8407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:46 smithi055 ceph-mon[31863]: pgmap v8407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T09:59:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:48 smithi086 ceph-mon[35163]: pgmap v8408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:48 smithi159 ceph-mon[36109]: pgmap v8408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:48 smithi055 ceph-mon[31863]: pgmap v8408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T09:59:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14388.055670 secs 2024-03-28T09:59:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14388.055670 secs 2024-03-28T09:59:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14388.055670 secs 2024-03-28T09:59:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:50 smithi086 ceph-mon[35163]: pgmap v8409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:50 smithi159 ceph-mon[36109]: pgmap v8409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:50 smithi055 ceph-mon[31863]: pgmap v8409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:52 smithi086 ceph-mon[35163]: pgmap v8410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:52 smithi159 ceph-mon[36109]: pgmap v8410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:52 smithi055 ceph-mon[31863]: pgmap v8410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14393.055818 secs 2024-03-28T09:59:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:54 smithi086 ceph-mon[35163]: pgmap v8411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14393.055818 secs 2024-03-28T09:59:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:54 smithi159 ceph-mon[36109]: pgmap v8411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14393.055818 secs 2024-03-28T09:59:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:54 smithi055 ceph-mon[31863]: pgmap v8411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:56 smithi086 ceph-mon[35163]: pgmap v8412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:56 smithi159 ceph-mon[36109]: pgmap v8412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:56 smithi055 ceph-mon[31863]: pgmap v8412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T09:59:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:58 smithi086 ceph-mon[35163]: pgmap v8413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:58 smithi159 ceph-mon[36109]: pgmap v8413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:58 smithi055 ceph-mon[31863]: pgmap v8413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T09:59:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 09:59:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14398.055884 secs 2024-03-28T09:59:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 09:59:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14398.055884 secs 2024-03-28T09:59:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 09:59:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14398.055884 secs 2024-03-28T10:00:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:00 smithi086 ceph-mon[35163]: pgmap v8414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:00:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:00 smithi159 ceph-mon[36109]: pgmap v8414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:00:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:00 smithi055 ceph-mon[31863]: pgmap v8414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:00:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:02 smithi086 ceph-mon[35163]: pgmap v8415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:02 smithi159 ceph-mon[36109]: pgmap v8415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:02 smithi055 ceph-mon[31863]: pgmap v8415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14403.055955 secs 2024-03-28T10:00:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:04 smithi086 ceph-mon[35163]: pgmap v8416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14403.055955 secs 2024-03-28T10:00:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:04 smithi159 ceph-mon[36109]: pgmap v8416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14403.055955 secs 2024-03-28T10:00:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:04 smithi055 ceph-mon[31863]: pgmap v8416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:06 smithi086 ceph-mon[35163]: pgmap v8417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:06 smithi159 ceph-mon[36109]: pgmap v8417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:06 smithi055 ceph-mon[31863]: pgmap v8417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:08 smithi086 ceph-mon[35163]: pgmap v8418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:08 smithi159 ceph-mon[36109]: pgmap v8418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:08 smithi055 ceph-mon[31863]: pgmap v8418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14408.056043 secs 2024-03-28T10:00:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14408.056043 secs 2024-03-28T10:00:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14408.056043 secs 2024-03-28T10:00:10.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:10 smithi055 ceph-mon[31863]: pgmap v8419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:10 smithi086 ceph-mon[35163]: pgmap v8419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:10 smithi159 ceph-mon[36109]: pgmap v8419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:12 smithi086 ceph-mon[35163]: pgmap v8420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:12 smithi159 ceph-mon[36109]: pgmap v8420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:12 smithi055 ceph-mon[31863]: pgmap v8420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14413.056121 secs 2024-03-28T10:00:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:14 smithi086 ceph-mon[35163]: pgmap v8421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14413.056121 secs 2024-03-28T10:00:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:14 smithi159 ceph-mon[36109]: pgmap v8421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14413.056121 secs 2024-03-28T10:00:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:14 smithi055 ceph-mon[31863]: pgmap v8421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:16 smithi086 ceph-mon[35163]: pgmap v8422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:16 smithi159 ceph-mon[36109]: pgmap v8422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:16 smithi055 ceph-mon[31863]: pgmap v8422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:18 smithi086 ceph-mon[35163]: pgmap v8423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:18 smithi159 ceph-mon[36109]: pgmap v8423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:18 smithi055 ceph-mon[31863]: pgmap v8423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14418.056181 secs 2024-03-28T10:00:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14418.056181 secs 2024-03-28T10:00:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14418.056181 secs 2024-03-28T10:00:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:20 smithi086 ceph-mon[35163]: pgmap v8424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:20 smithi159 ceph-mon[36109]: pgmap v8424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:20 smithi055 ceph-mon[31863]: pgmap v8424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:22 smithi086 ceph-mon[35163]: pgmap v8425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:22 smithi159 ceph-mon[36109]: pgmap v8425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:22 smithi055 ceph-mon[31863]: pgmap v8425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14423.056244 secs 2024-03-28T10:00:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:24 smithi086 ceph-mon[35163]: pgmap v8426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14423.056244 secs 2024-03-28T10:00:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:24 smithi159 ceph-mon[36109]: pgmap v8426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14423.056244 secs 2024-03-28T10:00:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:24 smithi055 ceph-mon[31863]: pgmap v8426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:26 smithi086 ceph-mon[35163]: pgmap v8427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:26 smithi159 ceph-mon[36109]: pgmap v8427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:26 smithi055 ceph-mon[31863]: pgmap v8427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:28 smithi055 ceph-mon[31863]: pgmap v8428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:28 smithi086 ceph-mon[35163]: pgmap v8428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:28 smithi159 ceph-mon[36109]: pgmap v8428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14428.056311 secs 2024-03-28T10:00:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14428.056311 secs 2024-03-28T10:00:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14428.056311 secs 2024-03-28T10:00:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:30 smithi055 ceph-mon[31863]: pgmap v8429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:30 smithi086 ceph-mon[35163]: pgmap v8429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:30 smithi159 ceph-mon[36109]: pgmap v8429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:32 smithi055 ceph-mon[31863]: pgmap v8430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:32 smithi086 ceph-mon[35163]: pgmap v8430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:32 smithi159 ceph-mon[36109]: pgmap v8430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14433.056389 secs 2024-03-28T10:00:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:34 smithi055 ceph-mon[31863]: pgmap v8431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14433.056389 secs 2024-03-28T10:00:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:34 smithi086 ceph-mon[35163]: pgmap v8431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14433.056389 secs 2024-03-28T10:00:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:34 smithi159 ceph-mon[36109]: pgmap v8431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:36 smithi055 ceph-mon[31863]: pgmap v8432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:36 smithi086 ceph-mon[35163]: pgmap v8432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:36 smithi159 ceph-mon[36109]: pgmap v8432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:38 smithi055 ceph-mon[31863]: pgmap v8433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:00:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:38 smithi086 ceph-mon[35163]: pgmap v8433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:00:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:38 smithi159 ceph-mon[36109]: pgmap v8433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:38.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:00:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14438.056491 secs 2024-03-28T10:00:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:00:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:00:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: pgmap v8434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: pgmap v8435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:00:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14438.056491 secs 2024-03-28T10:00:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:00:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:00:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: pgmap v8434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: pgmap v8435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:00:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14438.056491 secs 2024-03-28T10:00:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:00:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:00:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: pgmap v8434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: pgmap v8435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:39.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:00:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:41 smithi086 ceph-mon[35163]: pgmap v8436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:41 smithi159 ceph-mon[36109]: pgmap v8436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:41 smithi055 ceph-mon[31863]: pgmap v8436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14443.056577 secs 2024-03-28T10:00:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:43 smithi086 ceph-mon[35163]: pgmap v8437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:00:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14443.056577 secs 2024-03-28T10:00:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:43 smithi159 ceph-mon[36109]: pgmap v8437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:00:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14443.056577 secs 2024-03-28T10:00:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:43 smithi055 ceph-mon[31863]: pgmap v8437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:00:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:45 smithi086 ceph-mon[35163]: pgmap v8438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:45 smithi159 ceph-mon[36109]: pgmap v8438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:45 smithi055 ceph-mon[31863]: pgmap v8438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:47 smithi086 ceph-mon[35163]: pgmap v8439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:47 smithi159 ceph-mon[36109]: pgmap v8439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:47 smithi055 ceph-mon[31863]: pgmap v8439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14448.056668 secs 2024-03-28T10:00:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14448.056668 secs 2024-03-28T10:00:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14448.056668 secs 2024-03-28T10:00:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:49 smithi086 ceph-mon[35163]: pgmap v8440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:00:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:49 smithi159 ceph-mon[36109]: pgmap v8440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:00:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:49 smithi055 ceph-mon[31863]: pgmap v8440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:00:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:51 smithi086 ceph-mon[35163]: pgmap v8441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:52.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:51 smithi159 ceph-mon[36109]: pgmap v8441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:51 smithi055 ceph-mon[31863]: pgmap v8441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14453.056813 secs 2024-03-28T10:00:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:53 smithi086 ceph-mon[35163]: pgmap v8442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14453.056813 secs 2024-03-28T10:00:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:53 smithi159 ceph-mon[36109]: pgmap v8442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14453.056813 secs 2024-03-28T10:00:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:53 smithi055 ceph-mon[31863]: pgmap v8442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:00:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:55 smithi086 ceph-mon[35163]: pgmap v8443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:55 smithi159 ceph-mon[36109]: pgmap v8443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:55 smithi055 ceph-mon[31863]: pgmap v8443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:57 smithi086 ceph-mon[35163]: pgmap v8444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:57 smithi159 ceph-mon[36109]: pgmap v8444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:57 smithi055 ceph-mon[31863]: pgmap v8444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:00:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:00:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14458.056877 secs 2024-03-28T10:00:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:00:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14458.056877 secs 2024-03-28T10:00:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:00:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14458.056877 secs 2024-03-28T10:01:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:00 smithi086 ceph-mon[35163]: pgmap v8445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:00 smithi159 ceph-mon[36109]: pgmap v8445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:00 smithi055 ceph-mon[31863]: pgmap v8445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:01.270 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:01 smithi055 ceph-mon[31863]: pgmap v8446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:01 smithi086 ceph-mon[35163]: pgmap v8446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:01 smithi159 ceph-mon[36109]: pgmap v8446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14463.056941 secs 2024-03-28T10:01:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:03 smithi086 ceph-mon[35163]: pgmap v8447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14463.056941 secs 2024-03-28T10:01:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:03 smithi159 ceph-mon[36109]: pgmap v8447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14463.056941 secs 2024-03-28T10:01:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:03 smithi055 ceph-mon[31863]: pgmap v8447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:05 smithi086 ceph-mon[35163]: pgmap v8448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:05 smithi159 ceph-mon[36109]: pgmap v8448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:05 smithi055 ceph-mon[31863]: pgmap v8448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:07 smithi086 ceph-mon[35163]: pgmap v8449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:07 smithi159 ceph-mon[36109]: pgmap v8449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:07 smithi055 ceph-mon[31863]: pgmap v8449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14468.057033 secs 2024-03-28T10:01:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14468.057033 secs 2024-03-28T10:01:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14468.057033 secs 2024-03-28T10:01:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:09 smithi086 ceph-mon[35163]: pgmap v8450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:09 smithi159 ceph-mon[36109]: pgmap v8450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:09 smithi055 ceph-mon[31863]: pgmap v8450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:11 smithi086 ceph-mon[35163]: pgmap v8451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:11 smithi159 ceph-mon[36109]: pgmap v8451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:11 smithi055 ceph-mon[31863]: pgmap v8451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14473.057125 secs 2024-03-28T10:01:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:13 smithi086 ceph-mon[35163]: pgmap v8452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14473.057125 secs 2024-03-28T10:01:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:13 smithi159 ceph-mon[36109]: pgmap v8452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14473.057125 secs 2024-03-28T10:01:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:13 smithi055 ceph-mon[31863]: pgmap v8452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:15 smithi086 ceph-mon[35163]: pgmap v8453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:15 smithi159 ceph-mon[36109]: pgmap v8453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:15 smithi055 ceph-mon[31863]: pgmap v8453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:17 smithi086 ceph-mon[35163]: pgmap v8454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:17 smithi159 ceph-mon[36109]: pgmap v8454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:17 smithi055 ceph-mon[31863]: pgmap v8454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14478.057243 secs 2024-03-28T10:01:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14478.057243 secs 2024-03-28T10:01:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14478.057243 secs 2024-03-28T10:01:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:20 smithi086 ceph-mon[35163]: pgmap v8455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:20 smithi159 ceph-mon[36109]: pgmap v8455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:20 smithi055 ceph-mon[31863]: pgmap v8455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:21 smithi086 ceph-mon[35163]: pgmap v8456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:21 smithi159 ceph-mon[36109]: pgmap v8456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:21 smithi055 ceph-mon[31863]: pgmap v8456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14483.057361 secs 2024-03-28T10:01:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:23 smithi086 ceph-mon[35163]: pgmap v8457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14483.057361 secs 2024-03-28T10:01:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:23 smithi159 ceph-mon[36109]: pgmap v8457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14483.057361 secs 2024-03-28T10:01:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:23 smithi055 ceph-mon[31863]: pgmap v8457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:26.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:25 smithi159 ceph-mon[36109]: pgmap v8458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:25 smithi086 ceph-mon[35163]: pgmap v8458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:25 smithi055 ceph-mon[31863]: pgmap v8458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:27 smithi086 ceph-mon[35163]: pgmap v8459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:27 smithi159 ceph-mon[36109]: pgmap v8459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:27 smithi055 ceph-mon[31863]: pgmap v8459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14488.057438 secs 2024-03-28T10:01:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14488.057438 secs 2024-03-28T10:01:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14488.057438 secs 2024-03-28T10:01:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:29 smithi086 ceph-mon[35163]: pgmap v8460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:29 smithi159 ceph-mon[36109]: pgmap v8460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:29 smithi055 ceph-mon[31863]: pgmap v8460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:31 smithi086 ceph-mon[35163]: pgmap v8461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:31 smithi159 ceph-mon[36109]: pgmap v8461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:31 smithi055 ceph-mon[31863]: pgmap v8461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14493.057557 secs 2024-03-28T10:01:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:33 smithi086 ceph-mon[35163]: pgmap v8462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14493.057557 secs 2024-03-28T10:01:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:33 smithi159 ceph-mon[36109]: pgmap v8462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14493.057557 secs 2024-03-28T10:01:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:33 smithi055 ceph-mon[31863]: pgmap v8462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:35 smithi086 ceph-mon[35163]: pgmap v8463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:35 smithi159 ceph-mon[36109]: pgmap v8463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:35 smithi055 ceph-mon[31863]: pgmap v8463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:38 smithi086 ceph-mon[35163]: pgmap v8464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:38 smithi159 ceph-mon[36109]: pgmap v8464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:38 smithi055 ceph-mon[31863]: pgmap v8464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14498.057626 secs 2024-03-28T10:01:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14498.057626 secs 2024-03-28T10:01:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14498.057626 secs 2024-03-28T10:01:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:40 smithi086 ceph-mon[35163]: pgmap v8465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:01:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:40 smithi159 ceph-mon[36109]: pgmap v8465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:01:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:40 smithi055 ceph-mon[31863]: pgmap v8465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:01:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:01:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:01:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:41 smithi086 ceph-mon[35163]: pgmap v8466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:01:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:41 smithi086 ceph-mon[35163]: pgmap v8467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:01:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:01:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:01:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:41 smithi159 ceph-mon[36109]: pgmap v8466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:01:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:41 smithi159 ceph-mon[36109]: pgmap v8467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:41.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:41 smithi055 ceph-mon[31863]: pgmap v8466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:41 smithi055 ceph-mon[31863]: pgmap v8467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:01:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14503.057689 secs 2024-03-28T10:01:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:43 smithi086 ceph-mon[35163]: pgmap v8468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:01:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14503.057689 secs 2024-03-28T10:01:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:43 smithi159 ceph-mon[36109]: pgmap v8468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:01:44.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14503.057689 secs 2024-03-28T10:01:44.076 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:43 smithi055 ceph-mon[31863]: pgmap v8468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:01:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:45 smithi086 ceph-mon[35163]: pgmap v8469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:45 smithi159 ceph-mon[36109]: pgmap v8469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:45 smithi055 ceph-mon[31863]: pgmap v8469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:47 smithi086 ceph-mon[35163]: pgmap v8470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:47 smithi159 ceph-mon[36109]: pgmap v8470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:47 smithi055 ceph-mon[31863]: pgmap v8470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14508.057754 secs 2024-03-28T10:01:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14508.057754 secs 2024-03-28T10:01:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14508.057754 secs 2024-03-28T10:01:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:49 smithi086 ceph-mon[35163]: pgmap v8471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:49 smithi159 ceph-mon[36109]: pgmap v8471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:49 smithi055 ceph-mon[31863]: pgmap v8471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:01:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:51 smithi086 ceph-mon[35163]: pgmap v8472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:51 smithi159 ceph-mon[36109]: pgmap v8472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:51 smithi055 ceph-mon[31863]: pgmap v8472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:01:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:53 smithi055 ceph-mon[31863]: pgmap v8473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:53 smithi086 ceph-mon[35163]: pgmap v8473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:53 smithi159 ceph-mon[36109]: pgmap v8473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:01:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14513.057835 secs 2024-03-28T10:01:54.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14513.057835 secs 2024-03-28T10:01:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14513.057835 secs 2024-03-28T10:01:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:55 smithi086 ceph-mon[35163]: pgmap v8474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:55 smithi159 ceph-mon[36109]: pgmap v8474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:55 smithi055 ceph-mon[31863]: pgmap v8474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:57 smithi086 ceph-mon[35163]: pgmap v8475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:57 smithi159 ceph-mon[36109]: pgmap v8475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:57 smithi055 ceph-mon[31863]: pgmap v8475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:01:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14518.057902 secs 2024-03-28T10:01:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14518.057902 secs 2024-03-28T10:01:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14518.057902 secs 2024-03-28T10:02:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:01:59 smithi086 ceph-mon[35163]: pgmap v8476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:01:59 smithi159 ceph-mon[36109]: pgmap v8476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:01:59 smithi055 ceph-mon[31863]: pgmap v8476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:01 smithi086 ceph-mon[35163]: pgmap v8477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:01 smithi159 ceph-mon[36109]: pgmap v8477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:01 smithi055 ceph-mon[31863]: pgmap v8477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14523.057994 secs 2024-03-28T10:02:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:03 smithi086 ceph-mon[35163]: pgmap v8478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14523.057994 secs 2024-03-28T10:02:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:03 smithi159 ceph-mon[36109]: pgmap v8478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14523.057994 secs 2024-03-28T10:02:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:03 smithi055 ceph-mon[31863]: pgmap v8478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:05 smithi086 ceph-mon[35163]: pgmap v8479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:05 smithi159 ceph-mon[36109]: pgmap v8479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:05 smithi055 ceph-mon[31863]: pgmap v8479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:07 smithi086 ceph-mon[35163]: pgmap v8480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:07 smithi159 ceph-mon[36109]: pgmap v8480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:07 smithi055 ceph-mon[31863]: pgmap v8480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14528.058081 secs 2024-03-28T10:02:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14528.058081 secs 2024-03-28T10:02:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14528.058081 secs 2024-03-28T10:02:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:09 smithi086 ceph-mon[35163]: pgmap v8481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:09 smithi159 ceph-mon[36109]: pgmap v8481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:09 smithi055 ceph-mon[31863]: pgmap v8481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:11 smithi159 ceph-mon[36109]: pgmap v8482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:12.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:11 smithi055 ceph-mon[31863]: pgmap v8482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:11 smithi086 ceph-mon[35163]: pgmap v8482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14533.058163 secs 2024-03-28T10:02:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:13 smithi055 ceph-mon[31863]: pgmap v8483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14533.058163 secs 2024-03-28T10:02:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:13 smithi086 ceph-mon[35163]: pgmap v8483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14533.058163 secs 2024-03-28T10:02:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:13 smithi159 ceph-mon[36109]: pgmap v8483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:15 smithi055 ceph-mon[31863]: pgmap v8484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:15 smithi086 ceph-mon[35163]: pgmap v8484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:15 smithi159 ceph-mon[36109]: pgmap v8484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:17 smithi055 ceph-mon[31863]: pgmap v8485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:17 smithi086 ceph-mon[35163]: pgmap v8485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:17 smithi159 ceph-mon[36109]: pgmap v8485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14538.058229 secs 2024-03-28T10:02:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14538.058229 secs 2024-03-28T10:02:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14538.058229 secs 2024-03-28T10:02:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:19 smithi055 ceph-mon[31863]: pgmap v8486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:19 smithi086 ceph-mon[35163]: pgmap v8486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:19 smithi159 ceph-mon[36109]: pgmap v8486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:21 smithi055 ceph-mon[31863]: pgmap v8487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:21 smithi086 ceph-mon[35163]: pgmap v8487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:21 smithi159 ceph-mon[36109]: pgmap v8487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14543.058351 secs 2024-03-28T10:02:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:23 smithi086 ceph-mon[35163]: pgmap v8488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14543.058351 secs 2024-03-28T10:02:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:23 smithi159 ceph-mon[36109]: pgmap v8488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14543.058351 secs 2024-03-28T10:02:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:23 smithi055 ceph-mon[31863]: pgmap v8488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:25 smithi086 ceph-mon[35163]: pgmap v8489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:25 smithi159 ceph-mon[36109]: pgmap v8489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:25 smithi055 ceph-mon[31863]: pgmap v8489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:27 smithi086 ceph-mon[35163]: pgmap v8490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:27 smithi159 ceph-mon[36109]: pgmap v8490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:27 smithi055 ceph-mon[31863]: pgmap v8490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14548.058435 secs 2024-03-28T10:02:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14548.058435 secs 2024-03-28T10:02:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14548.058435 secs 2024-03-28T10:02:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:29 smithi086 ceph-mon[35163]: pgmap v8491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:29 smithi159 ceph-mon[36109]: pgmap v8491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:29 smithi055 ceph-mon[31863]: pgmap v8491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:31 smithi086 ceph-mon[35163]: pgmap v8492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:31 smithi159 ceph-mon[36109]: pgmap v8492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:31 smithi055 ceph-mon[31863]: pgmap v8492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14553.058562 secs 2024-03-28T10:02:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:33 smithi086 ceph-mon[35163]: pgmap v8493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14553.058562 secs 2024-03-28T10:02:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:33 smithi159 ceph-mon[36109]: pgmap v8493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14553.058562 secs 2024-03-28T10:02:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:33 smithi055 ceph-mon[31863]: pgmap v8493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:35 smithi086 ceph-mon[35163]: pgmap v8494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:36.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:35 smithi159 ceph-mon[36109]: pgmap v8494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:35 smithi055 ceph-mon[31863]: pgmap v8494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:37 smithi086 ceph-mon[35163]: pgmap v8495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:37 smithi159 ceph-mon[36109]: pgmap v8495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:37 smithi055 ceph-mon[31863]: pgmap v8495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14558.058683 secs 2024-03-28T10:02:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14558.058683 secs 2024-03-28T10:02:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14558.058683 secs 2024-03-28T10:02:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:39 smithi086 ceph-mon[35163]: pgmap v8496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:39 smithi159 ceph-mon[36109]: pgmap v8496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:39 smithi055 ceph-mon[31863]: pgmap v8496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:41 smithi086 ceph-mon[35163]: pgmap v8497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:02:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:41 smithi159 ceph-mon[36109]: pgmap v8497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:02:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:41 smithi055 ceph-mon[31863]: pgmap v8497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:02:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:02:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:02:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:02:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:02:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:02:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:02:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:02:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:02:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: pgmap v8498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: pgmap v8499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14563.058714 secs 2024-03-28T10:02:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:02:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: pgmap v8498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: pgmap v8499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14563.058714 secs 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: pgmap v8498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: pgmap v8499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14563.058714 secs 2024-03-28T10:02:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:45 smithi086 ceph-mon[35163]: pgmap v8500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:45 smithi159 ceph-mon[36109]: pgmap v8500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:45 smithi055 ceph-mon[31863]: pgmap v8500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:47 smithi086 ceph-mon[35163]: pgmap v8501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:47 smithi159 ceph-mon[36109]: pgmap v8501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:47 smithi055 ceph-mon[31863]: pgmap v8501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14568.058831 secs 2024-03-28T10:02:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14568.058831 secs 2024-03-28T10:02:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14568.058831 secs 2024-03-28T10:02:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:50 smithi086 ceph-mon[35163]: pgmap v8502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:50 smithi159 ceph-mon[36109]: pgmap v8502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:50 smithi055 ceph-mon[31863]: pgmap v8502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:52 smithi086 ceph-mon[35163]: pgmap v8503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:52 smithi159 ceph-mon[36109]: pgmap v8503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:52 smithi055 ceph-mon[31863]: pgmap v8503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:02:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:54 smithi086 ceph-mon[35163]: pgmap v8504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:02:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14573.058897 secs 2024-03-28T10:02:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:54 smithi159 ceph-mon[36109]: pgmap v8504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:02:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14573.058897 secs 2024-03-28T10:02:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:54 smithi055 ceph-mon[31863]: pgmap v8504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:02:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14573.058897 secs 2024-03-28T10:02:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:56 smithi086 ceph-mon[35163]: pgmap v8505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:56 smithi159 ceph-mon[36109]: pgmap v8505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:56 smithi055 ceph-mon[31863]: pgmap v8505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:57 smithi055 ceph-mon[31863]: pgmap v8506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:57 smithi086 ceph-mon[35163]: pgmap v8506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:57 smithi159 ceph-mon[36109]: pgmap v8506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14578.059016 secs 2024-03-28T10:02:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:02:59 smithi086 ceph-mon[35163]: pgmap v8507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14578.059016 secs 2024-03-28T10:02:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:02:59 smithi159 ceph-mon[36109]: pgmap v8507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:02:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14578.059016 secs 2024-03-28T10:02:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:02:59 smithi055 ceph-mon[31863]: pgmap v8507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:01 smithi086 ceph-mon[35163]: pgmap v8508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:01 smithi159 ceph-mon[36109]: pgmap v8508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:01 smithi055 ceph-mon[31863]: pgmap v8508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:03 smithi086 ceph-mon[35163]: pgmap v8509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:03 smithi159 ceph-mon[36109]: pgmap v8509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:03 smithi055 ceph-mon[31863]: pgmap v8509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14583.059137 secs 2024-03-28T10:03:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14583.059137 secs 2024-03-28T10:03:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14583.059137 secs 2024-03-28T10:03:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:05 smithi086 ceph-mon[35163]: pgmap v8510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:05 smithi159 ceph-mon[36109]: pgmap v8510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:05 smithi055 ceph-mon[31863]: pgmap v8510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:07 smithi086 ceph-mon[35163]: pgmap v8511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:07 smithi159 ceph-mon[36109]: pgmap v8511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:07 smithi055 ceph-mon[31863]: pgmap v8511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14588.059162 secs 2024-03-28T10:03:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:09 smithi055 ceph-mon[31863]: pgmap v8512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14588.059162 secs 2024-03-28T10:03:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:09 smithi086 ceph-mon[35163]: pgmap v8512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14588.059162 secs 2024-03-28T10:03:10.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:09 smithi159 ceph-mon[36109]: pgmap v8512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:11 smithi055 ceph-mon[31863]: pgmap v8513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:11 smithi086 ceph-mon[35163]: pgmap v8513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:11 smithi159 ceph-mon[36109]: pgmap v8513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:13 smithi055 ceph-mon[31863]: pgmap v8514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14593.059286 secs 2024-03-28T10:03:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:13 smithi086 ceph-mon[35163]: pgmap v8514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14593.059286 secs 2024-03-28T10:03:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:13 smithi159 ceph-mon[36109]: pgmap v8514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14593.059286 secs 2024-03-28T10:03:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:15 smithi055 ceph-mon[31863]: pgmap v8515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:15 smithi086 ceph-mon[35163]: pgmap v8515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:15 smithi159 ceph-mon[36109]: pgmap v8515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:17 smithi055 ceph-mon[31863]: pgmap v8516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:17 smithi086 ceph-mon[35163]: pgmap v8516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:17 smithi159 ceph-mon[36109]: pgmap v8516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14598.059370 secs 2024-03-28T10:03:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14598.059370 secs 2024-03-28T10:03:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14598.059370 secs 2024-03-28T10:03:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:19 smithi086 ceph-mon[35163]: pgmap v8517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:19 smithi159 ceph-mon[36109]: pgmap v8517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:19 smithi055 ceph-mon[31863]: pgmap v8517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:21 smithi086 ceph-mon[35163]: pgmap v8518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:21 smithi159 ceph-mon[36109]: pgmap v8518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:21 smithi055 ceph-mon[31863]: pgmap v8518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:23 smithi086 ceph-mon[35163]: pgmap v8519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14603.059491 secs 2024-03-28T10:03:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:23 smithi159 ceph-mon[36109]: pgmap v8519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14603.059491 secs 2024-03-28T10:03:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:23 smithi055 ceph-mon[31863]: pgmap v8519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14603.059491 secs 2024-03-28T10:03:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:25 smithi086 ceph-mon[35163]: pgmap v8520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:25 smithi159 ceph-mon[36109]: pgmap v8520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:25 smithi055 ceph-mon[31863]: pgmap v8520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:27 smithi086 ceph-mon[35163]: pgmap v8521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:28.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:27 smithi159 ceph-mon[36109]: pgmap v8521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:27 smithi055 ceph-mon[31863]: pgmap v8521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14608.059569 secs 2024-03-28T10:03:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14608.059569 secs 2024-03-28T10:03:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14608.059569 secs 2024-03-28T10:03:29.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:29 smithi086 ceph-mon[35163]: pgmap v8522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:29 smithi159 ceph-mon[36109]: pgmap v8522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:29 smithi055 ceph-mon[31863]: pgmap v8522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:31 smithi086 ceph-mon[35163]: pgmap v8523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:31 smithi159 ceph-mon[36109]: pgmap v8523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:32.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:31 smithi055 ceph-mon[31863]: pgmap v8523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:33 smithi086 ceph-mon[35163]: pgmap v8524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14613.059689 secs 2024-03-28T10:03:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:33 smithi159 ceph-mon[36109]: pgmap v8524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14613.059689 secs 2024-03-28T10:03:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:33 smithi055 ceph-mon[31863]: pgmap v8524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14613.059689 secs 2024-03-28T10:03:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:35 smithi086 ceph-mon[35163]: pgmap v8525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:35 smithi159 ceph-mon[36109]: pgmap v8525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:36.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:35 smithi055 ceph-mon[31863]: pgmap v8525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:37 smithi086 ceph-mon[35163]: pgmap v8526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:37 smithi159 ceph-mon[36109]: pgmap v8526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:38.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:37 smithi055 ceph-mon[31863]: pgmap v8526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14618.059812 secs 2024-03-28T10:03:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14618.059812 secs 2024-03-28T10:03:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14618.059812 secs 2024-03-28T10:03:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:39 smithi086 ceph-mon[35163]: pgmap v8527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:39 smithi159 ceph-mon[36109]: pgmap v8527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:40.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:39 smithi055 ceph-mon[31863]: pgmap v8527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:41 smithi086 ceph-mon[35163]: pgmap v8528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:41 smithi159 ceph-mon[36109]: pgmap v8528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:42.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:41 smithi055 ceph-mon[31863]: pgmap v8528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:03:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:43 smithi086 ceph-mon[35163]: pgmap v8529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14623.059972 secs 2024-03-28T10:03:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:03:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:43 smithi159 ceph-mon[36109]: pgmap v8529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14623.059972 secs 2024-03-28T10:03:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:03:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:43 smithi055 ceph-mon[31863]: pgmap v8529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:03:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14623.059972 secs 2024-03-28T10:03:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:03:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:03:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:03:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:03:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:03:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:03:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:03:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:03:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:03:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:03:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:03:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:45 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:03:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:45 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:03:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:45 smithi086 ceph-mon[35163]: pgmap v8530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:45 smithi086 ceph-mon[35163]: pgmap v8531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:45 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:03:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:45 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:03:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:45 smithi159 ceph-mon[36109]: pgmap v8530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:46.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:45 smithi159 ceph-mon[36109]: pgmap v8531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:45 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:03:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:45 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:03:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:45 smithi055 ceph-mon[31863]: pgmap v8530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:46.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:45 smithi055 ceph-mon[31863]: pgmap v8531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:47 smithi086 ceph-mon[35163]: pgmap v8532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:47 smithi159 ceph-mon[36109]: pgmap v8532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:47 smithi055 ceph-mon[31863]: pgmap v8532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14628.060092 secs 2024-03-28T10:03:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14628.060092 secs 2024-03-28T10:03:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14628.060092 secs 2024-03-28T10:03:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:49 smithi086 ceph-mon[35163]: pgmap v8533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:49 smithi159 ceph-mon[36109]: pgmap v8533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:49 smithi055 ceph-mon[31863]: pgmap v8533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:51 smithi086 ceph-mon[35163]: pgmap v8534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:51 smithi159 ceph-mon[36109]: pgmap v8534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:51 smithi055 ceph-mon[31863]: pgmap v8534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:53 smithi055 ceph-mon[31863]: pgmap v8535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14633.060179 secs 2024-03-28T10:03:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:53 smithi086 ceph-mon[35163]: pgmap v8535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14633.060179 secs 2024-03-28T10:03:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:53 smithi159 ceph-mon[36109]: pgmap v8535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:03:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14633.060179 secs 2024-03-28T10:03:56.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:55 smithi159 ceph-mon[36109]: pgmap v8536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:03:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:55 smithi055 ceph-mon[31863]: pgmap v8536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:03:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:55 smithi086 ceph-mon[35163]: pgmap v8536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:03:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:57 smithi055 ceph-mon[31863]: pgmap v8537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:57 smithi086 ceph-mon[35163]: pgmap v8537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:57 smithi159 ceph-mon[36109]: pgmap v8537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:03:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14638.060301 secs 2024-03-28T10:03:59.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14638.060301 secs 2024-03-28T10:03:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14638.060301 secs 2024-03-28T10:04:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:03:59 smithi055 ceph-mon[31863]: pgmap v8538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:03:59 smithi086 ceph-mon[35163]: pgmap v8538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:03:59 smithi159 ceph-mon[36109]: pgmap v8538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:01 smithi055 ceph-mon[31863]: pgmap v8539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:01 smithi086 ceph-mon[35163]: pgmap v8539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:01 smithi159 ceph-mon[36109]: pgmap v8539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:03 smithi055 ceph-mon[31863]: pgmap v8540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14643.060419 secs 2024-03-28T10:04:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:03 smithi086 ceph-mon[35163]: pgmap v8540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14643.060419 secs 2024-03-28T10:04:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:03 smithi159 ceph-mon[36109]: pgmap v8540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14643.060419 secs 2024-03-28T10:04:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:05 smithi055 ceph-mon[31863]: pgmap v8541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:05 smithi086 ceph-mon[35163]: pgmap v8541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:05 smithi159 ceph-mon[36109]: pgmap v8541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:07 smithi086 ceph-mon[35163]: pgmap v8542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:07 smithi159 ceph-mon[36109]: pgmap v8542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:07 smithi055 ceph-mon[31863]: pgmap v8542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14648.060507 secs 2024-03-28T10:04:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14648.060507 secs 2024-03-28T10:04:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14648.060507 secs 2024-03-28T10:04:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:09 smithi086 ceph-mon[35163]: pgmap v8543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:09 smithi159 ceph-mon[36109]: pgmap v8543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:09 smithi055 ceph-mon[31863]: pgmap v8543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:11 smithi086 ceph-mon[35163]: pgmap v8544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:11 smithi159 ceph-mon[36109]: pgmap v8544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:11 smithi055 ceph-mon[31863]: pgmap v8544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:13 smithi086 ceph-mon[35163]: pgmap v8545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14653.060629 secs 2024-03-28T10:04:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:13 smithi159 ceph-mon[36109]: pgmap v8545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14653.060629 secs 2024-03-28T10:04:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:13 smithi055 ceph-mon[31863]: pgmap v8545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14653.060629 secs 2024-03-28T10:04:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:15 smithi086 ceph-mon[35163]: pgmap v8546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:15 smithi159 ceph-mon[36109]: pgmap v8546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:15 smithi055 ceph-mon[31863]: pgmap v8546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:17 smithi086 ceph-mon[35163]: pgmap v8547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:17 smithi159 ceph-mon[36109]: pgmap v8547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:17 smithi055 ceph-mon[31863]: pgmap v8547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14658.060650 secs 2024-03-28T10:04:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14658.060650 secs 2024-03-28T10:04:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14658.060650 secs 2024-03-28T10:04:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:19 smithi086 ceph-mon[35163]: pgmap v8548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:19 smithi159 ceph-mon[36109]: pgmap v8548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:19 smithi055 ceph-mon[31863]: pgmap v8548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:21 smithi086 ceph-mon[35163]: pgmap v8549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:21 smithi159 ceph-mon[36109]: pgmap v8549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:21 smithi055 ceph-mon[31863]: pgmap v8549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:23 smithi086 ceph-mon[35163]: pgmap v8550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:23 smithi159 ceph-mon[36109]: pgmap v8550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:23 smithi055 ceph-mon[31863]: pgmap v8550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14663.060713 secs 2024-03-28T10:04:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14663.060713 secs 2024-03-28T10:04:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14663.060713 secs 2024-03-28T10:04:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:25 smithi086 ceph-mon[35163]: pgmap v8551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:25 smithi159 ceph-mon[36109]: pgmap v8551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:25 smithi055 ceph-mon[31863]: pgmap v8551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:27 smithi086 ceph-mon[35163]: pgmap v8552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:27 smithi159 ceph-mon[36109]: pgmap v8552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:27 smithi055 ceph-mon[31863]: pgmap v8552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14668.060836 secs 2024-03-28T10:04:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:29 smithi086 ceph-mon[35163]: pgmap v8553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14668.060836 secs 2024-03-28T10:04:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:29 smithi159 ceph-mon[36109]: pgmap v8553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14668.060836 secs 2024-03-28T10:04:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:29 smithi055 ceph-mon[31863]: pgmap v8553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:31 smithi086 ceph-mon[35163]: pgmap v8554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:31 smithi159 ceph-mon[36109]: pgmap v8554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:31 smithi055 ceph-mon[31863]: pgmap v8554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:33 smithi086 ceph-mon[35163]: pgmap v8555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:33 smithi159 ceph-mon[36109]: pgmap v8555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:33 smithi055 ceph-mon[31863]: pgmap v8555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14673.060913 secs 2024-03-28T10:04:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14673.060913 secs 2024-03-28T10:04:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14673.060913 secs 2024-03-28T10:04:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:35 smithi086 ceph-mon[35163]: pgmap v8556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:35 smithi159 ceph-mon[36109]: pgmap v8556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:35 smithi055 ceph-mon[31863]: pgmap v8556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:37 smithi086 ceph-mon[35163]: pgmap v8557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:37 smithi159 ceph-mon[36109]: pgmap v8557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:37 smithi055 ceph-mon[31863]: pgmap v8557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14678.060998 secs 2024-03-28T10:04:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:39 smithi086 ceph-mon[35163]: pgmap v8558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14678.060998 secs 2024-03-28T10:04:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:39 smithi159 ceph-mon[36109]: pgmap v8558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14678.060998 secs 2024-03-28T10:04:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:39 smithi055 ceph-mon[31863]: pgmap v8558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:41 smithi086 ceph-mon[35163]: pgmap v8559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:41 smithi159 ceph-mon[36109]: pgmap v8559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:41 smithi055 ceph-mon[31863]: pgmap v8559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:04:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:43 smithi086 ceph-mon[35163]: pgmap v8560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:43 smithi159 ceph-mon[36109]: pgmap v8560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:43 smithi055 ceph-mon[31863]: pgmap v8560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:04:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14683.061095 secs 2024-03-28T10:04:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14683.061095 secs 2024-03-28T10:04:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14683.061095 secs 2024-03-28T10:04:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:45 smithi055 ceph-mon[31863]: pgmap v8561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:04:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:45 smithi086 ceph-mon[35163]: pgmap v8561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:04:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:45 smithi159 ceph-mon[36109]: pgmap v8561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:04:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:04:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:04:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:04:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:04:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:04:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:04:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:04:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:04:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:04:47.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:04:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:47 smithi055 ceph-mon[31863]: pgmap v8562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:04:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:47 smithi055 ceph-mon[31863]: pgmap v8563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:47 smithi086 ceph-mon[35163]: pgmap v8562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:04:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:47 smithi086 ceph-mon[35163]: pgmap v8563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:47 smithi159 ceph-mon[36109]: pgmap v8562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:04:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:47 smithi159 ceph-mon[36109]: pgmap v8563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14688.061219 secs 2024-03-28T10:04:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14688.061219 secs 2024-03-28T10:04:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14688.061219 secs 2024-03-28T10:04:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:49 smithi055 ceph-mon[31863]: pgmap v8564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:49 smithi086 ceph-mon[35163]: pgmap v8564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:49 smithi159 ceph-mon[36109]: pgmap v8564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:51 smithi055 ceph-mon[31863]: pgmap v8565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T10:04:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:51 smithi086 ceph-mon[35163]: pgmap v8565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T10:04:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:51 smithi159 ceph-mon[36109]: pgmap v8565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T10:04:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:53 smithi055 ceph-mon[31863]: pgmap v8566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14693.061343 secs 2024-03-28T10:04:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:53 smithi086 ceph-mon[35163]: pgmap v8566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14693.061343 secs 2024-03-28T10:04:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:53 smithi159 ceph-mon[36109]: pgmap v8566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14693.061343 secs 2024-03-28T10:04:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:55 smithi086 ceph-mon[35163]: pgmap v8567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:55 smithi159 ceph-mon[36109]: pgmap v8567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:55 smithi055 ceph-mon[31863]: pgmap v8567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:04:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:57 smithi086 ceph-mon[35163]: pgmap v8568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:04:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:57 smithi159 ceph-mon[36109]: pgmap v8568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:04:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:57 smithi055 ceph-mon[31863]: pgmap v8568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:04:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14698.061434 secs 2024-03-28T10:04:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14698.061434 secs 2024-03-28T10:04:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14698.061434 secs 2024-03-28T10:04:59.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:04:59 smithi086 ceph-mon[35163]: pgmap v8569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:04:59 smithi159 ceph-mon[36109]: pgmap v8569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:04:59 smithi055 ceph-mon[31863]: pgmap v8569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:01 smithi086 ceph-mon[35163]: pgmap v8570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:01 smithi159 ceph-mon[36109]: pgmap v8570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:01 smithi055 ceph-mon[31863]: pgmap v8570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:03 smithi086 ceph-mon[35163]: pgmap v8571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14703.061524 secs 2024-03-28T10:05:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:03 smithi159 ceph-mon[36109]: pgmap v8571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14703.061524 secs 2024-03-28T10:05:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:03 smithi055 ceph-mon[31863]: pgmap v8571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14703.061524 secs 2024-03-28T10:05:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:05 smithi086 ceph-mon[35163]: pgmap v8572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:05 smithi159 ceph-mon[36109]: pgmap v8572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:05 smithi055 ceph-mon[31863]: pgmap v8572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:07 smithi086 ceph-mon[35163]: pgmap v8573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:07 smithi159 ceph-mon[36109]: pgmap v8573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:07 smithi055 ceph-mon[31863]: pgmap v8573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14708.061639 secs 2024-03-28T10:05:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14708.061639 secs 2024-03-28T10:05:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14708.061639 secs 2024-03-28T10:05:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:09 smithi086 ceph-mon[35163]: pgmap v8574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:09 smithi159 ceph-mon[36109]: pgmap v8574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:09 smithi055 ceph-mon[31863]: pgmap v8574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:11 smithi086 ceph-mon[35163]: pgmap v8575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:11 smithi159 ceph-mon[36109]: pgmap v8575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:11 smithi055 ceph-mon[31863]: pgmap v8575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:13 smithi086 ceph-mon[35163]: pgmap v8576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14713.061758 secs 2024-03-28T10:05:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:13 smithi159 ceph-mon[36109]: pgmap v8576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14713.061758 secs 2024-03-28T10:05:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:13 smithi055 ceph-mon[31863]: pgmap v8576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14713.061758 secs 2024-03-28T10:05:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:15 smithi086 ceph-mon[35163]: pgmap v8577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:15 smithi159 ceph-mon[36109]: pgmap v8577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:16.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:15 smithi055 ceph-mon[31863]: pgmap v8577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:17 smithi086 ceph-mon[35163]: pgmap v8578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:17 smithi159 ceph-mon[36109]: pgmap v8578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:18.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:17 smithi055 ceph-mon[31863]: pgmap v8578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:19.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14718.061844 secs 2024-03-28T10:05:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14718.061844 secs 2024-03-28T10:05:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14718.061844 secs 2024-03-28T10:05:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:19 smithi086 ceph-mon[35163]: pgmap v8579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:19 smithi159 ceph-mon[36109]: pgmap v8579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:19 smithi055 ceph-mon[31863]: pgmap v8579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:21 smithi086 ceph-mon[35163]: pgmap v8580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:21 smithi159 ceph-mon[36109]: pgmap v8580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:21 smithi055 ceph-mon[31863]: pgmap v8580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:23 smithi086 ceph-mon[35163]: pgmap v8581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14723.061882 secs 2024-03-28T10:05:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:23 smithi159 ceph-mon[36109]: pgmap v8581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14723.061882 secs 2024-03-28T10:05:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:23 smithi055 ceph-mon[31863]: pgmap v8581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14723.061882 secs 2024-03-28T10:05:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:25 smithi086 ceph-mon[35163]: pgmap v8582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:25 smithi159 ceph-mon[36109]: pgmap v8582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:25 smithi055 ceph-mon[31863]: pgmap v8582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:27 smithi086 ceph-mon[35163]: pgmap v8583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:27 smithi159 ceph-mon[36109]: pgmap v8583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:27 smithi055 ceph-mon[31863]: pgmap v8583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14728.062005 secs 2024-03-28T10:05:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14728.062005 secs 2024-03-28T10:05:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14728.062005 secs 2024-03-28T10:05:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:29 smithi086 ceph-mon[35163]: pgmap v8584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:29 smithi159 ceph-mon[36109]: pgmap v8584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:29 smithi055 ceph-mon[31863]: pgmap v8584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:31 smithi086 ceph-mon[35163]: pgmap v8585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:31 smithi159 ceph-mon[36109]: pgmap v8585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:31 smithi055 ceph-mon[31863]: pgmap v8585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:33 smithi086 ceph-mon[35163]: pgmap v8586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14733.062079 secs 2024-03-28T10:05:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:33 smithi159 ceph-mon[36109]: pgmap v8586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14733.062079 secs 2024-03-28T10:05:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:33 smithi055 ceph-mon[31863]: pgmap v8586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14733.062079 secs 2024-03-28T10:05:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:35 smithi055 ceph-mon[31863]: pgmap v8587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:35 smithi086 ceph-mon[35163]: pgmap v8587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:35 smithi159 ceph-mon[36109]: pgmap v8587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:37 smithi055 ceph-mon[31863]: pgmap v8588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:37 smithi086 ceph-mon[35163]: pgmap v8588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:37 smithi159 ceph-mon[36109]: pgmap v8588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14738.062203 secs 2024-03-28T10:05:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14738.062203 secs 2024-03-28T10:05:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14738.062203 secs 2024-03-28T10:05:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:39 smithi055 ceph-mon[31863]: pgmap v8589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:39 smithi086 ceph-mon[35163]: pgmap v8589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:39 smithi159 ceph-mon[36109]: pgmap v8589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:42.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:41 smithi055 ceph-mon[31863]: pgmap v8590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:41 smithi086 ceph-mon[35163]: pgmap v8590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:41 smithi159 ceph-mon[36109]: pgmap v8590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:43 smithi086 ceph-mon[35163]: pgmap v8591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14743.062280 secs 2024-03-28T10:05:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:43 smithi159 ceph-mon[36109]: pgmap v8591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14743.062280 secs 2024-03-28T10:05:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:43 smithi055 ceph-mon[31863]: pgmap v8591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14743.062280 secs 2024-03-28T10:05:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:45 smithi086 ceph-mon[35163]: pgmap v8592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:45 smithi159 ceph-mon[36109]: pgmap v8592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:45 smithi055 ceph-mon[31863]: pgmap v8592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:05:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:05:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:05:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:47 smithi086 ceph-mon[35163]: pgmap v8593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:47 smithi159 ceph-mon[36109]: pgmap v8593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:47 smithi055 ceph-mon[31863]: pgmap v8593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:49.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14748.062356 secs 2024-03-28T10:05:49.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:05:49.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:05:49.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14748.062356 secs 2024-03-28T10:05:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:05:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:05:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14748.062356 secs 2024-03-28T10:05:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:05:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:05:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:05:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:49 smithi086 ceph-mon[35163]: pgmap v8594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:49 smithi086 ceph-mon[35163]: pgmap v8595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:05:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:49 smithi086 ceph-mon[35163]: pgmap v8596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:49 smithi159 ceph-mon[36109]: pgmap v8594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:49 smithi159 ceph-mon[36109]: pgmap v8595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:05:50.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:49 smithi159 ceph-mon[36109]: pgmap v8596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:49 smithi055 ceph-mon[31863]: pgmap v8594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:05:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:49 smithi055 ceph-mon[31863]: pgmap v8595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:05:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:49 smithi055 ceph-mon[31863]: pgmap v8596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:51 smithi086 ceph-mon[35163]: pgmap v8597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:51 smithi159 ceph-mon[36109]: pgmap v8597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:51 smithi055 ceph-mon[31863]: pgmap v8597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:05:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14753.062419 secs 2024-03-28T10:05:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:53 smithi086 ceph-mon[35163]: pgmap v8598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14753.062419 secs 2024-03-28T10:05:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:53 smithi159 ceph-mon[36109]: pgmap v8598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14753.062419 secs 2024-03-28T10:05:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:53 smithi055 ceph-mon[31863]: pgmap v8598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:55 smithi086 ceph-mon[35163]: pgmap v8599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:55 smithi159 ceph-mon[36109]: pgmap v8599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:55 smithi055 ceph-mon[31863]: pgmap v8599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:57 smithi086 ceph-mon[35163]: pgmap v8600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:57 smithi159 ceph-mon[36109]: pgmap v8600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:57 smithi055 ceph-mon[31863]: pgmap v8600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:05:59.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14758.062544 secs 2024-03-28T10:05:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14758.062544 secs 2024-03-28T10:05:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14758.062544 secs 2024-03-28T10:06:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:05:59 smithi086 ceph-mon[35163]: pgmap v8601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:06:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:05:59 smithi159 ceph-mon[36109]: pgmap v8601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:06:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:05:59 smithi055 ceph-mon[31863]: pgmap v8601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:06:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:01 smithi086 ceph-mon[35163]: pgmap v8602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:01 smithi159 ceph-mon[36109]: pgmap v8602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:01 smithi055 ceph-mon[31863]: pgmap v8602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14763.062664 secs 2024-03-28T10:06:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:03 smithi086 ceph-mon[35163]: pgmap v8603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14763.062664 secs 2024-03-28T10:06:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:03 smithi159 ceph-mon[36109]: pgmap v8603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14763.062664 secs 2024-03-28T10:06:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:03 smithi055 ceph-mon[31863]: pgmap v8603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:05 smithi086 ceph-mon[35163]: pgmap v8604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:05 smithi159 ceph-mon[36109]: pgmap v8604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:05 smithi055 ceph-mon[31863]: pgmap v8604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:07 smithi086 ceph-mon[35163]: pgmap v8605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:07 smithi159 ceph-mon[36109]: pgmap v8605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:07 smithi055 ceph-mon[31863]: pgmap v8605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14768.062730 secs 2024-03-28T10:06:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14768.062730 secs 2024-03-28T10:06:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14768.062730 secs 2024-03-28T10:06:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:10 smithi086 ceph-mon[35163]: pgmap v8606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:10 smithi159 ceph-mon[36109]: pgmap v8606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:10 smithi055 ceph-mon[31863]: pgmap v8606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:12 smithi086 ceph-mon[35163]: pgmap v8607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:12 smithi159 ceph-mon[36109]: pgmap v8607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:12 smithi055 ceph-mon[31863]: pgmap v8607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14773.062812 secs 2024-03-28T10:06:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:14 smithi086 ceph-mon[35163]: pgmap v8608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14773.062812 secs 2024-03-28T10:06:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:14 smithi159 ceph-mon[36109]: pgmap v8608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14773.062812 secs 2024-03-28T10:06:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:14 smithi055 ceph-mon[31863]: pgmap v8608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:16 smithi086 ceph-mon[35163]: pgmap v8609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:16 smithi159 ceph-mon[36109]: pgmap v8609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:16 smithi055 ceph-mon[31863]: pgmap v8609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:18 smithi086 ceph-mon[35163]: pgmap v8610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:18 smithi159 ceph-mon[36109]: pgmap v8610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:18 smithi055 ceph-mon[31863]: pgmap v8610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14778.062877 secs 2024-03-28T10:06:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14778.062877 secs 2024-03-28T10:06:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14778.062877 secs 2024-03-28T10:06:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:20 smithi086 ceph-mon[35163]: pgmap v8611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:20 smithi159 ceph-mon[36109]: pgmap v8611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:20 smithi055 ceph-mon[31863]: pgmap v8611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:22 smithi086 ceph-mon[35163]: pgmap v8612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:22 smithi159 ceph-mon[36109]: pgmap v8612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:22 smithi055 ceph-mon[31863]: pgmap v8612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:23 smithi055 ceph-mon[31863]: pgmap v8613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:23 smithi086 ceph-mon[35163]: pgmap v8613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:23 smithi159 ceph-mon[36109]: pgmap v8613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14783.062966 secs 2024-03-28T10:06:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14783.062966 secs 2024-03-28T10:06:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14783.062966 secs 2024-03-28T10:06:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:25 smithi086 ceph-mon[35163]: pgmap v8614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:25 smithi159 ceph-mon[36109]: pgmap v8614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:25 smithi055 ceph-mon[31863]: pgmap v8614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:28.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:27 smithi159 ceph-mon[36109]: pgmap v8615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:27 smithi086 ceph-mon[35163]: pgmap v8615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:27 smithi055 ceph-mon[31863]: pgmap v8615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:29.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14788.063096 secs 2024-03-28T10:06:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14788.063096 secs 2024-03-28T10:06:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14788.063096 secs 2024-03-28T10:06:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:29 smithi086 ceph-mon[35163]: pgmap v8616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:29 smithi159 ceph-mon[36109]: pgmap v8616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:29 smithi055 ceph-mon[31863]: pgmap v8616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:31 smithi086 ceph-mon[35163]: pgmap v8617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:31 smithi159 ceph-mon[36109]: pgmap v8617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:31 smithi055 ceph-mon[31863]: pgmap v8617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14793.063208 secs 2024-03-28T10:06:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:33 smithi086 ceph-mon[35163]: pgmap v8618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14793.063208 secs 2024-03-28T10:06:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:33 smithi159 ceph-mon[36109]: pgmap v8618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14793.063208 secs 2024-03-28T10:06:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:33 smithi055 ceph-mon[31863]: pgmap v8618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:35 smithi086 ceph-mon[35163]: pgmap v8619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:35 smithi159 ceph-mon[36109]: pgmap v8619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:35 smithi055 ceph-mon[31863]: pgmap v8619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:37 smithi086 ceph-mon[35163]: pgmap v8620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:37 smithi159 ceph-mon[36109]: pgmap v8620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:37 smithi055 ceph-mon[31863]: pgmap v8620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14798.063264 secs 2024-03-28T10:06:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14798.063264 secs 2024-03-28T10:06:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14798.063264 secs 2024-03-28T10:06:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:39 smithi086 ceph-mon[35163]: pgmap v8621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:39 smithi159 ceph-mon[36109]: pgmap v8621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:39 smithi055 ceph-mon[31863]: pgmap v8621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:41 smithi086 ceph-mon[35163]: pgmap v8622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:41 smithi159 ceph-mon[36109]: pgmap v8622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:41 smithi055 ceph-mon[31863]: pgmap v8622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14803.063349 secs 2024-03-28T10:06:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:44 smithi086 ceph-mon[35163]: pgmap v8623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14803.063349 secs 2024-03-28T10:06:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:44 smithi159 ceph-mon[36109]: pgmap v8623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14803.063349 secs 2024-03-28T10:06:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:44 smithi055 ceph-mon[31863]: pgmap v8623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:46 smithi086 ceph-mon[35163]: pgmap v8624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:46 smithi159 ceph-mon[36109]: pgmap v8624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:46 smithi055 ceph-mon[31863]: pgmap v8624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:48 smithi086 ceph-mon[35163]: pgmap v8625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:48 smithi159 ceph-mon[36109]: pgmap v8625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:48 smithi055 ceph-mon[31863]: pgmap v8625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:49.277 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14808.063425 secs 2024-03-28T10:06:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14808.063425 secs 2024-03-28T10:06:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14808.063425 secs 2024-03-28T10:06:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:50 smithi086 ceph-mon[35163]: pgmap v8626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:06:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:50 smithi159 ceph-mon[36109]: pgmap v8626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:06:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:50 smithi055 ceph-mon[31863]: pgmap v8626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:06:51.551 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.552 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.552 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:51 smithi159 ceph-mon[36109]: pgmap v8627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:51 smithi086 ceph-mon[35163]: pgmap v8627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:51 smithi055 ceph-mon[31863]: pgmap v8627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:06:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:53 smithi055 ceph-mon[31863]: pgmap v8628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:53 smithi086 ceph-mon[35163]: pgmap v8628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:53 smithi159 ceph-mon[36109]: pgmap v8628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:06:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14813.063548 secs 2024-03-28T10:06:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14813.063548 secs 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14813.063548 secs 2024-03-28T10:06:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:55 smithi055 ceph-mon[31863]: pgmap v8629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:55 smithi086 ceph-mon[35163]: pgmap v8629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:55 smithi159 ceph-mon[36109]: pgmap v8629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:06:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: pgmap v8630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:06:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: pgmap v8631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: pgmap v8630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:06:57.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: pgmap v8631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:57.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: pgmap v8630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: pgmap v8631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:06:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:06:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14818.063670 secs 2024-03-28T10:06:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:06:59 smithi086 ceph-mon[35163]: pgmap v8632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:06:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14818.063670 secs 2024-03-28T10:06:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:06:59 smithi159 ceph-mon[36109]: pgmap v8632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:06:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14818.063670 secs 2024-03-28T10:06:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:06:59 smithi055 ceph-mon[31863]: pgmap v8632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:01 smithi086 ceph-mon[35163]: pgmap v8633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:07:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:01 smithi159 ceph-mon[36109]: pgmap v8633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:07:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:01 smithi055 ceph-mon[31863]: pgmap v8633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:07:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:03 smithi086 ceph-mon[35163]: pgmap v8634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:03 smithi159 ceph-mon[36109]: pgmap v8634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:03 smithi055 ceph-mon[31863]: pgmap v8634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14823.063812 secs 2024-03-28T10:07:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14823.063812 secs 2024-03-28T10:07:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14823.063812 secs 2024-03-28T10:07:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:05 smithi086 ceph-mon[35163]: pgmap v8635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:05 smithi159 ceph-mon[36109]: pgmap v8635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:05 smithi055 ceph-mon[31863]: pgmap v8635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:07:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:07 smithi086 ceph-mon[35163]: pgmap v8636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:07:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:07 smithi159 ceph-mon[36109]: pgmap v8636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:07:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:07 smithi055 ceph-mon[31863]: pgmap v8636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:07:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14828.063935 secs 2024-03-28T10:07:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:09 smithi086 ceph-mon[35163]: pgmap v8637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:07:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14828.063935 secs 2024-03-28T10:07:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:09 smithi159 ceph-mon[36109]: pgmap v8637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:07:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14828.063935 secs 2024-03-28T10:07:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:09 smithi055 ceph-mon[31863]: pgmap v8637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:07:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:11 smithi159 ceph-mon[36109]: pgmap v8638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:11 smithi055 ceph-mon[31863]: pgmap v8638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:11 smithi086 ceph-mon[35163]: pgmap v8638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:13 smithi055 ceph-mon[31863]: pgmap v8639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:13 smithi086 ceph-mon[35163]: pgmap v8639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:13 smithi159 ceph-mon[36109]: pgmap v8639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14833.064054 secs 2024-03-28T10:07:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14833.064054 secs 2024-03-28T10:07:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14833.064054 secs 2024-03-28T10:07:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:15 smithi055 ceph-mon[31863]: pgmap v8640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:15 smithi086 ceph-mon[35163]: pgmap v8640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:15 smithi159 ceph-mon[36109]: pgmap v8640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:17 smithi055 ceph-mon[31863]: pgmap v8641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:17 smithi086 ceph-mon[35163]: pgmap v8641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:17 smithi159 ceph-mon[36109]: pgmap v8641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14838.064149 secs 2024-03-28T10:07:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:19 smithi086 ceph-mon[35163]: pgmap v8642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14838.064149 secs 2024-03-28T10:07:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:19 smithi159 ceph-mon[36109]: pgmap v8642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14838.064149 secs 2024-03-28T10:07:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:19 smithi055 ceph-mon[31863]: pgmap v8642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:21 smithi086 ceph-mon[35163]: pgmap v8643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:21 smithi159 ceph-mon[36109]: pgmap v8643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:21 smithi055 ceph-mon[31863]: pgmap v8643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:23 smithi086 ceph-mon[35163]: pgmap v8644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:23 smithi159 ceph-mon[36109]: pgmap v8644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:23 smithi055 ceph-mon[31863]: pgmap v8644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14843.064268 secs 2024-03-28T10:07:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14843.064268 secs 2024-03-28T10:07:24.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14843.064268 secs 2024-03-28T10:07:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:25 smithi086 ceph-mon[35163]: pgmap v8645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:25 smithi159 ceph-mon[36109]: pgmap v8645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:25 smithi055 ceph-mon[31863]: pgmap v8645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:27 smithi086 ceph-mon[35163]: pgmap v8646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:27 smithi159 ceph-mon[36109]: pgmap v8646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:27 smithi055 ceph-mon[31863]: pgmap v8646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14848.064391 secs 2024-03-28T10:07:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:29 smithi086 ceph-mon[35163]: pgmap v8647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14848.064391 secs 2024-03-28T10:07:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:29 smithi159 ceph-mon[36109]: pgmap v8647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14848.064391 secs 2024-03-28T10:07:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:29 smithi055 ceph-mon[31863]: pgmap v8647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:31 smithi086 ceph-mon[35163]: pgmap v8648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:31 smithi159 ceph-mon[36109]: pgmap v8648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:31 smithi055 ceph-mon[31863]: pgmap v8648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:33 smithi086 ceph-mon[35163]: pgmap v8649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:33 smithi159 ceph-mon[36109]: pgmap v8649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:33 smithi055 ceph-mon[31863]: pgmap v8649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14853.064507 secs 2024-03-28T10:07:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14853.064507 secs 2024-03-28T10:07:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14853.064507 secs 2024-03-28T10:07:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:35 smithi086 ceph-mon[35163]: pgmap v8650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:35 smithi159 ceph-mon[36109]: pgmap v8650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:35 smithi055 ceph-mon[31863]: pgmap v8650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:37 smithi086 ceph-mon[35163]: pgmap v8651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:37 smithi159 ceph-mon[36109]: pgmap v8651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:37 smithi055 ceph-mon[31863]: pgmap v8651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14858.064612 secs 2024-03-28T10:07:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:39 smithi086 ceph-mon[35163]: pgmap v8652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14858.064612 secs 2024-03-28T10:07:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:39 smithi159 ceph-mon[36109]: pgmap v8652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14858.064612 secs 2024-03-28T10:07:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:39 smithi055 ceph-mon[31863]: pgmap v8652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:41 smithi086 ceph-mon[35163]: pgmap v8653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:41 smithi159 ceph-mon[36109]: pgmap v8653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:41 smithi055 ceph-mon[31863]: pgmap v8653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:43 smithi086 ceph-mon[35163]: pgmap v8654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:43 smithi159 ceph-mon[36109]: pgmap v8654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:43 smithi055 ceph-mon[31863]: pgmap v8654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14863.064733 secs 2024-03-28T10:07:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14863.064733 secs 2024-03-28T10:07:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14863.064733 secs 2024-03-28T10:07:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:45 smithi086 ceph-mon[35163]: pgmap v8655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:45 smithi159 ceph-mon[36109]: pgmap v8655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:45 smithi055 ceph-mon[31863]: pgmap v8655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:47 smithi086 ceph-mon[35163]: pgmap v8656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:47 smithi159 ceph-mon[36109]: pgmap v8656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:47 smithi055 ceph-mon[31863]: pgmap v8656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14868.064857 secs 2024-03-28T10:07:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:49 smithi086 ceph-mon[35163]: pgmap v8657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14868.064857 secs 2024-03-28T10:07:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:49 smithi159 ceph-mon[36109]: pgmap v8657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14868.064857 secs 2024-03-28T10:07:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:49 smithi055 ceph-mon[31863]: pgmap v8657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:51 smithi086 ceph-mon[35163]: pgmap v8658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:51 smithi159 ceph-mon[36109]: pgmap v8658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:51 smithi055 ceph-mon[31863]: pgmap v8658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:07:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:53 smithi086 ceph-mon[35163]: pgmap v8659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:53 smithi159 ceph-mon[36109]: pgmap v8659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:53 smithi055 ceph-mon[31863]: pgmap v8659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14873.064944 secs 2024-03-28T10:07:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14873.064944 secs 2024-03-28T10:07:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14873.064944 secs 2024-03-28T10:07:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:55 smithi086 ceph-mon[35163]: pgmap v8660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:55 smithi159 ceph-mon[36109]: pgmap v8660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:55 smithi055 ceph-mon[31863]: pgmap v8660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:57 smithi086 ceph-mon[35163]: pgmap v8661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:07:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:57 smithi159 ceph-mon[36109]: pgmap v8661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:07:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:57 smithi055 ceph-mon[31863]: pgmap v8661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14878.065035 secs 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: pgmap v8662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:07:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: pgmap v8663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:07:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: pgmap v8664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:07:59.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:07:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14878.065035 secs 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: pgmap v8662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:07:59.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: pgmap v8663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:07:59.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: pgmap v8664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:07:59.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:07:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14878.065035 secs 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: pgmap v8662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:08:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: pgmap v8663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:08:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: pgmap v8664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:08:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:07:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:08:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:01 smithi086 ceph-mon[35163]: pgmap v8665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:08:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:01 smithi159 ceph-mon[36109]: pgmap v8665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:08:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:01 smithi055 ceph-mon[31863]: pgmap v8665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:08:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14883.065067 secs 2024-03-28T10:08:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:03 smithi086 ceph-mon[35163]: pgmap v8666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14883.065067 secs 2024-03-28T10:08:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:03 smithi159 ceph-mon[36109]: pgmap v8666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14883.065067 secs 2024-03-28T10:08:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:03 smithi055 ceph-mon[31863]: pgmap v8666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:05 smithi055 ceph-mon[31863]: pgmap v8667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:05 smithi086 ceph-mon[35163]: pgmap v8667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:05 smithi159 ceph-mon[36109]: pgmap v8667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:07 smithi055 ceph-mon[31863]: pgmap v8668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:07 smithi086 ceph-mon[35163]: pgmap v8668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:07 smithi159 ceph-mon[36109]: pgmap v8668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:08:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14888.065169 secs 2024-03-28T10:08:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14888.065169 secs 2024-03-28T10:08:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14888.065169 secs 2024-03-28T10:08:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:09 smithi055 ceph-mon[31863]: pgmap v8669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:08:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:09 smithi086 ceph-mon[35163]: pgmap v8669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:08:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:09 smithi159 ceph-mon[36109]: pgmap v8669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:08:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:11 smithi055 ceph-mon[31863]: pgmap v8670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:11 smithi086 ceph-mon[35163]: pgmap v8670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:11 smithi159 ceph-mon[36109]: pgmap v8670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14893.065254 secs 2024-03-28T10:08:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:13 smithi055 ceph-mon[31863]: pgmap v8671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14893.065254 secs 2024-03-28T10:08:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:13 smithi086 ceph-mon[35163]: pgmap v8671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14893.065254 secs 2024-03-28T10:08:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:13 smithi159 ceph-mon[36109]: pgmap v8671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:15 smithi086 ceph-mon[35163]: pgmap v8672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:15 smithi159 ceph-mon[36109]: pgmap v8672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:15 smithi055 ceph-mon[31863]: pgmap v8672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:17 smithi086 ceph-mon[35163]: pgmap v8673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:17 smithi159 ceph-mon[36109]: pgmap v8673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:17 smithi055 ceph-mon[31863]: pgmap v8673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:19.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14898.066810 secs 2024-03-28T10:08:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14898.066810 secs 2024-03-28T10:08:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14898.066810 secs 2024-03-28T10:08:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:19 smithi086 ceph-mon[35163]: pgmap v8674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:19 smithi159 ceph-mon[36109]: pgmap v8674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:19 smithi055 ceph-mon[31863]: pgmap v8674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:21 smithi086 ceph-mon[35163]: pgmap v8675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:21 smithi159 ceph-mon[36109]: pgmap v8675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:21 smithi055 ceph-mon[31863]: pgmap v8675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:23 smithi055 ceph-mon[31863]: pgmap v8676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:23 smithi086 ceph-mon[35163]: pgmap v8676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:23 smithi159 ceph-mon[36109]: pgmap v8676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14903.066898 secs 2024-03-28T10:08:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14903.066898 secs 2024-03-28T10:08:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14903.066898 secs 2024-03-28T10:08:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:25 smithi055 ceph-mon[31863]: pgmap v8677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:25 smithi086 ceph-mon[35163]: pgmap v8677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:25 smithi159 ceph-mon[36109]: pgmap v8677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:27 smithi159 ceph-mon[36109]: pgmap v8678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:27 smithi055 ceph-mon[31863]: pgmap v8678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:27 smithi086 ceph-mon[35163]: pgmap v8678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14908.066963 secs 2024-03-28T10:08:29.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14908.066963 secs 2024-03-28T10:08:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14908.066963 secs 2024-03-28T10:08:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:29 smithi055 ceph-mon[31863]: pgmap v8679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:30.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:29 smithi159 ceph-mon[36109]: pgmap v8679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:29 smithi086 ceph-mon[35163]: pgmap v8679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:32.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:31 smithi055 ceph-mon[31863]: pgmap v8680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:31 smithi086 ceph-mon[35163]: pgmap v8680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:31 smithi159 ceph-mon[36109]: pgmap v8680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14913.067031 secs 2024-03-28T10:08:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:33 smithi055 ceph-mon[31863]: pgmap v8681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14913.067031 secs 2024-03-28T10:08:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:33 smithi086 ceph-mon[35163]: pgmap v8681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14913.067031 secs 2024-03-28T10:08:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:33 smithi159 ceph-mon[36109]: pgmap v8681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:36.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:35 smithi055 ceph-mon[31863]: pgmap v8682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:35 smithi086 ceph-mon[35163]: pgmap v8682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:35 smithi159 ceph-mon[36109]: pgmap v8682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:37 smithi086 ceph-mon[35163]: pgmap v8683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:37 smithi159 ceph-mon[36109]: pgmap v8683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:37 smithi055 ceph-mon[31863]: pgmap v8683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14918.067127 secs 2024-03-28T10:08:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14918.067127 secs 2024-03-28T10:08:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14918.067127 secs 2024-03-28T10:08:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:39 smithi086 ceph-mon[35163]: pgmap v8684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:39 smithi159 ceph-mon[36109]: pgmap v8684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:39 smithi055 ceph-mon[31863]: pgmap v8684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:41 smithi086 ceph-mon[35163]: pgmap v8685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:41 smithi159 ceph-mon[36109]: pgmap v8685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:41 smithi055 ceph-mon[31863]: pgmap v8685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:43 smithi055 ceph-mon[31863]: pgmap v8686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:43 smithi086 ceph-mon[35163]: pgmap v8686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:43 smithi159 ceph-mon[36109]: pgmap v8686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14923.067250 secs 2024-03-28T10:08:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14923.067250 secs 2024-03-28T10:08:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14923.067250 secs 2024-03-28T10:08:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:45 smithi086 ceph-mon[35163]: pgmap v8687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:45 smithi159 ceph-mon[36109]: pgmap v8687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:45 smithi055 ceph-mon[31863]: pgmap v8687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:47 smithi055 ceph-mon[31863]: pgmap v8688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:47 smithi086 ceph-mon[35163]: pgmap v8688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:47 smithi159 ceph-mon[36109]: pgmap v8688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14928.067321 secs 2024-03-28T10:08:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14928.067321 secs 2024-03-28T10:08:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14928.067321 secs 2024-03-28T10:08:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:49 smithi055 ceph-mon[31863]: pgmap v8689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:49 smithi086 ceph-mon[35163]: pgmap v8689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:49 smithi159 ceph-mon[36109]: pgmap v8689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:51 smithi055 ceph-mon[31863]: pgmap v8690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:51 smithi086 ceph-mon[35163]: pgmap v8690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:51 smithi159 ceph-mon[36109]: pgmap v8690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14933.067443 secs 2024-03-28T10:08:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:53 smithi086 ceph-mon[35163]: pgmap v8691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14933.067443 secs 2024-03-28T10:08:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:53 smithi159 ceph-mon[36109]: pgmap v8691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14933.067443 secs 2024-03-28T10:08:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:53 smithi055 ceph-mon[31863]: pgmap v8691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:08:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:55 smithi086 ceph-mon[35163]: pgmap v8692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:55 smithi159 ceph-mon[36109]: pgmap v8692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:55 smithi055 ceph-mon[31863]: pgmap v8692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:08:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:57 smithi086 ceph-mon[35163]: pgmap v8693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:08:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:57 smithi159 ceph-mon[36109]: pgmap v8693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:08:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:57 smithi055 ceph-mon[31863]: pgmap v8693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:08:59.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14938.067569 secs 2024-03-28T10:08:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14938.067569 secs 2024-03-28T10:08:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14938.067569 secs 2024-03-28T10:09:00.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:59 smithi159 ceph-mon[36109]: pgmap v8694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:00.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:08:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:09:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:59 smithi086 ceph-mon[35163]: pgmap v8694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:08:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:09:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:59 smithi055 ceph-mon[31863]: pgmap v8694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:08:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:09:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:09:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:09:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:09:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:09:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:09:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:09:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:09:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:09:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:09:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:01 smithi086 ceph-mon[35163]: pgmap v8695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:01 smithi086 ceph-mon[35163]: pgmap v8696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:01 smithi159 ceph-mon[36109]: pgmap v8695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:01 smithi159 ceph-mon[36109]: pgmap v8696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:01 smithi055 ceph-mon[31863]: pgmap v8695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:01 smithi055 ceph-mon[31863]: pgmap v8696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:03 smithi086 ceph-mon[35163]: pgmap v8697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14943.067654 secs 2024-03-28T10:09:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:03 smithi159 ceph-mon[36109]: pgmap v8697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14943.067654 secs 2024-03-28T10:09:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:03 smithi055 ceph-mon[31863]: pgmap v8697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14943.067654 secs 2024-03-28T10:09:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:05 smithi086 ceph-mon[35163]: pgmap v8698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:05 smithi159 ceph-mon[36109]: pgmap v8698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:05 smithi055 ceph-mon[31863]: pgmap v8698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:09:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:07 smithi086 ceph-mon[35163]: pgmap v8699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:07 smithi159 ceph-mon[36109]: pgmap v8699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:07 smithi055 ceph-mon[31863]: pgmap v8699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14948.067738 secs 2024-03-28T10:09:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14948.067738 secs 2024-03-28T10:09:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14948.067738 secs 2024-03-28T10:09:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:09 smithi086 ceph-mon[35163]: pgmap v8700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:09 smithi159 ceph-mon[36109]: pgmap v8700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:09 smithi055 ceph-mon[31863]: pgmap v8700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:09:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:11 smithi086 ceph-mon[35163]: pgmap v8701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:11 smithi159 ceph-mon[36109]: pgmap v8701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:11 smithi055 ceph-mon[31863]: pgmap v8701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:09:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:13 smithi086 ceph-mon[35163]: pgmap v8702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14953.067856 secs 2024-03-28T10:09:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:13 smithi159 ceph-mon[36109]: pgmap v8702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14953.067856 secs 2024-03-28T10:09:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:13 smithi055 ceph-mon[31863]: pgmap v8702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14953.067856 secs 2024-03-28T10:09:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:15 smithi086 ceph-mon[35163]: pgmap v8703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:15 smithi159 ceph-mon[36109]: pgmap v8703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:15 smithi055 ceph-mon[31863]: pgmap v8703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:17 smithi086 ceph-mon[35163]: pgmap v8704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:17 smithi159 ceph-mon[36109]: pgmap v8704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:17 smithi055 ceph-mon[31863]: pgmap v8704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:19.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14958.067977 secs 2024-03-28T10:09:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14958.067977 secs 2024-03-28T10:09:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14958.067977 secs 2024-03-28T10:09:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:20 smithi086 ceph-mon[35163]: pgmap v8705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:20 smithi159 ceph-mon[36109]: pgmap v8705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:20 smithi055 ceph-mon[31863]: pgmap v8705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:22 smithi086 ceph-mon[35163]: pgmap v8706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:22 smithi159 ceph-mon[36109]: pgmap v8706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:22 smithi055 ceph-mon[31863]: pgmap v8706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:24 smithi086 ceph-mon[35163]: pgmap v8707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14963.068023 secs 2024-03-28T10:09:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:24 smithi159 ceph-mon[36109]: pgmap v8707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:24.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14963.068023 secs 2024-03-28T10:09:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:24 smithi055 ceph-mon[31863]: pgmap v8707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14963.068023 secs 2024-03-28T10:09:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:26 smithi086 ceph-mon[35163]: pgmap v8708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:26 smithi159 ceph-mon[36109]: pgmap v8708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:26 smithi055 ceph-mon[31863]: pgmap v8708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:28 smithi086 ceph-mon[35163]: pgmap v8709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:28 smithi159 ceph-mon[36109]: pgmap v8709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:28 smithi055 ceph-mon[31863]: pgmap v8709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14968.068088 secs 2024-03-28T10:09:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14968.068088 secs 2024-03-28T10:09:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14968.068088 secs 2024-03-28T10:09:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:30 smithi086 ceph-mon[35163]: pgmap v8710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:30 smithi159 ceph-mon[36109]: pgmap v8710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:30 smithi055 ceph-mon[31863]: pgmap v8710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:32 smithi086 ceph-mon[35163]: pgmap v8711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:32 smithi159 ceph-mon[36109]: pgmap v8711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:32 smithi055 ceph-mon[31863]: pgmap v8711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:34 smithi086 ceph-mon[35163]: pgmap v8712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14973.068183 secs 2024-03-28T10:09:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:34 smithi159 ceph-mon[36109]: pgmap v8712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14973.068183 secs 2024-03-28T10:09:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:34 smithi055 ceph-mon[31863]: pgmap v8712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14973.068183 secs 2024-03-28T10:09:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:36 smithi055 ceph-mon[31863]: pgmap v8713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:36 smithi086 ceph-mon[35163]: pgmap v8713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:36 smithi159 ceph-mon[36109]: pgmap v8713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:38 smithi055 ceph-mon[31863]: pgmap v8714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:38 smithi086 ceph-mon[35163]: pgmap v8714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:38 smithi159 ceph-mon[36109]: pgmap v8714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14978.068269 secs 2024-03-28T10:09:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14978.068269 secs 2024-03-28T10:09:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14978.068269 secs 2024-03-28T10:09:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:40 smithi055 ceph-mon[31863]: pgmap v8715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:40 smithi086 ceph-mon[35163]: pgmap v8715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:40 smithi159 ceph-mon[36109]: pgmap v8715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:42 smithi055 ceph-mon[31863]: pgmap v8716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:42 smithi086 ceph-mon[35163]: pgmap v8716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:42 smithi159 ceph-mon[36109]: pgmap v8716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:43 smithi086 ceph-mon[35163]: pgmap v8717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:43 smithi159 ceph-mon[36109]: pgmap v8717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:43 smithi055 ceph-mon[31863]: pgmap v8717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14983.068391 secs 2024-03-28T10:09:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14983.068391 secs 2024-03-28T10:09:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14983.068391 secs 2024-03-28T10:09:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:45 smithi086 ceph-mon[35163]: pgmap v8718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:45 smithi159 ceph-mon[36109]: pgmap v8718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:45 smithi055 ceph-mon[31863]: pgmap v8718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:47 smithi055 ceph-mon[31863]: pgmap v8719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:47 smithi086 ceph-mon[35163]: pgmap v8719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:47 smithi159 ceph-mon[36109]: pgmap v8719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14988.068514 secs 2024-03-28T10:09:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:49 smithi055 ceph-mon[31863]: pgmap v8720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14988.068514 secs 2024-03-28T10:09:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:49 smithi086 ceph-mon[35163]: pgmap v8720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14988.068514 secs 2024-03-28T10:09:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:49 smithi159 ceph-mon[36109]: pgmap v8720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:51 smithi086 ceph-mon[35163]: pgmap v8721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:51 smithi159 ceph-mon[36109]: pgmap v8721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:51 smithi055 ceph-mon[31863]: pgmap v8721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:09:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:53 smithi086 ceph-mon[35163]: pgmap v8722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:53 smithi159 ceph-mon[36109]: pgmap v8722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:53 smithi055 ceph-mon[31863]: pgmap v8722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:09:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14993.068592 secs 2024-03-28T10:09:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14993.068592 secs 2024-03-28T10:09:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14993.068592 secs 2024-03-28T10:09:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:55 smithi086 ceph-mon[35163]: pgmap v8723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:55 smithi159 ceph-mon[36109]: pgmap v8723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:55 smithi055 ceph-mon[31863]: pgmap v8723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:57 smithi086 ceph-mon[35163]: pgmap v8724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:57 smithi159 ceph-mon[36109]: pgmap v8724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:57 smithi055 ceph-mon[31863]: pgmap v8724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:09:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 14998.068714 secs 2024-03-28T10:09:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 14998.068714 secs 2024-03-28T10:09:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 14998.068714 secs 2024-03-28T10:09:59.968 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:09:59 smithi086 ceph-mon[35163]: pgmap v8725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:09:59 smithi159 ceph-mon[36109]: pgmap v8725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:09:59 smithi055 ceph-mon[31863]: pgmap v8725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:00.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:10:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:10:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:10:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:01 smithi086 ceph-mon[35163]: pgmap v8726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:10:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:01 smithi159 ceph-mon[36109]: pgmap v8726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:10:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:01 smithi055 ceph-mon[31863]: pgmap v8726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:10:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:10:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:10:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:10:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:10:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:10:03.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:10:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:10:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:10:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:10:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:03 smithi086 ceph-mon[35163]: pgmap v8727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:03 smithi086 ceph-mon[35163]: pgmap v8728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15003.068840 secs 2024-03-28T10:10:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:03 smithi159 ceph-mon[36109]: pgmap v8727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:03 smithi159 ceph-mon[36109]: pgmap v8728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15003.068840 secs 2024-03-28T10:10:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:03 smithi055 ceph-mon[31863]: pgmap v8727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:03 smithi055 ceph-mon[31863]: pgmap v8728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15003.068840 secs 2024-03-28T10:10:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:05 smithi086 ceph-mon[35163]: pgmap v8729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:05 smithi159 ceph-mon[36109]: pgmap v8729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:05 smithi055 ceph-mon[31863]: pgmap v8729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:07 smithi086 ceph-mon[35163]: pgmap v8730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:07 smithi159 ceph-mon[36109]: pgmap v8730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:07 smithi055 ceph-mon[31863]: pgmap v8730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15008.068921 secs 2024-03-28T10:10:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15008.068921 secs 2024-03-28T10:10:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15008.068921 secs 2024-03-28T10:10:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:09 smithi086 ceph-mon[35163]: pgmap v8731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:09 smithi159 ceph-mon[36109]: pgmap v8731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:09 smithi055 ceph-mon[31863]: pgmap v8731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:11 smithi086 ceph-mon[35163]: pgmap v8732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:11 smithi159 ceph-mon[36109]: pgmap v8732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:11 smithi055 ceph-mon[31863]: pgmap v8732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:13 smithi086 ceph-mon[35163]: pgmap v8733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:10:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15013.068997 secs 2024-03-28T10:10:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:13 smithi159 ceph-mon[36109]: pgmap v8733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:10:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15013.068997 secs 2024-03-28T10:10:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:13 smithi055 ceph-mon[31863]: pgmap v8733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:10:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15013.068997 secs 2024-03-28T10:10:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:15 smithi086 ceph-mon[35163]: pgmap v8734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:15 smithi159 ceph-mon[36109]: pgmap v8734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:16.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:15 smithi055 ceph-mon[31863]: pgmap v8734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:17 smithi086 ceph-mon[35163]: pgmap v8735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:17 smithi159 ceph-mon[36109]: pgmap v8735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:18.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:17 smithi055 ceph-mon[31863]: pgmap v8735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15018.069082 secs 2024-03-28T10:10:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15018.069082 secs 2024-03-28T10:10:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15018.069082 secs 2024-03-28T10:10:20.049 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:19 smithi055 ceph-mon[31863]: pgmap v8736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:19 smithi086 ceph-mon[35163]: pgmap v8736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:19 smithi159 ceph-mon[36109]: pgmap v8736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:21 smithi086 ceph-mon[35163]: pgmap v8737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:21 smithi159 ceph-mon[36109]: pgmap v8737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:21 smithi055 ceph-mon[31863]: pgmap v8737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:23 smithi086 ceph-mon[35163]: pgmap v8738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15023.069166 secs 2024-03-28T10:10:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:23 smithi159 ceph-mon[36109]: pgmap v8738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15023.069166 secs 2024-03-28T10:10:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:23 smithi055 ceph-mon[31863]: pgmap v8738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15023.069166 secs 2024-03-28T10:10:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:25 smithi086 ceph-mon[35163]: pgmap v8739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:25 smithi159 ceph-mon[36109]: pgmap v8739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:25 smithi055 ceph-mon[31863]: pgmap v8739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:27 smithi055 ceph-mon[31863]: pgmap v8740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:27 smithi086 ceph-mon[35163]: pgmap v8740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:27 smithi159 ceph-mon[36109]: pgmap v8740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15028.069245 secs 2024-03-28T10:10:29.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15028.069245 secs 2024-03-28T10:10:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15028.069245 secs 2024-03-28T10:10:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:29 smithi055 ceph-mon[31863]: pgmap v8741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:30.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:29 smithi159 ceph-mon[36109]: pgmap v8741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:29 smithi086 ceph-mon[35163]: pgmap v8741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:31.896 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:31 smithi159 ceph-mon[36109]: pgmap v8742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:32.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:31 smithi055 ceph-mon[31863]: pgmap v8742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:31 smithi086 ceph-mon[35163]: pgmap v8742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:33 smithi055 ceph-mon[31863]: pgmap v8743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15033.069318 secs 2024-03-28T10:10:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:33 smithi086 ceph-mon[35163]: pgmap v8743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15033.069318 secs 2024-03-28T10:10:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:33 smithi159 ceph-mon[36109]: pgmap v8743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15033.069318 secs 2024-03-28T10:10:36.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:35 smithi055 ceph-mon[31863]: pgmap v8744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:35 smithi086 ceph-mon[35163]: pgmap v8744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:35 smithi159 ceph-mon[36109]: pgmap v8744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:37 smithi055 ceph-mon[31863]: pgmap v8745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:37 smithi086 ceph-mon[35163]: pgmap v8745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:37 smithi159 ceph-mon[36109]: pgmap v8745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15038.069392 secs 2024-03-28T10:10:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15038.069392 secs 2024-03-28T10:10:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15038.069392 secs 2024-03-28T10:10:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:39 smithi086 ceph-mon[35163]: pgmap v8746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:39 smithi159 ceph-mon[36109]: pgmap v8746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:39 smithi055 ceph-mon[31863]: pgmap v8746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:42.262 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:41 smithi159 ceph-mon[36109]: pgmap v8747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:41 smithi086 ceph-mon[35163]: pgmap v8747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:41 smithi055 ceph-mon[31863]: pgmap v8747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:43 smithi086 ceph-mon[35163]: pgmap v8748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15043.069498 secs 2024-03-28T10:10:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:43 smithi159 ceph-mon[36109]: pgmap v8748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15043.069498 secs 2024-03-28T10:10:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:43 smithi055 ceph-mon[31863]: pgmap v8748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15043.069498 secs 2024-03-28T10:10:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:45 smithi086 ceph-mon[35163]: pgmap v8749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:45 smithi159 ceph-mon[36109]: pgmap v8749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:45 smithi055 ceph-mon[31863]: pgmap v8749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:47 smithi086 ceph-mon[35163]: pgmap v8750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:47 smithi159 ceph-mon[36109]: pgmap v8750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:47 smithi055 ceph-mon[31863]: pgmap v8750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:49.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15048.069620 secs 2024-03-28T10:10:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15048.069620 secs 2024-03-28T10:10:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15048.069620 secs 2024-03-28T10:10:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:49 smithi086 ceph-mon[35163]: pgmap v8751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:49 smithi159 ceph-mon[36109]: pgmap v8751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:49 smithi055 ceph-mon[31863]: pgmap v8751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:51 smithi086 ceph-mon[35163]: pgmap v8752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:51 smithi159 ceph-mon[36109]: pgmap v8752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:51 smithi055 ceph-mon[31863]: pgmap v8752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:10:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:53 smithi086 ceph-mon[35163]: pgmap v8753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15053.069693 secs 2024-03-28T10:10:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:53 smithi159 ceph-mon[36109]: pgmap v8753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15053.069693 secs 2024-03-28T10:10:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:53 smithi055 ceph-mon[31863]: pgmap v8753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:10:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15053.069693 secs 2024-03-28T10:10:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:55 smithi086 ceph-mon[35163]: pgmap v8754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:55 smithi159 ceph-mon[36109]: pgmap v8754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:55 smithi055 ceph-mon[31863]: pgmap v8754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:57 smithi086 ceph-mon[35163]: pgmap v8755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:57 smithi159 ceph-mon[36109]: pgmap v8755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:57 smithi055 ceph-mon[31863]: pgmap v8755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:10:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15058.069832 secs 2024-03-28T10:10:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15058.069832 secs 2024-03-28T10:10:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15058.069832 secs 2024-03-28T10:11:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:10:59 smithi086 ceph-mon[35163]: pgmap v8756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:10:59 smithi159 ceph-mon[36109]: pgmap v8756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:10:59 smithi055 ceph-mon[31863]: pgmap v8756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:01 smithi086 ceph-mon[35163]: pgmap v8757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:11:02.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:01 smithi159 ceph-mon[36109]: pgmap v8757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:11:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:01 smithi055 ceph-mon[31863]: pgmap v8757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:11:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:11:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:11:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:11:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:03 smithi086 ceph-mon[35163]: pgmap v8758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15063.069925 secs 2024-03-28T10:11:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:03 smithi159 ceph-mon[36109]: pgmap v8758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15063.069925 secs 2024-03-28T10:11:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:03 smithi055 ceph-mon[31863]: pgmap v8758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15063.069925 secs 2024-03-28T10:11:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:11:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:11:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:05 smithi086 ceph-mon[35163]: pgmap v8759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:05 smithi086 ceph-mon[35163]: pgmap v8760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:11:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:11:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:11:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:05 smithi159 ceph-mon[36109]: pgmap v8759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:05 smithi159 ceph-mon[36109]: pgmap v8760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:11:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:11:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:11:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:05 smithi055 ceph-mon[31863]: pgmap v8759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:05 smithi055 ceph-mon[31863]: pgmap v8760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:11:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:06 smithi086 ceph-mon[35163]: pgmap v8761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:06 smithi159 ceph-mon[36109]: pgmap v8761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:06 smithi055 ceph-mon[31863]: pgmap v8761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:08 smithi086 ceph-mon[35163]: pgmap v8762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:08 smithi159 ceph-mon[36109]: pgmap v8762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:08 smithi055 ceph-mon[31863]: pgmap v8762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15068.070016 secs 2024-03-28T10:11:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15068.070016 secs 2024-03-28T10:11:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15068.070016 secs 2024-03-28T10:11:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:10 smithi086 ceph-mon[35163]: pgmap v8763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:11:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:10 smithi159 ceph-mon[36109]: pgmap v8763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:11:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:10 smithi055 ceph-mon[31863]: pgmap v8763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:11:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:12 smithi086 ceph-mon[35163]: pgmap v8764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:12 smithi159 ceph-mon[36109]: pgmap v8764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:12 smithi055 ceph-mon[31863]: pgmap v8764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15073.070094 secs 2024-03-28T10:11:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15073.070094 secs 2024-03-28T10:11:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15073.070094 secs 2024-03-28T10:11:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:14 smithi086 ceph-mon[35163]: pgmap v8765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:11:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:14 smithi159 ceph-mon[36109]: pgmap v8765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:11:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:14 smithi055 ceph-mon[31863]: pgmap v8765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:11:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:16 smithi086 ceph-mon[35163]: pgmap v8766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:16 smithi159 ceph-mon[36109]: pgmap v8766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:16 smithi055 ceph-mon[31863]: pgmap v8766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:18 smithi086 ceph-mon[35163]: pgmap v8767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:18 smithi159 ceph-mon[36109]: pgmap v8767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:18 smithi055 ceph-mon[31863]: pgmap v8767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:19.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15078.070167 secs 2024-03-28T10:11:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15078.070167 secs 2024-03-28T10:11:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15078.070167 secs 2024-03-28T10:11:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:20 smithi086 ceph-mon[35163]: pgmap v8768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:20 smithi159 ceph-mon[36109]: pgmap v8768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:20 smithi055 ceph-mon[31863]: pgmap v8768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:22 smithi086 ceph-mon[35163]: pgmap v8769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:22 smithi159 ceph-mon[36109]: pgmap v8769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:22 smithi055 ceph-mon[31863]: pgmap v8769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15083.070238 secs 2024-03-28T10:11:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15083.070238 secs 2024-03-28T10:11:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15083.070238 secs 2024-03-28T10:11:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:24 smithi086 ceph-mon[35163]: pgmap v8770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:24 smithi159 ceph-mon[36109]: pgmap v8770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:24 smithi055 ceph-mon[31863]: pgmap v8770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:26 smithi086 ceph-mon[35163]: pgmap v8771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:26 smithi159 ceph-mon[36109]: pgmap v8771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:26 smithi055 ceph-mon[31863]: pgmap v8771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:28 smithi086 ceph-mon[35163]: pgmap v8772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:28 smithi159 ceph-mon[36109]: pgmap v8772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:28 smithi055 ceph-mon[31863]: pgmap v8772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:29.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15088.070314 secs 2024-03-28T10:11:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15088.070314 secs 2024-03-28T10:11:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15088.070314 secs 2024-03-28T10:11:30.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:30 smithi159 ceph-mon[36109]: pgmap v8773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:30 smithi086 ceph-mon[35163]: pgmap v8773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:30 smithi055 ceph-mon[31863]: pgmap v8773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:32 smithi086 ceph-mon[35163]: pgmap v8774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:32 smithi159 ceph-mon[36109]: pgmap v8774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:32 smithi055 ceph-mon[31863]: pgmap v8774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15093.070380 secs 2024-03-28T10:11:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15093.070380 secs 2024-03-28T10:11:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15093.070380 secs 2024-03-28T10:11:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:34 smithi086 ceph-mon[35163]: pgmap v8775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:34 smithi159 ceph-mon[36109]: pgmap v8775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:34 smithi055 ceph-mon[31863]: pgmap v8775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:36 smithi086 ceph-mon[35163]: pgmap v8776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:36 smithi159 ceph-mon[36109]: pgmap v8776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:36 smithi055 ceph-mon[31863]: pgmap v8776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:38 smithi086 ceph-mon[35163]: pgmap v8777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:38 smithi159 ceph-mon[36109]: pgmap v8777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:38 smithi055 ceph-mon[31863]: pgmap v8777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15098.070499 secs 2024-03-28T10:11:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15098.070499 secs 2024-03-28T10:11:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15098.070499 secs 2024-03-28T10:11:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:40 smithi086 ceph-mon[35163]: pgmap v8778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:40 smithi159 ceph-mon[36109]: pgmap v8778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:40 smithi055 ceph-mon[31863]: pgmap v8778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:42 smithi086 ceph-mon[35163]: pgmap v8779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:42 smithi159 ceph-mon[36109]: pgmap v8779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:42 smithi055 ceph-mon[31863]: pgmap v8779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15103.070625 secs 2024-03-28T10:11:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15103.070625 secs 2024-03-28T10:11:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15103.070625 secs 2024-03-28T10:11:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:44 smithi086 ceph-mon[35163]: pgmap v8780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:44 smithi159 ceph-mon[36109]: pgmap v8780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:44 smithi055 ceph-mon[31863]: pgmap v8780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:46 smithi086 ceph-mon[35163]: pgmap v8781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:46 smithi159 ceph-mon[36109]: pgmap v8781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:46 smithi055 ceph-mon[31863]: pgmap v8781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:48 smithi086 ceph-mon[35163]: pgmap v8782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:48 smithi159 ceph-mon[36109]: pgmap v8782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:48 smithi055 ceph-mon[31863]: pgmap v8782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:49.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15108.070747 secs 2024-03-28T10:11:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15108.070747 secs 2024-03-28T10:11:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15108.070747 secs 2024-03-28T10:11:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:50 smithi086 ceph-mon[35163]: pgmap v8783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:50 smithi159 ceph-mon[36109]: pgmap v8783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:50 smithi055 ceph-mon[31863]: pgmap v8783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:11:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:52 smithi086 ceph-mon[35163]: pgmap v8784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:52 smithi159 ceph-mon[36109]: pgmap v8784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:52 smithi055 ceph-mon[31863]: pgmap v8784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15113.070870 secs 2024-03-28T10:11:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15113.070870 secs 2024-03-28T10:11:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15113.070870 secs 2024-03-28T10:11:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:54 smithi086 ceph-mon[35163]: pgmap v8785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:54 smithi159 ceph-mon[36109]: pgmap v8785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:54 smithi055 ceph-mon[31863]: pgmap v8785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:56 smithi086 ceph-mon[35163]: pgmap v8786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:56 smithi159 ceph-mon[36109]: pgmap v8786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:56 smithi055 ceph-mon[31863]: pgmap v8786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:58 smithi086 ceph-mon[35163]: pgmap v8787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:58 smithi159 ceph-mon[36109]: pgmap v8787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:58 smithi055 ceph-mon[31863]: pgmap v8787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:11:59.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:11:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15118.070963 secs 2024-03-28T10:11:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:11:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15118.070963 secs 2024-03-28T10:11:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:11:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15118.070963 secs 2024-03-28T10:12:00.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:00 smithi159 ceph-mon[36109]: pgmap v8788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:00 smithi086 ceph-mon[35163]: pgmap v8788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:00 smithi055 ceph-mon[31863]: pgmap v8788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:02 smithi086 ceph-mon[35163]: pgmap v8789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:02 smithi159 ceph-mon[36109]: pgmap v8789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:02 smithi055 ceph-mon[31863]: pgmap v8789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15123.071054 secs 2024-03-28T10:12:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15123.071054 secs 2024-03-28T10:12:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15123.071054 secs 2024-03-28T10:12:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:04 smithi086 ceph-mon[35163]: pgmap v8790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:12:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:04 smithi159 ceph-mon[36109]: pgmap v8790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:12:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:04 smithi055 ceph-mon[31863]: pgmap v8790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:12:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:12:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:12:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:12:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:12:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:12:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:12:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:12:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:12:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:12:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:06 smithi086 ceph-mon[35163]: pgmap v8791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:06 smithi086 ceph-mon[35163]: pgmap v8792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:06 smithi159 ceph-mon[36109]: pgmap v8791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:06 smithi159 ceph-mon[36109]: pgmap v8792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:06 smithi055 ceph-mon[31863]: pgmap v8791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:06 smithi055 ceph-mon[31863]: pgmap v8792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15128.071132 secs 2024-03-28T10:12:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:08 smithi086 ceph-mon[35163]: pgmap v8793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15128.071132 secs 2024-03-28T10:12:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:08 smithi159 ceph-mon[36109]: pgmap v8793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15128.071132 secs 2024-03-28T10:12:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:08 smithi055 ceph-mon[31863]: pgmap v8793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:10 smithi086 ceph-mon[35163]: pgmap v8794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:10 smithi159 ceph-mon[36109]: pgmap v8794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:10 smithi055 ceph-mon[31863]: pgmap v8794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:12 smithi086 ceph-mon[35163]: pgmap v8795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:12 smithi159 ceph-mon[36109]: pgmap v8795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:12 smithi055 ceph-mon[31863]: pgmap v8795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15133.071206 secs 2024-03-28T10:12:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15133.071206 secs 2024-03-28T10:12:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15133.071206 secs 2024-03-28T10:12:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:15 smithi086 ceph-mon[35163]: pgmap v8796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:15 smithi159 ceph-mon[36109]: pgmap v8796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:15 smithi055 ceph-mon[31863]: pgmap v8796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:12:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:17 smithi086 ceph-mon[35163]: pgmap v8797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:17 smithi159 ceph-mon[36109]: pgmap v8797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:17 smithi055 ceph-mon[31863]: pgmap v8797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15138.071287 secs 2024-03-28T10:12:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:19 smithi086 ceph-mon[35163]: pgmap v8798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15138.071287 secs 2024-03-28T10:12:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:19 smithi159 ceph-mon[36109]: pgmap v8798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15138.071287 secs 2024-03-28T10:12:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:19 smithi055 ceph-mon[31863]: pgmap v8798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:21 smithi086 ceph-mon[35163]: pgmap v8799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:21 smithi159 ceph-mon[36109]: pgmap v8799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:21 smithi055 ceph-mon[31863]: pgmap v8799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:23 smithi086 ceph-mon[35163]: pgmap v8800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:23 smithi159 ceph-mon[36109]: pgmap v8800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:23 smithi055 ceph-mon[31863]: pgmap v8800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15143.071332 secs 2024-03-28T10:12:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15143.071332 secs 2024-03-28T10:12:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15143.071332 secs 2024-03-28T10:12:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:25 smithi055 ceph-mon[31863]: pgmap v8801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:25 smithi086 ceph-mon[35163]: pgmap v8801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:25 smithi159 ceph-mon[36109]: pgmap v8801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:27 smithi055 ceph-mon[31863]: pgmap v8802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:27 smithi086 ceph-mon[35163]: pgmap v8802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:27 smithi159 ceph-mon[36109]: pgmap v8802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:29.369 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15148.071413 secs 2024-03-28T10:12:29.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:29 smithi086 ceph-mon[35163]: pgmap v8803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15148.071413 secs 2024-03-28T10:12:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:29 smithi055 ceph-mon[31863]: pgmap v8803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15148.071413 secs 2024-03-28T10:12:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:29 smithi159 ceph-mon[36109]: pgmap v8803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:31.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:31 smithi159 ceph-mon[36109]: pgmap v8804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:31 smithi055 ceph-mon[31863]: pgmap v8804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:31 smithi086 ceph-mon[35163]: pgmap v8804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:33 smithi055 ceph-mon[31863]: pgmap v8805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:33 smithi086 ceph-mon[35163]: pgmap v8805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:33 smithi159 ceph-mon[36109]: pgmap v8805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15153.071533 secs 2024-03-28T10:12:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15153.071533 secs 2024-03-28T10:12:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15153.071533 secs 2024-03-28T10:12:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:35 smithi055 ceph-mon[31863]: pgmap v8806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:35 smithi086 ceph-mon[35163]: pgmap v8806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:35 smithi159 ceph-mon[36109]: pgmap v8806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:37 smithi086 ceph-mon[35163]: pgmap v8807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:37 smithi159 ceph-mon[36109]: pgmap v8807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:37 smithi055 ceph-mon[31863]: pgmap v8807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15158.071651 secs 2024-03-28T10:12:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:39 smithi086 ceph-mon[35163]: pgmap v8808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15158.071651 secs 2024-03-28T10:12:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:39 smithi159 ceph-mon[36109]: pgmap v8808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15158.071651 secs 2024-03-28T10:12:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:39 smithi055 ceph-mon[31863]: pgmap v8808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:41 smithi086 ceph-mon[35163]: pgmap v8809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:12:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:41 smithi159 ceph-mon[36109]: pgmap v8809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:12:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:41 smithi055 ceph-mon[31863]: pgmap v8809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:12:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:43 smithi086 ceph-mon[35163]: pgmap v8810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:43 smithi159 ceph-mon[36109]: pgmap v8810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:43 smithi055 ceph-mon[31863]: pgmap v8810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15163.071723 secs 2024-03-28T10:12:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15163.071723 secs 2024-03-28T10:12:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15163.071723 secs 2024-03-28T10:12:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:45 smithi086 ceph-mon[35163]: pgmap v8811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:45 smithi159 ceph-mon[36109]: pgmap v8811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:45 smithi055 ceph-mon[31863]: pgmap v8811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:12:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:46 smithi086 ceph-mon[35163]: pgmap v8812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:46 smithi159 ceph-mon[36109]: pgmap v8812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:46 smithi055 ceph-mon[31863]: pgmap v8812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15168.071858 secs 2024-03-28T10:12:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:48 smithi086 ceph-mon[35163]: pgmap v8813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15168.071858 secs 2024-03-28T10:12:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:48 smithi159 ceph-mon[36109]: pgmap v8813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:49.326 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15168.071858 secs 2024-03-28T10:12:49.326 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:48 smithi055 ceph-mon[31863]: pgmap v8813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:50 smithi086 ceph-mon[35163]: pgmap v8814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:50 smithi159 ceph-mon[36109]: pgmap v8814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:50 smithi055 ceph-mon[31863]: pgmap v8814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:12:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:52 smithi086 ceph-mon[35163]: pgmap v8815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:52 smithi159 ceph-mon[36109]: pgmap v8815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:52 smithi055 ceph-mon[31863]: pgmap v8815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15173.071920 secs 2024-03-28T10:12:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15173.071920 secs 2024-03-28T10:12:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15173.071920 secs 2024-03-28T10:12:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:55 smithi086 ceph-mon[35163]: pgmap v8816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:55 smithi159 ceph-mon[36109]: pgmap v8816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:55 smithi055 ceph-mon[31863]: pgmap v8816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:57 smithi086 ceph-mon[35163]: pgmap v8817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:57 smithi159 ceph-mon[36109]: pgmap v8817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:57 smithi055 ceph-mon[31863]: pgmap v8817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15178.072012 secs 2024-03-28T10:12:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:12:59 smithi086 ceph-mon[35163]: pgmap v8818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15178.072012 secs 2024-03-28T10:12:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:12:59 smithi159 ceph-mon[36109]: pgmap v8818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:12:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15178.072012 secs 2024-03-28T10:12:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:12:59 smithi055 ceph-mon[31863]: pgmap v8818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:01 smithi086 ceph-mon[35163]: pgmap v8819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:01 smithi159 ceph-mon[36109]: pgmap v8819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:01 smithi055 ceph-mon[31863]: pgmap v8819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:03 smithi086 ceph-mon[35163]: pgmap v8820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:03 smithi159 ceph-mon[36109]: pgmap v8820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:03 smithi055 ceph-mon[31863]: pgmap v8820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15183.072076 secs 2024-03-28T10:13:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15183.072076 secs 2024-03-28T10:13:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15183.072076 secs 2024-03-28T10:13:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:05 smithi086 ceph-mon[35163]: pgmap v8821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:05 smithi159 ceph-mon[36109]: pgmap v8821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:05 smithi055 ceph-mon[31863]: pgmap v8821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:07 smithi086 ceph-mon[35163]: pgmap v8822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:13:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:07 smithi159 ceph-mon[36109]: pgmap v8822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:13:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:07 smithi055 ceph-mon[31863]: pgmap v8822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:13:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:13:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:13:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:13:08.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:13:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:13:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:13:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15188.072140 secs 2024-03-28T10:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:13:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:13:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: pgmap v8823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:09.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:09 smithi055 ceph-mon[31863]: pgmap v8824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15188.072140 secs 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: pgmap v8823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:09 smithi086 ceph-mon[35163]: pgmap v8824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15188.072140 secs 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: pgmap v8823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:09 smithi159 ceph-mon[36109]: pgmap v8824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:11 smithi055 ceph-mon[31863]: pgmap v8825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:11 smithi086 ceph-mon[35163]: pgmap v8825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:11 smithi159 ceph-mon[36109]: pgmap v8825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:13 smithi055 ceph-mon[31863]: pgmap v8826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:13 smithi086 ceph-mon[35163]: pgmap v8826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:13 smithi159 ceph-mon[36109]: pgmap v8826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15193.072204 secs 2024-03-28T10:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15193.072204 secs 2024-03-28T10:13:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15193.072204 secs 2024-03-28T10:13:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:15 smithi055 ceph-mon[31863]: pgmap v8827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:15 smithi086 ceph-mon[35163]: pgmap v8827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:15 smithi159 ceph-mon[36109]: pgmap v8827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:17 smithi086 ceph-mon[35163]: pgmap v8828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:17 smithi159 ceph-mon[36109]: pgmap v8828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:17 smithi055 ceph-mon[31863]: pgmap v8828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:13:19.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15198.072278 secs 2024-03-28T10:13:19.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:19 smithi055 ceph-mon[31863]: pgmap v8829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:13:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15198.072278 secs 2024-03-28T10:13:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:19 smithi086 ceph-mon[35163]: pgmap v8829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:13:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15198.072278 secs 2024-03-28T10:13:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:19 smithi159 ceph-mon[36109]: pgmap v8829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:13:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:21 smithi086 ceph-mon[35163]: pgmap v8830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:21 smithi159 ceph-mon[36109]: pgmap v8830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:21 smithi055 ceph-mon[31863]: pgmap v8830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:23 smithi086 ceph-mon[35163]: pgmap v8831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:23 smithi159 ceph-mon[36109]: pgmap v8831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:23 smithi055 ceph-mon[31863]: pgmap v8831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15203.072344 secs 2024-03-28T10:13:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15203.072344 secs 2024-03-28T10:13:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15203.072344 secs 2024-03-28T10:13:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:25 smithi086 ceph-mon[35163]: pgmap v8832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:25 smithi159 ceph-mon[36109]: pgmap v8832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:25 smithi055 ceph-mon[31863]: pgmap v8832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:26 smithi086 ceph-mon[35163]: pgmap v8833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:26 smithi159 ceph-mon[36109]: pgmap v8833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:26 smithi055 ceph-mon[31863]: pgmap v8833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15208.072464 secs 2024-03-28T10:13:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:28 smithi086 ceph-mon[35163]: pgmap v8834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15208.072464 secs 2024-03-28T10:13:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:28 smithi159 ceph-mon[36109]: pgmap v8834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15208.072464 secs 2024-03-28T10:13:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:28 smithi055 ceph-mon[31863]: pgmap v8834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:30 smithi086 ceph-mon[35163]: pgmap v8835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:30 smithi159 ceph-mon[36109]: pgmap v8835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:30 smithi055 ceph-mon[31863]: pgmap v8835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:32 smithi159 ceph-mon[36109]: pgmap v8836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:32 smithi055 ceph-mon[31863]: pgmap v8836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:32 smithi086 ceph-mon[35163]: pgmap v8836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15213.072535 secs 2024-03-28T10:13:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15213.072535 secs 2024-03-28T10:13:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15213.072535 secs 2024-03-28T10:13:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:34 smithi055 ceph-mon[31863]: pgmap v8837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:34 smithi086 ceph-mon[35163]: pgmap v8837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:34 smithi159 ceph-mon[36109]: pgmap v8837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:36 smithi055 ceph-mon[31863]: pgmap v8838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:36 smithi086 ceph-mon[35163]: pgmap v8838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:36 smithi159 ceph-mon[36109]: pgmap v8838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15218.072605 secs 2024-03-28T10:13:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:38 smithi055 ceph-mon[31863]: pgmap v8839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15218.072605 secs 2024-03-28T10:13:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:38 smithi086 ceph-mon[35163]: pgmap v8839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15218.072605 secs 2024-03-28T10:13:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:38 smithi159 ceph-mon[36109]: pgmap v8839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:40 smithi055 ceph-mon[31863]: pgmap v8840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:40 smithi086 ceph-mon[35163]: pgmap v8840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:40 smithi159 ceph-mon[36109]: pgmap v8840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:42 smithi055 ceph-mon[31863]: pgmap v8841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:42 smithi086 ceph-mon[35163]: pgmap v8841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:42 smithi159 ceph-mon[36109]: pgmap v8841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15223.072670 secs 2024-03-28T10:13:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15223.072670 secs 2024-03-28T10:13:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15223.072670 secs 2024-03-28T10:13:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:44 smithi086 ceph-mon[35163]: pgmap v8842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:44 smithi159 ceph-mon[36109]: pgmap v8842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:44 smithi055 ceph-mon[31863]: pgmap v8842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:46 smithi086 ceph-mon[35163]: pgmap v8843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:46 smithi159 ceph-mon[36109]: pgmap v8843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:46 smithi055 ceph-mon[31863]: pgmap v8843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:49.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15228.072741 secs 2024-03-28T10:13:49.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:48 smithi055 ceph-mon[31863]: pgmap v8844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15228.072741 secs 2024-03-28T10:13:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:48 smithi086 ceph-mon[35163]: pgmap v8844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15228.072741 secs 2024-03-28T10:13:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:48 smithi159 ceph-mon[36109]: pgmap v8844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:50 smithi086 ceph-mon[35163]: pgmap v8845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:50 smithi159 ceph-mon[36109]: pgmap v8845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:50 smithi055 ceph-mon[31863]: pgmap v8845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:13:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:52 smithi086 ceph-mon[35163]: pgmap v8846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:52 smithi159 ceph-mon[36109]: pgmap v8846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:52 smithi055 ceph-mon[31863]: pgmap v8846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15233.072841 secs 2024-03-28T10:13:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15233.072841 secs 2024-03-28T10:13:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15233.072841 secs 2024-03-28T10:13:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:54 smithi086 ceph-mon[35163]: pgmap v8847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:54 smithi159 ceph-mon[36109]: pgmap v8847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:54 smithi055 ceph-mon[31863]: pgmap v8847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:56 smithi086 ceph-mon[35163]: pgmap v8848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:56 smithi159 ceph-mon[36109]: pgmap v8848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:56 smithi055 ceph-mon[31863]: pgmap v8848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15238.072907 secs 2024-03-28T10:13:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:13:58 smithi086 ceph-mon[35163]: pgmap v8849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15238.072907 secs 2024-03-28T10:13:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:13:58 smithi159 ceph-mon[36109]: pgmap v8849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:13:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15238.072907 secs 2024-03-28T10:13:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:13:58 smithi055 ceph-mon[31863]: pgmap v8849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:00 smithi086 ceph-mon[35163]: pgmap v8850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:00 smithi159 ceph-mon[36109]: pgmap v8850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:00 smithi055 ceph-mon[31863]: pgmap v8850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:02 smithi086 ceph-mon[35163]: pgmap v8851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:02 smithi159 ceph-mon[36109]: pgmap v8851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:02 smithi055 ceph-mon[31863]: pgmap v8851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15243.072972 secs 2024-03-28T10:14:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15243.072972 secs 2024-03-28T10:14:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15243.072972 secs 2024-03-28T10:14:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:04 smithi086 ceph-mon[35163]: pgmap v8852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:04 smithi159 ceph-mon[36109]: pgmap v8852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:04 smithi055 ceph-mon[31863]: pgmap v8852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:06 smithi086 ceph-mon[35163]: pgmap v8853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:06 smithi159 ceph-mon[36109]: pgmap v8853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:06 smithi055 ceph-mon[31863]: pgmap v8853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15248.073047 secs 2024-03-28T10:14:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:08 smithi086 ceph-mon[35163]: pgmap v8854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:14:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15248.073047 secs 2024-03-28T10:14:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:08 smithi159 ceph-mon[36109]: pgmap v8854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:14:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15248.073047 secs 2024-03-28T10:14:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:08 smithi055 ceph-mon[31863]: pgmap v8854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:14:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:14:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:10 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:14:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:10 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:14:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:10 smithi055 ceph-mon[31863]: pgmap v8855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:11.248 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:10 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:14:11.249 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:10 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:14:11.249 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:10 smithi086 ceph-mon[35163]: pgmap v8855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:10 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:14:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:10 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:14:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:10 smithi159 ceph-mon[36109]: pgmap v8855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:12 smithi086 ceph-mon[35163]: pgmap v8856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:12 smithi159 ceph-mon[36109]: pgmap v8856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:12 smithi055 ceph-mon[31863]: pgmap v8856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15253.073113 secs 2024-03-28T10:14:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15253.073113 secs 2024-03-28T10:14:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15253.073113 secs 2024-03-28T10:14:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: pgmap v8857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:14:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:14:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: pgmap v8857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:14:15.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: pgmap v8857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:14:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:14:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:16 smithi086 ceph-mon[35163]: pgmap v8858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:14:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:16 smithi086 ceph-mon[35163]: pgmap v8859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:16 smithi159 ceph-mon[36109]: pgmap v8858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:14:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:16 smithi159 ceph-mon[36109]: pgmap v8859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:16 smithi055 ceph-mon[31863]: pgmap v8858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:14:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:16 smithi055 ceph-mon[31863]: pgmap v8859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:14:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:18 smithi086 ceph-mon[35163]: pgmap v8860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:18 smithi159 ceph-mon[36109]: pgmap v8860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:18 smithi055 ceph-mon[31863]: pgmap v8860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15258.073196 secs 2024-03-28T10:14:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15258.073196 secs 2024-03-28T10:14:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15258.073196 secs 2024-03-28T10:14:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:20 smithi086 ceph-mon[35163]: pgmap v8861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:20 smithi159 ceph-mon[36109]: pgmap v8861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:20 smithi055 ceph-mon[31863]: pgmap v8861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:22 smithi086 ceph-mon[35163]: pgmap v8862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:22 smithi159 ceph-mon[36109]: pgmap v8862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:22 smithi055 ceph-mon[31863]: pgmap v8862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15263.073298 secs 2024-03-28T10:14:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:24 smithi086 ceph-mon[35163]: pgmap v8863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15263.073298 secs 2024-03-28T10:14:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:24 smithi055 ceph-mon[31863]: pgmap v8863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15263.073298 secs 2024-03-28T10:14:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:24 smithi159 ceph-mon[36109]: pgmap v8863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:14:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:26 smithi055 ceph-mon[31863]: pgmap v8864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:14:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:26 smithi086 ceph-mon[35163]: pgmap v8864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:14:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:26 smithi159 ceph-mon[36109]: pgmap v8864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:14:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:28 smithi055 ceph-mon[31863]: pgmap v8865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:28 smithi086 ceph-mon[35163]: pgmap v8865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:28 smithi159 ceph-mon[36109]: pgmap v8865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15268.073403 secs 2024-03-28T10:14:29.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15268.073403 secs 2024-03-28T10:14:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15268.073403 secs 2024-03-28T10:14:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:30 smithi055 ceph-mon[31863]: pgmap v8866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:30.491 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:30 smithi086 ceph-mon[35163]: pgmap v8866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:30 smithi159 ceph-mon[36109]: pgmap v8866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:32 smithi086 ceph-mon[35163]: pgmap v8867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:32 smithi055 ceph-mon[31863]: pgmap v8867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:32 smithi159 ceph-mon[36109]: pgmap v8867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:34.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15273.073475 secs 2024-03-28T10:14:34.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:34 smithi159 ceph-mon[36109]: pgmap v8868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15273.073475 secs 2024-03-28T10:14:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:34 smithi055 ceph-mon[31863]: pgmap v8868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15273.073475 secs 2024-03-28T10:14:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:34 smithi086 ceph-mon[35163]: pgmap v8868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:36 smithi086 ceph-mon[35163]: pgmap v8869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:36 smithi159 ceph-mon[36109]: pgmap v8869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:36 smithi055 ceph-mon[31863]: pgmap v8869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:14:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:38 smithi086 ceph-mon[35163]: pgmap v8870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15278.073588 secs 2024-03-28T10:14:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:38 smithi159 ceph-mon[36109]: pgmap v8870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15278.073588 secs 2024-03-28T10:14:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:38 smithi055 ceph-mon[31863]: pgmap v8870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15278.073588 secs 2024-03-28T10:14:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:40 smithi086 ceph-mon[35163]: pgmap v8871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:40 smithi159 ceph-mon[36109]: pgmap v8871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:40 smithi055 ceph-mon[31863]: pgmap v8871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:42 smithi086 ceph-mon[35163]: pgmap v8872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:42 smithi159 ceph-mon[36109]: pgmap v8872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:42 smithi055 ceph-mon[31863]: pgmap v8872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:14:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15283.073650 secs 2024-03-28T10:14:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15283.073650 secs 2024-03-28T10:14:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15283.073650 secs 2024-03-28T10:14:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:44 smithi086 ceph-mon[35163]: pgmap v8873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:44 smithi159 ceph-mon[36109]: pgmap v8873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:44 smithi055 ceph-mon[31863]: pgmap v8873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:46 smithi086 ceph-mon[35163]: pgmap v8874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:46 smithi159 ceph-mon[36109]: pgmap v8874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:46 smithi055 ceph-mon[31863]: pgmap v8874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:47 smithi086 ceph-mon[35163]: pgmap v8875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:47 smithi159 ceph-mon[36109]: pgmap v8875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:47 smithi055 ceph-mon[31863]: pgmap v8875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15288.073772 secs 2024-03-28T10:14:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15288.073772 secs 2024-03-28T10:14:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15288.073772 secs 2024-03-28T10:14:49.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:49 smithi055 ceph-mon[31863]: pgmap v8876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:49 smithi086 ceph-mon[35163]: pgmap v8876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:49 smithi159 ceph-mon[36109]: pgmap v8876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:52 smithi055 ceph-mon[31863]: pgmap v8877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:52 smithi086 ceph-mon[35163]: pgmap v8877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:52 smithi159 ceph-mon[36109]: pgmap v8877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15293.073825 secs 2024-03-28T10:14:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15293.073825 secs 2024-03-28T10:14:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15293.073825 secs 2024-03-28T10:14:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:54 smithi055 ceph-mon[31863]: pgmap v8878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:54 smithi086 ceph-mon[35163]: pgmap v8878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:54 smithi159 ceph-mon[36109]: pgmap v8878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:56 smithi055 ceph-mon[31863]: pgmap v8879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:56 smithi086 ceph-mon[35163]: pgmap v8879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:56 smithi159 ceph-mon[36109]: pgmap v8879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:14:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:58 smithi086 ceph-mon[35163]: pgmap v8880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:14:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15298.073946 secs 2024-03-28T10:14:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:58 smithi159 ceph-mon[36109]: pgmap v8880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:14:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15298.073946 secs 2024-03-28T10:14:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:58 smithi055 ceph-mon[31863]: pgmap v8880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:14:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:14:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15298.073946 secs 2024-03-28T10:15:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:00 smithi086 ceph-mon[35163]: pgmap v8881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:00 smithi159 ceph-mon[36109]: pgmap v8881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:00 smithi055 ceph-mon[31863]: pgmap v8881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:02 smithi086 ceph-mon[35163]: pgmap v8882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:02 smithi159 ceph-mon[36109]: pgmap v8882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:02 smithi055 ceph-mon[31863]: pgmap v8882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15303.074070 secs 2024-03-28T10:15:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15303.074070 secs 2024-03-28T10:15:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15303.074070 secs 2024-03-28T10:15:04.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:04 smithi159 ceph-mon[36109]: pgmap v8883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:04 smithi086 ceph-mon[35163]: pgmap v8883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:04 smithi055 ceph-mon[31863]: pgmap v8883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:06 smithi086 ceph-mon[35163]: pgmap v8884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:06 smithi159 ceph-mon[36109]: pgmap v8884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:06 smithi055 ceph-mon[31863]: pgmap v8884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:08 smithi086 ceph-mon[35163]: pgmap v8885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15308.074195 secs 2024-03-28T10:15:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:08 smithi159 ceph-mon[36109]: pgmap v8885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15308.074195 secs 2024-03-28T10:15:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:08 smithi055 ceph-mon[31863]: pgmap v8885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15308.074195 secs 2024-03-28T10:15:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:10 smithi086 ceph-mon[35163]: pgmap v8886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:10 smithi159 ceph-mon[36109]: pgmap v8886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:10 smithi055 ceph-mon[31863]: pgmap v8886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:11 smithi086 ceph-mon[35163]: pgmap v8887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:11 smithi159 ceph-mon[36109]: pgmap v8887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:11 smithi055 ceph-mon[31863]: pgmap v8887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15313.074278 secs 2024-03-28T10:15:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:13 smithi055 ceph-mon[31863]: pgmap v8888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15313.074278 secs 2024-03-28T10:15:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:13 smithi086 ceph-mon[35163]: pgmap v8888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15313.074278 secs 2024-03-28T10:15:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:13 smithi159 ceph-mon[36109]: pgmap v8888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:16 smithi055 ceph-mon[31863]: pgmap v8889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:15:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:16 smithi086 ceph-mon[35163]: pgmap v8889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:15:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:16 smithi159 ceph-mon[36109]: pgmap v8889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:15:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:18 smithi055 ceph-mon[31863]: pgmap v8890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15318.074304 secs 2024-03-28T10:15:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:18 smithi086 ceph-mon[35163]: pgmap v8890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15318.074304 secs 2024-03-28T10:15:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:18 smithi159 ceph-mon[36109]: pgmap v8890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15318.074304 secs 2024-03-28T10:15:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:20 smithi055 ceph-mon[31863]: pgmap v8891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:20 smithi086 ceph-mon[35163]: pgmap v8891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:20.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:20 smithi159 ceph-mon[36109]: pgmap v8891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:22.297 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:22 smithi159 ceph-mon[36109]: pgmap v8892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:22 smithi055 ceph-mon[31863]: pgmap v8892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:22 smithi086 ceph-mon[35163]: pgmap v8892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: pgmap v8893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: pgmap v8894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:15:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15323.074377 secs 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: pgmap v8893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: pgmap v8894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15323.074377 secs 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: pgmap v8893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: pgmap v8894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:15:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15323.074377 secs 2024-03-28T10:15:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:25 smithi086 ceph-mon[35163]: pgmap v8895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:25 smithi159 ceph-mon[36109]: pgmap v8895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:25 smithi055 ceph-mon[31863]: pgmap v8895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:27 smithi086 ceph-mon[35163]: pgmap v8896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:27 smithi159 ceph-mon[36109]: pgmap v8896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:27 smithi055 ceph-mon[31863]: pgmap v8896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15328.074501 secs 2024-03-28T10:15:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15328.074501 secs 2024-03-28T10:15:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15328.074501 secs 2024-03-28T10:15:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:29 smithi086 ceph-mon[35163]: pgmap v8897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:29 smithi159 ceph-mon[36109]: pgmap v8897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:29 smithi055 ceph-mon[31863]: pgmap v8897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:31 smithi086 ceph-mon[35163]: pgmap v8898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:31 smithi159 ceph-mon[36109]: pgmap v8898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:31 smithi055 ceph-mon[31863]: pgmap v8898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:33 smithi086 ceph-mon[35163]: pgmap v8899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:15:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15333.074536 secs 2024-03-28T10:15:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:33 smithi159 ceph-mon[36109]: pgmap v8899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:15:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15333.074536 secs 2024-03-28T10:15:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:33 smithi055 ceph-mon[31863]: pgmap v8899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:15:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15333.074536 secs 2024-03-28T10:15:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:35 smithi086 ceph-mon[35163]: pgmap v8900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:35 smithi159 ceph-mon[36109]: pgmap v8900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:35 smithi055 ceph-mon[31863]: pgmap v8900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:37 smithi159 ceph-mon[36109]: pgmap v8901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:37 smithi086 ceph-mon[35163]: pgmap v8901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:37 smithi055 ceph-mon[31863]: pgmap v8901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15338.074625 secs 2024-03-28T10:15:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15338.074625 secs 2024-03-28T10:15:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15338.074625 secs 2024-03-28T10:15:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:39 smithi055 ceph-mon[31863]: pgmap v8902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:39 smithi086 ceph-mon[35163]: pgmap v8902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:39 smithi159 ceph-mon[36109]: pgmap v8902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:41 smithi055 ceph-mon[31863]: pgmap v8903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:41 smithi086 ceph-mon[35163]: pgmap v8903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:41 smithi159 ceph-mon[36109]: pgmap v8903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:43 smithi055 ceph-mon[31863]: pgmap v8904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15343.074712 secs 2024-03-28T10:15:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:43 smithi086 ceph-mon[35163]: pgmap v8904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15343.074712 secs 2024-03-28T10:15:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:43 smithi159 ceph-mon[36109]: pgmap v8904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15343.074712 secs 2024-03-28T10:15:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:45 smithi055 ceph-mon[31863]: pgmap v8905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:45 smithi086 ceph-mon[35163]: pgmap v8905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:45 smithi159 ceph-mon[36109]: pgmap v8905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:47 smithi055 ceph-mon[31863]: pgmap v8906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:47 smithi086 ceph-mon[35163]: pgmap v8906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:47 smithi159 ceph-mon[36109]: pgmap v8906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15348.074837 secs 2024-03-28T10:15:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15348.074837 secs 2024-03-28T10:15:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15348.074837 secs 2024-03-28T10:15:50.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:49 smithi055 ceph-mon[31863]: pgmap v8907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:49 smithi086 ceph-mon[35163]: pgmap v8907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:49 smithi159 ceph-mon[36109]: pgmap v8907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:51 smithi086 ceph-mon[35163]: pgmap v8908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:51 smithi159 ceph-mon[36109]: pgmap v8908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:51 smithi055 ceph-mon[31863]: pgmap v8908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:15:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:53 smithi086 ceph-mon[35163]: pgmap v8909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15353.074956 secs 2024-03-28T10:15:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:53 smithi159 ceph-mon[36109]: pgmap v8909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15353.074956 secs 2024-03-28T10:15:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:53 smithi055 ceph-mon[31863]: pgmap v8909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:15:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15353.074956 secs 2024-03-28T10:15:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:55 smithi086 ceph-mon[35163]: pgmap v8910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:55 smithi159 ceph-mon[36109]: pgmap v8910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:55 smithi055 ceph-mon[31863]: pgmap v8910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:57 smithi086 ceph-mon[35163]: pgmap v8911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:57 smithi159 ceph-mon[36109]: pgmap v8911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:57 smithi055 ceph-mon[31863]: pgmap v8911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:15:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15358.075036 secs 2024-03-28T10:15:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15358.075036 secs 2024-03-28T10:15:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15358.075036 secs 2024-03-28T10:16:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:15:59 smithi086 ceph-mon[35163]: pgmap v8912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:15:59 smithi159 ceph-mon[36109]: pgmap v8912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:15:59 smithi055 ceph-mon[31863]: pgmap v8912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:01 smithi086 ceph-mon[35163]: pgmap v8913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:01 smithi159 ceph-mon[36109]: pgmap v8913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:01 smithi055 ceph-mon[31863]: pgmap v8913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15363.075157 secs 2024-03-28T10:16:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15363.075157 secs 2024-03-28T10:16:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15363.075157 secs 2024-03-28T10:16:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:03 smithi086 ceph-mon[35163]: pgmap v8914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:03 smithi159 ceph-mon[36109]: pgmap v8914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:03 smithi055 ceph-mon[31863]: pgmap v8914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:05 smithi086 ceph-mon[35163]: pgmap v8915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:05 smithi159 ceph-mon[36109]: pgmap v8915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:05 smithi055 ceph-mon[31863]: pgmap v8915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:07 smithi086 ceph-mon[35163]: pgmap v8916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15368.075245 secs 2024-03-28T10:16:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:07 smithi159 ceph-mon[36109]: pgmap v8916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15368.075245 secs 2024-03-28T10:16:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:07 smithi055 ceph-mon[31863]: pgmap v8916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15368.075245 secs 2024-03-28T10:16:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:09 smithi086 ceph-mon[35163]: pgmap v8917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:09 smithi159 ceph-mon[36109]: pgmap v8917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:09 smithi055 ceph-mon[31863]: pgmap v8917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:11 smithi086 ceph-mon[35163]: pgmap v8918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:12.082 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:11 smithi159 ceph-mon[36109]: pgmap v8918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:11 smithi055 ceph-mon[31863]: pgmap v8918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15373.075314 secs 2024-03-28T10:16:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15373.075314 secs 2024-03-28T10:16:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15373.075314 secs 2024-03-28T10:16:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:13 smithi086 ceph-mon[35163]: pgmap v8919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:13 smithi159 ceph-mon[36109]: pgmap v8919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:13 smithi055 ceph-mon[31863]: pgmap v8919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:15 smithi086 ceph-mon[35163]: pgmap v8920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:15 smithi159 ceph-mon[36109]: pgmap v8920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:16.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:15 smithi055 ceph-mon[31863]: pgmap v8920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:17 smithi086 ceph-mon[35163]: pgmap v8921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15378.075431 secs 2024-03-28T10:16:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:17 smithi159 ceph-mon[36109]: pgmap v8921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15378.075431 secs 2024-03-28T10:16:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:17 smithi055 ceph-mon[31863]: pgmap v8921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:18.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15378.075431 secs 2024-03-28T10:16:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:19 smithi086 ceph-mon[35163]: pgmap v8922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:19 smithi159 ceph-mon[36109]: pgmap v8922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:19 smithi055 ceph-mon[31863]: pgmap v8922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:21 smithi086 ceph-mon[35163]: pgmap v8923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:21 smithi159 ceph-mon[36109]: pgmap v8923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:21 smithi055 ceph-mon[31863]: pgmap v8923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:23 smithi086 ceph-mon[35163]: pgmap v8924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15383.075555 secs 2024-03-28T10:16:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:16:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:23 smithi159 ceph-mon[36109]: pgmap v8924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15383.075555 secs 2024-03-28T10:16:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:16:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:23 smithi055 ceph-mon[31863]: pgmap v8924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15383.075555 secs 2024-03-28T10:16:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:16:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:25 smithi055 ceph-mon[31863]: pgmap v8925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:16:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:16:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:25 smithi086 ceph-mon[35163]: pgmap v8925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:16:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:16:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:25 smithi159 ceph-mon[36109]: pgmap v8925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:16:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:16:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:16:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:26 smithi086 ceph-mon[35163]: pgmap v8926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:26 smithi086 ceph-mon[35163]: pgmap v8927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:26 smithi159 ceph-mon[36109]: pgmap v8926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:26 smithi159 ceph-mon[36109]: pgmap v8927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:26 smithi055 ceph-mon[31863]: pgmap v8926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:26 smithi055 ceph-mon[31863]: pgmap v8927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:28 smithi086 ceph-mon[35163]: pgmap v8928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15388.075680 secs 2024-03-28T10:16:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:28 smithi159 ceph-mon[36109]: pgmap v8928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15388.075680 secs 2024-03-28T10:16:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:28 smithi055 ceph-mon[31863]: pgmap v8928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15388.075680 secs 2024-03-28T10:16:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:30 smithi086 ceph-mon[35163]: pgmap v8929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T10:16:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:30 smithi159 ceph-mon[36109]: pgmap v8929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T10:16:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:30 smithi055 ceph-mon[31863]: pgmap v8929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T10:16:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:32 smithi086 ceph-mon[35163]: pgmap v8930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:32 smithi159 ceph-mon[36109]: pgmap v8930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:32 smithi055 ceph-mon[31863]: pgmap v8930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15393.075775 secs 2024-03-28T10:16:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15393.075775 secs 2024-03-28T10:16:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15393.075775 secs 2024-03-28T10:16:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:34 smithi086 ceph-mon[35163]: pgmap v8931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:34 smithi159 ceph-mon[36109]: pgmap v8931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:34 smithi055 ceph-mon[31863]: pgmap v8931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:16:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:36 smithi086 ceph-mon[35163]: pgmap v8932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:16:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:36 smithi159 ceph-mon[36109]: pgmap v8932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:16:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:36 smithi055 ceph-mon[31863]: pgmap v8932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:16:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:38 smithi159 ceph-mon[36109]: pgmap v8933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15398.075882 secs 2024-03-28T10:16:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:38 smithi086 ceph-mon[35163]: pgmap v8933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15398.075882 secs 2024-03-28T10:16:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:38 smithi055 ceph-mon[31863]: pgmap v8933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15398.075882 secs 2024-03-28T10:16:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:40 smithi086 ceph-mon[35163]: pgmap v8934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:40 smithi159 ceph-mon[36109]: pgmap v8934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:40 smithi055 ceph-mon[31863]: pgmap v8934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:42 smithi086 ceph-mon[35163]: pgmap v8935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15403.075955 secs 2024-03-28T10:16:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:42 smithi159 ceph-mon[36109]: pgmap v8935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15403.075955 secs 2024-03-28T10:16:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:42 smithi055 ceph-mon[31863]: pgmap v8935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15403.075955 secs 2024-03-28T10:16:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:44 smithi086 ceph-mon[35163]: pgmap v8936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:44 smithi159 ceph-mon[36109]: pgmap v8936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:44 smithi055 ceph-mon[31863]: pgmap v8936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:46 smithi086 ceph-mon[35163]: pgmap v8937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:46 smithi159 ceph-mon[36109]: pgmap v8937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:46 smithi055 ceph-mon[31863]: pgmap v8937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15408.076076 secs 2024-03-28T10:16:48.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15408.076076 secs 2024-03-28T10:16:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15408.076076 secs 2024-03-28T10:16:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:48 smithi086 ceph-mon[35163]: pgmap v8938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:48 smithi159 ceph-mon[36109]: pgmap v8938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:48 smithi055 ceph-mon[31863]: pgmap v8938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:50 smithi086 ceph-mon[35163]: pgmap v8939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:50 smithi159 ceph-mon[36109]: pgmap v8939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:50 smithi055 ceph-mon[31863]: pgmap v8939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:52 smithi086 ceph-mon[35163]: pgmap v8940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15413.076154 secs 2024-03-28T10:16:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:52 smithi159 ceph-mon[36109]: pgmap v8940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15413.076154 secs 2024-03-28T10:16:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:52 smithi055 ceph-mon[31863]: pgmap v8940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15413.076154 secs 2024-03-28T10:16:54.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:54 smithi055 ceph-mon[31863]: pgmap v8941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:54 smithi086 ceph-mon[35163]: pgmap v8941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:54 smithi159 ceph-mon[36109]: pgmap v8941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:16:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:56 smithi086 ceph-mon[35163]: pgmap v8942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:56 smithi159 ceph-mon[36109]: pgmap v8942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:56 smithi055 ceph-mon[31863]: pgmap v8942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:16:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15418.076239 secs 2024-03-28T10:16:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15418.076239 secs 2024-03-28T10:16:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15418.076239 secs 2024-03-28T10:16:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:16:58 smithi086 ceph-mon[35163]: pgmap v8943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:16:58 smithi159 ceph-mon[36109]: pgmap v8943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:16:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:16:58 smithi055 ceph-mon[31863]: pgmap v8943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:00 smithi086 ceph-mon[35163]: pgmap v8944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:00 smithi159 ceph-mon[36109]: pgmap v8944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:00 smithi055 ceph-mon[31863]: pgmap v8944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:02 smithi086 ceph-mon[35163]: pgmap v8945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15423.076362 secs 2024-03-28T10:17:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:02 smithi159 ceph-mon[36109]: pgmap v8945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15423.076362 secs 2024-03-28T10:17:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:02 smithi055 ceph-mon[31863]: pgmap v8945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15423.076362 secs 2024-03-28T10:17:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:04 smithi086 ceph-mon[35163]: pgmap v8946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:04 smithi159 ceph-mon[36109]: pgmap v8946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:04 smithi055 ceph-mon[31863]: pgmap v8946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:06 smithi086 ceph-mon[35163]: pgmap v8947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:06 smithi159 ceph-mon[36109]: pgmap v8947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:06 smithi055 ceph-mon[31863]: pgmap v8947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15428.076447 secs 2024-03-28T10:17:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15428.076447 secs 2024-03-28T10:17:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15428.076447 secs 2024-03-28T10:17:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:08 smithi055 ceph-mon[31863]: pgmap v8948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:08 smithi086 ceph-mon[35163]: pgmap v8948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:08 smithi159 ceph-mon[36109]: pgmap v8948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:10 smithi055 ceph-mon[31863]: pgmap v8949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:10 smithi086 ceph-mon[35163]: pgmap v8949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:10 smithi159 ceph-mon[36109]: pgmap v8949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:12 smithi055 ceph-mon[31863]: pgmap v8950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15433.076567 secs 2024-03-28T10:17:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:12 smithi086 ceph-mon[35163]: pgmap v8950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15433.076567 secs 2024-03-28T10:17:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:12 smithi159 ceph-mon[36109]: pgmap v8950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15433.076567 secs 2024-03-28T10:17:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:14 smithi055 ceph-mon[31863]: pgmap v8951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:14 smithi086 ceph-mon[35163]: pgmap v8951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:14 smithi159 ceph-mon[36109]: pgmap v8951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:16 smithi055 ceph-mon[31863]: pgmap v8952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:16 smithi086 ceph-mon[35163]: pgmap v8952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:16 smithi159 ceph-mon[36109]: pgmap v8952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15438.076647 secs 2024-03-28T10:17:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15438.076647 secs 2024-03-28T10:17:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15438.076647 secs 2024-03-28T10:17:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:18 smithi086 ceph-mon[35163]: pgmap v8953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:18 smithi159 ceph-mon[36109]: pgmap v8953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:18 smithi055 ceph-mon[31863]: pgmap v8953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:20 smithi086 ceph-mon[35163]: pgmap v8954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:20 smithi159 ceph-mon[36109]: pgmap v8954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:20 smithi055 ceph-mon[31863]: pgmap v8954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:23.175 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:22 smithi055 ceph-mon[31863]: pgmap v8955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:23.175 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15443.076768 secs 2024-03-28T10:17:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:22 smithi086 ceph-mon[35163]: pgmap v8955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15443.076768 secs 2024-03-28T10:17:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:22 smithi159 ceph-mon[36109]: pgmap v8955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15443.076768 secs 2024-03-28T10:17:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:24 smithi086 ceph-mon[35163]: pgmap v8956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:24 smithi159 ceph-mon[36109]: pgmap v8956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:24 smithi055 ceph-mon[31863]: pgmap v8956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:17:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:17:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:17:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:26 smithi086 ceph-mon[35163]: pgmap v8957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:26 smithi159 ceph-mon[36109]: pgmap v8957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:26 smithi055 ceph-mon[31863]: pgmap v8957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:17:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15448.076826 secs 2024-03-28T10:17:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15448.076826 secs 2024-03-28T10:17:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15448.076826 secs 2024-03-28T10:17:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:28 smithi086 ceph-mon[35163]: pgmap v8958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:28 smithi159 ceph-mon[36109]: pgmap v8958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:28 smithi055 ceph-mon[31863]: pgmap v8958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:30 smithi086 ceph-mon[35163]: pgmap v8959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:30 smithi159 ceph-mon[36109]: pgmap v8959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:30 smithi055 ceph-mon[31863]: pgmap v8959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:32.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:17:32.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:17:32.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:17:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:17:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:17:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:17:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:17:33.240 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:32 smithi086 ceph-mon[35163]: pgmap v8960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:33.240 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:32 smithi086 ceph-mon[35163]: pgmap v8961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:17:33.240 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:32 smithi086 ceph-mon[35163]: pgmap v8962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:33.240 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15453.076912 secs 2024-03-28T10:17:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:32 smithi159 ceph-mon[36109]: pgmap v8960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:32 smithi159 ceph-mon[36109]: pgmap v8961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:17:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:32 smithi159 ceph-mon[36109]: pgmap v8962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15453.076912 secs 2024-03-28T10:17:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:32 smithi055 ceph-mon[31863]: pgmap v8960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:32 smithi055 ceph-mon[31863]: pgmap v8961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:17:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:32 smithi055 ceph-mon[31863]: pgmap v8962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15453.076912 secs 2024-03-28T10:17:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:34 smithi086 ceph-mon[35163]: pgmap v8963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:17:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:34 smithi159 ceph-mon[36109]: pgmap v8963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:17:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:34 smithi055 ceph-mon[31863]: pgmap v8963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:17:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:36 smithi086 ceph-mon[35163]: pgmap v8964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:36 smithi159 ceph-mon[36109]: pgmap v8964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:36 smithi055 ceph-mon[31863]: pgmap v8964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15458.077035 secs 2024-03-28T10:17:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15458.077035 secs 2024-03-28T10:17:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15458.077035 secs 2024-03-28T10:17:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:38 smithi086 ceph-mon[35163]: pgmap v8965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:38 smithi159 ceph-mon[36109]: pgmap v8965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:38 smithi055 ceph-mon[31863]: pgmap v8965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:17:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:40 smithi086 ceph-mon[35163]: pgmap v8966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:40 smithi159 ceph-mon[36109]: pgmap v8966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:40 smithi055 ceph-mon[31863]: pgmap v8966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:17:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:43 smithi086 ceph-mon[35163]: pgmap v8967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:17:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15463.077155 secs 2024-03-28T10:17:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:43 smithi159 ceph-mon[36109]: pgmap v8967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:17:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15463.077155 secs 2024-03-28T10:17:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:43 smithi055 ceph-mon[31863]: pgmap v8967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:17:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15463.077155 secs 2024-03-28T10:17:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:45 smithi086 ceph-mon[35163]: pgmap v8968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:45 smithi159 ceph-mon[36109]: pgmap v8968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:45 smithi055 ceph-mon[31863]: pgmap v8968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:47 smithi086 ceph-mon[35163]: pgmap v8969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:47 smithi159 ceph-mon[36109]: pgmap v8969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:47 smithi055 ceph-mon[31863]: pgmap v8969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15468.077232 secs 2024-03-28T10:17:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15468.077232 secs 2024-03-28T10:17:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15468.077232 secs 2024-03-28T10:17:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:49 smithi086 ceph-mon[35163]: pgmap v8970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:49 smithi159 ceph-mon[36109]: pgmap v8970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:49 smithi055 ceph-mon[31863]: pgmap v8970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:51 smithi086 ceph-mon[35163]: pgmap v8971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:51 smithi159 ceph-mon[36109]: pgmap v8971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:51 smithi055 ceph-mon[31863]: pgmap v8971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:17:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:53 smithi086 ceph-mon[35163]: pgmap v8972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15473.077355 secs 2024-03-28T10:17:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:53 smithi159 ceph-mon[36109]: pgmap v8972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15473.077355 secs 2024-03-28T10:17:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:53 smithi055 ceph-mon[31863]: pgmap v8972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15473.077355 secs 2024-03-28T10:17:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:55 smithi055 ceph-mon[31863]: pgmap v8973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:55 smithi086 ceph-mon[35163]: pgmap v8973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:55 smithi159 ceph-mon[36109]: pgmap v8973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:57 smithi055 ceph-mon[31863]: pgmap v8974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:57 smithi086 ceph-mon[35163]: pgmap v8974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:57 smithi159 ceph-mon[36109]: pgmap v8974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15478.077395 secs 2024-03-28T10:17:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15478.077395 secs 2024-03-28T10:17:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15478.077395 secs 2024-03-28T10:17:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:17:59 smithi055 ceph-mon[31863]: pgmap v8975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:17:59 smithi086 ceph-mon[35163]: pgmap v8975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:17:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:17:59 smithi159 ceph-mon[36109]: pgmap v8975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:01 smithi055 ceph-mon[31863]: pgmap v8976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:01 smithi086 ceph-mon[35163]: pgmap v8976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:01 smithi159 ceph-mon[36109]: pgmap v8976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:03.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:03 smithi086 ceph-mon[35163]: pgmap v8977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:03.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15483.077513 secs 2024-03-28T10:18:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:03 smithi055 ceph-mon[31863]: pgmap v8977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15483.077513 secs 2024-03-28T10:18:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:03 smithi159 ceph-mon[36109]: pgmap v8977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15483.077513 secs 2024-03-28T10:18:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:05 smithi055 ceph-mon[31863]: pgmap v8978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:05 smithi086 ceph-mon[35163]: pgmap v8978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:05 smithi159 ceph-mon[36109]: pgmap v8978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:07.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:07 smithi159 ceph-mon[36109]: pgmap v8979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:07 smithi055 ceph-mon[31863]: pgmap v8979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:07 smithi086 ceph-mon[35163]: pgmap v8979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15488.077634 secs 2024-03-28T10:18:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15488.077634 secs 2024-03-28T10:18:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15488.077634 secs 2024-03-28T10:18:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:09 smithi086 ceph-mon[35163]: pgmap v8980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:09 smithi159 ceph-mon[36109]: pgmap v8980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:09 smithi055 ceph-mon[31863]: pgmap v8980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:11 smithi086 ceph-mon[35163]: pgmap v8981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:11 smithi159 ceph-mon[36109]: pgmap v8981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:11 smithi055 ceph-mon[31863]: pgmap v8981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:13 smithi086 ceph-mon[35163]: pgmap v8982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15493.077710 secs 2024-03-28T10:18:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:13 smithi159 ceph-mon[36109]: pgmap v8982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15493.077710 secs 2024-03-28T10:18:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:13 smithi055 ceph-mon[31863]: pgmap v8982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15493.077710 secs 2024-03-28T10:18:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:15 smithi086 ceph-mon[35163]: pgmap v8983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:15 smithi159 ceph-mon[36109]: pgmap v8983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:15 smithi055 ceph-mon[31863]: pgmap v8983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:17 smithi086 ceph-mon[35163]: pgmap v8984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:17 smithi159 ceph-mon[36109]: pgmap v8984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:17 smithi055 ceph-mon[31863]: pgmap v8984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15498.077826 secs 2024-03-28T10:18:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15498.077826 secs 2024-03-28T10:18:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15498.077826 secs 2024-03-28T10:18:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:19 smithi086 ceph-mon[35163]: pgmap v8985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:19 smithi159 ceph-mon[36109]: pgmap v8985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:19 smithi055 ceph-mon[31863]: pgmap v8985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:21 smithi086 ceph-mon[35163]: pgmap v8986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:21 smithi159 ceph-mon[36109]: pgmap v8986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:21 smithi055 ceph-mon[31863]: pgmap v8986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:23 smithi086 ceph-mon[35163]: pgmap v8987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15503.077904 secs 2024-03-28T10:18:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:23 smithi159 ceph-mon[36109]: pgmap v8987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15503.077904 secs 2024-03-28T10:18:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:23 smithi055 ceph-mon[31863]: pgmap v8987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15503.077904 secs 2024-03-28T10:18:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:25 smithi086 ceph-mon[35163]: pgmap v8988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:25 smithi159 ceph-mon[36109]: pgmap v8988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:25 smithi055 ceph-mon[31863]: pgmap v8988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:27 smithi086 ceph-mon[35163]: pgmap v8989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:27 smithi159 ceph-mon[36109]: pgmap v8989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:27 smithi055 ceph-mon[31863]: pgmap v8989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15508.078024 secs 2024-03-28T10:18:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15508.078024 secs 2024-03-28T10:18:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15508.078024 secs 2024-03-28T10:18:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:29 smithi086 ceph-mon[35163]: pgmap v8990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:29 smithi159 ceph-mon[36109]: pgmap v8990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:29 smithi055 ceph-mon[31863]: pgmap v8990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:30 smithi086 ceph-mon[35163]: pgmap v8991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:30 smithi159 ceph-mon[36109]: pgmap v8991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:30 smithi055 ceph-mon[31863]: pgmap v8991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:32 smithi055 ceph-mon[31863]: pgmap v8992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:18:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15513.078152 secs 2024-03-28T10:18:33.270 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:32 smithi086 ceph-mon[35163]: pgmap v8992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:33.270 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:18:33.270 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15513.078152 secs 2024-03-28T10:18:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:32 smithi159 ceph-mon[36109]: pgmap v8992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:18:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15513.078152 secs 2024-03-28T10:18:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:18:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:18:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:18:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:18:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:18:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:18:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:18:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:18:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:18:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:34 smithi055 ceph-mon[31863]: pgmap v8993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:34 smithi055 ceph-mon[31863]: pgmap v8994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:34 smithi086 ceph-mon[35163]: pgmap v8993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:34 smithi086 ceph-mon[35163]: pgmap v8994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:34 smithi159 ceph-mon[36109]: pgmap v8993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:34 smithi159 ceph-mon[36109]: pgmap v8994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:36 smithi086 ceph-mon[35163]: pgmap v8995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:36 smithi159 ceph-mon[36109]: pgmap v8995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:36 smithi055 ceph-mon[31863]: pgmap v8995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15518.078209 secs 2024-03-28T10:18:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15518.078209 secs 2024-03-28T10:18:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15518.078209 secs 2024-03-28T10:18:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:38 smithi086 ceph-mon[35163]: pgmap v8996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:18:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:38 smithi159 ceph-mon[36109]: pgmap v8996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:18:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:38 smithi055 ceph-mon[31863]: pgmap v8996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:18:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:40 smithi086 ceph-mon[35163]: pgmap v8997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:40 smithi159 ceph-mon[36109]: pgmap v8997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:40 smithi055 ceph-mon[31863]: pgmap v8997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:42 smithi086 ceph-mon[35163]: pgmap v8998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15523.078328 secs 2024-03-28T10:18:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:42 smithi159 ceph-mon[36109]: pgmap v8998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15523.078328 secs 2024-03-28T10:18:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:42 smithi055 ceph-mon[31863]: pgmap v8998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:18:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15523.078328 secs 2024-03-28T10:18:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:44 smithi086 ceph-mon[35163]: pgmap v8999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:44 smithi159 ceph-mon[36109]: pgmap v8999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:44 smithi055 ceph-mon[31863]: pgmap v8999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:18:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:46 smithi086 ceph-mon[35163]: pgmap v9000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:46 smithi159 ceph-mon[36109]: pgmap v9000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:47.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:46 smithi055 ceph-mon[31863]: pgmap v9000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15528.078449 secs 2024-03-28T10:18:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15528.078449 secs 2024-03-28T10:18:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15528.078449 secs 2024-03-28T10:18:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:48 smithi086 ceph-mon[35163]: pgmap v9001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:48 smithi159 ceph-mon[36109]: pgmap v9001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:48 smithi055 ceph-mon[31863]: pgmap v9001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:50 smithi086 ceph-mon[35163]: pgmap v9002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:50 smithi159 ceph-mon[36109]: pgmap v9002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:50 smithi055 ceph-mon[31863]: pgmap v9002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:52 smithi086 ceph-mon[35163]: pgmap v9003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15533.078524 secs 2024-03-28T10:18:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:52 smithi159 ceph-mon[36109]: pgmap v9003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15533.078524 secs 2024-03-28T10:18:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:52 smithi055 ceph-mon[31863]: pgmap v9003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15533.078524 secs 2024-03-28T10:18:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:54 smithi086 ceph-mon[35163]: pgmap v9004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:54 smithi159 ceph-mon[36109]: pgmap v9004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:54 smithi055 ceph-mon[31863]: pgmap v9004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:18:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:56 smithi086 ceph-mon[35163]: pgmap v9005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:56 smithi159 ceph-mon[36109]: pgmap v9005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:56 smithi055 ceph-mon[31863]: pgmap v9005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:18:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15538.078609 secs 2024-03-28T10:18:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15538.078609 secs 2024-03-28T10:18:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15538.078609 secs 2024-03-28T10:18:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:18:58 smithi086 ceph-mon[35163]: pgmap v9006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:18:58 smithi159 ceph-mon[36109]: pgmap v9006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:18:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:18:58 smithi055 ceph-mon[31863]: pgmap v9006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:00 smithi086 ceph-mon[35163]: pgmap v9007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:00 smithi159 ceph-mon[36109]: pgmap v9007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:00 smithi055 ceph-mon[31863]: pgmap v9007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:03 smithi086 ceph-mon[35163]: pgmap v9008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15543.078727 secs 2024-03-28T10:19:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:03 smithi159 ceph-mon[36109]: pgmap v9008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15543.078727 secs 2024-03-28T10:19:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:02 smithi055 ceph-mon[31863]: pgmap v9008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15543.078727 secs 2024-03-28T10:19:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:05 smithi086 ceph-mon[35163]: pgmap v9009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:05 smithi159 ceph-mon[36109]: pgmap v9009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:05 smithi055 ceph-mon[31863]: pgmap v9009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:07 smithi086 ceph-mon[35163]: pgmap v9010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:07 smithi159 ceph-mon[36109]: pgmap v9010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:07 smithi055 ceph-mon[31863]: pgmap v9010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15548.078855 secs 2024-03-28T10:19:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15548.078855 secs 2024-03-28T10:19:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15548.078855 secs 2024-03-28T10:19:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:09 smithi086 ceph-mon[35163]: pgmap v9011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:09 smithi159 ceph-mon[36109]: pgmap v9011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:09 smithi055 ceph-mon[31863]: pgmap v9011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:11 smithi086 ceph-mon[35163]: pgmap v9012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:11 smithi159 ceph-mon[36109]: pgmap v9012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:11 smithi055 ceph-mon[31863]: pgmap v9012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:13 smithi086 ceph-mon[35163]: pgmap v9013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15553.078924 secs 2024-03-28T10:19:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:13 smithi159 ceph-mon[36109]: pgmap v9013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15553.078924 secs 2024-03-28T10:19:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:13 smithi055 ceph-mon[31863]: pgmap v9013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15553.078924 secs 2024-03-28T10:19:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:15 smithi086 ceph-mon[35163]: pgmap v9014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:15 smithi159 ceph-mon[36109]: pgmap v9014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:15 smithi055 ceph-mon[31863]: pgmap v9014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:17 smithi086 ceph-mon[35163]: pgmap v9015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:17 smithi159 ceph-mon[36109]: pgmap v9015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:17.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:17 smithi055 ceph-mon[31863]: pgmap v9015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15558.079018 secs 2024-03-28T10:19:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15558.079018 secs 2024-03-28T10:19:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15558.079018 secs 2024-03-28T10:19:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:19 smithi055 ceph-mon[31863]: pgmap v9016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:19 smithi086 ceph-mon[35163]: pgmap v9016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:19 smithi159 ceph-mon[36109]: pgmap v9016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:21 smithi055 ceph-mon[31863]: pgmap v9017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:21 smithi086 ceph-mon[35163]: pgmap v9017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:21 smithi159 ceph-mon[36109]: pgmap v9017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:23 smithi055 ceph-mon[31863]: pgmap v9018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15563.079101 secs 2024-03-28T10:19:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:23 smithi086 ceph-mon[35163]: pgmap v9018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15563.079101 secs 2024-03-28T10:19:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:23 smithi159 ceph-mon[36109]: pgmap v9018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15563.079101 secs 2024-03-28T10:19:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:25 smithi055 ceph-mon[31863]: pgmap v9019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:25 smithi086 ceph-mon[35163]: pgmap v9019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:25 smithi159 ceph-mon[36109]: pgmap v9019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:27 smithi055 ceph-mon[31863]: pgmap v9020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:27 smithi086 ceph-mon[35163]: pgmap v9020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:27 smithi159 ceph-mon[36109]: pgmap v9020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15568.079165 secs 2024-03-28T10:19:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15568.079165 secs 2024-03-28T10:19:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15568.079165 secs 2024-03-28T10:19:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:29 smithi086 ceph-mon[35163]: pgmap v9021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:29 smithi159 ceph-mon[36109]: pgmap v9021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:29 smithi055 ceph-mon[31863]: pgmap v9021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:31 smithi086 ceph-mon[35163]: pgmap v9022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:31 smithi159 ceph-mon[36109]: pgmap v9022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:31 smithi055 ceph-mon[31863]: pgmap v9022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:33 smithi086 ceph-mon[35163]: pgmap v9023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15573.079286 secs 2024-03-28T10:19:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:33 smithi159 ceph-mon[36109]: pgmap v9023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15573.079286 secs 2024-03-28T10:19:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:33 smithi055 ceph-mon[31863]: pgmap v9023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15573.079286 secs 2024-03-28T10:19:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:34 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:19:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:34 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:19:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:34 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:19:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:35 smithi086 ceph-mon[35163]: pgmap v9024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:35 smithi159 ceph-mon[36109]: pgmap v9024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:35 smithi055 ceph-mon[31863]: pgmap v9024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:19:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:19:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:19:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:19:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:19:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:19:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:19:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:19:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:19:37.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:37 smithi159 ceph-mon[36109]: pgmap v9025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:37.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:37 smithi159 ceph-mon[36109]: pgmap v9026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:37 smithi086 ceph-mon[35163]: pgmap v9025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:37 smithi086 ceph-mon[35163]: pgmap v9026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:37 smithi055 ceph-mon[31863]: pgmap v9025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:19:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:37 smithi055 ceph-mon[31863]: pgmap v9026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15578.079350 secs 2024-03-28T10:19:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15578.079350 secs 2024-03-28T10:19:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15578.079350 secs 2024-03-28T10:19:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:39 smithi086 ceph-mon[35163]: pgmap v9027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:39 smithi159 ceph-mon[36109]: pgmap v9027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:39 smithi055 ceph-mon[31863]: pgmap v9027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:41 smithi086 ceph-mon[35163]: pgmap v9028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:41 smithi159 ceph-mon[36109]: pgmap v9028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:41 smithi055 ceph-mon[31863]: pgmap v9028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:43 smithi086 ceph-mon[35163]: pgmap v9029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15583.079415 secs 2024-03-28T10:19:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:43 smithi159 ceph-mon[36109]: pgmap v9029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15583.079415 secs 2024-03-28T10:19:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:43 smithi055 ceph-mon[31863]: pgmap v9029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15583.079415 secs 2024-03-28T10:19:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:45 smithi086 ceph-mon[35163]: pgmap v9030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:45 smithi159 ceph-mon[36109]: pgmap v9030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:45 smithi055 ceph-mon[31863]: pgmap v9030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:19:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:47 smithi086 ceph-mon[35163]: pgmap v9031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:47 smithi159 ceph-mon[36109]: pgmap v9031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:47 smithi055 ceph-mon[31863]: pgmap v9031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15588.079482 secs 2024-03-28T10:19:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15588.079482 secs 2024-03-28T10:19:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15588.079482 secs 2024-03-28T10:19:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:49 smithi086 ceph-mon[35163]: pgmap v9032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:49 smithi159 ceph-mon[36109]: pgmap v9032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:49 smithi055 ceph-mon[31863]: pgmap v9032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:19:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:50 smithi086 ceph-mon[35163]: pgmap v9033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:50 smithi159 ceph-mon[36109]: pgmap v9033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:50 smithi055 ceph-mon[31863]: pgmap v9033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:52 smithi086 ceph-mon[35163]: pgmap v9034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:52 smithi159 ceph-mon[36109]: pgmap v9034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:52 smithi055 ceph-mon[31863]: pgmap v9034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:19:53.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15593.079606 secs 2024-03-28T10:19:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15593.079606 secs 2024-03-28T10:19:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15593.079606 secs 2024-03-28T10:19:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:54 smithi086 ceph-mon[35163]: pgmap v9035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:54 smithi159 ceph-mon[36109]: pgmap v9035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:54 smithi055 ceph-mon[31863]: pgmap v9035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:56 smithi086 ceph-mon[35163]: pgmap v9036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:56 smithi159 ceph-mon[36109]: pgmap v9036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:56.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:56 smithi055 ceph-mon[31863]: pgmap v9036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:19:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:58 smithi086 ceph-mon[35163]: pgmap v9037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:19:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:19:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15598.079688 secs 2024-03-28T10:19:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:58 smithi159 ceph-mon[36109]: pgmap v9037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:19:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:19:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15598.079688 secs 2024-03-28T10:19:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:58 smithi055 ceph-mon[31863]: pgmap v9037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:19:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:19:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15598.079688 secs 2024-03-28T10:20:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:00 smithi086 ceph-mon[35163]: pgmap v9038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:20:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:00 smithi159 ceph-mon[36109]: pgmap v9038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:20:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:00 smithi055 ceph-mon[31863]: pgmap v9038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:20:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:02 smithi086 ceph-mon[35163]: pgmap v9039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:02 smithi159 ceph-mon[36109]: pgmap v9039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:02 smithi055 ceph-mon[31863]: pgmap v9039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15603.079770 secs 2024-03-28T10:20:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15603.079770 secs 2024-03-28T10:20:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15603.079770 secs 2024-03-28T10:20:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:04 smithi086 ceph-mon[35163]: pgmap v9040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:04 smithi159 ceph-mon[36109]: pgmap v9040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:04 smithi055 ceph-mon[31863]: pgmap v9040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:06 smithi086 ceph-mon[35163]: pgmap v9041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:06 smithi159 ceph-mon[36109]: pgmap v9041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:06 smithi055 ceph-mon[31863]: pgmap v9041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:08 smithi086 ceph-mon[35163]: pgmap v9042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15608.079852 secs 2024-03-28T10:20:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:08 smithi159 ceph-mon[36109]: pgmap v9042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15608.079852 secs 2024-03-28T10:20:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:08 smithi055 ceph-mon[31863]: pgmap v9042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15608.079852 secs 2024-03-28T10:20:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:10 smithi086 ceph-mon[35163]: pgmap v9043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:10 smithi159 ceph-mon[36109]: pgmap v9043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:10 smithi055 ceph-mon[31863]: pgmap v9043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:12 smithi086 ceph-mon[35163]: pgmap v9044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:12 smithi159 ceph-mon[36109]: pgmap v9044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:12.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:12 smithi055 ceph-mon[31863]: pgmap v9044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15613.079973 secs 2024-03-28T10:20:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15613.079973 secs 2024-03-28T10:20:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15613.079973 secs 2024-03-28T10:20:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:14 smithi086 ceph-mon[35163]: pgmap v9045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:14 smithi159 ceph-mon[36109]: pgmap v9045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:14 smithi055 ceph-mon[31863]: pgmap v9045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:16 smithi086 ceph-mon[35163]: pgmap v9046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:16 smithi159 ceph-mon[36109]: pgmap v9046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:16 smithi055 ceph-mon[31863]: pgmap v9046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:18 smithi055 ceph-mon[31863]: pgmap v9047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:20:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15618.080092 secs 2024-03-28T10:20:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:18 smithi086 ceph-mon[35163]: pgmap v9047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:20:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15618.080092 secs 2024-03-28T10:20:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:18 smithi159 ceph-mon[36109]: pgmap v9047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:20:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15618.080092 secs 2024-03-28T10:20:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:20 smithi055 ceph-mon[31863]: pgmap v9048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:20 smithi086 ceph-mon[35163]: pgmap v9048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:20 smithi159 ceph-mon[36109]: pgmap v9048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:22 smithi055 ceph-mon[31863]: pgmap v9049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:22 smithi086 ceph-mon[35163]: pgmap v9049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:22 smithi159 ceph-mon[36109]: pgmap v9049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15623.080209 secs 2024-03-28T10:20:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15623.080209 secs 2024-03-28T10:20:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15623.080209 secs 2024-03-28T10:20:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:24 smithi086 ceph-mon[35163]: pgmap v9050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:24 smithi159 ceph-mon[36109]: pgmap v9050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:24 smithi055 ceph-mon[31863]: pgmap v9050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:26 smithi086 ceph-mon[35163]: pgmap v9051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:26 smithi159 ceph-mon[36109]: pgmap v9051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:26 smithi055 ceph-mon[31863]: pgmap v9051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15628.080329 secs 2024-03-28T10:20:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15628.080329 secs 2024-03-28T10:20:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15628.080329 secs 2024-03-28T10:20:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:28 smithi086 ceph-mon[35163]: pgmap v9052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:28 smithi159 ceph-mon[36109]: pgmap v9052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:28 smithi055 ceph-mon[31863]: pgmap v9052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:30 smithi086 ceph-mon[35163]: pgmap v9053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:30 smithi159 ceph-mon[36109]: pgmap v9053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:30 smithi055 ceph-mon[31863]: pgmap v9053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:32 smithi055 ceph-mon[31863]: pgmap v9054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15633.080447 secs 2024-03-28T10:20:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:32 smithi086 ceph-mon[35163]: pgmap v9054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15633.080447 secs 2024-03-28T10:20:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:32 smithi159 ceph-mon[36109]: pgmap v9054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15633.080447 secs 2024-03-28T10:20:35.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:34 smithi086 ceph-mon[35163]: pgmap v9055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:34 smithi055 ceph-mon[31863]: pgmap v9055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:34 smithi159 ceph-mon[36109]: pgmap v9055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:36 smithi055 ceph-mon[31863]: pgmap v9056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:20:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:36 smithi086 ceph-mon[35163]: pgmap v9056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:20:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:36 smithi159 ceph-mon[36109]: pgmap v9056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:20:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:20:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:20:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:20:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: pgmap v9057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: pgmap v9058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:20:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15638.080518 secs 2024-03-28T10:20:38.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:20:38.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:20:38.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: pgmap v9057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:38.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: pgmap v9058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:38.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:20:38.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15638.080518 secs 2024-03-28T10:20:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:20:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:20:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: pgmap v9057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: pgmap v9058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:20:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15638.080518 secs 2024-03-28T10:20:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:40 smithi086 ceph-mon[35163]: pgmap v9059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:40 smithi159 ceph-mon[36109]: pgmap v9059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:40 smithi055 ceph-mon[31863]: pgmap v9059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:42 smithi086 ceph-mon[35163]: pgmap v9060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:42 smithi159 ceph-mon[36109]: pgmap v9060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:42 smithi055 ceph-mon[31863]: pgmap v9060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15643.080638 secs 2024-03-28T10:20:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15643.080638 secs 2024-03-28T10:20:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15643.080638 secs 2024-03-28T10:20:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:44 smithi086 ceph-mon[35163]: pgmap v9061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:44 smithi159 ceph-mon[36109]: pgmap v9061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:44 smithi055 ceph-mon[31863]: pgmap v9061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:20:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:45 smithi086 ceph-mon[35163]: pgmap v9062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:20:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:45 smithi159 ceph-mon[36109]: pgmap v9062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:20:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:45 smithi055 ceph-mon[31863]: pgmap v9062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:20:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:48 smithi086 ceph-mon[35163]: pgmap v9063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15648.080712 secs 2024-03-28T10:20:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:48 smithi159 ceph-mon[36109]: pgmap v9063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15648.080712 secs 2024-03-28T10:20:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:48 smithi055 ceph-mon[31863]: pgmap v9063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:20:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15648.080712 secs 2024-03-28T10:20:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:50 smithi086 ceph-mon[35163]: pgmap v9064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:50 smithi159 ceph-mon[36109]: pgmap v9064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:50 smithi055 ceph-mon[31863]: pgmap v9064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:52 smithi086 ceph-mon[35163]: pgmap v9065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:52 smithi159 ceph-mon[36109]: pgmap v9065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:52 smithi055 ceph-mon[31863]: pgmap v9065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:53.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15653.080827 secs 2024-03-28T10:20:53.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:53 smithi055 ceph-mon[31863]: pgmap v9066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15653.080827 secs 2024-03-28T10:20:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:53 smithi086 ceph-mon[35163]: pgmap v9066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15653.080827 secs 2024-03-28T10:20:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:53 smithi159 ceph-mon[36109]: pgmap v9066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:56 smithi086 ceph-mon[35163]: pgmap v9067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:56 smithi159 ceph-mon[36109]: pgmap v9067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:56 smithi055 ceph-mon[31863]: pgmap v9067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:20:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:58 smithi086 ceph-mon[35163]: pgmap v9068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15658.080918 secs 2024-03-28T10:20:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:58 smithi159 ceph-mon[36109]: pgmap v9068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15658.080918 secs 2024-03-28T10:20:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:58 smithi055 ceph-mon[31863]: pgmap v9068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15658.080918 secs 2024-03-28T10:20:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:20:59 smithi086 ceph-mon[35163]: pgmap v9069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:20:59 smithi159 ceph-mon[36109]: pgmap v9069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:20:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:20:59 smithi055 ceph-mon[31863]: pgmap v9069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:02 smithi086 ceph-mon[35163]: pgmap v9070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:02 smithi159 ceph-mon[36109]: pgmap v9070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:02 smithi055 ceph-mon[31863]: pgmap v9070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15663.080996 secs 2024-03-28T10:21:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15663.080996 secs 2024-03-28T10:21:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15663.080996 secs 2024-03-28T10:21:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:04 smithi086 ceph-mon[35163]: pgmap v9071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:04 smithi159 ceph-mon[36109]: pgmap v9071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:04 smithi055 ceph-mon[31863]: pgmap v9071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:05 smithi086 ceph-mon[35163]: pgmap v9072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:05 smithi159 ceph-mon[36109]: pgmap v9072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:05 smithi055 ceph-mon[31863]: pgmap v9072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:08 smithi086 ceph-mon[35163]: pgmap v9073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15668.081088 secs 2024-03-28T10:21:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:08 smithi159 ceph-mon[36109]: pgmap v9073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15668.081088 secs 2024-03-28T10:21:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:08 smithi055 ceph-mon[31863]: pgmap v9073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:08.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15668.081088 secs 2024-03-28T10:21:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:09 smithi086 ceph-mon[35163]: pgmap v9074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:09 smithi159 ceph-mon[36109]: pgmap v9074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:09 smithi055 ceph-mon[31863]: pgmap v9074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:12 smithi086 ceph-mon[35163]: pgmap v9075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:12 smithi159 ceph-mon[36109]: pgmap v9075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:12 smithi055 ceph-mon[31863]: pgmap v9075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15673.081170 secs 2024-03-28T10:21:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15673.081170 secs 2024-03-28T10:21:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15673.081170 secs 2024-03-28T10:21:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:14 smithi086 ceph-mon[35163]: pgmap v9076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:14 smithi159 ceph-mon[36109]: pgmap v9076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:14 smithi055 ceph-mon[31863]: pgmap v9076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:15 smithi086 ceph-mon[35163]: pgmap v9077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:15 smithi159 ceph-mon[36109]: pgmap v9077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:15 smithi055 ceph-mon[31863]: pgmap v9077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:18 smithi086 ceph-mon[35163]: pgmap v9078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15678.081257 secs 2024-03-28T10:21:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:18 smithi159 ceph-mon[36109]: pgmap v9078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15678.081257 secs 2024-03-28T10:21:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:18 smithi055 ceph-mon[31863]: pgmap v9078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15678.081257 secs 2024-03-28T10:21:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:19 smithi086 ceph-mon[35163]: pgmap v9079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:19 smithi159 ceph-mon[36109]: pgmap v9079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:19 smithi055 ceph-mon[31863]: pgmap v9079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:22 smithi086 ceph-mon[35163]: pgmap v9080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:22 smithi159 ceph-mon[36109]: pgmap v9080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:22 smithi055 ceph-mon[31863]: pgmap v9080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:23.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15683.081373 secs 2024-03-28T10:21:23.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:23 smithi055 ceph-mon[31863]: pgmap v9081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15683.081373 secs 2024-03-28T10:21:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:23 smithi086 ceph-mon[35163]: pgmap v9081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15683.081373 secs 2024-03-28T10:21:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:23 smithi159 ceph-mon[36109]: pgmap v9081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:26 smithi086 ceph-mon[35163]: pgmap v9082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:26 smithi159 ceph-mon[36109]: pgmap v9082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:26 smithi055 ceph-mon[31863]: pgmap v9082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:27 smithi086 ceph-mon[35163]: pgmap v9083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:27 smithi159 ceph-mon[36109]: pgmap v9083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:27 smithi055 ceph-mon[31863]: pgmap v9083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15688.081498 secs 2024-03-28T10:21:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15688.081498 secs 2024-03-28T10:21:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15688.081498 secs 2024-03-28T10:21:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:29 smithi086 ceph-mon[35163]: pgmap v9084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:29 smithi159 ceph-mon[36109]: pgmap v9084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:29 smithi055 ceph-mon[31863]: pgmap v9084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:32 smithi086 ceph-mon[35163]: pgmap v9085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:32 smithi159 ceph-mon[36109]: pgmap v9085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:32 smithi055 ceph-mon[31863]: pgmap v9085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15693.081561 secs 2024-03-28T10:21:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:33 smithi086 ceph-mon[35163]: pgmap v9086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15693.081561 secs 2024-03-28T10:21:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:33 smithi159 ceph-mon[36109]: pgmap v9086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15693.081561 secs 2024-03-28T10:21:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:33 smithi055 ceph-mon[31863]: pgmap v9086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:35 smithi086 ceph-mon[35163]: pgmap v9087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:35 smithi159 ceph-mon[36109]: pgmap v9087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:35 smithi055 ceph-mon[31863]: pgmap v9087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:37 smithi086 ceph-mon[35163]: pgmap v9088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:37 smithi159 ceph-mon[36109]: pgmap v9088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:37 smithi055 ceph-mon[31863]: pgmap v9088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:21:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15698.081678 secs 2024-03-28T10:21:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:21:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15698.081678 secs 2024-03-28T10:21:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:21:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15698.081678 secs 2024-03-28T10:21:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:21:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:21:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:39 smithi055 ceph-mon[31863]: pgmap v9089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:39 smithi055 ceph-mon[31863]: pgmap v9090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:21:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:21:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:21:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:39 smithi086 ceph-mon[35163]: pgmap v9089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:39 smithi086 ceph-mon[35163]: pgmap v9090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:21:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:21:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:21:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:39 smithi159 ceph-mon[36109]: pgmap v9089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:39 smithi159 ceph-mon[36109]: pgmap v9090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:21:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:42 smithi086 ceph-mon[35163]: pgmap v9091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:42 smithi159 ceph-mon[36109]: pgmap v9091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:42 smithi055 ceph-mon[31863]: pgmap v9091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15703.081822 secs 2024-03-28T10:21:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15703.081822 secs 2024-03-28T10:21:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15703.081822 secs 2024-03-28T10:21:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:44 smithi086 ceph-mon[35163]: pgmap v9092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:44 smithi159 ceph-mon[36109]: pgmap v9092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:44 smithi055 ceph-mon[31863]: pgmap v9092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:46 smithi086 ceph-mon[35163]: pgmap v9093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:46 smithi159 ceph-mon[36109]: pgmap v9093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:46 smithi055 ceph-mon[31863]: pgmap v9093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:48 smithi086 ceph-mon[35163]: pgmap v9094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15708.081851 secs 2024-03-28T10:21:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:48 smithi159 ceph-mon[36109]: pgmap v9094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15708.081851 secs 2024-03-28T10:21:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:48 smithi055 ceph-mon[31863]: pgmap v9094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:21:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15708.081851 secs 2024-03-28T10:21:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:50 smithi055 ceph-mon[31863]: pgmap v9095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:21:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:50 smithi086 ceph-mon[35163]: pgmap v9095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:21:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:50 smithi159 ceph-mon[36109]: pgmap v9095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:21:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:52 smithi055 ceph-mon[31863]: pgmap v9096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:52 smithi086 ceph-mon[35163]: pgmap v9096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:52 smithi159 ceph-mon[36109]: pgmap v9096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:53.321 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15713.081937 secs 2024-03-28T10:21:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15713.081937 secs 2024-03-28T10:21:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15713.081937 secs 2024-03-28T10:21:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:54 smithi055 ceph-mon[31863]: pgmap v9097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:54 smithi086 ceph-mon[35163]: pgmap v9097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:54 smithi159 ceph-mon[36109]: pgmap v9097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:56 smithi055 ceph-mon[31863]: pgmap v9098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:56 smithi086 ceph-mon[35163]: pgmap v9098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:56 smithi159 ceph-mon[36109]: pgmap v9098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:21:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:58 smithi055 ceph-mon[31863]: pgmap v9099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:21:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15718.082042 secs 2024-03-28T10:21:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:58 smithi086 ceph-mon[35163]: pgmap v9099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:21:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15718.082042 secs 2024-03-28T10:21:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:58 smithi159 ceph-mon[36109]: pgmap v9099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:21:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:21:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15718.082042 secs 2024-03-28T10:22:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:00 smithi055 ceph-mon[31863]: pgmap v9100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:00 smithi086 ceph-mon[35163]: pgmap v9100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:00 smithi159 ceph-mon[36109]: pgmap v9100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:02 smithi055 ceph-mon[31863]: pgmap v9101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:02 smithi086 ceph-mon[35163]: pgmap v9101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:02 smithi159 ceph-mon[36109]: pgmap v9101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15723.082128 secs 2024-03-28T10:22:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15723.082128 secs 2024-03-28T10:22:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15723.082128 secs 2024-03-28T10:22:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:04 smithi086 ceph-mon[35163]: pgmap v9102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:04 smithi159 ceph-mon[36109]: pgmap v9102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:04 smithi055 ceph-mon[31863]: pgmap v9102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:06 smithi086 ceph-mon[35163]: pgmap v9103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:06 smithi159 ceph-mon[36109]: pgmap v9103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:06 smithi055 ceph-mon[31863]: pgmap v9103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:08 smithi086 ceph-mon[35163]: pgmap v9104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15728.082254 secs 2024-03-28T10:22:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:08 smithi159 ceph-mon[36109]: pgmap v9104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15728.082254 secs 2024-03-28T10:22:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:08 smithi055 ceph-mon[31863]: pgmap v9104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15728.082254 secs 2024-03-28T10:22:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:10 smithi086 ceph-mon[35163]: pgmap v9105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:10 smithi159 ceph-mon[36109]: pgmap v9105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:10 smithi055 ceph-mon[31863]: pgmap v9105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:12 smithi086 ceph-mon[35163]: pgmap v9106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:12 smithi159 ceph-mon[36109]: pgmap v9106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:12 smithi055 ceph-mon[31863]: pgmap v9106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15733.082373 secs 2024-03-28T10:22:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15733.082373 secs 2024-03-28T10:22:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15733.082373 secs 2024-03-28T10:22:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:14 smithi086 ceph-mon[35163]: pgmap v9107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:14 smithi159 ceph-mon[36109]: pgmap v9107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:14 smithi055 ceph-mon[31863]: pgmap v9107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:16 smithi086 ceph-mon[35163]: pgmap v9108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:16 smithi159 ceph-mon[36109]: pgmap v9108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:16 smithi055 ceph-mon[31863]: pgmap v9108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:18 smithi086 ceph-mon[35163]: pgmap v9109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15738.082438 secs 2024-03-28T10:22:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:18 smithi159 ceph-mon[36109]: pgmap v9109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15738.082438 secs 2024-03-28T10:22:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:18 smithi055 ceph-mon[31863]: pgmap v9109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15738.082438 secs 2024-03-28T10:22:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:20 smithi086 ceph-mon[35163]: pgmap v9110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:20 smithi159 ceph-mon[36109]: pgmap v9110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:20.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:20 smithi055 ceph-mon[31863]: pgmap v9110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:22 smithi086 ceph-mon[35163]: pgmap v9111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:22 smithi159 ceph-mon[36109]: pgmap v9111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:22 smithi055 ceph-mon[31863]: pgmap v9111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:23.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15743.082502 secs 2024-03-28T10:22:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15743.082502 secs 2024-03-28T10:22:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15743.082502 secs 2024-03-28T10:22:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:24 smithi086 ceph-mon[35163]: pgmap v9112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:24 smithi159 ceph-mon[36109]: pgmap v9112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:24 smithi055 ceph-mon[31863]: pgmap v9112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:26 smithi086 ceph-mon[35163]: pgmap v9113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:26 smithi159 ceph-mon[36109]: pgmap v9113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:26 smithi055 ceph-mon[31863]: pgmap v9113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:28 smithi086 ceph-mon[35163]: pgmap v9114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15748.082567 secs 2024-03-28T10:22:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:28 smithi159 ceph-mon[36109]: pgmap v9114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15748.082567 secs 2024-03-28T10:22:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:28 smithi055 ceph-mon[31863]: pgmap v9114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15748.082567 secs 2024-03-28T10:22:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:30 smithi086 ceph-mon[35163]: pgmap v9115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:30 smithi159 ceph-mon[36109]: pgmap v9115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:30 smithi055 ceph-mon[31863]: pgmap v9115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:32 smithi086 ceph-mon[35163]: pgmap v9116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:32 smithi159 ceph-mon[36109]: pgmap v9116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:32 smithi055 ceph-mon[31863]: pgmap v9116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15753.082639 secs 2024-03-28T10:22:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15753.082639 secs 2024-03-28T10:22:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15753.082639 secs 2024-03-28T10:22:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:34 smithi086 ceph-mon[35163]: pgmap v9117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:34 smithi159 ceph-mon[36109]: pgmap v9117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:34 smithi055 ceph-mon[31863]: pgmap v9117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:36 smithi086 ceph-mon[35163]: pgmap v9118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:36 smithi159 ceph-mon[36109]: pgmap v9118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:36 smithi055 ceph-mon[31863]: pgmap v9118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:37 smithi086 ceph-mon[35163]: pgmap v9119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:37 smithi159 ceph-mon[36109]: pgmap v9119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:37 smithi055 ceph-mon[31863]: pgmap v9119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15758.082718 secs 2024-03-28T10:22:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15758.082718 secs 2024-03-28T10:22:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15758.082718 secs 2024-03-28T10:22:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:39 smithi086 ceph-mon[35163]: pgmap v9120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:39 smithi159 ceph-mon[36109]: pgmap v9120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:39 smithi055 ceph-mon[31863]: pgmap v9120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:22:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:22:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:22:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:22:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:22:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:41 smithi159 ceph-mon[36109]: pgmap v9121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:41 smithi159 ceph-mon[36109]: pgmap v9122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:22:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:22:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:22:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:41 smithi055 ceph-mon[31863]: pgmap v9121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:41 smithi055 ceph-mon[31863]: pgmap v9122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:22:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:22:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:22:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:41 smithi086 ceph-mon[35163]: pgmap v9121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:41 smithi086 ceph-mon[35163]: pgmap v9122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:22:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:22:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:42 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15763.082739 secs 2024-03-28T10:22:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:42 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15763.082739 secs 2024-03-28T10:22:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:42 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15763.082739 secs 2024-03-28T10:22:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:43 smithi086 ceph-mon[35163]: pgmap v9123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:22:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:43 smithi159 ceph-mon[36109]: pgmap v9123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:22:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:43 smithi055 ceph-mon[31863]: pgmap v9123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:22:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:45 smithi159 ceph-mon[36109]: pgmap v9124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:45 smithi055 ceph-mon[31863]: pgmap v9124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:45 smithi086 ceph-mon[35163]: pgmap v9124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:47 smithi055 ceph-mon[31863]: pgmap v9125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:47 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15768.082863 secs 2024-03-28T10:22:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:47 smithi086 ceph-mon[35163]: pgmap v9125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:47 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15768.082863 secs 2024-03-28T10:22:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:47 smithi159 ceph-mon[36109]: pgmap v9125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:47 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15768.082863 secs 2024-03-28T10:22:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:49 smithi055 ceph-mon[31863]: pgmap v9126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:49 smithi086 ceph-mon[35163]: pgmap v9126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:49 smithi159 ceph-mon[36109]: pgmap v9126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:51 smithi055 ceph-mon[31863]: pgmap v9127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:22:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:51 smithi086 ceph-mon[35163]: pgmap v9127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:22:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:51 smithi159 ceph-mon[36109]: pgmap v9127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:22:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15773.082947 secs 2024-03-28T10:22:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15773.082947 secs 2024-03-28T10:22:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15773.082947 secs 2024-03-28T10:22:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:53 smithi055 ceph-mon[31863]: pgmap v9128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:53 smithi086 ceph-mon[35163]: pgmap v9128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:53 smithi159 ceph-mon[36109]: pgmap v9128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:22:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:55 smithi055 ceph-mon[31863]: pgmap v9129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:55 smithi086 ceph-mon[35163]: pgmap v9129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:55 smithi159 ceph-mon[36109]: pgmap v9129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:57 smithi055 ceph-mon[31863]: pgmap v9130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15778.083065 secs 2024-03-28T10:22:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:57 smithi086 ceph-mon[35163]: pgmap v9130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15778.083065 secs 2024-03-28T10:22:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:57 smithi159 ceph-mon[36109]: pgmap v9130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:22:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15778.083065 secs 2024-03-28T10:23:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:22:59 smithi086 ceph-mon[35163]: pgmap v9131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:22:59 smithi159 ceph-mon[36109]: pgmap v9131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:22:59 smithi055 ceph-mon[31863]: pgmap v9131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:01 smithi086 ceph-mon[35163]: pgmap v9132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:01 smithi159 ceph-mon[36109]: pgmap v9132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:01 smithi055 ceph-mon[31863]: pgmap v9132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15783.083142 secs 2024-03-28T10:23:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15783.083142 secs 2024-03-28T10:23:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15783.083142 secs 2024-03-28T10:23:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:03 smithi086 ceph-mon[35163]: pgmap v9133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:03 smithi159 ceph-mon[36109]: pgmap v9133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:03 smithi055 ceph-mon[31863]: pgmap v9133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:05 smithi086 ceph-mon[35163]: pgmap v9134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:05 smithi159 ceph-mon[36109]: pgmap v9134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:05 smithi055 ceph-mon[31863]: pgmap v9134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:07 smithi086 ceph-mon[35163]: pgmap v9135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15788.083206 secs 2024-03-28T10:23:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:07 smithi159 ceph-mon[36109]: pgmap v9135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15788.083206 secs 2024-03-28T10:23:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:07 smithi055 ceph-mon[31863]: pgmap v9135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15788.083206 secs 2024-03-28T10:23:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:09 smithi086 ceph-mon[35163]: pgmap v9136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:09 smithi159 ceph-mon[36109]: pgmap v9136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:09 smithi055 ceph-mon[31863]: pgmap v9136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:11 smithi086 ceph-mon[35163]: pgmap v9137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:11 smithi159 ceph-mon[36109]: pgmap v9137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:11 smithi055 ceph-mon[31863]: pgmap v9137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15793.083268 secs 2024-03-28T10:23:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15793.083268 secs 2024-03-28T10:23:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15793.083268 secs 2024-03-28T10:23:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:13 smithi086 ceph-mon[35163]: pgmap v9138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:13 smithi159 ceph-mon[36109]: pgmap v9138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:13 smithi055 ceph-mon[31863]: pgmap v9138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:15 smithi086 ceph-mon[35163]: pgmap v9139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:15 smithi159 ceph-mon[36109]: pgmap v9139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:15 smithi055 ceph-mon[31863]: pgmap v9139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:17 smithi086 ceph-mon[35163]: pgmap v9140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15798.083334 secs 2024-03-28T10:23:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:17 smithi159 ceph-mon[36109]: pgmap v9140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15798.083334 secs 2024-03-28T10:23:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:17 smithi055 ceph-mon[31863]: pgmap v9140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15798.083334 secs 2024-03-28T10:23:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:19 smithi086 ceph-mon[35163]: pgmap v9141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:19 smithi159 ceph-mon[36109]: pgmap v9141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:19 smithi055 ceph-mon[31863]: pgmap v9141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:21 smithi086 ceph-mon[35163]: pgmap v9142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:21 smithi159 ceph-mon[36109]: pgmap v9142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:21 smithi055 ceph-mon[31863]: pgmap v9142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:23.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15803.084067 secs 2024-03-28T10:23:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15803.084067 secs 2024-03-28T10:23:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15803.084067 secs 2024-03-28T10:23:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:23 smithi086 ceph-mon[35163]: pgmap v9143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:23 smithi159 ceph-mon[36109]: pgmap v9143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:23 smithi055 ceph-mon[31863]: pgmap v9143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:26 smithi086 ceph-mon[35163]: pgmap v9144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:26 smithi159 ceph-mon[36109]: pgmap v9144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:26 smithi055 ceph-mon[31863]: pgmap v9144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:28 smithi086 ceph-mon[35163]: pgmap v9145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15808.084146 secs 2024-03-28T10:23:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:28 smithi159 ceph-mon[36109]: pgmap v9145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15808.084146 secs 2024-03-28T10:23:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:28 smithi055 ceph-mon[31863]: pgmap v9145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15808.084146 secs 2024-03-28T10:23:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:30 smithi086 ceph-mon[35163]: pgmap v9146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:30 smithi159 ceph-mon[36109]: pgmap v9146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:30 smithi055 ceph-mon[31863]: pgmap v9146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:32 smithi086 ceph-mon[35163]: pgmap v9147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:32 smithi159 ceph-mon[36109]: pgmap v9147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:32 smithi055 ceph-mon[31863]: pgmap v9147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15813.084235 secs 2024-03-28T10:23:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15813.084235 secs 2024-03-28T10:23:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15813.084235 secs 2024-03-28T10:23:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:34 smithi086 ceph-mon[35163]: pgmap v9148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:34 smithi159 ceph-mon[36109]: pgmap v9148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:34 smithi055 ceph-mon[31863]: pgmap v9148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:36 smithi086 ceph-mon[35163]: pgmap v9149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:36 smithi159 ceph-mon[36109]: pgmap v9149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:36 smithi055 ceph-mon[31863]: pgmap v9149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:38 smithi086 ceph-mon[35163]: pgmap v9150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15818.084323 secs 2024-03-28T10:23:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:38 smithi159 ceph-mon[36109]: pgmap v9150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15818.084323 secs 2024-03-28T10:23:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:38 smithi055 ceph-mon[31863]: pgmap v9150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15818.084323 secs 2024-03-28T10:23:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:40 smithi055 ceph-mon[31863]: pgmap v9151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:40 smithi086 ceph-mon[35163]: pgmap v9151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:40 smithi159 ceph-mon[36109]: pgmap v9151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:42 smithi055 ceph-mon[31863]: pgmap v9152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:23:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:42 smithi086 ceph-mon[35163]: pgmap v9152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:23:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:42 smithi159 ceph-mon[36109]: pgmap v9152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:23:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:23:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:23:43.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15823.084444 secs 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:23:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15823.084444 secs 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:23:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:23:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:23:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:23:43.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15823.084444 secs 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: pgmap v9153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:44 smithi055 ceph-mon[31863]: pgmap v9154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: pgmap v9153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:44 smithi086 ceph-mon[35163]: pgmap v9154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:23:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:23:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:23:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:23:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: pgmap v9153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:23:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:44 smithi159 ceph-mon[36109]: pgmap v9154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:46 smithi055 ceph-mon[31863]: pgmap v9155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:46 smithi086 ceph-mon[35163]: pgmap v9155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:46 smithi159 ceph-mon[36109]: pgmap v9155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:48 smithi055 ceph-mon[31863]: pgmap v9156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15828.084509 secs 2024-03-28T10:23:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:48 smithi086 ceph-mon[35163]: pgmap v9156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15828.084509 secs 2024-03-28T10:23:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:48 smithi159 ceph-mon[36109]: pgmap v9156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15828.084509 secs 2024-03-28T10:23:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:50 smithi086 ceph-mon[35163]: pgmap v9157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:50 smithi159 ceph-mon[36109]: pgmap v9157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:50 smithi055 ceph-mon[31863]: pgmap v9157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:52 smithi086 ceph-mon[35163]: pgmap v9158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:52 smithi159 ceph-mon[36109]: pgmap v9158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:52 smithi055 ceph-mon[31863]: pgmap v9158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:23:53.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15833.084641 secs 2024-03-28T10:23:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15833.084641 secs 2024-03-28T10:23:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15833.084641 secs 2024-03-28T10:23:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:54 smithi086 ceph-mon[35163]: pgmap v9159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:23:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:54 smithi159 ceph-mon[36109]: pgmap v9159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:23:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:54 smithi055 ceph-mon[31863]: pgmap v9159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:23:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:56 smithi086 ceph-mon[35163]: pgmap v9160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:56 smithi159 ceph-mon[36109]: pgmap v9160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:56 smithi055 ceph-mon[31863]: pgmap v9160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:58 smithi086 ceph-mon[35163]: pgmap v9161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:23:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15838.084839 secs 2024-03-28T10:23:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:58 smithi159 ceph-mon[36109]: pgmap v9161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:23:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15838.084839 secs 2024-03-28T10:23:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:58 smithi055 ceph-mon[31863]: pgmap v9161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:23:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:23:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15838.084839 secs 2024-03-28T10:24:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:00 smithi086 ceph-mon[35163]: pgmap v9162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:00 smithi159 ceph-mon[36109]: pgmap v9162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:00 smithi055 ceph-mon[31863]: pgmap v9162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:02 smithi086 ceph-mon[35163]: pgmap v9163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:02 smithi159 ceph-mon[36109]: pgmap v9163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:02 smithi055 ceph-mon[31863]: pgmap v9163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15843.084884 secs 2024-03-28T10:24:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15843.084884 secs 2024-03-28T10:24:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15843.084884 secs 2024-03-28T10:24:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:04 smithi086 ceph-mon[35163]: pgmap v9164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:04 smithi159 ceph-mon[36109]: pgmap v9164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:04 smithi055 ceph-mon[31863]: pgmap v9164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:06 smithi086 ceph-mon[35163]: pgmap v9165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:06 smithi159 ceph-mon[36109]: pgmap v9165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:06 smithi055 ceph-mon[31863]: pgmap v9165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:08 smithi086 ceph-mon[35163]: pgmap v9166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15848.084957 secs 2024-03-28T10:24:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:08 smithi159 ceph-mon[36109]: pgmap v9166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15848.084957 secs 2024-03-28T10:24:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:08 smithi055 ceph-mon[31863]: pgmap v9166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15848.084957 secs 2024-03-28T10:24:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:10 smithi086 ceph-mon[35163]: pgmap v9167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:10 smithi159 ceph-mon[36109]: pgmap v9167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:10 smithi055 ceph-mon[31863]: pgmap v9167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:12 smithi086 ceph-mon[35163]: pgmap v9168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:12 smithi159 ceph-mon[36109]: pgmap v9168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:12 smithi055 ceph-mon[31863]: pgmap v9168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15853.085080 secs 2024-03-28T10:24:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15853.085080 secs 2024-03-28T10:24:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15853.085080 secs 2024-03-28T10:24:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:14 smithi086 ceph-mon[35163]: pgmap v9169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:14 smithi159 ceph-mon[36109]: pgmap v9169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:14 smithi055 ceph-mon[31863]: pgmap v9169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:16 smithi086 ceph-mon[35163]: pgmap v9170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:16 smithi159 ceph-mon[36109]: pgmap v9170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:16 smithi055 ceph-mon[31863]: pgmap v9170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:18 smithi086 ceph-mon[35163]: pgmap v9171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15858.085202 secs 2024-03-28T10:24:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:18 smithi159 ceph-mon[36109]: pgmap v9171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15858.085202 secs 2024-03-28T10:24:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:18 smithi055 ceph-mon[31863]: pgmap v9171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15858.085202 secs 2024-03-28T10:24:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:20 smithi086 ceph-mon[35163]: pgmap v9172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:20 smithi159 ceph-mon[36109]: pgmap v9172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:20 smithi055 ceph-mon[31863]: pgmap v9172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:22 smithi086 ceph-mon[35163]: pgmap v9173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:22 smithi159 ceph-mon[36109]: pgmap v9173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:22 smithi055 ceph-mon[31863]: pgmap v9173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:23.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15863.085324 secs 2024-03-28T10:24:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15863.085324 secs 2024-03-28T10:24:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15863.085324 secs 2024-03-28T10:24:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:24 smithi086 ceph-mon[35163]: pgmap v9174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:24 smithi159 ceph-mon[36109]: pgmap v9174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:24 smithi055 ceph-mon[31863]: pgmap v9174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:26 smithi086 ceph-mon[35163]: pgmap v9175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:26 smithi159 ceph-mon[36109]: pgmap v9175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:26 smithi055 ceph-mon[31863]: pgmap v9175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:28 smithi086 ceph-mon[35163]: pgmap v9176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15868.085444 secs 2024-03-28T10:24:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:28 smithi159 ceph-mon[36109]: pgmap v9176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15868.085444 secs 2024-03-28T10:24:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:28 smithi055 ceph-mon[31863]: pgmap v9176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15868.085444 secs 2024-03-28T10:24:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:30 smithi086 ceph-mon[35163]: pgmap v9177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:30 smithi159 ceph-mon[36109]: pgmap v9177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:30 smithi055 ceph-mon[31863]: pgmap v9177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:31 smithi055 ceph-mon[31863]: pgmap v9178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:31 smithi086 ceph-mon[35163]: pgmap v9178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:31 smithi159 ceph-mon[36109]: pgmap v9178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:33 smithi086 ceph-mon[35163]: pgmap v9179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15873.085578 secs 2024-03-28T10:24:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:33 smithi159 ceph-mon[36109]: pgmap v9179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15873.085578 secs 2024-03-28T10:24:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:33 smithi055 ceph-mon[31863]: pgmap v9179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15873.085578 secs 2024-03-28T10:24:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:35 smithi086 ceph-mon[35163]: pgmap v9180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:35 smithi159 ceph-mon[36109]: pgmap v9180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:36.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:35 smithi055 ceph-mon[31863]: pgmap v9180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:37 smithi086 ceph-mon[35163]: pgmap v9181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:37 smithi159 ceph-mon[36109]: pgmap v9181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:38.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:37 smithi055 ceph-mon[31863]: pgmap v9181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:38.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15878.085660 secs 2024-03-28T10:24:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15878.085660 secs 2024-03-28T10:24:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15878.085660 secs 2024-03-28T10:24:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:39 smithi086 ceph-mon[35163]: pgmap v9182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:39 smithi159 ceph-mon[36109]: pgmap v9182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:40.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:39 smithi055 ceph-mon[31863]: pgmap v9182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:41 smithi086 ceph-mon[35163]: pgmap v9183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:41 smithi159 ceph-mon[36109]: pgmap v9183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:42.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:41 smithi055 ceph-mon[31863]: pgmap v9183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:24:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:43 smithi086 ceph-mon[35163]: pgmap v9184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15883.085822 secs 2024-03-28T10:24:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:24:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:43 smithi159 ceph-mon[36109]: pgmap v9184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15883.085822 secs 2024-03-28T10:24:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:24:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:43 smithi055 ceph-mon[31863]: pgmap v9184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:24:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15883.085822 secs 2024-03-28T10:24:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:24:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:24:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:24:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:24:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:24:45.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:24:45.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:24:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:24:45.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:24:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:45 smithi086 ceph-mon[35163]: pgmap v9185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:45 smithi086 ceph-mon[35163]: pgmap v9186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:45 smithi159 ceph-mon[36109]: pgmap v9185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:45 smithi159 ceph-mon[36109]: pgmap v9186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:45 smithi055 ceph-mon[31863]: pgmap v9185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:45 smithi055 ceph-mon[31863]: pgmap v9186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:47 smithi086 ceph-mon[35163]: pgmap v9187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:47 smithi159 ceph-mon[36109]: pgmap v9187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:47 smithi055 ceph-mon[31863]: pgmap v9187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15888.085911 secs 2024-03-28T10:24:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15888.085911 secs 2024-03-28T10:24:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15888.085911 secs 2024-03-28T10:24:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:49 smithi086 ceph-mon[35163]: pgmap v9188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:49 smithi159 ceph-mon[36109]: pgmap v9188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:49 smithi055 ceph-mon[31863]: pgmap v9188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:51 smithi086 ceph-mon[35163]: pgmap v9189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:51 smithi159 ceph-mon[36109]: pgmap v9189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:51 smithi055 ceph-mon[31863]: pgmap v9189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:53.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15893.085992 secs 2024-03-28T10:24:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15893.085992 secs 2024-03-28T10:24:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15893.085992 secs 2024-03-28T10:24:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:53 smithi086 ceph-mon[35163]: pgmap v9190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:53 smithi159 ceph-mon[36109]: pgmap v9190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:53 smithi055 ceph-mon[31863]: pgmap v9190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:24:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:55 smithi086 ceph-mon[35163]: pgmap v9191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:24:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:55 smithi159 ceph-mon[36109]: pgmap v9191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:24:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:55 smithi055 ceph-mon[31863]: pgmap v9191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:24:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:57 smithi086 ceph-mon[35163]: pgmap v9192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15898.086107 secs 2024-03-28T10:24:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:57 smithi159 ceph-mon[36109]: pgmap v9192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15898.086107 secs 2024-03-28T10:24:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:57 smithi055 ceph-mon[31863]: pgmap v9192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:24:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15898.086107 secs 2024-03-28T10:25:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:24:59 smithi086 ceph-mon[35163]: pgmap v9193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:24:59 smithi159 ceph-mon[36109]: pgmap v9193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:24:59 smithi055 ceph-mon[31863]: pgmap v9193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:01 smithi086 ceph-mon[35163]: pgmap v9194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:01 smithi159 ceph-mon[36109]: pgmap v9194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:01 smithi055 ceph-mon[31863]: pgmap v9194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15903.086135 secs 2024-03-28T10:25:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15903.086135 secs 2024-03-28T10:25:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15903.086135 secs 2024-03-28T10:25:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:04 smithi086 ceph-mon[35163]: pgmap v9195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:04 smithi159 ceph-mon[36109]: pgmap v9195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:04 smithi055 ceph-mon[31863]: pgmap v9195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:06 smithi086 ceph-mon[35163]: pgmap v9196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:06 smithi159 ceph-mon[36109]: pgmap v9196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:06 smithi055 ceph-mon[31863]: pgmap v9196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:08 smithi086 ceph-mon[35163]: pgmap v9197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15908.086211 secs 2024-03-28T10:25:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:08 smithi159 ceph-mon[36109]: pgmap v9197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15908.086211 secs 2024-03-28T10:25:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:08 smithi055 ceph-mon[31863]: pgmap v9197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15908.086211 secs 2024-03-28T10:25:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:10 smithi086 ceph-mon[35163]: pgmap v9198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:10 smithi159 ceph-mon[36109]: pgmap v9198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:10 smithi055 ceph-mon[31863]: pgmap v9198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:12 smithi086 ceph-mon[35163]: pgmap v9199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:12 smithi159 ceph-mon[36109]: pgmap v9199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:12 smithi055 ceph-mon[31863]: pgmap v9199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15913.086291 secs 2024-03-28T10:25:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15913.086291 secs 2024-03-28T10:25:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15913.086291 secs 2024-03-28T10:25:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:14 smithi086 ceph-mon[35163]: pgmap v9200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:14 smithi159 ceph-mon[36109]: pgmap v9200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:14 smithi055 ceph-mon[31863]: pgmap v9200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:16 smithi086 ceph-mon[35163]: pgmap v9201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:16 smithi159 ceph-mon[36109]: pgmap v9201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:16 smithi055 ceph-mon[31863]: pgmap v9201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:18 smithi055 ceph-mon[31863]: pgmap v9202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15918.086370 secs 2024-03-28T10:25:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:18 smithi086 ceph-mon[35163]: pgmap v9202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15918.086370 secs 2024-03-28T10:25:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:18 smithi159 ceph-mon[36109]: pgmap v9202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15918.086370 secs 2024-03-28T10:25:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:20 smithi055 ceph-mon[31863]: pgmap v9203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:20 smithi086 ceph-mon[35163]: pgmap v9203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:20 smithi159 ceph-mon[36109]: pgmap v9203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:22 smithi055 ceph-mon[31863]: pgmap v9204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:22 smithi086 ceph-mon[35163]: pgmap v9204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:22 smithi159 ceph-mon[36109]: pgmap v9204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15923.086411 secs 2024-03-28T10:25:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15923.086411 secs 2024-03-28T10:25:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15923.086411 secs 2024-03-28T10:25:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:24 smithi055 ceph-mon[31863]: pgmap v9205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:24 smithi086 ceph-mon[35163]: pgmap v9205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:24 smithi159 ceph-mon[36109]: pgmap v9205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:26 smithi055 ceph-mon[31863]: pgmap v9206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:26 smithi086 ceph-mon[35163]: pgmap v9206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:26 smithi159 ceph-mon[36109]: pgmap v9206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:28 smithi055 ceph-mon[31863]: pgmap v9207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15928.086502 secs 2024-03-28T10:25:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:28 smithi086 ceph-mon[35163]: pgmap v9207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15928.086502 secs 2024-03-28T10:25:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:28 smithi159 ceph-mon[36109]: pgmap v9207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15928.086502 secs 2024-03-28T10:25:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:30 smithi086 ceph-mon[35163]: pgmap v9208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:30 smithi159 ceph-mon[36109]: pgmap v9208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:30 smithi055 ceph-mon[31863]: pgmap v9208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:32 smithi086 ceph-mon[35163]: pgmap v9209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:32 smithi159 ceph-mon[36109]: pgmap v9209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:32 smithi055 ceph-mon[31863]: pgmap v9209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15933.086534 secs 2024-03-28T10:25:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15933.086534 secs 2024-03-28T10:25:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15933.086534 secs 2024-03-28T10:25:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:34 smithi086 ceph-mon[35163]: pgmap v9210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:34 smithi159 ceph-mon[36109]: pgmap v9210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:34 smithi055 ceph-mon[31863]: pgmap v9210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:36 smithi086 ceph-mon[35163]: pgmap v9211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:36 smithi159 ceph-mon[36109]: pgmap v9211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:36 smithi055 ceph-mon[31863]: pgmap v9211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:38 smithi086 ceph-mon[35163]: pgmap v9212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15938.086654 secs 2024-03-28T10:25:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:38 smithi159 ceph-mon[36109]: pgmap v9212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15938.086654 secs 2024-03-28T10:25:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:38 smithi055 ceph-mon[31863]: pgmap v9212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15938.086654 secs 2024-03-28T10:25:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:40 smithi086 ceph-mon[35163]: pgmap v9213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:40 smithi159 ceph-mon[36109]: pgmap v9213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:40 smithi055 ceph-mon[31863]: pgmap v9213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:42 smithi086 ceph-mon[35163]: pgmap v9214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:42 smithi159 ceph-mon[36109]: pgmap v9214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:42 smithi055 ceph-mon[31863]: pgmap v9214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:25:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15943.086762 secs 2024-03-28T10:25:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15943.086762 secs 2024-03-28T10:25:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15943.086762 secs 2024-03-28T10:25:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:44 smithi086 ceph-mon[35163]: pgmap v9215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:44 smithi159 ceph-mon[36109]: pgmap v9215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:44 smithi055 ceph-mon[31863]: pgmap v9215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:25:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:25:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:25:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:25:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:46 smithi086 ceph-mon[35163]: pgmap v9216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:25:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:25:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:46 smithi159 ceph-mon[36109]: pgmap v9216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:25:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:25:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:46 smithi055 ceph-mon[31863]: pgmap v9216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:25:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:25:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:47 smithi086 ceph-mon[35163]: pgmap v9217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:47 smithi086 ceph-mon[35163]: pgmap v9218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:25:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:47 smithi159 ceph-mon[36109]: pgmap v9217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:47 smithi159 ceph-mon[36109]: pgmap v9218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:25:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:47 smithi055 ceph-mon[31863]: pgmap v9217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:47 smithi055 ceph-mon[31863]: pgmap v9218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:25:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15948.086883 secs 2024-03-28T10:25:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15948.086883 secs 2024-03-28T10:25:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15948.086883 secs 2024-03-28T10:25:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:49 smithi086 ceph-mon[35163]: pgmap v9219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:49 smithi159 ceph-mon[36109]: pgmap v9219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:49 smithi055 ceph-mon[31863]: pgmap v9219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:51 smithi086 ceph-mon[35163]: pgmap v9220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:25:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:51 smithi159 ceph-mon[36109]: pgmap v9220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:25:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:51 smithi055 ceph-mon[31863]: pgmap v9220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:25:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:53 smithi086 ceph-mon[35163]: pgmap v9221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15953.086962 secs 2024-03-28T10:25:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:53 smithi159 ceph-mon[36109]: pgmap v9221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15953.086962 secs 2024-03-28T10:25:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:53 smithi055 ceph-mon[31863]: pgmap v9221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15953.086962 secs 2024-03-28T10:25:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:55 smithi086 ceph-mon[35163]: pgmap v9222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:55 smithi159 ceph-mon[36109]: pgmap v9222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:55 smithi055 ceph-mon[31863]: pgmap v9222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:57 smithi086 ceph-mon[35163]: pgmap v9223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:25:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:57 smithi159 ceph-mon[36109]: pgmap v9223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:25:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:57 smithi055 ceph-mon[31863]: pgmap v9223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:25:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15958.087037 secs 2024-03-28T10:25:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15958.087037 secs 2024-03-28T10:25:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15958.087037 secs 2024-03-28T10:25:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:25:59 smithi086 ceph-mon[35163]: pgmap v9224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:25:59 smithi159 ceph-mon[36109]: pgmap v9224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:25:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:25:59 smithi055 ceph-mon[31863]: pgmap v9224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:01 smithi086 ceph-mon[35163]: pgmap v9225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:01 smithi159 ceph-mon[36109]: pgmap v9225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:01 smithi055 ceph-mon[31863]: pgmap v9225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:03 smithi086 ceph-mon[35163]: pgmap v9226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15963.087113 secs 2024-03-28T10:26:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:03 smithi159 ceph-mon[36109]: pgmap v9226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15963.087113 secs 2024-03-28T10:26:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:03 smithi055 ceph-mon[31863]: pgmap v9226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15963.087113 secs 2024-03-28T10:26:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:05 smithi086 ceph-mon[35163]: pgmap v9227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:05 smithi159 ceph-mon[36109]: pgmap v9227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:05 smithi055 ceph-mon[31863]: pgmap v9227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:07 smithi055 ceph-mon[31863]: pgmap v9228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:07 smithi086 ceph-mon[35163]: pgmap v9228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:07 smithi159 ceph-mon[36109]: pgmap v9228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15968.087234 secs 2024-03-28T10:26:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:08 smithi055 ceph-mon[31863]: pgmap v9229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15968.087234 secs 2024-03-28T10:26:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:08 smithi086 ceph-mon[35163]: pgmap v9229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15968.087234 secs 2024-03-28T10:26:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:08 smithi159 ceph-mon[36109]: pgmap v9229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:11 smithi086 ceph-mon[35163]: pgmap v9230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:26:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:11 smithi159 ceph-mon[36109]: pgmap v9230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:26:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:11 smithi055 ceph-mon[31863]: pgmap v9230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:26:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:13 smithi086 ceph-mon[35163]: pgmap v9231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15973.087317 secs 2024-03-28T10:26:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:13 smithi159 ceph-mon[36109]: pgmap v9231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15973.087317 secs 2024-03-28T10:26:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:13 smithi055 ceph-mon[31863]: pgmap v9231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:26:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15973.087317 secs 2024-03-28T10:26:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:15 smithi086 ceph-mon[35163]: pgmap v9232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:15 smithi159 ceph-mon[36109]: pgmap v9232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:15 smithi055 ceph-mon[31863]: pgmap v9232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:17 smithi086 ceph-mon[35163]: pgmap v9233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:17 smithi159 ceph-mon[36109]: pgmap v9233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:17 smithi055 ceph-mon[31863]: pgmap v9233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15978.087436 secs 2024-03-28T10:26:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15978.087436 secs 2024-03-28T10:26:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15978.087436 secs 2024-03-28T10:26:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:19 smithi055 ceph-mon[31863]: pgmap v9234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:19 smithi086 ceph-mon[35163]: pgmap v9234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:19 smithi159 ceph-mon[36109]: pgmap v9234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:21 smithi055 ceph-mon[31863]: pgmap v9235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:21 smithi086 ceph-mon[35163]: pgmap v9235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:21 smithi159 ceph-mon[36109]: pgmap v9235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:22 smithi055 ceph-mon[31863]: pgmap v9236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:22 smithi086 ceph-mon[35163]: pgmap v9236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:22 smithi159 ceph-mon[36109]: pgmap v9236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15983.087560 secs 2024-03-28T10:26:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15983.087560 secs 2024-03-28T10:26:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15983.087560 secs 2024-03-28T10:26:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:24 smithi055 ceph-mon[31863]: pgmap v9237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:24 smithi086 ceph-mon[35163]: pgmap v9237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:24 smithi159 ceph-mon[36109]: pgmap v9237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:27 smithi086 ceph-mon[35163]: pgmap v9238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:27 smithi159 ceph-mon[36109]: pgmap v9238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:27 smithi055 ceph-mon[31863]: pgmap v9238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15988.087637 secs 2024-03-28T10:26:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15988.087637 secs 2024-03-28T10:26:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15988.087637 secs 2024-03-28T10:26:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:29 smithi086 ceph-mon[35163]: pgmap v9239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:29 smithi159 ceph-mon[36109]: pgmap v9239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:29 smithi055 ceph-mon[31863]: pgmap v9239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:31 smithi159 ceph-mon[36109]: pgmap v9240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:31 smithi055 ceph-mon[31863]: pgmap v9240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:31 smithi086 ceph-mon[35163]: pgmap v9240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:33 smithi055 ceph-mon[31863]: pgmap v9241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15993.087761 secs 2024-03-28T10:26:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:33 smithi086 ceph-mon[35163]: pgmap v9241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15993.087761 secs 2024-03-28T10:26:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:33 smithi159 ceph-mon[36109]: pgmap v9241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15993.087761 secs 2024-03-28T10:26:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:35 smithi055 ceph-mon[31863]: pgmap v9242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:35 smithi086 ceph-mon[35163]: pgmap v9242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:35 smithi159 ceph-mon[36109]: pgmap v9242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:36 smithi055 ceph-mon[31863]: pgmap v9243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:36 smithi086 ceph-mon[35163]: pgmap v9243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:36 smithi159 ceph-mon[36109]: pgmap v9243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:38.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 15998.087923 secs 2024-03-28T10:26:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 15998.087923 secs 2024-03-28T10:26:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 15998.087923 secs 2024-03-28T10:26:39.005 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:38 smithi159 ceph-mon[36109]: pgmap v9244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:38 smithi055 ceph-mon[31863]: pgmap v9244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:38 smithi086 ceph-mon[35163]: pgmap v9244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:41 smithi086 ceph-mon[35163]: pgmap v9245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:41 smithi159 ceph-mon[36109]: pgmap v9245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:41 smithi055 ceph-mon[31863]: pgmap v9245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:43 smithi086 ceph-mon[35163]: pgmap v9246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16003.088039 secs 2024-03-28T10:26:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:43 smithi159 ceph-mon[36109]: pgmap v9246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16003.088039 secs 2024-03-28T10:26:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:43 smithi055 ceph-mon[31863]: pgmap v9246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16003.088039 secs 2024-03-28T10:26:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:45 smithi086 ceph-mon[35163]: pgmap v9247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:45 smithi159 ceph-mon[36109]: pgmap v9247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:45 smithi055 ceph-mon[31863]: pgmap v9247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:47 smithi055 ceph-mon[31863]: pgmap v9248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:26:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:47 smithi086 ceph-mon[35163]: pgmap v9248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:26:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:47 smithi159 ceph-mon[36109]: pgmap v9248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16008.088097 secs 2024-03-28T10:26:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:48 smithi086 ceph-mon[35163]: pgmap v9249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16008.088097 secs 2024-03-28T10:26:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:48 smithi159 ceph-mon[36109]: pgmap v9249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16008.088097 secs 2024-03-28T10:26:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:48 smithi055 ceph-mon[31863]: pgmap v9249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:49 smithi159 ceph-mon[36109]: pgmap v9250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:49 smithi159 ceph-mon[36109]: pgmap v9251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:49 smithi055 ceph-mon[31863]: pgmap v9250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:49 smithi055 ceph-mon[31863]: pgmap v9251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:26:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:26:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:49 smithi086 ceph-mon[35163]: pgmap v9250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:26:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:49 smithi086 ceph-mon[35163]: pgmap v9251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:26:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:51 smithi086 ceph-mon[35163]: pgmap v9252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:51 smithi159 ceph-mon[36109]: pgmap v9252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:51 smithi055 ceph-mon[31863]: pgmap v9252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:53.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16013.088188 secs 2024-03-28T10:26:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16013.088188 secs 2024-03-28T10:26:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16013.088188 secs 2024-03-28T10:26:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:53 smithi086 ceph-mon[35163]: pgmap v9253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:53 smithi159 ceph-mon[36109]: pgmap v9253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:53 smithi055 ceph-mon[31863]: pgmap v9253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:26:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:55 smithi086 ceph-mon[35163]: pgmap v9254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:55 smithi159 ceph-mon[36109]: pgmap v9254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:55 smithi055 ceph-mon[31863]: pgmap v9254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:57 smithi086 ceph-mon[35163]: pgmap v9255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:57 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16018.088270 secs 2024-03-28T10:26:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:57 smithi159 ceph-mon[36109]: pgmap v9255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:57 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16018.088270 secs 2024-03-28T10:26:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:57 smithi055 ceph-mon[31863]: pgmap v9255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:26:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:57 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16018.088270 secs 2024-03-28T10:27:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:26:59 smithi086 ceph-mon[35163]: pgmap v9256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:26:59 smithi159 ceph-mon[36109]: pgmap v9256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:26:59 smithi055 ceph-mon[31863]: pgmap v9256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:01 smithi086 ceph-mon[35163]: pgmap v9257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:01 smithi159 ceph-mon[36109]: pgmap v9257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:01 smithi055 ceph-mon[31863]: pgmap v9257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16023.088356 secs 2024-03-28T10:27:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16023.088356 secs 2024-03-28T10:27:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16023.088356 secs 2024-03-28T10:27:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:04 smithi086 ceph-mon[35163]: pgmap v9258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:04 smithi159 ceph-mon[36109]: pgmap v9258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:04 smithi055 ceph-mon[31863]: pgmap v9258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:06 smithi086 ceph-mon[35163]: pgmap v9259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:06 smithi159 ceph-mon[36109]: pgmap v9259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:06 smithi055 ceph-mon[31863]: pgmap v9259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:08 smithi086 ceph-mon[35163]: pgmap v9260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16028.088476 secs 2024-03-28T10:27:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:08 smithi159 ceph-mon[36109]: pgmap v9260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16028.088476 secs 2024-03-28T10:27:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:08 smithi055 ceph-mon[31863]: pgmap v9260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16028.088476 secs 2024-03-28T10:27:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:10 smithi086 ceph-mon[35163]: pgmap v9261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:10 smithi159 ceph-mon[36109]: pgmap v9261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:10 smithi055 ceph-mon[31863]: pgmap v9261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:12 smithi086 ceph-mon[35163]: pgmap v9262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:12 smithi159 ceph-mon[36109]: pgmap v9262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:12 smithi055 ceph-mon[31863]: pgmap v9262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16033.088539 secs 2024-03-28T10:27:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16033.088539 secs 2024-03-28T10:27:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16033.088539 secs 2024-03-28T10:27:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:14 smithi086 ceph-mon[35163]: pgmap v9263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:14 smithi159 ceph-mon[36109]: pgmap v9263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:14 smithi055 ceph-mon[31863]: pgmap v9263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:16 smithi086 ceph-mon[35163]: pgmap v9264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:16 smithi159 ceph-mon[36109]: pgmap v9264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:16 smithi055 ceph-mon[31863]: pgmap v9264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:18 smithi086 ceph-mon[35163]: pgmap v9265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16038.088661 secs 2024-03-28T10:27:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:18 smithi159 ceph-mon[36109]: pgmap v9265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16038.088661 secs 2024-03-28T10:27:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:18 smithi055 ceph-mon[31863]: pgmap v9265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16038.088661 secs 2024-03-28T10:27:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:20 smithi055 ceph-mon[31863]: pgmap v9266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:20 smithi086 ceph-mon[35163]: pgmap v9266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:20 smithi159 ceph-mon[36109]: pgmap v9266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:22 smithi055 ceph-mon[31863]: pgmap v9267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:22 smithi086 ceph-mon[35163]: pgmap v9267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:22 smithi159 ceph-mon[36109]: pgmap v9267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16043.088806 secs 2024-03-28T10:27:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16043.088806 secs 2024-03-28T10:27:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16043.088806 secs 2024-03-28T10:27:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:24 smithi055 ceph-mon[31863]: pgmap v9268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:24 smithi086 ceph-mon[35163]: pgmap v9268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:24 smithi159 ceph-mon[36109]: pgmap v9268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:26 smithi055 ceph-mon[31863]: pgmap v9269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:27:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:26 smithi086 ceph-mon[35163]: pgmap v9269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:27:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:26 smithi159 ceph-mon[36109]: pgmap v9269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:27:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:28 smithi055 ceph-mon[31863]: pgmap v9270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16048.088870 secs 2024-03-28T10:27:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:28 smithi086 ceph-mon[35163]: pgmap v9270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16048.088870 secs 2024-03-28T10:27:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:28 smithi159 ceph-mon[36109]: pgmap v9270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16048.088870 secs 2024-03-28T10:27:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:30 smithi055 ceph-mon[31863]: pgmap v9271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:30 smithi086 ceph-mon[35163]: pgmap v9271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:30 smithi159 ceph-mon[36109]: pgmap v9271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:32 smithi086 ceph-mon[35163]: pgmap v9272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:32 smithi159 ceph-mon[36109]: pgmap v9272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:32 smithi055 ceph-mon[31863]: pgmap v9272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16053.088963 secs 2024-03-28T10:27:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16053.088963 secs 2024-03-28T10:27:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16053.088963 secs 2024-03-28T10:27:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:34 smithi086 ceph-mon[35163]: pgmap v9273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:34 smithi159 ceph-mon[36109]: pgmap v9273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:34 smithi055 ceph-mon[31863]: pgmap v9273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:27:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:36 smithi086 ceph-mon[35163]: pgmap v9274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:36 smithi159 ceph-mon[36109]: pgmap v9274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:36 smithi055 ceph-mon[31863]: pgmap v9274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:38 smithi086 ceph-mon[35163]: pgmap v9275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16058.089056 secs 2024-03-28T10:27:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:38 smithi159 ceph-mon[36109]: pgmap v9275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16058.089056 secs 2024-03-28T10:27:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:38 smithi055 ceph-mon[31863]: pgmap v9275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16058.089056 secs 2024-03-28T10:27:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:40 smithi086 ceph-mon[35163]: pgmap v9276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:40 smithi159 ceph-mon[36109]: pgmap v9276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:40 smithi055 ceph-mon[31863]: pgmap v9276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:42 smithi086 ceph-mon[35163]: pgmap v9277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:42 smithi159 ceph-mon[36109]: pgmap v9277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:42 smithi055 ceph-mon[31863]: pgmap v9277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16063.089170 secs 2024-03-28T10:27:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16063.089170 secs 2024-03-28T10:27:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16063.089170 secs 2024-03-28T10:27:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:44 smithi086 ceph-mon[35163]: pgmap v9278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:44 smithi159 ceph-mon[36109]: pgmap v9278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:44 smithi055 ceph-mon[31863]: pgmap v9278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:46 smithi086 ceph-mon[35163]: pgmap v9279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:46 smithi159 ceph-mon[36109]: pgmap v9279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:46 smithi055 ceph-mon[31863]: pgmap v9279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:48 smithi086 ceph-mon[35163]: pgmap v9280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16068.089252 secs 2024-03-28T10:27:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:48 smithi159 ceph-mon[36109]: pgmap v9280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16068.089252 secs 2024-03-28T10:27:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:48 smithi055 ceph-mon[31863]: pgmap v9280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16068.089252 secs 2024-03-28T10:27:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:50 smithi086 ceph-mon[35163]: pgmap v9281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:27:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:50 smithi159 ceph-mon[36109]: pgmap v9281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:27:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:50 smithi055 ceph-mon[31863]: pgmap v9281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:27:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:52 smithi086 ceph-mon[35163]: pgmap v9282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:52 smithi159 ceph-mon[36109]: pgmap v9282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:52 smithi055 ceph-mon[31863]: pgmap v9282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16073.089331 secs 2024-03-28T10:27:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16073.089331 secs 2024-03-28T10:27:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16073.089331 secs 2024-03-28T10:27:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:54 smithi055 ceph-mon[31863]: pgmap v9283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:54 smithi086 ceph-mon[35163]: pgmap v9283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:54 smithi159 ceph-mon[36109]: pgmap v9283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:27:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:54.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:55 smithi055 ceph-mon[31863]: pgmap v9284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:55 smithi086 ceph-mon[35163]: pgmap v9284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:55 smithi159 ceph-mon[36109]: pgmap v9284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:56 smithi086 ceph-mon[35163]: pgmap v9285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:56 smithi086 ceph-mon[35163]: pgmap v9286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:27:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:27:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:56 smithi159 ceph-mon[36109]: pgmap v9285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:56 smithi159 ceph-mon[36109]: pgmap v9286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:27:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:27:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:56 smithi055 ceph-mon[31863]: pgmap v9285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:56 smithi055 ceph-mon[31863]: pgmap v9286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:27:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:27:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:58 smithi055 ceph-mon[31863]: pgmap v9287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:27:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16078.089412 secs 2024-03-28T10:27:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:58 smithi086 ceph-mon[35163]: pgmap v9287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:27:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16078.089412 secs 2024-03-28T10:27:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:58 smithi159 ceph-mon[36109]: pgmap v9287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:27:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:27:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16078.089412 secs 2024-03-28T10:28:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:00 smithi055 ceph-mon[31863]: pgmap v9288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:00 smithi086 ceph-mon[35163]: pgmap v9288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:00 smithi159 ceph-mon[36109]: pgmap v9288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:02 smithi086 ceph-mon[35163]: pgmap v9289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:02 smithi159 ceph-mon[36109]: pgmap v9289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:02 smithi055 ceph-mon[31863]: pgmap v9289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16083.089481 secs 2024-03-28T10:28:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16083.089481 secs 2024-03-28T10:28:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16083.089481 secs 2024-03-28T10:28:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:04 smithi086 ceph-mon[35163]: pgmap v9290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:28:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:04 smithi159 ceph-mon[36109]: pgmap v9290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:28:05.082 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:04 smithi055 ceph-mon[31863]: pgmap v9290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:28:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:06 smithi086 ceph-mon[35163]: pgmap v9291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:06 smithi159 ceph-mon[36109]: pgmap v9291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:06 smithi055 ceph-mon[31863]: pgmap v9291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:08 smithi086 ceph-mon[35163]: pgmap v9292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16088.089605 secs 2024-03-28T10:28:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:08 smithi159 ceph-mon[36109]: pgmap v9292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16088.089605 secs 2024-03-28T10:28:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:08 smithi055 ceph-mon[31863]: pgmap v9292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16088.089605 secs 2024-03-28T10:28:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:10 smithi086 ceph-mon[35163]: pgmap v9293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:10 smithi159 ceph-mon[36109]: pgmap v9293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:10 smithi055 ceph-mon[31863]: pgmap v9293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:12 smithi086 ceph-mon[35163]: pgmap v9294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:12 smithi159 ceph-mon[36109]: pgmap v9294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:12 smithi055 ceph-mon[31863]: pgmap v9294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16093.089685 secs 2024-03-28T10:28:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16093.089685 secs 2024-03-28T10:28:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16093.089685 secs 2024-03-28T10:28:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:14 smithi086 ceph-mon[35163]: pgmap v9295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:14 smithi159 ceph-mon[36109]: pgmap v9295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:14 smithi055 ceph-mon[31863]: pgmap v9295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:16 smithi086 ceph-mon[35163]: pgmap v9296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:16 smithi159 ceph-mon[36109]: pgmap v9296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:16 smithi055 ceph-mon[31863]: pgmap v9296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:18 smithi086 ceph-mon[35163]: pgmap v9297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16098.089811 secs 2024-03-28T10:28:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:18 smithi159 ceph-mon[36109]: pgmap v9297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16098.089811 secs 2024-03-28T10:28:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:18 smithi055 ceph-mon[31863]: pgmap v9297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16098.089811 secs 2024-03-28T10:28:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:20 smithi086 ceph-mon[35163]: pgmap v9298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:20 smithi159 ceph-mon[36109]: pgmap v9298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:20 smithi055 ceph-mon[31863]: pgmap v9298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:22 smithi086 ceph-mon[35163]: pgmap v9299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:22 smithi159 ceph-mon[36109]: pgmap v9299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:22 smithi055 ceph-mon[31863]: pgmap v9299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:24.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16103.089883 secs 2024-03-28T10:28:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16103.089883 secs 2024-03-28T10:28:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16103.089883 secs 2024-03-28T10:28:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:25 smithi086 ceph-mon[35163]: pgmap v9300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:25 smithi159 ceph-mon[36109]: pgmap v9300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:25 smithi055 ceph-mon[31863]: pgmap v9300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:27 smithi055 ceph-mon[31863]: pgmap v9301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:27 smithi086 ceph-mon[35163]: pgmap v9301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:27 smithi159 ceph-mon[36109]: pgmap v9301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16108.089955 secs 2024-03-28T10:28:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16108.089955 secs 2024-03-28T10:28:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16108.089955 secs 2024-03-28T10:28:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:29 smithi055 ceph-mon[31863]: pgmap v9302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:29 smithi086 ceph-mon[35163]: pgmap v9302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:29 smithi159 ceph-mon[36109]: pgmap v9302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:31 smithi055 ceph-mon[31863]: pgmap v9303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:31 smithi086 ceph-mon[35163]: pgmap v9303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:31 smithi159 ceph-mon[36109]: pgmap v9303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:33 smithi055 ceph-mon[31863]: pgmap v9304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16113.090024 secs 2024-03-28T10:28:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:33 smithi086 ceph-mon[35163]: pgmap v9304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16113.090024 secs 2024-03-28T10:28:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:33 smithi159 ceph-mon[36109]: pgmap v9304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16113.090024 secs 2024-03-28T10:28:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:35 smithi055 ceph-mon[31863]: pgmap v9305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:35 smithi086 ceph-mon[35163]: pgmap v9305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:35 smithi159 ceph-mon[36109]: pgmap v9305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:37 smithi086 ceph-mon[35163]: pgmap v9306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:37 smithi159 ceph-mon[36109]: pgmap v9306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:37 smithi055 ceph-mon[31863]: pgmap v9306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:38.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16118.090058 secs 2024-03-28T10:28:38.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16118.090058 secs 2024-03-28T10:28:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16118.090058 secs 2024-03-28T10:28:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:39 smithi086 ceph-mon[35163]: pgmap v9307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:39 smithi159 ceph-mon[36109]: pgmap v9307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:39 smithi055 ceph-mon[31863]: pgmap v9307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:41 smithi086 ceph-mon[35163]: pgmap v9308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:41 smithi159 ceph-mon[36109]: pgmap v9308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:41 smithi055 ceph-mon[31863]: pgmap v9308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:43 smithi086 ceph-mon[35163]: pgmap v9309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16123.090147 secs 2024-03-28T10:28:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:43 smithi159 ceph-mon[36109]: pgmap v9309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16123.090147 secs 2024-03-28T10:28:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:43 smithi055 ceph-mon[31863]: pgmap v9309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16123.090147 secs 2024-03-28T10:28:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:45 smithi086 ceph-mon[35163]: pgmap v9310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:45 smithi159 ceph-mon[36109]: pgmap v9310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:45 smithi055 ceph-mon[31863]: pgmap v9310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:47 smithi086 ceph-mon[35163]: pgmap v9311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:47 smithi159 ceph-mon[36109]: pgmap v9311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:47 smithi055 ceph-mon[31863]: pgmap v9311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16128.090268 secs 2024-03-28T10:28:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16128.090268 secs 2024-03-28T10:28:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16128.090268 secs 2024-03-28T10:28:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:49 smithi086 ceph-mon[35163]: pgmap v9312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:49 smithi159 ceph-mon[36109]: pgmap v9312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:49 smithi055 ceph-mon[31863]: pgmap v9312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:51 smithi086 ceph-mon[35163]: pgmap v9313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:51 smithi159 ceph-mon[36109]: pgmap v9313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:51 smithi055 ceph-mon[31863]: pgmap v9313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:53 smithi086 ceph-mon[35163]: pgmap v9314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16133.090347 secs 2024-03-28T10:28:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:53 smithi159 ceph-mon[36109]: pgmap v9314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16133.090347 secs 2024-03-28T10:28:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:53 smithi055 ceph-mon[31863]: pgmap v9314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16133.090347 secs 2024-03-28T10:28:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:55 smithi086 ceph-mon[35163]: pgmap v9315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:55 smithi159 ceph-mon[36109]: pgmap v9315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:55 smithi055 ceph-mon[31863]: pgmap v9315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:28:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:28:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:28:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:28:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:57 smithi086 ceph-mon[35163]: pgmap v9316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:57 smithi159 ceph-mon[36109]: pgmap v9316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:57 smithi055 ceph-mon[31863]: pgmap v9316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:28:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:28:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:28:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: pgmap v9317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: pgmap v9318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:28:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16138.090406 secs 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: pgmap v9317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: pgmap v9318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:28:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16138.090406 secs 2024-03-28T10:28:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: pgmap v9317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: pgmap v9318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:28:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16138.090406 secs 2024-03-28T10:28:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:28:59 smithi086 ceph-mon[35163]: pgmap v9319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:28:59 smithi159 ceph-mon[36109]: pgmap v9319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:28:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:28:59 smithi055 ceph-mon[31863]: pgmap v9319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:01 smithi086 ceph-mon[35163]: pgmap v9320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:01 smithi159 ceph-mon[36109]: pgmap v9320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:01 smithi055 ceph-mon[31863]: pgmap v9320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16143.090526 secs 2024-03-28T10:29:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16143.090526 secs 2024-03-28T10:29:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16143.090526 secs 2024-03-28T10:29:04.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:03 smithi055 ceph-mon[31863]: pgmap v9321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:03 smithi086 ceph-mon[35163]: pgmap v9321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:03 smithi159 ceph-mon[36109]: pgmap v9321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:05 smithi086 ceph-mon[35163]: pgmap v9322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:05 smithi159 ceph-mon[36109]: pgmap v9322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:05 smithi055 ceph-mon[31863]: pgmap v9322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:07 smithi086 ceph-mon[35163]: pgmap v9323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:07 smithi159 ceph-mon[36109]: pgmap v9323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:07 smithi055 ceph-mon[31863]: pgmap v9323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:29:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16148.090649 secs 2024-03-28T10:29:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16148.090649 secs 2024-03-28T10:29:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16148.090649 secs 2024-03-28T10:29:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:09 smithi086 ceph-mon[35163]: pgmap v9324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:09 smithi159 ceph-mon[36109]: pgmap v9324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:09 smithi055 ceph-mon[31863]: pgmap v9324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:11 smithi086 ceph-mon[35163]: pgmap v9325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:11 smithi159 ceph-mon[36109]: pgmap v9325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:11 smithi055 ceph-mon[31863]: pgmap v9325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16153.090725 secs 2024-03-28T10:29:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16153.090725 secs 2024-03-28T10:29:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16153.090725 secs 2024-03-28T10:29:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:13 smithi055 ceph-mon[31863]: pgmap v9326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:13 smithi086 ceph-mon[35163]: pgmap v9326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:13 smithi159 ceph-mon[36109]: pgmap v9326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:15 smithi086 ceph-mon[35163]: pgmap v9327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:15 smithi159 ceph-mon[36109]: pgmap v9327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:15 smithi055 ceph-mon[31863]: pgmap v9327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:17 smithi086 ceph-mon[35163]: pgmap v9328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:17 smithi159 ceph-mon[36109]: pgmap v9328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:17 smithi055 ceph-mon[31863]: pgmap v9328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16158.090857 secs 2024-03-28T10:29:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16158.090857 secs 2024-03-28T10:29:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16158.090857 secs 2024-03-28T10:29:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:19 smithi086 ceph-mon[35163]: pgmap v9329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:19 smithi159 ceph-mon[36109]: pgmap v9329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:19 smithi055 ceph-mon[31863]: pgmap v9329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:21 smithi086 ceph-mon[35163]: pgmap v9330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:21 smithi159 ceph-mon[36109]: pgmap v9330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:21 smithi055 ceph-mon[31863]: pgmap v9330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16163.090935 secs 2024-03-28T10:29:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16163.090935 secs 2024-03-28T10:29:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16163.090935 secs 2024-03-28T10:29:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:24 smithi055 ceph-mon[31863]: pgmap v9331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:24 smithi086 ceph-mon[35163]: pgmap v9331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:24 smithi159 ceph-mon[36109]: pgmap v9331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:25 smithi086 ceph-mon[35163]: pgmap v9332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:25 smithi159 ceph-mon[36109]: pgmap v9332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:25 smithi055 ceph-mon[31863]: pgmap v9332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:27 smithi086 ceph-mon[35163]: pgmap v9333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:27 smithi159 ceph-mon[36109]: pgmap v9333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:27 smithi055 ceph-mon[31863]: pgmap v9333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16168.091002 secs 2024-03-28T10:29:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16168.091002 secs 2024-03-28T10:29:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16168.091002 secs 2024-03-28T10:29:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:29 smithi086 ceph-mon[35163]: pgmap v9334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:29 smithi159 ceph-mon[36109]: pgmap v9334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:29 smithi055 ceph-mon[31863]: pgmap v9334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:31 smithi086 ceph-mon[35163]: pgmap v9335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:31 smithi159 ceph-mon[36109]: pgmap v9335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:31.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:31 smithi055 ceph-mon[31863]: pgmap v9335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16173.091080 secs 2024-03-28T10:29:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16173.091080 secs 2024-03-28T10:29:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16173.091080 secs 2024-03-28T10:29:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:33 smithi055 ceph-mon[31863]: pgmap v9336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:33 smithi086 ceph-mon[35163]: pgmap v9336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:33 smithi159 ceph-mon[36109]: pgmap v9336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:36 smithi086 ceph-mon[35163]: pgmap v9337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:36 smithi159 ceph-mon[36109]: pgmap v9337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:36 smithi055 ceph-mon[31863]: pgmap v9337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:38 smithi086 ceph-mon[35163]: pgmap v9338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16178.091165 secs 2024-03-28T10:29:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:38 smithi159 ceph-mon[36109]: pgmap v9338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16178.091165 secs 2024-03-28T10:29:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:38 smithi055 ceph-mon[31863]: pgmap v9338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16178.091165 secs 2024-03-28T10:29:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:40 smithi086 ceph-mon[35163]: pgmap v9339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:40 smithi159 ceph-mon[36109]: pgmap v9339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:40 smithi055 ceph-mon[31863]: pgmap v9339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:42 smithi086 ceph-mon[35163]: pgmap v9340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:42 smithi159 ceph-mon[36109]: pgmap v9340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:42 smithi055 ceph-mon[31863]: pgmap v9340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16183.091244 secs 2024-03-28T10:29:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16183.091244 secs 2024-03-28T10:29:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16183.091244 secs 2024-03-28T10:29:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:44 smithi086 ceph-mon[35163]: pgmap v9341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:44 smithi159 ceph-mon[36109]: pgmap v9341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:44 smithi055 ceph-mon[31863]: pgmap v9341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:46 smithi086 ceph-mon[35163]: pgmap v9342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:46 smithi159 ceph-mon[36109]: pgmap v9342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:46 smithi055 ceph-mon[31863]: pgmap v9342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:48 smithi086 ceph-mon[35163]: pgmap v9343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16188.091316 secs 2024-03-28T10:29:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:48 smithi159 ceph-mon[36109]: pgmap v9343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16188.091316 secs 2024-03-28T10:29:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:48 smithi055 ceph-mon[31863]: pgmap v9343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16188.091316 secs 2024-03-28T10:29:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:50 smithi086 ceph-mon[35163]: pgmap v9344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:50 smithi159 ceph-mon[36109]: pgmap v9344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:50 smithi055 ceph-mon[31863]: pgmap v9344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:52 smithi086 ceph-mon[35163]: pgmap v9345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:52 smithi159 ceph-mon[36109]: pgmap v9345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:52 smithi055 ceph-mon[31863]: pgmap v9345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16193.091431 secs 2024-03-28T10:29:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16193.091431 secs 2024-03-28T10:29:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16193.091431 secs 2024-03-28T10:29:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:54 smithi086 ceph-mon[35163]: pgmap v9346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:54 smithi159 ceph-mon[36109]: pgmap v9346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:54 smithi055 ceph-mon[31863]: pgmap v9346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:56 smithi086 ceph-mon[35163]: pgmap v9347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:56 smithi159 ceph-mon[36109]: pgmap v9347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:56.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:56 smithi055 ceph-mon[31863]: pgmap v9347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:29:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:58 smithi086 ceph-mon[35163]: pgmap v9348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16198.091498 secs 2024-03-28T10:29:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:29:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:58 smithi159 ceph-mon[36109]: pgmap v9348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16198.091498 secs 2024-03-28T10:29:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:29:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:58 smithi055 ceph-mon[31863]: pgmap v9348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:29:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16198.091498 secs 2024-03-28T10:29:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:29:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:29:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:29:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:59 smithi086 ceph-mon[35163]: pgmap v9349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:59 smithi086 ceph-mon[35163]: pgmap v9350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:29:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:29:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:29:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:29:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:29:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:59 smithi159 ceph-mon[36109]: pgmap v9349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:59 smithi159 ceph-mon[36109]: pgmap v9350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:29:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:29:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:29:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:29:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:29:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:59 smithi055 ceph-mon[31863]: pgmap v9349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:29:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:59 smithi055 ceph-mon[31863]: pgmap v9350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:29:59.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:29:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:30:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:30:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:30:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:30:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:01 smithi086 ceph-mon[35163]: pgmap v9351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:01 smithi159 ceph-mon[36109]: pgmap v9351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:01 smithi055 ceph-mon[31863]: pgmap v9351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16203.091562 secs 2024-03-28T10:30:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16203.091562 secs 2024-03-28T10:30:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16203.091562 secs 2024-03-28T10:30:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:03 smithi055 ceph-mon[31863]: pgmap v9352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:03 smithi086 ceph-mon[35163]: pgmap v9352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:03 smithi159 ceph-mon[36109]: pgmap v9352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:06 smithi055 ceph-mon[31863]: pgmap v9353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:30:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:06 smithi086 ceph-mon[35163]: pgmap v9353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:30:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:06 smithi159 ceph-mon[36109]: pgmap v9353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:30:08.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:08 smithi159 ceph-mon[36109]: pgmap v9354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:08.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16208.091631 secs 2024-03-28T10:30:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:08 smithi055 ceph-mon[31863]: pgmap v9354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16208.091631 secs 2024-03-28T10:30:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:08 smithi086 ceph-mon[35163]: pgmap v9354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:30:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16208.091631 secs 2024-03-28T10:30:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:10 smithi055 ceph-mon[31863]: pgmap v9355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:30:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:10 smithi086 ceph-mon[35163]: pgmap v9355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:30:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:10 smithi159 ceph-mon[36109]: pgmap v9355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:30:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:12 smithi055 ceph-mon[31863]: pgmap v9356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:12 smithi086 ceph-mon[35163]: pgmap v9356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:12 smithi159 ceph-mon[36109]: pgmap v9356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16213.091752 secs 2024-03-28T10:30:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16213.091752 secs 2024-03-28T10:30:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16213.091752 secs 2024-03-28T10:30:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:14 smithi055 ceph-mon[31863]: pgmap v9357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:14 smithi086 ceph-mon[35163]: pgmap v9357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:14 smithi159 ceph-mon[36109]: pgmap v9357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:16 smithi055 ceph-mon[31863]: pgmap v9358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:16 smithi086 ceph-mon[35163]: pgmap v9358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:16 smithi159 ceph-mon[36109]: pgmap v9358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:18 smithi055 ceph-mon[31863]: pgmap v9359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16218.091825 secs 2024-03-28T10:30:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:18 smithi086 ceph-mon[35163]: pgmap v9359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16218.091825 secs 2024-03-28T10:30:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:18 smithi159 ceph-mon[36109]: pgmap v9359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16218.091825 secs 2024-03-28T10:30:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:20 smithi086 ceph-mon[35163]: pgmap v9360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:20 smithi159 ceph-mon[36109]: pgmap v9360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:20.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:20 smithi055 ceph-mon[31863]: pgmap v9360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:21 smithi086 ceph-mon[35163]: pgmap v9361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:21 smithi159 ceph-mon[36109]: pgmap v9361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:21 smithi055 ceph-mon[31863]: pgmap v9361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16223.091943 secs 2024-03-28T10:30:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16223.091943 secs 2024-03-28T10:30:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16223.091943 secs 2024-03-28T10:30:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:23 smithi055 ceph-mon[31863]: pgmap v9362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:23 smithi086 ceph-mon[35163]: pgmap v9362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:23 smithi159 ceph-mon[36109]: pgmap v9362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:26 smithi055 ceph-mon[31863]: pgmap v9363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:26 smithi086 ceph-mon[35163]: pgmap v9363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:26 smithi159 ceph-mon[36109]: pgmap v9363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:28 smithi055 ceph-mon[31863]: pgmap v9364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16228.092067 secs 2024-03-28T10:30:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:28 smithi086 ceph-mon[35163]: pgmap v9364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16228.092067 secs 2024-03-28T10:30:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:28 smithi159 ceph-mon[36109]: pgmap v9364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16228.092067 secs 2024-03-28T10:30:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:30 smithi055 ceph-mon[31863]: pgmap v9365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:30 smithi086 ceph-mon[35163]: pgmap v9365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:30 smithi159 ceph-mon[36109]: pgmap v9365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:32 smithi055 ceph-mon[31863]: pgmap v9366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:32 smithi086 ceph-mon[35163]: pgmap v9366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:32 smithi159 ceph-mon[36109]: pgmap v9366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16233.092200 secs 2024-03-28T10:30:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16233.092200 secs 2024-03-28T10:30:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16233.092200 secs 2024-03-28T10:30:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:34 smithi086 ceph-mon[35163]: pgmap v9367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:34 smithi159 ceph-mon[36109]: pgmap v9367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:34 smithi055 ceph-mon[31863]: pgmap v9367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:35 smithi086 ceph-mon[35163]: pgmap v9368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:35 smithi159 ceph-mon[36109]: pgmap v9368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:35 smithi055 ceph-mon[31863]: pgmap v9368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:38 smithi055 ceph-mon[31863]: pgmap v9369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16238.092267 secs 2024-03-28T10:30:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:38 smithi086 ceph-mon[35163]: pgmap v9369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16238.092267 secs 2024-03-28T10:30:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:38 smithi159 ceph-mon[36109]: pgmap v9369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16238.092267 secs 2024-03-28T10:30:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:40 smithi055 ceph-mon[31863]: pgmap v9370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:40 smithi086 ceph-mon[35163]: pgmap v9370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:40 smithi159 ceph-mon[36109]: pgmap v9370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:42 smithi055 ceph-mon[31863]: pgmap v9371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:42 smithi086 ceph-mon[35163]: pgmap v9371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:42 smithi159 ceph-mon[36109]: pgmap v9371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16243.092292 secs 2024-03-28T10:30:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16243.092292 secs 2024-03-28T10:30:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16243.092292 secs 2024-03-28T10:30:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:44 smithi086 ceph-mon[35163]: pgmap v9372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:44 smithi159 ceph-mon[36109]: pgmap v9372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:44 smithi055 ceph-mon[31863]: pgmap v9372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:45 smithi086 ceph-mon[35163]: pgmap v9373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:45 smithi159 ceph-mon[36109]: pgmap v9373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:45 smithi055 ceph-mon[31863]: pgmap v9373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:48 smithi055 ceph-mon[31863]: pgmap v9374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16248.092412 secs 2024-03-28T10:30:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:48 smithi086 ceph-mon[35163]: pgmap v9374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16248.092412 secs 2024-03-28T10:30:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:48 smithi159 ceph-mon[36109]: pgmap v9374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16248.092412 secs 2024-03-28T10:30:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:50 smithi055 ceph-mon[31863]: pgmap v9375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:50 smithi086 ceph-mon[35163]: pgmap v9375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:50 smithi159 ceph-mon[36109]: pgmap v9375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:52 smithi055 ceph-mon[31863]: pgmap v9376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:52 smithi086 ceph-mon[35163]: pgmap v9376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:52 smithi159 ceph-mon[36109]: pgmap v9376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16253.092485 secs 2024-03-28T10:30:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16253.092485 secs 2024-03-28T10:30:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16253.092485 secs 2024-03-28T10:30:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:54 smithi086 ceph-mon[35163]: pgmap v9377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:54 smithi159 ceph-mon[36109]: pgmap v9377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:54 smithi055 ceph-mon[31863]: pgmap v9377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:56.675 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:56 smithi055 ceph-mon[31863]: pgmap v9378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:56 smithi086 ceph-mon[35163]: pgmap v9378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:56 smithi159 ceph-mon[36109]: pgmap v9378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:30:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:57 smithi086 ceph-mon[35163]: pgmap v9379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:57 smithi159 ceph-mon[36109]: pgmap v9379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:57 smithi055 ceph-mon[31863]: pgmap v9379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16258.092603 secs 2024-03-28T10:30:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16258.092603 secs 2024-03-28T10:30:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16258.092603 secs 2024-03-28T10:30:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:30:59 smithi086 ceph-mon[35163]: pgmap v9380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:30:59 smithi159 ceph-mon[36109]: pgmap v9380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:30:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:30:59 smithi055 ceph-mon[31863]: pgmap v9380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:31:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:31:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:31:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:31:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:31:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:01 smithi086 ceph-mon[35163]: pgmap v9381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:01 smithi086 ceph-mon[35163]: pgmap v9382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:31:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:31:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:31:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:01 smithi159 ceph-mon[36109]: pgmap v9381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:01 smithi159 ceph-mon[36109]: pgmap v9382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:31:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:31:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:31:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:01 smithi055 ceph-mon[31863]: pgmap v9381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:01 smithi055 ceph-mon[31863]: pgmap v9382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:31:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16263.092674 secs 2024-03-28T10:31:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16263.092674 secs 2024-03-28T10:31:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16263.092674 secs 2024-03-28T10:31:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:03 smithi086 ceph-mon[35163]: pgmap v9383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:03 smithi159 ceph-mon[36109]: pgmap v9383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:03 smithi055 ceph-mon[31863]: pgmap v9383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:06 smithi055 ceph-mon[31863]: pgmap v9384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:06 smithi086 ceph-mon[35163]: pgmap v9384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:06 smithi159 ceph-mon[36109]: pgmap v9384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:08.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:08 smithi086 ceph-mon[35163]: pgmap v9385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:08.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16268.092817 secs 2024-03-28T10:31:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:08 smithi055 ceph-mon[31863]: pgmap v9385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16268.092817 secs 2024-03-28T10:31:08.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:08 smithi159 ceph-mon[36109]: pgmap v9385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:08.373 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16268.092817 secs 2024-03-28T10:31:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:10 smithi159 ceph-mon[36109]: pgmap v9386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:10 smithi055 ceph-mon[31863]: pgmap v9386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:10 smithi086 ceph-mon[35163]: pgmap v9386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:12 smithi055 ceph-mon[31863]: pgmap v9387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:31:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:12 smithi086 ceph-mon[35163]: pgmap v9387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:31:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:12 smithi159 ceph-mon[36109]: pgmap v9387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:31:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16273.092938 secs 2024-03-28T10:31:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16273.092938 secs 2024-03-28T10:31:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16273.092938 secs 2024-03-28T10:31:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:14 smithi086 ceph-mon[35163]: pgmap v9388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:14 smithi159 ceph-mon[36109]: pgmap v9388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:14 smithi055 ceph-mon[31863]: pgmap v9388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:16 smithi086 ceph-mon[35163]: pgmap v9389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:16 smithi159 ceph-mon[36109]: pgmap v9389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:16 smithi055 ceph-mon[31863]: pgmap v9389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:18 smithi086 ceph-mon[35163]: pgmap v9390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16278.093058 secs 2024-03-28T10:31:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:18 smithi159 ceph-mon[36109]: pgmap v9390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16278.093058 secs 2024-03-28T10:31:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:18 smithi055 ceph-mon[31863]: pgmap v9390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16278.093058 secs 2024-03-28T10:31:20.415 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:20 smithi159 ceph-mon[36109]: pgmap v9391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:20 smithi086 ceph-mon[35163]: pgmap v9391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:20 smithi055 ceph-mon[31863]: pgmap v9391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:22 smithi086 ceph-mon[35163]: pgmap v9392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:22 smithi159 ceph-mon[36109]: pgmap v9392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:22 smithi055 ceph-mon[31863]: pgmap v9392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16283.093186 secs 2024-03-28T10:31:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16283.093186 secs 2024-03-28T10:31:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16283.093186 secs 2024-03-28T10:31:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:24 smithi086 ceph-mon[35163]: pgmap v9393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:24 smithi159 ceph-mon[36109]: pgmap v9393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:24 smithi055 ceph-mon[31863]: pgmap v9393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:26 smithi086 ceph-mon[35163]: pgmap v9394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:26 smithi159 ceph-mon[36109]: pgmap v9394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:26 smithi055 ceph-mon[31863]: pgmap v9394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:28 smithi086 ceph-mon[35163]: pgmap v9395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16288.093308 secs 2024-03-28T10:31:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:28 smithi159 ceph-mon[36109]: pgmap v9395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16288.093308 secs 2024-03-28T10:31:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:28 smithi055 ceph-mon[31863]: pgmap v9395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16288.093308 secs 2024-03-28T10:31:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:30 smithi086 ceph-mon[35163]: pgmap v9396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:30 smithi159 ceph-mon[36109]: pgmap v9396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:30 smithi055 ceph-mon[31863]: pgmap v9396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:32 smithi086 ceph-mon[35163]: pgmap v9397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:32 smithi159 ceph-mon[36109]: pgmap v9397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:32 smithi055 ceph-mon[31863]: pgmap v9397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16293.093391 secs 2024-03-28T10:31:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16293.093391 secs 2024-03-28T10:31:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16293.093391 secs 2024-03-28T10:31:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:34 smithi086 ceph-mon[35163]: pgmap v9398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:34 smithi159 ceph-mon[36109]: pgmap v9398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:34 smithi055 ceph-mon[31863]: pgmap v9398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:36 smithi086 ceph-mon[35163]: pgmap v9399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:36 smithi159 ceph-mon[36109]: pgmap v9399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:36 smithi055 ceph-mon[31863]: pgmap v9399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:38 smithi086 ceph-mon[35163]: pgmap v9400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16298.093511 secs 2024-03-28T10:31:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:38 smithi159 ceph-mon[36109]: pgmap v9400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16298.093511 secs 2024-03-28T10:31:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:38 smithi055 ceph-mon[31863]: pgmap v9400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16298.093511 secs 2024-03-28T10:31:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:40 smithi086 ceph-mon[35163]: pgmap v9401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:40 smithi159 ceph-mon[36109]: pgmap v9401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:40 smithi055 ceph-mon[31863]: pgmap v9401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:42 smithi086 ceph-mon[35163]: pgmap v9402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:42 smithi159 ceph-mon[36109]: pgmap v9402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:42 smithi055 ceph-mon[31863]: pgmap v9402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16303.093631 secs 2024-03-28T10:31:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16303.093631 secs 2024-03-28T10:31:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16303.093631 secs 2024-03-28T10:31:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:44 smithi086 ceph-mon[35163]: pgmap v9403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:44 smithi159 ceph-mon[36109]: pgmap v9403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:44 smithi055 ceph-mon[31863]: pgmap v9403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:46 smithi086 ceph-mon[35163]: pgmap v9404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:31:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:46 smithi159 ceph-mon[36109]: pgmap v9404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:31:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:46 smithi055 ceph-mon[31863]: pgmap v9404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:31:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:48 smithi086 ceph-mon[35163]: pgmap v9405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16308.093757 secs 2024-03-28T10:31:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:48 smithi159 ceph-mon[36109]: pgmap v9405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16308.093757 secs 2024-03-28T10:31:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:48 smithi055 ceph-mon[31863]: pgmap v9405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16308.093757 secs 2024-03-28T10:31:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:50 smithi086 ceph-mon[35163]: pgmap v9406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:50 smithi159 ceph-mon[36109]: pgmap v9406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:50 smithi055 ceph-mon[31863]: pgmap v9406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:52 smithi055 ceph-mon[31863]: pgmap v9407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:52 smithi086 ceph-mon[35163]: pgmap v9407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:52 smithi159 ceph-mon[36109]: pgmap v9407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:31:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16313.093822 secs 2024-03-28T10:31:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16313.093822 secs 2024-03-28T10:31:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16313.093822 secs 2024-03-28T10:31:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:54 smithi055 ceph-mon[31863]: pgmap v9408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:54 smithi086 ceph-mon[35163]: pgmap v9408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:54 smithi159 ceph-mon[36109]: pgmap v9408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:56 smithi055 ceph-mon[31863]: pgmap v9409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:56 smithi086 ceph-mon[35163]: pgmap v9409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:56 smithi159 ceph-mon[36109]: pgmap v9409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:31:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:58 smithi055 ceph-mon[31863]: pgmap v9410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16318.093919 secs 2024-03-28T10:31:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:58 smithi086 ceph-mon[35163]: pgmap v9410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16318.093919 secs 2024-03-28T10:31:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:58 smithi159 ceph-mon[36109]: pgmap v9410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:31:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16318.093919 secs 2024-03-28T10:32:00.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:00 smithi055 ceph-mon[31863]: pgmap v9411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:00 smithi086 ceph-mon[35163]: pgmap v9411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:00 smithi159 ceph-mon[36109]: pgmap v9411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:02 smithi055 ceph-mon[31863]: pgmap v9412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:32:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:02 smithi086 ceph-mon[35163]: pgmap v9412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:32:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:02 smithi159 ceph-mon[36109]: pgmap v9412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:32:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16323.093998 secs 2024-03-28T10:32:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:32:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:32:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:32:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16323.093998 secs 2024-03-28T10:32:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:32:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:32:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:32:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16323.093998 secs 2024-03-28T10:32:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:32:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:32:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:32:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:04 smithi086 ceph-mon[35163]: pgmap v9413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:04 smithi086 ceph-mon[35163]: pgmap v9414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:04 smithi159 ceph-mon[36109]: pgmap v9413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:04 smithi159 ceph-mon[36109]: pgmap v9414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:04 smithi055 ceph-mon[31863]: pgmap v9413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:04 smithi055 ceph-mon[31863]: pgmap v9414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:06 smithi086 ceph-mon[35163]: pgmap v9415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:06 smithi159 ceph-mon[36109]: pgmap v9415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:06 smithi055 ceph-mon[31863]: pgmap v9415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:07 smithi086 ceph-mon[35163]: pgmap v9416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:07 smithi159 ceph-mon[36109]: pgmap v9416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:07 smithi055 ceph-mon[31863]: pgmap v9416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16328.094080 secs 2024-03-28T10:32:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16328.094080 secs 2024-03-28T10:32:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16328.094080 secs 2024-03-28T10:32:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:09 smithi086 ceph-mon[35163]: pgmap v9417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:09 smithi159 ceph-mon[36109]: pgmap v9417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:09 smithi055 ceph-mon[31863]: pgmap v9417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:11 smithi086 ceph-mon[35163]: pgmap v9418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:11 smithi159 ceph-mon[36109]: pgmap v9418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:11 smithi055 ceph-mon[31863]: pgmap v9418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:32:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16333.094158 secs 2024-03-28T10:32:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16333.094158 secs 2024-03-28T10:32:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16333.094158 secs 2024-03-28T10:32:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:13 smithi086 ceph-mon[35163]: pgmap v9419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:32:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:13 smithi159 ceph-mon[36109]: pgmap v9419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:32:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:13 smithi055 ceph-mon[31863]: pgmap v9419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:32:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:15 smithi086 ceph-mon[35163]: pgmap v9420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:15 smithi159 ceph-mon[36109]: pgmap v9420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:15 smithi055 ceph-mon[31863]: pgmap v9420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:17 smithi086 ceph-mon[35163]: pgmap v9421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16338.094223 secs 2024-03-28T10:32:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:17 smithi159 ceph-mon[36109]: pgmap v9421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16338.094223 secs 2024-03-28T10:32:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:17 smithi055 ceph-mon[31863]: pgmap v9421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16338.094223 secs 2024-03-28T10:32:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:19 smithi086 ceph-mon[35163]: pgmap v9422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:19 smithi159 ceph-mon[36109]: pgmap v9422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:19 smithi055 ceph-mon[31863]: pgmap v9422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:22 smithi086 ceph-mon[35163]: pgmap v9423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:22 smithi159 ceph-mon[36109]: pgmap v9423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:22 smithi055 ceph-mon[31863]: pgmap v9423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16343.094349 secs 2024-03-28T10:32:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16343.094349 secs 2024-03-28T10:32:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16343.094349 secs 2024-03-28T10:32:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:24 smithi086 ceph-mon[35163]: pgmap v9424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:24 smithi159 ceph-mon[36109]: pgmap v9424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:24 smithi055 ceph-mon[31863]: pgmap v9424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:26 smithi086 ceph-mon[35163]: pgmap v9425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:26 smithi159 ceph-mon[36109]: pgmap v9425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:26 smithi055 ceph-mon[31863]: pgmap v9425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:28 smithi086 ceph-mon[35163]: pgmap v9426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16348.094473 secs 2024-03-28T10:32:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:28 smithi159 ceph-mon[36109]: pgmap v9426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16348.094473 secs 2024-03-28T10:32:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:28 smithi055 ceph-mon[31863]: pgmap v9426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16348.094473 secs 2024-03-28T10:32:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:30 smithi086 ceph-mon[35163]: pgmap v9427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:30 smithi159 ceph-mon[36109]: pgmap v9427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:30 smithi055 ceph-mon[31863]: pgmap v9427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:32 smithi086 ceph-mon[35163]: pgmap v9428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:32 smithi159 ceph-mon[36109]: pgmap v9428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:32 smithi055 ceph-mon[31863]: pgmap v9428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16353.094595 secs 2024-03-28T10:32:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16353.094595 secs 2024-03-28T10:32:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16353.094595 secs 2024-03-28T10:32:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:34 smithi086 ceph-mon[35163]: pgmap v9429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:34 smithi159 ceph-mon[36109]: pgmap v9429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:34 smithi055 ceph-mon[31863]: pgmap v9429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:36 smithi086 ceph-mon[35163]: pgmap v9430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:36 smithi159 ceph-mon[36109]: pgmap v9430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:36 smithi055 ceph-mon[31863]: pgmap v9430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:38 smithi086 ceph-mon[35163]: pgmap v9431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16358.094718 secs 2024-03-28T10:32:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:38 smithi159 ceph-mon[36109]: pgmap v9431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16358.094718 secs 2024-03-28T10:32:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:38 smithi055 ceph-mon[31863]: pgmap v9431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16358.094718 secs 2024-03-28T10:32:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:40 smithi086 ceph-mon[35163]: pgmap v9432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:40 smithi159 ceph-mon[36109]: pgmap v9432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:40 smithi055 ceph-mon[31863]: pgmap v9432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:42 smithi086 ceph-mon[35163]: pgmap v9433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:42 smithi159 ceph-mon[36109]: pgmap v9433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:42 smithi055 ceph-mon[31863]: pgmap v9433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16363.094850 secs 2024-03-28T10:32:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16363.094850 secs 2024-03-28T10:32:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16363.094850 secs 2024-03-28T10:32:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:44 smithi055 ceph-mon[31863]: pgmap v9434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:44 smithi086 ceph-mon[35163]: pgmap v9434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:44 smithi159 ceph-mon[36109]: pgmap v9434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:46 smithi055 ceph-mon[31863]: pgmap v9435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:46 smithi086 ceph-mon[35163]: pgmap v9435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:46 smithi159 ceph-mon[36109]: pgmap v9435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:48 smithi055 ceph-mon[31863]: pgmap v9436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16368.094968 secs 2024-03-28T10:32:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:48 smithi086 ceph-mon[35163]: pgmap v9436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16368.094968 secs 2024-03-28T10:32:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:48 smithi159 ceph-mon[36109]: pgmap v9436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16368.094968 secs 2024-03-28T10:32:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:50 smithi055 ceph-mon[31863]: pgmap v9437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:50 smithi086 ceph-mon[35163]: pgmap v9437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:50 smithi159 ceph-mon[36109]: pgmap v9437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:52 smithi055 ceph-mon[31863]: pgmap v9438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:52 smithi086 ceph-mon[35163]: pgmap v9438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:52 smithi159 ceph-mon[36109]: pgmap v9438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16373.095056 secs 2024-03-28T10:32:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16373.095056 secs 2024-03-28T10:32:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16373.095056 secs 2024-03-28T10:32:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:54 smithi055 ceph-mon[31863]: pgmap v9439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:54 smithi086 ceph-mon[35163]: pgmap v9439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:54 smithi159 ceph-mon[36109]: pgmap v9439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:56 smithi086 ceph-mon[35163]: pgmap v9440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:56 smithi159 ceph-mon[36109]: pgmap v9440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:56.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:56 smithi055 ceph-mon[31863]: pgmap v9440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:32:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:58 smithi086 ceph-mon[35163]: pgmap v9441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:32:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16378.095148 secs 2024-03-28T10:32:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:58 smithi159 ceph-mon[36109]: pgmap v9441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:32:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16378.095148 secs 2024-03-28T10:32:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:58 smithi055 ceph-mon[31863]: pgmap v9441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:32:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:32:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16378.095148 secs 2024-03-28T10:33:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:00 smithi086 ceph-mon[35163]: pgmap v9442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:00 smithi159 ceph-mon[36109]: pgmap v9442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:00 smithi055 ceph-mon[31863]: pgmap v9442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:02 smithi086 ceph-mon[35163]: pgmap v9443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:02 smithi159 ceph-mon[36109]: pgmap v9443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:02 smithi055 ceph-mon[31863]: pgmap v9443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16383.095270 secs 2024-03-28T10:33:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:33:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16383.095270 secs 2024-03-28T10:33:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:33:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16383.095270 secs 2024-03-28T10:33:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:33:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:04 smithi086 ceph-mon[35163]: pgmap v9444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:04 smithi159 ceph-mon[36109]: pgmap v9444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:04 smithi055 ceph-mon[31863]: pgmap v9444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:33:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:33:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:05 smithi086 ceph-mon[35163]: pgmap v9445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:05 smithi086 ceph-mon[35163]: pgmap v9446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:33:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:33:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:33:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:05 smithi159 ceph-mon[36109]: pgmap v9445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:05 smithi159 ceph-mon[36109]: pgmap v9446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:05.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:33:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:33:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:33:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:05 smithi055 ceph-mon[31863]: pgmap v9445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:05 smithi055 ceph-mon[31863]: pgmap v9446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:33:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:07 smithi086 ceph-mon[35163]: pgmap v9447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:07 smithi159 ceph-mon[36109]: pgmap v9447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:07 smithi055 ceph-mon[31863]: pgmap v9447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16388.095333 secs 2024-03-28T10:33:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16388.095333 secs 2024-03-28T10:33:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16388.095333 secs 2024-03-28T10:33:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:10 smithi086 ceph-mon[35163]: pgmap v9448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:10 smithi159 ceph-mon[36109]: pgmap v9448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:10 smithi055 ceph-mon[31863]: pgmap v9448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:12 smithi086 ceph-mon[35163]: pgmap v9449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:12 smithi159 ceph-mon[36109]: pgmap v9449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:12 smithi055 ceph-mon[31863]: pgmap v9449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16393.095449 secs 2024-03-28T10:33:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16393.095449 secs 2024-03-28T10:33:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16393.095449 secs 2024-03-28T10:33:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:14 smithi086 ceph-mon[35163]: pgmap v9450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:33:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:14 smithi159 ceph-mon[36109]: pgmap v9450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:33:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:14 smithi055 ceph-mon[31863]: pgmap v9450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:33:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:16 smithi086 ceph-mon[35163]: pgmap v9451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:33:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:16 smithi159 ceph-mon[36109]: pgmap v9451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:33:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:16 smithi055 ceph-mon[31863]: pgmap v9451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:33:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:18 smithi086 ceph-mon[35163]: pgmap v9452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16398.095570 secs 2024-03-28T10:33:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:18 smithi159 ceph-mon[36109]: pgmap v9452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16398.095570 secs 2024-03-28T10:33:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:18 smithi055 ceph-mon[31863]: pgmap v9452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16398.095570 secs 2024-03-28T10:33:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:20 smithi086 ceph-mon[35163]: pgmap v9453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:20 smithi159 ceph-mon[36109]: pgmap v9453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:20 smithi055 ceph-mon[31863]: pgmap v9453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:22 smithi086 ceph-mon[35163]: pgmap v9454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:22 smithi159 ceph-mon[36109]: pgmap v9454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:22 smithi055 ceph-mon[31863]: pgmap v9454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16403.095644 secs 2024-03-28T10:33:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16403.095644 secs 2024-03-28T10:33:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16403.095644 secs 2024-03-28T10:33:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:24 smithi086 ceph-mon[35163]: pgmap v9455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:24 smithi159 ceph-mon[36109]: pgmap v9455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:24 smithi055 ceph-mon[31863]: pgmap v9455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:26 smithi055 ceph-mon[31863]: pgmap v9456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:26 smithi086 ceph-mon[35163]: pgmap v9456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:26 smithi159 ceph-mon[36109]: pgmap v9456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:28 smithi055 ceph-mon[31863]: pgmap v9457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16408.095703 secs 2024-03-28T10:33:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:28 smithi086 ceph-mon[35163]: pgmap v9457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16408.095703 secs 2024-03-28T10:33:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:28 smithi159 ceph-mon[36109]: pgmap v9457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16408.095703 secs 2024-03-28T10:33:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:30 smithi055 ceph-mon[31863]: pgmap v9458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:30 smithi086 ceph-mon[35163]: pgmap v9458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:30 smithi159 ceph-mon[36109]: pgmap v9458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:32 smithi055 ceph-mon[31863]: pgmap v9459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:32 smithi086 ceph-mon[35163]: pgmap v9459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:32 smithi159 ceph-mon[36109]: pgmap v9459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16413.095831 secs 2024-03-28T10:33:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16413.095831 secs 2024-03-28T10:33:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16413.095831 secs 2024-03-28T10:33:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:34 smithi055 ceph-mon[31863]: pgmap v9460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:34 smithi086 ceph-mon[35163]: pgmap v9460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:34 smithi159 ceph-mon[36109]: pgmap v9460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:36 smithi086 ceph-mon[35163]: pgmap v9461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:36 smithi159 ceph-mon[36109]: pgmap v9461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:36 smithi055 ceph-mon[31863]: pgmap v9461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:38 smithi086 ceph-mon[35163]: pgmap v9462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16418.095925 secs 2024-03-28T10:33:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:38 smithi159 ceph-mon[36109]: pgmap v9462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16418.095925 secs 2024-03-28T10:33:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:38 smithi055 ceph-mon[31863]: pgmap v9462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16418.095925 secs 2024-03-28T10:33:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:40 smithi086 ceph-mon[35163]: pgmap v9463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:40 smithi159 ceph-mon[36109]: pgmap v9463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:40 smithi055 ceph-mon[31863]: pgmap v9463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:42 smithi086 ceph-mon[35163]: pgmap v9464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:42 smithi159 ceph-mon[36109]: pgmap v9464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:42 smithi055 ceph-mon[31863]: pgmap v9464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16423.096018 secs 2024-03-28T10:33:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16423.096018 secs 2024-03-28T10:33:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16423.096018 secs 2024-03-28T10:33:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:44 smithi086 ceph-mon[35163]: pgmap v9465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:44 smithi159 ceph-mon[36109]: pgmap v9465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:44 smithi055 ceph-mon[31863]: pgmap v9465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:45 smithi086 ceph-mon[35163]: pgmap v9466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:45 smithi159 ceph-mon[36109]: pgmap v9466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:45 smithi055 ceph-mon[31863]: pgmap v9466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:47 smithi086 ceph-mon[35163]: pgmap v9467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:47 smithi159 ceph-mon[36109]: pgmap v9467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:47 smithi055 ceph-mon[31863]: pgmap v9467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16428.096100 secs 2024-03-28T10:33:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16428.096100 secs 2024-03-28T10:33:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16428.096100 secs 2024-03-28T10:33:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:49 smithi086 ceph-mon[35163]: pgmap v9468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:49 smithi159 ceph-mon[36109]: pgmap v9468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:49 smithi055 ceph-mon[31863]: pgmap v9468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:51 smithi086 ceph-mon[35163]: pgmap v9469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:51 smithi159 ceph-mon[36109]: pgmap v9469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:51 smithi055 ceph-mon[31863]: pgmap v9469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:33:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:53 smithi086 ceph-mon[35163]: pgmap v9470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16433.096175 secs 2024-03-28T10:33:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:53 smithi159 ceph-mon[36109]: pgmap v9470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16433.096175 secs 2024-03-28T10:33:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:53 smithi055 ceph-mon[31863]: pgmap v9470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:33:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16433.096175 secs 2024-03-28T10:33:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:55 smithi086 ceph-mon[35163]: pgmap v9471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:55 smithi159 ceph-mon[36109]: pgmap v9471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:55 smithi055 ceph-mon[31863]: pgmap v9471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:57 smithi086 ceph-mon[35163]: pgmap v9472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:57 smithi159 ceph-mon[36109]: pgmap v9472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:57 smithi055 ceph-mon[31863]: pgmap v9472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:33:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16438.096262 secs 2024-03-28T10:33:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16438.096262 secs 2024-03-28T10:33:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16438.096262 secs 2024-03-28T10:34:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:33:59 smithi055 ceph-mon[31863]: pgmap v9473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:33:59 smithi086 ceph-mon[35163]: pgmap v9473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:33:59 smithi159 ceph-mon[36109]: pgmap v9473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:01 smithi055 ceph-mon[31863]: pgmap v9474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:01 smithi086 ceph-mon[35163]: pgmap v9474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:01 smithi159 ceph-mon[36109]: pgmap v9474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16443.096330 secs 2024-03-28T10:34:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:03 smithi055 ceph-mon[31863]: pgmap v9475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16443.096330 secs 2024-03-28T10:34:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:03 smithi086 ceph-mon[35163]: pgmap v9475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16443.096330 secs 2024-03-28T10:34:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:03 smithi159 ceph-mon[36109]: pgmap v9475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:05 smithi055 ceph-mon[31863]: pgmap v9476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:34:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:05 smithi086 ceph-mon[35163]: pgmap v9476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:34:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:05 smithi159 ceph-mon[36109]: pgmap v9476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:34:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:34:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:34:07.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:34:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:34:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:34:07.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:07 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:07 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:07 smithi055 ceph-mon[31863]: pgmap v9477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:07 smithi055 ceph-mon[31863]: pgmap v9478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:08.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16448.096454 secs 2024-03-28T10:34:08.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:07 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:34:08.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:07 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:34:08.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:07 smithi086 ceph-mon[35163]: pgmap v9477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:08.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:07 smithi086 ceph-mon[35163]: pgmap v9478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:08.220 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16448.096454 secs 2024-03-28T10:34:08.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:07 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:34:08.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:07 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:34:08.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:07 smithi159 ceph-mon[36109]: pgmap v9477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:08.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:07 smithi159 ceph-mon[36109]: pgmap v9478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:08.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16448.096454 secs 2024-03-28T10:34:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:09 smithi055 ceph-mon[31863]: pgmap v9479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:09 smithi086 ceph-mon[35163]: pgmap v9479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:09 smithi159 ceph-mon[36109]: pgmap v9479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:11 smithi086 ceph-mon[35163]: pgmap v9480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:11 smithi159 ceph-mon[36109]: pgmap v9480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:11 smithi055 ceph-mon[31863]: pgmap v9480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16453.096573 secs 2024-03-28T10:34:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16453.096573 secs 2024-03-28T10:34:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16453.096573 secs 2024-03-28T10:34:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:13 smithi086 ceph-mon[35163]: pgmap v9481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:13 smithi159 ceph-mon[36109]: pgmap v9481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:13 smithi055 ceph-mon[31863]: pgmap v9481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:15 smithi086 ceph-mon[35163]: pgmap v9482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:15 smithi159 ceph-mon[36109]: pgmap v9482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:15 smithi055 ceph-mon[31863]: pgmap v9482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:34:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:17 smithi086 ceph-mon[35163]: pgmap v9483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:34:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16458.096695 secs 2024-03-28T10:34:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:17 smithi159 ceph-mon[36109]: pgmap v9483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:34:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16458.096695 secs 2024-03-28T10:34:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:17 smithi055 ceph-mon[31863]: pgmap v9483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:34:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16458.096695 secs 2024-03-28T10:34:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:19 smithi086 ceph-mon[35163]: pgmap v9484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:19 smithi159 ceph-mon[36109]: pgmap v9484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:19 smithi055 ceph-mon[31863]: pgmap v9484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:21 smithi086 ceph-mon[35163]: pgmap v9485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:21 smithi159 ceph-mon[36109]: pgmap v9485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:21 smithi055 ceph-mon[31863]: pgmap v9485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:22 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16463.096831 secs 2024-03-28T10:34:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:22 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16463.096831 secs 2024-03-28T10:34:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:22 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16463.096831 secs 2024-03-28T10:34:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:23 smithi086 ceph-mon[35163]: pgmap v9486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:23 smithi159 ceph-mon[36109]: pgmap v9486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:23 smithi055 ceph-mon[31863]: pgmap v9486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:25 smithi086 ceph-mon[35163]: pgmap v9487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:25 smithi159 ceph-mon[36109]: pgmap v9487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:25 smithi055 ceph-mon[31863]: pgmap v9487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:27 smithi086 ceph-mon[35163]: pgmap v9488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:27 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16468.096923 secs 2024-03-28T10:34:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:27 smithi159 ceph-mon[36109]: pgmap v9488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:27 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16468.096923 secs 2024-03-28T10:34:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:27 smithi055 ceph-mon[31863]: pgmap v9488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:27 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16468.096923 secs 2024-03-28T10:34:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:29 smithi086 ceph-mon[35163]: pgmap v9489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:29 smithi159 ceph-mon[36109]: pgmap v9489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:29 smithi055 ceph-mon[31863]: pgmap v9489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:31 smithi086 ceph-mon[35163]: pgmap v9490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:31 smithi159 ceph-mon[36109]: pgmap v9490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:31 smithi055 ceph-mon[31863]: pgmap v9490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:32 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16473.097039 secs 2024-03-28T10:34:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:32 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16473.097039 secs 2024-03-28T10:34:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:32 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16473.097039 secs 2024-03-28T10:34:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:33 smithi086 ceph-mon[35163]: pgmap v9491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:33 smithi159 ceph-mon[36109]: pgmap v9491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:33 smithi055 ceph-mon[31863]: pgmap v9491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:35 smithi086 ceph-mon[35163]: pgmap v9492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:36.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:35 smithi159 ceph-mon[36109]: pgmap v9492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:35 smithi055 ceph-mon[31863]: pgmap v9492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:37 smithi086 ceph-mon[35163]: pgmap v9493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16478.097109 secs 2024-03-28T10:34:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:37 smithi159 ceph-mon[36109]: pgmap v9493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16478.097109 secs 2024-03-28T10:34:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:37 smithi055 ceph-mon[31863]: pgmap v9493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16478.097109 secs 2024-03-28T10:34:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:39 smithi086 ceph-mon[35163]: pgmap v9494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:39 smithi159 ceph-mon[36109]: pgmap v9494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:39 smithi055 ceph-mon[31863]: pgmap v9494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:42 smithi086 ceph-mon[35163]: pgmap v9495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:42 smithi159 ceph-mon[36109]: pgmap v9495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:42 smithi055 ceph-mon[31863]: pgmap v9495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16483.097171 secs 2024-03-28T10:34:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16483.097171 secs 2024-03-28T10:34:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16483.097171 secs 2024-03-28T10:34:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:44 smithi086 ceph-mon[35163]: pgmap v9496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:44 smithi159 ceph-mon[36109]: pgmap v9496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:44 smithi055 ceph-mon[31863]: pgmap v9496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:46 smithi086 ceph-mon[35163]: pgmap v9497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:46 smithi159 ceph-mon[36109]: pgmap v9497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:46 smithi055 ceph-mon[31863]: pgmap v9497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:48 smithi086 ceph-mon[35163]: pgmap v9498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16488.097291 secs 2024-03-28T10:34:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:48 smithi159 ceph-mon[36109]: pgmap v9498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16488.097291 secs 2024-03-28T10:34:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:48 smithi055 ceph-mon[31863]: pgmap v9498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16488.097291 secs 2024-03-28T10:34:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:50 smithi086 ceph-mon[35163]: pgmap v9499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:50 smithi159 ceph-mon[36109]: pgmap v9499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:50 smithi055 ceph-mon[31863]: pgmap v9499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:52 smithi086 ceph-mon[35163]: pgmap v9500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:52 smithi159 ceph-mon[36109]: pgmap v9500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:52 smithi055 ceph-mon[31863]: pgmap v9500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:34:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16493.097414 secs 2024-03-28T10:34:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16493.097414 secs 2024-03-28T10:34:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16493.097414 secs 2024-03-28T10:34:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:54 smithi055 ceph-mon[31863]: pgmap v9501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:54 smithi086 ceph-mon[35163]: pgmap v9501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:54 smithi159 ceph-mon[36109]: pgmap v9501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:34:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:56 smithi055 ceph-mon[31863]: pgmap v9502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:56 smithi086 ceph-mon[35163]: pgmap v9502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:56 smithi159 ceph-mon[36109]: pgmap v9502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:58 smithi055 ceph-mon[31863]: pgmap v9503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:34:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16498.097533 secs 2024-03-28T10:34:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:58 smithi086 ceph-mon[35163]: pgmap v9503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:34:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16498.097533 secs 2024-03-28T10:34:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:58 smithi159 ceph-mon[36109]: pgmap v9503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:34:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:34:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16498.097533 secs 2024-03-28T10:35:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:00 smithi055 ceph-mon[31863]: pgmap v9504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:00 smithi086 ceph-mon[35163]: pgmap v9504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:00 smithi159 ceph-mon[36109]: pgmap v9504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:02 smithi055 ceph-mon[31863]: pgmap v9505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:02 smithi086 ceph-mon[35163]: pgmap v9505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:02 smithi159 ceph-mon[36109]: pgmap v9505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16503.097621 secs 2024-03-28T10:35:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16503.097621 secs 2024-03-28T10:35:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16503.097621 secs 2024-03-28T10:35:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:04 smithi055 ceph-mon[31863]: pgmap v9506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:35:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:04 smithi086 ceph-mon[35163]: pgmap v9506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:35:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:04 smithi159 ceph-mon[36109]: pgmap v9506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:35:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:06 smithi086 ceph-mon[35163]: pgmap v9507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:06 smithi159 ceph-mon[36109]: pgmap v9507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:06 smithi055 ceph-mon[31863]: pgmap v9507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:35:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:35:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:35:08.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:08 smithi086 ceph-mon[35163]: pgmap v9508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:08.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16508.097727 secs 2024-03-28T10:35:08.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:08 smithi159 ceph-mon[36109]: pgmap v9508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:08.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16508.097727 secs 2024-03-28T10:35:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:08 smithi055 ceph-mon[31863]: pgmap v9508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16508.097727 secs 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:35:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:35:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:35:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:35:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: pgmap v9509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: pgmap v9510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:35:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: pgmap v9509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: pgmap v9510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:35:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: pgmap v9509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: pgmap v9510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:35:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:11 smithi055 ceph-mon[31863]: pgmap v9511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:35:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:11 smithi086 ceph-mon[35163]: pgmap v9511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:35:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:11 smithi159 ceph-mon[36109]: pgmap v9511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:35:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:13 smithi055 ceph-mon[31863]: pgmap v9512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16513.097869 secs 2024-03-28T10:35:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:13 smithi086 ceph-mon[35163]: pgmap v9512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16513.097869 secs 2024-03-28T10:35:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:13 smithi159 ceph-mon[36109]: pgmap v9512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16513.097869 secs 2024-03-28T10:35:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:15 smithi055 ceph-mon[31863]: pgmap v9513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:15 smithi086 ceph-mon[35163]: pgmap v9513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:15 smithi159 ceph-mon[36109]: pgmap v9513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:17 smithi055 ceph-mon[31863]: pgmap v9514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:17 smithi086 ceph-mon[35163]: pgmap v9514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:17 smithi159 ceph-mon[36109]: pgmap v9514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:35:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16518.097992 secs 2024-03-28T10:35:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16518.097992 secs 2024-03-28T10:35:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16518.097992 secs 2024-03-28T10:35:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:19 smithi086 ceph-mon[35163]: pgmap v9515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:19 smithi159 ceph-mon[36109]: pgmap v9515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:19 smithi055 ceph-mon[31863]: pgmap v9515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:35:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:21 smithi086 ceph-mon[35163]: pgmap v9516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:21 smithi159 ceph-mon[36109]: pgmap v9516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:21 smithi055 ceph-mon[31863]: pgmap v9516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:23 smithi086 ceph-mon[35163]: pgmap v9517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16523.098083 secs 2024-03-28T10:35:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:23 smithi159 ceph-mon[36109]: pgmap v9517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16523.098083 secs 2024-03-28T10:35:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:23 smithi055 ceph-mon[31863]: pgmap v9517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16523.098083 secs 2024-03-28T10:35:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:25 smithi086 ceph-mon[35163]: pgmap v9518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:25 smithi159 ceph-mon[36109]: pgmap v9518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:25 smithi055 ceph-mon[31863]: pgmap v9518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:27 smithi086 ceph-mon[35163]: pgmap v9519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:27 smithi159 ceph-mon[36109]: pgmap v9519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:27 smithi055 ceph-mon[31863]: pgmap v9519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:28.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16528.098149 secs 2024-03-28T10:35:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16528.098149 secs 2024-03-28T10:35:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16528.098149 secs 2024-03-28T10:35:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:29 smithi086 ceph-mon[35163]: pgmap v9520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:29 smithi159 ceph-mon[36109]: pgmap v9520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:29 smithi055 ceph-mon[31863]: pgmap v9520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:31 smithi086 ceph-mon[35163]: pgmap v9521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:31 smithi159 ceph-mon[36109]: pgmap v9521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:31 smithi055 ceph-mon[31863]: pgmap v9521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:33 smithi086 ceph-mon[35163]: pgmap v9522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16533.098226 secs 2024-03-28T10:35:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:33 smithi159 ceph-mon[36109]: pgmap v9522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16533.098226 secs 2024-03-28T10:35:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:33 smithi055 ceph-mon[31863]: pgmap v9522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16533.098226 secs 2024-03-28T10:35:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:35 smithi086 ceph-mon[35163]: pgmap v9523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:35 smithi159 ceph-mon[36109]: pgmap v9523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:35 smithi055 ceph-mon[31863]: pgmap v9523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:36 smithi086 ceph-mon[35163]: pgmap v9524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:36 smithi159 ceph-mon[36109]: pgmap v9524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:36 smithi055 ceph-mon[31863]: pgmap v9524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:37 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16538.098356 secs 2024-03-28T10:35:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:37 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16538.098356 secs 2024-03-28T10:35:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:37 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16538.098356 secs 2024-03-28T10:35:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:38 smithi086 ceph-mon[35163]: pgmap v9525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:38 smithi159 ceph-mon[36109]: pgmap v9525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:38 smithi055 ceph-mon[31863]: pgmap v9525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:41 smithi055 ceph-mon[31863]: pgmap v9526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:41 smithi086 ceph-mon[35163]: pgmap v9526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:41 smithi159 ceph-mon[36109]: pgmap v9526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:43 smithi055 ceph-mon[31863]: pgmap v9527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16543.098417 secs 2024-03-28T10:35:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:43 smithi086 ceph-mon[35163]: pgmap v9527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16543.098417 secs 2024-03-28T10:35:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:43 smithi159 ceph-mon[36109]: pgmap v9527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16543.098417 secs 2024-03-28T10:35:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:45 smithi086 ceph-mon[35163]: pgmap v9528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:45 smithi159 ceph-mon[36109]: pgmap v9528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:45 smithi055 ceph-mon[31863]: pgmap v9528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:47 smithi086 ceph-mon[35163]: pgmap v9529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:47 smithi159 ceph-mon[36109]: pgmap v9529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:47 smithi055 ceph-mon[31863]: pgmap v9529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16548.098481 secs 2024-03-28T10:35:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16548.098481 secs 2024-03-28T10:35:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16548.098481 secs 2024-03-28T10:35:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:49 smithi086 ceph-mon[35163]: pgmap v9530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:49 smithi159 ceph-mon[36109]: pgmap v9530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:49 smithi055 ceph-mon[31863]: pgmap v9530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:51 smithi086 ceph-mon[35163]: pgmap v9531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:51 smithi159 ceph-mon[36109]: pgmap v9531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:51 smithi055 ceph-mon[31863]: pgmap v9531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:35:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:53 smithi086 ceph-mon[35163]: pgmap v9532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16553.098552 secs 2024-03-28T10:35:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:53 smithi159 ceph-mon[36109]: pgmap v9532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16553.098552 secs 2024-03-28T10:35:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:53 smithi055 ceph-mon[31863]: pgmap v9532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16553.098552 secs 2024-03-28T10:35:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:55 smithi086 ceph-mon[35163]: pgmap v9533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:55 smithi159 ceph-mon[36109]: pgmap v9533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:55 smithi055 ceph-mon[31863]: pgmap v9533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:57 smithi086 ceph-mon[35163]: pgmap v9534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:57 smithi159 ceph-mon[36109]: pgmap v9534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:57 smithi055 ceph-mon[31863]: pgmap v9534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:58.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16558.098615 secs 2024-03-28T10:35:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16558.098615 secs 2024-03-28T10:35:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16558.098615 secs 2024-03-28T10:35:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:35:59 smithi086 ceph-mon[35163]: pgmap v9535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:35:59 smithi159 ceph-mon[36109]: pgmap v9535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:35:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:35:59 smithi055 ceph-mon[31863]: pgmap v9535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:01 smithi086 ceph-mon[35163]: pgmap v9536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:01 smithi159 ceph-mon[36109]: pgmap v9536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:01 smithi055 ceph-mon[31863]: pgmap v9536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:02 smithi086 ceph-mon[35163]: pgmap v9537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:02 smithi159 ceph-mon[36109]: pgmap v9537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:02 smithi055 ceph-mon[31863]: pgmap v9537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16563.098735 secs 2024-03-28T10:36:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16563.098735 secs 2024-03-28T10:36:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16563.098735 secs 2024-03-28T10:36:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:04 smithi086 ceph-mon[35163]: pgmap v9538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:04 smithi159 ceph-mon[36109]: pgmap v9538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:04 smithi055 ceph-mon[31863]: pgmap v9538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:07 smithi055 ceph-mon[31863]: pgmap v9539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:07 smithi086 ceph-mon[35163]: pgmap v9539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:07 smithi159 ceph-mon[36109]: pgmap v9539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:08.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16568.098867 secs 2024-03-28T10:36:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16568.098867 secs 2024-03-28T10:36:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16568.098867 secs 2024-03-28T10:36:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:09 smithi086 ceph-mon[35163]: pgmap v9540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:36:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:09 smithi159 ceph-mon[36109]: pgmap v9540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:36:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:09 smithi055 ceph-mon[31863]: pgmap v9540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:36:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:36:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:36:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:36:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:36:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:36:10.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:36:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:36:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:36:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:36:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:11 smithi086 ceph-mon[35163]: pgmap v9541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:11 smithi086 ceph-mon[35163]: pgmap v9542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:11 smithi159 ceph-mon[36109]: pgmap v9541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:11 smithi159 ceph-mon[36109]: pgmap v9542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:11 smithi055 ceph-mon[31863]: pgmap v9541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:11 smithi055 ceph-mon[31863]: pgmap v9542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:13 smithi086 ceph-mon[35163]: pgmap v9543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16573.098960 secs 2024-03-28T10:36:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:13 smithi159 ceph-mon[36109]: pgmap v9543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16573.098960 secs 2024-03-28T10:36:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:13 smithi055 ceph-mon[31863]: pgmap v9543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16573.098960 secs 2024-03-28T10:36:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:15 smithi086 ceph-mon[35163]: pgmap v9544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:15 smithi159 ceph-mon[36109]: pgmap v9544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:15 smithi055 ceph-mon[31863]: pgmap v9544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:17 smithi086 ceph-mon[35163]: pgmap v9545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:17 smithi159 ceph-mon[36109]: pgmap v9545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:17 smithi055 ceph-mon[31863]: pgmap v9545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16578.099084 secs 2024-03-28T10:36:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16578.099084 secs 2024-03-28T10:36:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16578.099084 secs 2024-03-28T10:36:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:19 smithi086 ceph-mon[35163]: pgmap v9546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:19 smithi159 ceph-mon[36109]: pgmap v9546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:19 smithi055 ceph-mon[31863]: pgmap v9546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:36:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:20 smithi086 ceph-mon[35163]: pgmap v9547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:36:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:20 smithi159 ceph-mon[36109]: pgmap v9547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:36:20.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:20 smithi055 ceph-mon[31863]: pgmap v9547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:36:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:23 smithi086 ceph-mon[35163]: pgmap v9548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16583.099207 secs 2024-03-28T10:36:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:23 smithi159 ceph-mon[36109]: pgmap v9548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16583.099207 secs 2024-03-28T10:36:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:23 smithi055 ceph-mon[31863]: pgmap v9548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16583.099207 secs 2024-03-28T10:36:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:25 smithi055 ceph-mon[31863]: pgmap v9549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:25 smithi086 ceph-mon[35163]: pgmap v9549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:25 smithi159 ceph-mon[36109]: pgmap v9549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:27 smithi086 ceph-mon[35163]: pgmap v9550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:27 smithi159 ceph-mon[36109]: pgmap v9550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:27 smithi055 ceph-mon[31863]: pgmap v9550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:28.775 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16588.099337 secs 2024-03-28T10:36:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16588.099337 secs 2024-03-28T10:36:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16588.099337 secs 2024-03-28T10:36:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:29 smithi086 ceph-mon[35163]: pgmap v9551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:29 smithi159 ceph-mon[36109]: pgmap v9551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:29 smithi055 ceph-mon[31863]: pgmap v9551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:31 smithi086 ceph-mon[35163]: pgmap v9552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:31 smithi159 ceph-mon[36109]: pgmap v9552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:31 smithi055 ceph-mon[31863]: pgmap v9552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:33 smithi086 ceph-mon[35163]: pgmap v9553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16593.099459 secs 2024-03-28T10:36:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:33 smithi159 ceph-mon[36109]: pgmap v9553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16593.099459 secs 2024-03-28T10:36:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:33 smithi055 ceph-mon[31863]: pgmap v9553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16593.099459 secs 2024-03-28T10:36:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:35 smithi086 ceph-mon[35163]: pgmap v9554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:35 smithi159 ceph-mon[36109]: pgmap v9554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:35 smithi055 ceph-mon[31863]: pgmap v9554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:37 smithi086 ceph-mon[35163]: pgmap v9555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:37 smithi159 ceph-mon[36109]: pgmap v9555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:37 smithi055 ceph-mon[31863]: pgmap v9555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:38.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16598.099501 secs 2024-03-28T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16598.099501 secs 2024-03-28T10:36:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16598.099501 secs 2024-03-28T10:36:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:39 smithi086 ceph-mon[35163]: pgmap v9556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:39 smithi159 ceph-mon[36109]: pgmap v9556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:39 smithi055 ceph-mon[31863]: pgmap v9556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:41 smithi086 ceph-mon[35163]: pgmap v9557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:41 smithi159 ceph-mon[36109]: pgmap v9557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:41 smithi055 ceph-mon[31863]: pgmap v9557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:43 smithi086 ceph-mon[35163]: pgmap v9558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16603.099580 secs 2024-03-28T10:36:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:43 smithi159 ceph-mon[36109]: pgmap v9558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16603.099580 secs 2024-03-28T10:36:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:43 smithi055 ceph-mon[31863]: pgmap v9558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16603.099580 secs 2024-03-28T10:36:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:45 smithi086 ceph-mon[35163]: pgmap v9559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:45 smithi159 ceph-mon[36109]: pgmap v9559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:45 smithi055 ceph-mon[31863]: pgmap v9559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:47 smithi086 ceph-mon[35163]: pgmap v9560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:47 smithi159 ceph-mon[36109]: pgmap v9560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:47 smithi055 ceph-mon[31863]: pgmap v9560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16608.099704 secs 2024-03-28T10:36:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:48 smithi086 ceph-mon[35163]: pgmap v9561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16608.099704 secs 2024-03-28T10:36:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:48 smithi159 ceph-mon[36109]: pgmap v9561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16608.099704 secs 2024-03-28T10:36:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:48 smithi055 ceph-mon[31863]: pgmap v9561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:51 smithi086 ceph-mon[35163]: pgmap v9562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:51 smithi159 ceph-mon[36109]: pgmap v9562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:51 smithi055 ceph-mon[31863]: pgmap v9562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:36:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:53 smithi086 ceph-mon[35163]: pgmap v9563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16613.099852 secs 2024-03-28T10:36:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:53 smithi159 ceph-mon[36109]: pgmap v9563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16613.099852 secs 2024-03-28T10:36:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:53 smithi055 ceph-mon[31863]: pgmap v9563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16613.099852 secs 2024-03-28T10:36:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:55 smithi086 ceph-mon[35163]: pgmap v9564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:55 smithi159 ceph-mon[36109]: pgmap v9564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:55 smithi055 ceph-mon[31863]: pgmap v9564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:57 smithi086 ceph-mon[35163]: pgmap v9565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:57 smithi159 ceph-mon[36109]: pgmap v9565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:57 smithi055 ceph-mon[31863]: pgmap v9565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:58.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16618.099972 secs 2024-03-28T10:36:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16618.099972 secs 2024-03-28T10:36:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16618.099972 secs 2024-03-28T10:36:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:36:59 smithi086 ceph-mon[35163]: pgmap v9566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:36:59 smithi159 ceph-mon[36109]: pgmap v9566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:36:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:36:59 smithi055 ceph-mon[31863]: pgmap v9566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:01 smithi086 ceph-mon[35163]: pgmap v9567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:01 smithi159 ceph-mon[36109]: pgmap v9567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:01 smithi055 ceph-mon[31863]: pgmap v9567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:03 smithi086 ceph-mon[35163]: pgmap v9568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16623.100038 secs 2024-03-28T10:37:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:03 smithi159 ceph-mon[36109]: pgmap v9568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16623.100038 secs 2024-03-28T10:37:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:03 smithi055 ceph-mon[31863]: pgmap v9568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16623.100038 secs 2024-03-28T10:37:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:05 smithi086 ceph-mon[35163]: pgmap v9569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:05 smithi159 ceph-mon[36109]: pgmap v9569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:05 smithi055 ceph-mon[31863]: pgmap v9569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:07 smithi086 ceph-mon[35163]: pgmap v9570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:07 smithi159 ceph-mon[36109]: pgmap v9570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:07 smithi055 ceph-mon[31863]: pgmap v9570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16628.100109 secs 2024-03-28T10:37:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16628.100109 secs 2024-03-28T10:37:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16628.100109 secs 2024-03-28T10:37:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:09 smithi086 ceph-mon[35163]: pgmap v9571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:09 smithi159 ceph-mon[36109]: pgmap v9571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:09 smithi055 ceph-mon[31863]: pgmap v9571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:11 smithi086 ceph-mon[35163]: pgmap v9572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:37:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:11 smithi159 ceph-mon[36109]: pgmap v9572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:37:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:11 smithi055 ceph-mon[31863]: pgmap v9572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:37:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:13 smithi055 ceph-mon[31863]: pgmap v9573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16633.100142 secs 2024-03-28T10:37:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:13 smithi086 ceph-mon[35163]: pgmap v9573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16633.100142 secs 2024-03-28T10:37:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:13 smithi159 ceph-mon[36109]: pgmap v9573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16633.100142 secs 2024-03-28T10:37:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: pgmap v9574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: pgmap v9575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:14.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:37:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: pgmap v9574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:37:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: pgmap v9575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: pgmap v9574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: pgmap v9575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:37:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:16 smithi086 ceph-mon[35163]: pgmap v9576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:16 smithi159 ceph-mon[36109]: pgmap v9576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:16 smithi055 ceph-mon[31863]: pgmap v9576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:18 smithi086 ceph-mon[35163]: pgmap v9577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16638.100227 secs 2024-03-28T10:37:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:18 smithi159 ceph-mon[36109]: pgmap v9577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16638.100227 secs 2024-03-28T10:37:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:18 smithi055 ceph-mon[31863]: pgmap v9577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16638.100227 secs 2024-03-28T10:37:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:20 smithi086 ceph-mon[35163]: pgmap v9578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:20 smithi159 ceph-mon[36109]: pgmap v9578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:20 smithi055 ceph-mon[31863]: pgmap v9578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:22 smithi086 ceph-mon[35163]: pgmap v9579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:22 smithi159 ceph-mon[36109]: pgmap v9579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:22 smithi055 ceph-mon[31863]: pgmap v9579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16643.100348 secs 2024-03-28T10:37:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16643.100348 secs 2024-03-28T10:37:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16643.100348 secs 2024-03-28T10:37:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:24 smithi086 ceph-mon[35163]: pgmap v9580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:24 smithi159 ceph-mon[36109]: pgmap v9580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:24 smithi055 ceph-mon[31863]: pgmap v9580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:26 smithi086 ceph-mon[35163]: pgmap v9581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:26 smithi159 ceph-mon[36109]: pgmap v9581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:26 smithi055 ceph-mon[31863]: pgmap v9581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:28 smithi086 ceph-mon[35163]: pgmap v9582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16648.100466 secs 2024-03-28T10:37:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:28 smithi159 ceph-mon[36109]: pgmap v9582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16648.100466 secs 2024-03-28T10:37:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:28 smithi055 ceph-mon[31863]: pgmap v9582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:37:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16648.100466 secs 2024-03-28T10:37:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:30 smithi086 ceph-mon[35163]: pgmap v9583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:30 smithi159 ceph-mon[36109]: pgmap v9583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:30 smithi055 ceph-mon[31863]: pgmap v9583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:32 smithi086 ceph-mon[35163]: pgmap v9584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:32 smithi159 ceph-mon[36109]: pgmap v9584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:32 smithi055 ceph-mon[31863]: pgmap v9584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16653.100565 secs 2024-03-28T10:37:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16653.100565 secs 2024-03-28T10:37:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16653.100565 secs 2024-03-28T10:37:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:34 smithi086 ceph-mon[35163]: pgmap v9585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:34 smithi159 ceph-mon[36109]: pgmap v9585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:34 smithi055 ceph-mon[31863]: pgmap v9585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:37:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:36 smithi086 ceph-mon[35163]: pgmap v9586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:36 smithi159 ceph-mon[36109]: pgmap v9586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:36 smithi055 ceph-mon[31863]: pgmap v9586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:37:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:38 smithi086 ceph-mon[35163]: pgmap v9587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16658.100685 secs 2024-03-28T10:37:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:38 smithi159 ceph-mon[36109]: pgmap v9587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16658.100685 secs 2024-03-28T10:37:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:38 smithi055 ceph-mon[31863]: pgmap v9587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16658.100685 secs 2024-03-28T10:37:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:40 smithi086 ceph-mon[35163]: pgmap v9588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:40 smithi159 ceph-mon[36109]: pgmap v9588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:40 smithi055 ceph-mon[31863]: pgmap v9588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:42 smithi086 ceph-mon[35163]: pgmap v9589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:42 smithi159 ceph-mon[36109]: pgmap v9589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:42 smithi055 ceph-mon[31863]: pgmap v9589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16663.100804 secs 2024-03-28T10:37:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16663.100804 secs 2024-03-28T10:37:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16663.100804 secs 2024-03-28T10:37:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:44 smithi086 ceph-mon[35163]: pgmap v9590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:44 smithi159 ceph-mon[36109]: pgmap v9590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:44 smithi055 ceph-mon[31863]: pgmap v9590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:46 smithi159 ceph-mon[36109]: pgmap v9591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:46 smithi055 ceph-mon[31863]: pgmap v9591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:46 smithi086 ceph-mon[35163]: pgmap v9591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:48 smithi055 ceph-mon[31863]: pgmap v9592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16668.100877 secs 2024-03-28T10:37:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:48 smithi086 ceph-mon[35163]: pgmap v9592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16668.100877 secs 2024-03-28T10:37:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:48 smithi159 ceph-mon[36109]: pgmap v9592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16668.100877 secs 2024-03-28T10:37:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:50 smithi055 ceph-mon[31863]: pgmap v9593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:50 smithi086 ceph-mon[35163]: pgmap v9593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:50 smithi159 ceph-mon[36109]: pgmap v9593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:52 smithi055 ceph-mon[31863]: pgmap v9594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:52 smithi086 ceph-mon[35163]: pgmap v9594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:52 smithi159 ceph-mon[36109]: pgmap v9594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16673.100954 secs 2024-03-28T10:37:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16673.100954 secs 2024-03-28T10:37:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16673.100954 secs 2024-03-28T10:37:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:54 smithi055 ceph-mon[31863]: pgmap v9595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:54 smithi086 ceph-mon[35163]: pgmap v9595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:54 smithi159 ceph-mon[36109]: pgmap v9595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:37:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:56 smithi055 ceph-mon[31863]: pgmap v9596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:56 smithi086 ceph-mon[35163]: pgmap v9596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:56 smithi159 ceph-mon[36109]: pgmap v9596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:37:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:58 smithi055 ceph-mon[31863]: pgmap v9597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:37:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16678.101118 secs 2024-03-28T10:37:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:58 smithi086 ceph-mon[35163]: pgmap v9597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:37:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16678.101118 secs 2024-03-28T10:37:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:58 smithi159 ceph-mon[36109]: pgmap v9597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:37:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:37:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16678.101118 secs 2024-03-28T10:38:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:00 smithi086 ceph-mon[35163]: pgmap v9598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:00 smithi159 ceph-mon[36109]: pgmap v9598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:00 smithi055 ceph-mon[31863]: pgmap v9598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:02 smithi086 ceph-mon[35163]: pgmap v9599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16683.101163 secs 2024-03-28T10:38:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:02 smithi159 ceph-mon[36109]: pgmap v9599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16683.101163 secs 2024-03-28T10:38:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:02 smithi055 ceph-mon[31863]: pgmap v9599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16683.101163 secs 2024-03-28T10:38:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:04 smithi086 ceph-mon[35163]: pgmap v9600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:04 smithi159 ceph-mon[36109]: pgmap v9600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:04 smithi055 ceph-mon[31863]: pgmap v9600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:06 smithi086 ceph-mon[35163]: pgmap v9601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:06 smithi159 ceph-mon[36109]: pgmap v9601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:06 smithi055 ceph-mon[31863]: pgmap v9601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:08.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16688.101251 secs 2024-03-28T10:38:08.220 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16688.101251 secs 2024-03-28T10:38:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16688.101251 secs 2024-03-28T10:38:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:08 smithi086 ceph-mon[35163]: pgmap v9602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:08 smithi159 ceph-mon[36109]: pgmap v9602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:08 smithi055 ceph-mon[31863]: pgmap v9602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:10 smithi086 ceph-mon[35163]: pgmap v9603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:10 smithi159 ceph-mon[36109]: pgmap v9603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:10 smithi055 ceph-mon[31863]: pgmap v9603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:12 smithi086 ceph-mon[35163]: pgmap v9604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16693.101383 secs 2024-03-28T10:38:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:12 smithi159 ceph-mon[36109]: pgmap v9604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16693.101383 secs 2024-03-28T10:38:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:12 smithi055 ceph-mon[31863]: pgmap v9604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16693.101383 secs 2024-03-28T10:38:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:14 smithi086 ceph-mon[35163]: pgmap v9605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:38:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:14 smithi159 ceph-mon[36109]: pgmap v9605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:38:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:14 smithi055 ceph-mon[31863]: pgmap v9605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:38:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:16.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:16 smithi086 ceph-mon[35163]: pgmap v9606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:16 smithi159 ceph-mon[36109]: pgmap v9606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:16 smithi055 ceph-mon[31863]: pgmap v9606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:38:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16698.101458 secs 2024-03-28T10:38:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16698.101458 secs 2024-03-28T10:38:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16698.101458 secs 2024-03-28T10:38:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:19 smithi086 ceph-mon[35163]: pgmap v9607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:19 smithi159 ceph-mon[36109]: pgmap v9607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:19 smithi055 ceph-mon[31863]: pgmap v9607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: pgmap v9608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:38:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:38:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: pgmap v9608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:38:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:38:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: pgmap v9608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:38:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:38:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:22 smithi086 ceph-mon[35163]: pgmap v9609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:38:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:22 smithi086 ceph-mon[35163]: pgmap v9610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:22 smithi159 ceph-mon[36109]: pgmap v9609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:38:22.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:22 smithi159 ceph-mon[36109]: pgmap v9610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:22 smithi055 ceph-mon[31863]: pgmap v9609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:38:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:22 smithi055 ceph-mon[31863]: pgmap v9610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16703.101522 secs 2024-03-28T10:38:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16703.101522 secs 2024-03-28T10:38:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16703.101522 secs 2024-03-28T10:38:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:24 smithi159 ceph-mon[36109]: pgmap v9611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:24 smithi055 ceph-mon[31863]: pgmap v9611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:24 smithi086 ceph-mon[35163]: pgmap v9611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:26 smithi055 ceph-mon[31863]: pgmap v9612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:38:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:26 smithi086 ceph-mon[35163]: pgmap v9612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:38:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:26 smithi159 ceph-mon[36109]: pgmap v9612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:38:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:28 smithi055 ceph-mon[31863]: pgmap v9613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16708.101588 secs 2024-03-28T10:38:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:28 smithi086 ceph-mon[35163]: pgmap v9613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16708.101588 secs 2024-03-28T10:38:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:28 smithi159 ceph-mon[36109]: pgmap v9613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16708.101588 secs 2024-03-28T10:38:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:30 smithi055 ceph-mon[31863]: pgmap v9614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:30 smithi086 ceph-mon[35163]: pgmap v9614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:30 smithi159 ceph-mon[36109]: pgmap v9614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:32 smithi055 ceph-mon[31863]: pgmap v9615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:38:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:32 smithi086 ceph-mon[35163]: pgmap v9615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:38:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:32 smithi159 ceph-mon[36109]: pgmap v9615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:38:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16713.101666 secs 2024-03-28T10:38:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16713.101666 secs 2024-03-28T10:38:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16713.101666 secs 2024-03-28T10:38:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:34 smithi055 ceph-mon[31863]: pgmap v9616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:34 smithi086 ceph-mon[35163]: pgmap v9616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:34 smithi159 ceph-mon[36109]: pgmap v9616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:36 smithi086 ceph-mon[35163]: pgmap v9617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:36 smithi159 ceph-mon[36109]: pgmap v9617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:36 smithi055 ceph-mon[31863]: pgmap v9617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:38 smithi086 ceph-mon[35163]: pgmap v9618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16718.101808 secs 2024-03-28T10:38:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:38 smithi159 ceph-mon[36109]: pgmap v9618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16718.101808 secs 2024-03-28T10:38:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:38 smithi055 ceph-mon[31863]: pgmap v9618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16718.101808 secs 2024-03-28T10:38:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:40 smithi086 ceph-mon[35163]: pgmap v9619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:40 smithi159 ceph-mon[36109]: pgmap v9619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:40 smithi055 ceph-mon[31863]: pgmap v9619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:42 smithi086 ceph-mon[35163]: pgmap v9620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:42 smithi159 ceph-mon[36109]: pgmap v9620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:42 smithi055 ceph-mon[31863]: pgmap v9620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16723.101870 secs 2024-03-28T10:38:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16723.101870 secs 2024-03-28T10:38:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16723.101870 secs 2024-03-28T10:38:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:44 smithi086 ceph-mon[35163]: pgmap v9621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:44 smithi159 ceph-mon[36109]: pgmap v9621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:44 smithi055 ceph-mon[31863]: pgmap v9621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:46 smithi086 ceph-mon[35163]: pgmap v9622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:46 smithi159 ceph-mon[36109]: pgmap v9622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:46 smithi055 ceph-mon[31863]: pgmap v9622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:48 smithi086 ceph-mon[35163]: pgmap v9623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16728.101932 secs 2024-03-28T10:38:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:48 smithi159 ceph-mon[36109]: pgmap v9623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16728.101932 secs 2024-03-28T10:38:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:48 smithi055 ceph-mon[31863]: pgmap v9623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16728.101932 secs 2024-03-28T10:38:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:50 smithi086 ceph-mon[35163]: pgmap v9624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:50 smithi159 ceph-mon[36109]: pgmap v9624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:50 smithi055 ceph-mon[31863]: pgmap v9624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:52 smithi086 ceph-mon[35163]: pgmap v9625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:52 smithi159 ceph-mon[36109]: pgmap v9625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:52 smithi055 ceph-mon[31863]: pgmap v9625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16733.102019 secs 2024-03-28T10:38:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16733.102019 secs 2024-03-28T10:38:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16733.102019 secs 2024-03-28T10:38:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:54 smithi086 ceph-mon[35163]: pgmap v9626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:54.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:54 smithi159 ceph-mon[36109]: pgmap v9626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:54 smithi055 ceph-mon[31863]: pgmap v9626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:56 smithi086 ceph-mon[35163]: pgmap v9627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:56 smithi159 ceph-mon[36109]: pgmap v9627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:56 smithi055 ceph-mon[31863]: pgmap v9627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:38:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:58 smithi086 ceph-mon[35163]: pgmap v9628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:38:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16738.102105 secs 2024-03-28T10:38:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:58 smithi159 ceph-mon[36109]: pgmap v9628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:38:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16738.102105 secs 2024-03-28T10:38:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:58 smithi055 ceph-mon[31863]: pgmap v9628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:38:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:38:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16738.102105 secs 2024-03-28T10:39:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:00 smithi086 ceph-mon[35163]: pgmap v9629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:00 smithi159 ceph-mon[36109]: pgmap v9629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:00 smithi055 ceph-mon[31863]: pgmap v9629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:02 smithi086 ceph-mon[35163]: pgmap v9630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:02 smithi159 ceph-mon[36109]: pgmap v9630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:02 smithi055 ceph-mon[31863]: pgmap v9630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16743.102224 secs 2024-03-28T10:39:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16743.102224 secs 2024-03-28T10:39:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16743.102224 secs 2024-03-28T10:39:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:04 smithi086 ceph-mon[35163]: pgmap v9631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:04 smithi159 ceph-mon[36109]: pgmap v9631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:04 smithi055 ceph-mon[31863]: pgmap v9631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:06 smithi086 ceph-mon[35163]: pgmap v9632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:06 smithi159 ceph-mon[36109]: pgmap v9632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:06 smithi055 ceph-mon[31863]: pgmap v9632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:08 smithi086 ceph-mon[35163]: pgmap v9633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16748.102314 secs 2024-03-28T10:39:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:08 smithi159 ceph-mon[36109]: pgmap v9633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16748.102314 secs 2024-03-28T10:39:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:08 smithi055 ceph-mon[31863]: pgmap v9633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16748.102314 secs 2024-03-28T10:39:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:10 smithi086 ceph-mon[35163]: pgmap v9634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:10 smithi159 ceph-mon[36109]: pgmap v9634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:10 smithi055 ceph-mon[31863]: pgmap v9634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:12 smithi086 ceph-mon[35163]: pgmap v9635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:12 smithi159 ceph-mon[36109]: pgmap v9635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:12 smithi055 ceph-mon[31863]: pgmap v9635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16753.102388 secs 2024-03-28T10:39:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16753.102388 secs 2024-03-28T10:39:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16753.102388 secs 2024-03-28T10:39:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:14 smithi086 ceph-mon[35163]: pgmap v9636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:14 smithi159 ceph-mon[36109]: pgmap v9636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:14 smithi055 ceph-mon[31863]: pgmap v9636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:16 smithi086 ceph-mon[35163]: pgmap v9637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:16 smithi159 ceph-mon[36109]: pgmap v9637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:16 smithi055 ceph-mon[31863]: pgmap v9637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:18 smithi055 ceph-mon[31863]: pgmap v9638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16758.102456 secs 2024-03-28T10:39:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:18 smithi086 ceph-mon[35163]: pgmap v9638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16758.102456 secs 2024-03-28T10:39:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:18 smithi159 ceph-mon[36109]: pgmap v9638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16758.102456 secs 2024-03-28T10:39:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:20 smithi055 ceph-mon[31863]: pgmap v9639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:20 smithi086 ceph-mon[35163]: pgmap v9639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:20 smithi159 ceph-mon[36109]: pgmap v9639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:22 smithi055 ceph-mon[31863]: pgmap v9640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:39:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:22 smithi086 ceph-mon[35163]: pgmap v9640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:39:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:22 smithi159 ceph-mon[36109]: pgmap v9640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:39:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16763.102576 secs 2024-03-28T10:39:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:39:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:39:23.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:39:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16763.102576 secs 2024-03-28T10:39:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:39:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:39:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:39:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16763.102576 secs 2024-03-28T10:39:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:39:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:39:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:39:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:24 smithi055 ceph-mon[31863]: pgmap v9641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:24 smithi055 ceph-mon[31863]: pgmap v9642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:39:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:24 smithi086 ceph-mon[35163]: pgmap v9641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:24 smithi086 ceph-mon[35163]: pgmap v9642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:39:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:24 smithi159 ceph-mon[36109]: pgmap v9641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:24 smithi159 ceph-mon[36109]: pgmap v9642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:39:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:26 smithi055 ceph-mon[31863]: pgmap v9643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:26 smithi086 ceph-mon[35163]: pgmap v9643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:26 smithi159 ceph-mon[36109]: pgmap v9643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:28 smithi055 ceph-mon[31863]: pgmap v9644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16768.102662 secs 2024-03-28T10:39:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:28 smithi086 ceph-mon[35163]: pgmap v9644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16768.102662 secs 2024-03-28T10:39:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:28 smithi159 ceph-mon[36109]: pgmap v9644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16768.102662 secs 2024-03-28T10:39:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:30 smithi086 ceph-mon[35163]: pgmap v9645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:30 smithi159 ceph-mon[36109]: pgmap v9645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:30 smithi055 ceph-mon[31863]: pgmap v9645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:32 smithi086 ceph-mon[35163]: pgmap v9646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:32 smithi159 ceph-mon[36109]: pgmap v9646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:32 smithi055 ceph-mon[31863]: pgmap v9646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:39:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16773.102818 secs 2024-03-28T10:39:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16773.102818 secs 2024-03-28T10:39:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16773.102818 secs 2024-03-28T10:39:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:34 smithi086 ceph-mon[35163]: pgmap v9647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:39:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:34 smithi159 ceph-mon[36109]: pgmap v9647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:39:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:34 smithi055 ceph-mon[31863]: pgmap v9647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:39:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:36 smithi086 ceph-mon[35163]: pgmap v9648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:36 smithi159 ceph-mon[36109]: pgmap v9648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:36 smithi055 ceph-mon[31863]: pgmap v9648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:38 smithi086 ceph-mon[35163]: pgmap v9649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16778.102938 secs 2024-03-28T10:39:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:38 smithi159 ceph-mon[36109]: pgmap v9649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16778.102938 secs 2024-03-28T10:39:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:38 smithi055 ceph-mon[31863]: pgmap v9649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16778.102938 secs 2024-03-28T10:39:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:40 smithi086 ceph-mon[35163]: pgmap v9650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:40 smithi159 ceph-mon[36109]: pgmap v9650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:40 smithi055 ceph-mon[31863]: pgmap v9650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:42 smithi086 ceph-mon[35163]: pgmap v9651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:42 smithi159 ceph-mon[36109]: pgmap v9651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:42 smithi055 ceph-mon[31863]: pgmap v9651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16783.103060 secs 2024-03-28T10:39:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16783.103060 secs 2024-03-28T10:39:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16783.103060 secs 2024-03-28T10:39:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:44 smithi086 ceph-mon[35163]: pgmap v9652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:44 smithi159 ceph-mon[36109]: pgmap v9652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:44 smithi055 ceph-mon[31863]: pgmap v9652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:46 smithi086 ceph-mon[35163]: pgmap v9653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:46 smithi159 ceph-mon[36109]: pgmap v9653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:46 smithi055 ceph-mon[31863]: pgmap v9653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:48 smithi086 ceph-mon[35163]: pgmap v9654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16788.103184 secs 2024-03-28T10:39:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:48 smithi159 ceph-mon[36109]: pgmap v9654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16788.103184 secs 2024-03-28T10:39:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:48 smithi055 ceph-mon[31863]: pgmap v9654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16788.103184 secs 2024-03-28T10:39:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:50 smithi086 ceph-mon[35163]: pgmap v9655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:50 smithi159 ceph-mon[36109]: pgmap v9655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:50 smithi055 ceph-mon[31863]: pgmap v9655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:52 smithi086 ceph-mon[35163]: pgmap v9656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:52 smithi159 ceph-mon[36109]: pgmap v9656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:52 smithi055 ceph-mon[31863]: pgmap v9656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16793.103304 secs 2024-03-28T10:39:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:53 smithi086 ceph-mon[35163]: pgmap v9657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16793.103304 secs 2024-03-28T10:39:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:53 smithi159 ceph-mon[36109]: pgmap v9657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16793.103304 secs 2024-03-28T10:39:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:53 smithi055 ceph-mon[31863]: pgmap v9657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:39:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:55 smithi055 ceph-mon[31863]: pgmap v9658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:55 smithi086 ceph-mon[35163]: pgmap v9658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:55 smithi159 ceph-mon[36109]: pgmap v9658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:57 smithi086 ceph-mon[35163]: pgmap v9659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:57 smithi159 ceph-mon[36109]: pgmap v9659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:57 smithi055 ceph-mon[31863]: pgmap v9659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:39:59.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16798.103430 secs 2024-03-28T10:39:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16798.103430 secs 2024-03-28T10:39:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16798.103430 secs 2024-03-28T10:40:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:39:59 smithi086 ceph-mon[35163]: pgmap v9660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:39:59 smithi159 ceph-mon[36109]: pgmap v9660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:39:59 smithi055 ceph-mon[31863]: pgmap v9660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:40:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:40:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:40:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:01 smithi086 ceph-mon[35163]: pgmap v9661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:01 smithi159 ceph-mon[36109]: pgmap v9661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:01 smithi055 ceph-mon[31863]: pgmap v9661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:02 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16803.103553 secs 2024-03-28T10:40:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:02 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16803.103553 secs 2024-03-28T10:40:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:02 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16803.103553 secs 2024-03-28T10:40:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:03 smithi086 ceph-mon[35163]: pgmap v9662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:03 smithi159 ceph-mon[36109]: pgmap v9662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:03 smithi055 ceph-mon[31863]: pgmap v9662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:05 smithi086 ceph-mon[35163]: pgmap v9663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:05 smithi159 ceph-mon[36109]: pgmap v9663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:05 smithi055 ceph-mon[31863]: pgmap v9663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:07 smithi086 ceph-mon[35163]: pgmap v9664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:07 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16808.103654 secs 2024-03-28T10:40:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:07 smithi159 ceph-mon[36109]: pgmap v9664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:07 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16808.103654 secs 2024-03-28T10:40:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:07 smithi055 ceph-mon[31863]: pgmap v9664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:07 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16808.103654 secs 2024-03-28T10:40:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:09 smithi086 ceph-mon[35163]: pgmap v9665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:09 smithi159 ceph-mon[36109]: pgmap v9665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:09 smithi055 ceph-mon[31863]: pgmap v9665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:11 smithi086 ceph-mon[35163]: pgmap v9666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:11 smithi159 ceph-mon[36109]: pgmap v9666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:11 smithi055 ceph-mon[31863]: pgmap v9666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:12 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16813.103807 secs 2024-03-28T10:40:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:12 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16813.103807 secs 2024-03-28T10:40:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:12 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16813.103807 secs 2024-03-28T10:40:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:13 smithi086 ceph-mon[35163]: pgmap v9667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:13 smithi159 ceph-mon[36109]: pgmap v9667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:13 smithi055 ceph-mon[31863]: pgmap v9667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:15 smithi086 ceph-mon[35163]: pgmap v9668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:15 smithi159 ceph-mon[36109]: pgmap v9668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:15 smithi055 ceph-mon[31863]: pgmap v9668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:17 smithi086 ceph-mon[35163]: pgmap v9669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:17 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16818.103927 secs 2024-03-28T10:40:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:17 smithi159 ceph-mon[36109]: pgmap v9669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:17 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16818.103927 secs 2024-03-28T10:40:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:17 smithi055 ceph-mon[31863]: pgmap v9669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:17 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16818.103927 secs 2024-03-28T10:40:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:19 smithi086 ceph-mon[35163]: pgmap v9670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:19 smithi159 ceph-mon[36109]: pgmap v9670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:19 smithi055 ceph-mon[31863]: pgmap v9670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:21 smithi086 ceph-mon[35163]: pgmap v9671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:21 smithi159 ceph-mon[36109]: pgmap v9671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:21 smithi055 ceph-mon[31863]: pgmap v9671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16823.103991 secs 2024-03-28T10:40:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16823.103991 secs 2024-03-28T10:40:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16823.103991 secs 2024-03-28T10:40:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:24 smithi086 ceph-mon[35163]: pgmap v9672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:40:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:24 smithi159 ceph-mon[36109]: pgmap v9672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:40:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:24 smithi055 ceph-mon[31863]: pgmap v9672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:40:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:40:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:40:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:40:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:40:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:40:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:40:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:40:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:40:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:40:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:26 smithi086 ceph-mon[35163]: pgmap v9673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:26 smithi086 ceph-mon[35163]: pgmap v9674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:26 smithi159 ceph-mon[36109]: pgmap v9673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:26.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:26 smithi159 ceph-mon[36109]: pgmap v9674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:26 smithi055 ceph-mon[31863]: pgmap v9673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:26 smithi055 ceph-mon[31863]: pgmap v9674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:28 smithi086 ceph-mon[35163]: pgmap v9675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16828.104090 secs 2024-03-28T10:40:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:28 smithi159 ceph-mon[36109]: pgmap v9675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16828.104090 secs 2024-03-28T10:40:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:28 smithi055 ceph-mon[31863]: pgmap v9675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16828.104090 secs 2024-03-28T10:40:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:30 smithi086 ceph-mon[35163]: pgmap v9676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:30 smithi159 ceph-mon[36109]: pgmap v9676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:30 smithi055 ceph-mon[31863]: pgmap v9676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:32 smithi086 ceph-mon[35163]: pgmap v9677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:32 smithi159 ceph-mon[36109]: pgmap v9677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:32 smithi055 ceph-mon[31863]: pgmap v9677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16833.104214 secs 2024-03-28T10:40:33.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16833.104214 secs 2024-03-28T10:40:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16833.104214 secs 2024-03-28T10:40:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:34 smithi086 ceph-mon[35163]: pgmap v9678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:34 smithi159 ceph-mon[36109]: pgmap v9678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:34 smithi055 ceph-mon[31863]: pgmap v9678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:40:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:36 smithi055 ceph-mon[31863]: pgmap v9679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:36 smithi086 ceph-mon[35163]: pgmap v9679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:36 smithi159 ceph-mon[36109]: pgmap v9679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:40:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:38 smithi055 ceph-mon[31863]: pgmap v9680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16838.104306 secs 2024-03-28T10:40:38.374 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:38 smithi159 ceph-mon[36109]: pgmap v9680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:38.374 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16838.104306 secs 2024-03-28T10:40:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:38 smithi086 ceph-mon[35163]: pgmap v9680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16838.104306 secs 2024-03-28T10:40:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:40 smithi159 ceph-mon[36109]: pgmap v9681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:40.369 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:40 smithi086 ceph-mon[35163]: pgmap v9681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:40 smithi055 ceph-mon[31863]: pgmap v9681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:42 smithi055 ceph-mon[31863]: pgmap v9682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:42 smithi086 ceph-mon[35163]: pgmap v9682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:42 smithi159 ceph-mon[36109]: pgmap v9682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16843.104391 secs 2024-03-28T10:40:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16843.104391 secs 2024-03-28T10:40:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16843.104391 secs 2024-03-28T10:40:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:44 smithi055 ceph-mon[31863]: pgmap v9683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:44 smithi086 ceph-mon[35163]: pgmap v9683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:44 smithi159 ceph-mon[36109]: pgmap v9683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:46 smithi055 ceph-mon[31863]: pgmap v9684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:46 smithi086 ceph-mon[35163]: pgmap v9684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:46 smithi159 ceph-mon[36109]: pgmap v9684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:48 smithi086 ceph-mon[35163]: pgmap v9685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16848.104509 secs 2024-03-28T10:40:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:48 smithi159 ceph-mon[36109]: pgmap v9685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16848.104509 secs 2024-03-28T10:40:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:48 smithi055 ceph-mon[31863]: pgmap v9685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16848.104509 secs 2024-03-28T10:40:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:50 smithi086 ceph-mon[35163]: pgmap v9686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:50 smithi159 ceph-mon[36109]: pgmap v9686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:50 smithi055 ceph-mon[31863]: pgmap v9686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:52 smithi086 ceph-mon[35163]: pgmap v9687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:52 smithi159 ceph-mon[36109]: pgmap v9687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:52 smithi055 ceph-mon[31863]: pgmap v9687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:40:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16853.104633 secs 2024-03-28T10:40:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16853.104633 secs 2024-03-28T10:40:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16853.104633 secs 2024-03-28T10:40:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:54 smithi086 ceph-mon[35163]: pgmap v9688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:54 smithi159 ceph-mon[36109]: pgmap v9688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:54 smithi055 ceph-mon[31863]: pgmap v9688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:40:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:56 smithi086 ceph-mon[35163]: pgmap v9689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:56 smithi159 ceph-mon[36109]: pgmap v9689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:56 smithi055 ceph-mon[31863]: pgmap v9689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:58 smithi086 ceph-mon[35163]: pgmap v9690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:40:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16858.104756 secs 2024-03-28T10:40:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:58 smithi159 ceph-mon[36109]: pgmap v9690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:40:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16858.104756 secs 2024-03-28T10:40:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:58 smithi055 ceph-mon[31863]: pgmap v9690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:40:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:40:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16858.104756 secs 2024-03-28T10:41:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:00 smithi086 ceph-mon[35163]: pgmap v9691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:00 smithi159 ceph-mon[36109]: pgmap v9691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:00 smithi055 ceph-mon[31863]: pgmap v9691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:02 smithi086 ceph-mon[35163]: pgmap v9692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:02 smithi159 ceph-mon[36109]: pgmap v9692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:02.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:02 smithi055 ceph-mon[31863]: pgmap v9692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16863.104874 secs 2024-03-28T10:41:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16863.104874 secs 2024-03-28T10:41:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16863.104874 secs 2024-03-28T10:41:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:04 smithi086 ceph-mon[35163]: pgmap v9693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:04 smithi159 ceph-mon[36109]: pgmap v9693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:04 smithi055 ceph-mon[31863]: pgmap v9693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:06 smithi086 ceph-mon[35163]: pgmap v9694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:06 smithi159 ceph-mon[36109]: pgmap v9694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:06 smithi055 ceph-mon[31863]: pgmap v9694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:08 smithi086 ceph-mon[35163]: pgmap v9695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16868.104963 secs 2024-03-28T10:41:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:08 smithi159 ceph-mon[36109]: pgmap v9695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16868.104963 secs 2024-03-28T10:41:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:08 smithi055 ceph-mon[31863]: pgmap v9695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16868.104963 secs 2024-03-28T10:41:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:10 smithi086 ceph-mon[35163]: pgmap v9696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:10 smithi159 ceph-mon[36109]: pgmap v9696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:10 smithi055 ceph-mon[31863]: pgmap v9696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:12 smithi086 ceph-mon[35163]: pgmap v9697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:12 smithi159 ceph-mon[36109]: pgmap v9697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:12 smithi055 ceph-mon[31863]: pgmap v9697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16873.105081 secs 2024-03-28T10:41:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16873.105081 secs 2024-03-28T10:41:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16873.105081 secs 2024-03-28T10:41:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:14 smithi086 ceph-mon[35163]: pgmap v9698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:14 smithi159 ceph-mon[36109]: pgmap v9698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:14 smithi055 ceph-mon[31863]: pgmap v9698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:16 smithi086 ceph-mon[35163]: pgmap v9699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:16 smithi159 ceph-mon[36109]: pgmap v9699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:16 smithi055 ceph-mon[31863]: pgmap v9699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:18 smithi086 ceph-mon[35163]: pgmap v9700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16878.105108 secs 2024-03-28T10:41:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:18 smithi159 ceph-mon[36109]: pgmap v9700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16878.105108 secs 2024-03-28T10:41:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:18 smithi055 ceph-mon[31863]: pgmap v9700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16878.105108 secs 2024-03-28T10:41:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:20 smithi086 ceph-mon[35163]: pgmap v9701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:20 smithi159 ceph-mon[36109]: pgmap v9701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:20 smithi055 ceph-mon[31863]: pgmap v9701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:22 smithi086 ceph-mon[35163]: pgmap v9702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:22 smithi159 ceph-mon[36109]: pgmap v9702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:22 smithi055 ceph-mon[31863]: pgmap v9702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16883.105179 secs 2024-03-28T10:41:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16883.105179 secs 2024-03-28T10:41:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16883.105179 secs 2024-03-28T10:41:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:24 smithi086 ceph-mon[35163]: pgmap v9703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:41:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:24 smithi159 ceph-mon[36109]: pgmap v9703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:41:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:24 smithi055 ceph-mon[31863]: pgmap v9703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:41:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:41:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:41:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:41:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:26 smithi086 ceph-mon[35163]: pgmap v9704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:26 smithi159 ceph-mon[36109]: pgmap v9704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:26 smithi055 ceph-mon[31863]: pgmap v9704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:41:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:41:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:27 smithi086 ceph-mon[35163]: pgmap v9705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:27 smithi086 ceph-mon[35163]: pgmap v9706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:41:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:41:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:41:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:27 smithi159 ceph-mon[36109]: pgmap v9705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:27 smithi159 ceph-mon[36109]: pgmap v9706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:27.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:41:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:41:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:41:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:27 smithi055 ceph-mon[31863]: pgmap v9705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:27 smithi055 ceph-mon[31863]: pgmap v9706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:27.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:41:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16888.105266 secs 2024-03-28T10:41:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16888.105266 secs 2024-03-28T10:41:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16888.105266 secs 2024-03-28T10:41:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:29 smithi055 ceph-mon[31863]: pgmap v9707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:29 smithi086 ceph-mon[35163]: pgmap v9707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:29 smithi159 ceph-mon[36109]: pgmap v9707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:31 smithi086 ceph-mon[35163]: pgmap v9708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:31 smithi159 ceph-mon[36109]: pgmap v9708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:31 smithi055 ceph-mon[31863]: pgmap v9708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:33 smithi086 ceph-mon[35163]: pgmap v9709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16893.105341 secs 2024-03-28T10:41:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:33 smithi159 ceph-mon[36109]: pgmap v9709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16893.105341 secs 2024-03-28T10:41:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:33 smithi055 ceph-mon[31863]: pgmap v9709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16893.105341 secs 2024-03-28T10:41:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:35 smithi086 ceph-mon[35163]: pgmap v9710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:35 smithi159 ceph-mon[36109]: pgmap v9710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:35 smithi055 ceph-mon[31863]: pgmap v9710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:37 smithi086 ceph-mon[35163]: pgmap v9711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:37 smithi159 ceph-mon[36109]: pgmap v9711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:37 smithi055 ceph-mon[31863]: pgmap v9711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:41:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16898.105422 secs 2024-03-28T10:41:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16898.105422 secs 2024-03-28T10:41:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16898.105422 secs 2024-03-28T10:41:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:39 smithi086 ceph-mon[35163]: pgmap v9712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:39 smithi159 ceph-mon[36109]: pgmap v9712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:39 smithi055 ceph-mon[31863]: pgmap v9712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:41:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:41 smithi086 ceph-mon[35163]: pgmap v9713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:41 smithi159 ceph-mon[36109]: pgmap v9713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:41 smithi055 ceph-mon[31863]: pgmap v9713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:41:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:43 smithi086 ceph-mon[35163]: pgmap v9714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16903.105536 secs 2024-03-28T10:41:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:43 smithi159 ceph-mon[36109]: pgmap v9714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16903.105536 secs 2024-03-28T10:41:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:43 smithi055 ceph-mon[31863]: pgmap v9714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16903.105536 secs 2024-03-28T10:41:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:45 smithi086 ceph-mon[35163]: pgmap v9715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:45 smithi159 ceph-mon[36109]: pgmap v9715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:45 smithi055 ceph-mon[31863]: pgmap v9715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:47 smithi086 ceph-mon[35163]: pgmap v9716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:47.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:47 smithi159 ceph-mon[36109]: pgmap v9716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:47 smithi055 ceph-mon[31863]: pgmap v9716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16908.105657 secs 2024-03-28T10:41:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16908.105657 secs 2024-03-28T10:41:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16908.105657 secs 2024-03-28T10:41:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:49 smithi086 ceph-mon[35163]: pgmap v9717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:49 smithi159 ceph-mon[36109]: pgmap v9717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:49 smithi055 ceph-mon[31863]: pgmap v9717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:50 smithi086 ceph-mon[35163]: pgmap v9718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:50 smithi159 ceph-mon[36109]: pgmap v9718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:50 smithi055 ceph-mon[31863]: pgmap v9718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:41:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:53 smithi086 ceph-mon[35163]: pgmap v9719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16913.105807 secs 2024-03-28T10:41:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:53 smithi159 ceph-mon[36109]: pgmap v9719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16913.105807 secs 2024-03-28T10:41:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:53 smithi055 ceph-mon[31863]: pgmap v9719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:41:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16913.105807 secs 2024-03-28T10:41:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:55 smithi086 ceph-mon[35163]: pgmap v9720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:55 smithi159 ceph-mon[36109]: pgmap v9720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:55 smithi055 ceph-mon[31863]: pgmap v9720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:57 smithi086 ceph-mon[35163]: pgmap v9721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:57 smithi159 ceph-mon[36109]: pgmap v9721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:57 smithi055 ceph-mon[31863]: pgmap v9721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16918.105928 secs 2024-03-28T10:41:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16918.105928 secs 2024-03-28T10:41:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16918.105928 secs 2024-03-28T10:41:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:41:59 smithi086 ceph-mon[35163]: pgmap v9722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:41:59 smithi159 ceph-mon[36109]: pgmap v9722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:41:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:41:59 smithi055 ceph-mon[31863]: pgmap v9722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:01 smithi086 ceph-mon[35163]: pgmap v9723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:01 smithi159 ceph-mon[36109]: pgmap v9723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:01 smithi055 ceph-mon[31863]: pgmap v9723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:03 smithi086 ceph-mon[35163]: pgmap v9724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16923.105994 secs 2024-03-28T10:42:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:03 smithi159 ceph-mon[36109]: pgmap v9724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16923.105994 secs 2024-03-28T10:42:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:03 smithi055 ceph-mon[31863]: pgmap v9724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:03.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16923.105994 secs 2024-03-28T10:42:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:04 smithi086 ceph-mon[35163]: pgmap v9725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:04 smithi159 ceph-mon[36109]: pgmap v9725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:04 smithi055 ceph-mon[31863]: pgmap v9725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:07 smithi086 ceph-mon[35163]: pgmap v9726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:07 smithi159 ceph-mon[36109]: pgmap v9726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:07 smithi055 ceph-mon[31863]: pgmap v9726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16928.106041 secs 2024-03-28T10:42:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16928.106041 secs 2024-03-28T10:42:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16928.106041 secs 2024-03-28T10:42:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:09 smithi086 ceph-mon[35163]: pgmap v9727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:09 smithi159 ceph-mon[36109]: pgmap v9727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:09 smithi055 ceph-mon[31863]: pgmap v9727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:11 smithi086 ceph-mon[35163]: pgmap v9728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:11 smithi159 ceph-mon[36109]: pgmap v9728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:11 smithi055 ceph-mon[31863]: pgmap v9728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:13 smithi086 ceph-mon[35163]: pgmap v9729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16933.106367 secs 2024-03-28T10:42:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:13 smithi159 ceph-mon[36109]: pgmap v9729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16933.106367 secs 2024-03-28T10:42:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:13 smithi055 ceph-mon[31863]: pgmap v9729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16933.106367 secs 2024-03-28T10:42:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:14 smithi055 ceph-mon[31863]: pgmap v9730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:14 smithi086 ceph-mon[35163]: pgmap v9730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:14 smithi159 ceph-mon[36109]: pgmap v9730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:17 smithi086 ceph-mon[35163]: pgmap v9731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:17 smithi159 ceph-mon[36109]: pgmap v9731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:17 smithi055 ceph-mon[31863]: pgmap v9731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16938.106484 secs 2024-03-28T10:42:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16938.106484 secs 2024-03-28T10:42:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16938.106484 secs 2024-03-28T10:42:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:19 smithi086 ceph-mon[35163]: pgmap v9732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:19 smithi159 ceph-mon[36109]: pgmap v9732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:19 smithi055 ceph-mon[31863]: pgmap v9732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:21 smithi086 ceph-mon[35163]: pgmap v9733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:21 smithi159 ceph-mon[36109]: pgmap v9733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:21 smithi055 ceph-mon[31863]: pgmap v9733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:23 smithi086 ceph-mon[35163]: pgmap v9734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16943.106556 secs 2024-03-28T10:42:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:23 smithi159 ceph-mon[36109]: pgmap v9734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16943.106556 secs 2024-03-28T10:42:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:23 smithi055 ceph-mon[31863]: pgmap v9734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16943.106556 secs 2024-03-28T10:42:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:25 smithi086 ceph-mon[35163]: pgmap v9735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:25 smithi159 ceph-mon[36109]: pgmap v9735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:25 smithi055 ceph-mon[31863]: pgmap v9735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:27 smithi086 ceph-mon[35163]: pgmap v9736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:42:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:27 smithi159 ceph-mon[36109]: pgmap v9736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:42:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:27 smithi055 ceph-mon[31863]: pgmap v9736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:42:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16948.106621 secs 2024-03-28T10:42:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:42:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:42:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:42:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16948.106621 secs 2024-03-28T10:42:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:42:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:42:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:42:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16948.106621 secs 2024-03-28T10:42:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:42:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:42:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:42:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:29 smithi086 ceph-mon[35163]: pgmap v9737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:29 smithi086 ceph-mon[35163]: pgmap v9738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:29 smithi159 ceph-mon[36109]: pgmap v9737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:29 smithi159 ceph-mon[36109]: pgmap v9738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:29 smithi055 ceph-mon[31863]: pgmap v9737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:29 smithi055 ceph-mon[31863]: pgmap v9738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:30 smithi086 ceph-mon[35163]: pgmap v9739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:30 smithi159 ceph-mon[36109]: pgmap v9739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:30 smithi055 ceph-mon[31863]: pgmap v9739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:33 smithi086 ceph-mon[35163]: pgmap v9740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16953.106742 secs 2024-03-28T10:42:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:33 smithi159 ceph-mon[36109]: pgmap v9740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16953.106742 secs 2024-03-28T10:42:33.576 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:33 smithi055 ceph-mon[31863]: pgmap v9740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:33.576 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16953.106742 secs 2024-03-28T10:42:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:35 smithi086 ceph-mon[35163]: pgmap v9741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:35 smithi159 ceph-mon[36109]: pgmap v9741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:35 smithi055 ceph-mon[31863]: pgmap v9741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:37 smithi086 ceph-mon[35163]: pgmap v9742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:37 smithi159 ceph-mon[36109]: pgmap v9742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:37 smithi055 ceph-mon[31863]: pgmap v9742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:42:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16958.106826 secs 2024-03-28T10:42:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16958.106826 secs 2024-03-28T10:42:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16958.106826 secs 2024-03-28T10:42:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:39 smithi086 ceph-mon[35163]: pgmap v9743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:42:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:39 smithi159 ceph-mon[36109]: pgmap v9743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:42:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:39 smithi055 ceph-mon[31863]: pgmap v9743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:42:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:41 smithi086 ceph-mon[35163]: pgmap v9744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:41 smithi159 ceph-mon[36109]: pgmap v9744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:41 smithi055 ceph-mon[31863]: pgmap v9744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:43 smithi055 ceph-mon[31863]: pgmap v9745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16963.106897 secs 2024-03-28T10:42:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:43 smithi086 ceph-mon[35163]: pgmap v9745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16963.106897 secs 2024-03-28T10:42:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:43 smithi159 ceph-mon[36109]: pgmap v9745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16963.106897 secs 2024-03-28T10:42:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:45 smithi055 ceph-mon[31863]: pgmap v9746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:45 smithi086 ceph-mon[35163]: pgmap v9746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:45 smithi159 ceph-mon[36109]: pgmap v9746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:47 smithi055 ceph-mon[31863]: pgmap v9747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:47 smithi086 ceph-mon[35163]: pgmap v9747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:47 smithi159 ceph-mon[36109]: pgmap v9747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16968.107014 secs 2024-03-28T10:42:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16968.107014 secs 2024-03-28T10:42:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16968.107014 secs 2024-03-28T10:42:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:49 smithi055 ceph-mon[31863]: pgmap v9748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:49 smithi086 ceph-mon[35163]: pgmap v9748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:49 smithi159 ceph-mon[36109]: pgmap v9748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:51 smithi055 ceph-mon[31863]: pgmap v9749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:51 smithi086 ceph-mon[35163]: pgmap v9749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:51 smithi159 ceph-mon[36109]: pgmap v9749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:53 smithi086 ceph-mon[35163]: pgmap v9750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16973.107100 secs 2024-03-28T10:42:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:53 smithi159 ceph-mon[36109]: pgmap v9750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16973.107100 secs 2024-03-28T10:42:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:53 smithi055 ceph-mon[31863]: pgmap v9750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:42:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16973.107100 secs 2024-03-28T10:42:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:55 smithi086 ceph-mon[35163]: pgmap v9751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:55 smithi159 ceph-mon[36109]: pgmap v9751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:55 smithi055 ceph-mon[31863]: pgmap v9751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:57 smithi086 ceph-mon[35163]: pgmap v9752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:57 smithi159 ceph-mon[36109]: pgmap v9752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:57 smithi055 ceph-mon[31863]: pgmap v9752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16978.107195 secs 2024-03-28T10:42:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16978.107195 secs 2024-03-28T10:42:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16978.107195 secs 2024-03-28T10:42:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:42:59 smithi086 ceph-mon[35163]: pgmap v9753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:42:59 smithi159 ceph-mon[36109]: pgmap v9753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:42:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:42:59 smithi055 ceph-mon[31863]: pgmap v9753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:01 smithi086 ceph-mon[35163]: pgmap v9754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:01.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:01 smithi159 ceph-mon[36109]: pgmap v9754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:01 smithi055 ceph-mon[31863]: pgmap v9754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:03.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:03 smithi055 ceph-mon[31863]: pgmap v9755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:03.676 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16983.107274 secs 2024-03-28T10:43:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:03 smithi086 ceph-mon[35163]: pgmap v9755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16983.107274 secs 2024-03-28T10:43:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:03 smithi159 ceph-mon[36109]: pgmap v9755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16983.107274 secs 2024-03-28T10:43:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:05 smithi086 ceph-mon[35163]: pgmap v9756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:05 smithi159 ceph-mon[36109]: pgmap v9756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:05 smithi055 ceph-mon[31863]: pgmap v9756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:07 smithi086 ceph-mon[35163]: pgmap v9757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:07 smithi159 ceph-mon[36109]: pgmap v9757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:07 smithi055 ceph-mon[31863]: pgmap v9757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:08.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16988.107341 secs 2024-03-28T10:43:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16988.107341 secs 2024-03-28T10:43:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16988.107341 secs 2024-03-28T10:43:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:09 smithi086 ceph-mon[35163]: pgmap v9758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:09 smithi159 ceph-mon[36109]: pgmap v9758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:09 smithi055 ceph-mon[31863]: pgmap v9758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:11 smithi086 ceph-mon[35163]: pgmap v9759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:11 smithi159 ceph-mon[36109]: pgmap v9759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:11 smithi055 ceph-mon[31863]: pgmap v9759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:13 smithi086 ceph-mon[35163]: pgmap v9760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16993.107463 secs 2024-03-28T10:43:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:13 smithi159 ceph-mon[36109]: pgmap v9760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16993.107463 secs 2024-03-28T10:43:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:13 smithi055 ceph-mon[31863]: pgmap v9760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16993.107463 secs 2024-03-28T10:43:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:15 smithi086 ceph-mon[35163]: pgmap v9761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:15 smithi159 ceph-mon[36109]: pgmap v9761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:15 smithi055 ceph-mon[31863]: pgmap v9761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:17 smithi086 ceph-mon[35163]: pgmap v9762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:17 smithi159 ceph-mon[36109]: pgmap v9762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:17 smithi055 ceph-mon[31863]: pgmap v9762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 16998.107587 secs 2024-03-28T10:43:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 16998.107587 secs 2024-03-28T10:43:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 16998.107587 secs 2024-03-28T10:43:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:19 smithi086 ceph-mon[35163]: pgmap v9763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:19 smithi159 ceph-mon[36109]: pgmap v9763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:19 smithi055 ceph-mon[31863]: pgmap v9763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:21 smithi086 ceph-mon[35163]: pgmap v9764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:21 smithi159 ceph-mon[36109]: pgmap v9764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:21 smithi055 ceph-mon[31863]: pgmap v9764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:43:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:23 smithi086 ceph-mon[35163]: pgmap v9765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17003.107708 secs 2024-03-28T10:43:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:23 smithi159 ceph-mon[36109]: pgmap v9765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17003.107708 secs 2024-03-28T10:43:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:23 smithi055 ceph-mon[31863]: pgmap v9765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17003.107708 secs 2024-03-28T10:43:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:25 smithi086 ceph-mon[35163]: pgmap v9766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:25 smithi159 ceph-mon[36109]: pgmap v9766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:25 smithi055 ceph-mon[31863]: pgmap v9766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:27 smithi086 ceph-mon[35163]: pgmap v9767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:27.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:27 smithi159 ceph-mon[36109]: pgmap v9767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:27 smithi055 ceph-mon[31863]: pgmap v9767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17008.107841 secs 2024-03-28T10:43:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:28 smithi086 ceph-mon[35163]: pgmap v9768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17008.107841 secs 2024-03-28T10:43:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:28 smithi159 ceph-mon[36109]: pgmap v9768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17008.107841 secs 2024-03-28T10:43:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:28 smithi055 ceph-mon[31863]: pgmap v9768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:43:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:43:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:43:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:43:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:43:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:30 smithi055 ceph-mon[31863]: pgmap v9769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:30 smithi055 ceph-mon[31863]: pgmap v9770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:43:30.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:30 smithi086 ceph-mon[35163]: pgmap v9769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:30 smithi086 ceph-mon[35163]: pgmap v9770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:43:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:43:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:43:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:43:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:30 smithi159 ceph-mon[36109]: pgmap v9769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:30 smithi159 ceph-mon[36109]: pgmap v9770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:43:31.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:43:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:33 smithi055 ceph-mon[31863]: pgmap v9771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17013.107920 secs 2024-03-28T10:43:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:33 smithi086 ceph-mon[35163]: pgmap v9771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17013.107920 secs 2024-03-28T10:43:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:33 smithi159 ceph-mon[36109]: pgmap v9771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17013.107920 secs 2024-03-28T10:43:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:35 smithi055 ceph-mon[31863]: pgmap v9772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:35 smithi086 ceph-mon[35163]: pgmap v9772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:35 smithi159 ceph-mon[36109]: pgmap v9772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:37 smithi055 ceph-mon[31863]: pgmap v9773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:37 smithi086 ceph-mon[35163]: pgmap v9773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:37 smithi159 ceph-mon[36109]: pgmap v9773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:38.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17018.107986 secs 2024-03-28T10:43:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17018.107986 secs 2024-03-28T10:43:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17018.107986 secs 2024-03-28T10:43:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:39 smithi086 ceph-mon[35163]: pgmap v9774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:39 smithi159 ceph-mon[36109]: pgmap v9774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:39 smithi055 ceph-mon[31863]: pgmap v9774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:43:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:41 smithi086 ceph-mon[35163]: pgmap v9775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:43:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:41 smithi159 ceph-mon[36109]: pgmap v9775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:43:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:41 smithi055 ceph-mon[31863]: pgmap v9775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:43:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:43 smithi086 ceph-mon[35163]: pgmap v9776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17023.108109 secs 2024-03-28T10:43:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:43 smithi159 ceph-mon[36109]: pgmap v9776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17023.108109 secs 2024-03-28T10:43:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:43 smithi055 ceph-mon[31863]: pgmap v9776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17023.108109 secs 2024-03-28T10:43:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:45 smithi086 ceph-mon[35163]: pgmap v9777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:45 smithi159 ceph-mon[36109]: pgmap v9777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:45.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:45 smithi055 ceph-mon[31863]: pgmap v9777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:47 smithi086 ceph-mon[35163]: pgmap v9778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:47 smithi159 ceph-mon[36109]: pgmap v9778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:47 smithi055 ceph-mon[31863]: pgmap v9778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17028.108231 secs 2024-03-28T10:43:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17028.108231 secs 2024-03-28T10:43:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17028.108231 secs 2024-03-28T10:43:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:49 smithi086 ceph-mon[35163]: pgmap v9779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:49 smithi159 ceph-mon[36109]: pgmap v9779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:49 smithi055 ceph-mon[31863]: pgmap v9779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:51 smithi086 ceph-mon[35163]: pgmap v9780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:51 smithi159 ceph-mon[36109]: pgmap v9780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:51 smithi055 ceph-mon[31863]: pgmap v9780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:53 smithi086 ceph-mon[35163]: pgmap v9781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17033.108351 secs 2024-03-28T10:43:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:53 smithi159 ceph-mon[36109]: pgmap v9781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17033.108351 secs 2024-03-28T10:43:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:53 smithi055 ceph-mon[31863]: pgmap v9781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17033.108351 secs 2024-03-28T10:43:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:55 smithi086 ceph-mon[35163]: pgmap v9782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:55.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:55 smithi159 ceph-mon[36109]: pgmap v9782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:55 smithi055 ceph-mon[31863]: pgmap v9782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:57 smithi086 ceph-mon[35163]: pgmap v9783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:57 smithi159 ceph-mon[36109]: pgmap v9783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:57 smithi055 ceph-mon[31863]: pgmap v9783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17038.108431 secs 2024-03-28T10:43:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17038.108431 secs 2024-03-28T10:43:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17038.108431 secs 2024-03-28T10:43:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:43:59 smithi086 ceph-mon[35163]: pgmap v9784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:43:59 smithi159 ceph-mon[36109]: pgmap v9784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:43:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:43:59 smithi055 ceph-mon[31863]: pgmap v9784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:01 smithi086 ceph-mon[35163]: pgmap v9785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:01 smithi159 ceph-mon[36109]: pgmap v9785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:01 smithi055 ceph-mon[31863]: pgmap v9785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:03 smithi086 ceph-mon[35163]: pgmap v9786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17043.108496 secs 2024-03-28T10:44:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:03 smithi159 ceph-mon[36109]: pgmap v9786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17043.108496 secs 2024-03-28T10:44:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:03 smithi055 ceph-mon[31863]: pgmap v9786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17043.108496 secs 2024-03-28T10:44:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:05 smithi086 ceph-mon[35163]: pgmap v9787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:05 smithi159 ceph-mon[36109]: pgmap v9787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:05 smithi055 ceph-mon[31863]: pgmap v9787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:07 smithi086 ceph-mon[35163]: pgmap v9788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:07 smithi159 ceph-mon[36109]: pgmap v9788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:07 smithi055 ceph-mon[31863]: pgmap v9788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17048.108558 secs 2024-03-28T10:44:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17048.108558 secs 2024-03-28T10:44:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17048.108558 secs 2024-03-28T10:44:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:09 smithi086 ceph-mon[35163]: pgmap v9789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:09 smithi159 ceph-mon[36109]: pgmap v9789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:09 smithi055 ceph-mon[31863]: pgmap v9789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:11 smithi086 ceph-mon[35163]: pgmap v9790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:11 smithi159 ceph-mon[36109]: pgmap v9790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:11 smithi055 ceph-mon[31863]: pgmap v9790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:13 smithi086 ceph-mon[35163]: pgmap v9791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17053.108662 secs 2024-03-28T10:44:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:13 smithi159 ceph-mon[36109]: pgmap v9791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17053.108662 secs 2024-03-28T10:44:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:13 smithi055 ceph-mon[31863]: pgmap v9791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17053.108662 secs 2024-03-28T10:44:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:15 smithi086 ceph-mon[35163]: pgmap v9792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:15 smithi159 ceph-mon[36109]: pgmap v9792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:15 smithi055 ceph-mon[31863]: pgmap v9792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:17 smithi086 ceph-mon[35163]: pgmap v9793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:17 smithi159 ceph-mon[36109]: pgmap v9793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:17 smithi055 ceph-mon[31863]: pgmap v9793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17058.108753 secs 2024-03-28T10:44:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17058.108753 secs 2024-03-28T10:44:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17058.108753 secs 2024-03-28T10:44:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:19 smithi086 ceph-mon[35163]: pgmap v9794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:19 smithi159 ceph-mon[36109]: pgmap v9794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:19 smithi055 ceph-mon[31863]: pgmap v9794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:21 smithi086 ceph-mon[35163]: pgmap v9795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:21 smithi159 ceph-mon[36109]: pgmap v9795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:21 smithi055 ceph-mon[31863]: pgmap v9795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:23 smithi086 ceph-mon[35163]: pgmap v9796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17063.108823 secs 2024-03-28T10:44:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:23 smithi159 ceph-mon[36109]: pgmap v9796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17063.108823 secs 2024-03-28T10:44:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:23 smithi055 ceph-mon[31863]: pgmap v9796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17063.108823 secs 2024-03-28T10:44:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:24 smithi086 ceph-mon[35163]: pgmap v9797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:24 smithi159 ceph-mon[36109]: pgmap v9797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:25.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:24 smithi055 ceph-mon[31863]: pgmap v9797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:27 smithi055 ceph-mon[31863]: pgmap v9798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:27 smithi086 ceph-mon[35163]: pgmap v9798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:27 smithi159 ceph-mon[36109]: pgmap v9798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17068.108891 secs 2024-03-28T10:44:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17068.108891 secs 2024-03-28T10:44:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17068.108891 secs 2024-03-28T10:44:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:29 smithi086 ceph-mon[35163]: pgmap v9799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:29 smithi159 ceph-mon[36109]: pgmap v9799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:29 smithi055 ceph-mon[31863]: pgmap v9799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:31 smithi086 ceph-mon[35163]: pgmap v9800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:44:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:31 smithi159 ceph-mon[36109]: pgmap v9800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:44:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:31 smithi055 ceph-mon[31863]: pgmap v9800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:44:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:33 smithi086 ceph-mon[35163]: pgmap v9801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17073.108986 secs 2024-03-28T10:44:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:33 smithi055 ceph-mon[31863]: pgmap v9801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17073.108986 secs 2024-03-28T10:44:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:33 smithi159 ceph-mon[36109]: pgmap v9801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17073.108986 secs 2024-03-28T10:44:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:35 smithi086 ceph-mon[35163]: pgmap v9802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:35 smithi055 ceph-mon[31863]: pgmap v9802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:35 smithi159 ceph-mon[36109]: pgmap v9802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: pgmap v9803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: pgmap v9803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: pgmap v9803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:37.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17078.109075 secs 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.473 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.474 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:44:38.474 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:44:38.474 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17078.109075 secs 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:44:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:44:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17078.109075 secs 2024-03-28T10:44:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:44:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:44:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:39 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:44:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:39 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:44:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:39 smithi086 ceph-mon[35163]: pgmap v9804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:39 smithi086 ceph-mon[35163]: pgmap v9805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:39 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:44:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:39 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:44:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:39 smithi159 ceph-mon[36109]: pgmap v9804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:39.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:39 smithi159 ceph-mon[36109]: pgmap v9805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:39 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:44:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:39 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:44:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:39 smithi055 ceph-mon[31863]: pgmap v9804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:39 smithi055 ceph-mon[31863]: pgmap v9805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:41 smithi086 ceph-mon[35163]: pgmap v9806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:41.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:41 smithi159 ceph-mon[36109]: pgmap v9806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:41 smithi055 ceph-mon[31863]: pgmap v9806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:43 smithi086 ceph-mon[35163]: pgmap v9807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17083.109133 secs 2024-03-28T10:44:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:43 smithi159 ceph-mon[36109]: pgmap v9807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17083.109133 secs 2024-03-28T10:44:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:43 smithi055 ceph-mon[31863]: pgmap v9807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17083.109133 secs 2024-03-28T10:44:45.542 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:45 smithi086 ceph-mon[35163]: pgmap v9808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:45.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:45 smithi159 ceph-mon[36109]: pgmap v9808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:45 smithi055 ceph-mon[31863]: pgmap v9808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:47 smithi086 ceph-mon[35163]: pgmap v9809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:44:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:47 smithi159 ceph-mon[36109]: pgmap v9809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:44:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:47 smithi055 ceph-mon[31863]: pgmap v9809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:44:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17088.109165 secs 2024-03-28T10:44:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17088.109165 secs 2024-03-28T10:44:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17088.109165 secs 2024-03-28T10:44:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:49 smithi086 ceph-mon[35163]: pgmap v9810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:49 smithi159 ceph-mon[36109]: pgmap v9810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:49 smithi055 ceph-mon[31863]: pgmap v9810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:44:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:51 smithi086 ceph-mon[35163]: pgmap v9811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:51 smithi159 ceph-mon[36109]: pgmap v9811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:51 smithi055 ceph-mon[31863]: pgmap v9811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:44:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:53 smithi086 ceph-mon[35163]: pgmap v9812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17093.109241 secs 2024-03-28T10:44:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:53 smithi159 ceph-mon[36109]: pgmap v9812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17093.109241 secs 2024-03-28T10:44:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:53 smithi055 ceph-mon[31863]: pgmap v9812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17093.109241 secs 2024-03-28T10:44:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:55 smithi086 ceph-mon[35163]: pgmap v9813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:55 smithi159 ceph-mon[36109]: pgmap v9813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:55.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:55 smithi055 ceph-mon[31863]: pgmap v9813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:57 smithi086 ceph-mon[35163]: pgmap v9814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:57.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:57 smithi055 ceph-mon[31863]: pgmap v9814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:57.625 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:57 smithi159 ceph-mon[36109]: pgmap v9814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17098.109319 secs 2024-03-28T10:44:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17098.109319 secs 2024-03-28T10:44:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17098.109319 secs 2024-03-28T10:44:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:44:59 smithi086 ceph-mon[35163]: pgmap v9815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:44:59 smithi159 ceph-mon[36109]: pgmap v9815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:44:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:44:59 smithi055 ceph-mon[31863]: pgmap v9815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:01 smithi086 ceph-mon[35163]: pgmap v9816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:01 smithi159 ceph-mon[36109]: pgmap v9816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:01 smithi055 ceph-mon[31863]: pgmap v9816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:03 smithi086 ceph-mon[35163]: pgmap v9817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17103.109397 secs 2024-03-28T10:45:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:03 smithi159 ceph-mon[36109]: pgmap v9817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17103.109397 secs 2024-03-28T10:45:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:03 smithi055 ceph-mon[31863]: pgmap v9817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17103.109397 secs 2024-03-28T10:45:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:05 smithi055 ceph-mon[31863]: pgmap v9818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:05 smithi086 ceph-mon[35163]: pgmap v9818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:05 smithi159 ceph-mon[36109]: pgmap v9818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:07 smithi086 ceph-mon[35163]: pgmap v9819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:07 smithi159 ceph-mon[36109]: pgmap v9819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:07 smithi055 ceph-mon[31863]: pgmap v9819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17108.109518 secs 2024-03-28T10:45:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17108.109518 secs 2024-03-28T10:45:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17108.109518 secs 2024-03-28T10:45:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:09 smithi086 ceph-mon[35163]: pgmap v9820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:09 smithi159 ceph-mon[36109]: pgmap v9820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:09 smithi055 ceph-mon[31863]: pgmap v9820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:11 smithi086 ceph-mon[35163]: pgmap v9821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:11 smithi159 ceph-mon[36109]: pgmap v9821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:11 smithi055 ceph-mon[31863]: pgmap v9821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:13 smithi055 ceph-mon[31863]: pgmap v9822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17113.109604 secs 2024-03-28T10:45:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:13 smithi086 ceph-mon[35163]: pgmap v9822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17113.109604 secs 2024-03-28T10:45:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:13 smithi159 ceph-mon[36109]: pgmap v9822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17113.109604 secs 2024-03-28T10:45:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:15 smithi055 ceph-mon[31863]: pgmap v9823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:15 smithi086 ceph-mon[35163]: pgmap v9823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:15 smithi159 ceph-mon[36109]: pgmap v9823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:17.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:17 smithi055 ceph-mon[31863]: pgmap v9824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:17 smithi086 ceph-mon[35163]: pgmap v9824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:17 smithi159 ceph-mon[36109]: pgmap v9824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17118.109724 secs 2024-03-28T10:45:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17118.109724 secs 2024-03-28T10:45:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17118.109724 secs 2024-03-28T10:45:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:19 smithi055 ceph-mon[31863]: pgmap v9825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:19 smithi086 ceph-mon[35163]: pgmap v9825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:19 smithi159 ceph-mon[36109]: pgmap v9825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:21.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:21 smithi055 ceph-mon[31863]: pgmap v9826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:21 smithi086 ceph-mon[35163]: pgmap v9826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:21 smithi159 ceph-mon[36109]: pgmap v9826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:23 smithi086 ceph-mon[35163]: pgmap v9827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17123.109855 secs 2024-03-28T10:45:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:23 smithi159 ceph-mon[36109]: pgmap v9827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17123.109855 secs 2024-03-28T10:45:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:23 smithi055 ceph-mon[31863]: pgmap v9827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17123.109855 secs 2024-03-28T10:45:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:25 smithi086 ceph-mon[35163]: pgmap v9828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:25 smithi159 ceph-mon[36109]: pgmap v9828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:25 smithi055 ceph-mon[31863]: pgmap v9828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:27 smithi086 ceph-mon[35163]: pgmap v9829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:27 smithi159 ceph-mon[36109]: pgmap v9829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:27 smithi055 ceph-mon[31863]: pgmap v9829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17128.109920 secs 2024-03-28T10:45:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17128.109920 secs 2024-03-28T10:45:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17128.109920 secs 2024-03-28T10:45:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:29 smithi086 ceph-mon[35163]: pgmap v9830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:29 smithi159 ceph-mon[36109]: pgmap v9830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:29 smithi055 ceph-mon[31863]: pgmap v9830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:31 smithi086 ceph-mon[35163]: pgmap v9831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:31 smithi159 ceph-mon[36109]: pgmap v9831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:31 smithi055 ceph-mon[31863]: pgmap v9831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:33 smithi086 ceph-mon[35163]: pgmap v9832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17133.109986 secs 2024-03-28T10:45:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:33 smithi159 ceph-mon[36109]: pgmap v9832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17133.109986 secs 2024-03-28T10:45:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:33 smithi055 ceph-mon[31863]: pgmap v9832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17133.109986 secs 2024-03-28T10:45:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:35 smithi086 ceph-mon[35163]: pgmap v9833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:35 smithi159 ceph-mon[36109]: pgmap v9833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:35 smithi055 ceph-mon[31863]: pgmap v9833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:37 smithi086 ceph-mon[35163]: pgmap v9834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:37 smithi159 ceph-mon[36109]: pgmap v9834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:37 smithi055 ceph-mon[31863]: pgmap v9834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:38.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17138.110107 secs 2024-03-28T10:45:38.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:45:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17138.110107 secs 2024-03-28T10:45:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:45:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17138.110107 secs 2024-03-28T10:45:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:45:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:39 smithi086 ceph-mon[35163]: pgmap v9835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:39 smithi159 ceph-mon[36109]: pgmap v9835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:39 smithi055 ceph-mon[31863]: pgmap v9835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:41.679 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:41 smithi159 ceph-mon[36109]: pgmap v9836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:41 smithi086 ceph-mon[35163]: pgmap v9836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:41 smithi055 ceph-mon[31863]: pgmap v9836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:43 smithi086 ceph-mon[35163]: pgmap v9837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17143.110185 secs 2024-03-28T10:45:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:43 smithi159 ceph-mon[36109]: pgmap v9837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17143.110185 secs 2024-03-28T10:45:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:43 smithi055 ceph-mon[31863]: pgmap v9837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17143.110185 secs 2024-03-28T10:45:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: pgmap v9838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:45:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:45:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: pgmap v9838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:45:45.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:45:45.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: pgmap v9838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:45:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:45:45.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:45:45.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:45:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:46 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:45:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:46 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:45:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:46 smithi086 ceph-mon[35163]: pgmap v9839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:45:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:46 smithi086 ceph-mon[35163]: pgmap v9840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:46 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:45:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:46 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:45:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:46 smithi159 ceph-mon[36109]: pgmap v9839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:45:46.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:46 smithi159 ceph-mon[36109]: pgmap v9840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:46 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:45:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:46 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:45:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:46 smithi055 ceph-mon[31863]: pgmap v9839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:45:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:46 smithi055 ceph-mon[31863]: pgmap v9840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:48 smithi086 ceph-mon[35163]: pgmap v9841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17148.110277 secs 2024-03-28T10:45:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:48 smithi159 ceph-mon[36109]: pgmap v9841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17148.110277 secs 2024-03-28T10:45:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:48 smithi055 ceph-mon[31863]: pgmap v9841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:45:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17148.110277 secs 2024-03-28T10:45:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:50 smithi086 ceph-mon[35163]: pgmap v9842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:50 smithi159 ceph-mon[36109]: pgmap v9842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:50 smithi055 ceph-mon[31863]: pgmap v9842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:52 smithi086 ceph-mon[35163]: pgmap v9843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:52 smithi159 ceph-mon[36109]: pgmap v9843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:52 smithi055 ceph-mon[31863]: pgmap v9843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17153.110397 secs 2024-03-28T10:45:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17153.110397 secs 2024-03-28T10:45:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17153.110397 secs 2024-03-28T10:45:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:54 smithi086 ceph-mon[35163]: pgmap v9844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:54 smithi159 ceph-mon[36109]: pgmap v9844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:54 smithi055 ceph-mon[31863]: pgmap v9844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T10:45:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:56 smithi086 ceph-mon[35163]: pgmap v9845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:45:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:56 smithi159 ceph-mon[36109]: pgmap v9845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:45:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:56 smithi055 ceph-mon[31863]: pgmap v9845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:45:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:58 smithi086 ceph-mon[35163]: pgmap v9846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:45:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17158.110472 secs 2024-03-28T10:45:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:58 smithi159 ceph-mon[36109]: pgmap v9846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:45:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17158.110472 secs 2024-03-28T10:45:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:58 smithi055 ceph-mon[31863]: pgmap v9846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:45:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:45:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17158.110472 secs 2024-03-28T10:46:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:00 smithi086 ceph-mon[35163]: pgmap v9847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:00 smithi159 ceph-mon[36109]: pgmap v9847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:00 smithi055 ceph-mon[31863]: pgmap v9847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:02 smithi086 ceph-mon[35163]: pgmap v9848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:02 smithi159 ceph-mon[36109]: pgmap v9848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:02 smithi055 ceph-mon[31863]: pgmap v9848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17163.110546 secs 2024-03-28T10:46:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17163.110546 secs 2024-03-28T10:46:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17163.110546 secs 2024-03-28T10:46:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:04 smithi055 ceph-mon[31863]: pgmap v9849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:04 smithi086 ceph-mon[35163]: pgmap v9849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:04 smithi159 ceph-mon[36109]: pgmap v9849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:05 smithi055 ceph-mon[31863]: pgmap v9850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:05 smithi086 ceph-mon[35163]: pgmap v9850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:05 smithi159 ceph-mon[36109]: pgmap v9850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:08 smithi086 ceph-mon[35163]: pgmap v9851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17168.110625 secs 2024-03-28T10:46:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:08 smithi159 ceph-mon[36109]: pgmap v9851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17168.110625 secs 2024-03-28T10:46:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:08 smithi055 ceph-mon[31863]: pgmap v9851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17168.110625 secs 2024-03-28T10:46:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:10 smithi086 ceph-mon[35163]: pgmap v9852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:10 smithi159 ceph-mon[36109]: pgmap v9852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:10 smithi055 ceph-mon[31863]: pgmap v9852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:12 smithi086 ceph-mon[35163]: pgmap v9853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:12 smithi159 ceph-mon[36109]: pgmap v9853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:12 smithi055 ceph-mon[31863]: pgmap v9853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17173.110747 secs 2024-03-28T10:46:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17173.110747 secs 2024-03-28T10:46:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17173.110747 secs 2024-03-28T10:46:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:14 smithi086 ceph-mon[35163]: pgmap v9854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:14 smithi159 ceph-mon[36109]: pgmap v9854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:14 smithi055 ceph-mon[31863]: pgmap v9854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:16 smithi086 ceph-mon[35163]: pgmap v9855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:16 smithi159 ceph-mon[36109]: pgmap v9855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:16 smithi055 ceph-mon[31863]: pgmap v9855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:18 smithi086 ceph-mon[35163]: pgmap v9856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17178.110873 secs 2024-03-28T10:46:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:18 smithi159 ceph-mon[36109]: pgmap v9856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17178.110873 secs 2024-03-28T10:46:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:18 smithi055 ceph-mon[31863]: pgmap v9856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17178.110873 secs 2024-03-28T10:46:20.365 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:20 smithi159 ceph-mon[36109]: pgmap v9857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:20 smithi055 ceph-mon[31863]: pgmap v9857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:20 smithi086 ceph-mon[35163]: pgmap v9857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:22 smithi055 ceph-mon[31863]: pgmap v9858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:22 smithi086 ceph-mon[35163]: pgmap v9858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:22 smithi159 ceph-mon[36109]: pgmap v9858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:23.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17183.110996 secs 2024-03-28T10:46:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17183.110996 secs 2024-03-28T10:46:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17183.110996 secs 2024-03-28T10:46:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:24 smithi055 ceph-mon[31863]: pgmap v9859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:24 smithi086 ceph-mon[35163]: pgmap v9859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:24.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:24 smithi159 ceph-mon[36109]: pgmap v9859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:26 smithi055 ceph-mon[31863]: pgmap v9860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:26 smithi086 ceph-mon[35163]: pgmap v9860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:26 smithi159 ceph-mon[36109]: pgmap v9860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:28 smithi086 ceph-mon[35163]: pgmap v9861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17188.111076 secs 2024-03-28T10:46:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:28 smithi159 ceph-mon[36109]: pgmap v9861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17188.111076 secs 2024-03-28T10:46:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:28 smithi055 ceph-mon[31863]: pgmap v9861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17188.111076 secs 2024-03-28T10:46:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:30 smithi086 ceph-mon[35163]: pgmap v9862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:30 smithi159 ceph-mon[36109]: pgmap v9862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:30 smithi055 ceph-mon[31863]: pgmap v9862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:32 smithi086 ceph-mon[35163]: pgmap v9863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:32 smithi159 ceph-mon[36109]: pgmap v9863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:32 smithi055 ceph-mon[31863]: pgmap v9863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:33.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17193.111160 secs 2024-03-28T10:46:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17193.111160 secs 2024-03-28T10:46:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17193.111160 secs 2024-03-28T10:46:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:34 smithi086 ceph-mon[35163]: pgmap v9864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:34 smithi159 ceph-mon[36109]: pgmap v9864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:34 smithi055 ceph-mon[31863]: pgmap v9864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:36 smithi086 ceph-mon[35163]: pgmap v9865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:36 smithi159 ceph-mon[36109]: pgmap v9865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:36 smithi055 ceph-mon[31863]: pgmap v9865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:38 smithi086 ceph-mon[35163]: pgmap v9866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17198.111232 secs 2024-03-28T10:46:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:38 smithi159 ceph-mon[36109]: pgmap v9866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17198.111232 secs 2024-03-28T10:46:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:38 smithi055 ceph-mon[31863]: pgmap v9866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17198.111232 secs 2024-03-28T10:46:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:40 smithi086 ceph-mon[35163]: pgmap v9867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:40 smithi159 ceph-mon[36109]: pgmap v9867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:40 smithi055 ceph-mon[31863]: pgmap v9867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:42 smithi086 ceph-mon[35163]: pgmap v9868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:42 smithi159 ceph-mon[36109]: pgmap v9868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:42 smithi055 ceph-mon[31863]: pgmap v9868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17203.111319 secs 2024-03-28T10:46:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17203.111319 secs 2024-03-28T10:46:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17203.111319 secs 2024-03-28T10:46:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:44 smithi086 ceph-mon[35163]: pgmap v9869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:44 smithi159 ceph-mon[36109]: pgmap v9869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:44 smithi055 ceph-mon[31863]: pgmap v9869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:46 smithi086 ceph-mon[35163]: pgmap v9870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:46:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:46 smithi159 ceph-mon[36109]: pgmap v9870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:46.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:46:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:46 smithi055 ceph-mon[31863]: pgmap v9870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:46:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:46:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:46:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:46:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:46:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:46:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:46:47.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:46:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:46:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:46:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:46:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:48 smithi086 ceph-mon[35163]: pgmap v9871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:48 smithi086 ceph-mon[35163]: pgmap v9872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17208.111396 secs 2024-03-28T10:46:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:48 smithi159 ceph-mon[36109]: pgmap v9871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:48 smithi159 ceph-mon[36109]: pgmap v9872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:48.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17208.111396 secs 2024-03-28T10:46:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:48 smithi055 ceph-mon[31863]: pgmap v9871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:46:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:48 smithi055 ceph-mon[31863]: pgmap v9872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17208.111396 secs 2024-03-28T10:46:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:50 smithi086 ceph-mon[35163]: pgmap v9873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:50 smithi159 ceph-mon[36109]: pgmap v9873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:50 smithi055 ceph-mon[31863]: pgmap v9873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:52 smithi086 ceph-mon[35163]: pgmap v9874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:52 smithi159 ceph-mon[36109]: pgmap v9874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:52 smithi055 ceph-mon[31863]: pgmap v9874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17213.111517 secs 2024-03-28T10:46:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17213.111517 secs 2024-03-28T10:46:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17213.111517 secs 2024-03-28T10:46:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:54 smithi086 ceph-mon[35163]: pgmap v9875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:46:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:54 smithi159 ceph-mon[36109]: pgmap v9875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:46:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:54 smithi055 ceph-mon[31863]: pgmap v9875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:46:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:56 smithi086 ceph-mon[35163]: pgmap v9876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:56 smithi159 ceph-mon[36109]: pgmap v9876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:56 smithi055 ceph-mon[31863]: pgmap v9876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:46:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:58 smithi086 ceph-mon[35163]: pgmap v9877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:46:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17218.111640 secs 2024-03-28T10:46:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:58 smithi159 ceph-mon[36109]: pgmap v9877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:46:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17218.111640 secs 2024-03-28T10:46:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:58 smithi055 ceph-mon[31863]: pgmap v9877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:46:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:46:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17218.111640 secs 2024-03-28T10:47:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:00 smithi086 ceph-mon[35163]: pgmap v9878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:00 smithi159 ceph-mon[36109]: pgmap v9878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:00 smithi055 ceph-mon[31863]: pgmap v9878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:02 smithi086 ceph-mon[35163]: pgmap v9879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:02 smithi159 ceph-mon[36109]: pgmap v9879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:02 smithi055 ceph-mon[31863]: pgmap v9879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17223.111765 secs 2024-03-28T10:47:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17223.111765 secs 2024-03-28T10:47:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17223.111765 secs 2024-03-28T10:47:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:04 smithi086 ceph-mon[35163]: pgmap v9880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:04 smithi159 ceph-mon[36109]: pgmap v9880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:04 smithi055 ceph-mon[31863]: pgmap v9880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:06.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:06 smithi055 ceph-mon[31863]: pgmap v9881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:06 smithi086 ceph-mon[35163]: pgmap v9881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:06 smithi159 ceph-mon[36109]: pgmap v9881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:08 smithi055 ceph-mon[31863]: pgmap v9882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17228.111881 secs 2024-03-28T10:47:08.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:08 smithi159 ceph-mon[36109]: pgmap v9882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:08.623 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17228.111881 secs 2024-03-28T10:47:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:08 smithi086 ceph-mon[35163]: pgmap v9882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17228.111881 secs 2024-03-28T10:47:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:10 smithi159 ceph-mon[36109]: pgmap v9883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:10 smithi055 ceph-mon[31863]: pgmap v9883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:10 smithi086 ceph-mon[35163]: pgmap v9883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:12.620 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:12 smithi086 ceph-mon[35163]: pgmap v9884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:12 smithi055 ceph-mon[31863]: pgmap v9884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:12 smithi159 ceph-mon[36109]: pgmap v9884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17233.111957 secs 2024-03-28T10:47:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17233.111957 secs 2024-03-28T10:47:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17233.111957 secs 2024-03-28T10:47:14.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:14 smithi055 ceph-mon[31863]: pgmap v9885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:14 smithi086 ceph-mon[35163]: pgmap v9885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:14 smithi159 ceph-mon[36109]: pgmap v9885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:16.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:16 smithi055 ceph-mon[31863]: pgmap v9886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:16 smithi086 ceph-mon[35163]: pgmap v9886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:16 smithi159 ceph-mon[36109]: pgmap v9886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:18 smithi055 ceph-mon[31863]: pgmap v9887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17238.112063 secs 2024-03-28T10:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:18 smithi086 ceph-mon[35163]: pgmap v9887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17238.112063 secs 2024-03-28T10:47:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:18 smithi159 ceph-mon[36109]: pgmap v9887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17238.112063 secs 2024-03-28T10:47:20.689 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:20 smithi159 ceph-mon[36109]: pgmap v9888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:20 smithi086 ceph-mon[35163]: pgmap v9888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:20 smithi055 ceph-mon[31863]: pgmap v9888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:22 smithi086 ceph-mon[35163]: pgmap v9889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:47:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:22 smithi159 ceph-mon[36109]: pgmap v9889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:47:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:22 smithi055 ceph-mon[31863]: pgmap v9889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:47:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17243.112151 secs 2024-03-28T10:47:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17243.112151 secs 2024-03-28T10:47:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17243.112151 secs 2024-03-28T10:47:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:24 smithi086 ceph-mon[35163]: pgmap v9890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:47:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:24 smithi159 ceph-mon[36109]: pgmap v9890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:47:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:24 smithi055 ceph-mon[31863]: pgmap v9890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:47:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:26 smithi086 ceph-mon[35163]: pgmap v9891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:26 smithi159 ceph-mon[36109]: pgmap v9891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:26 smithi055 ceph-mon[31863]: pgmap v9891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:28 smithi086 ceph-mon[35163]: pgmap v9892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17248.112270 secs 2024-03-28T10:47:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:28 smithi159 ceph-mon[36109]: pgmap v9892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17248.112270 secs 2024-03-28T10:47:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:28 smithi055 ceph-mon[31863]: pgmap v9892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:47:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17248.112270 secs 2024-03-28T10:47:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:30 smithi086 ceph-mon[35163]: pgmap v9893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:30 smithi159 ceph-mon[36109]: pgmap v9893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:30 smithi055 ceph-mon[31863]: pgmap v9893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:32 smithi086 ceph-mon[35163]: pgmap v9894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:32 smithi159 ceph-mon[36109]: pgmap v9894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:32 smithi055 ceph-mon[31863]: pgmap v9894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:33.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17253.112394 secs 2024-03-28T10:47:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17253.112394 secs 2024-03-28T10:47:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17253.112394 secs 2024-03-28T10:47:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:34 smithi086 ceph-mon[35163]: pgmap v9895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:34 smithi159 ceph-mon[36109]: pgmap v9895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:34 smithi055 ceph-mon[31863]: pgmap v9895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:36 smithi086 ceph-mon[35163]: pgmap v9896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:36 smithi159 ceph-mon[36109]: pgmap v9896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:36 smithi055 ceph-mon[31863]: pgmap v9896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:38 smithi086 ceph-mon[35163]: pgmap v9897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17258.112475 secs 2024-03-28T10:47:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:38 smithi159 ceph-mon[36109]: pgmap v9897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17258.112475 secs 2024-03-28T10:47:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:38 smithi055 ceph-mon[31863]: pgmap v9897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17258.112475 secs 2024-03-28T10:47:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:40 smithi086 ceph-mon[35163]: pgmap v9898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:40 smithi159 ceph-mon[36109]: pgmap v9898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:40 smithi055 ceph-mon[31863]: pgmap v9898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:42 smithi086 ceph-mon[35163]: pgmap v9899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:42 smithi159 ceph-mon[36109]: pgmap v9899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:42 smithi055 ceph-mon[31863]: pgmap v9899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:47:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17263.112600 secs 2024-03-28T10:47:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17263.112600 secs 2024-03-28T10:47:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17263.112600 secs 2024-03-28T10:47:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:44 smithi086 ceph-mon[35163]: pgmap v9900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:44 smithi159 ceph-mon[36109]: pgmap v9900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:44 smithi055 ceph-mon[31863]: pgmap v9900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:46 smithi086 ceph-mon[35163]: pgmap v9901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:46 smithi159 ceph-mon[36109]: pgmap v9901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:46 smithi055 ceph-mon[31863]: pgmap v9901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:47:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:47:47.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:47:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: pgmap v9902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17268.112676 secs 2024-03-28T10:47:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: pgmap v9902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17268.112676 secs 2024-03-28T10:47:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: pgmap v9902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17268.112676 secs 2024-03-28T10:47:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:48.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:50 smithi086 ceph-mon[35163]: pgmap v9903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:47:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:47:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:50 smithi159 ceph-mon[36109]: pgmap v9903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:47:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:47:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:50 smithi055 ceph-mon[31863]: pgmap v9903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:47:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:47:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:47:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:47:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:51 smithi086 ceph-mon[35163]: pgmap v9904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:47:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:51 smithi086 ceph-mon[35163]: pgmap v9905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:51 smithi159 ceph-mon[36109]: pgmap v9904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:47:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:51 smithi159 ceph-mon[36109]: pgmap v9905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:51 smithi055 ceph-mon[31863]: pgmap v9904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:47:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:51 smithi055 ceph-mon[31863]: pgmap v9905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:53 smithi086 ceph-mon[35163]: pgmap v9906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17273.112821 secs 2024-03-28T10:47:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:53 smithi159 ceph-mon[36109]: pgmap v9906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17273.112821 secs 2024-03-28T10:47:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:53 smithi055 ceph-mon[31863]: pgmap v9906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17273.112821 secs 2024-03-28T10:47:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:55 smithi086 ceph-mon[35163]: pgmap v9907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:55.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:55 smithi159 ceph-mon[36109]: pgmap v9907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:55 smithi055 ceph-mon[31863]: pgmap v9907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:47:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:57 smithi086 ceph-mon[35163]: pgmap v9908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T10:47:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:57 smithi159 ceph-mon[36109]: pgmap v9908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T10:47:57.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:57 smithi055 ceph-mon[31863]: pgmap v9908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-03-28T10:47:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17278.112909 secs 2024-03-28T10:47:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17278.112909 secs 2024-03-28T10:47:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17278.112909 secs 2024-03-28T10:47:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:47:59 smithi055 ceph-mon[31863]: pgmap v9909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:47:59 smithi086 ceph-mon[35163]: pgmap v9909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:47:59 smithi159 ceph-mon[36109]: pgmap v9909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:01 smithi055 ceph-mon[31863]: pgmap v9910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:01 smithi086 ceph-mon[35163]: pgmap v9910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:01 smithi159 ceph-mon[36109]: pgmap v9910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:03 smithi055 ceph-mon[31863]: pgmap v9911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17283.113009 secs 2024-03-28T10:48:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:03 smithi086 ceph-mon[35163]: pgmap v9911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17283.113009 secs 2024-03-28T10:48:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:03 smithi159 ceph-mon[36109]: pgmap v9911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17283.113009 secs 2024-03-28T10:48:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:04 smithi055 ceph-mon[31863]: pgmap v9912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:04 smithi086 ceph-mon[35163]: pgmap v9912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:04 smithi159 ceph-mon[36109]: pgmap v9912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:06 smithi086 ceph-mon[35163]: pgmap v9913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:06 smithi159 ceph-mon[36109]: pgmap v9913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:06 smithi055 ceph-mon[31863]: pgmap v9913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:08 smithi086 ceph-mon[35163]: pgmap v9914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:48:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17288.113082 secs 2024-03-28T10:48:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:08 smithi159 ceph-mon[36109]: pgmap v9914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:48:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17288.113082 secs 2024-03-28T10:48:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:08 smithi055 ceph-mon[31863]: pgmap v9914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:48:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17288.113082 secs 2024-03-28T10:48:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:10 smithi086 ceph-mon[35163]: pgmap v9915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:10 smithi159 ceph-mon[36109]: pgmap v9915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:10 smithi055 ceph-mon[31863]: pgmap v9915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:48:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:12 smithi086 ceph-mon[35163]: pgmap v9916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:12 smithi159 ceph-mon[36109]: pgmap v9916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:12 smithi055 ceph-mon[31863]: pgmap v9916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17293.113200 secs 2024-03-28T10:48:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17293.113200 secs 2024-03-28T10:48:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17293.113200 secs 2024-03-28T10:48:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:14 smithi086 ceph-mon[35163]: pgmap v9917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:14 smithi159 ceph-mon[36109]: pgmap v9917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:14 smithi055 ceph-mon[31863]: pgmap v9917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:48:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:16 smithi086 ceph-mon[35163]: pgmap v9918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:16 smithi159 ceph-mon[36109]: pgmap v9918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:16 smithi055 ceph-mon[31863]: pgmap v9918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:18 smithi086 ceph-mon[35163]: pgmap v9919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17298.113324 secs 2024-03-28T10:48:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:18 smithi159 ceph-mon[36109]: pgmap v9919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17298.113324 secs 2024-03-28T10:48:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:18 smithi055 ceph-mon[31863]: pgmap v9919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17298.113324 secs 2024-03-28T10:48:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:20 smithi086 ceph-mon[35163]: pgmap v9920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:20 smithi159 ceph-mon[36109]: pgmap v9920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:20 smithi055 ceph-mon[31863]: pgmap v9920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:22 smithi086 ceph-mon[35163]: pgmap v9921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:22 smithi159 ceph-mon[36109]: pgmap v9921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:22 smithi055 ceph-mon[31863]: pgmap v9921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17303.113346 secs 2024-03-28T10:48:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17303.113346 secs 2024-03-28T10:48:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17303.113346 secs 2024-03-28T10:48:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:24 smithi086 ceph-mon[35163]: pgmap v9922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:24 smithi159 ceph-mon[36109]: pgmap v9922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:24 smithi055 ceph-mon[31863]: pgmap v9922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:26 smithi086 ceph-mon[35163]: pgmap v9923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:26 smithi159 ceph-mon[36109]: pgmap v9923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:26 smithi055 ceph-mon[31863]: pgmap v9923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:28 smithi086 ceph-mon[35163]: pgmap v9924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17308.113468 secs 2024-03-28T10:48:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:28 smithi159 ceph-mon[36109]: pgmap v9924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17308.113468 secs 2024-03-28T10:48:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:28 smithi055 ceph-mon[31863]: pgmap v9924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17308.113468 secs 2024-03-28T10:48:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:30 smithi086 ceph-mon[35163]: pgmap v9925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:30 smithi159 ceph-mon[36109]: pgmap v9925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:30 smithi055 ceph-mon[31863]: pgmap v9925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:32 smithi055 ceph-mon[31863]: pgmap v9926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:32 smithi086 ceph-mon[35163]: pgmap v9926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:32 smithi159 ceph-mon[36109]: pgmap v9926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17313.113583 secs 2024-03-28T10:48:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17313.113583 secs 2024-03-28T10:48:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17313.113583 secs 2024-03-28T10:48:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:34 smithi055 ceph-mon[31863]: pgmap v9927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:34 smithi086 ceph-mon[35163]: pgmap v9927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:34 smithi159 ceph-mon[36109]: pgmap v9927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:36 smithi055 ceph-mon[31863]: pgmap v9928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:36 smithi086 ceph-mon[35163]: pgmap v9928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:36 smithi159 ceph-mon[36109]: pgmap v9928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:39.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:38 smithi159 ceph-mon[36109]: pgmap v9929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:39.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17318.113704 secs 2024-03-28T10:48:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:38 smithi055 ceph-mon[31863]: pgmap v9929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:39.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17318.113704 secs 2024-03-28T10:48:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:38 smithi086 ceph-mon[35163]: pgmap v9929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17318.113704 secs 2024-03-28T10:48:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:40 smithi055 ceph-mon[31863]: pgmap v9930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:40 smithi086 ceph-mon[35163]: pgmap v9930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:40 smithi159 ceph-mon[36109]: pgmap v9930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:43.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:42 smithi086 ceph-mon[35163]: pgmap v9931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:42 smithi055 ceph-mon[31863]: pgmap v9931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:42 smithi159 ceph-mon[36109]: pgmap v9931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17323.113844 secs 2024-03-28T10:48:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17323.113844 secs 2024-03-28T10:48:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17323.113844 secs 2024-03-28T10:48:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:44 smithi086 ceph-mon[35163]: pgmap v9932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:44 smithi159 ceph-mon[36109]: pgmap v9932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:44 smithi055 ceph-mon[31863]: pgmap v9932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:46 smithi086 ceph-mon[35163]: pgmap v9933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:46 smithi159 ceph-mon[36109]: pgmap v9933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:46 smithi055 ceph-mon[31863]: pgmap v9933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:48 smithi086 ceph-mon[35163]: pgmap v9934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17328.113968 secs 2024-03-28T10:48:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:48 smithi159 ceph-mon[36109]: pgmap v9934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17328.113968 secs 2024-03-28T10:48:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:48 smithi055 ceph-mon[31863]: pgmap v9934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:48:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17328.113968 secs 2024-03-28T10:48:51.251 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:50 smithi086 ceph-mon[35163]: pgmap v9935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:51.252 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:48:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:50 smithi159 ceph-mon[36109]: pgmap v9935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:48:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:50 smithi055 ceph-mon[31863]: pgmap v9935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:48:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:52 smithi086 ceph-mon[35163]: pgmap v9936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:52 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17333.114078 secs 2024-03-28T10:48:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:52 smithi159 ceph-mon[36109]: pgmap v9936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:52 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17333.114078 secs 2024-03-28T10:48:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:52 smithi055 ceph-mon[31863]: pgmap v9936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:52 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17333.114078 secs 2024-03-28T10:48:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:54 smithi086 ceph-mon[35163]: pgmap v9937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:54 smithi159 ceph-mon[36109]: pgmap v9937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:54 smithi055 ceph-mon[31863]: pgmap v9937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:48:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: pgmap v9938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:48:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:48:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: pgmap v9939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T10:48:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: pgmap v9940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:48:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: pgmap v9938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:48:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:48:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: pgmap v9939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T10:48:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: pgmap v9940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:48:57.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: pgmap v9938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:48:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:48:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:48:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: pgmap v9939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T10:48:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: pgmap v9940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:48:57.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:48:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17338.114196 secs 2024-03-28T10:48:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17338.114196 secs 2024-03-28T10:48:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17338.114196 secs 2024-03-28T10:48:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:48:59 smithi086 ceph-mon[35163]: pgmap v9941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:48:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:48:59 smithi159 ceph-mon[36109]: pgmap v9941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:48:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:48:59 smithi055 ceph-mon[31863]: pgmap v9941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:49:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:01 smithi086 ceph-mon[35163]: pgmap v9942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:01 smithi159 ceph-mon[36109]: pgmap v9942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:01 smithi055 ceph-mon[31863]: pgmap v9942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:03 smithi086 ceph-mon[35163]: pgmap v9943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17343.114315 secs 2024-03-28T10:49:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:03 smithi159 ceph-mon[36109]: pgmap v9943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:03.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17343.114315 secs 2024-03-28T10:49:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:03 smithi055 ceph-mon[31863]: pgmap v9943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:49:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17343.114315 secs 2024-03-28T10:49:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:05 smithi086 ceph-mon[35163]: pgmap v9944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:49:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:05 smithi159 ceph-mon[36109]: pgmap v9944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:49:05.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:05 smithi055 ceph-mon[31863]: pgmap v9944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T10:49:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:07 smithi086 ceph-mon[35163]: pgmap v9945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:49:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:07 smithi159 ceph-mon[36109]: pgmap v9945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:49:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:07 smithi055 ceph-mon[31863]: pgmap v9945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:49:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17348.114449 secs 2024-03-28T10:49:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17348.114449 secs 2024-03-28T10:49:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17348.114449 secs 2024-03-28T10:49:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:09 smithi086 ceph-mon[35163]: pgmap v9946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:09 smithi159 ceph-mon[36109]: pgmap v9946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:09 smithi055 ceph-mon[31863]: pgmap v9946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:11 smithi086 ceph-mon[35163]: pgmap v9947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:11 smithi159 ceph-mon[36109]: pgmap v9947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:11 smithi055 ceph-mon[31863]: pgmap v9947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:13 smithi086 ceph-mon[35163]: pgmap v9948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17353.114571 secs 2024-03-28T10:49:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:13 smithi159 ceph-mon[36109]: pgmap v9948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:13.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17353.114571 secs 2024-03-28T10:49:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:13 smithi055 ceph-mon[31863]: pgmap v9948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17353.114571 secs 2024-03-28T10:49:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:15 smithi086 ceph-mon[35163]: pgmap v9949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:15 smithi159 ceph-mon[36109]: pgmap v9949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:15 smithi055 ceph-mon[31863]: pgmap v9949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:17 smithi086 ceph-mon[35163]: pgmap v9950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:17 smithi159 ceph-mon[36109]: pgmap v9950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:17 smithi055 ceph-mon[31863]: pgmap v9950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17358.114692 secs 2024-03-28T10:49:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17358.114692 secs 2024-03-28T10:49:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17358.114692 secs 2024-03-28T10:49:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:19 smithi086 ceph-mon[35163]: pgmap v9951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:19 smithi159 ceph-mon[36109]: pgmap v9951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:19 smithi055 ceph-mon[31863]: pgmap v9951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:21 smithi055 ceph-mon[31863]: pgmap v9952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:21 smithi086 ceph-mon[35163]: pgmap v9952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:21 smithi159 ceph-mon[36109]: pgmap v9952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:23 smithi055 ceph-mon[31863]: pgmap v9953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17363.114856 secs 2024-03-28T10:49:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:23 smithi086 ceph-mon[35163]: pgmap v9953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17363.114856 secs 2024-03-28T10:49:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:23 smithi159 ceph-mon[36109]: pgmap v9953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17363.114856 secs 2024-03-28T10:49:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:25 smithi055 ceph-mon[31863]: pgmap v9954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:25 smithi086 ceph-mon[35163]: pgmap v9954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:25.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:25 smithi159 ceph-mon[36109]: pgmap v9954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:27.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:27 smithi055 ceph-mon[31863]: pgmap v9955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:27 smithi086 ceph-mon[35163]: pgmap v9955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:27 smithi159 ceph-mon[36109]: pgmap v9955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17368.114979 secs 2024-03-28T10:49:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17368.114979 secs 2024-03-28T10:49:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17368.114979 secs 2024-03-28T10:49:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:29 smithi055 ceph-mon[31863]: pgmap v9956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:29 smithi086 ceph-mon[35163]: pgmap v9956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:29 smithi159 ceph-mon[36109]: pgmap v9956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:31 smithi055 ceph-mon[31863]: pgmap v9957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:31 smithi086 ceph-mon[35163]: pgmap v9957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:31 smithi159 ceph-mon[36109]: pgmap v9957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:33 smithi086 ceph-mon[35163]: pgmap v9958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17373.115080 secs 2024-03-28T10:49:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:33 smithi159 ceph-mon[36109]: pgmap v9958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17373.115080 secs 2024-03-28T10:49:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:33 smithi055 ceph-mon[31863]: pgmap v9958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17373.115080 secs 2024-03-28T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:35 smithi055 ceph-mon[31863]: pgmap v9959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:35 smithi086 ceph-mon[35163]: pgmap v9959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:35 smithi159 ceph-mon[36109]: pgmap v9959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:37 smithi086 ceph-mon[35163]: pgmap v9960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:37.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:37 smithi159 ceph-mon[36109]: pgmap v9960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:37 smithi055 ceph-mon[31863]: pgmap v9960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17378.115202 secs 2024-03-28T10:49:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17378.115202 secs 2024-03-28T10:49:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17378.115202 secs 2024-03-28T10:49:39.723 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:39 smithi159 ceph-mon[36109]: pgmap v9961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:39 smithi086 ceph-mon[35163]: pgmap v9961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:39 smithi055 ceph-mon[31863]: pgmap v9961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:41 smithi086 ceph-mon[35163]: pgmap v9962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:41.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:41 smithi159 ceph-mon[36109]: pgmap v9962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:41 smithi055 ceph-mon[31863]: pgmap v9962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:43 smithi086 ceph-mon[35163]: pgmap v9963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17383.115283 secs 2024-03-28T10:49:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:43 smithi159 ceph-mon[36109]: pgmap v9963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:43.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17383.115283 secs 2024-03-28T10:49:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:43 smithi055 ceph-mon[31863]: pgmap v9963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17383.115283 secs 2024-03-28T10:49:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:44 smithi055 ceph-mon[31863]: pgmap v9964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:44 smithi086 ceph-mon[35163]: pgmap v9964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:44 smithi159 ceph-mon[36109]: pgmap v9964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:47 smithi086 ceph-mon[35163]: pgmap v9965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:47 smithi159 ceph-mon[36109]: pgmap v9965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:47 smithi055 ceph-mon[31863]: pgmap v9965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17388.115406 secs 2024-03-28T10:49:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17388.115406 secs 2024-03-28T10:49:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17388.115406 secs 2024-03-28T10:49:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:49 smithi086 ceph-mon[35163]: pgmap v9966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:49 smithi159 ceph-mon[36109]: pgmap v9966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:49 smithi055 ceph-mon[31863]: pgmap v9966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:51 smithi086 ceph-mon[35163]: pgmap v9967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:51 smithi159 ceph-mon[36109]: pgmap v9967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:51 smithi055 ceph-mon[31863]: pgmap v9967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:49:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:53 smithi086 ceph-mon[35163]: pgmap v9968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17393.115465 secs 2024-03-28T10:49:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:53 smithi159 ceph-mon[36109]: pgmap v9968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17393.115465 secs 2024-03-28T10:49:53.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:53 smithi055 ceph-mon[31863]: pgmap v9968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17393.115465 secs 2024-03-28T10:49:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:55 smithi086 ceph-mon[35163]: pgmap v9969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:55 smithi159 ceph-mon[36109]: pgmap v9969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:55 smithi055 ceph-mon[31863]: pgmap v9969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:57 smithi086 ceph-mon[35163]: pgmap v9970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:49:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:57 smithi159 ceph-mon[36109]: pgmap v9970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:49:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:57 smithi055 ceph-mon[31863]: pgmap v9970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:49:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17398.115551 secs 2024-03-28T10:49:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:49:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:49:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:49:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17398.115551 secs 2024-03-28T10:49:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:49:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:49:58.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:49:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17398.115551 secs 2024-03-28T10:49:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:49:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:49:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:49:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:49:59 smithi055 ceph-mon[31863]: pgmap v9971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:49:59 smithi086 ceph-mon[35163]: pgmap v9971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:49:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:49:59 smithi159 ceph-mon[36109]: pgmap v9971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:50:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:50:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T10:50:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:01 smithi055 ceph-mon[31863]: pgmap v9972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:01 smithi086 ceph-mon[35163]: pgmap v9972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:01 smithi159 ceph-mon[36109]: pgmap v9972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:03 smithi055 ceph-mon[31863]: pgmap v9973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17403.115682 secs 2024-03-28T10:50:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:03 smithi086 ceph-mon[35163]: pgmap v9973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17403.115682 secs 2024-03-28T10:50:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:03 smithi159 ceph-mon[36109]: pgmap v9973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17403.115682 secs 2024-03-28T10:50:05.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:05 smithi055 ceph-mon[31863]: pgmap v9974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:05 smithi086 ceph-mon[35163]: pgmap v9974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:05 smithi159 ceph-mon[36109]: pgmap v9974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:07 smithi055 ceph-mon[31863]: pgmap v9975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:07.652 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:07 smithi086 ceph-mon[35163]: pgmap v9975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:07 smithi159 ceph-mon[36109]: pgmap v9975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17408.115773 secs 2024-03-28T10:50:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17408.115773 secs 2024-03-28T10:50:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17408.115773 secs 2024-03-28T10:50:09.722 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:09 smithi159 ceph-mon[36109]: pgmap v9976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:09 smithi086 ceph-mon[35163]: pgmap v9976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:09 smithi055 ceph-mon[31863]: pgmap v9976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:11 smithi086 ceph-mon[35163]: pgmap v9977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:11 smithi159 ceph-mon[36109]: pgmap v9977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:11 smithi055 ceph-mon[31863]: pgmap v9977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:13 smithi086 ceph-mon[35163]: pgmap v9978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17413.115809 secs 2024-03-28T10:50:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:13 smithi159 ceph-mon[36109]: pgmap v9978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17413.115809 secs 2024-03-28T10:50:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:13 smithi055 ceph-mon[31863]: pgmap v9978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17413.115809 secs 2024-03-28T10:50:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:15 smithi086 ceph-mon[35163]: pgmap v9979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:15 smithi159 ceph-mon[36109]: pgmap v9979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:15.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:15 smithi055 ceph-mon[31863]: pgmap v9979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:17 smithi086 ceph-mon[35163]: pgmap v9980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:17 smithi159 ceph-mon[36109]: pgmap v9980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:17 smithi055 ceph-mon[31863]: pgmap v9980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17418.115925 secs 2024-03-28T10:50:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17418.115925 secs 2024-03-28T10:50:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17418.115925 secs 2024-03-28T10:50:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:19 smithi086 ceph-mon[35163]: pgmap v9981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:19 smithi159 ceph-mon[36109]: pgmap v9981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:19.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:19 smithi055 ceph-mon[31863]: pgmap v9981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:21 smithi086 ceph-mon[35163]: pgmap v9982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:21.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:21 smithi159 ceph-mon[36109]: pgmap v9982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:21.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:21 smithi055 ceph-mon[31863]: pgmap v9982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:23 smithi086 ceph-mon[35163]: pgmap v9983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17423.116016 secs 2024-03-28T10:50:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:23 smithi159 ceph-mon[36109]: pgmap v9983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17423.116016 secs 2024-03-28T10:50:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:23 smithi055 ceph-mon[31863]: pgmap v9983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17423.116016 secs 2024-03-28T10:50:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:25 smithi086 ceph-mon[35163]: pgmap v9984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:25 smithi159 ceph-mon[36109]: pgmap v9984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:25.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:25 smithi055 ceph-mon[31863]: pgmap v9984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:27 smithi159 ceph-mon[36109]: pgmap v9985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:27 smithi086 ceph-mon[35163]: pgmap v9985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:27 smithi055 ceph-mon[31863]: pgmap v9985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17428.116134 secs 2024-03-28T10:50:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17428.116134 secs 2024-03-28T10:50:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17428.116134 secs 2024-03-28T10:50:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:29 smithi086 ceph-mon[35163]: pgmap v9986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:29 smithi159 ceph-mon[36109]: pgmap v9986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:29 smithi055 ceph-mon[31863]: pgmap v9986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:31 smithi086 ceph-mon[35163]: pgmap v9987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:31 smithi159 ceph-mon[36109]: pgmap v9987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:31 smithi055 ceph-mon[31863]: pgmap v9987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:33 smithi086 ceph-mon[35163]: pgmap v9988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17433.116219 secs 2024-03-28T10:50:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:33 smithi159 ceph-mon[36109]: pgmap v9988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17433.116219 secs 2024-03-28T10:50:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:33 smithi055 ceph-mon[31863]: pgmap v9988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17433.116219 secs 2024-03-28T10:50:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:35 smithi086 ceph-mon[35163]: pgmap v9989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:35 smithi159 ceph-mon[36109]: pgmap v9989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:35 smithi055 ceph-mon[31863]: pgmap v9989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:37 smithi086 ceph-mon[35163]: pgmap v9990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:37 smithi159 ceph-mon[36109]: pgmap v9990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:37 smithi055 ceph-mon[31863]: pgmap v9990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17438.116338 secs 2024-03-28T10:50:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17438.116338 secs 2024-03-28T10:50:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17438.116338 secs 2024-03-28T10:50:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:39 smithi086 ceph-mon[35163]: pgmap v9991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:39.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:39 smithi159 ceph-mon[36109]: pgmap v9991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:39 smithi055 ceph-mon[31863]: pgmap v9991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:41 smithi086 ceph-mon[35163]: pgmap v9992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:41 smithi159 ceph-mon[36109]: pgmap v9992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:41 smithi055 ceph-mon[31863]: pgmap v9992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:43 smithi086 ceph-mon[35163]: pgmap v9993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17443.116466 secs 2024-03-28T10:50:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:43 smithi159 ceph-mon[36109]: pgmap v9993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17443.116466 secs 2024-03-28T10:50:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:43 smithi055 ceph-mon[31863]: pgmap v9993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17443.116466 secs 2024-03-28T10:50:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:45 smithi086 ceph-mon[35163]: pgmap v9994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:45 smithi159 ceph-mon[36109]: pgmap v9994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:45 smithi055 ceph-mon[31863]: pgmap v9994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:47 smithi086 ceph-mon[35163]: pgmap v9995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:47 smithi159 ceph-mon[36109]: pgmap v9995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:47 smithi055 ceph-mon[31863]: pgmap v9995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17448.116587 secs 2024-03-28T10:50:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17448.116587 secs 2024-03-28T10:50:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17448.116587 secs 2024-03-28T10:50:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:49 smithi055 ceph-mon[31863]: pgmap v9996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:49 smithi086 ceph-mon[35163]: pgmap v9996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:49 smithi159 ceph-mon[36109]: pgmap v9996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:51.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:51 smithi055 ceph-mon[31863]: pgmap v9997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:51 smithi086 ceph-mon[35163]: pgmap v9997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:52.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:51 smithi159 ceph-mon[36109]: pgmap v9997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:50:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:53 smithi055 ceph-mon[31863]: pgmap v9998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17453.116713 secs 2024-03-28T10:50:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:53 smithi086 ceph-mon[35163]: pgmap v9998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17453.116713 secs 2024-03-28T10:50:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:53 smithi159 ceph-mon[36109]: pgmap v9998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17453.116713 secs 2024-03-28T10:50:55.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:55 smithi055 ceph-mon[31863]: pgmap v9999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:55 smithi086 ceph-mon[35163]: pgmap v9999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:55 smithi159 ceph-mon[36109]: pgmap v9999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:57 smithi055 ceph-mon[31863]: pgmap v10000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:57 smithi086 ceph-mon[35163]: pgmap v10000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:57 smithi159 ceph-mon[36109]: pgmap v10000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:50:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17458.116831 secs 2024-03-28T10:50:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:50:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17458.116831 secs 2024-03-28T10:50:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:50:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17458.116831 secs 2024-03-28T10:50:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:50:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:50:59 smithi055 ceph-mon[31863]: pgmap v10001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:50:59 smithi086 ceph-mon[35163]: pgmap v10001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:50:59 smithi159 ceph-mon[36109]: pgmap v10001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:00 smithi086 ceph-mon[35163]: pgmap v10002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:51:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:51:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:51:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:00 smithi159 ceph-mon[36109]: pgmap v10002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:51:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:51:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:51:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:00 smithi055 ceph-mon[31863]: pgmap v10002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:51:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:01 smithi086 ceph-mon[35163]: pgmap v10003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:01 smithi159 ceph-mon[36109]: pgmap v10003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:01 smithi055 ceph-mon[31863]: pgmap v10003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17463.116916 secs 2024-03-28T10:51:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17463.116916 secs 2024-03-28T10:51:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17463.116916 secs 2024-03-28T10:51:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:04 smithi086 ceph-mon[35163]: pgmap v10004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:04 smithi159 ceph-mon[36109]: pgmap v10004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:04 smithi055 ceph-mon[31863]: pgmap v10004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:05 smithi086 ceph-mon[35163]: pgmap v10005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:05 smithi159 ceph-mon[36109]: pgmap v10005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:05 smithi055 ceph-mon[31863]: pgmap v10005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:08 smithi086 ceph-mon[35163]: pgmap v10006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17468.117054 secs 2024-03-28T10:51:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:08 smithi159 ceph-mon[36109]: pgmap v10006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17468.117054 secs 2024-03-28T10:51:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:08 smithi055 ceph-mon[31863]: pgmap v10006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17468.117054 secs 2024-03-28T10:51:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:10 smithi086 ceph-mon[35163]: pgmap v10007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:10 smithi159 ceph-mon[36109]: pgmap v10007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:10 smithi055 ceph-mon[31863]: pgmap v10007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:12 smithi086 ceph-mon[35163]: pgmap v10008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:12 smithi159 ceph-mon[36109]: pgmap v10008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:12 smithi055 ceph-mon[31863]: pgmap v10008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17473.117167 secs 2024-03-28T10:51:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17473.117167 secs 2024-03-28T10:51:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17473.117167 secs 2024-03-28T10:51:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:14 smithi086 ceph-mon[35163]: pgmap v10009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:14 smithi159 ceph-mon[36109]: pgmap v10009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:14 smithi055 ceph-mon[31863]: pgmap v10009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:16 smithi086 ceph-mon[35163]: pgmap v10010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:16 smithi159 ceph-mon[36109]: pgmap v10010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:16 smithi055 ceph-mon[31863]: pgmap v10010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:18 smithi086 ceph-mon[35163]: pgmap v10011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17478.117291 secs 2024-03-28T10:51:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:18 smithi159 ceph-mon[36109]: pgmap v10011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17478.117291 secs 2024-03-28T10:51:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:18 smithi055 ceph-mon[31863]: pgmap v10011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17478.117291 secs 2024-03-28T10:51:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:20 smithi086 ceph-mon[35163]: pgmap v10012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:20 smithi159 ceph-mon[36109]: pgmap v10012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:20 smithi055 ceph-mon[31863]: pgmap v10012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:22 smithi086 ceph-mon[35163]: pgmap v10013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:22 smithi159 ceph-mon[36109]: pgmap v10013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:22 smithi055 ceph-mon[31863]: pgmap v10013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17483.117417 secs 2024-03-28T10:51:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17483.117417 secs 2024-03-28T10:51:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17483.117417 secs 2024-03-28T10:51:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:24 smithi086 ceph-mon[35163]: pgmap v10014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:24 smithi159 ceph-mon[36109]: pgmap v10014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:24 smithi055 ceph-mon[31863]: pgmap v10014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:26 smithi086 ceph-mon[35163]: pgmap v10015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:26 smithi159 ceph-mon[36109]: pgmap v10015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:26 smithi055 ceph-mon[31863]: pgmap v10015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:28 smithi086 ceph-mon[35163]: pgmap v10016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17488.117504 secs 2024-03-28T10:51:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:28 smithi159 ceph-mon[36109]: pgmap v10016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17488.117504 secs 2024-03-28T10:51:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:28 smithi055 ceph-mon[31863]: pgmap v10016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17488.117504 secs 2024-03-28T10:51:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:30 smithi086 ceph-mon[35163]: pgmap v10017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:30 smithi159 ceph-mon[36109]: pgmap v10017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:30 smithi055 ceph-mon[31863]: pgmap v10017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:32 smithi086 ceph-mon[35163]: pgmap v10018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:32 smithi159 ceph-mon[36109]: pgmap v10018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:32 smithi055 ceph-mon[31863]: pgmap v10018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17493.117638 secs 2024-03-28T10:51:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17493.117638 secs 2024-03-28T10:51:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17493.117638 secs 2024-03-28T10:51:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:34 smithi086 ceph-mon[35163]: pgmap v10019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:34 smithi159 ceph-mon[36109]: pgmap v10019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:34 smithi055 ceph-mon[31863]: pgmap v10019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:36 smithi086 ceph-mon[35163]: pgmap v10020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:36 smithi159 ceph-mon[36109]: pgmap v10020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:36 smithi055 ceph-mon[31863]: pgmap v10020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:38 smithi086 ceph-mon[35163]: pgmap v10021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17498.117706 secs 2024-03-28T10:51:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:38 smithi159 ceph-mon[36109]: pgmap v10021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17498.117706 secs 2024-03-28T10:51:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:38 smithi055 ceph-mon[31863]: pgmap v10021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17498.117706 secs 2024-03-28T10:51:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:40 smithi086 ceph-mon[35163]: pgmap v10022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:40 smithi159 ceph-mon[36109]: pgmap v10022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:40 smithi055 ceph-mon[31863]: pgmap v10022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:42 smithi086 ceph-mon[35163]: pgmap v10023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:42 smithi159 ceph-mon[36109]: pgmap v10023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:42 smithi055 ceph-mon[31863]: pgmap v10023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17503.117831 secs 2024-03-28T10:51:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17503.117831 secs 2024-03-28T10:51:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17503.117831 secs 2024-03-28T10:51:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:44 smithi086 ceph-mon[35163]: pgmap v10024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:44 smithi159 ceph-mon[36109]: pgmap v10024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:44 smithi055 ceph-mon[31863]: pgmap v10024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:47 smithi086 ceph-mon[35163]: pgmap v10025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:47 smithi159 ceph-mon[36109]: pgmap v10025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:47 smithi055 ceph-mon[31863]: pgmap v10025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17508.117922 secs 2024-03-28T10:51:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17508.117922 secs 2024-03-28T10:51:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17508.117922 secs 2024-03-28T10:51:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:49 smithi086 ceph-mon[35163]: pgmap v10026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:49 smithi159 ceph-mon[36109]: pgmap v10026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:49 smithi055 ceph-mon[31863]: pgmap v10026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:51 smithi086 ceph-mon[35163]: pgmap v10027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:51 smithi159 ceph-mon[36109]: pgmap v10027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:51.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:51 smithi055 ceph-mon[31863]: pgmap v10027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:53 smithi086 ceph-mon[35163]: pgmap v10028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17513.118006 secs 2024-03-28T10:51:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:53 smithi159 ceph-mon[36109]: pgmap v10028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17513.118006 secs 2024-03-28T10:51:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:53 smithi055 ceph-mon[31863]: pgmap v10028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17513.118006 secs 2024-03-28T10:51:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:55 smithi086 ceph-mon[35163]: pgmap v10029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:55 smithi159 ceph-mon[36109]: pgmap v10029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:55 smithi055 ceph-mon[31863]: pgmap v10029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:51:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:57 smithi086 ceph-mon[35163]: pgmap v10030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:57 smithi159 ceph-mon[36109]: pgmap v10030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:57 smithi055 ceph-mon[31863]: pgmap v10030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:51:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17518.118153 secs 2024-03-28T10:51:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17518.118153 secs 2024-03-28T10:51:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17518.118153 secs 2024-03-28T10:51:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:51:59 smithi055 ceph-mon[31863]: pgmap v10031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:51:59 smithi086 ceph-mon[35163]: pgmap v10031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:51:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:51:59 smithi159 ceph-mon[36109]: pgmap v10031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:52:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:52:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:52:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:01 smithi055 ceph-mon[31863]: pgmap v10032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:01 smithi086 ceph-mon[35163]: pgmap v10032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:01 smithi159 ceph-mon[36109]: pgmap v10032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:52:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:52:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:02 smithi055 ceph-mon[31863]: pgmap v10033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:02 smithi055 ceph-mon[31863]: pgmap v10034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:52:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:52:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:52:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:02 smithi086 ceph-mon[35163]: pgmap v10033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:02 smithi086 ceph-mon[35163]: pgmap v10034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:52:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:52:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:52:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:02 smithi159 ceph-mon[36109]: pgmap v10033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:02 smithi159 ceph-mon[36109]: pgmap v10034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:52:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17523.118239 secs 2024-03-28T10:52:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17523.118239 secs 2024-03-28T10:52:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17523.118239 secs 2024-03-28T10:52:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:04 smithi055 ceph-mon[31863]: pgmap v10035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:04 smithi086 ceph-mon[35163]: pgmap v10035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:04 smithi159 ceph-mon[36109]: pgmap v10035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:06 smithi086 ceph-mon[35163]: pgmap v10036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:06 smithi159 ceph-mon[36109]: pgmap v10036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:06 smithi055 ceph-mon[31863]: pgmap v10036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:08 smithi086 ceph-mon[35163]: pgmap v10037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17528.118315 secs 2024-03-28T10:52:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:08 smithi159 ceph-mon[36109]: pgmap v10037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17528.118315 secs 2024-03-28T10:52:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:08 smithi055 ceph-mon[31863]: pgmap v10037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17528.118315 secs 2024-03-28T10:52:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:10 smithi086 ceph-mon[35163]: pgmap v10038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:10 smithi159 ceph-mon[36109]: pgmap v10038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:10 smithi055 ceph-mon[31863]: pgmap v10038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:12 smithi086 ceph-mon[35163]: pgmap v10039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:12 smithi159 ceph-mon[36109]: pgmap v10039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:12.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:12 smithi055 ceph-mon[31863]: pgmap v10039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17533.118437 secs 2024-03-28T10:52:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17533.118437 secs 2024-03-28T10:52:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17533.118437 secs 2024-03-28T10:52:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:14 smithi086 ceph-mon[35163]: pgmap v10040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:14 smithi159 ceph-mon[36109]: pgmap v10040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:14 smithi055 ceph-mon[31863]: pgmap v10040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:16 smithi086 ceph-mon[35163]: pgmap v10041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:16 smithi159 ceph-mon[36109]: pgmap v10041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:16 smithi055 ceph-mon[31863]: pgmap v10041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:18 smithi086 ceph-mon[35163]: pgmap v10042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17538.118554 secs 2024-03-28T10:52:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:18 smithi159 ceph-mon[36109]: pgmap v10042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17538.118554 secs 2024-03-28T10:52:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:18 smithi055 ceph-mon[31863]: pgmap v10042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17538.118554 secs 2024-03-28T10:52:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:20 smithi086 ceph-mon[35163]: pgmap v10043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:20 smithi159 ceph-mon[36109]: pgmap v10043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:20 smithi055 ceph-mon[31863]: pgmap v10043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:22 smithi086 ceph-mon[35163]: pgmap v10044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:22 smithi159 ceph-mon[36109]: pgmap v10044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:22.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:22 smithi055 ceph-mon[31863]: pgmap v10044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17543.118631 secs 2024-03-28T10:52:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17543.118631 secs 2024-03-28T10:52:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17543.118631 secs 2024-03-28T10:52:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:24 smithi086 ceph-mon[35163]: pgmap v10045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:24 smithi159 ceph-mon[36109]: pgmap v10045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:24.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:24 smithi055 ceph-mon[31863]: pgmap v10045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:26 smithi086 ceph-mon[35163]: pgmap v10046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:26 smithi159 ceph-mon[36109]: pgmap v10046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:26.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:26 smithi055 ceph-mon[31863]: pgmap v10046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:28 smithi086 ceph-mon[35163]: pgmap v10047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17548.118709 secs 2024-03-28T10:52:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:28 smithi159 ceph-mon[36109]: pgmap v10047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17548.118709 secs 2024-03-28T10:52:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:28 smithi055 ceph-mon[31863]: pgmap v10047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17548.118709 secs 2024-03-28T10:52:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:30 smithi055 ceph-mon[31863]: pgmap v10048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:30 smithi086 ceph-mon[35163]: pgmap v10048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:30 smithi159 ceph-mon[36109]: pgmap v10048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:32 smithi055 ceph-mon[31863]: pgmap v10049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:32 smithi086 ceph-mon[35163]: pgmap v10049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:32 smithi159 ceph-mon[36109]: pgmap v10049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17553.118830 secs 2024-03-28T10:52:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17553.118830 secs 2024-03-28T10:52:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17553.118830 secs 2024-03-28T10:52:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:34 smithi055 ceph-mon[31863]: pgmap v10050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:34 smithi086 ceph-mon[35163]: pgmap v10050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:34 smithi159 ceph-mon[36109]: pgmap v10050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:36 smithi055 ceph-mon[31863]: pgmap v10051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:36 smithi086 ceph-mon[35163]: pgmap v10051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:36 smithi159 ceph-mon[36109]: pgmap v10051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:38 smithi055 ceph-mon[31863]: pgmap v10052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17558.118932 secs 2024-03-28T10:52:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:38 smithi086 ceph-mon[35163]: pgmap v10052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17558.118932 secs 2024-03-28T10:52:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:38 smithi159 ceph-mon[36109]: pgmap v10052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17558.118932 secs 2024-03-28T10:52:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:40 smithi055 ceph-mon[31863]: pgmap v10053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:40 smithi086 ceph-mon[35163]: pgmap v10053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:40 smithi159 ceph-mon[36109]: pgmap v10053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:42 smithi055 ceph-mon[31863]: pgmap v10054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:42.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:42 smithi159 ceph-mon[36109]: pgmap v10054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:42 smithi086 ceph-mon[35163]: pgmap v10054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:43.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17563.119054 secs 2024-03-28T10:52:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17563.119054 secs 2024-03-28T10:52:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17563.119054 secs 2024-03-28T10:52:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:44 smithi086 ceph-mon[35163]: pgmap v10055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:44 smithi159 ceph-mon[36109]: pgmap v10055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:44 smithi055 ceph-mon[31863]: pgmap v10055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:46 smithi086 ceph-mon[35163]: pgmap v10056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:46 smithi159 ceph-mon[36109]: pgmap v10056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:46 smithi055 ceph-mon[31863]: pgmap v10056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:52:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:48 smithi086 ceph-mon[35163]: pgmap v10057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17568.119184 secs 2024-03-28T10:52:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:48 smithi159 ceph-mon[36109]: pgmap v10057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17568.119184 secs 2024-03-28T10:52:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:48 smithi055 ceph-mon[31863]: pgmap v10057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:52:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17568.119184 secs 2024-03-28T10:52:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:49 smithi086 ceph-mon[35163]: pgmap v10058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:49 smithi159 ceph-mon[36109]: pgmap v10058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:49 smithi055 ceph-mon[31863]: pgmap v10058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:52 smithi086 ceph-mon[35163]: pgmap v10059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:52 smithi159 ceph-mon[36109]: pgmap v10059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:52 smithi055 ceph-mon[31863]: pgmap v10059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17573.119210 secs 2024-03-28T10:52:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17573.119210 secs 2024-03-28T10:52:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17573.119210 secs 2024-03-28T10:52:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:54 smithi086 ceph-mon[35163]: pgmap v10060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:54 smithi159 ceph-mon[36109]: pgmap v10060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:54 smithi055 ceph-mon[31863]: pgmap v10060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:52:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:56 smithi086 ceph-mon[35163]: pgmap v10061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:56 smithi159 ceph-mon[36109]: pgmap v10061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:56.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:56 smithi055 ceph-mon[31863]: pgmap v10061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:52:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:58 smithi086 ceph-mon[35163]: pgmap v10062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:52:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:52:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17578.119330 secs 2024-03-28T10:52:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:58 smithi159 ceph-mon[36109]: pgmap v10062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:52:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:52:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17578.119330 secs 2024-03-28T10:52:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:58 smithi055 ceph-mon[31863]: pgmap v10062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:52:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:52:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17578.119330 secs 2024-03-28T10:53:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:00 smithi086 ceph-mon[35163]: pgmap v10063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:00 smithi159 ceph-mon[36109]: pgmap v10063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:00 smithi055 ceph-mon[31863]: pgmap v10063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:02 smithi086 ceph-mon[35163]: pgmap v10064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:53:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:02 smithi159 ceph-mon[36109]: pgmap v10064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:53:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:02 smithi055 ceph-mon[31863]: pgmap v10064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17583.119419 secs 2024-03-28T10:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:53:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:53:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17583.119419 secs 2024-03-28T10:53:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:53:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:53:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17583.119419 secs 2024-03-28T10:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:53:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:53:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:04 smithi086 ceph-mon[35163]: pgmap v10065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:04 smithi086 ceph-mon[35163]: pgmap v10066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:53:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:04 smithi159 ceph-mon[36109]: pgmap v10065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:04 smithi159 ceph-mon[36109]: pgmap v10066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:53:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:04 smithi055 ceph-mon[31863]: pgmap v10065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:04 smithi055 ceph-mon[31863]: pgmap v10066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:53:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:06 smithi086 ceph-mon[35163]: pgmap v10067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:53:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:06 smithi159 ceph-mon[36109]: pgmap v10067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:53:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:06 smithi055 ceph-mon[31863]: pgmap v10067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:53:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:08 smithi055 ceph-mon[31863]: pgmap v10068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17588.119543 secs 2024-03-28T10:53:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:08 smithi086 ceph-mon[35163]: pgmap v10068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17588.119543 secs 2024-03-28T10:53:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:08 smithi159 ceph-mon[36109]: pgmap v10068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17588.119543 secs 2024-03-28T10:53:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:10 smithi055 ceph-mon[31863]: pgmap v10069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:10 smithi086 ceph-mon[35163]: pgmap v10069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:10 smithi159 ceph-mon[36109]: pgmap v10069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:12 smithi055 ceph-mon[31863]: pgmap v10070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:12.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:12 smithi159 ceph-mon[36109]: pgmap v10070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:12 smithi086 ceph-mon[35163]: pgmap v10070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:53:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17593.119707 secs 2024-03-28T10:53:13.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17593.119707 secs 2024-03-28T10:53:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17593.119707 secs 2024-03-28T10:53:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:14 smithi055 ceph-mon[31863]: pgmap v10071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:53:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:14 smithi086 ceph-mon[35163]: pgmap v10071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:53:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:14 smithi159 ceph-mon[36109]: pgmap v10071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:53:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:16 smithi055 ceph-mon[31863]: pgmap v10072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:16 smithi086 ceph-mon[35163]: pgmap v10072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:16 smithi159 ceph-mon[36109]: pgmap v10072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:18 smithi055 ceph-mon[31863]: pgmap v10073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17598.119767 secs 2024-03-28T10:53:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:18 smithi086 ceph-mon[35163]: pgmap v10073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17598.119767 secs 2024-03-28T10:53:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:18 smithi159 ceph-mon[36109]: pgmap v10073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17598.119767 secs 2024-03-28T10:53:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:20 smithi086 ceph-mon[35163]: pgmap v10074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:20 smithi159 ceph-mon[36109]: pgmap v10074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:20 smithi055 ceph-mon[31863]: pgmap v10074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:22 smithi086 ceph-mon[35163]: pgmap v10075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:22 smithi159 ceph-mon[36109]: pgmap v10075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:22 smithi055 ceph-mon[31863]: pgmap v10075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17603.119868 secs 2024-03-28T10:53:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17603.119868 secs 2024-03-28T10:53:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17603.119868 secs 2024-03-28T10:53:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:24 smithi086 ceph-mon[35163]: pgmap v10076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:25.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:24 smithi159 ceph-mon[36109]: pgmap v10076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:24 smithi055 ceph-mon[31863]: pgmap v10076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:26 smithi086 ceph-mon[35163]: pgmap v10077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:26 smithi159 ceph-mon[36109]: pgmap v10077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:26 smithi055 ceph-mon[31863]: pgmap v10077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:28 smithi086 ceph-mon[35163]: pgmap v10078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17608.119944 secs 2024-03-28T10:53:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:28 smithi159 ceph-mon[36109]: pgmap v10078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17608.119944 secs 2024-03-28T10:53:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:28 smithi055 ceph-mon[31863]: pgmap v10078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17608.119944 secs 2024-03-28T10:53:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:29 smithi086 ceph-mon[35163]: pgmap v10079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:29 smithi159 ceph-mon[36109]: pgmap v10079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:29 smithi055 ceph-mon[31863]: pgmap v10079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:32 smithi086 ceph-mon[35163]: pgmap v10080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:32 smithi159 ceph-mon[36109]: pgmap v10080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:32 smithi055 ceph-mon[31863]: pgmap v10080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17613.120015 secs 2024-03-28T10:53:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17613.120015 secs 2024-03-28T10:53:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17613.120015 secs 2024-03-28T10:53:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:34 smithi086 ceph-mon[35163]: pgmap v10081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:34 smithi159 ceph-mon[36109]: pgmap v10081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:34 smithi055 ceph-mon[31863]: pgmap v10081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:36.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:36 smithi159 ceph-mon[36109]: pgmap v10082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:36 smithi055 ceph-mon[31863]: pgmap v10082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:36 smithi086 ceph-mon[35163]: pgmap v10082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:38 smithi055 ceph-mon[31863]: pgmap v10083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:38.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17618.120094 secs 2024-03-28T10:53:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:38 smithi086 ceph-mon[35163]: pgmap v10083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17618.120094 secs 2024-03-28T10:53:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:38 smithi159 ceph-mon[36109]: pgmap v10083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17618.120094 secs 2024-03-28T10:53:40.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:40 smithi055 ceph-mon[31863]: pgmap v10084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:40 smithi086 ceph-mon[35163]: pgmap v10084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:40 smithi159 ceph-mon[36109]: pgmap v10084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:42 smithi055 ceph-mon[31863]: pgmap v10085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:42.624 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:42 smithi159 ceph-mon[36109]: pgmap v10085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:42 smithi086 ceph-mon[35163]: pgmap v10085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17623.120119 secs 2024-03-28T10:53:43.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17623.120119 secs 2024-03-28T10:53:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17623.120119 secs 2024-03-28T10:53:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:44 smithi055 ceph-mon[31863]: pgmap v10086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:44 smithi086 ceph-mon[35163]: pgmap v10086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:44 smithi159 ceph-mon[36109]: pgmap v10086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:46 smithi055 ceph-mon[31863]: pgmap v10087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:46 smithi086 ceph-mon[35163]: pgmap v10087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:46 smithi159 ceph-mon[36109]: pgmap v10087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:48 smithi055 ceph-mon[31863]: pgmap v10088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17628.120207 secs 2024-03-28T10:53:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:48 smithi086 ceph-mon[35163]: pgmap v10088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17628.120207 secs 2024-03-28T10:53:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:48 smithi159 ceph-mon[36109]: pgmap v10088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17628.120207 secs 2024-03-28T10:53:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:50 smithi086 ceph-mon[35163]: pgmap v10089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:50 smithi159 ceph-mon[36109]: pgmap v10089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:50 smithi055 ceph-mon[31863]: pgmap v10089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:52 smithi086 ceph-mon[35163]: pgmap v10090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:52 smithi159 ceph-mon[36109]: pgmap v10090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:52 smithi055 ceph-mon[31863]: pgmap v10090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17633.120271 secs 2024-03-28T10:53:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17633.120271 secs 2024-03-28T10:53:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17633.120271 secs 2024-03-28T10:53:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:54 smithi086 ceph-mon[35163]: pgmap v10091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:54 smithi159 ceph-mon[36109]: pgmap v10091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:54 smithi055 ceph-mon[31863]: pgmap v10091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:56 smithi086 ceph-mon[35163]: pgmap v10092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:56 smithi159 ceph-mon[36109]: pgmap v10092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:56.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:56 smithi055 ceph-mon[31863]: pgmap v10092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:53:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:58 smithi086 ceph-mon[35163]: pgmap v10093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:53:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17638.120395 secs 2024-03-28T10:53:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:58 smithi159 ceph-mon[36109]: pgmap v10093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:53:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17638.120395 secs 2024-03-28T10:53:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:58 smithi055 ceph-mon[31863]: pgmap v10093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:53:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:53:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17638.120395 secs 2024-03-28T10:54:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:00 smithi086 ceph-mon[35163]: pgmap v10094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:00 smithi159 ceph-mon[36109]: pgmap v10094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:00 smithi055 ceph-mon[31863]: pgmap v10094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:02 smithi086 ceph-mon[35163]: pgmap v10095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:02 smithi159 ceph-mon[36109]: pgmap v10095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:02 smithi055 ceph-mon[31863]: pgmap v10095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17643.120518 secs 2024-03-28T10:54:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17643.120518 secs 2024-03-28T10:54:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17643.120518 secs 2024-03-28T10:54:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:04 smithi086 ceph-mon[35163]: pgmap v10096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:04 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:54:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:04 smithi159 ceph-mon[36109]: pgmap v10096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:04.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:04 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:54:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:04 smithi055 ceph-mon[31863]: pgmap v10096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:04 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:54:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:54:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:54:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:54:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:54:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:54:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:54:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:54:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:54:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:54:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:06 smithi086 ceph-mon[35163]: pgmap v10097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:06 smithi086 ceph-mon[35163]: pgmap v10098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:06 smithi159 ceph-mon[36109]: pgmap v10097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:06 smithi159 ceph-mon[36109]: pgmap v10098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:06 smithi055 ceph-mon[31863]: pgmap v10097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:06 smithi055 ceph-mon[31863]: pgmap v10098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:08 smithi086 ceph-mon[35163]: pgmap v10099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17648.120642 secs 2024-03-28T10:54:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:08 smithi159 ceph-mon[36109]: pgmap v10099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17648.120642 secs 2024-03-28T10:54:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:08 smithi055 ceph-mon[31863]: pgmap v10099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17648.120642 secs 2024-03-28T10:54:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:10 smithi086 ceph-mon[35163]: pgmap v10100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:10 smithi159 ceph-mon[36109]: pgmap v10100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:10 smithi055 ceph-mon[31863]: pgmap v10100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:12 smithi086 ceph-mon[35163]: pgmap v10101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:12 smithi159 ceph-mon[36109]: pgmap v10101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:12.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:12 smithi055 ceph-mon[31863]: pgmap v10101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17653.120718 secs 2024-03-28T10:54:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17653.120718 secs 2024-03-28T10:54:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17653.120718 secs 2024-03-28T10:54:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:14 smithi086 ceph-mon[35163]: pgmap v10102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:14 smithi159 ceph-mon[36109]: pgmap v10102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:14 smithi055 ceph-mon[31863]: pgmap v10102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:16 smithi086 ceph-mon[35163]: pgmap v10103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:54:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:16 smithi159 ceph-mon[36109]: pgmap v10103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:54:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:16 smithi055 ceph-mon[31863]: pgmap v10103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:54:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:18 smithi086 ceph-mon[35163]: pgmap v10104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17658.120854 secs 2024-03-28T10:54:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:18 smithi159 ceph-mon[36109]: pgmap v10104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17658.120854 secs 2024-03-28T10:54:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:18 smithi055 ceph-mon[31863]: pgmap v10104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17658.120854 secs 2024-03-28T10:54:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:20 smithi086 ceph-mon[35163]: pgmap v10105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:20 smithi159 ceph-mon[36109]: pgmap v10105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:20.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:20 smithi055 ceph-mon[31863]: pgmap v10105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:22 smithi086 ceph-mon[35163]: pgmap v10106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:22 smithi159 ceph-mon[36109]: pgmap v10106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:22.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:22 smithi055 ceph-mon[31863]: pgmap v10106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17663.120924 secs 2024-03-28T10:54:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17663.120924 secs 2024-03-28T10:54:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17663.120924 secs 2024-03-28T10:54:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:24 smithi055 ceph-mon[31863]: pgmap v10107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:24 smithi086 ceph-mon[35163]: pgmap v10107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:24 smithi159 ceph-mon[36109]: pgmap v10107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:26 smithi055 ceph-mon[31863]: pgmap v10108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:26 smithi086 ceph-mon[35163]: pgmap v10108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:26 smithi159 ceph-mon[36109]: pgmap v10108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:28 smithi055 ceph-mon[31863]: pgmap v10109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17668.121005 secs 2024-03-28T10:54:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:28 smithi086 ceph-mon[35163]: pgmap v10109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17668.121005 secs 2024-03-28T10:54:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:28 smithi159 ceph-mon[36109]: pgmap v10109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17668.121005 secs 2024-03-28T10:54:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:30 smithi055 ceph-mon[31863]: pgmap v10110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:30 smithi086 ceph-mon[35163]: pgmap v10110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:30 smithi159 ceph-mon[36109]: pgmap v10110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:32 smithi055 ceph-mon[31863]: pgmap v10111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:32 smithi086 ceph-mon[35163]: pgmap v10111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:32 smithi159 ceph-mon[36109]: pgmap v10111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17673.121079 secs 2024-03-28T10:54:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17673.121079 secs 2024-03-28T10:54:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17673.121079 secs 2024-03-28T10:54:34.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:34 smithi055 ceph-mon[31863]: pgmap v10112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:34 smithi086 ceph-mon[35163]: pgmap v10112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:34 smithi159 ceph-mon[36109]: pgmap v10112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:36 smithi086 ceph-mon[35163]: pgmap v10113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:36 smithi159 ceph-mon[36109]: pgmap v10113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:36 smithi055 ceph-mon[31863]: pgmap v10113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:38.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:38 smithi055 ceph-mon[31863]: pgmap v10114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:38.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17678.121165 secs 2024-03-28T10:54:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:38 smithi086 ceph-mon[35163]: pgmap v10114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17678.121165 secs 2024-03-28T10:54:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:38 smithi159 ceph-mon[36109]: pgmap v10114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17678.121165 secs 2024-03-28T10:54:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:40 smithi086 ceph-mon[35163]: pgmap v10115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:40 smithi159 ceph-mon[36109]: pgmap v10115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:40 smithi055 ceph-mon[31863]: pgmap v10115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:42 smithi086 ceph-mon[35163]: pgmap v10116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:42 smithi159 ceph-mon[36109]: pgmap v10116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:42 smithi055 ceph-mon[31863]: pgmap v10116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:43.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17683.121230 secs 2024-03-28T10:54:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17683.121230 secs 2024-03-28T10:54:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17683.121230 secs 2024-03-28T10:54:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:44 smithi086 ceph-mon[35163]: pgmap v10117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:44 smithi159 ceph-mon[36109]: pgmap v10117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:44 smithi055 ceph-mon[31863]: pgmap v10117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:46 smithi086 ceph-mon[35163]: pgmap v10118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:46 smithi159 ceph-mon[36109]: pgmap v10118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:46 smithi055 ceph-mon[31863]: pgmap v10118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:48 smithi086 ceph-mon[35163]: pgmap v10119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17688.121293 secs 2024-03-28T10:54:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:48 smithi159 ceph-mon[36109]: pgmap v10119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17688.121293 secs 2024-03-28T10:54:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:48 smithi055 ceph-mon[31863]: pgmap v10119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17688.121293 secs 2024-03-28T10:54:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:49 smithi086 ceph-mon[35163]: pgmap v10120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:49 smithi159 ceph-mon[36109]: pgmap v10120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:49 smithi055 ceph-mon[31863]: pgmap v10120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:51 smithi086 ceph-mon[35163]: pgmap v10121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:51 smithi159 ceph-mon[36109]: pgmap v10121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:51 smithi055 ceph-mon[31863]: pgmap v10121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17693.121412 secs 2024-03-28T10:54:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:53 smithi086 ceph-mon[35163]: pgmap v10122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17693.121412 secs 2024-03-28T10:54:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:53 smithi159 ceph-mon[36109]: pgmap v10122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17693.121412 secs 2024-03-28T10:54:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:53 smithi055 ceph-mon[31863]: pgmap v10122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:56 smithi086 ceph-mon[35163]: pgmap v10123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:56 smithi159 ceph-mon[36109]: pgmap v10123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:56 smithi055 ceph-mon[31863]: pgmap v10123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:54:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:58 smithi086 ceph-mon[35163]: pgmap v10124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:58 smithi159 ceph-mon[36109]: pgmap v10124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:58 smithi055 ceph-mon[31863]: pgmap v10124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:54:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:54:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17698.121533 secs 2024-03-28T10:54:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:54:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17698.121533 secs 2024-03-28T10:54:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:54:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17698.121533 secs 2024-03-28T10:55:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:00 smithi086 ceph-mon[35163]: pgmap v10125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:00 smithi159 ceph-mon[36109]: pgmap v10125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:00 smithi055 ceph-mon[31863]: pgmap v10125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:02 smithi086 ceph-mon[35163]: pgmap v10126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:02 smithi159 ceph-mon[36109]: pgmap v10126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:02 smithi055 ceph-mon[31863]: pgmap v10126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17703.121649 secs 2024-03-28T10:55:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17703.121649 secs 2024-03-28T10:55:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17703.121649 secs 2024-03-28T10:55:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:04 smithi086 ceph-mon[35163]: pgmap v10127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:04 smithi159 ceph-mon[36109]: pgmap v10127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:04 smithi055 ceph-mon[31863]: pgmap v10127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:06 smithi055 ceph-mon[31863]: pgmap v10128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:55:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:06 smithi086 ceph-mon[35163]: pgmap v10128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:55:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:06 smithi159 ceph-mon[36109]: pgmap v10128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:55:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:55:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.375 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:55:07.376 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:55:07.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: pgmap v10129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: pgmap v10130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.377 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:55:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:55:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:55:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:55:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:55:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:55:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:55:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: pgmap v10129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: pgmap v10130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:55:07.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T10:55:07.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T10:55:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:55:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T10:55:07.574 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T10:55:07.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:55:07.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:55:07.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: pgmap v10129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: pgmap v10130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:07.575 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:55:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17708.121775 secs 2024-03-28T10:55:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17708.121775 secs 2024-03-28T10:55:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17708.121775 secs 2024-03-28T10:55:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:09 smithi055 ceph-mon[31863]: pgmap v10131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:09 smithi086 ceph-mon[35163]: pgmap v10131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:09 smithi159 ceph-mon[36109]: pgmap v10131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:10 smithi086 ceph-mon[35163]: pgmap v10132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:10 smithi159 ceph-mon[36109]: pgmap v10132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:10 smithi055 ceph-mon[31863]: pgmap v10132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:12 smithi086 ceph-mon[35163]: pgmap v10133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:55:13.073 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:12 smithi159 ceph-mon[36109]: pgmap v10133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:55:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:12 smithi055 ceph-mon[31863]: pgmap v10133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:55:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17713.121839 secs 2024-03-28T10:55:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17713.121839 secs 2024-03-28T10:55:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17713.121839 secs 2024-03-28T10:55:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:14 smithi086 ceph-mon[35163]: pgmap v10134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:15.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:14 smithi159 ceph-mon[36109]: pgmap v10134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:14 smithi055 ceph-mon[31863]: pgmap v10134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:16 smithi086 ceph-mon[35163]: pgmap v10135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:17.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:16 smithi159 ceph-mon[36109]: pgmap v10135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:16 smithi055 ceph-mon[31863]: pgmap v10135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17718.121909 secs 2024-03-28T10:55:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17718.121909 secs 2024-03-28T10:55:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17718.121909 secs 2024-03-28T10:55:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:19 smithi055 ceph-mon[31863]: pgmap v10136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:19 smithi086 ceph-mon[35163]: pgmap v10136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:19 smithi159 ceph-mon[36109]: pgmap v10136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:20 smithi086 ceph-mon[35163]: pgmap v10137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:20 smithi159 ceph-mon[36109]: pgmap v10137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:20 smithi055 ceph-mon[31863]: pgmap v10137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:22 smithi086 ceph-mon[35163]: pgmap v10138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:22 smithi159 ceph-mon[36109]: pgmap v10138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:22 smithi055 ceph-mon[31863]: pgmap v10138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17723.121997 secs 2024-03-28T10:55:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17723.121997 secs 2024-03-28T10:55:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17723.121997 secs 2024-03-28T10:55:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:24 smithi086 ceph-mon[35163]: pgmap v10139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:24 smithi159 ceph-mon[36109]: pgmap v10139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:24 smithi055 ceph-mon[31863]: pgmap v10139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:26 smithi086 ceph-mon[35163]: pgmap v10140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:26 smithi159 ceph-mon[36109]: pgmap v10140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:26 smithi055 ceph-mon[31863]: pgmap v10140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17728.122072 secs 2024-03-28T10:55:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17728.122072 secs 2024-03-28T10:55:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17728.122072 secs 2024-03-28T10:55:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:29 smithi055 ceph-mon[31863]: pgmap v10141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:29 smithi086 ceph-mon[35163]: pgmap v10141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:29 smithi159 ceph-mon[36109]: pgmap v10141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:30 smithi086 ceph-mon[35163]: pgmap v10142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:30 smithi159 ceph-mon[36109]: pgmap v10142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:30 smithi055 ceph-mon[31863]: pgmap v10142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:32 smithi086 ceph-mon[35163]: pgmap v10143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:55:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:32 smithi159 ceph-mon[36109]: pgmap v10143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:55:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:32 smithi055 ceph-mon[31863]: pgmap v10143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:55:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17733.122158 secs 2024-03-28T10:55:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17733.122158 secs 2024-03-28T10:55:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17733.122158 secs 2024-03-28T10:55:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:34 smithi086 ceph-mon[35163]: pgmap v10144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:34 smithi159 ceph-mon[36109]: pgmap v10144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:34 smithi055 ceph-mon[31863]: pgmap v10144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:36 smithi086 ceph-mon[35163]: pgmap v10145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:36 smithi159 ceph-mon[36109]: pgmap v10145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:36 smithi055 ceph-mon[31863]: pgmap v10145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17738.122280 secs 2024-03-28T10:55:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17738.122280 secs 2024-03-28T10:55:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17738.122280 secs 2024-03-28T10:55:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:39 smithi055 ceph-mon[31863]: pgmap v10146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:39 smithi086 ceph-mon[35163]: pgmap v10146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:39 smithi159 ceph-mon[36109]: pgmap v10146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:55:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:40 smithi086 ceph-mon[35163]: pgmap v10147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:40 smithi159 ceph-mon[36109]: pgmap v10147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:40 smithi055 ceph-mon[31863]: pgmap v10147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:42 smithi086 ceph-mon[35163]: pgmap v10148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:42 smithi159 ceph-mon[36109]: pgmap v10148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:42 smithi055 ceph-mon[31863]: pgmap v10148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17743.122312 secs 2024-03-28T10:55:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17743.122312 secs 2024-03-28T10:55:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17743.122312 secs 2024-03-28T10:55:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:45 smithi086 ceph-mon[35163]: pgmap v10149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:45 smithi159 ceph-mon[36109]: pgmap v10149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:45 smithi055 ceph-mon[31863]: pgmap v10149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:47 smithi086 ceph-mon[35163]: pgmap v10150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:47 smithi159 ceph-mon[36109]: pgmap v10150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:47 smithi055 ceph-mon[31863]: pgmap v10150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17748.122389 secs 2024-03-28T10:55:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17748.122389 secs 2024-03-28T10:55:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17748.122389 secs 2024-03-28T10:55:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:50 smithi055 ceph-mon[31863]: pgmap v10151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:50 smithi086 ceph-mon[35163]: pgmap v10151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:50 smithi159 ceph-mon[36109]: pgmap v10151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:52 smithi055 ceph-mon[31863]: pgmap v10152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:52 smithi086 ceph-mon[35163]: pgmap v10152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:52 smithi159 ceph-mon[36109]: pgmap v10152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:55:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17753.122463 secs 2024-03-28T10:55:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17753.122463 secs 2024-03-28T10:55:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17753.122463 secs 2024-03-28T10:55:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:54 smithi055 ceph-mon[31863]: pgmap v10153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:54 smithi086 ceph-mon[35163]: pgmap v10153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:54 smithi159 ceph-mon[36109]: pgmap v10153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:55:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:56 smithi055 ceph-mon[31863]: pgmap v10154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:56 smithi086 ceph-mon[35163]: pgmap v10154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:56 smithi159 ceph-mon[36109]: pgmap v10154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:58 smithi086 ceph-mon[35163]: pgmap v10155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:55:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17758.122584 secs 2024-03-28T10:55:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:58 smithi159 ceph-mon[36109]: pgmap v10155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:55:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17758.122584 secs 2024-03-28T10:55:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:58 smithi055 ceph-mon[31863]: pgmap v10155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:55:58.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:55:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17758.122584 secs 2024-03-28T10:56:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:00 smithi086 ceph-mon[35163]: pgmap v10156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:00 smithi159 ceph-mon[36109]: pgmap v10156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:00 smithi055 ceph-mon[31863]: pgmap v10156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:02 smithi086 ceph-mon[35163]: pgmap v10157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:02 smithi159 ceph-mon[36109]: pgmap v10157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:02 smithi055 ceph-mon[31863]: pgmap v10157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17763.122699 secs 2024-03-28T10:56:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17763.122699 secs 2024-03-28T10:56:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17763.122699 secs 2024-03-28T10:56:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:04 smithi086 ceph-mon[35163]: pgmap v10158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:04 smithi159 ceph-mon[36109]: pgmap v10158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:04 smithi055 ceph-mon[31863]: pgmap v10158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:06 smithi086 ceph-mon[35163]: pgmap v10159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:06 smithi159 ceph-mon[36109]: pgmap v10159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:06 smithi055 ceph-mon[31863]: pgmap v10159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:56:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:56:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:56:08.523 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:08 smithi055 ceph-mon[31863]: pgmap v10160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:08.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17768.122769 secs 2024-03-28T10:56:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:08 smithi086 ceph-mon[35163]: pgmap v10160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17768.122769 secs 2024-03-28T10:56:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:08 smithi159 ceph-mon[36109]: pgmap v10160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17768.122769 secs 2024-03-28T10:56:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:56:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:56:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:56:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:56:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: pgmap v10161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: pgmap v10162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:56:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:56:09.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: pgmap v10161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:09.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: pgmap v10162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:09.573 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:56:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:56:09.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:56:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: pgmap v10161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: pgmap v10162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:09.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:56:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:11 smithi086 ceph-mon[35163]: pgmap v10163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:11 smithi159 ceph-mon[36109]: pgmap v10163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:11 smithi055 ceph-mon[31863]: pgmap v10163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:13 smithi086 ceph-mon[35163]: pgmap v10164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17773.122851 secs 2024-03-28T10:56:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:13 smithi159 ceph-mon[36109]: pgmap v10164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17773.122851 secs 2024-03-28T10:56:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:13 smithi055 ceph-mon[31863]: pgmap v10164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17773.122851 secs 2024-03-28T10:56:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:15 smithi086 ceph-mon[35163]: pgmap v10165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:15 smithi159 ceph-mon[36109]: pgmap v10165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:15 smithi055 ceph-mon[31863]: pgmap v10165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:17 smithi086 ceph-mon[35163]: pgmap v10166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:17 smithi159 ceph-mon[36109]: pgmap v10166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:17 smithi055 ceph-mon[31863]: pgmap v10166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:56:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17778.122969 secs 2024-03-28T10:56:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17778.122969 secs 2024-03-28T10:56:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17778.122969 secs 2024-03-28T10:56:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:19 smithi055 ceph-mon[31863]: pgmap v10167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:56:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:19 smithi086 ceph-mon[35163]: pgmap v10167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:56:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:19 smithi159 ceph-mon[36109]: pgmap v10167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:56:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:21 smithi055 ceph-mon[31863]: pgmap v10168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:21 smithi086 ceph-mon[35163]: pgmap v10168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:21 smithi159 ceph-mon[36109]: pgmap v10168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:23 smithi055 ceph-mon[31863]: pgmap v10169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17783.123090 secs 2024-03-28T10:56:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:23 smithi086 ceph-mon[35163]: pgmap v10169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17783.123090 secs 2024-03-28T10:56:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:23 smithi159 ceph-mon[36109]: pgmap v10169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17783.123090 secs 2024-03-28T10:56:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:25 smithi055 ceph-mon[31863]: pgmap v10170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:25 smithi086 ceph-mon[35163]: pgmap v10170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:25 smithi159 ceph-mon[36109]: pgmap v10170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:27 smithi086 ceph-mon[35163]: pgmap v10171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:27 smithi159 ceph-mon[36109]: pgmap v10171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:27 smithi055 ceph-mon[31863]: pgmap v10171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17788.123213 secs 2024-03-28T10:56:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17788.123213 secs 2024-03-28T10:56:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17788.123213 secs 2024-03-28T10:56:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:29 smithi086 ceph-mon[35163]: pgmap v10172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:29 smithi159 ceph-mon[36109]: pgmap v10172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:29 smithi055 ceph-mon[31863]: pgmap v10172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:31 smithi086 ceph-mon[35163]: pgmap v10173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:31 smithi159 ceph-mon[36109]: pgmap v10173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:31 smithi055 ceph-mon[31863]: pgmap v10173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:33 smithi055 ceph-mon[31863]: pgmap v10174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17793.123332 secs 2024-03-28T10:56:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:33 smithi086 ceph-mon[35163]: pgmap v10174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17793.123332 secs 2024-03-28T10:56:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:33 smithi159 ceph-mon[36109]: pgmap v10174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17793.123332 secs 2024-03-28T10:56:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:35 smithi055 ceph-mon[31863]: pgmap v10175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:35 smithi086 ceph-mon[35163]: pgmap v10175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:35 smithi159 ceph-mon[36109]: pgmap v10175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:37 smithi055 ceph-mon[31863]: pgmap v10176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:37 smithi086 ceph-mon[35163]: pgmap v10176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:37 smithi159 ceph-mon[36109]: pgmap v10176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17798.123426 secs 2024-03-28T10:56:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17798.123426 secs 2024-03-28T10:56:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17798.123426 secs 2024-03-28T10:56:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:39 smithi055 ceph-mon[31863]: pgmap v10177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:39 smithi086 ceph-mon[35163]: pgmap v10177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:39 smithi159 ceph-mon[36109]: pgmap v10177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:41 smithi055 ceph-mon[31863]: pgmap v10178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:41 smithi086 ceph-mon[35163]: pgmap v10178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:41 smithi159 ceph-mon[36109]: pgmap v10178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:43.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:43 smithi086 ceph-mon[35163]: pgmap v10179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:43.871 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17803.123554 secs 2024-03-28T10:56:43.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:43 smithi159 ceph-mon[36109]: pgmap v10179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:43.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17803.123554 secs 2024-03-28T10:56:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:43 smithi055 ceph-mon[31863]: pgmap v10179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:43.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17803.123554 secs 2024-03-28T10:56:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:45 smithi086 ceph-mon[35163]: pgmap v10180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:45 smithi159 ceph-mon[36109]: pgmap v10180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:45 smithi055 ceph-mon[31863]: pgmap v10180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:47 smithi086 ceph-mon[35163]: pgmap v10181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:47 smithi159 ceph-mon[36109]: pgmap v10181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:48.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:47 smithi055 ceph-mon[31863]: pgmap v10181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17808.123677 secs 2024-03-28T10:56:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17808.123677 secs 2024-03-28T10:56:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17808.123677 secs 2024-03-28T10:56:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:49 smithi086 ceph-mon[35163]: pgmap v10182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:49 smithi159 ceph-mon[36109]: pgmap v10182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:49 smithi055 ceph-mon[31863]: pgmap v10182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:51 smithi086 ceph-mon[35163]: pgmap v10183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:51 smithi159 ceph-mon[36109]: pgmap v10183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:52.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:51 smithi055 ceph-mon[31863]: pgmap v10183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:56:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:53 smithi086 ceph-mon[35163]: pgmap v10184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17813.123842 secs 2024-03-28T10:56:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:53 smithi159 ceph-mon[36109]: pgmap v10184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17813.123842 secs 2024-03-28T10:56:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:53 smithi055 ceph-mon[31863]: pgmap v10184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:56:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17813.123842 secs 2024-03-28T10:56:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:55 smithi086 ceph-mon[35163]: pgmap v10185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:55 smithi159 ceph-mon[36109]: pgmap v10185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:55 smithi055 ceph-mon[31863]: pgmap v10185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:57 smithi086 ceph-mon[35163]: pgmap v10186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:58.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:57 smithi159 ceph-mon[36109]: pgmap v10186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:57 smithi055 ceph-mon[31863]: pgmap v10186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:56:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17818.123931 secs 2024-03-28T10:56:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17818.123931 secs 2024-03-28T10:56:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17818.123931 secs 2024-03-28T10:57:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:56:59 smithi086 ceph-mon[35163]: pgmap v10187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:56:59 smithi159 ceph-mon[36109]: pgmap v10187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:56:59 smithi055 ceph-mon[31863]: pgmap v10187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:01 smithi086 ceph-mon[35163]: pgmap v10188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:57:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:01 smithi159 ceph-mon[36109]: pgmap v10188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:57:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:01 smithi055 ceph-mon[31863]: pgmap v10188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:57:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:03 smithi086 ceph-mon[35163]: pgmap v10189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17823.124050 secs 2024-03-28T10:57:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:03 smithi159 ceph-mon[36109]: pgmap v10189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17823.124050 secs 2024-03-28T10:57:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:03 smithi055 ceph-mon[31863]: pgmap v10189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17823.124050 secs 2024-03-28T10:57:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:04 smithi086 ceph-mon[35163]: pgmap v10190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:05.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:04 smithi159 ceph-mon[36109]: pgmap v10190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:04 smithi055 ceph-mon[31863]: pgmap v10190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:07 smithi086 ceph-mon[35163]: pgmap v10191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:07 smithi159 ceph-mon[36109]: pgmap v10191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:07 smithi055 ceph-mon[31863]: pgmap v10191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17828.124146 secs 2024-03-28T10:57:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17828.124146 secs 2024-03-28T10:57:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17828.124146 secs 2024-03-28T10:57:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:09 smithi159 ceph-mon[36109]: pgmap v10192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:09.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:57:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:09 smithi055 ceph-mon[31863]: pgmap v10192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:57:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:09 smithi086 ceph-mon[35163]: pgmap v10192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:57:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:57:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:57:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:57:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:57:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:57:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:57:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:57:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:57:11.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:57:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:11 smithi055 ceph-mon[31863]: pgmap v10193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:11 smithi055 ceph-mon[31863]: pgmap v10194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:57:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:11 smithi086 ceph-mon[35163]: pgmap v10193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:11 smithi086 ceph-mon[35163]: pgmap v10194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:57:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:11 smithi159 ceph-mon[36109]: pgmap v10193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:12.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:11 smithi159 ceph-mon[36109]: pgmap v10194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T10:57:13.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:13 smithi086 ceph-mon[35163]: pgmap v10195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:13.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17833.124216 secs 2024-03-28T10:57:13.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:13 smithi159 ceph-mon[36109]: pgmap v10195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:13.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17833.124216 secs 2024-03-28T10:57:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:13 smithi055 ceph-mon[31863]: pgmap v10195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17833.124216 secs 2024-03-28T10:57:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:15 smithi055 ceph-mon[31863]: pgmap v10196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:15 smithi086 ceph-mon[35163]: pgmap v10196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:15 smithi159 ceph-mon[36109]: pgmap v10196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:17 smithi055 ceph-mon[31863]: pgmap v10197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:17 smithi086 ceph-mon[35163]: pgmap v10197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:17 smithi159 ceph-mon[36109]: pgmap v10197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17838.124293 secs 2024-03-28T10:57:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17838.124293 secs 2024-03-28T10:57:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17838.124293 secs 2024-03-28T10:57:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:19 smithi086 ceph-mon[35163]: pgmap v10198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:19 smithi159 ceph-mon[36109]: pgmap v10198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:20.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:19 smithi055 ceph-mon[31863]: pgmap v10198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:21 smithi086 ceph-mon[35163]: pgmap v10199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:57:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:21 smithi159 ceph-mon[36109]: pgmap v10199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:57:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:21 smithi055 ceph-mon[31863]: pgmap v10199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:57:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:23 smithi086 ceph-mon[35163]: pgmap v10200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17843.124400 secs 2024-03-28T10:57:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:23 smithi159 ceph-mon[36109]: pgmap v10200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17843.124400 secs 2024-03-28T10:57:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:23 smithi055 ceph-mon[31863]: pgmap v10200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17843.124400 secs 2024-03-28T10:57:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:25 smithi086 ceph-mon[35163]: pgmap v10201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:25 smithi159 ceph-mon[36109]: pgmap v10201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:25 smithi055 ceph-mon[31863]: pgmap v10201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:27 smithi086 ceph-mon[35163]: pgmap v10202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:27 smithi159 ceph-mon[36109]: pgmap v10202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:27 smithi055 ceph-mon[31863]: pgmap v10202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17848.124492 secs 2024-03-28T10:57:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17848.124492 secs 2024-03-28T10:57:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17848.124492 secs 2024-03-28T10:57:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:29 smithi086 ceph-mon[35163]: pgmap v10203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:29 smithi159 ceph-mon[36109]: pgmap v10203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:30.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:29 smithi055 ceph-mon[31863]: pgmap v10203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:31 smithi086 ceph-mon[35163]: pgmap v10204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:31 smithi159 ceph-mon[36109]: pgmap v10204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:31 smithi055 ceph-mon[31863]: pgmap v10204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:33 smithi086 ceph-mon[35163]: pgmap v10205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17853.124623 secs 2024-03-28T10:57:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:33 smithi159 ceph-mon[36109]: pgmap v10205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17853.124623 secs 2024-03-28T10:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:33 smithi055 ceph-mon[31863]: pgmap v10205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17853.124623 secs 2024-03-28T10:57:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:35 smithi086 ceph-mon[35163]: pgmap v10206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:35 smithi159 ceph-mon[36109]: pgmap v10206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:35 smithi055 ceph-mon[31863]: pgmap v10206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:37 smithi086 ceph-mon[35163]: pgmap v10207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:37 smithi159 ceph-mon[36109]: pgmap v10207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:38.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:37 smithi055 ceph-mon[31863]: pgmap v10207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:39.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17858.124747 secs 2024-03-28T10:57:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17858.124747 secs 2024-03-28T10:57:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17858.124747 secs 2024-03-28T10:57:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:39 smithi086 ceph-mon[35163]: pgmap v10208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:39 smithi159 ceph-mon[36109]: pgmap v10208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:40.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:39 smithi055 ceph-mon[31863]: pgmap v10208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:40 smithi086 ceph-mon[35163]: pgmap v10209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:40 smithi159 ceph-mon[36109]: pgmap v10209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:40 smithi055 ceph-mon[31863]: pgmap v10209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:43 smithi086 ceph-mon[35163]: pgmap v10210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17863.124866 secs 2024-03-28T10:57:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:43 smithi159 ceph-mon[36109]: pgmap v10210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:43.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17863.124866 secs 2024-03-28T10:57:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:43 smithi055 ceph-mon[31863]: pgmap v10210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17863.124866 secs 2024-03-28T10:57:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:45 smithi055 ceph-mon[31863]: pgmap v10211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:45 smithi086 ceph-mon[35163]: pgmap v10211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:45 smithi159 ceph-mon[36109]: pgmap v10211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:47.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:47 smithi055 ceph-mon[31863]: pgmap v10212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:47 smithi086 ceph-mon[35163]: pgmap v10212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:47 smithi159 ceph-mon[36109]: pgmap v10212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17868.124958 secs 2024-03-28T10:57:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17868.124958 secs 2024-03-28T10:57:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17868.124958 secs 2024-03-28T10:57:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:49 smithi055 ceph-mon[31863]: pgmap v10213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:49 smithi086 ceph-mon[35163]: pgmap v10213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:49 smithi159 ceph-mon[36109]: pgmap v10213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:51.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:51 smithi055 ceph-mon[31863]: pgmap v10214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:51 smithi086 ceph-mon[35163]: pgmap v10214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:51 smithi159 ceph-mon[36109]: pgmap v10214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:57:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:53 smithi055 ceph-mon[31863]: pgmap v10215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17873.125034 secs 2024-03-28T10:57:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:53 smithi086 ceph-mon[35163]: pgmap v10215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17873.125034 secs 2024-03-28T10:57:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:53 smithi159 ceph-mon[36109]: pgmap v10215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17873.125034 secs 2024-03-28T10:57:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:55 smithi055 ceph-mon[31863]: pgmap v10216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:55 smithi086 ceph-mon[35163]: pgmap v10216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:55 smithi159 ceph-mon[36109]: pgmap v10216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:57.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:57 smithi055 ceph-mon[31863]: pgmap v10217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:57 smithi086 ceph-mon[35163]: pgmap v10217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:57 smithi159 ceph-mon[36109]: pgmap v10217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17878.125148 secs 2024-03-28T10:57:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17878.125148 secs 2024-03-28T10:57:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17878.125148 secs 2024-03-28T10:57:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:57:59 smithi086 ceph-mon[35163]: pgmap v10218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:57:59 smithi159 ceph-mon[36109]: pgmap v10218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:57:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:57:59 smithi055 ceph-mon[31863]: pgmap v10218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:01 smithi086 ceph-mon[35163]: pgmap v10219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:01 smithi159 ceph-mon[36109]: pgmap v10219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:01 smithi055 ceph-mon[31863]: pgmap v10219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:03 smithi086 ceph-mon[35163]: pgmap v10220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17883.125233 secs 2024-03-28T10:58:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:03 smithi159 ceph-mon[36109]: pgmap v10220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17883.125233 secs 2024-03-28T10:58:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:03 smithi055 ceph-mon[31863]: pgmap v10220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17883.125233 secs 2024-03-28T10:58:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:05 smithi086 ceph-mon[35163]: pgmap v10221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:05.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:05 smithi159 ceph-mon[36109]: pgmap v10221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:05 smithi055 ceph-mon[31863]: pgmap v10221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:07.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:07 smithi055 ceph-mon[31863]: pgmap v10222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:07 smithi086 ceph-mon[35163]: pgmap v10222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:07 smithi159 ceph-mon[36109]: pgmap v10222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17888.125359 secs 2024-03-28T10:58:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17888.125359 secs 2024-03-28T10:58:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17888.125359 secs 2024-03-28T10:58:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:09 smithi055 ceph-mon[31863]: pgmap v10223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:09 smithi086 ceph-mon[35163]: pgmap v10223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:09 smithi159 ceph-mon[36109]: pgmap v10223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:11 smithi055 ceph-mon[31863]: pgmap v10224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:58:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:11 smithi086 ceph-mon[35163]: pgmap v10224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:58:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:11 smithi159 ceph-mon[36109]: pgmap v10224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:58:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:13 smithi055 ceph-mon[31863]: pgmap v10225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17893.125481 secs 2024-03-28T10:58:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:58:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:58:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:13 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:13 smithi086 ceph-mon[35163]: pgmap v10225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17893.125481 secs 2024-03-28T10:58:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:58:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:58:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:13 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:13 smithi159 ceph-mon[36109]: pgmap v10225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17893.125481 secs 2024-03-28T10:58:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:58:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:58:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:13 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:58:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:14 smithi055 ceph-mon[31863]: pgmap v10226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:14 smithi055 ceph-mon[31863]: pgmap v10227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:14 smithi086 ceph-mon[35163]: pgmap v10226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:14 smithi086 ceph-mon[35163]: pgmap v10227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:14 smithi159 ceph-mon[36109]: pgmap v10226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:14 smithi159 ceph-mon[36109]: pgmap v10227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:16 smithi086 ceph-mon[35163]: pgmap v10228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:16 smithi159 ceph-mon[36109]: pgmap v10228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:16 smithi055 ceph-mon[31863]: pgmap v10228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:18 smithi086 ceph-mon[35163]: pgmap v10229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17898.125602 secs 2024-03-28T10:58:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:18 smithi159 ceph-mon[36109]: pgmap v10229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17898.125602 secs 2024-03-28T10:58:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:18 smithi055 ceph-mon[31863]: pgmap v10229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:19.126 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17898.125602 secs 2024-03-28T10:58:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:20 smithi086 ceph-mon[35163]: pgmap v10230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:20 smithi159 ceph-mon[36109]: pgmap v10230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:20 smithi055 ceph-mon[31863]: pgmap v10230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:22 smithi086 ceph-mon[35163]: pgmap v10231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:22 smithi159 ceph-mon[36109]: pgmap v10231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:22 smithi055 ceph-mon[31863]: pgmap v10231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T10:58:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17903.125725 secs 2024-03-28T10:58:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17903.125725 secs 2024-03-28T10:58:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17903.125725 secs 2024-03-28T10:58:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:24 smithi086 ceph-mon[35163]: pgmap v10232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:58:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:24 smithi159 ceph-mon[36109]: pgmap v10232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:58:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:24 smithi055 ceph-mon[31863]: pgmap v10232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:58:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:26 smithi086 ceph-mon[35163]: pgmap v10233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:26 smithi159 ceph-mon[36109]: pgmap v10233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:26 smithi055 ceph-mon[31863]: pgmap v10233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:28 smithi086 ceph-mon[35163]: pgmap v10234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17908.125820 secs 2024-03-28T10:58:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:28 smithi159 ceph-mon[36109]: pgmap v10234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17908.125820 secs 2024-03-28T10:58:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:28 smithi055 ceph-mon[31863]: pgmap v10234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17908.125820 secs 2024-03-28T10:58:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:30 smithi086 ceph-mon[35163]: pgmap v10235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:30 smithi159 ceph-mon[36109]: pgmap v10235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:30 smithi055 ceph-mon[31863]: pgmap v10235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:32 smithi086 ceph-mon[35163]: pgmap v10236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:32 smithi159 ceph-mon[36109]: pgmap v10236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:32 smithi055 ceph-mon[31863]: pgmap v10236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17913.125942 secs 2024-03-28T10:58:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17913.125942 secs 2024-03-28T10:58:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17913.125942 secs 2024-03-28T10:58:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:34 smithi086 ceph-mon[35163]: pgmap v10237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:34 smithi159 ceph-mon[36109]: pgmap v10237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:34 smithi055 ceph-mon[31863]: pgmap v10237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:36 smithi086 ceph-mon[35163]: pgmap v10238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:36 smithi159 ceph-mon[36109]: pgmap v10238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:36 smithi055 ceph-mon[31863]: pgmap v10238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:38 smithi086 ceph-mon[35163]: pgmap v10239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17918.126027 secs 2024-03-28T10:58:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:38 smithi159 ceph-mon[36109]: pgmap v10239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17918.126027 secs 2024-03-28T10:58:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:38 smithi055 ceph-mon[31863]: pgmap v10239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17918.126027 secs 2024-03-28T10:58:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:40 smithi086 ceph-mon[35163]: pgmap v10240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:40 smithi159 ceph-mon[36109]: pgmap v10240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:40 smithi055 ceph-mon[31863]: pgmap v10240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:41 smithi086 ceph-mon[35163]: pgmap v10241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:41 smithi159 ceph-mon[36109]: pgmap v10241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:42.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:41 smithi055 ceph-mon[31863]: pgmap v10241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17923.126105 secs 2024-03-28T10:58:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:43 smithi086 ceph-mon[35163]: pgmap v10242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17923.126105 secs 2024-03-28T10:58:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:43 smithi159 ceph-mon[36109]: pgmap v10242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17923.126105 secs 2024-03-28T10:58:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:43 smithi055 ceph-mon[31863]: pgmap v10242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:45 smithi086 ceph-mon[35163]: pgmap v10243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:58:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:45 smithi159 ceph-mon[36109]: pgmap v10243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:58:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:45 smithi055 ceph-mon[31863]: pgmap v10243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T10:58:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:47 smithi086 ceph-mon[35163]: pgmap v10244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:47 smithi159 ceph-mon[36109]: pgmap v10244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:47 smithi055 ceph-mon[31863]: pgmap v10244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17928.126225 secs 2024-03-28T10:58:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17928.126225 secs 2024-03-28T10:58:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17928.126225 secs 2024-03-28T10:58:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:50 smithi086 ceph-mon[35163]: pgmap v10245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:50 smithi159 ceph-mon[36109]: pgmap v10245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:50 smithi055 ceph-mon[31863]: pgmap v10245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:52 smithi086 ceph-mon[35163]: pgmap v10246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:52 smithi159 ceph-mon[36109]: pgmap v10246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:52 smithi055 ceph-mon[31863]: pgmap v10246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T10:58:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17933.126348 secs 2024-03-28T10:58:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:54 smithi086 ceph-mon[35163]: pgmap v10247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17933.126348 secs 2024-03-28T10:58:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:54 smithi159 ceph-mon[36109]: pgmap v10247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17933.126348 secs 2024-03-28T10:58:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:54 smithi055 ceph-mon[31863]: pgmap v10247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:56 smithi086 ceph-mon[35163]: pgmap v10248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:56 smithi159 ceph-mon[36109]: pgmap v10248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:56 smithi055 ceph-mon[31863]: pgmap v10248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:58:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:58 smithi086 ceph-mon[35163]: pgmap v10249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:58 smithi159 ceph-mon[36109]: pgmap v10249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:58 smithi055 ceph-mon[31863]: pgmap v10249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:58:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:58:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17938.126471 secs 2024-03-28T10:58:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:58:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17938.126471 secs 2024-03-28T10:58:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:58:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17938.126471 secs 2024-03-28T10:59:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:00 smithi086 ceph-mon[35163]: pgmap v10250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:00 smithi159 ceph-mon[36109]: pgmap v10250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:00 smithi055 ceph-mon[31863]: pgmap v10250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:02 smithi086 ceph-mon[35163]: pgmap v10251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:02 smithi159 ceph-mon[36109]: pgmap v10251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:02 smithi055 ceph-mon[31863]: pgmap v10251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17943.126594 secs 2024-03-28T10:59:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17943.126594 secs 2024-03-28T10:59:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17943.126594 secs 2024-03-28T10:59:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:04 smithi055 ceph-mon[31863]: pgmap v10252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:04 smithi086 ceph-mon[35163]: pgmap v10252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:04 smithi159 ceph-mon[36109]: pgmap v10252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:06 smithi055 ceph-mon[31863]: pgmap v10253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:06 smithi086 ceph-mon[35163]: pgmap v10253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:06 smithi159 ceph-mon[36109]: pgmap v10253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:08 smithi055 ceph-mon[31863]: pgmap v10254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:08.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17948.126725 secs 2024-03-28T10:59:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:08 smithi086 ceph-mon[35163]: pgmap v10254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17948.126725 secs 2024-03-28T10:59:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:08 smithi159 ceph-mon[36109]: pgmap v10254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:08.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17948.126725 secs 2024-03-28T10:59:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:10 smithi055 ceph-mon[31863]: pgmap v10255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:10 smithi086 ceph-mon[35163]: pgmap v10255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:10 smithi159 ceph-mon[36109]: pgmap v10255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:12 smithi055 ceph-mon[31863]: pgmap v10256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:12 smithi086 ceph-mon[35163]: pgmap v10256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:12.583 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:12 smithi159 ceph-mon[36109]: pgmap v10256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17953.126848 secs 2024-03-28T10:59:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17953.126848 secs 2024-03-28T10:59:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17953.126848 secs 2024-03-28T10:59:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:14 smithi055 ceph-mon[31863]: pgmap v10257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:59:14.468 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:14 smithi086 ceph-mon[35163]: pgmap v10257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:14.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:59:14.470 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:14 smithi159 ceph-mon[36109]: pgmap v10257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:14.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T10:59:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:15 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:15.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:15 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:15 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:16 smithi086 ceph-mon[35163]: pgmap v10258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:16.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:16 smithi159 ceph-mon[36109]: pgmap v10258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:16 smithi055 ceph-mon[31863]: pgmap v10258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:17.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: pgmap v10259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17958.126972 secs 2024-03-28T10:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: pgmap v10259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17958.126972 secs 2024-03-28T10:59:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: pgmap v10259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17958.126972 secs 2024-03-28T10:59:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:59:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:59:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:59:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:59:19.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T10:59:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T10:59:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T10:59:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:20 smithi086 ceph-mon[35163]: pgmap v10260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:20 smithi086 ceph-mon[35163]: pgmap v10261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:59:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:20 smithi086 ceph-mon[35163]: pgmap v10262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:20 smithi159 ceph-mon[36109]: pgmap v10260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:20 smithi159 ceph-mon[36109]: pgmap v10261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:59:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:20 smithi159 ceph-mon[36109]: pgmap v10262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:20 smithi055 ceph-mon[31863]: pgmap v10260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:20 smithi055 ceph-mon[31863]: pgmap v10261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T10:59:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:20 smithi055 ceph-mon[31863]: pgmap v10262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:22 smithi086 ceph-mon[35163]: pgmap v10263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:22 smithi159 ceph-mon[36109]: pgmap v10263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:22 smithi055 ceph-mon[31863]: pgmap v10263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17963.127019 secs 2024-03-28T10:59:23.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17963.127019 secs 2024-03-28T10:59:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17963.127019 secs 2024-03-28T10:59:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:24 smithi086 ceph-mon[35163]: pgmap v10264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:24 smithi159 ceph-mon[36109]: pgmap v10264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:24 smithi055 ceph-mon[31863]: pgmap v10264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:26 smithi086 ceph-mon[35163]: pgmap v10265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:26 smithi159 ceph-mon[36109]: pgmap v10265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:26.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:26 smithi055 ceph-mon[31863]: pgmap v10265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T10:59:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:28 smithi086 ceph-mon[35163]: pgmap v10266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17968.127098 secs 2024-03-28T10:59:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:28 smithi159 ceph-mon[36109]: pgmap v10266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17968.127098 secs 2024-03-28T10:59:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:28 smithi055 ceph-mon[31863]: pgmap v10266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T10:59:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17968.127098 secs 2024-03-28T10:59:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:30 smithi086 ceph-mon[35163]: pgmap v10267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:59:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:30 smithi159 ceph-mon[36109]: pgmap v10267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:59:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:30 smithi055 ceph-mon[31863]: pgmap v10267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T10:59:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:32 smithi086 ceph-mon[35163]: pgmap v10268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:32 smithi159 ceph-mon[36109]: pgmap v10268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:32 smithi055 ceph-mon[31863]: pgmap v10268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17973.127172 secs 2024-03-28T10:59:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17973.127172 secs 2024-03-28T10:59:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17973.127172 secs 2024-03-28T10:59:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:34 smithi086 ceph-mon[35163]: pgmap v10269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:34 smithi159 ceph-mon[36109]: pgmap v10269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:34 smithi055 ceph-mon[31863]: pgmap v10269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:36 smithi086 ceph-mon[35163]: pgmap v10270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:36 smithi159 ceph-mon[36109]: pgmap v10270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:36 smithi055 ceph-mon[31863]: pgmap v10270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:38 smithi086 ceph-mon[35163]: pgmap v10271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17978.127254 secs 2024-03-28T10:59:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:38 smithi159 ceph-mon[36109]: pgmap v10271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17978.127254 secs 2024-03-28T10:59:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:38 smithi055 ceph-mon[31863]: pgmap v10271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17978.127254 secs 2024-03-28T10:59:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:40 smithi086 ceph-mon[35163]: pgmap v10272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:40 smithi159 ceph-mon[36109]: pgmap v10272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:40 smithi055 ceph-mon[31863]: pgmap v10272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:42 smithi086 ceph-mon[35163]: pgmap v10273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:42 smithi159 ceph-mon[36109]: pgmap v10273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:42 smithi055 ceph-mon[31863]: pgmap v10273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17983.127330 secs 2024-03-28T10:59:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17983.127330 secs 2024-03-28T10:59:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17983.127330 secs 2024-03-28T10:59:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:44 smithi055 ceph-mon[31863]: pgmap v10274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:44.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:44 smithi086 ceph-mon[35163]: pgmap v10274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:44.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:44 smithi159 ceph-mon[36109]: pgmap v10274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:46.658 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:46 smithi159 ceph-mon[36109]: pgmap v10275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:46 smithi055 ceph-mon[31863]: pgmap v10275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:46 smithi086 ceph-mon[35163]: pgmap v10275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:48 smithi055 ceph-mon[31863]: pgmap v10276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17988.127415 secs 2024-03-28T10:59:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:48 smithi086 ceph-mon[35163]: pgmap v10276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17988.127415 secs 2024-03-28T10:59:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:48 smithi159 ceph-mon[36109]: pgmap v10276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17988.127415 secs 2024-03-28T10:59:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:50 smithi055 ceph-mon[31863]: pgmap v10277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:50 smithi086 ceph-mon[35163]: pgmap v10277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:50 smithi159 ceph-mon[36109]: pgmap v10277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:52 smithi055 ceph-mon[31863]: pgmap v10278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:52 smithi086 ceph-mon[35163]: pgmap v10278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:52 smithi159 ceph-mon[36109]: pgmap v10278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17993.127535 secs 2024-03-28T10:59:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17993.127535 secs 2024-03-28T10:59:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17993.127535 secs 2024-03-28T10:59:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:54 smithi055 ceph-mon[31863]: pgmap v10279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:54 smithi086 ceph-mon[35163]: pgmap v10279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:54 smithi159 ceph-mon[36109]: pgmap v10279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T10:59:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:56 smithi055 ceph-mon[31863]: pgmap v10280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:56.957 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:56 smithi086 ceph-mon[35163]: pgmap v10280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:57.029 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:56 smithi159 ceph-mon[36109]: pgmap v10280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T10:59:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:58 smithi086 ceph-mon[35163]: pgmap v10281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 10:59:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 17998.127656 secs 2024-03-28T10:59:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:58 smithi159 ceph-mon[36109]: pgmap v10281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 10:59:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 17998.127656 secs 2024-03-28T10:59:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:58 smithi055 ceph-mon[31863]: pgmap v10281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T10:59:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 10:59:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 17998.127656 secs 2024-03-28T11:00:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:00 smithi086 ceph-mon[35163]: pgmap v10282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:00:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:00 smithi159 ceph-mon[36109]: pgmap v10282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:00:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:00 smithi055 ceph-mon[31863]: pgmap v10282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:00:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:02 smithi086 ceph-mon[35163]: pgmap v10283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:02 smithi159 ceph-mon[36109]: pgmap v10283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:02 smithi055 ceph-mon[31863]: pgmap v10283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18003.127742 secs 2024-03-28T11:00:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18003.127742 secs 2024-03-28T11:00:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18003.127742 secs 2024-03-28T11:00:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:04 smithi086 ceph-mon[35163]: pgmap v10284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:04 smithi159 ceph-mon[36109]: pgmap v10284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:04 smithi055 ceph-mon[31863]: pgmap v10284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:06 smithi086 ceph-mon[35163]: pgmap v10285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:06 smithi159 ceph-mon[36109]: pgmap v10285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:06 smithi055 ceph-mon[31863]: pgmap v10285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:08 smithi086 ceph-mon[35163]: pgmap v10286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18008.127869 secs 2024-03-28T11:00:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:08 smithi159 ceph-mon[36109]: pgmap v10286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18008.127869 secs 2024-03-28T11:00:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:08 smithi055 ceph-mon[31863]: pgmap v10286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18008.127869 secs 2024-03-28T11:00:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:10 smithi086 ceph-mon[35163]: pgmap v10287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:10 smithi159 ceph-mon[36109]: pgmap v10287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:10 smithi055 ceph-mon[31863]: pgmap v10287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:12 smithi086 ceph-mon[35163]: pgmap v10288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:12 smithi159 ceph-mon[36109]: pgmap v10288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:12 smithi055 ceph-mon[31863]: pgmap v10288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18013.127985 secs 2024-03-28T11:00:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18013.127985 secs 2024-03-28T11:00:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18013.127985 secs 2024-03-28T11:00:14.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:14 smithi086 ceph-mon[35163]: pgmap v10289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:14.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:14 smithi159 ceph-mon[36109]: pgmap v10289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:14 smithi055 ceph-mon[31863]: pgmap v10289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:16 smithi086 ceph-mon[35163]: pgmap v10290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:16 smithi159 ceph-mon[36109]: pgmap v10290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:16 smithi055 ceph-mon[31863]: pgmap v10290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:00:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:18 smithi086 ceph-mon[35163]: pgmap v10291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18018.128062 secs 2024-03-28T11:00:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:18 smithi159 ceph-mon[36109]: pgmap v10291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18018.128062 secs 2024-03-28T11:00:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:18 smithi055 ceph-mon[31863]: pgmap v10291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18018.128062 secs 2024-03-28T11:00:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:20 smithi086 ceph-mon[35163]: pgmap v10292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:00:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:20 smithi159 ceph-mon[36109]: pgmap v10292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:00:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:20 smithi055 ceph-mon[31863]: pgmap v10292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:00:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:00:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:00:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:00:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:00:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:00:22.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:00:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:00:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:00:22.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:00:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:22 smithi086 ceph-mon[35163]: pgmap v10293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:22 smithi086 ceph-mon[35163]: pgmap v10294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:22 smithi159 ceph-mon[36109]: pgmap v10293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:23.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:22 smithi159 ceph-mon[36109]: pgmap v10294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:22 smithi055 ceph-mon[31863]: pgmap v10293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:22 smithi055 ceph-mon[31863]: pgmap v10294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18023.128179 secs 2024-03-28T11:00:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18023.128179 secs 2024-03-28T11:00:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18023.128179 secs 2024-03-28T11:00:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:24 smithi086 ceph-mon[35163]: pgmap v10295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:24 smithi159 ceph-mon[36109]: pgmap v10295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:24 smithi055 ceph-mon[31863]: pgmap v10295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:25 smithi086 ceph-mon[35163]: pgmap v10296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:00:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:25 smithi159 ceph-mon[36109]: pgmap v10296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:00:26.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:25 smithi055 ceph-mon[31863]: pgmap v10296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:00:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:28 smithi086 ceph-mon[35163]: pgmap v10297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18028.128289 secs 2024-03-28T11:00:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:28 smithi159 ceph-mon[36109]: pgmap v10297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18028.128289 secs 2024-03-28T11:00:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:28 smithi055 ceph-mon[31863]: pgmap v10297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18028.128289 secs 2024-03-28T11:00:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:30 smithi086 ceph-mon[35163]: pgmap v10298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:30 smithi159 ceph-mon[36109]: pgmap v10298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:30 smithi055 ceph-mon[31863]: pgmap v10298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:32 smithi086 ceph-mon[35163]: pgmap v10299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:00:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:32 smithi159 ceph-mon[36109]: pgmap v10299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:00:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:32 smithi055 ceph-mon[31863]: pgmap v10299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:00:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18033.128371 secs 2024-03-28T11:00:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18033.128371 secs 2024-03-28T11:00:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18033.128371 secs 2024-03-28T11:00:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:34 smithi086 ceph-mon[35163]: pgmap v10300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:34 smithi159 ceph-mon[36109]: pgmap v10300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:34 smithi055 ceph-mon[31863]: pgmap v10300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:36 smithi086 ceph-mon[35163]: pgmap v10301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:36 smithi159 ceph-mon[36109]: pgmap v10301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:36.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:36 smithi055 ceph-mon[31863]: pgmap v10301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:38 smithi086 ceph-mon[35163]: pgmap v10302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18038.128490 secs 2024-03-28T11:00:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:38 smithi159 ceph-mon[36109]: pgmap v10302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:38.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18038.128490 secs 2024-03-28T11:00:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:38 smithi055 ceph-mon[31863]: pgmap v10302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18038.128490 secs 2024-03-28T11:00:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:40 smithi086 ceph-mon[35163]: pgmap v10303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:40.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:40 smithi159 ceph-mon[36109]: pgmap v10303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:40 smithi055 ceph-mon[31863]: pgmap v10303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:42 smithi086 ceph-mon[35163]: pgmap v10304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:42 smithi159 ceph-mon[36109]: pgmap v10304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:42 smithi055 ceph-mon[31863]: pgmap v10304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18043.128612 secs 2024-03-28T11:00:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18043.128612 secs 2024-03-28T11:00:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18043.128612 secs 2024-03-28T11:00:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:44 smithi055 ceph-mon[31863]: pgmap v10305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:44 smithi086 ceph-mon[35163]: pgmap v10305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:44 smithi159 ceph-mon[36109]: pgmap v10305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:46.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:46 smithi055 ceph-mon[31863]: pgmap v10306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:46 smithi086 ceph-mon[35163]: pgmap v10306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:46 smithi159 ceph-mon[36109]: pgmap v10306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:48 smithi055 ceph-mon[31863]: pgmap v10307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18048.128698 secs 2024-03-28T11:00:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:48 smithi086 ceph-mon[35163]: pgmap v10307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18048.128698 secs 2024-03-28T11:00:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:48 smithi159 ceph-mon[36109]: pgmap v10307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:48.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18048.128698 secs 2024-03-28T11:00:50.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:50 smithi055 ceph-mon[31863]: pgmap v10308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:50 smithi086 ceph-mon[35163]: pgmap v10308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:50 smithi159 ceph-mon[36109]: pgmap v10308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:52.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:52 smithi055 ceph-mon[31863]: pgmap v10309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:52 smithi086 ceph-mon[35163]: pgmap v10309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:52 smithi159 ceph-mon[36109]: pgmap v10309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18053.128771 secs 2024-03-28T11:00:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18053.128771 secs 2024-03-28T11:00:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18053.128771 secs 2024-03-28T11:00:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:54 smithi086 ceph-mon[35163]: pgmap v10310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:54 smithi159 ceph-mon[36109]: pgmap v10310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:54 smithi055 ceph-mon[31863]: pgmap v10310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:56 smithi086 ceph-mon[35163]: pgmap v10311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:56 smithi159 ceph-mon[36109]: pgmap v10311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:56 smithi055 ceph-mon[31863]: pgmap v10311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:00:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:58 smithi086 ceph-mon[35163]: pgmap v10312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:00:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18058.128818 secs 2024-03-28T11:00:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:58 smithi159 ceph-mon[36109]: pgmap v10312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:00:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18058.128818 secs 2024-03-28T11:00:58.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:58 smithi055 ceph-mon[31863]: pgmap v10312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:00:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:00:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18058.128818 secs 2024-03-28T11:01:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:00 smithi086 ceph-mon[35163]: pgmap v10313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:00 smithi159 ceph-mon[36109]: pgmap v10313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:00 smithi055 ceph-mon[31863]: pgmap v10313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:02 smithi086 ceph-mon[35163]: pgmap v10314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:02 smithi159 ceph-mon[36109]: pgmap v10314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:02.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:02 smithi055 ceph-mon[31863]: pgmap v10314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18063.128899 secs 2024-03-28T11:01:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18063.128899 secs 2024-03-28T11:01:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18063.128899 secs 2024-03-28T11:01:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:04 smithi086 ceph-mon[35163]: pgmap v10315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:04 smithi159 ceph-mon[36109]: pgmap v10315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:04 smithi055 ceph-mon[31863]: pgmap v10315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:06 smithi086 ceph-mon[35163]: pgmap v10316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:06 smithi159 ceph-mon[36109]: pgmap v10316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:06 smithi055 ceph-mon[31863]: pgmap v10316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:08 smithi086 ceph-mon[35163]: pgmap v10317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18068.128989 secs 2024-03-28T11:01:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:08 smithi159 ceph-mon[36109]: pgmap v10317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18068.128989 secs 2024-03-28T11:01:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:08 smithi055 ceph-mon[31863]: pgmap v10317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18068.128989 secs 2024-03-28T11:01:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:10 smithi086 ceph-mon[35163]: pgmap v10318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:10 smithi159 ceph-mon[36109]: pgmap v10318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:10 smithi055 ceph-mon[31863]: pgmap v10318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:12 smithi086 ceph-mon[35163]: pgmap v10319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:12 smithi159 ceph-mon[36109]: pgmap v10319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:12.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:12 smithi055 ceph-mon[31863]: pgmap v10319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18073.129067 secs 2024-03-28T11:01:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18073.129067 secs 2024-03-28T11:01:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18073.129067 secs 2024-03-28T11:01:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:14 smithi086 ceph-mon[35163]: pgmap v10320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:14 smithi159 ceph-mon[36109]: pgmap v10320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:14 smithi055 ceph-mon[31863]: pgmap v10320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:16 smithi086 ceph-mon[35163]: pgmap v10321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:16 smithi159 ceph-mon[36109]: pgmap v10321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:16.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:16 smithi055 ceph-mon[31863]: pgmap v10321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:18 smithi086 ceph-mon[35163]: pgmap v10322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18078.129120 secs 2024-03-28T11:01:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:18 smithi159 ceph-mon[36109]: pgmap v10322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18078.129120 secs 2024-03-28T11:01:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:18 smithi055 ceph-mon[31863]: pgmap v10322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18078.129120 secs 2024-03-28T11:01:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:20 smithi086 ceph-mon[35163]: pgmap v10323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:20 smithi159 ceph-mon[36109]: pgmap v10323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:20.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:20 smithi055 ceph-mon[31863]: pgmap v10323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:22 smithi086 ceph-mon[35163]: pgmap v10324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:01:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:22 smithi159 ceph-mon[36109]: pgmap v10324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:22.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:01:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:22 smithi055 ceph-mon[31863]: pgmap v10324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:01:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18083.129242 secs 2024-03-28T11:01:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:01:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:01:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:01:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18083.129242 secs 2024-03-28T11:01:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:01:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:01:23.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:01:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18083.129242 secs 2024-03-28T11:01:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:01:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:01:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:01:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:24 smithi086 ceph-mon[35163]: pgmap v10325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:24 smithi086 ceph-mon[35163]: pgmap v10326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:24.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:24 smithi159 ceph-mon[36109]: pgmap v10325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:24.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:24 smithi159 ceph-mon[36109]: pgmap v10326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:24 smithi055 ceph-mon[31863]: pgmap v10325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:24 smithi055 ceph-mon[31863]: pgmap v10326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:26 smithi086 ceph-mon[35163]: pgmap v10327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:26 smithi159 ceph-mon[36109]: pgmap v10327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:26.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:26 smithi055 ceph-mon[31863]: pgmap v10327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:28 smithi159 ceph-mon[36109]: pgmap v10328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18088.129308 secs 2024-03-28T11:01:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:28 smithi055 ceph-mon[31863]: pgmap v10328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18088.129308 secs 2024-03-28T11:01:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:28 smithi086 ceph-mon[35163]: pgmap v10328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18088.129308 secs 2024-03-28T11:01:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:30 smithi055 ceph-mon[31863]: pgmap v10329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:30 smithi086 ceph-mon[35163]: pgmap v10329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:30 smithi159 ceph-mon[36109]: pgmap v10329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:32.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:32 smithi055 ceph-mon[31863]: pgmap v10330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:32 smithi086 ceph-mon[35163]: pgmap v10330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:32 smithi159 ceph-mon[36109]: pgmap v10330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:01:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18093.129391 secs 2024-03-28T11:01:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18093.129391 secs 2024-03-28T11:01:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18093.129391 secs 2024-03-28T11:01:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:34 smithi055 ceph-mon[31863]: pgmap v10331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:01:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:34 smithi086 ceph-mon[35163]: pgmap v10331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:01:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:34 smithi159 ceph-mon[36109]: pgmap v10331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:01:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:36 smithi055 ceph-mon[31863]: pgmap v10332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:36 smithi086 ceph-mon[35163]: pgmap v10332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:36 smithi159 ceph-mon[36109]: pgmap v10332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:38 smithi055 ceph-mon[31863]: pgmap v10333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18098.129455 secs 2024-03-28T11:01:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:38 smithi086 ceph-mon[35163]: pgmap v10333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18098.129455 secs 2024-03-28T11:01:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:38 smithi159 ceph-mon[36109]: pgmap v10333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18098.129455 secs 2024-03-28T11:01:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:40 smithi055 ceph-mon[31863]: pgmap v10334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:40 smithi086 ceph-mon[35163]: pgmap v10334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:40 smithi159 ceph-mon[36109]: pgmap v10334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:42 smithi055 ceph-mon[31863]: pgmap v10335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:42 smithi086 ceph-mon[35163]: pgmap v10335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:42 smithi159 ceph-mon[36109]: pgmap v10335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18103.129521 secs 2024-03-28T11:01:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18103.129521 secs 2024-03-28T11:01:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18103.129521 secs 2024-03-28T11:01:44.970 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:44 smithi086 ceph-mon[35163]: pgmap v10336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:44.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:44 smithi159 ceph-mon[36109]: pgmap v10336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:44 smithi055 ceph-mon[31863]: pgmap v10336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:46 smithi086 ceph-mon[35163]: pgmap v10337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:46 smithi159 ceph-mon[36109]: pgmap v10337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:46 smithi055 ceph-mon[31863]: pgmap v10337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:48 smithi086 ceph-mon[35163]: pgmap v10338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18108.129595 secs 2024-03-28T11:01:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:48 smithi159 ceph-mon[36109]: pgmap v10338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18108.129595 secs 2024-03-28T11:01:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:48 smithi055 ceph-mon[31863]: pgmap v10338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18108.129595 secs 2024-03-28T11:01:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:50 smithi086 ceph-mon[35163]: pgmap v10339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:50 smithi159 ceph-mon[36109]: pgmap v10339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:50 smithi055 ceph-mon[31863]: pgmap v10339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:52 smithi086 ceph-mon[35163]: pgmap v10340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:52 smithi159 ceph-mon[36109]: pgmap v10340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:52 smithi055 ceph-mon[31863]: pgmap v10340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18113.129661 secs 2024-03-28T11:01:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18113.129661 secs 2024-03-28T11:01:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18113.129661 secs 2024-03-28T11:01:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:54 smithi086 ceph-mon[35163]: pgmap v10341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:54 smithi159 ceph-mon[36109]: pgmap v10341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:54 smithi055 ceph-mon[31863]: pgmap v10341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:56 smithi086 ceph-mon[35163]: pgmap v10342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:56 smithi159 ceph-mon[36109]: pgmap v10342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:56 smithi055 ceph-mon[31863]: pgmap v10342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:01:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:58 smithi086 ceph-mon[35163]: pgmap v10343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:01:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18118.129714 secs 2024-03-28T11:01:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:58 smithi159 ceph-mon[36109]: pgmap v10343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:01:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18118.129714 secs 2024-03-28T11:01:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:58 smithi055 ceph-mon[31863]: pgmap v10343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:01:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:01:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18118.129714 secs 2024-03-28T11:02:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:00 smithi086 ceph-mon[35163]: pgmap v10344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:00 smithi159 ceph-mon[36109]: pgmap v10344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:00 smithi055 ceph-mon[31863]: pgmap v10344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:02 smithi086 ceph-mon[35163]: pgmap v10345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:02 smithi159 ceph-mon[36109]: pgmap v10345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:02 smithi055 ceph-mon[31863]: pgmap v10345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18123.129791 secs 2024-03-28T11:02:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18123.129791 secs 2024-03-28T11:02:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18123.129791 secs 2024-03-28T11:02:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:04 smithi086 ceph-mon[35163]: pgmap v10346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:04 smithi159 ceph-mon[36109]: pgmap v10346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:04 smithi055 ceph-mon[31863]: pgmap v10346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:06 smithi086 ceph-mon[35163]: pgmap v10347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:06 smithi159 ceph-mon[36109]: pgmap v10347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:06 smithi055 ceph-mon[31863]: pgmap v10347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:08 smithi086 ceph-mon[35163]: pgmap v10348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18128.129885 secs 2024-03-28T11:02:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:08 smithi159 ceph-mon[36109]: pgmap v10348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18128.129885 secs 2024-03-28T11:02:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:08 smithi055 ceph-mon[31863]: pgmap v10348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18128.129885 secs 2024-03-28T11:02:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:10 smithi086 ceph-mon[35163]: pgmap v10349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:10 smithi159 ceph-mon[36109]: pgmap v10349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:10 smithi055 ceph-mon[31863]: pgmap v10349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:12 smithi086 ceph-mon[35163]: pgmap v10350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:12 smithi159 ceph-mon[36109]: pgmap v10350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:12 smithi055 ceph-mon[31863]: pgmap v10350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18133.129980 secs 2024-03-28T11:02:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:13 smithi086 ceph-mon[35163]: pgmap v10351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18133.129980 secs 2024-03-28T11:02:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:13 smithi159 ceph-mon[36109]: pgmap v10351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18133.129980 secs 2024-03-28T11:02:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:13 smithi055 ceph-mon[31863]: pgmap v10351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:16 smithi055 ceph-mon[31863]: pgmap v10352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:16 smithi086 ceph-mon[35163]: pgmap v10352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:16 smithi159 ceph-mon[36109]: pgmap v10352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:18 smithi055 ceph-mon[31863]: pgmap v10353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18138.130049 secs 2024-03-28T11:02:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:18 smithi086 ceph-mon[35163]: pgmap v10353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18138.130049 secs 2024-03-28T11:02:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:18 smithi159 ceph-mon[36109]: pgmap v10353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18138.130049 secs 2024-03-28T11:02:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:20 smithi055 ceph-mon[31863]: pgmap v10354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:20 smithi086 ceph-mon[35163]: pgmap v10354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:20 smithi159 ceph-mon[36109]: pgmap v10354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:22 smithi055 ceph-mon[31863]: pgmap v10355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:22 smithi086 ceph-mon[35163]: pgmap v10355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:22 smithi159 ceph-mon[36109]: pgmap v10355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18143.130098 secs 2024-03-28T11:02:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18143.130098 secs 2024-03-28T11:02:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18143.130098 secs 2024-03-28T11:02:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:24 smithi086 ceph-mon[35163]: pgmap v10356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:02:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:24 smithi159 ceph-mon[36109]: pgmap v10356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:02:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:24 smithi055 ceph-mon[31863]: pgmap v10356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:02:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:02:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:02:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:25 smithi086 ceph-mon[35163]: pgmap v10357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:25 smithi086 ceph-mon[35163]: pgmap v10358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:02:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:02:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:02:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:25 smithi159 ceph-mon[36109]: pgmap v10357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:25 smithi159 ceph-mon[36109]: pgmap v10358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:02:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:02:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:02:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:25 smithi055 ceph-mon[31863]: pgmap v10357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:25 smithi055 ceph-mon[31863]: pgmap v10358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:25.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:02:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:26 smithi055 ceph-mon[31863]: pgmap v10359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:26 smithi086 ceph-mon[35163]: pgmap v10359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:26 smithi159 ceph-mon[36109]: pgmap v10359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18148.130220 secs 2024-03-28T11:02:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18148.130220 secs 2024-03-28T11:02:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18148.130220 secs 2024-03-28T11:02:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:29 smithi086 ceph-mon[35163]: pgmap v10360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:29 smithi159 ceph-mon[36109]: pgmap v10360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:29 smithi055 ceph-mon[31863]: pgmap v10360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:30 smithi055 ceph-mon[31863]: pgmap v10361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:30 smithi086 ceph-mon[35163]: pgmap v10361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:30 smithi159 ceph-mon[36109]: pgmap v10361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:32 smithi055 ceph-mon[31863]: pgmap v10362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:02:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:32 smithi086 ceph-mon[35163]: pgmap v10362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:02:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:32 smithi159 ceph-mon[36109]: pgmap v10362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:02:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18153.130330 secs 2024-03-28T11:02:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18153.130330 secs 2024-03-28T11:02:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18153.130330 secs 2024-03-28T11:02:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:35 smithi055 ceph-mon[31863]: pgmap v10363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:35 smithi086 ceph-mon[35163]: pgmap v10363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:35 smithi159 ceph-mon[36109]: pgmap v10363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:36 smithi055 ceph-mon[31863]: pgmap v10364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:36 smithi086 ceph-mon[35163]: pgmap v10364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:36 smithi159 ceph-mon[36109]: pgmap v10364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18158.130416 secs 2024-03-28T11:02:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18158.130416 secs 2024-03-28T11:02:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18158.130416 secs 2024-03-28T11:02:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:39 smithi086 ceph-mon[35163]: pgmap v10365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:39 smithi159 ceph-mon[36109]: pgmap v10365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:39 smithi055 ceph-mon[31863]: pgmap v10365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:40 smithi055 ceph-mon[31863]: pgmap v10366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:40 smithi086 ceph-mon[35163]: pgmap v10366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:40 smithi159 ceph-mon[36109]: pgmap v10366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:02:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:42 smithi055 ceph-mon[31863]: pgmap v10367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:42 smithi086 ceph-mon[35163]: pgmap v10367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:42 smithi159 ceph-mon[36109]: pgmap v10367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:02:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18163.130536 secs 2024-03-28T11:02:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18163.130536 secs 2024-03-28T11:02:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18163.130536 secs 2024-03-28T11:02:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:44 smithi055 ceph-mon[31863]: pgmap v10368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:44 smithi086 ceph-mon[35163]: pgmap v10368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:44 smithi159 ceph-mon[36109]: pgmap v10368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:47.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:46 smithi086 ceph-mon[35163]: pgmap v10369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:47.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:46 smithi159 ceph-mon[36109]: pgmap v10369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:46 smithi055 ceph-mon[31863]: pgmap v10369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:02:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18168.130644 secs 2024-03-28T11:02:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18168.130644 secs 2024-03-28T11:02:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18168.130644 secs 2024-03-28T11:02:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:49 smithi086 ceph-mon[35163]: pgmap v10370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:49 smithi159 ceph-mon[36109]: pgmap v10370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:49 smithi055 ceph-mon[31863]: pgmap v10370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:50 smithi055 ceph-mon[31863]: pgmap v10371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:50 smithi086 ceph-mon[35163]: pgmap v10371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:50 smithi159 ceph-mon[36109]: pgmap v10371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:52 smithi055 ceph-mon[31863]: pgmap v10372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:02:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:52 smithi086 ceph-mon[35163]: pgmap v10372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:02:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:52 smithi159 ceph-mon[36109]: pgmap v10372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:02:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18173.130722 secs 2024-03-28T11:02:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18173.130722 secs 2024-03-28T11:02:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18173.130722 secs 2024-03-28T11:02:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:54 smithi055 ceph-mon[31863]: pgmap v10373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:54 smithi086 ceph-mon[35163]: pgmap v10373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:54 smithi159 ceph-mon[36109]: pgmap v10373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:56 smithi055 ceph-mon[31863]: pgmap v10374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:56 smithi086 ceph-mon[35163]: pgmap v10374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:56 smithi159 ceph-mon[36109]: pgmap v10374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18178.130811 secs 2024-03-28T11:02:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18178.130811 secs 2024-03-28T11:02:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18178.130811 secs 2024-03-28T11:02:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:02:59 smithi086 ceph-mon[35163]: pgmap v10375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:02:59 smithi159 ceph-mon[36109]: pgmap v10375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:02:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:02:59 smithi055 ceph-mon[31863]: pgmap v10375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:03:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:00 smithi055 ceph-mon[31863]: pgmap v10376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:00 smithi086 ceph-mon[35163]: pgmap v10376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:00 smithi159 ceph-mon[36109]: pgmap v10376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:03.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:02 smithi055 ceph-mon[31863]: pgmap v10377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:02 smithi086 ceph-mon[35163]: pgmap v10377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:02 smithi159 ceph-mon[36109]: pgmap v10377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18183.130934 secs 2024-03-28T11:03:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18183.130934 secs 2024-03-28T11:03:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18183.130934 secs 2024-03-28T11:03:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:04 smithi055 ceph-mon[31863]: pgmap v10378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:04 smithi086 ceph-mon[35163]: pgmap v10378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:04 smithi159 ceph-mon[36109]: pgmap v10378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:06 smithi055 ceph-mon[31863]: pgmap v10379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:06 smithi086 ceph-mon[35163]: pgmap v10379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:06 smithi159 ceph-mon[36109]: pgmap v10379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18188.131051 secs 2024-03-28T11:03:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18188.131051 secs 2024-03-28T11:03:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18188.131051 secs 2024-03-28T11:03:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:09 smithi086 ceph-mon[35163]: pgmap v10380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:09 smithi159 ceph-mon[36109]: pgmap v10380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:09 smithi055 ceph-mon[31863]: pgmap v10380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:10 smithi055 ceph-mon[31863]: pgmap v10381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:10 smithi086 ceph-mon[35163]: pgmap v10381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:10 smithi159 ceph-mon[36109]: pgmap v10381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:12 smithi055 ceph-mon[31863]: pgmap v10382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:12 smithi086 ceph-mon[35163]: pgmap v10382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:12 smithi159 ceph-mon[36109]: pgmap v10382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18193.131184 secs 2024-03-28T11:03:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18193.131184 secs 2024-03-28T11:03:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18193.131184 secs 2024-03-28T11:03:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:14 smithi055 ceph-mon[31863]: pgmap v10383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:14 smithi086 ceph-mon[35163]: pgmap v10383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:14 smithi159 ceph-mon[36109]: pgmap v10383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:17.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:16 smithi086 ceph-mon[35163]: pgmap v10384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:17.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:16 smithi159 ceph-mon[36109]: pgmap v10384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:16 smithi055 ceph-mon[31863]: pgmap v10384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18198.131305 secs 2024-03-28T11:03:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18198.131305 secs 2024-03-28T11:03:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18198.131305 secs 2024-03-28T11:03:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:19 smithi086 ceph-mon[35163]: pgmap v10385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:19 smithi159 ceph-mon[36109]: pgmap v10385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:19 smithi055 ceph-mon[31863]: pgmap v10385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:20 smithi055 ceph-mon[31863]: pgmap v10386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:20 smithi086 ceph-mon[35163]: pgmap v10386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:20 smithi159 ceph-mon[36109]: pgmap v10386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:22 smithi055 ceph-mon[31863]: pgmap v10387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:22 smithi086 ceph-mon[35163]: pgmap v10387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:22 smithi159 ceph-mon[36109]: pgmap v10387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18203.131427 secs 2024-03-28T11:03:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18203.131427 secs 2024-03-28T11:03:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18203.131427 secs 2024-03-28T11:03:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:24 smithi055 ceph-mon[31863]: pgmap v10388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:24 smithi086 ceph-mon[35163]: pgmap v10388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:24 smithi159 ceph-mon[36109]: pgmap v10388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:25 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:03:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:25 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:03:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:25 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:03:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:03:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:03:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:26 smithi086 ceph-mon[35163]: pgmap v10389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:26 smithi086 ceph-mon[35163]: pgmap v10390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:03:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:03:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:03:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:26 smithi159 ceph-mon[36109]: pgmap v10389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:26 smithi159 ceph-mon[36109]: pgmap v10390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:03:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:03:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:03:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:26 smithi055 ceph-mon[31863]: pgmap v10389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:26 smithi055 ceph-mon[31863]: pgmap v10390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:03:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18208.131492 secs 2024-03-28T11:03:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18208.131492 secs 2024-03-28T11:03:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18208.131492 secs 2024-03-28T11:03:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:29 smithi086 ceph-mon[35163]: pgmap v10391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:29 smithi159 ceph-mon[36109]: pgmap v10391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:29 smithi055 ceph-mon[31863]: pgmap v10391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:31 smithi086 ceph-mon[35163]: pgmap v10392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:31 smithi159 ceph-mon[36109]: pgmap v10392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:31 smithi055 ceph-mon[31863]: pgmap v10392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:33 smithi086 ceph-mon[35163]: pgmap v10393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18213.131616 secs 2024-03-28T11:03:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:33 smithi159 ceph-mon[36109]: pgmap v10393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:33.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18213.131616 secs 2024-03-28T11:03:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:33 smithi055 ceph-mon[31863]: pgmap v10393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18213.131616 secs 2024-03-28T11:03:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:35 smithi086 ceph-mon[35163]: pgmap v10394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:35 smithi159 ceph-mon[36109]: pgmap v10394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:35.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:35 smithi055 ceph-mon[31863]: pgmap v10394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:37 smithi086 ceph-mon[35163]: pgmap v10395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:03:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:37 smithi159 ceph-mon[36109]: pgmap v10395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:03:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:37 smithi055 ceph-mon[31863]: pgmap v10395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:03:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18218.131737 secs 2024-03-28T11:03:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18218.131737 secs 2024-03-28T11:03:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18218.131737 secs 2024-03-28T11:03:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:39 smithi086 ceph-mon[35163]: pgmap v10396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:39 smithi159 ceph-mon[36109]: pgmap v10396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:39 smithi055 ceph-mon[31863]: pgmap v10396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:41 smithi055 ceph-mon[31863]: pgmap v10397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:41 smithi086 ceph-mon[35163]: pgmap v10397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:41 smithi159 ceph-mon[36109]: pgmap v10397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:43 smithi055 ceph-mon[31863]: pgmap v10398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18223.131865 secs 2024-03-28T11:03:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:43 smithi086 ceph-mon[35163]: pgmap v10398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18223.131865 secs 2024-03-28T11:03:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:43 smithi159 ceph-mon[36109]: pgmap v10398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18223.131865 secs 2024-03-28T11:03:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:45 smithi055 ceph-mon[31863]: pgmap v10399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:45 smithi086 ceph-mon[35163]: pgmap v10399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:45 smithi159 ceph-mon[36109]: pgmap v10399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:47.870 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:47 smithi086 ceph-mon[35163]: pgmap v10400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:47.872 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:47 smithi159 ceph-mon[36109]: pgmap v10400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:47 smithi055 ceph-mon[31863]: pgmap v10400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18228.131908 secs 2024-03-28T11:03:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18228.131908 secs 2024-03-28T11:03:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18228.131908 secs 2024-03-28T11:03:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:49 smithi055 ceph-mon[31863]: pgmap v10401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:49 smithi086 ceph-mon[35163]: pgmap v10401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:49 smithi159 ceph-mon[36109]: pgmap v10401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:51 smithi055 ceph-mon[31863]: pgmap v10402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:51 smithi086 ceph-mon[35163]: pgmap v10402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:51 smithi159 ceph-mon[36109]: pgmap v10402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:03:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:53 smithi086 ceph-mon[35163]: pgmap v10403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18233.131977 secs 2024-03-28T11:03:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:53 smithi159 ceph-mon[36109]: pgmap v10403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18233.131977 secs 2024-03-28T11:03:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:53 smithi055 ceph-mon[31863]: pgmap v10403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:03:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18233.131977 secs 2024-03-28T11:03:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:55 smithi086 ceph-mon[35163]: pgmap v10404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:55 smithi159 ceph-mon[36109]: pgmap v10404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:55 smithi055 ceph-mon[31863]: pgmap v10404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:57 smithi086 ceph-mon[35163]: pgmap v10405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:57 smithi159 ceph-mon[36109]: pgmap v10405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:57 smithi055 ceph-mon[31863]: pgmap v10405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:03:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18238.132098 secs 2024-03-28T11:03:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18238.132098 secs 2024-03-28T11:03:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18238.132098 secs 2024-03-28T11:04:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:03:59 smithi086 ceph-mon[35163]: pgmap v10406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:03:59 smithi159 ceph-mon[36109]: pgmap v10406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:03:59 smithi055 ceph-mon[31863]: pgmap v10406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:01 smithi086 ceph-mon[35163]: pgmap v10407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:01 smithi159 ceph-mon[36109]: pgmap v10407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:01 smithi055 ceph-mon[31863]: pgmap v10407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:03 smithi086 ceph-mon[35163]: pgmap v10408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18243.132215 secs 2024-03-28T11:04:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:03 smithi159 ceph-mon[36109]: pgmap v10408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18243.132215 secs 2024-03-28T11:04:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:03 smithi055 ceph-mon[31863]: pgmap v10408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18243.132215 secs 2024-03-28T11:04:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:05 smithi086 ceph-mon[35163]: pgmap v10409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:05 smithi159 ceph-mon[36109]: pgmap v10409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:05 smithi055 ceph-mon[31863]: pgmap v10409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:07 smithi086 ceph-mon[35163]: pgmap v10410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:07 smithi159 ceph-mon[36109]: pgmap v10410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:07 smithi055 ceph-mon[31863]: pgmap v10410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18248.132338 secs 2024-03-28T11:04:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18248.132338 secs 2024-03-28T11:04:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18248.132338 secs 2024-03-28T11:04:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:09 smithi086 ceph-mon[35163]: pgmap v10411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:09 smithi159 ceph-mon[36109]: pgmap v10411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:10.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:09 smithi055 ceph-mon[31863]: pgmap v10411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:11 smithi086 ceph-mon[35163]: pgmap v10412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:11 smithi159 ceph-mon[36109]: pgmap v10412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:11 smithi055 ceph-mon[31863]: pgmap v10412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:13 smithi086 ceph-mon[35163]: pgmap v10413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18253.132459 secs 2024-03-28T11:04:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:13 smithi159 ceph-mon[36109]: pgmap v10413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18253.132459 secs 2024-03-28T11:04:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:13 smithi055 ceph-mon[31863]: pgmap v10413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18253.132459 secs 2024-03-28T11:04:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:15 smithi086 ceph-mon[35163]: pgmap v10414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:15 smithi159 ceph-mon[36109]: pgmap v10414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:16.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:15 smithi055 ceph-mon[31863]: pgmap v10414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:17 smithi086 ceph-mon[35163]: pgmap v10415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:17 smithi159 ceph-mon[36109]: pgmap v10415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:18.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:17 smithi055 ceph-mon[31863]: pgmap v10415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18258.132536 secs 2024-03-28T11:04:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18258.132536 secs 2024-03-28T11:04:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18258.132536 secs 2024-03-28T11:04:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:19 smithi086 ceph-mon[35163]: pgmap v10416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:19 smithi159 ceph-mon[36109]: pgmap v10416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:19 smithi055 ceph-mon[31863]: pgmap v10416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:21 smithi086 ceph-mon[35163]: pgmap v10417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:21 smithi159 ceph-mon[36109]: pgmap v10417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:21 smithi055 ceph-mon[31863]: pgmap v10417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:04:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:23 smithi086 ceph-mon[35163]: pgmap v10418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18263.132655 secs 2024-03-28T11:04:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:23 smithi159 ceph-mon[36109]: pgmap v10418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18263.132655 secs 2024-03-28T11:04:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:23 smithi055 ceph-mon[31863]: pgmap v10418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18263.132655 secs 2024-03-28T11:04:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:25 smithi086 ceph-mon[35163]: pgmap v10419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:25.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:25 smithi159 ceph-mon[36109]: pgmap v10419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:25 smithi055 ceph-mon[31863]: pgmap v10419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:27 smithi086 ceph-mon[35163]: pgmap v10420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:04:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:27 smithi159 ceph-mon[36109]: pgmap v10420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:27.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:04:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:27 smithi055 ceph-mon[31863]: pgmap v10420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:27.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:04:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18268.132723 secs 2024-03-28T11:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:04:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18268.132723 secs 2024-03-28T11:04:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:04:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:04:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:04:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18268.132723 secs 2024-03-28T11:04:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:04:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:04:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:04:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:29 smithi086 ceph-mon[35163]: pgmap v10421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:29 smithi086 ceph-mon[35163]: pgmap v10422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:29 smithi159 ceph-mon[36109]: pgmap v10421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:29 smithi159 ceph-mon[36109]: pgmap v10422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:29 smithi055 ceph-mon[31863]: pgmap v10421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:29 smithi055 ceph-mon[31863]: pgmap v10422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:31.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:31 smithi055 ceph-mon[31863]: pgmap v10423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T11:04:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:31 smithi086 ceph-mon[35163]: pgmap v10423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T11:04:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:31 smithi159 ceph-mon[36109]: pgmap v10423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3 op/s 2024-03-28T11:04:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:33 smithi055 ceph-mon[31863]: pgmap v10424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:33.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18273.132810 secs 2024-03-28T11:04:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:33 smithi086 ceph-mon[35163]: pgmap v10424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18273.132810 secs 2024-03-28T11:04:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:33 smithi159 ceph-mon[36109]: pgmap v10424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18273.132810 secs 2024-03-28T11:04:35.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:35 smithi055 ceph-mon[31863]: pgmap v10425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:35 smithi086 ceph-mon[35163]: pgmap v10425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:36.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:35 smithi159 ceph-mon[36109]: pgmap v10425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:04:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:37 smithi055 ceph-mon[31863]: pgmap v10426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:37 smithi086 ceph-mon[35163]: pgmap v10426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:38.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:37 smithi159 ceph-mon[36109]: pgmap v10426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18278.132929 secs 2024-03-28T11:04:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18278.132929 secs 2024-03-28T11:04:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18278.132929 secs 2024-03-28T11:04:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:39 smithi086 ceph-mon[35163]: pgmap v10427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:04:40.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:39 smithi159 ceph-mon[36109]: pgmap v10427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:04:40.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:39 smithi055 ceph-mon[31863]: pgmap v10427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:04:41.925 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:41 smithi055 ceph-mon[31863]: pgmap v10428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:41 smithi086 ceph-mon[35163]: pgmap v10428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:42.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:41 smithi159 ceph-mon[36109]: pgmap v10428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:43 smithi086 ceph-mon[35163]: pgmap v10429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18283.133017 secs 2024-03-28T11:04:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:43 smithi159 ceph-mon[36109]: pgmap v10429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18283.133017 secs 2024-03-28T11:04:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:43 smithi055 ceph-mon[31863]: pgmap v10429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18283.133017 secs 2024-03-28T11:04:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:45 smithi086 ceph-mon[35163]: pgmap v10430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:46.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:45 smithi159 ceph-mon[36109]: pgmap v10430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:46.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:45 smithi055 ceph-mon[31863]: pgmap v10430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:47 smithi086 ceph-mon[35163]: pgmap v10431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:47 smithi159 ceph-mon[36109]: pgmap v10431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:47 smithi055 ceph-mon[31863]: pgmap v10431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18288.133122 secs 2024-03-28T11:04:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18288.133122 secs 2024-03-28T11:04:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18288.133122 secs 2024-03-28T11:04:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:49 smithi086 ceph-mon[35163]: pgmap v10432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:49 smithi159 ceph-mon[36109]: pgmap v10432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:49 smithi055 ceph-mon[31863]: pgmap v10432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:51 smithi086 ceph-mon[35163]: pgmap v10433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:52.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:51 smithi159 ceph-mon[36109]: pgmap v10433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:52.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:51 smithi055 ceph-mon[31863]: pgmap v10433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:04:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:53 smithi086 ceph-mon[35163]: pgmap v10434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18293.133212 secs 2024-03-28T11:04:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:53 smithi159 ceph-mon[36109]: pgmap v10434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18293.133212 secs 2024-03-28T11:04:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:53 smithi055 ceph-mon[31863]: pgmap v10434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18293.133212 secs 2024-03-28T11:04:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:55 smithi086 ceph-mon[35163]: pgmap v10435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:55 smithi159 ceph-mon[36109]: pgmap v10435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:55 smithi055 ceph-mon[31863]: pgmap v10435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:57 smithi086 ceph-mon[35163]: pgmap v10436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:57 smithi159 ceph-mon[36109]: pgmap v10436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:57 smithi055 ceph-mon[31863]: pgmap v10436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:04:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18298.133292 secs 2024-03-28T11:04:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18298.133292 secs 2024-03-28T11:04:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18298.133292 secs 2024-03-28T11:05:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:04:59 smithi086 ceph-mon[35163]: pgmap v10437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:00.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:04:59 smithi159 ceph-mon[36109]: pgmap v10437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:00.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:04:59 smithi055 ceph-mon[31863]: pgmap v10437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:01 smithi086 ceph-mon[35163]: pgmap v10438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:01 smithi159 ceph-mon[36109]: pgmap v10438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:01 smithi055 ceph-mon[31863]: pgmap v10438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:03 smithi086 ceph-mon[35163]: pgmap v10439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18303.133419 secs 2024-03-28T11:05:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:03 smithi159 ceph-mon[36109]: pgmap v10439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18303.133419 secs 2024-03-28T11:05:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:03 smithi055 ceph-mon[31863]: pgmap v10439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18303.133419 secs 2024-03-28T11:05:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:05 smithi086 ceph-mon[35163]: pgmap v10440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:05 smithi159 ceph-mon[36109]: pgmap v10440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:05 smithi055 ceph-mon[31863]: pgmap v10440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:07 smithi086 ceph-mon[35163]: pgmap v10441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:08.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:07 smithi159 ceph-mon[36109]: pgmap v10441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:08.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:07 smithi055 ceph-mon[31863]: pgmap v10441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18308.133506 secs 2024-03-28T11:05:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18308.133506 secs 2024-03-28T11:05:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18308.133506 secs 2024-03-28T11:05:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:09 smithi086 ceph-mon[35163]: pgmap v10442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:09 smithi159 ceph-mon[36109]: pgmap v10442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:09 smithi055 ceph-mon[31863]: pgmap v10442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:11 smithi086 ceph-mon[35163]: pgmap v10443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:11 smithi159 ceph-mon[36109]: pgmap v10443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:12.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:11 smithi055 ceph-mon[31863]: pgmap v10443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:13 smithi086 ceph-mon[35163]: pgmap v10444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18313.133629 secs 2024-03-28T11:05:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:13 smithi159 ceph-mon[36109]: pgmap v10444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18313.133629 secs 2024-03-28T11:05:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:13 smithi055 ceph-mon[31863]: pgmap v10444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18313.133629 secs 2024-03-28T11:05:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:15 smithi086 ceph-mon[35163]: pgmap v10445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:15 smithi159 ceph-mon[36109]: pgmap v10445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:16.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:15 smithi055 ceph-mon[31863]: pgmap v10445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:17 smithi086 ceph-mon[35163]: pgmap v10446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:17 smithi159 ceph-mon[36109]: pgmap v10446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:18.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:17 smithi055 ceph-mon[31863]: pgmap v10446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18318.133728 secs 2024-03-28T11:05:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18318.133728 secs 2024-03-28T11:05:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18318.133728 secs 2024-03-28T11:05:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:19 smithi086 ceph-mon[35163]: pgmap v10447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:19 smithi159 ceph-mon[36109]: pgmap v10447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:19 smithi055 ceph-mon[31863]: pgmap v10447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:21 smithi055 ceph-mon[31863]: pgmap v10448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:21 smithi086 ceph-mon[35163]: pgmap v10448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:21 smithi159 ceph-mon[36109]: pgmap v10448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:22 smithi086 ceph-mon[35163]: pgmap v10449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:22 smithi159 ceph-mon[36109]: pgmap v10449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:22 smithi055 ceph-mon[31863]: pgmap v10449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18323.133843 secs 2024-03-28T11:05:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18323.133843 secs 2024-03-28T11:05:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18323.133843 secs 2024-03-28T11:05:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:24 smithi086 ceph-mon[35163]: pgmap v10450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:24 smithi159 ceph-mon[36109]: pgmap v10450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:24 smithi055 ceph-mon[31863]: pgmap v10450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:27 smithi086 ceph-mon[35163]: pgmap v10451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:27 smithi159 ceph-mon[36109]: pgmap v10451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:27 smithi055 ceph-mon[31863]: pgmap v10451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18328.133932 secs 2024-03-28T11:05:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18328.133932 secs 2024-03-28T11:05:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18328.133932 secs 2024-03-28T11:05:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:29 smithi055 ceph-mon[31863]: pgmap v10452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:29.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:05:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:29 smithi086 ceph-mon[35163]: pgmap v10452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:05:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:29 smithi159 ceph-mon[36109]: pgmap v10452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:05:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:05:30.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:05:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:05:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:05:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:05:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:05:30.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:05:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:31 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:05:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:31 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:05:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:31 smithi055 ceph-mon[31863]: pgmap v10453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:31 smithi055 ceph-mon[31863]: pgmap v10454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:31 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:05:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:31 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:05:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:31 smithi086 ceph-mon[35163]: pgmap v10453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:31 smithi086 ceph-mon[35163]: pgmap v10454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:31.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:31 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:05:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:31 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:05:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:31 smithi159 ceph-mon[36109]: pgmap v10453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:31.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:31 smithi159 ceph-mon[36109]: pgmap v10454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:33 smithi055 ceph-mon[31863]: pgmap v10455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18333.134005 secs 2024-03-28T11:05:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:33 smithi086 ceph-mon[35163]: pgmap v10455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18333.134005 secs 2024-03-28T11:05:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:33 smithi159 ceph-mon[36109]: pgmap v10455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18333.134005 secs 2024-03-28T11:05:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:35 smithi055 ceph-mon[31863]: pgmap v10456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:35 smithi086 ceph-mon[35163]: pgmap v10456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:35 smithi159 ceph-mon[36109]: pgmap v10456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:37 smithi086 ceph-mon[35163]: pgmap v10457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:37 smithi159 ceph-mon[36109]: pgmap v10457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:37 smithi055 ceph-mon[31863]: pgmap v10457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18338.134096 secs 2024-03-28T11:05:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18338.134096 secs 2024-03-28T11:05:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18338.134096 secs 2024-03-28T11:05:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:39 smithi086 ceph-mon[35163]: pgmap v10458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:39 smithi159 ceph-mon[36109]: pgmap v10458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:39 smithi055 ceph-mon[31863]: pgmap v10458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:05:41.675 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:41 smithi055 ceph-mon[31863]: pgmap v10459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:05:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:41 smithi086 ceph-mon[35163]: pgmap v10459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:05:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:41 smithi159 ceph-mon[36109]: pgmap v10459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:05:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:43 smithi086 ceph-mon[35163]: pgmap v10460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18343.134181 secs 2024-03-28T11:05:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:43 smithi159 ceph-mon[36109]: pgmap v10460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18343.134181 secs 2024-03-28T11:05:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:43 smithi055 ceph-mon[31863]: pgmap v10460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18343.134181 secs 2024-03-28T11:05:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:45 smithi086 ceph-mon[35163]: pgmap v10461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:45 smithi159 ceph-mon[36109]: pgmap v10461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:45 smithi055 ceph-mon[31863]: pgmap v10461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:47 smithi086 ceph-mon[35163]: pgmap v10462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:47 smithi159 ceph-mon[36109]: pgmap v10462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:47 smithi055 ceph-mon[31863]: pgmap v10462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18348.134267 secs 2024-03-28T11:05:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18348.134267 secs 2024-03-28T11:05:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18348.134267 secs 2024-03-28T11:05:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:49 smithi086 ceph-mon[35163]: pgmap v10463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:49.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:49 smithi159 ceph-mon[36109]: pgmap v10463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:49 smithi055 ceph-mon[31863]: pgmap v10463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:51 smithi086 ceph-mon[35163]: pgmap v10464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:51.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:51 smithi159 ceph-mon[36109]: pgmap v10464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:51 smithi055 ceph-mon[31863]: pgmap v10464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:05:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:53 smithi086 ceph-mon[35163]: pgmap v10465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18353.134357 secs 2024-03-28T11:05:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:53 smithi159 ceph-mon[36109]: pgmap v10465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18353.134357 secs 2024-03-28T11:05:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:53 smithi055 ceph-mon[31863]: pgmap v10465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18353.134357 secs 2024-03-28T11:05:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:55 smithi086 ceph-mon[35163]: pgmap v10466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:55 smithi159 ceph-mon[36109]: pgmap v10466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:55 smithi055 ceph-mon[31863]: pgmap v10466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:57 smithi086 ceph-mon[35163]: pgmap v10467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:57.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:57 smithi159 ceph-mon[36109]: pgmap v10467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:57 smithi055 ceph-mon[31863]: pgmap v10467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18358.134477 secs 2024-03-28T11:05:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18358.134477 secs 2024-03-28T11:05:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18358.134477 secs 2024-03-28T11:05:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:05:59 smithi086 ceph-mon[35163]: pgmap v10468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:05:59 smithi159 ceph-mon[36109]: pgmap v10468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:05:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:05:59 smithi055 ceph-mon[31863]: pgmap v10468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:01 smithi086 ceph-mon[35163]: pgmap v10469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:01 smithi159 ceph-mon[36109]: pgmap v10469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:01 smithi055 ceph-mon[31863]: pgmap v10469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:03 smithi086 ceph-mon[35163]: pgmap v10470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18363.134598 secs 2024-03-28T11:06:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:03 smithi159 ceph-mon[36109]: pgmap v10470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18363.134598 secs 2024-03-28T11:06:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:03 smithi055 ceph-mon[31863]: pgmap v10470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18363.134598 secs 2024-03-28T11:06:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:05 smithi086 ceph-mon[35163]: pgmap v10471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:05 smithi159 ceph-mon[36109]: pgmap v10471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:05.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:05 smithi055 ceph-mon[31863]: pgmap v10471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:07 smithi086 ceph-mon[35163]: pgmap v10472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:07 smithi159 ceph-mon[36109]: pgmap v10472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:07 smithi055 ceph-mon[31863]: pgmap v10472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18368.134670 secs 2024-03-28T11:06:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18368.134670 secs 2024-03-28T11:06:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18368.134670 secs 2024-03-28T11:06:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:09 smithi086 ceph-mon[35163]: pgmap v10473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:09 smithi159 ceph-mon[36109]: pgmap v10473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:09 smithi055 ceph-mon[31863]: pgmap v10473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:11 smithi086 ceph-mon[35163]: pgmap v10474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:11 smithi159 ceph-mon[36109]: pgmap v10474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:11 smithi055 ceph-mon[31863]: pgmap v10474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:13 smithi086 ceph-mon[35163]: pgmap v10475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18373.134740 secs 2024-03-28T11:06:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:13 smithi159 ceph-mon[36109]: pgmap v10475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18373.134740 secs 2024-03-28T11:06:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:13 smithi055 ceph-mon[31863]: pgmap v10475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18373.134740 secs 2024-03-28T11:06:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:15 smithi086 ceph-mon[35163]: pgmap v10476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:15.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:15 smithi159 ceph-mon[36109]: pgmap v10476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:15.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:15 smithi055 ceph-mon[31863]: pgmap v10476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:17 smithi086 ceph-mon[35163]: pgmap v10477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:17.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:17 smithi159 ceph-mon[36109]: pgmap v10477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:17 smithi055 ceph-mon[31863]: pgmap v10477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18378.134868 secs 2024-03-28T11:06:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18378.134868 secs 2024-03-28T11:06:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18378.134868 secs 2024-03-28T11:06:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:19 smithi055 ceph-mon[31863]: pgmap v10478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:19 smithi086 ceph-mon[35163]: pgmap v10478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:19 smithi159 ceph-mon[36109]: pgmap v10478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:21.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:21 smithi055 ceph-mon[31863]: pgmap v10479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:21 smithi086 ceph-mon[35163]: pgmap v10479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:21 smithi159 ceph-mon[36109]: pgmap v10479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:23 smithi055 ceph-mon[31863]: pgmap v10480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18383.134992 secs 2024-03-28T11:06:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:23 smithi086 ceph-mon[35163]: pgmap v10480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18383.134992 secs 2024-03-28T11:06:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:23 smithi159 ceph-mon[36109]: pgmap v10480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:24.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18383.134992 secs 2024-03-28T11:06:25.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:25 smithi055 ceph-mon[31863]: pgmap v10481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:25 smithi086 ceph-mon[35163]: pgmap v10481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:25 smithi159 ceph-mon[36109]: pgmap v10481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:27.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:27 smithi055 ceph-mon[31863]: pgmap v10482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:27 smithi086 ceph-mon[35163]: pgmap v10482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:27 smithi159 ceph-mon[36109]: pgmap v10482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18388.135117 secs 2024-03-28T11:06:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18388.135117 secs 2024-03-28T11:06:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18388.135117 secs 2024-03-28T11:06:29.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:29 smithi055 ceph-mon[31863]: pgmap v10483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:29 smithi086 ceph-mon[35163]: pgmap v10483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:29 smithi159 ceph-mon[36109]: pgmap v10483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:06:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:06:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:06:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:31 smithi086 ceph-mon[35163]: pgmap v10484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:31 smithi159 ceph-mon[36109]: pgmap v10484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:31 smithi055 ceph-mon[31863]: pgmap v10484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: pgmap v10485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: pgmap v10486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:06:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: pgmap v10485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: pgmap v10486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:33.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:06:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:06:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: pgmap v10485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: pgmap v10486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:33.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:06:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18393.135194 secs 2024-03-28T11:06:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18393.135194 secs 2024-03-28T11:06:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18393.135194 secs 2024-03-28T11:06:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:34 smithi086 ceph-mon[35163]: pgmap v10487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:34 smithi159 ceph-mon[36109]: pgmap v10487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:34 smithi055 ceph-mon[31863]: pgmap v10487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:35 smithi086 ceph-mon[35163]: pgmap v10488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:35 smithi159 ceph-mon[36109]: pgmap v10488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:35 smithi055 ceph-mon[31863]: pgmap v10488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:37 smithi086 ceph-mon[35163]: pgmap v10489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:06:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:37 smithi159 ceph-mon[36109]: pgmap v10489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:06:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:37 smithi055 ceph-mon[31863]: pgmap v10489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:06:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18398.135318 secs 2024-03-28T11:06:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18398.135318 secs 2024-03-28T11:06:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18398.135318 secs 2024-03-28T11:06:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:39 smithi086 ceph-mon[35163]: pgmap v10490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:39 smithi159 ceph-mon[36109]: pgmap v10490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:39 smithi055 ceph-mon[31863]: pgmap v10490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:06:42.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:41 smithi055 ceph-mon[31863]: pgmap v10491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:41 smithi086 ceph-mon[35163]: pgmap v10491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:41 smithi159 ceph-mon[36109]: pgmap v10491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:06:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18403.135436 secs 2024-03-28T11:06:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18403.135436 secs 2024-03-28T11:06:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18403.135436 secs 2024-03-28T11:06:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:44 smithi086 ceph-mon[35163]: pgmap v10492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:44 smithi159 ceph-mon[36109]: pgmap v10492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:44 smithi055 ceph-mon[31863]: pgmap v10492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:45 smithi086 ceph-mon[35163]: pgmap v10493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:45 smithi159 ceph-mon[36109]: pgmap v10493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:45 smithi055 ceph-mon[31863]: pgmap v10493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:47 smithi086 ceph-mon[35163]: pgmap v10494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:47 smithi159 ceph-mon[36109]: pgmap v10494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:47 smithi055 ceph-mon[31863]: pgmap v10494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18408.135570 secs 2024-03-28T11:06:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18408.135570 secs 2024-03-28T11:06:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18408.135570 secs 2024-03-28T11:06:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:49 smithi086 ceph-mon[35163]: pgmap v10495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:49 smithi159 ceph-mon[36109]: pgmap v10495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:49 smithi055 ceph-mon[31863]: pgmap v10495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:51 smithi086 ceph-mon[35163]: pgmap v10496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:51 smithi159 ceph-mon[36109]: pgmap v10496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:51 smithi055 ceph-mon[31863]: pgmap v10496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18413.135634 secs 2024-03-28T11:06:53.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18413.135634 secs 2024-03-28T11:06:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18413.135634 secs 2024-03-28T11:06:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:54 smithi086 ceph-mon[35163]: pgmap v10497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:54 smithi159 ceph-mon[36109]: pgmap v10497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:54 smithi055 ceph-mon[31863]: pgmap v10497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:06:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:55 smithi086 ceph-mon[35163]: pgmap v10498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:55 smithi159 ceph-mon[36109]: pgmap v10498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:55 smithi055 ceph-mon[31863]: pgmap v10498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:06:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:57 smithi086 ceph-mon[35163]: pgmap v10499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:57 smithi159 ceph-mon[36109]: pgmap v10499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:57 smithi055 ceph-mon[31863]: pgmap v10499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:06:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18418.135697 secs 2024-03-28T11:06:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18418.135697 secs 2024-03-28T11:06:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18418.135697 secs 2024-03-28T11:07:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:06:59 smithi086 ceph-mon[35163]: pgmap v10500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:06:59 smithi159 ceph-mon[36109]: pgmap v10500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:06:59 smithi055 ceph-mon[31863]: pgmap v10500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:01 smithi086 ceph-mon[35163]: pgmap v10501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:01 smithi159 ceph-mon[36109]: pgmap v10501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:01 smithi055 ceph-mon[31863]: pgmap v10501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18423.135762 secs 2024-03-28T11:07:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18423.135762 secs 2024-03-28T11:07:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18423.135762 secs 2024-03-28T11:07:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:04 smithi086 ceph-mon[35163]: pgmap v10502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:04 smithi159 ceph-mon[36109]: pgmap v10502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:04 smithi055 ceph-mon[31863]: pgmap v10502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:05 smithi086 ceph-mon[35163]: pgmap v10503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:05 smithi159 ceph-mon[36109]: pgmap v10503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:05 smithi055 ceph-mon[31863]: pgmap v10503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:07 smithi086 ceph-mon[35163]: pgmap v10504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:07 smithi159 ceph-mon[36109]: pgmap v10504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:07 smithi055 ceph-mon[31863]: pgmap v10504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18428.135860 secs 2024-03-28T11:07:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18428.135860 secs 2024-03-28T11:07:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18428.135860 secs 2024-03-28T11:07:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:09 smithi086 ceph-mon[35163]: pgmap v10505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:09 smithi159 ceph-mon[36109]: pgmap v10505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:09 smithi055 ceph-mon[31863]: pgmap v10505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:12.176 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:11 smithi055 ceph-mon[31863]: pgmap v10506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:11 smithi086 ceph-mon[35163]: pgmap v10506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:12.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:11 smithi159 ceph-mon[36109]: pgmap v10506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18433.135953 secs 2024-03-28T11:07:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18433.135953 secs 2024-03-28T11:07:13.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18433.135953 secs 2024-03-28T11:07:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:14 smithi086 ceph-mon[35163]: pgmap v10507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:14 smithi159 ceph-mon[36109]: pgmap v10507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:14 smithi055 ceph-mon[31863]: pgmap v10507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:15 smithi086 ceph-mon[35163]: pgmap v10508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:15 smithi159 ceph-mon[36109]: pgmap v10508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:15 smithi055 ceph-mon[31863]: pgmap v10508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:17 smithi086 ceph-mon[35163]: pgmap v10509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:17 smithi159 ceph-mon[36109]: pgmap v10509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:17 smithi055 ceph-mon[31863]: pgmap v10509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18438.136070 secs 2024-03-28T11:07:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18438.136070 secs 2024-03-28T11:07:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18438.136070 secs 2024-03-28T11:07:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:19 smithi086 ceph-mon[35163]: pgmap v10510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:19 smithi159 ceph-mon[36109]: pgmap v10510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:19 smithi055 ceph-mon[31863]: pgmap v10510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:21 smithi086 ceph-mon[35163]: pgmap v10511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:21 smithi159 ceph-mon[36109]: pgmap v10511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:21 smithi055 ceph-mon[31863]: pgmap v10511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18443.136159 secs 2024-03-28T11:07:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18443.136159 secs 2024-03-28T11:07:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18443.136159 secs 2024-03-28T11:07:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:24 smithi086 ceph-mon[35163]: pgmap v10512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:24 smithi159 ceph-mon[36109]: pgmap v10512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:24 smithi055 ceph-mon[31863]: pgmap v10512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:25 smithi086 ceph-mon[35163]: pgmap v10513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:25 smithi159 ceph-mon[36109]: pgmap v10513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:25 smithi055 ceph-mon[31863]: pgmap v10513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:07:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:27 smithi086 ceph-mon[35163]: pgmap v10514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:27 smithi159 ceph-mon[36109]: pgmap v10514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:27 smithi055 ceph-mon[31863]: pgmap v10514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18448.136279 secs 2024-03-28T11:07:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18448.136279 secs 2024-03-28T11:07:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18448.136279 secs 2024-03-28T11:07:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:29 smithi086 ceph-mon[35163]: pgmap v10515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:29 smithi159 ceph-mon[36109]: pgmap v10515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:29 smithi055 ceph-mon[31863]: pgmap v10515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:31 smithi086 ceph-mon[35163]: pgmap v10516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:31 smithi159 ceph-mon[36109]: pgmap v10516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:31 smithi055 ceph-mon[31863]: pgmap v10516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:07:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:07:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:07:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18453.136402 secs 2024-03-28T11:07:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:33 smithi086 ceph-mon[35163]: pgmap v10517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18453.136402 secs 2024-03-28T11:07:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:33 smithi159 ceph-mon[36109]: pgmap v10517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18453.136402 secs 2024-03-28T11:07:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:33 smithi055 ceph-mon[31863]: pgmap v10517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:07:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:07:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: pgmap v10518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:07:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: pgmap v10519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T11:07:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:07:35.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:07:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: pgmap v10518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:07:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: pgmap v10519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T11:07:35.572 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:07:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:07:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: pgmap v10518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:07:35.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: pgmap v10519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-03-28T11:07:35.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:07:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:37 smithi086 ceph-mon[35163]: pgmap v10520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:37 smithi159 ceph-mon[36109]: pgmap v10520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:37.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:37 smithi055 ceph-mon[31863]: pgmap v10520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18458.136465 secs 2024-03-28T11:07:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18458.136465 secs 2024-03-28T11:07:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18458.136465 secs 2024-03-28T11:07:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:39 smithi086 ceph-mon[35163]: pgmap v10521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:39 smithi159 ceph-mon[36109]: pgmap v10521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:39 smithi055 ceph-mon[31863]: pgmap v10521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:07:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:41 smithi086 ceph-mon[35163]: pgmap v10522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:41 smithi159 ceph-mon[36109]: pgmap v10522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:41 smithi055 ceph-mon[31863]: pgmap v10522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:43 smithi086 ceph-mon[35163]: pgmap v10523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18463.137173 secs 2024-03-28T11:07:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:43 smithi159 ceph-mon[36109]: pgmap v10523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18463.137173 secs 2024-03-28T11:07:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:43 smithi055 ceph-mon[31863]: pgmap v10523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:07:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18463.137173 secs 2024-03-28T11:07:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:45 smithi086 ceph-mon[35163]: pgmap v10524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:07:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:45 smithi159 ceph-mon[36109]: pgmap v10524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:07:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:45 smithi055 ceph-mon[31863]: pgmap v10524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:07:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:47 smithi086 ceph-mon[35163]: pgmap v10525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:47 smithi159 ceph-mon[36109]: pgmap v10525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:47 smithi055 ceph-mon[31863]: pgmap v10525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18468.137243 secs 2024-03-28T11:07:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18468.137243 secs 2024-03-28T11:07:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18468.137243 secs 2024-03-28T11:07:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:49 smithi086 ceph-mon[35163]: pgmap v10526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:49 smithi159 ceph-mon[36109]: pgmap v10526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:49.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:49 smithi055 ceph-mon[31863]: pgmap v10526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:51 smithi086 ceph-mon[35163]: pgmap v10527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:51 smithi159 ceph-mon[36109]: pgmap v10527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:51 smithi055 ceph-mon[31863]: pgmap v10527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:07:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:53 smithi086 ceph-mon[35163]: pgmap v10528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18473.137274 secs 2024-03-28T11:07:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:53 smithi159 ceph-mon[36109]: pgmap v10528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18473.137274 secs 2024-03-28T11:07:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:53 smithi055 ceph-mon[31863]: pgmap v10528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18473.137274 secs 2024-03-28T11:07:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:55 smithi086 ceph-mon[35163]: pgmap v10529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:55 smithi159 ceph-mon[36109]: pgmap v10529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:55 smithi055 ceph-mon[31863]: pgmap v10529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:57 smithi086 ceph-mon[35163]: pgmap v10530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:57 smithi159 ceph-mon[36109]: pgmap v10530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:57 smithi055 ceph-mon[31863]: pgmap v10530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18478.137339 secs 2024-03-28T11:07:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18478.137339 secs 2024-03-28T11:07:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18478.137339 secs 2024-03-28T11:07:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:07:59 smithi086 ceph-mon[35163]: pgmap v10531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:59.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:07:59 smithi159 ceph-mon[36109]: pgmap v10531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:07:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:07:59 smithi055 ceph-mon[31863]: pgmap v10531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:01 smithi086 ceph-mon[35163]: pgmap v10532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:01 smithi159 ceph-mon[36109]: pgmap v10532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:01.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:01 smithi055 ceph-mon[31863]: pgmap v10532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:03 smithi086 ceph-mon[35163]: pgmap v10533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18483.137413 secs 2024-03-28T11:08:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:03 smithi159 ceph-mon[36109]: pgmap v10533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18483.137413 secs 2024-03-28T11:08:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:03 smithi055 ceph-mon[31863]: pgmap v10533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18483.137413 secs 2024-03-28T11:08:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:05 smithi086 ceph-mon[35163]: pgmap v10534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:05 smithi159 ceph-mon[36109]: pgmap v10534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:05 smithi055 ceph-mon[31863]: pgmap v10534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:07 smithi159 ceph-mon[36109]: pgmap v10535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:07 smithi055 ceph-mon[31863]: pgmap v10535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:07 smithi086 ceph-mon[35163]: pgmap v10535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18488.137536 secs 2024-03-28T11:08:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18488.137536 secs 2024-03-28T11:08:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18488.137536 secs 2024-03-28T11:08:09.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:09 smithi055 ceph-mon[31863]: pgmap v10536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:09 smithi086 ceph-mon[35163]: pgmap v10536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:09 smithi159 ceph-mon[36109]: pgmap v10536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:11.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:11 smithi055 ceph-mon[31863]: pgmap v10537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:11 smithi086 ceph-mon[35163]: pgmap v10537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:12.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:11 smithi159 ceph-mon[36109]: pgmap v10537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:13 smithi055 ceph-mon[31863]: pgmap v10538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18493.137614 secs 2024-03-28T11:08:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:13 smithi086 ceph-mon[35163]: pgmap v10538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18493.137614 secs 2024-03-28T11:08:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:13 smithi159 ceph-mon[36109]: pgmap v10538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18493.137614 secs 2024-03-28T11:08:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:15 smithi055 ceph-mon[31863]: pgmap v10539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:15 smithi086 ceph-mon[35163]: pgmap v10539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:16.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:15 smithi159 ceph-mon[36109]: pgmap v10539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:17 smithi055 ceph-mon[31863]: pgmap v10540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:17 smithi086 ceph-mon[35163]: pgmap v10540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:18.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:17 smithi159 ceph-mon[36109]: pgmap v10540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:18.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18498.137732 secs 2024-03-28T11:08:18.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18498.137732 secs 2024-03-28T11:08:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18498.137732 secs 2024-03-28T11:08:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:19 smithi086 ceph-mon[35163]: pgmap v10541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:19 smithi159 ceph-mon[36109]: pgmap v10541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:20.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:19 smithi055 ceph-mon[31863]: pgmap v10541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:21 smithi086 ceph-mon[35163]: pgmap v10542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:22.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:21 smithi159 ceph-mon[36109]: pgmap v10542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:22.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:21 smithi055 ceph-mon[31863]: pgmap v10542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:23 smithi086 ceph-mon[35163]: pgmap v10543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18503.137839 secs 2024-03-28T11:08:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:23 smithi159 ceph-mon[36109]: pgmap v10543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18503.137839 secs 2024-03-28T11:08:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:23 smithi055 ceph-mon[31863]: pgmap v10543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18503.137839 secs 2024-03-28T11:08:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:25 smithi086 ceph-mon[35163]: pgmap v10544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:26.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:25 smithi159 ceph-mon[36109]: pgmap v10544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:26.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:25 smithi055 ceph-mon[31863]: pgmap v10544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:27 smithi086 ceph-mon[35163]: pgmap v10545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:28.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:27 smithi159 ceph-mon[36109]: pgmap v10545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:28.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:27 smithi055 ceph-mon[31863]: pgmap v10545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18508.137911 secs 2024-03-28T11:08:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18508.137911 secs 2024-03-28T11:08:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18508.137911 secs 2024-03-28T11:08:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:29 smithi086 ceph-mon[35163]: pgmap v10546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:29 smithi159 ceph-mon[36109]: pgmap v10546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:29 smithi055 ceph-mon[31863]: pgmap v10546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:31 smithi086 ceph-mon[35163]: pgmap v10547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:32.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:31 smithi159 ceph-mon[36109]: pgmap v10547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:32.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:31 smithi055 ceph-mon[31863]: pgmap v10547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:33 smithi086 ceph-mon[35163]: pgmap v10548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18513.137973 secs 2024-03-28T11:08:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:33 smithi159 ceph-mon[36109]: pgmap v10548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:34.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18513.137973 secs 2024-03-28T11:08:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:33 smithi055 ceph-mon[31863]: pgmap v10548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18513.137973 secs 2024-03-28T11:08:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:35 smithi086 ceph-mon[35163]: pgmap v10549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:08:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:35 smithi159 ceph-mon[36109]: pgmap v10549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:08:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:35 smithi055 ceph-mon[31863]: pgmap v10549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:08:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:36.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: pgmap v10550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:08:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:08:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: pgmap v10550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:08:38.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:08:38.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: pgmap v10550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:38.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:08:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:08:38.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:08:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:38 smithi086 ceph-mon[35163]: pgmap v10551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:08:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:38 smithi086 ceph-mon[35163]: pgmap v10552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18518.138048 secs 2024-03-28T11:08:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:38 smithi159 ceph-mon[36109]: pgmap v10551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:08:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:38 smithi159 ceph-mon[36109]: pgmap v10552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18518.138048 secs 2024-03-28T11:08:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:38 smithi055 ceph-mon[31863]: pgmap v10551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:08:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:38 smithi055 ceph-mon[31863]: pgmap v10552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18518.138048 secs 2024-03-28T11:08:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:40 smithi086 ceph-mon[35163]: pgmap v10553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:40 smithi159 ceph-mon[36109]: pgmap v10553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:40 smithi055 ceph-mon[31863]: pgmap v10553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:42 smithi086 ceph-mon[35163]: pgmap v10554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:42 smithi159 ceph-mon[36109]: pgmap v10554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:42 smithi055 ceph-mon[31863]: pgmap v10554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:44.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18523.138127 secs 2024-03-28T11:08:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18523.138127 secs 2024-03-28T11:08:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18523.138127 secs 2024-03-28T11:08:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:44 smithi086 ceph-mon[35163]: pgmap v10555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:44 smithi159 ceph-mon[36109]: pgmap v10555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:44 smithi055 ceph-mon[31863]: pgmap v10555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:08:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:46 smithi086 ceph-mon[35163]: pgmap v10556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:46 smithi159 ceph-mon[36109]: pgmap v10556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:46 smithi055 ceph-mon[31863]: pgmap v10556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:48 smithi086 ceph-mon[35163]: pgmap v10557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:08:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18528.138246 secs 2024-03-28T11:08:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:48 smithi159 ceph-mon[36109]: pgmap v10557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:08:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18528.138246 secs 2024-03-28T11:08:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:48 smithi055 ceph-mon[31863]: pgmap v10557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:08:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18528.138246 secs 2024-03-28T11:08:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:50 smithi086 ceph-mon[35163]: pgmap v10558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:50 smithi159 ceph-mon[36109]: pgmap v10558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:50 smithi055 ceph-mon[31863]: pgmap v10558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:52 smithi086 ceph-mon[35163]: pgmap v10559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:52 smithi159 ceph-mon[36109]: pgmap v10559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:52 smithi055 ceph-mon[31863]: pgmap v10559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18533.138322 secs 2024-03-28T11:08:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18533.138322 secs 2024-03-28T11:08:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18533.138322 secs 2024-03-28T11:08:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:54 smithi086 ceph-mon[35163]: pgmap v10560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:54 smithi159 ceph-mon[36109]: pgmap v10560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:54 smithi055 ceph-mon[31863]: pgmap v10560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:08:57.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:56 smithi055 ceph-mon[31863]: pgmap v10561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:56 smithi086 ceph-mon[35163]: pgmap v10561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:57.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:56 smithi159 ceph-mon[36109]: pgmap v10561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:08:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:58 smithi055 ceph-mon[31863]: pgmap v10562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:08:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:08:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18538.138395 secs 2024-03-28T11:08:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:58 smithi086 ceph-mon[35163]: pgmap v10562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:08:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:08:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18538.138395 secs 2024-03-28T11:08:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:58 smithi159 ceph-mon[36109]: pgmap v10562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:08:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:08:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18538.138395 secs 2024-03-28T11:09:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:00 smithi055 ceph-mon[31863]: pgmap v10563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:00 smithi086 ceph-mon[35163]: pgmap v10563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:00 smithi159 ceph-mon[36109]: pgmap v10563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:02 smithi055 ceph-mon[31863]: pgmap v10564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:02 smithi086 ceph-mon[35163]: pgmap v10564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:03.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:02 smithi159 ceph-mon[36109]: pgmap v10564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18543.138469 secs 2024-03-28T11:09:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18543.138469 secs 2024-03-28T11:09:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18543.138469 secs 2024-03-28T11:09:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:04 smithi055 ceph-mon[31863]: pgmap v10565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:04 smithi086 ceph-mon[35163]: pgmap v10565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:05.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:04 smithi159 ceph-mon[36109]: pgmap v10565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:06 smithi055 ceph-mon[31863]: pgmap v10566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:09:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:06 smithi086 ceph-mon[35163]: pgmap v10566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:09:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:06 smithi159 ceph-mon[36109]: pgmap v10566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:09:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:07 smithi086 ceph-mon[35163]: pgmap v10567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:07 smithi159 ceph-mon[36109]: pgmap v10567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:07 smithi055 ceph-mon[31863]: pgmap v10567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:09:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18548.138530 secs 2024-03-28T11:09:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18548.138530 secs 2024-03-28T11:09:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18548.138530 secs 2024-03-28T11:09:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:09 smithi086 ceph-mon[35163]: pgmap v10568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:09 smithi159 ceph-mon[36109]: pgmap v10568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:09 smithi055 ceph-mon[31863]: pgmap v10568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:12 smithi086 ceph-mon[35163]: pgmap v10569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:12 smithi159 ceph-mon[36109]: pgmap v10569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:12 smithi055 ceph-mon[31863]: pgmap v10569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:14.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18553.138592 secs 2024-03-28T11:09:14.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:14 smithi055 ceph-mon[31863]: pgmap v10570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18553.138592 secs 2024-03-28T11:09:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:14 smithi086 ceph-mon[35163]: pgmap v10570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18553.138592 secs 2024-03-28T11:09:14.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:14 smithi159 ceph-mon[36109]: pgmap v10570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:16 smithi086 ceph-mon[35163]: pgmap v10571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:16 smithi159 ceph-mon[36109]: pgmap v10571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:16 smithi055 ceph-mon[31863]: pgmap v10571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:18 smithi086 ceph-mon[35163]: pgmap v10572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18558.138671 secs 2024-03-28T11:09:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:18 smithi159 ceph-mon[36109]: pgmap v10572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18558.138671 secs 2024-03-28T11:09:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:18 smithi055 ceph-mon[31863]: pgmap v10572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:18.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18558.138671 secs 2024-03-28T11:09:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:20 smithi086 ceph-mon[35163]: pgmap v10573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:20 smithi159 ceph-mon[36109]: pgmap v10573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:20 smithi055 ceph-mon[31863]: pgmap v10573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:22 smithi086 ceph-mon[35163]: pgmap v10574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:22 smithi159 ceph-mon[36109]: pgmap v10574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:22 smithi055 ceph-mon[31863]: pgmap v10574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18563.138814 secs 2024-03-28T11:09:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18563.138814 secs 2024-03-28T11:09:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18563.138814 secs 2024-03-28T11:09:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:24 smithi086 ceph-mon[35163]: pgmap v10575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:24 smithi159 ceph-mon[36109]: pgmap v10575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:24 smithi055 ceph-mon[31863]: pgmap v10575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:26 smithi086 ceph-mon[35163]: pgmap v10576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:26 smithi159 ceph-mon[36109]: pgmap v10576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:26 smithi055 ceph-mon[31863]: pgmap v10576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:28 smithi086 ceph-mon[35163]: pgmap v10577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18568.138856 secs 2024-03-28T11:09:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:28 smithi159 ceph-mon[36109]: pgmap v10577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:28.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18568.138856 secs 2024-03-28T11:09:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:28 smithi055 ceph-mon[31863]: pgmap v10577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18568.138856 secs 2024-03-28T11:09:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:30 smithi086 ceph-mon[35163]: pgmap v10578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:30.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:30 smithi159 ceph-mon[36109]: pgmap v10578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:30.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:30 smithi055 ceph-mon[31863]: pgmap v10578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:32 smithi086 ceph-mon[35163]: pgmap v10579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:32 smithi159 ceph-mon[36109]: pgmap v10579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:32 smithi055 ceph-mon[31863]: pgmap v10579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18573.138943 secs 2024-03-28T11:09:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18573.138943 secs 2024-03-28T11:09:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18573.138943 secs 2024-03-28T11:09:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:34 smithi086 ceph-mon[35163]: pgmap v10580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:34.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:34 smithi159 ceph-mon[36109]: pgmap v10580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:34 smithi055 ceph-mon[31863]: pgmap v10580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:36 smithi086 ceph-mon[35163]: pgmap v10581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:36 smithi159 ceph-mon[36109]: pgmap v10581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:36 smithi055 ceph-mon[31863]: pgmap v10581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:38 smithi086 ceph-mon[35163]: pgmap v10582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:38 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:09:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18578.139024 secs 2024-03-28T11:09:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:38 smithi159 ceph-mon[36109]: pgmap v10582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:38 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:09:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18578.139024 secs 2024-03-28T11:09:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:38 smithi055 ceph-mon[31863]: pgmap v10582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:38 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:09:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18578.139024 secs 2024-03-28T11:09:39.702 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:39.702 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:39.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:40 smithi086 ceph-mon[35163]: pgmap v10583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:40.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:40 smithi159 ceph-mon[36109]: pgmap v10583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:40 smithi055 ceph-mon[31863]: pgmap v10583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:41 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:41 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:41.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:41 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:42 smithi086 ceph-mon[35163]: pgmap v10584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:42 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:42 smithi159 ceph-mon[36109]: pgmap v10584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:42 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:42 smithi055 ceph-mon[31863]: pgmap v10584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:42 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18583.139095 secs 2024-03-28T11:09:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18583.139095 secs 2024-03-28T11:09:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18583.139095 secs 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: pgmap v10585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: pgmap v10586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: pgmap v10587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:44.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: pgmap v10585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: pgmap v10586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: pgmap v10587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: pgmap v10585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: pgmap v10586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: pgmap v10587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:09:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:46 smithi086 ceph-mon[35163]: pgmap v10588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:46 smithi159 ceph-mon[36109]: pgmap v10588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:46 smithi055 ceph-mon[31863]: pgmap v10588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:09:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:48 smithi086 ceph-mon[35163]: pgmap v10589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18588.139167 secs 2024-03-28T11:09:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:48 smithi159 ceph-mon[36109]: pgmap v10589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18588.139167 secs 2024-03-28T11:09:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:48 smithi055 ceph-mon[31863]: pgmap v10589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18588.139167 secs 2024-03-28T11:09:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:50 smithi086 ceph-mon[35163]: pgmap v10590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:50 smithi159 ceph-mon[36109]: pgmap v10590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:50 smithi055 ceph-mon[31863]: pgmap v10590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:52 smithi086 ceph-mon[35163]: pgmap v10591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:52 smithi159 ceph-mon[36109]: pgmap v10591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:52 smithi055 ceph-mon[31863]: pgmap v10591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18593.139238 secs 2024-03-28T11:09:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18593.139238 secs 2024-03-28T11:09:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18593.139238 secs 2024-03-28T11:09:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:54 smithi086 ceph-mon[35163]: pgmap v10592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:09:55.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:54 smithi159 ceph-mon[36109]: pgmap v10592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:09:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:54 smithi055 ceph-mon[31863]: pgmap v10592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:09:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:56 smithi086 ceph-mon[35163]: pgmap v10593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:09:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:56 smithi159 ceph-mon[36109]: pgmap v10593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:09:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:56 smithi055 ceph-mon[31863]: pgmap v10593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:09:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:58 smithi086 ceph-mon[35163]: pgmap v10594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:09:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18598.139316 secs 2024-03-28T11:09:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:58 smithi159 ceph-mon[36109]: pgmap v10594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:09:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18598.139316 secs 2024-03-28T11:09:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:58 smithi055 ceph-mon[31863]: pgmap v10594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:09:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:09:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18598.139316 secs 2024-03-28T11:10:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:00 smithi086 ceph-mon[35163]: pgmap v10595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:10:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:00 smithi159 ceph-mon[36109]: pgmap v10595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:10:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:00 smithi055 ceph-mon[31863]: pgmap v10595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:10:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:02 smithi086 ceph-mon[35163]: pgmap v10596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:02 smithi159 ceph-mon[36109]: pgmap v10596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:02 smithi055 ceph-mon[31863]: pgmap v10596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18603.139439 secs 2024-03-28T11:10:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18603.139439 secs 2024-03-28T11:10:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18603.139439 secs 2024-03-28T11:10:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:04 smithi086 ceph-mon[35163]: pgmap v10597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:04 smithi159 ceph-mon[36109]: pgmap v10597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:04 smithi055 ceph-mon[31863]: pgmap v10597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:06 smithi055 ceph-mon[31863]: pgmap v10598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:06 smithi086 ceph-mon[35163]: pgmap v10598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:06 smithi159 ceph-mon[36109]: pgmap v10598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:08 smithi055 ceph-mon[31863]: pgmap v10599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18608.139551 secs 2024-03-28T11:10:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:08 smithi086 ceph-mon[35163]: pgmap v10599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18608.139551 secs 2024-03-28T11:10:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:08 smithi159 ceph-mon[36109]: pgmap v10599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18608.139551 secs 2024-03-28T11:10:11.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:10 smithi055 ceph-mon[31863]: pgmap v10600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:10 smithi086 ceph-mon[35163]: pgmap v10600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:10 smithi159 ceph-mon[36109]: pgmap v10600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:12 smithi055 ceph-mon[31863]: pgmap v10601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:12 smithi086 ceph-mon[35163]: pgmap v10601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:12 smithi159 ceph-mon[36109]: pgmap v10601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18613.139672 secs 2024-03-28T11:10:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18613.139672 secs 2024-03-28T11:10:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18613.139672 secs 2024-03-28T11:10:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:14 smithi055 ceph-mon[31863]: pgmap v10602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:14 smithi086 ceph-mon[35163]: pgmap v10602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:14 smithi159 ceph-mon[36109]: pgmap v10602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:16 smithi055 ceph-mon[31863]: pgmap v10603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:16 smithi086 ceph-mon[35163]: pgmap v10603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:16 smithi159 ceph-mon[36109]: pgmap v10603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:18 smithi086 ceph-mon[35163]: pgmap v10604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18618.139815 secs 2024-03-28T11:10:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:18 smithi159 ceph-mon[36109]: pgmap v10604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18618.139815 secs 2024-03-28T11:10:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:18 smithi055 ceph-mon[31863]: pgmap v10604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18618.139815 secs 2024-03-28T11:10:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:20 smithi086 ceph-mon[35163]: pgmap v10605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:20 smithi159 ceph-mon[36109]: pgmap v10605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:20 smithi055 ceph-mon[31863]: pgmap v10605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:22 smithi086 ceph-mon[35163]: pgmap v10606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:23.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:22 smithi159 ceph-mon[36109]: pgmap v10606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:22 smithi055 ceph-mon[31863]: pgmap v10606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18623.139897 secs 2024-03-28T11:10:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:23 smithi086 ceph-mon[35163]: pgmap v10607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18623.139897 secs 2024-03-28T11:10:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:23 smithi159 ceph-mon[36109]: pgmap v10607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18623.139897 secs 2024-03-28T11:10:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:23 smithi055 ceph-mon[31863]: pgmap v10607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:26 smithi086 ceph-mon[35163]: pgmap v10608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:27.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:26 smithi159 ceph-mon[36109]: pgmap v10608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:26 smithi055 ceph-mon[31863]: pgmap v10608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:28 smithi086 ceph-mon[35163]: pgmap v10609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:10:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18628.139926 secs 2024-03-28T11:10:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:28 smithi159 ceph-mon[36109]: pgmap v10609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:10:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18628.139926 secs 2024-03-28T11:10:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:28 smithi055 ceph-mon[31863]: pgmap v10609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:10:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18628.139926 secs 2024-03-28T11:10:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:30 smithi086 ceph-mon[35163]: pgmap v10610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:30 smithi159 ceph-mon[36109]: pgmap v10610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:30 smithi055 ceph-mon[31863]: pgmap v10610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:32 smithi086 ceph-mon[35163]: pgmap v10611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:32 smithi159 ceph-mon[36109]: pgmap v10611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:32 smithi055 ceph-mon[31863]: pgmap v10611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18633.139991 secs 2024-03-28T11:10:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18633.139991 secs 2024-03-28T11:10:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18633.139991 secs 2024-03-28T11:10:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:34 smithi086 ceph-mon[35163]: pgmap v10612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:34 smithi159 ceph-mon[36109]: pgmap v10612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:34 smithi055 ceph-mon[31863]: pgmap v10612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:36 smithi086 ceph-mon[35163]: pgmap v10613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:36 smithi159 ceph-mon[36109]: pgmap v10613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:36 smithi055 ceph-mon[31863]: pgmap v10613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:38 smithi086 ceph-mon[35163]: pgmap v10614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18638.140057 secs 2024-03-28T11:10:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:38 smithi159 ceph-mon[36109]: pgmap v10614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18638.140057 secs 2024-03-28T11:10:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:38 smithi055 ceph-mon[31863]: pgmap v10614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18638.140057 secs 2024-03-28T11:10:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:40 smithi055 ceph-mon[31863]: pgmap v10615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:40 smithi086 ceph-mon[35163]: pgmap v10615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:40 smithi159 ceph-mon[36109]: pgmap v10615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:42 smithi055 ceph-mon[31863]: pgmap v10616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:42 smithi086 ceph-mon[35163]: pgmap v10616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:42 smithi159 ceph-mon[36109]: pgmap v10616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18643.140121 secs 2024-03-28T11:10:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18643.140121 secs 2024-03-28T11:10:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18643.140121 secs 2024-03-28T11:10:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:44 smithi055 ceph-mon[31863]: pgmap v10617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:10:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:44 smithi086 ceph-mon[35163]: pgmap v10617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:10:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:44 smithi159 ceph-mon[36109]: pgmap v10617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:10:45.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:10:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:10:46.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:10:46.125 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:10:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:10:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:10:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:10:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:10:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:10:46.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:10:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:46 smithi055 ceph-mon[31863]: pgmap v10618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:46 smithi055 ceph-mon[31863]: pgmap v10619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:46 smithi086 ceph-mon[35163]: pgmap v10618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:46 smithi086 ceph-mon[35163]: pgmap v10619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:46 smithi159 ceph-mon[36109]: pgmap v10618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:10:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:46 smithi159 ceph-mon[36109]: pgmap v10619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:49.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:48 smithi086 ceph-mon[35163]: pgmap v10620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:49.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18648.140248 secs 2024-03-28T11:10:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:48 smithi055 ceph-mon[31863]: pgmap v10620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18648.140248 secs 2024-03-28T11:10:49.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:48 smithi159 ceph-mon[36109]: pgmap v10620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:49.123 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18648.140248 secs 2024-03-28T11:10:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:50 smithi159 ceph-mon[36109]: pgmap v10621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:50 smithi086 ceph-mon[35163]: pgmap v10621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:50 smithi055 ceph-mon[31863]: pgmap v10621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:52 smithi086 ceph-mon[35163]: pgmap v10622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:53.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:52 smithi159 ceph-mon[36109]: pgmap v10622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:52 smithi055 ceph-mon[31863]: pgmap v10622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18653.140372 secs 2024-03-28T11:10:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18653.140372 secs 2024-03-28T11:10:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18653.140372 secs 2024-03-28T11:10:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:54 smithi086 ceph-mon[35163]: pgmap v10623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:54 smithi159 ceph-mon[36109]: pgmap v10623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:54 smithi055 ceph-mon[31863]: pgmap v10623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:10:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:55 smithi086 ceph-mon[35163]: pgmap v10624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:56.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:55 smithi159 ceph-mon[36109]: pgmap v10624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:55 smithi055 ceph-mon[31863]: pgmap v10624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:10:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:58 smithi086 ceph-mon[35163]: pgmap v10625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:10:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18658.140496 secs 2024-03-28T11:10:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:58 smithi159 ceph-mon[36109]: pgmap v10625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:10:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18658.140496 secs 2024-03-28T11:10:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:58 smithi055 ceph-mon[31863]: pgmap v10625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:10:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:10:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18658.140496 secs 2024-03-28T11:11:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:00 smithi086 ceph-mon[35163]: pgmap v10626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:00 smithi159 ceph-mon[36109]: pgmap v10626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:00 smithi055 ceph-mon[31863]: pgmap v10626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:02 smithi086 ceph-mon[35163]: pgmap v10627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:02 smithi159 ceph-mon[36109]: pgmap v10627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:02 smithi055 ceph-mon[31863]: pgmap v10627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18663.140574 secs 2024-03-28T11:11:04.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18663.140574 secs 2024-03-28T11:11:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18663.140574 secs 2024-03-28T11:11:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:04 smithi086 ceph-mon[35163]: pgmap v10628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:04 smithi159 ceph-mon[36109]: pgmap v10628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:04 smithi055 ceph-mon[31863]: pgmap v10628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:06 smithi086 ceph-mon[35163]: pgmap v10629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:06 smithi159 ceph-mon[36109]: pgmap v10629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:06 smithi055 ceph-mon[31863]: pgmap v10629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:08 smithi086 ceph-mon[35163]: pgmap v10630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18668.140697 secs 2024-03-28T11:11:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:08 smithi159 ceph-mon[36109]: pgmap v10630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18668.140697 secs 2024-03-28T11:11:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:08 smithi055 ceph-mon[31863]: pgmap v10630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18668.140697 secs 2024-03-28T11:11:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:10 smithi086 ceph-mon[35163]: pgmap v10631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:10 smithi159 ceph-mon[36109]: pgmap v10631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:10 smithi055 ceph-mon[31863]: pgmap v10631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:12 smithi086 ceph-mon[35163]: pgmap v10632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:12 smithi159 ceph-mon[36109]: pgmap v10632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:12 smithi055 ceph-mon[31863]: pgmap v10632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:14.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18673.140821 secs 2024-03-28T11:11:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18673.140821 secs 2024-03-28T11:11:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18673.140821 secs 2024-03-28T11:11:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:14 smithi086 ceph-mon[35163]: pgmap v10633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:14 smithi159 ceph-mon[36109]: pgmap v10633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:15.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:14 smithi055 ceph-mon[31863]: pgmap v10633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:16 smithi086 ceph-mon[35163]: pgmap v10634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:16 smithi159 ceph-mon[36109]: pgmap v10634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:16 smithi055 ceph-mon[31863]: pgmap v10634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:18 smithi086 ceph-mon[35163]: pgmap v10635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18678.140916 secs 2024-03-28T11:11:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:18 smithi159 ceph-mon[36109]: pgmap v10635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18678.140916 secs 2024-03-28T11:11:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:18 smithi055 ceph-mon[31863]: pgmap v10635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18678.140916 secs 2024-03-28T11:11:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:20 smithi086 ceph-mon[35163]: pgmap v10636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:20 smithi159 ceph-mon[36109]: pgmap v10636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:20 smithi055 ceph-mon[31863]: pgmap v10636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:22 smithi086 ceph-mon[35163]: pgmap v10637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:22 smithi159 ceph-mon[36109]: pgmap v10637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:22 smithi055 ceph-mon[31863]: pgmap v10637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18683.141005 secs 2024-03-28T11:11:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18683.141005 secs 2024-03-28T11:11:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18683.141005 secs 2024-03-28T11:11:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:24 smithi086 ceph-mon[35163]: pgmap v10638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:24 smithi159 ceph-mon[36109]: pgmap v10638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:24 smithi055 ceph-mon[31863]: pgmap v10638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:26 smithi086 ceph-mon[35163]: pgmap v10639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:26 smithi159 ceph-mon[36109]: pgmap v10639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:26 smithi055 ceph-mon[31863]: pgmap v10639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:28 smithi086 ceph-mon[35163]: pgmap v10640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18688.141070 secs 2024-03-28T11:11:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:28 smithi159 ceph-mon[36109]: pgmap v10640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18688.141070 secs 2024-03-28T11:11:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:28 smithi055 ceph-mon[31863]: pgmap v10640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18688.141070 secs 2024-03-28T11:11:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:30 smithi086 ceph-mon[35163]: pgmap v10641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:30 smithi159 ceph-mon[36109]: pgmap v10641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:30 smithi055 ceph-mon[31863]: pgmap v10641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:32 smithi086 ceph-mon[35163]: pgmap v10642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:32 smithi159 ceph-mon[36109]: pgmap v10642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:32 smithi055 ceph-mon[31863]: pgmap v10642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18693.141135 secs 2024-03-28T11:11:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18693.141135 secs 2024-03-28T11:11:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18693.141135 secs 2024-03-28T11:11:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:34 smithi086 ceph-mon[35163]: pgmap v10643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:34 smithi159 ceph-mon[36109]: pgmap v10643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:34 smithi055 ceph-mon[31863]: pgmap v10643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:36 smithi055 ceph-mon[31863]: pgmap v10644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:36 smithi086 ceph-mon[35163]: pgmap v10644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:36 smithi159 ceph-mon[36109]: pgmap v10644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:38 smithi055 ceph-mon[31863]: pgmap v10645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18698.141258 secs 2024-03-28T11:11:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:38 smithi086 ceph-mon[35163]: pgmap v10645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18698.141258 secs 2024-03-28T11:11:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:38 smithi159 ceph-mon[36109]: pgmap v10645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18698.141258 secs 2024-03-28T11:11:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:40 smithi055 ceph-mon[31863]: pgmap v10646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:40 smithi086 ceph-mon[35163]: pgmap v10646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:40 smithi159 ceph-mon[36109]: pgmap v10646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:42 smithi055 ceph-mon[31863]: pgmap v10647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:42 smithi086 ceph-mon[35163]: pgmap v10647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:42 smithi159 ceph-mon[36109]: pgmap v10647: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18703.141322 secs 2024-03-28T11:11:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18703.141322 secs 2024-03-28T11:11:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18703.141322 secs 2024-03-28T11:11:45.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:44 smithi055 ceph-mon[31863]: pgmap v10648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:44 smithi086 ceph-mon[35163]: pgmap v10648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:44 smithi159 ceph-mon[36109]: pgmap v10648: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:46 smithi055 ceph-mon[31863]: pgmap v10649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:11:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:46 smithi086 ceph-mon[35163]: pgmap v10649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:11:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:46 smithi159 ceph-mon[36109]: pgmap v10649: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:11:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:11:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:11:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:11:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:11:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:11:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:11:48.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:11:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:11:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:11:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:11:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:48 smithi086 ceph-mon[35163]: pgmap v10650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:48 smithi086 ceph-mon[35163]: pgmap v10651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18708.141400 secs 2024-03-28T11:11:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:48 smithi159 ceph-mon[36109]: pgmap v10650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:48 smithi159 ceph-mon[36109]: pgmap v10651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18708.141400 secs 2024-03-28T11:11:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:48 smithi055 ceph-mon[31863]: pgmap v10650: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:11:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:48 smithi055 ceph-mon[31863]: pgmap v10651: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18708.141400 secs 2024-03-28T11:11:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:50 smithi086 ceph-mon[35163]: pgmap v10652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:50 smithi159 ceph-mon[36109]: pgmap v10652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:50 smithi055 ceph-mon[31863]: pgmap v10652: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:52 smithi086 ceph-mon[35163]: pgmap v10653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:52 smithi159 ceph-mon[36109]: pgmap v10653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:52 smithi055 ceph-mon[31863]: pgmap v10653: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18713.141516 secs 2024-03-28T11:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:53 smithi086 ceph-mon[35163]: pgmap v10654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18713.141516 secs 2024-03-28T11:11:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:53 smithi159 ceph-mon[36109]: pgmap v10654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18713.141516 secs 2024-03-28T11:11:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:53 smithi055 ceph-mon[31863]: pgmap v10654: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:56.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:56 smithi055 ceph-mon[31863]: pgmap v10655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:56 smithi086 ceph-mon[35163]: pgmap v10655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:56 smithi159 ceph-mon[36109]: pgmap v10655: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:11:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:58 smithi086 ceph-mon[35163]: pgmap v10656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:11:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:11:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18718.141580 secs 2024-03-28T11:11:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:58 smithi159 ceph-mon[36109]: pgmap v10656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:11:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:11:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18718.141580 secs 2024-03-28T11:11:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:58 smithi055 ceph-mon[31863]: pgmap v10656: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:11:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:11:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18718.141580 secs 2024-03-28T11:12:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:00 smithi086 ceph-mon[35163]: pgmap v10657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:00.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:00 smithi159 ceph-mon[36109]: pgmap v10657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:00 smithi055 ceph-mon[31863]: pgmap v10657: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:02 smithi086 ceph-mon[35163]: pgmap v10658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:02.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:02 smithi159 ceph-mon[36109]: pgmap v10658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:02 smithi055 ceph-mon[31863]: pgmap v10658: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18723.141642 secs 2024-03-28T11:12:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18723.141642 secs 2024-03-28T11:12:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18723.141642 secs 2024-03-28T11:12:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:04 smithi086 ceph-mon[35163]: pgmap v10659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:04 smithi159 ceph-mon[36109]: pgmap v10659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:04.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:04 smithi055 ceph-mon[31863]: pgmap v10659: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:06 smithi086 ceph-mon[35163]: pgmap v10660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:06.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:06 smithi159 ceph-mon[36109]: pgmap v10660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:06.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:06 smithi055 ceph-mon[31863]: pgmap v10660: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:08 smithi086 ceph-mon[35163]: pgmap v10661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18728.141758 secs 2024-03-28T11:12:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:08 smithi159 ceph-mon[36109]: pgmap v10661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:08.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18728.141758 secs 2024-03-28T11:12:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:08 smithi055 ceph-mon[31863]: pgmap v10661: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18728.141758 secs 2024-03-28T11:12:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:10 smithi086 ceph-mon[35163]: pgmap v10662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:10 smithi159 ceph-mon[36109]: pgmap v10662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:10.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:10 smithi055 ceph-mon[31863]: pgmap v10662: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:12 smithi086 ceph-mon[35163]: pgmap v10663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:12.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:12 smithi159 ceph-mon[36109]: pgmap v10663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:12 smithi055 ceph-mon[31863]: pgmap v10663: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18733.141875 secs 2024-03-28T11:12:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18733.141875 secs 2024-03-28T11:12:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18733.141875 secs 2024-03-28T11:12:14.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:14 smithi055 ceph-mon[31863]: pgmap v10664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:14 smithi086 ceph-mon[35163]: pgmap v10664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:14 smithi159 ceph-mon[36109]: pgmap v10664: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:16 smithi086 ceph-mon[35163]: pgmap v10665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:16 smithi159 ceph-mon[36109]: pgmap v10665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:16 smithi055 ceph-mon[31863]: pgmap v10665: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:18 smithi086 ceph-mon[35163]: pgmap v10666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18738.141941 secs 2024-03-28T11:12:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:18 smithi159 ceph-mon[36109]: pgmap v10666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:18.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18738.141941 secs 2024-03-28T11:12:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:18 smithi055 ceph-mon[31863]: pgmap v10666: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18738.141941 secs 2024-03-28T11:12:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:20 smithi086 ceph-mon[35163]: pgmap v10667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:20.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:20 smithi159 ceph-mon[36109]: pgmap v10667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:20 smithi055 ceph-mon[31863]: pgmap v10667: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:22 smithi086 ceph-mon[35163]: pgmap v10668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:22 smithi159 ceph-mon[36109]: pgmap v10668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:22.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:22 smithi055 ceph-mon[31863]: pgmap v10668: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18743.142006 secs 2024-03-28T11:12:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18743.142006 secs 2024-03-28T11:12:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18743.142006 secs 2024-03-28T11:12:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:24 smithi086 ceph-mon[35163]: pgmap v10669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:24 smithi159 ceph-mon[36109]: pgmap v10669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:24.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:24 smithi055 ceph-mon[31863]: pgmap v10669: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:26 smithi086 ceph-mon[35163]: pgmap v10670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:26 smithi159 ceph-mon[36109]: pgmap v10670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:26 smithi055 ceph-mon[31863]: pgmap v10670: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:28 smithi086 ceph-mon[35163]: pgmap v10671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18748.142072 secs 2024-03-28T11:12:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:28 smithi159 ceph-mon[36109]: pgmap v10671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18748.142072 secs 2024-03-28T11:12:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:28 smithi055 ceph-mon[31863]: pgmap v10671: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18748.142072 secs 2024-03-28T11:12:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:30 smithi086 ceph-mon[35163]: pgmap v10672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:30 smithi159 ceph-mon[36109]: pgmap v10672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:30 smithi055 ceph-mon[31863]: pgmap v10672: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:32 smithi086 ceph-mon[35163]: pgmap v10673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:32 smithi159 ceph-mon[36109]: pgmap v10673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:32 smithi055 ceph-mon[31863]: pgmap v10673: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18753.142167 secs 2024-03-28T11:12:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18753.142167 secs 2024-03-28T11:12:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18753.142167 secs 2024-03-28T11:12:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:34 smithi086 ceph-mon[35163]: pgmap v10674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:34 smithi159 ceph-mon[36109]: pgmap v10674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:34 smithi055 ceph-mon[31863]: pgmap v10674: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:36 smithi086 ceph-mon[35163]: pgmap v10675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:36 smithi159 ceph-mon[36109]: pgmap v10675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:36 smithi055 ceph-mon[31863]: pgmap v10675: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:38 smithi086 ceph-mon[35163]: pgmap v10676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18758.142247 secs 2024-03-28T11:12:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:38 smithi159 ceph-mon[36109]: pgmap v10676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18758.142247 secs 2024-03-28T11:12:39.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:38 smithi055 ceph-mon[31863]: pgmap v10676: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18758.142247 secs 2024-03-28T11:12:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:40 smithi086 ceph-mon[35163]: pgmap v10677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:40 smithi159 ceph-mon[36109]: pgmap v10677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:40 smithi055 ceph-mon[31863]: pgmap v10677: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:42 smithi086 ceph-mon[35163]: pgmap v10678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:42 smithi159 ceph-mon[36109]: pgmap v10678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:42 smithi055 ceph-mon[31863]: pgmap v10678: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:44.024 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18763.142310 secs 2024-03-28T11:12:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18763.142310 secs 2024-03-28T11:12:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18763.142310 secs 2024-03-28T11:12:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:44 smithi086 ceph-mon[35163]: pgmap v10679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:44 smithi159 ceph-mon[36109]: pgmap v10679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:44 smithi055 ceph-mon[31863]: pgmap v10679: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:46 smithi086 ceph-mon[35163]: pgmap v10680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:46 smithi159 ceph-mon[36109]: pgmap v10680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:46 smithi055 ceph-mon[31863]: pgmap v10680: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:12:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:12:48.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:12:48.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:12:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:48 smithi086 ceph-mon[35163]: pgmap v10681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18768.142376 secs 2024-03-28T11:12:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:48 smithi159 ceph-mon[36109]: pgmap v10681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18768.142376 secs 2024-03-28T11:12:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:48 smithi055 ceph-mon[31863]: pgmap v10681: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:12:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18768.142376 secs 2024-03-28T11:12:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:12:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:12:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:12:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:12:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:12:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:12:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:12:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:12:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:12:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:50 smithi086 ceph-mon[35163]: pgmap v10682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:50 smithi086 ceph-mon[35163]: pgmap v10683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:51.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:50 smithi159 ceph-mon[36109]: pgmap v10682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:51.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:50 smithi159 ceph-mon[36109]: pgmap v10683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:50 smithi055 ceph-mon[31863]: pgmap v10682: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:50 smithi055 ceph-mon[31863]: pgmap v10683: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:52 smithi086 ceph-mon[35163]: pgmap v10684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:52 smithi159 ceph-mon[36109]: pgmap v10684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:52 smithi055 ceph-mon[31863]: pgmap v10684: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18773.142441 secs 2024-03-28T11:12:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18773.142441 secs 2024-03-28T11:12:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18773.142441 secs 2024-03-28T11:12:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:54 smithi055 ceph-mon[31863]: pgmap v10685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:54 smithi086 ceph-mon[35163]: pgmap v10685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:54 smithi159 ceph-mon[36109]: pgmap v10685: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:56 smithi055 ceph-mon[31863]: pgmap v10686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:12:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:56 smithi086 ceph-mon[35163]: pgmap v10686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:12:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:56 smithi159 ceph-mon[36109]: pgmap v10686: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:12:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:58 smithi055 ceph-mon[31863]: pgmap v10687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:12:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18778.142506 secs 2024-03-28T11:12:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:58 smithi086 ceph-mon[35163]: pgmap v10687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:12:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18778.142506 secs 2024-03-28T11:12:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:58 smithi159 ceph-mon[36109]: pgmap v10687: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:12:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:12:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18778.142506 secs 2024-03-28T11:13:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:00 smithi055 ceph-mon[31863]: pgmap v10688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:13:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:00 smithi086 ceph-mon[35163]: pgmap v10688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:13:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:00 smithi159 ceph-mon[36109]: pgmap v10688: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:13:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:02 smithi055 ceph-mon[31863]: pgmap v10689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:02 smithi086 ceph-mon[35163]: pgmap v10689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:02 smithi159 ceph-mon[36109]: pgmap v10689: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18783.142569 secs 2024-03-28T11:13:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18783.142569 secs 2024-03-28T11:13:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18783.142569 secs 2024-03-28T11:13:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:04 smithi055 ceph-mon[31863]: pgmap v10690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:04 smithi086 ceph-mon[35163]: pgmap v10690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:04 smithi159 ceph-mon[36109]: pgmap v10690: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:06 smithi086 ceph-mon[35163]: pgmap v10691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:07.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:06 smithi159 ceph-mon[36109]: pgmap v10691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:06 smithi055 ceph-mon[31863]: pgmap v10691: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:08 smithi086 ceph-mon[35163]: pgmap v10692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18788.142649 secs 2024-03-28T11:13:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:08 smithi159 ceph-mon[36109]: pgmap v10692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18788.142649 secs 2024-03-28T11:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:08 smithi055 ceph-mon[31863]: pgmap v10692: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18788.142649 secs 2024-03-28T11:13:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:10 smithi086 ceph-mon[35163]: pgmap v10693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:10 smithi159 ceph-mon[36109]: pgmap v10693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:10 smithi055 ceph-mon[31863]: pgmap v10693: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:12 smithi086 ceph-mon[35163]: pgmap v10694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:13.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:12 smithi159 ceph-mon[36109]: pgmap v10694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:12 smithi055 ceph-mon[31863]: pgmap v10694: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:14.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18793.142838 secs 2024-03-28T11:13:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18793.142838 secs 2024-03-28T11:13:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18793.142838 secs 2024-03-28T11:13:15.306 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:14 smithi055 ceph-mon[31863]: pgmap v10695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:14 smithi086 ceph-mon[35163]: pgmap v10695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:14 smithi159 ceph-mon[36109]: pgmap v10695: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:15 smithi086 ceph-mon[35163]: pgmap v10696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:15 smithi159 ceph-mon[36109]: pgmap v10696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:15 smithi055 ceph-mon[31863]: pgmap v10696: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:18 smithi055 ceph-mon[31863]: pgmap v10697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:18 smithi086 ceph-mon[35163]: pgmap v10697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:18.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:18 smithi159 ceph-mon[36109]: pgmap v10697: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18798.142925 secs 2024-03-28T11:13:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18798.142925 secs 2024-03-28T11:13:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18798.142925 secs 2024-03-28T11:13:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:20 smithi055 ceph-mon[31863]: pgmap v10698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:20 smithi086 ceph-mon[35163]: pgmap v10698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:20 smithi159 ceph-mon[36109]: pgmap v10698: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:22 smithi086 ceph-mon[35163]: pgmap v10699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:22 smithi159 ceph-mon[36109]: pgmap v10699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:22 smithi055 ceph-mon[31863]: pgmap v10699: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18803.143008 secs 2024-03-28T11:13:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:24 smithi086 ceph-mon[35163]: pgmap v10700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18803.143008 secs 2024-03-28T11:13:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:24 smithi159 ceph-mon[36109]: pgmap v10700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18803.143008 secs 2024-03-28T11:13:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:24 smithi055 ceph-mon[31863]: pgmap v10700: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:27.026 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:26 smithi055 ceph-mon[31863]: pgmap v10701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:26 smithi086 ceph-mon[35163]: pgmap v10701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:26 smithi159 ceph-mon[36109]: pgmap v10701: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:28 smithi086 ceph-mon[35163]: pgmap v10702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18808.143131 secs 2024-03-28T11:13:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:28 smithi159 ceph-mon[36109]: pgmap v10702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18808.143131 secs 2024-03-28T11:13:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:28 smithi055 ceph-mon[31863]: pgmap v10702: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18808.143131 secs 2024-03-28T11:13:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:30 smithi086 ceph-mon[35163]: pgmap v10703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:30 smithi159 ceph-mon[36109]: pgmap v10703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:30 smithi055 ceph-mon[31863]: pgmap v10703: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:32 smithi086 ceph-mon[35163]: pgmap v10704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:32 smithi159 ceph-mon[36109]: pgmap v10704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:32 smithi055 ceph-mon[31863]: pgmap v10704: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18813.143212 secs 2024-03-28T11:13:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18813.143212 secs 2024-03-28T11:13:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18813.143212 secs 2024-03-28T11:13:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:34 smithi086 ceph-mon[35163]: pgmap v10705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:34 smithi159 ceph-mon[36109]: pgmap v10705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:34 smithi055 ceph-mon[31863]: pgmap v10705: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:36 smithi086 ceph-mon[35163]: pgmap v10706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:37.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:36 smithi159 ceph-mon[36109]: pgmap v10706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:36 smithi055 ceph-mon[31863]: pgmap v10706: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:38 smithi086 ceph-mon[35163]: pgmap v10707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18818.143333 secs 2024-03-28T11:13:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:38 smithi159 ceph-mon[36109]: pgmap v10707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18818.143333 secs 2024-03-28T11:13:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:38 smithi055 ceph-mon[31863]: pgmap v10707: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18818.143333 secs 2024-03-28T11:13:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:40 smithi086 ceph-mon[35163]: pgmap v10708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:40 smithi159 ceph-mon[36109]: pgmap v10708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:40 smithi055 ceph-mon[31863]: pgmap v10708: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:42 smithi086 ceph-mon[35163]: pgmap v10709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:42 smithi159 ceph-mon[36109]: pgmap v10709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:42 smithi055 ceph-mon[31863]: pgmap v10709: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18823.143452 secs 2024-03-28T11:13:44.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18823.143452 secs 2024-03-28T11:13:44.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18823.143452 secs 2024-03-28T11:13:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:44 smithi086 ceph-mon[35163]: pgmap v10710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:44 smithi159 ceph-mon[36109]: pgmap v10710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:44 smithi055 ceph-mon[31863]: pgmap v10710: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:46 smithi086 ceph-mon[35163]: pgmap v10711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:46 smithi159 ceph-mon[36109]: pgmap v10711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:46 smithi055 ceph-mon[31863]: pgmap v10711: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:13:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:48 smithi086 ceph-mon[35163]: pgmap v10712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18828.143533 secs 2024-03-28T11:13:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:48 smithi159 ceph-mon[36109]: pgmap v10712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18828.143533 secs 2024-03-28T11:13:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:48 smithi055 ceph-mon[31863]: pgmap v10712: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18828.143533 secs 2024-03-28T11:13:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:13:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:13:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:13:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:50 smithi055 ceph-mon[31863]: pgmap v10713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:13:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:13:51.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:13:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:50 smithi086 ceph-mon[35163]: pgmap v10713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:13:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:13:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:13:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:50 smithi159 ceph-mon[36109]: pgmap v10713: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:13:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:13:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:13:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:51 smithi055 ceph-mon[31863]: pgmap v10714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:52.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:51 smithi055 ceph-mon[31863]: pgmap v10715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:52.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:51 smithi086 ceph-mon[35163]: pgmap v10714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:52.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:51 smithi086 ceph-mon[35163]: pgmap v10715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:52.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:51 smithi159 ceph-mon[36109]: pgmap v10714: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:52.222 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:51 smithi159 ceph-mon[36109]: pgmap v10715: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18833.143618 secs 2024-03-28T11:13:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:53 smithi055 ceph-mon[31863]: pgmap v10716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18833.143618 secs 2024-03-28T11:13:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:53 smithi086 ceph-mon[35163]: pgmap v10716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18833.143618 secs 2024-03-28T11:13:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:53 smithi159 ceph-mon[36109]: pgmap v10716: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:56.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:55 smithi055 ceph-mon[31863]: pgmap v10717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:55 smithi086 ceph-mon[35163]: pgmap v10717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:55 smithi159 ceph-mon[36109]: pgmap v10717: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:58.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:57 smithi055 ceph-mon[31863]: pgmap v10718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:57 smithi086 ceph-mon[35163]: pgmap v10718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:57 smithi159 ceph-mon[36109]: pgmap v10718: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:13:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18838.143742 secs 2024-03-28T11:13:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18838.143742 secs 2024-03-28T11:13:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18838.143742 secs 2024-03-28T11:14:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:13:59 smithi086 ceph-mon[35163]: pgmap v10719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:13:59 smithi159 ceph-mon[36109]: pgmap v10719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:13:59 smithi055 ceph-mon[31863]: pgmap v10719: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:01 smithi086 ceph-mon[35163]: pgmap v10720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:14:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:01 smithi159 ceph-mon[36109]: pgmap v10720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:14:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:01 smithi055 ceph-mon[31863]: pgmap v10720: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:14:04.193 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18843.143858 secs 2024-03-28T11:14:04.193 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:03 smithi086 ceph-mon[35163]: pgmap v10721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18843.143858 secs 2024-03-28T11:14:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:03 smithi159 ceph-mon[36109]: pgmap v10721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18843.143858 secs 2024-03-28T11:14:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:03 smithi055 ceph-mon[31863]: pgmap v10721: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:05 smithi086 ceph-mon[35163]: pgmap v10722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:05 smithi159 ceph-mon[36109]: pgmap v10722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:05 smithi055 ceph-mon[31863]: pgmap v10722: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:07 smithi086 ceph-mon[35163]: pgmap v10723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:08.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:07 smithi159 ceph-mon[36109]: pgmap v10723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:07 smithi055 ceph-mon[31863]: pgmap v10723: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18848.143945 secs 2024-03-28T11:14:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18848.143945 secs 2024-03-28T11:14:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18848.143945 secs 2024-03-28T11:14:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:09 smithi086 ceph-mon[35163]: pgmap v10724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:09 smithi159 ceph-mon[36109]: pgmap v10724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:09 smithi055 ceph-mon[31863]: pgmap v10724: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:10 smithi086 ceph-mon[35163]: pgmap v10725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:10 smithi159 ceph-mon[36109]: pgmap v10725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:10 smithi055 ceph-mon[31863]: pgmap v10725: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18853.144011 secs 2024-03-28T11:14:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:13 smithi055 ceph-mon[31863]: pgmap v10726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18853.144011 secs 2024-03-28T11:14:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:13 smithi086 ceph-mon[35163]: pgmap v10726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18853.144011 secs 2024-03-28T11:14:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:13 smithi159 ceph-mon[36109]: pgmap v10726: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:15 smithi086 ceph-mon[35163]: pgmap v10727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:14:16.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:15 smithi159 ceph-mon[36109]: pgmap v10727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:14:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:15 smithi055 ceph-mon[31863]: pgmap v10727: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:14:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:17 smithi086 ceph-mon[35163]: pgmap v10728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:18.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:17 smithi159 ceph-mon[36109]: pgmap v10728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:17 smithi055 ceph-mon[31863]: pgmap v10728: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18858.144104 secs 2024-03-28T11:14:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18858.144104 secs 2024-03-28T11:14:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18858.144104 secs 2024-03-28T11:14:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:19 smithi086 ceph-mon[35163]: pgmap v10729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:19 smithi159 ceph-mon[36109]: pgmap v10729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:19 smithi055 ceph-mon[31863]: pgmap v10729: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:21 smithi086 ceph-mon[35163]: pgmap v10730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:21 smithi159 ceph-mon[36109]: pgmap v10730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:21 smithi055 ceph-mon[31863]: pgmap v10730: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:14:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18863.144171 secs 2024-03-28T11:14:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:23 smithi086 ceph-mon[35163]: pgmap v10731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18863.144171 secs 2024-03-28T11:14:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:23 smithi159 ceph-mon[36109]: pgmap v10731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18863.144171 secs 2024-03-28T11:14:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:23 smithi055 ceph-mon[31863]: pgmap v10731: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:25 smithi086 ceph-mon[35163]: pgmap v10732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:25 smithi159 ceph-mon[36109]: pgmap v10732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:26.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:25 smithi055 ceph-mon[31863]: pgmap v10732: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:27 smithi086 ceph-mon[35163]: pgmap v10733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:27 smithi159 ceph-mon[36109]: pgmap v10733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:27 smithi055 ceph-mon[31863]: pgmap v10733: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18868.144248 secs 2024-03-28T11:14:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18868.144248 secs 2024-03-28T11:14:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18868.144248 secs 2024-03-28T11:14:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:29 smithi086 ceph-mon[35163]: pgmap v10734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:30.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:29 smithi159 ceph-mon[36109]: pgmap v10734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:29 smithi055 ceph-mon[31863]: pgmap v10734: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:30 smithi086 ceph-mon[35163]: pgmap v10735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:31.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:30 smithi159 ceph-mon[36109]: pgmap v10735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:31.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:30 smithi055 ceph-mon[31863]: pgmap v10735: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18873.144317 secs 2024-03-28T11:14:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:33 smithi086 ceph-mon[35163]: pgmap v10736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18873.144317 secs 2024-03-28T11:14:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:33 smithi159 ceph-mon[36109]: pgmap v10736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18873.144317 secs 2024-03-28T11:14:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:33 smithi055 ceph-mon[31863]: pgmap v10736: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:35 smithi086 ceph-mon[35163]: pgmap v10737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:35 smithi159 ceph-mon[36109]: pgmap v10737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:35 smithi055 ceph-mon[31863]: pgmap v10737: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:37 smithi086 ceph-mon[35163]: pgmap v10738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:38.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:37 smithi159 ceph-mon[36109]: pgmap v10738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:37 smithi055 ceph-mon[31863]: pgmap v10738: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18878.144398 secs 2024-03-28T11:14:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18878.144398 secs 2024-03-28T11:14:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18878.144398 secs 2024-03-28T11:14:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:39 smithi086 ceph-mon[35163]: pgmap v10739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:40.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:39 smithi159 ceph-mon[36109]: pgmap v10739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:39 smithi055 ceph-mon[31863]: pgmap v10739: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:41 smithi086 ceph-mon[35163]: pgmap v10740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:41 smithi159 ceph-mon[36109]: pgmap v10740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:41 smithi055 ceph-mon[31863]: pgmap v10740: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18883.144517 secs 2024-03-28T11:14:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:43 smithi086 ceph-mon[35163]: pgmap v10741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18883.144517 secs 2024-03-28T11:14:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:43 smithi159 ceph-mon[36109]: pgmap v10741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18883.144517 secs 2024-03-28T11:14:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:43 smithi055 ceph-mon[31863]: pgmap v10741: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:45 smithi086 ceph-mon[35163]: pgmap v10742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:45 smithi159 ceph-mon[36109]: pgmap v10742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:45 smithi055 ceph-mon[31863]: pgmap v10742: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:46 smithi086 ceph-mon[35163]: pgmap v10743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:47.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:46 smithi159 ceph-mon[36109]: pgmap v10743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:46 smithi055 ceph-mon[31863]: pgmap v10743: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18888.144637 secs 2024-03-28T11:14:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18888.144637 secs 2024-03-28T11:14:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18888.144637 secs 2024-03-28T11:14:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:49 smithi086 ceph-mon[35163]: pgmap v10744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:49 smithi159 ceph-mon[36109]: pgmap v10744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:49 smithi055 ceph-mon[31863]: pgmap v10744: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:52.269 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:51 smithi086 ceph-mon[35163]: pgmap v10745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:52.270 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:51 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:14:52.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:51 smithi159 ceph-mon[36109]: pgmap v10745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:52.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:51 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:14:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:51 smithi055 ceph-mon[31863]: pgmap v10745: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:51 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:14:53.988 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18893.144659 secs 2024-03-28T11:14:53.988 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:53 smithi055 ceph-mon[31863]: pgmap v10746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:53.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18893.144659 secs 2024-03-28T11:14:53.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:53 smithi086 ceph-mon[35163]: pgmap v10746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18893.144659 secs 2024-03-28T11:14:54.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:53 smithi159 ceph-mon[36109]: pgmap v10746: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:55 smithi055 ceph-mon[31863]: pgmap v10747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:56.312 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:55 smithi086 ceph-mon[35163]: pgmap v10747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:55 smithi159 ceph-mon[36109]: pgmap v10747: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:14:58.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:57 smithi055 ceph-mon[31863]: pgmap v10748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:58.166 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:58.167 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:57 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:57 smithi086 ceph-mon[35163]: pgmap v10748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:57 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:57 smithi159 ceph-mon[36109]: pgmap v10748: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:14:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:58.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:57 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18898.144772 secs 2024-03-28T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:14:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:14:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: pgmap v10749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: pgmap v10750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:14:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18898.144772 secs 2024-03-28T11:14:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:14:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:14:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: pgmap v10749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: pgmap v10750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:14:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18898.144772 secs 2024-03-28T11:14:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:14:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:14:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:14:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: pgmap v10749: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: pgmap v10750: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:14:59.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:14:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:15:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:01 smithi086 ceph-mon[35163]: pgmap v10751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:01 smithi159 ceph-mon[36109]: pgmap v10751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:01 smithi055 ceph-mon[31863]: pgmap v10751: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:03 smithi086 ceph-mon[35163]: pgmap v10752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:03 smithi159 ceph-mon[36109]: pgmap v10752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:03 smithi055 ceph-mon[31863]: pgmap v10752: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:15:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18903.144859 secs 2024-03-28T11:15:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18903.144859 secs 2024-03-28T11:15:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18903.144859 secs 2024-03-28T11:15:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:05 smithi086 ceph-mon[35163]: pgmap v10753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:05 smithi159 ceph-mon[36109]: pgmap v10753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:05 smithi055 ceph-mon[31863]: pgmap v10753: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:07 smithi086 ceph-mon[35163]: pgmap v10754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:07 smithi159 ceph-mon[36109]: pgmap v10754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:07.601 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:07 smithi055 ceph-mon[31863]: pgmap v10754: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:15:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18908.144943 secs 2024-03-28T11:15:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:09 smithi086 ceph-mon[35163]: pgmap v10755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18908.144943 secs 2024-03-28T11:15:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:09 smithi159 ceph-mon[36109]: pgmap v10755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18908.144943 secs 2024-03-28T11:15:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:09 smithi055 ceph-mon[31863]: pgmap v10755: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:11 smithi086 ceph-mon[35163]: pgmap v10756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:11 smithi159 ceph-mon[36109]: pgmap v10756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:11 smithi055 ceph-mon[31863]: pgmap v10756: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:13 smithi086 ceph-mon[35163]: pgmap v10757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:13 smithi159 ceph-mon[36109]: pgmap v10757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:13 smithi055 ceph-mon[31863]: pgmap v10757: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:14.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18913.145066 secs 2024-03-28T11:15:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18913.145066 secs 2024-03-28T11:15:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18913.145066 secs 2024-03-28T11:15:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:15 smithi086 ceph-mon[35163]: pgmap v10758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:15 smithi159 ceph-mon[36109]: pgmap v10758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:15.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:15 smithi055 ceph-mon[31863]: pgmap v10758: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:17 smithi086 ceph-mon[35163]: pgmap v10759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:17.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:17 smithi159 ceph-mon[36109]: pgmap v10759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:17 smithi055 ceph-mon[31863]: pgmap v10759: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18918.145145 secs 2024-03-28T11:15:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18918.145145 secs 2024-03-28T11:15:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18918.145145 secs 2024-03-28T11:15:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:19 smithi086 ceph-mon[35163]: pgmap v10760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:19 smithi159 ceph-mon[36109]: pgmap v10760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:19 smithi055 ceph-mon[31863]: pgmap v10760: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:21 smithi086 ceph-mon[35163]: pgmap v10761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:21 smithi159 ceph-mon[36109]: pgmap v10761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:21 smithi055 ceph-mon[31863]: pgmap v10761: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:23 smithi086 ceph-mon[35163]: pgmap v10762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18923.145209 secs 2024-03-28T11:15:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:23 smithi159 ceph-mon[36109]: pgmap v10762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:23.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18923.145209 secs 2024-03-28T11:15:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:23 smithi055 ceph-mon[31863]: pgmap v10762: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:23.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18923.145209 secs 2024-03-28T11:15:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:25 smithi086 ceph-mon[35163]: pgmap v10763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:25 smithi159 ceph-mon[36109]: pgmap v10763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:25 smithi055 ceph-mon[31863]: pgmap v10763: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:27 smithi086 ceph-mon[35163]: pgmap v10764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:27 smithi159 ceph-mon[36109]: pgmap v10764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:27 smithi055 ceph-mon[31863]: pgmap v10764: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18928.145273 secs 2024-03-28T11:15:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18928.145273 secs 2024-03-28T11:15:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18928.145273 secs 2024-03-28T11:15:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:29 smithi086 ceph-mon[35163]: pgmap v10765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:29.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:29 smithi159 ceph-mon[36109]: pgmap v10765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:29 smithi055 ceph-mon[31863]: pgmap v10765: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:31 smithi086 ceph-mon[35163]: pgmap v10766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:31.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:31 smithi159 ceph-mon[36109]: pgmap v10766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:31.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:31 smithi055 ceph-mon[31863]: pgmap v10766: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:33 smithi055 ceph-mon[31863]: pgmap v10767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:33.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18933.145337 secs 2024-03-28T11:15:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:33 smithi086 ceph-mon[35163]: pgmap v10767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18933.145337 secs 2024-03-28T11:15:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:33 smithi159 ceph-mon[36109]: pgmap v10767: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:33.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18933.145337 secs 2024-03-28T11:15:35.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:35 smithi055 ceph-mon[31863]: pgmap v10768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:35 smithi086 ceph-mon[35163]: pgmap v10768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:35.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:35 smithi159 ceph-mon[36109]: pgmap v10768: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:37.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:37 smithi055 ceph-mon[31863]: pgmap v10769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:37 smithi086 ceph-mon[35163]: pgmap v10769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:37 smithi159 ceph-mon[36109]: pgmap v10769: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:38.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18938.145460 secs 2024-03-28T11:15:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18938.145460 secs 2024-03-28T11:15:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18938.145460 secs 2024-03-28T11:15:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:39 smithi055 ceph-mon[31863]: pgmap v10770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:39 smithi086 ceph-mon[35163]: pgmap v10770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:39 smithi159 ceph-mon[36109]: pgmap v10770: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:41.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:41 smithi055 ceph-mon[31863]: pgmap v10771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:41 smithi086 ceph-mon[35163]: pgmap v10771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:41 smithi159 ceph-mon[36109]: pgmap v10771: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:43 smithi055 ceph-mon[31863]: pgmap v10772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18943.145583 secs 2024-03-28T11:15:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:43 smithi086 ceph-mon[35163]: pgmap v10772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18943.145583 secs 2024-03-28T11:15:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:43 smithi159 ceph-mon[36109]: pgmap v10772: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18943.145583 secs 2024-03-28T11:15:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:45 smithi086 ceph-mon[35163]: pgmap v10773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:45 smithi159 ceph-mon[36109]: pgmap v10773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:45.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:45 smithi055 ceph-mon[31863]: pgmap v10773: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:47 smithi086 ceph-mon[35163]: pgmap v10774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:47 smithi159 ceph-mon[36109]: pgmap v10774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:47 smithi055 ceph-mon[31863]: pgmap v10774: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18948.145702 secs 2024-03-28T11:15:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18948.145702 secs 2024-03-28T11:15:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18948.145702 secs 2024-03-28T11:15:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:49 smithi086 ceph-mon[35163]: pgmap v10775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:49 smithi159 ceph-mon[36109]: pgmap v10775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:49 smithi055 ceph-mon[31863]: pgmap v10775: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:51 smithi086 ceph-mon[35163]: pgmap v10776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:51 smithi159 ceph-mon[36109]: pgmap v10776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:51 smithi055 ceph-mon[31863]: pgmap v10776: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:15:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:53 smithi086 ceph-mon[35163]: pgmap v10777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18953.145823 secs 2024-03-28T11:15:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:53 smithi159 ceph-mon[36109]: pgmap v10777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:53.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18953.145823 secs 2024-03-28T11:15:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:53 smithi055 ceph-mon[31863]: pgmap v10777: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:15:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18953.145823 secs 2024-03-28T11:15:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:55 smithi086 ceph-mon[35163]: pgmap v10778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:56.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:55 smithi159 ceph-mon[36109]: pgmap v10778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:56.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:55 smithi055 ceph-mon[31863]: pgmap v10778: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:57 smithi086 ceph-mon[35163]: pgmap v10779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:58.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:57 smithi159 ceph-mon[36109]: pgmap v10779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:58.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:57 smithi055 ceph-mon[31863]: pgmap v10779: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:15:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18958.145946 secs 2024-03-28T11:15:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:58 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:15:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18958.145946 secs 2024-03-28T11:15:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:58 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:15:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18958.145946 secs 2024-03-28T11:15:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:58 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:16:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:59 smithi055 ceph-mon[31863]: pgmap v10780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:15:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:59 smithi086 ceph-mon[35163]: pgmap v10780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:15:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:59 smithi159 ceph-mon[36109]: pgmap v10780: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:00.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:15:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:16:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:16:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:16:01.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:00 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:16:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:00 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:16:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:16:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:00 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:16:01.909 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:01 smithi159 ceph-mon[36109]: pgmap v10781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:01 smithi055 ceph-mon[31863]: pgmap v10781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:01 smithi086 ceph-mon[35163]: pgmap v10781: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:03 smithi055 ceph-mon[31863]: pgmap v10782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18963.146068 secs 2024-03-28T11:16:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:03 smithi086 ceph-mon[35163]: pgmap v10782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18963.146068 secs 2024-03-28T11:16:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:03 smithi159 ceph-mon[36109]: pgmap v10782: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:04.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18963.146068 secs 2024-03-28T11:16:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: pgmap v10783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:16:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:16:06.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: pgmap v10783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: pgmap v10783: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:16:06.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:16:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:06 smithi055 ceph-mon[31863]: pgmap v10784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:07.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:06 smithi055 ceph-mon[31863]: pgmap v10785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T11:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:06 smithi086 ceph-mon[35163]: pgmap v10784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:06 smithi086 ceph-mon[35163]: pgmap v10785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T11:16:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:06 smithi159 ceph-mon[36109]: pgmap v10784: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:06 smithi159 ceph-mon[36109]: pgmap v10785: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-03-28T11:16:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:08 smithi086 ceph-mon[35163]: pgmap v10786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18968.146156 secs 2024-03-28T11:16:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:08 smithi159 ceph-mon[36109]: pgmap v10786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18968.146156 secs 2024-03-28T11:16:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:08 smithi055 ceph-mon[31863]: pgmap v10786: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:16:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18968.146156 secs 2024-03-28T11:16:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:10 smithi086 ceph-mon[35163]: pgmap v10787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:10 smithi159 ceph-mon[36109]: pgmap v10787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:10 smithi055 ceph-mon[31863]: pgmap v10787: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:12 smithi086 ceph-mon[35163]: pgmap v10788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:12 smithi159 ceph-mon[36109]: pgmap v10788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:12 smithi055 ceph-mon[31863]: pgmap v10788: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18973.146238 secs 2024-03-28T11:16:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18973.146238 secs 2024-03-28T11:16:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18973.146238 secs 2024-03-28T11:16:15.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:14 smithi055 ceph-mon[31863]: pgmap v10789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:14 smithi086 ceph-mon[35163]: pgmap v10789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:14 smithi159 ceph-mon[36109]: pgmap v10789: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:16:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:16 smithi086 ceph-mon[35163]: pgmap v10790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:16 smithi159 ceph-mon[36109]: pgmap v10790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:16 smithi055 ceph-mon[31863]: pgmap v10790: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:16:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:18 smithi086 ceph-mon[35163]: pgmap v10791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18978.146318 secs 2024-03-28T11:16:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:18 smithi159 ceph-mon[36109]: pgmap v10791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18978.146318 secs 2024-03-28T11:16:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:18 smithi055 ceph-mon[31863]: pgmap v10791: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18978.146318 secs 2024-03-28T11:16:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:20 smithi086 ceph-mon[35163]: pgmap v10792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:20 smithi159 ceph-mon[36109]: pgmap v10792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:20 smithi055 ceph-mon[31863]: pgmap v10792: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:22 smithi086 ceph-mon[35163]: pgmap v10793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:22 smithi159 ceph-mon[36109]: pgmap v10793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:23.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:22 smithi055 ceph-mon[31863]: pgmap v10793: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18983.146402 secs 2024-03-28T11:16:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18983.146402 secs 2024-03-28T11:16:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18983.146402 secs 2024-03-28T11:16:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:24 smithi086 ceph-mon[35163]: pgmap v10794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:25.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:24 smithi159 ceph-mon[36109]: pgmap v10794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:24 smithi055 ceph-mon[31863]: pgmap v10794: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:26 smithi086 ceph-mon[35163]: pgmap v10795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:26 smithi159 ceph-mon[36109]: pgmap v10795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:26 smithi055 ceph-mon[31863]: pgmap v10795: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:27 smithi086 ceph-mon[35163]: pgmap v10796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:27 smithi159 ceph-mon[36109]: pgmap v10796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:27 smithi055 ceph-mon[31863]: pgmap v10796: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18988.146423 secs 2024-03-28T11:16:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18988.146423 secs 2024-03-28T11:16:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18988.146423 secs 2024-03-28T11:16:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:30 smithi086 ceph-mon[35163]: pgmap v10797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:30 smithi159 ceph-mon[36109]: pgmap v10797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:30 smithi055 ceph-mon[31863]: pgmap v10797: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:32.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:32 smithi055 ceph-mon[31863]: pgmap v10798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:32 smithi086 ceph-mon[35163]: pgmap v10798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:32 smithi159 ceph-mon[36109]: pgmap v10798: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18993.146548 secs 2024-03-28T11:16:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18993.146548 secs 2024-03-28T11:16:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18993.146548 secs 2024-03-28T11:16:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:34 smithi159 ceph-mon[36109]: pgmap v10799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:34 smithi086 ceph-mon[35163]: pgmap v10799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:34 smithi055 ceph-mon[31863]: pgmap v10799: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:36 smithi086 ceph-mon[35163]: pgmap v10800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:36.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:36 smithi159 ceph-mon[36109]: pgmap v10800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:36.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:36 smithi055 ceph-mon[31863]: pgmap v10800: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:38 smithi086 ceph-mon[35163]: pgmap v10801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 18998.146650 secs 2024-03-28T11:16:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:38 smithi159 ceph-mon[36109]: pgmap v10801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 18998.146650 secs 2024-03-28T11:16:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:38 smithi055 ceph-mon[31863]: pgmap v10801: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:38.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 18998.146650 secs 2024-03-28T11:16:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:40 smithi086 ceph-mon[35163]: pgmap v10802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:40 smithi159 ceph-mon[36109]: pgmap v10802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:40 smithi055 ceph-mon[31863]: pgmap v10802: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:42 smithi086 ceph-mon[35163]: pgmap v10803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:42 smithi159 ceph-mon[36109]: pgmap v10803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:42 smithi055 ceph-mon[31863]: pgmap v10803: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19003.146775 secs 2024-03-28T11:16:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19003.146775 secs 2024-03-28T11:16:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19003.146775 secs 2024-03-28T11:16:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:44 smithi086 ceph-mon[35163]: pgmap v10804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:44 smithi159 ceph-mon[36109]: pgmap v10804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:44.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:44 smithi055 ceph-mon[31863]: pgmap v10804: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:46 smithi086 ceph-mon[35163]: pgmap v10805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:46 smithi159 ceph-mon[36109]: pgmap v10805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:46 smithi055 ceph-mon[31863]: pgmap v10805: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:48 smithi086 ceph-mon[35163]: pgmap v10806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19008.146858 secs 2024-03-28T11:16:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:48 smithi159 ceph-mon[36109]: pgmap v10806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19008.146858 secs 2024-03-28T11:16:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:48 smithi055 ceph-mon[31863]: pgmap v10806: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19008.146858 secs 2024-03-28T11:16:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:50 smithi086 ceph-mon[35163]: pgmap v10807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:50.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:50 smithi159 ceph-mon[36109]: pgmap v10807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:50 smithi055 ceph-mon[31863]: pgmap v10807: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:52 smithi086 ceph-mon[35163]: pgmap v10808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:52 smithi159 ceph-mon[36109]: pgmap v10808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:52 smithi055 ceph-mon[31863]: pgmap v10808: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19013.146980 secs 2024-03-28T11:16:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19013.146980 secs 2024-03-28T11:16:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19013.146980 secs 2024-03-28T11:16:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:54 smithi086 ceph-mon[35163]: pgmap v10809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:54 smithi159 ceph-mon[36109]: pgmap v10809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:54.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:54 smithi055 ceph-mon[31863]: pgmap v10809: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:16:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:56 smithi086 ceph-mon[35163]: pgmap v10810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:56.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:56 smithi159 ceph-mon[36109]: pgmap v10810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:56.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:56 smithi055 ceph-mon[31863]: pgmap v10810: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:16:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:58 smithi086 ceph-mon[35163]: pgmap v10811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:16:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19018.147067 secs 2024-03-28T11:16:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:58 smithi159 ceph-mon[36109]: pgmap v10811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:58.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:16:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19018.147067 secs 2024-03-28T11:16:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:58 smithi055 ceph-mon[31863]: pgmap v10811: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:16:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:16:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19018.147067 secs 2024-03-28T11:17:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:00 smithi086 ceph-mon[35163]: pgmap v10812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:00 smithi159 ceph-mon[36109]: pgmap v10812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:00 smithi055 ceph-mon[31863]: pgmap v10812: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:02 smithi086 ceph-mon[35163]: pgmap v10813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:02.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:02 smithi159 ceph-mon[36109]: pgmap v10813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:02.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:02 smithi055 ceph-mon[31863]: pgmap v10813: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19023.147151 secs 2024-03-28T11:17:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19023.147151 secs 2024-03-28T11:17:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19023.147151 secs 2024-03-28T11:17:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:04 smithi086 ceph-mon[35163]: pgmap v10814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:04 smithi159 ceph-mon[36109]: pgmap v10814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:04 smithi055 ceph-mon[31863]: pgmap v10814: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:06 smithi086 ceph-mon[35163]: pgmap v10815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:17:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:06 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:17:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:06 smithi159 ceph-mon[36109]: pgmap v10815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:17:06.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:06 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:17:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:06 smithi055 ceph-mon[31863]: pgmap v10815: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:17:06.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:06 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:17:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:17:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:17:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:17:07.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:17:07.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:17:07.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:17:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:17:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:17:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:17:07.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:17:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:08 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:17:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:08 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:17:08.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:08 smithi055 ceph-mon[31863]: pgmap v10816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:08 smithi055 ceph-mon[31863]: pgmap v10817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:08.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19028.147216 secs 2024-03-28T11:17:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:08 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:17:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:08 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:17:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:08 smithi086 ceph-mon[35163]: pgmap v10816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:08 smithi086 ceph-mon[35163]: pgmap v10817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19028.147216 secs 2024-03-28T11:17:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:08 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:17:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:08 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:17:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:08 smithi159 ceph-mon[36109]: pgmap v10816: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:08 smithi159 ceph-mon[36109]: pgmap v10817: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:09.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19028.147216 secs 2024-03-28T11:17:10.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:10 smithi055 ceph-mon[31863]: pgmap v10818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:10 smithi086 ceph-mon[35163]: pgmap v10818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:10 smithi159 ceph-mon[36109]: pgmap v10818: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:12.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:12 smithi055 ceph-mon[31863]: pgmap v10819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:12 smithi086 ceph-mon[35163]: pgmap v10819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:13.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:12 smithi159 ceph-mon[36109]: pgmap v10819: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19033.147293 secs 2024-03-28T11:17:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19033.147293 secs 2024-03-28T11:17:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19033.147293 secs 2024-03-28T11:17:14.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:14 smithi055 ceph-mon[31863]: pgmap v10820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:14 smithi086 ceph-mon[35163]: pgmap v10820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:14 smithi159 ceph-mon[36109]: pgmap v10820: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:17:16.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:16 smithi055 ceph-mon[31863]: pgmap v10821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:17:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:16 smithi086 ceph-mon[35163]: pgmap v10821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:17:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:16 smithi159 ceph-mon[36109]: pgmap v10821: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:17:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:18 smithi086 ceph-mon[35163]: pgmap v10822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:17:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19038.147415 secs 2024-03-28T11:17:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:18 smithi159 ceph-mon[36109]: pgmap v10822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:17:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19038.147415 secs 2024-03-28T11:17:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:18 smithi055 ceph-mon[31863]: pgmap v10822: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:17:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19038.147415 secs 2024-03-28T11:17:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:20 smithi086 ceph-mon[35163]: pgmap v10823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:20 smithi159 ceph-mon[36109]: pgmap v10823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:20 smithi055 ceph-mon[31863]: pgmap v10823: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:22 smithi086 ceph-mon[35163]: pgmap v10824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:22 smithi159 ceph-mon[36109]: pgmap v10824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:22 smithi055 ceph-mon[31863]: pgmap v10824: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:23.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19043.147537 secs 2024-03-28T11:17:23.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19043.147537 secs 2024-03-28T11:17:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19043.147537 secs 2024-03-28T11:17:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:24 smithi086 ceph-mon[35163]: pgmap v10825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:24 smithi159 ceph-mon[36109]: pgmap v10825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:24 smithi055 ceph-mon[31863]: pgmap v10825: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:26 smithi086 ceph-mon[35163]: pgmap v10826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:26 smithi159 ceph-mon[36109]: pgmap v10826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:26 smithi055 ceph-mon[31863]: pgmap v10826: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:28 smithi086 ceph-mon[35163]: pgmap v10827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19048.147661 secs 2024-03-28T11:17:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:28 smithi159 ceph-mon[36109]: pgmap v10827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:29.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19048.147661 secs 2024-03-28T11:17:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:28 smithi055 ceph-mon[31863]: pgmap v10827: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19048.147661 secs 2024-03-28T11:17:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:30 smithi086 ceph-mon[35163]: pgmap v10828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:30 smithi159 ceph-mon[36109]: pgmap v10828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:30 smithi055 ceph-mon[31863]: pgmap v10828: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:32 smithi086 ceph-mon[35163]: pgmap v10829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:33.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:32 smithi159 ceph-mon[36109]: pgmap v10829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:32 smithi055 ceph-mon[31863]: pgmap v10829: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19053.147747 secs 2024-03-28T11:17:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19053.147747 secs 2024-03-28T11:17:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19053.147747 secs 2024-03-28T11:17:34.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:34 smithi159 ceph-mon[36109]: pgmap v10830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:34 smithi086 ceph-mon[35163]: pgmap v10830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:34 smithi055 ceph-mon[31863]: pgmap v10830: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:36 smithi086 ceph-mon[35163]: pgmap v10831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:36 smithi159 ceph-mon[36109]: pgmap v10831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:37.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:36 smithi055 ceph-mon[31863]: pgmap v10831: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:38 smithi086 ceph-mon[35163]: pgmap v10832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19058.147873 secs 2024-03-28T11:17:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:38 smithi159 ceph-mon[36109]: pgmap v10832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:39.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19058.147873 secs 2024-03-28T11:17:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:38 smithi055 ceph-mon[31863]: pgmap v10832: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19058.147873 secs 2024-03-28T11:17:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:40 smithi086 ceph-mon[35163]: pgmap v10833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:40 smithi159 ceph-mon[36109]: pgmap v10833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:41.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:40 smithi055 ceph-mon[31863]: pgmap v10833: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:42 smithi086 ceph-mon[35163]: pgmap v10834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:42 smithi159 ceph-mon[36109]: pgmap v10834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:42 smithi055 ceph-mon[31863]: pgmap v10834: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19063.147996 secs 2024-03-28T11:17:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19063.147996 secs 2024-03-28T11:17:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19063.147996 secs 2024-03-28T11:17:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:44 smithi086 ceph-mon[35163]: pgmap v10835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:44 smithi159 ceph-mon[36109]: pgmap v10835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:44 smithi055 ceph-mon[31863]: pgmap v10835: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:46 smithi086 ceph-mon[35163]: pgmap v10836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:46 smithi159 ceph-mon[36109]: pgmap v10836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:46 smithi055 ceph-mon[31863]: pgmap v10836: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:48 smithi086 ceph-mon[35163]: pgmap v10837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19068.148104 secs 2024-03-28T11:17:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:48 smithi159 ceph-mon[36109]: pgmap v10837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19068.148104 secs 2024-03-28T11:17:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:48 smithi055 ceph-mon[31863]: pgmap v10837: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19068.148104 secs 2024-03-28T11:17:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:50 smithi086 ceph-mon[35163]: pgmap v10838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:50 smithi159 ceph-mon[36109]: pgmap v10838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:50 smithi055 ceph-mon[31863]: pgmap v10838: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:52 smithi086 ceph-mon[35163]: pgmap v10839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:53.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:52 smithi159 ceph-mon[36109]: pgmap v10839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:52 smithi055 ceph-mon[31863]: pgmap v10839: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19073.148224 secs 2024-03-28T11:17:54.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19073.148224 secs 2024-03-28T11:17:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19073.148224 secs 2024-03-28T11:17:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:54 smithi086 ceph-mon[35163]: pgmap v10840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:54 smithi159 ceph-mon[36109]: pgmap v10840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:54 smithi055 ceph-mon[31863]: pgmap v10840: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:56 smithi055 ceph-mon[31863]: pgmap v10841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:56 smithi086 ceph-mon[35163]: pgmap v10841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:56 smithi159 ceph-mon[36109]: pgmap v10841: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:17:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:58 smithi055 ceph-mon[31863]: pgmap v10842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:17:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19078.148302 secs 2024-03-28T11:17:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:58 smithi086 ceph-mon[35163]: pgmap v10842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:17:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19078.148302 secs 2024-03-28T11:17:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:58 smithi159 ceph-mon[36109]: pgmap v10842: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:17:59.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:17:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19078.148302 secs 2024-03-28T11:18:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:00 smithi055 ceph-mon[31863]: pgmap v10843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:00 smithi086 ceph-mon[35163]: pgmap v10843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:00 smithi159 ceph-mon[36109]: pgmap v10843: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:03.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:02 smithi055 ceph-mon[31863]: pgmap v10844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:02 smithi086 ceph-mon[35163]: pgmap v10844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:02 smithi159 ceph-mon[36109]: pgmap v10844: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19083.148422 secs 2024-03-28T11:18:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19083.148422 secs 2024-03-28T11:18:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19083.148422 secs 2024-03-28T11:18:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:04 smithi055 ceph-mon[31863]: pgmap v10845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:04 smithi086 ceph-mon[35163]: pgmap v10845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:04 smithi159 ceph-mon[36109]: pgmap v10845: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:06 smithi086 ceph-mon[35163]: pgmap v10846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:06 smithi159 ceph-mon[36109]: pgmap v10846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:06 smithi055 ceph-mon[31863]: pgmap v10846: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:18:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:18:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:18:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:08 smithi086 ceph-mon[35163]: pgmap v10847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19088.148492 secs 2024-03-28T11:18:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:08 smithi159 ceph-mon[36109]: pgmap v10847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19088.148492 secs 2024-03-28T11:18:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:08 smithi055 ceph-mon[31863]: pgmap v10847: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19088.148492 secs 2024-03-28T11:18:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:18:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:18:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:18:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:18:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:18:10.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:18:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:18:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:18:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:18:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:10 smithi086 ceph-mon[35163]: pgmap v10848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:10 smithi086 ceph-mon[35163]: pgmap v10849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:10 smithi159 ceph-mon[36109]: pgmap v10848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:10 smithi159 ceph-mon[36109]: pgmap v10849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:10 smithi055 ceph-mon[31863]: pgmap v10848: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:11.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:10 smithi055 ceph-mon[31863]: pgmap v10849: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:12 smithi086 ceph-mon[35163]: pgmap v10850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:12 smithi159 ceph-mon[36109]: pgmap v10850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:12 smithi055 ceph-mon[31863]: pgmap v10850: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19093.148570 secs 2024-03-28T11:18:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19093.148570 secs 2024-03-28T11:18:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19093.148570 secs 2024-03-28T11:18:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:14 smithi086 ceph-mon[35163]: pgmap v10851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:14 smithi159 ceph-mon[36109]: pgmap v10851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:14 smithi055 ceph-mon[31863]: pgmap v10851: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:16 smithi086 ceph-mon[35163]: pgmap v10852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:16 smithi159 ceph-mon[36109]: pgmap v10852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:16 smithi055 ceph-mon[31863]: pgmap v10852: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:18 smithi086 ceph-mon[35163]: pgmap v10853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19098.148692 secs 2024-03-28T11:18:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:18 smithi159 ceph-mon[36109]: pgmap v10853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19098.148692 secs 2024-03-28T11:18:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:18 smithi055 ceph-mon[31863]: pgmap v10853: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:18:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19098.148692 secs 2024-03-28T11:18:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:20 smithi086 ceph-mon[35163]: pgmap v10854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:18:21.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:20 smithi159 ceph-mon[36109]: pgmap v10854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:18:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:20 smithi055 ceph-mon[31863]: pgmap v10854: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:18:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:22 smithi086 ceph-mon[35163]: pgmap v10855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:22 smithi159 ceph-mon[36109]: pgmap v10855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:22 smithi055 ceph-mon[31863]: pgmap v10855: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19103.148763 secs 2024-03-28T11:18:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19103.148763 secs 2024-03-28T11:18:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19103.148763 secs 2024-03-28T11:18:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:24 smithi086 ceph-mon[35163]: pgmap v10856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:24 smithi159 ceph-mon[36109]: pgmap v10856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:24 smithi055 ceph-mon[31863]: pgmap v10856: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:26 smithi086 ceph-mon[35163]: pgmap v10857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:26 smithi159 ceph-mon[36109]: pgmap v10857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:27.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:26 smithi055 ceph-mon[31863]: pgmap v10857: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:28 smithi086 ceph-mon[35163]: pgmap v10858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19108.148858 secs 2024-03-28T11:18:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:28 smithi159 ceph-mon[36109]: pgmap v10858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19108.148858 secs 2024-03-28T11:18:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:28 smithi055 ceph-mon[31863]: pgmap v10858: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19108.148858 secs 2024-03-28T11:18:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:30 smithi086 ceph-mon[35163]: pgmap v10859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:30 smithi159 ceph-mon[36109]: pgmap v10859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:30.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:30 smithi055 ceph-mon[31863]: pgmap v10859: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:32 smithi086 ceph-mon[35163]: pgmap v10860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:32.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:32 smithi159 ceph-mon[36109]: pgmap v10860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:32.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:32 smithi055 ceph-mon[31863]: pgmap v10860: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19113.148944 secs 2024-03-28T11:18:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:34 smithi086 ceph-mon[35163]: pgmap v10861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19113.148944 secs 2024-03-28T11:18:34.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:34 smithi159 ceph-mon[36109]: pgmap v10861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19113.148944 secs 2024-03-28T11:18:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:34 smithi055 ceph-mon[31863]: pgmap v10861: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:36 smithi055 ceph-mon[31863]: pgmap v10862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:36 smithi086 ceph-mon[35163]: pgmap v10862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:36 smithi159 ceph-mon[36109]: pgmap v10862: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:38 smithi055 ceph-mon[31863]: pgmap v10863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:38 smithi086 ceph-mon[35163]: pgmap v10863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:38 smithi159 ceph-mon[36109]: pgmap v10863: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19118.149070 secs 2024-03-28T11:18:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19118.149070 secs 2024-03-28T11:18:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19118.149070 secs 2024-03-28T11:18:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:40 smithi055 ceph-mon[31863]: pgmap v10864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:40 smithi086 ceph-mon[35163]: pgmap v10864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:40 smithi159 ceph-mon[36109]: pgmap v10864: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:42 smithi055 ceph-mon[31863]: pgmap v10865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:42 smithi086 ceph-mon[35163]: pgmap v10865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:42 smithi159 ceph-mon[36109]: pgmap v10865: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19123.149156 secs 2024-03-28T11:18:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:44 smithi055 ceph-mon[31863]: pgmap v10866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19123.149156 secs 2024-03-28T11:18:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:44 smithi086 ceph-mon[35163]: pgmap v10866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19123.149156 secs 2024-03-28T11:18:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:44 smithi159 ceph-mon[36109]: pgmap v10866: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:46 smithi086 ceph-mon[35163]: pgmap v10867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:46 smithi159 ceph-mon[36109]: pgmap v10867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:46 smithi055 ceph-mon[31863]: pgmap v10867: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:48.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:48 smithi055 ceph-mon[31863]: pgmap v10868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:48 smithi086 ceph-mon[35163]: pgmap v10868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:48 smithi159 ceph-mon[36109]: pgmap v10868: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19128.149242 secs 2024-03-28T11:18:49.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19128.149242 secs 2024-03-28T11:18:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19128.149242 secs 2024-03-28T11:18:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:50 smithi086 ceph-mon[35163]: pgmap v10869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:50.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:50 smithi159 ceph-mon[36109]: pgmap v10869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:50 smithi055 ceph-mon[31863]: pgmap v10869: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:52 smithi086 ceph-mon[35163]: pgmap v10870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:52 smithi159 ceph-mon[36109]: pgmap v10870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:52 smithi055 ceph-mon[31863]: pgmap v10870: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19133.149360 secs 2024-03-28T11:18:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:54 smithi086 ceph-mon[35163]: pgmap v10871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19133.149360 secs 2024-03-28T11:18:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:54 smithi159 ceph-mon[36109]: pgmap v10871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19133.149360 secs 2024-03-28T11:18:54.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:54 smithi055 ceph-mon[31863]: pgmap v10871: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:56 smithi086 ceph-mon[35163]: pgmap v10872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:56 smithi159 ceph-mon[36109]: pgmap v10872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:56 smithi055 ceph-mon[31863]: pgmap v10872: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:18:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:58 smithi086 ceph-mon[35163]: pgmap v10873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:58 smithi159 ceph-mon[36109]: pgmap v10873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:58 smithi055 ceph-mon[31863]: pgmap v10873: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:18:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:18:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19138.149435 secs 2024-03-28T11:18:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:18:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19138.149435 secs 2024-03-28T11:18:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:18:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19138.149435 secs 2024-03-28T11:19:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:00 smithi086 ceph-mon[35163]: pgmap v10874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:00 smithi159 ceph-mon[36109]: pgmap v10874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:00 smithi055 ceph-mon[31863]: pgmap v10874: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:02 smithi086 ceph-mon[35163]: pgmap v10875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:02 smithi159 ceph-mon[36109]: pgmap v10875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:02 smithi055 ceph-mon[31863]: pgmap v10875: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19143.149530 secs 2024-03-28T11:19:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:04 smithi086 ceph-mon[35163]: pgmap v10876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19143.149530 secs 2024-03-28T11:19:04.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:04 smithi159 ceph-mon[36109]: pgmap v10876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19143.149530 secs 2024-03-28T11:19:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:04 smithi055 ceph-mon[31863]: pgmap v10876: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:06 smithi086 ceph-mon[35163]: pgmap v10877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:06.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:06 smithi159 ceph-mon[36109]: pgmap v10877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:06 smithi055 ceph-mon[31863]: pgmap v10877: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:08 smithi086 ceph-mon[35163]: pgmap v10878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:08 smithi159 ceph-mon[36109]: pgmap v10878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:08.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:08 smithi055 ceph-mon[31863]: pgmap v10878: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19148.149618 secs 2024-03-28T11:19:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19148.149618 secs 2024-03-28T11:19:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19148.149618 secs 2024-03-28T11:19:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:10 smithi086 ceph-mon[35163]: pgmap v10879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:19:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:10 smithi159 ceph-mon[36109]: pgmap v10879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:19:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:10.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:10 smithi055 ceph-mon[31863]: pgmap v10879: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:19:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:10.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:11 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:11 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:11.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:11 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: pgmap v10880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:19:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:19:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: pgmap v10881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:19:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: pgmap v10882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:12.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: pgmap v10880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:19:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:19:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: pgmap v10881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:19:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: pgmap v10882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: pgmap v10880: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: pgmap v10881: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: pgmap v10882: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:12.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:19:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19153.149745 secs 2024-03-28T11:19:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19153.149745 secs 2024-03-28T11:19:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19153.149745 secs 2024-03-28T11:19:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:14 smithi086 ceph-mon[35163]: pgmap v10883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:14 smithi159 ceph-mon[36109]: pgmap v10883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:14 smithi055 ceph-mon[31863]: pgmap v10883: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:16 smithi055 ceph-mon[31863]: pgmap v10884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:16 smithi086 ceph-mon[35163]: pgmap v10884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:16 smithi159 ceph-mon[36109]: pgmap v10884: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:19:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19158.149871 secs 2024-03-28T11:19:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:18 smithi055 ceph-mon[31863]: pgmap v10885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19158.149871 secs 2024-03-28T11:19:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:18 smithi086 ceph-mon[35163]: pgmap v10885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19158.149871 secs 2024-03-28T11:19:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:18 smithi159 ceph-mon[36109]: pgmap v10885: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:20 smithi055 ceph-mon[31863]: pgmap v10886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:20 smithi086 ceph-mon[35163]: pgmap v10886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:20 smithi159 ceph-mon[36109]: pgmap v10886: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:22 smithi055 ceph-mon[31863]: pgmap v10887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:19:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:22 smithi086 ceph-mon[35163]: pgmap v10887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:19:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:22 smithi159 ceph-mon[36109]: pgmap v10887: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:19:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19163.149980 secs 2024-03-28T11:19:24.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19163.149980 secs 2024-03-28T11:19:24.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19163.149980 secs 2024-03-28T11:19:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:24 smithi055 ceph-mon[31863]: pgmap v10888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:24 smithi086 ceph-mon[35163]: pgmap v10888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:24 smithi159 ceph-mon[36109]: pgmap v10888: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:26 smithi086 ceph-mon[35163]: pgmap v10889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:26 smithi159 ceph-mon[36109]: pgmap v10889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:26 smithi055 ceph-mon[31863]: pgmap v10889: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19168.150100 secs 2024-03-28T11:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:28 smithi086 ceph-mon[35163]: pgmap v10890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19168.150100 secs 2024-03-28T11:19:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:28 smithi159 ceph-mon[36109]: pgmap v10890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19168.150100 secs 2024-03-28T11:19:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:28 smithi055 ceph-mon[31863]: pgmap v10890: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:30 smithi086 ceph-mon[35163]: pgmap v10891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:30 smithi159 ceph-mon[36109]: pgmap v10891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:31.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:30 smithi055 ceph-mon[31863]: pgmap v10891: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:32 smithi086 ceph-mon[35163]: pgmap v10892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:32 smithi159 ceph-mon[36109]: pgmap v10892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:32 smithi055 ceph-mon[31863]: pgmap v10892: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19173.150222 secs 2024-03-28T11:19:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19173.150222 secs 2024-03-28T11:19:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19173.150222 secs 2024-03-28T11:19:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:34 smithi086 ceph-mon[35163]: pgmap v10893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:35.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:34 smithi159 ceph-mon[36109]: pgmap v10893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:34 smithi055 ceph-mon[31863]: pgmap v10893: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:36 smithi086 ceph-mon[35163]: pgmap v10894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:36 smithi159 ceph-mon[36109]: pgmap v10894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:36 smithi055 ceph-mon[31863]: pgmap v10894: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19178.150346 secs 2024-03-28T11:19:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:38 smithi086 ceph-mon[35163]: pgmap v10895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19178.150346 secs 2024-03-28T11:19:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:38 smithi159 ceph-mon[36109]: pgmap v10895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19178.150346 secs 2024-03-28T11:19:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:38 smithi055 ceph-mon[31863]: pgmap v10895: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:19:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:40 smithi086 ceph-mon[35163]: pgmap v10896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:40 smithi159 ceph-mon[36109]: pgmap v10896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:40 smithi055 ceph-mon[31863]: pgmap v10896: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:42 smithi086 ceph-mon[35163]: pgmap v10897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:42 smithi159 ceph-mon[36109]: pgmap v10897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:42 smithi055 ceph-mon[31863]: pgmap v10897: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19183.150430 secs 2024-03-28T11:19:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19183.150430 secs 2024-03-28T11:19:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19183.150430 secs 2024-03-28T11:19:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:44 smithi086 ceph-mon[35163]: pgmap v10898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:44 smithi159 ceph-mon[36109]: pgmap v10898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:44 smithi055 ceph-mon[31863]: pgmap v10898: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:47 smithi086 ceph-mon[35163]: pgmap v10899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:47 smithi159 ceph-mon[36109]: pgmap v10899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:47 smithi055 ceph-mon[31863]: pgmap v10899: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19188.150478 secs 2024-03-28T11:19:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:49 smithi086 ceph-mon[35163]: pgmap v10900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19188.150478 secs 2024-03-28T11:19:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:49 smithi159 ceph-mon[36109]: pgmap v10900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19188.150478 secs 2024-03-28T11:19:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:49 smithi055 ceph-mon[31863]: pgmap v10900: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:50 smithi086 ceph-mon[35163]: pgmap v10901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:50.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:50 smithi159 ceph-mon[36109]: pgmap v10901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:50.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:50 smithi055 ceph-mon[31863]: pgmap v10901: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:52 smithi055 ceph-mon[31863]: pgmap v10902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:52 smithi086 ceph-mon[35163]: pgmap v10902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:52 smithi159 ceph-mon[36109]: pgmap v10902: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19193.150599 secs 2024-03-28T11:19:54.218 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19193.150599 secs 2024-03-28T11:19:54.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19193.150599 secs 2024-03-28T11:19:55.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:54 smithi055 ceph-mon[31863]: pgmap v10903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:54 smithi086 ceph-mon[35163]: pgmap v10903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:55.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:54 smithi159 ceph-mon[36109]: pgmap v10903: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:19:57.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:56 smithi055 ceph-mon[31863]: pgmap v10904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:19:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:56 smithi086 ceph-mon[35163]: pgmap v10904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:19:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:56 smithi159 ceph-mon[36109]: pgmap v10904: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:19:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19198.150718 secs 2024-03-28T11:19:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:19:58 smithi055 ceph-mon[31863]: pgmap v10905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:19:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19198.150718 secs 2024-03-28T11:19:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:19:58 smithi086 ceph-mon[35163]: pgmap v10905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:19:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19198.150718 secs 2024-03-28T11:19:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:19:58 smithi159 ceph-mon[36109]: pgmap v10905: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:00 smithi086 ceph-mon[35163]: pgmap v10906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:20:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:20:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:00 smithi159 ceph-mon[36109]: pgmap v10906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:20:01.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:20:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:00 smithi055 ceph-mon[31863]: pgmap v10906: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:20:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:20:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:02 smithi086 ceph-mon[35163]: pgmap v10907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:02 smithi159 ceph-mon[36109]: pgmap v10907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:02 smithi055 ceph-mon[31863]: pgmap v10907: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19203.150839 secs 2024-03-28T11:20:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19203.150839 secs 2024-03-28T11:20:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19203.150839 secs 2024-03-28T11:20:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:04 smithi086 ceph-mon[35163]: pgmap v10908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:04 smithi159 ceph-mon[36109]: pgmap v10908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:04 smithi055 ceph-mon[31863]: pgmap v10908: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:06 smithi086 ceph-mon[35163]: pgmap v10909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:06 smithi159 ceph-mon[36109]: pgmap v10909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:06 smithi055 ceph-mon[31863]: pgmap v10909: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:20:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19208.150916 secs 2024-03-28T11:20:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:08 smithi086 ceph-mon[35163]: pgmap v10910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19208.150916 secs 2024-03-28T11:20:09.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:08 smithi159 ceph-mon[36109]: pgmap v10910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19208.150916 secs 2024-03-28T11:20:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:08 smithi055 ceph-mon[31863]: pgmap v10910: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:10 smithi086 ceph-mon[35163]: pgmap v10911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:10 smithi159 ceph-mon[36109]: pgmap v10911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:10 smithi055 ceph-mon[31863]: pgmap v10911: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:12 smithi086 ceph-mon[35163]: pgmap v10912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:20:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:12 smithi159 ceph-mon[36109]: pgmap v10912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:20:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:12 smithi055 ceph-mon[31863]: pgmap v10912: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:20:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19213.151017 secs 2024-03-28T11:20:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:14 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:14 smithi055 ceph-mon[31863]: pgmap v10913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:14.428 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19213.151017 secs 2024-03-28T11:20:14.428 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.428 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:14 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.428 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:14 smithi159 ceph-mon[36109]: pgmap v10913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19213.151017 secs 2024-03-28T11:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:14 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:14 smithi086 ceph-mon[35163]: pgmap v10913: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:16 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:16 smithi086 ceph-mon[35163]: pgmap v10914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:16 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:16 smithi159 ceph-mon[36109]: pgmap v10914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:16 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:16 smithi055 ceph-mon[31863]: pgmap v10914: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:17 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:17 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:17 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:19.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19218.151091 secs 2024-03-28T11:20:19.275 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:18 smithi055 ceph-mon[31863]: pgmap v10915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:19.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:20:19.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:20:19.276 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:18 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19218.151091 secs 2024-03-28T11:20:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:18 smithi086 ceph-mon[35163]: pgmap v10915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:20:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:20:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:18 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19218.151091 secs 2024-03-28T11:20:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:18 smithi159 ceph-mon[36109]: pgmap v10915: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:20:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:20:19.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:18 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:20:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:19 smithi086 ceph-mon[35163]: pgmap v10916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:20:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:19 smithi086 ceph-mon[35163]: pgmap v10917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:20.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:19 smithi159 ceph-mon[36109]: pgmap v10916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:20:20.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:19 smithi159 ceph-mon[36109]: pgmap v10917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:19 smithi055 ceph-mon[31863]: pgmap v10916: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:20:20.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:19 smithi055 ceph-mon[31863]: pgmap v10917: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:21 smithi086 ceph-mon[35163]: pgmap v10918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:22.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:21 smithi159 ceph-mon[36109]: pgmap v10918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:22.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:21 smithi055 ceph-mon[31863]: pgmap v10918: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:20:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:23 smithi086 ceph-mon[35163]: pgmap v10919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19223.151187 secs 2024-03-28T11:20:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:23 smithi159 ceph-mon[36109]: pgmap v10919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19223.151187 secs 2024-03-28T11:20:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:23 smithi055 ceph-mon[31863]: pgmap v10919: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19223.151187 secs 2024-03-28T11:20:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:25 smithi086 ceph-mon[35163]: pgmap v10920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:26.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:25 smithi159 ceph-mon[36109]: pgmap v10920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:25 smithi055 ceph-mon[31863]: pgmap v10920: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:27 smithi086 ceph-mon[35163]: pgmap v10921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:27 smithi159 ceph-mon[36109]: pgmap v10921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:27 smithi055 ceph-mon[31863]: pgmap v10921: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:20:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19228.151261 secs 2024-03-28T11:20:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19228.151261 secs 2024-03-28T11:20:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19228.151261 secs 2024-03-28T11:20:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:30 smithi086 ceph-mon[35163]: pgmap v10922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:20:30.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:30 smithi159 ceph-mon[36109]: pgmap v10922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:20:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:30 smithi055 ceph-mon[31863]: pgmap v10922: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:20:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:32 smithi086 ceph-mon[35163]: pgmap v10923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:32.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:32 smithi159 ceph-mon[36109]: pgmap v10923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:32 smithi055 ceph-mon[31863]: pgmap v10923: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:33 smithi055 ceph-mon[31863]: pgmap v10924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:33 smithi086 ceph-mon[35163]: pgmap v10924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:33 smithi159 ceph-mon[36109]: pgmap v10924: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19233.151382 secs 2024-03-28T11:20:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19233.151382 secs 2024-03-28T11:20:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19233.151382 secs 2024-03-28T11:20:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:35 smithi055 ceph-mon[31863]: pgmap v10925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:35 smithi086 ceph-mon[35163]: pgmap v10925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:35 smithi159 ceph-mon[36109]: pgmap v10925: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:37 smithi086 ceph-mon[35163]: pgmap v10926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:37.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:37 smithi159 ceph-mon[36109]: pgmap v10926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:37.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:37 smithi055 ceph-mon[31863]: pgmap v10926: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19238.151437 secs 2024-03-28T11:20:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19238.151437 secs 2024-03-28T11:20:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19238.151437 secs 2024-03-28T11:20:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:39 smithi086 ceph-mon[35163]: pgmap v10927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:39 smithi159 ceph-mon[36109]: pgmap v10927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:39.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:39 smithi055 ceph-mon[31863]: pgmap v10927: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:41 smithi086 ceph-mon[35163]: pgmap v10928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:41.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:41 smithi159 ceph-mon[36109]: pgmap v10928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:41.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:41 smithi055 ceph-mon[31863]: pgmap v10928: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:43 smithi086 ceph-mon[35163]: pgmap v10929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19243.151555 secs 2024-03-28T11:20:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:43 smithi159 ceph-mon[36109]: pgmap v10929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:43.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19243.151555 secs 2024-03-28T11:20:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:43 smithi055 ceph-mon[31863]: pgmap v10929: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:43.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19243.151555 secs 2024-03-28T11:20:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:45 smithi086 ceph-mon[35163]: pgmap v10930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:45.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:45 smithi159 ceph-mon[36109]: pgmap v10930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:45.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:45 smithi055 ceph-mon[31863]: pgmap v10930: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:47 smithi086 ceph-mon[35163]: pgmap v10931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:47 smithi159 ceph-mon[36109]: pgmap v10931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:47 smithi055 ceph-mon[31863]: pgmap v10931: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19248.151623 secs 2024-03-28T11:20:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19248.151623 secs 2024-03-28T11:20:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19248.151623 secs 2024-03-28T11:20:49.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:49 smithi055 ceph-mon[31863]: pgmap v10932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:49 smithi086 ceph-mon[35163]: pgmap v10932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:49 smithi159 ceph-mon[36109]: pgmap v10932: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:51 smithi086 ceph-mon[35163]: pgmap v10933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:51 smithi159 ceph-mon[36109]: pgmap v10933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:51 smithi055 ceph-mon[31863]: pgmap v10933: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:20:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:53 smithi086 ceph-mon[35163]: pgmap v10934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19253.151749 secs 2024-03-28T11:20:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:53 smithi159 ceph-mon[36109]: pgmap v10934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19253.151749 secs 2024-03-28T11:20:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:53 smithi055 ceph-mon[31863]: pgmap v10934: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:20:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19253.151749 secs 2024-03-28T11:20:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:55 smithi086 ceph-mon[35163]: pgmap v10935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:55 smithi159 ceph-mon[36109]: pgmap v10935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:55 smithi055 ceph-mon[31863]: pgmap v10935: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:57 smithi086 ceph-mon[35163]: pgmap v10936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:57 smithi159 ceph-mon[36109]: pgmap v10936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:57 smithi055 ceph-mon[31863]: pgmap v10936: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19258.151870 secs 2024-03-28T11:20:58.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19258.151870 secs 2024-03-28T11:20:58.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19258.151870 secs 2024-03-28T11:20:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:20:59 smithi086 ceph-mon[35163]: pgmap v10937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:20:59 smithi159 ceph-mon[36109]: pgmap v10937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:20:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:20:59 smithi055 ceph-mon[31863]: pgmap v10937: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:01 smithi086 ceph-mon[35163]: pgmap v10938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:01.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:01 smithi159 ceph-mon[36109]: pgmap v10938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:01.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:01 smithi055 ceph-mon[31863]: pgmap v10938: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:03 smithi086 ceph-mon[35163]: pgmap v10939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19263.151955 secs 2024-03-28T11:21:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:03 smithi159 ceph-mon[36109]: pgmap v10939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:03.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19263.151955 secs 2024-03-28T11:21:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:03 smithi055 ceph-mon[31863]: pgmap v10939: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:03.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19263.151955 secs 2024-03-28T11:21:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:05 smithi086 ceph-mon[35163]: pgmap v10940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:05.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:05 smithi159 ceph-mon[36109]: pgmap v10940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:05.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:05 smithi055 ceph-mon[31863]: pgmap v10940: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:07 smithi086 ceph-mon[35163]: pgmap v10941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:07.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:07 smithi159 ceph-mon[36109]: pgmap v10941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:07.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:07 smithi055 ceph-mon[31863]: pgmap v10941: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19268.152048 secs 2024-03-28T11:21:08.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19268.152048 secs 2024-03-28T11:21:08.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19268.152048 secs 2024-03-28T11:21:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:09 smithi086 ceph-mon[35163]: pgmap v10942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:09.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:09 smithi159 ceph-mon[36109]: pgmap v10942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:09.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:09 smithi055 ceph-mon[31863]: pgmap v10942: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:11 smithi086 ceph-mon[35163]: pgmap v10943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:11.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:11 smithi159 ceph-mon[36109]: pgmap v10943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:11.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:11 smithi055 ceph-mon[31863]: pgmap v10943: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:21:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:13 smithi086 ceph-mon[35163]: pgmap v10944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19273.152141 secs 2024-03-28T11:21:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:13 smithi159 ceph-mon[36109]: pgmap v10944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:13.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19273.152141 secs 2024-03-28T11:21:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:13 smithi055 ceph-mon[31863]: pgmap v10944: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:13.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19273.152141 secs 2024-03-28T11:21:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:15 smithi086 ceph-mon[35163]: pgmap v10945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:15.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:15 smithi159 ceph-mon[36109]: pgmap v10945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:15.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:15 smithi055 ceph-mon[31863]: pgmap v10945: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:17 smithi086 ceph-mon[35163]: pgmap v10946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:17.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:17 smithi159 ceph-mon[36109]: pgmap v10946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:17.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:17 smithi055 ceph-mon[31863]: pgmap v10946: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:18.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19278.152218 secs 2024-03-28T11:21:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19278.152218 secs 2024-03-28T11:21:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19278.152218 secs 2024-03-28T11:21:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:19 smithi055 ceph-mon[31863]: pgmap v10947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:19.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:19 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:21:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:19 smithi086 ceph-mon[35163]: pgmap v10947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:19 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:21:20.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:19 smithi159 ceph-mon[36109]: pgmap v10947: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:20.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:19 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:21:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:21:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:21:20.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:20 smithi055 ceph-mon[31863]: pgmap v10948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:20 smithi055 ceph-mon[31863]: pgmap v10949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:21:20.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:20 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:20 smithi086 ceph-mon[35163]: pgmap v10948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:20 smithi086 ceph-mon[35163]: pgmap v10949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:21:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:20 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:20 smithi159 ceph-mon[36109]: pgmap v10948: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:20 smithi159 ceph-mon[36109]: pgmap v10949: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:21:21.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:20 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:21:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:22 smithi055 ceph-mon[31863]: pgmap v10950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:22 smithi086 ceph-mon[35163]: pgmap v10950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:22 smithi159 ceph-mon[36109]: pgmap v10950: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19283.152293 secs 2024-03-28T11:21:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19283.152293 secs 2024-03-28T11:21:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19283.152293 secs 2024-03-28T11:21:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:24 smithi086 ceph-mon[35163]: pgmap v10951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:24 smithi159 ceph-mon[36109]: pgmap v10951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:24 smithi055 ceph-mon[31863]: pgmap v10951: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:26.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:26 smithi086 ceph-mon[35163]: pgmap v10952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:26.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:26 smithi159 ceph-mon[36109]: pgmap v10952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:26.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:26 smithi055 ceph-mon[31863]: pgmap v10952: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:28 smithi086 ceph-mon[35163]: pgmap v10953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:28.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:28 smithi055 ceph-mon[31863]: pgmap v10953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:28 smithi159 ceph-mon[36109]: pgmap v10953: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19288.152368 secs 2024-03-28T11:21:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19288.152368 secs 2024-03-28T11:21:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19288.152368 secs 2024-03-28T11:21:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:30 smithi055 ceph-mon[31863]: pgmap v10954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:21:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:30 smithi086 ceph-mon[35163]: pgmap v10954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:21:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:30 smithi159 ceph-mon[36109]: pgmap v10954: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:21:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:32 smithi055 ceph-mon[31863]: pgmap v10955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:32 smithi086 ceph-mon[35163]: pgmap v10955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:32 smithi159 ceph-mon[36109]: pgmap v10955: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19293.152446 secs 2024-03-28T11:21:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19293.152446 secs 2024-03-28T11:21:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19293.152446 secs 2024-03-28T11:21:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:34 smithi055 ceph-mon[31863]: pgmap v10956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:34 smithi086 ceph-mon[35163]: pgmap v10956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:34 smithi159 ceph-mon[36109]: pgmap v10956: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:36 smithi055 ceph-mon[31863]: pgmap v10957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:36 smithi086 ceph-mon[35163]: pgmap v10957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:36 smithi159 ceph-mon[36109]: pgmap v10957: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:38 smithi055 ceph-mon[31863]: pgmap v10958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:38.395 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:38 smithi086 ceph-mon[35163]: pgmap v10958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:38 smithi159 ceph-mon[36109]: pgmap v10958: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19298.152569 secs 2024-03-28T11:21:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19298.152569 secs 2024-03-28T11:21:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19298.152569 secs 2024-03-28T11:21:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:40 smithi055 ceph-mon[31863]: pgmap v10959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:40 smithi086 ceph-mon[35163]: pgmap v10959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:40 smithi159 ceph-mon[36109]: pgmap v10959: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:42 smithi055 ceph-mon[31863]: pgmap v10960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:42 smithi086 ceph-mon[35163]: pgmap v10960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:42 smithi159 ceph-mon[36109]: pgmap v10960: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19303.152604 secs 2024-03-28T11:21:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19303.152604 secs 2024-03-28T11:21:43.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19303.152604 secs 2024-03-28T11:21:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:44 smithi055 ceph-mon[31863]: pgmap v10961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:44 smithi086 ceph-mon[35163]: pgmap v10961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:44 smithi159 ceph-mon[36109]: pgmap v10961: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:46 smithi055 ceph-mon[31863]: pgmap v10962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:46 smithi086 ceph-mon[35163]: pgmap v10962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:46 smithi159 ceph-mon[36109]: pgmap v10962: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:48 smithi055 ceph-mon[31863]: pgmap v10963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:48 smithi086 ceph-mon[35163]: pgmap v10963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:48 smithi159 ceph-mon[36109]: pgmap v10963: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19308.152669 secs 2024-03-28T11:21:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19308.152669 secs 2024-03-28T11:21:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19308.152669 secs 2024-03-28T11:21:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:50 smithi055 ceph-mon[31863]: pgmap v10964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:50 smithi086 ceph-mon[35163]: pgmap v10964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:50 smithi159 ceph-mon[36109]: pgmap v10964: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:21:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:52 smithi055 ceph-mon[31863]: pgmap v10965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:52 smithi086 ceph-mon[35163]: pgmap v10965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:52 smithi159 ceph-mon[36109]: pgmap v10965: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19313.152823 secs 2024-03-28T11:21:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19313.152823 secs 2024-03-28T11:21:53.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19313.152823 secs 2024-03-28T11:21:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:54 smithi055 ceph-mon[31863]: pgmap v10966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:54 smithi086 ceph-mon[35163]: pgmap v10966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:54 smithi159 ceph-mon[36109]: pgmap v10966: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:56 smithi055 ceph-mon[31863]: pgmap v10967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:56 smithi086 ceph-mon[35163]: pgmap v10967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:56 smithi159 ceph-mon[36109]: pgmap v10967: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:58 smithi055 ceph-mon[31863]: pgmap v10968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:58 smithi086 ceph-mon[35163]: pgmap v10968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:58 smithi159 ceph-mon[36109]: pgmap v10968: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:21:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:21:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19318.152915 secs 2024-03-28T11:21:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:21:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19318.152915 secs 2024-03-28T11:21:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:21:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19318.152915 secs 2024-03-28T11:22:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:00 smithi055 ceph-mon[31863]: pgmap v10969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:00 smithi086 ceph-mon[35163]: pgmap v10969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:00 smithi159 ceph-mon[36109]: pgmap v10969: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:02.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:02 smithi055 ceph-mon[31863]: pgmap v10970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:02 smithi086 ceph-mon[35163]: pgmap v10970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:02.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:02 smithi159 ceph-mon[36109]: pgmap v10970: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19323.152993 secs 2024-03-28T11:22:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19323.152993 secs 2024-03-28T11:22:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19323.152993 secs 2024-03-28T11:22:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:04 smithi159 ceph-mon[36109]: pgmap v10971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:04 smithi055 ceph-mon[31863]: pgmap v10971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:04 smithi086 ceph-mon[35163]: pgmap v10971: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:06 smithi055 ceph-mon[31863]: pgmap v10972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:06 smithi086 ceph-mon[35163]: pgmap v10972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:06 smithi159 ceph-mon[36109]: pgmap v10972: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19328.153116 secs 2024-03-28T11:22:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:09 smithi055 ceph-mon[31863]: pgmap v10973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19328.153116 secs 2024-03-28T11:22:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:09 smithi086 ceph-mon[35163]: pgmap v10973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19328.153116 secs 2024-03-28T11:22:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:09 smithi159 ceph-mon[36109]: pgmap v10973: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:11 smithi055 ceph-mon[31863]: pgmap v10974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:11 smithi086 ceph-mon[35163]: pgmap v10974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:11 smithi159 ceph-mon[36109]: pgmap v10974: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:13 smithi055 ceph-mon[31863]: pgmap v10975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:13 smithi086 ceph-mon[35163]: pgmap v10975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:13 smithi159 ceph-mon[36109]: pgmap v10975: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19333.153196 secs 2024-03-28T11:22:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19333.153196 secs 2024-03-28T11:22:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19333.153196 secs 2024-03-28T11:22:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:15 smithi086 ceph-mon[35163]: pgmap v10976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:15 smithi159 ceph-mon[36109]: pgmap v10976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:15 smithi055 ceph-mon[31863]: pgmap v10976: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:17 smithi086 ceph-mon[35163]: pgmap v10977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:17 smithi159 ceph-mon[36109]: pgmap v10977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:17 smithi055 ceph-mon[31863]: pgmap v10977: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:19.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19338.153317 secs 2024-03-28T11:22:19.426 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:19 smithi055 ceph-mon[31863]: pgmap v10978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19338.153317 secs 2024-03-28T11:22:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:19 smithi086 ceph-mon[35163]: pgmap v10978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19338.153317 secs 2024-03-28T11:22:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:19 smithi159 ceph-mon[36109]: pgmap v10978: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:21 smithi086 ceph-mon[35163]: pgmap v10979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:21 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:22:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:21 smithi159 ceph-mon[36109]: pgmap v10979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:21 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:22:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:21 smithi055 ceph-mon[31863]: pgmap v10979: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:21 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:22 smithi086 ceph-mon[35163]: pgmap v10980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:22 smithi086 ceph-mon[35163]: pgmap v10981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:22:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:22:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:22:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:22 smithi159 ceph-mon[36109]: pgmap v10980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:22 smithi159 ceph-mon[36109]: pgmap v10981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:22:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:22:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:22:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:22 smithi055 ceph-mon[31863]: pgmap v10980: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:22 smithi055 ceph-mon[31863]: pgmap v10981: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:22.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:22:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19343.153389 secs 2024-03-28T11:22:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19343.153389 secs 2024-03-28T11:22:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19343.153389 secs 2024-03-28T11:22:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:24 smithi055 ceph-mon[31863]: pgmap v10982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:24 smithi086 ceph-mon[35163]: pgmap v10982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:24 smithi159 ceph-mon[36109]: pgmap v10982: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:26 smithi055 ceph-mon[31863]: pgmap v10983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:26 smithi086 ceph-mon[35163]: pgmap v10983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:26 smithi159 ceph-mon[36109]: pgmap v10983: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19348.153477 secs 2024-03-28T11:22:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:28 smithi055 ceph-mon[31863]: pgmap v10984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:22:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19348.153477 secs 2024-03-28T11:22:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:28 smithi086 ceph-mon[35163]: pgmap v10984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:22:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19348.153477 secs 2024-03-28T11:22:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:28 smithi159 ceph-mon[36109]: pgmap v10984: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:22:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:30 smithi055 ceph-mon[31863]: pgmap v10985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:30 smithi086 ceph-mon[35163]: pgmap v10985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:30 smithi159 ceph-mon[36109]: pgmap v10985: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:33.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:32 smithi055 ceph-mon[31863]: pgmap v10986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:22:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:32 smithi086 ceph-mon[35163]: pgmap v10986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:22:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:32 smithi159 ceph-mon[36109]: pgmap v10986: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:22:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19353.153599 secs 2024-03-28T11:22:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19353.153599 secs 2024-03-28T11:22:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19353.153599 secs 2024-03-28T11:22:35.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:34 smithi159 ceph-mon[36109]: pgmap v10987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:34 smithi086 ceph-mon[35163]: pgmap v10987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:34 smithi055 ceph-mon[31863]: pgmap v10987: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:36 smithi086 ceph-mon[35163]: pgmap v10988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:36.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:36 smithi159 ceph-mon[36109]: pgmap v10988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:36 smithi055 ceph-mon[31863]: pgmap v10988: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19358.153716 secs 2024-03-28T11:22:39.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:38 smithi055 ceph-mon[31863]: pgmap v10989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19358.153716 secs 2024-03-28T11:22:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:38 smithi086 ceph-mon[35163]: pgmap v10989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19358.153716 secs 2024-03-28T11:22:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:38 smithi159 ceph-mon[36109]: pgmap v10989: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:41.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:40 smithi055 ceph-mon[31863]: pgmap v10990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:40 smithi086 ceph-mon[35163]: pgmap v10990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:40 smithi159 ceph-mon[36109]: pgmap v10990: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:43.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:42 smithi055 ceph-mon[31863]: pgmap v10991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:42 smithi086 ceph-mon[35163]: pgmap v10991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:42 smithi159 ceph-mon[36109]: pgmap v10991: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19363.153840 secs 2024-03-28T11:22:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19363.153840 secs 2024-03-28T11:22:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19363.153840 secs 2024-03-28T11:22:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:44 smithi159 ceph-mon[36109]: pgmap v10992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:44 smithi086 ceph-mon[35163]: pgmap v10992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:44 smithi055 ceph-mon[31863]: pgmap v10992: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:46 smithi086 ceph-mon[35163]: pgmap v10993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:46 smithi159 ceph-mon[36109]: pgmap v10993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:46 smithi055 ceph-mon[31863]: pgmap v10993: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:49.175 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19368.153931 secs 2024-03-28T11:22:49.175 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:48 smithi055 ceph-mon[31863]: pgmap v10994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19368.153931 secs 2024-03-28T11:22:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:48 smithi086 ceph-mon[35163]: pgmap v10994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19368.153931 secs 2024-03-28T11:22:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:48 smithi159 ceph-mon[36109]: pgmap v10994: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:50 smithi086 ceph-mon[35163]: pgmap v10995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:50 smithi159 ceph-mon[36109]: pgmap v10995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:50 smithi055 ceph-mon[31863]: pgmap v10995: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:52 smithi086 ceph-mon[35163]: pgmap v10996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:52 smithi159 ceph-mon[36109]: pgmap v10996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:52 smithi055 ceph-mon[31863]: pgmap v10996: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19373.153996 secs 2024-03-28T11:22:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19373.153996 secs 2024-03-28T11:22:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19373.153996 secs 2024-03-28T11:22:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:54 smithi086 ceph-mon[35163]: pgmap v10997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:54 smithi159 ceph-mon[36109]: pgmap v10997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:54 smithi055 ceph-mon[31863]: pgmap v10997: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:56 smithi055 ceph-mon[31863]: pgmap v10998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:56 smithi086 ceph-mon[35163]: pgmap v10998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:56 smithi159 ceph-mon[36109]: pgmap v10998: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:22:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19378.154061 secs 2024-03-28T11:22:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:22:58 smithi055 ceph-mon[31863]: pgmap v10999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:59.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19378.154061 secs 2024-03-28T11:22:59.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:22:58 smithi086 ceph-mon[35163]: pgmap v10999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:22:59.274 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19378.154061 secs 2024-03-28T11:22:59.274 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:22:58 smithi159 ceph-mon[36109]: pgmap v10999: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:00.961 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:00 smithi159 ceph-mon[36109]: pgmap v11000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:00 smithi055 ceph-mon[31863]: pgmap v11000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:00 smithi086 ceph-mon[35163]: pgmap v11000: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:02 smithi086 ceph-mon[35163]: pgmap v11001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:02 smithi159 ceph-mon[36109]: pgmap v11001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:02 smithi055 ceph-mon[31863]: pgmap v11001: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19383.154124 secs 2024-03-28T11:23:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19383.154124 secs 2024-03-28T11:23:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19383.154124 secs 2024-03-28T11:23:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:04 smithi086 ceph-mon[35163]: pgmap v11002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:04 smithi159 ceph-mon[36109]: pgmap v11002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:04 smithi055 ceph-mon[31863]: pgmap v11002: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:06 smithi086 ceph-mon[35163]: pgmap v11003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:06 smithi159 ceph-mon[36109]: pgmap v11003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:06 smithi055 ceph-mon[31863]: pgmap v11003: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19388.154190 secs 2024-03-28T11:23:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:08 smithi086 ceph-mon[35163]: pgmap v11004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19388.154190 secs 2024-03-28T11:23:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:08 smithi159 ceph-mon[36109]: pgmap v11004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19388.154190 secs 2024-03-28T11:23:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:08 smithi055 ceph-mon[31863]: pgmap v11004: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:10 smithi086 ceph-mon[35163]: pgmap v11005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:10 smithi159 ceph-mon[36109]: pgmap v11005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:10 smithi055 ceph-mon[31863]: pgmap v11005: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:12 smithi086 ceph-mon[35163]: pgmap v11006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:12 smithi159 ceph-mon[36109]: pgmap v11006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:12 smithi055 ceph-mon[31863]: pgmap v11006: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19393.154261 secs 2024-03-28T11:23:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19393.154261 secs 2024-03-28T11:23:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19393.154261 secs 2024-03-28T11:23:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:14 smithi086 ceph-mon[35163]: pgmap v11007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:14 smithi159 ceph-mon[36109]: pgmap v11007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:15.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:14 smithi055 ceph-mon[31863]: pgmap v11007: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:16 smithi086 ceph-mon[35163]: pgmap v11008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:17.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:16 smithi159 ceph-mon[36109]: pgmap v11008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:16 smithi055 ceph-mon[31863]: pgmap v11008: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19398.154326 secs 2024-03-28T11:23:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:18 smithi086 ceph-mon[35163]: pgmap v11009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19398.154326 secs 2024-03-28T11:23:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:18 smithi159 ceph-mon[36109]: pgmap v11009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19398.154326 secs 2024-03-28T11:23:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:18 smithi055 ceph-mon[31863]: pgmap v11009: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:20 smithi086 ceph-mon[35163]: pgmap v11010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:20 smithi159 ceph-mon[36109]: pgmap v11010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:20 smithi055 ceph-mon[31863]: pgmap v11010: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:22 smithi086 ceph-mon[35163]: pgmap v11011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:22 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:23:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:22 smithi159 ceph-mon[36109]: pgmap v11011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:22 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:23:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:22 smithi055 ceph-mon[31863]: pgmap v11011: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:22 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:23:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19403.154400 secs 2024-03-28T11:23:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:23:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:23:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:23 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:23:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19403.154400 secs 2024-03-28T11:23:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:23:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:23:24.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:23 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:23:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19403.154400 secs 2024-03-28T11:23:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:23:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:23:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:23 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:23:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:24 smithi086 ceph-mon[35163]: pgmap v11012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:23:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:24 smithi086 ceph-mon[35163]: pgmap v11013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:24 smithi159 ceph-mon[36109]: pgmap v11012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:23:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:24 smithi159 ceph-mon[36109]: pgmap v11013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:24 smithi055 ceph-mon[31863]: pgmap v11012: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:23:25.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:24 smithi055 ceph-mon[31863]: pgmap v11013: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:26 smithi086 ceph-mon[35163]: pgmap v11014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:26 smithi159 ceph-mon[36109]: pgmap v11014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:26 smithi055 ceph-mon[31863]: pgmap v11014: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:28 smithi086 ceph-mon[35163]: pgmap v11015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-03-28T11:23:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19408.154465 secs 2024-03-28T11:23:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:28 smithi159 ceph-mon[36109]: pgmap v11015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-03-28T11:23:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19408.154465 secs 2024-03-28T11:23:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:28 smithi055 ceph-mon[31863]: pgmap v11015: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-03-28T11:23:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19408.154465 secs 2024-03-28T11:23:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:31 smithi086 ceph-mon[35163]: pgmap v11016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:31 smithi159 ceph-mon[36109]: pgmap v11016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:31.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:31 smithi055 ceph-mon[31863]: pgmap v11016: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:33 smithi086 ceph-mon[35163]: pgmap v11017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:33 smithi159 ceph-mon[36109]: pgmap v11017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:33 smithi055 ceph-mon[31863]: pgmap v11017: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:23:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19413.154530 secs 2024-03-28T11:23:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19413.154530 secs 2024-03-28T11:23:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19413.154530 secs 2024-03-28T11:23:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:35 smithi086 ceph-mon[35163]: pgmap v11018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:23:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:35 smithi159 ceph-mon[36109]: pgmap v11018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:23:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:35 smithi055 ceph-mon[31863]: pgmap v11018: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:23:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:37 smithi086 ceph-mon[35163]: pgmap v11019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:37 smithi159 ceph-mon[36109]: pgmap v11019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:37 smithi055 ceph-mon[31863]: pgmap v11019: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:39 smithi086 ceph-mon[35163]: pgmap v11020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19418.154595 secs 2024-03-28T11:23:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:39 smithi159 ceph-mon[36109]: pgmap v11020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19418.154595 secs 2024-03-28T11:23:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:39 smithi055 ceph-mon[31863]: pgmap v11020: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19418.154595 secs 2024-03-28T11:23:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:40 smithi055 ceph-mon[31863]: pgmap v11021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:40 smithi086 ceph-mon[35163]: pgmap v11021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:40 smithi159 ceph-mon[36109]: pgmap v11021: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:42 smithi086 ceph-mon[35163]: pgmap v11022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:42 smithi159 ceph-mon[36109]: pgmap v11022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:42 smithi055 ceph-mon[31863]: pgmap v11022: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19423.154714 secs 2024-03-28T11:23:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19423.154714 secs 2024-03-28T11:23:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19423.154714 secs 2024-03-28T11:23:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:44 smithi086 ceph-mon[35163]: pgmap v11023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:44 smithi159 ceph-mon[36109]: pgmap v11023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:44 smithi055 ceph-mon[31863]: pgmap v11023: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:46 smithi086 ceph-mon[35163]: pgmap v11024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:46 smithi159 ceph-mon[36109]: pgmap v11024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:47.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:46 smithi055 ceph-mon[31863]: pgmap v11024: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:48 smithi086 ceph-mon[35163]: pgmap v11025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19428.154801 secs 2024-03-28T11:23:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:48 smithi159 ceph-mon[36109]: pgmap v11025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19428.154801 secs 2024-03-28T11:23:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:48 smithi055 ceph-mon[31863]: pgmap v11025: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19428.154801 secs 2024-03-28T11:23:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:50 smithi086 ceph-mon[35163]: pgmap v11026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:50 smithi159 ceph-mon[36109]: pgmap v11026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:50 smithi055 ceph-mon[31863]: pgmap v11026: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:52 smithi086 ceph-mon[35163]: pgmap v11027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:52 smithi159 ceph-mon[36109]: pgmap v11027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:52 smithi055 ceph-mon[31863]: pgmap v11027: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19433.154843 secs 2024-03-28T11:23:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19433.154843 secs 2024-03-28T11:23:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19433.154843 secs 2024-03-28T11:23:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:54 smithi086 ceph-mon[35163]: pgmap v11028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:54 smithi159 ceph-mon[36109]: pgmap v11028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:54 smithi055 ceph-mon[31863]: pgmap v11028: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:23:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:56 smithi086 ceph-mon[35163]: pgmap v11029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:56 smithi159 ceph-mon[36109]: pgmap v11029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:56 smithi055 ceph-mon[31863]: pgmap v11029: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:23:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:58 smithi086 ceph-mon[35163]: pgmap v11030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:23:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19438.154918 secs 2024-03-28T11:23:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:58 smithi159 ceph-mon[36109]: pgmap v11030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:23:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19438.154918 secs 2024-03-28T11:23:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:58 smithi055 ceph-mon[31863]: pgmap v11030: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:23:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:23:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19438.154918 secs 2024-03-28T11:24:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:00 smithi086 ceph-mon[35163]: pgmap v11031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:00 smithi159 ceph-mon[36109]: pgmap v11031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:00 smithi055 ceph-mon[31863]: pgmap v11031: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:02 smithi086 ceph-mon[35163]: pgmap v11032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:02 smithi159 ceph-mon[36109]: pgmap v11032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:02 smithi055 ceph-mon[31863]: pgmap v11032: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19443.155036 secs 2024-03-28T11:24:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19443.155036 secs 2024-03-28T11:24:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19443.155036 secs 2024-03-28T11:24:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:04 smithi086 ceph-mon[35163]: pgmap v11033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:04 smithi159 ceph-mon[36109]: pgmap v11033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:04 smithi055 ceph-mon[31863]: pgmap v11033: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:06 smithi086 ceph-mon[35163]: pgmap v11034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:06 smithi159 ceph-mon[36109]: pgmap v11034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:06 smithi055 ceph-mon[31863]: pgmap v11034: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:08 smithi086 ceph-mon[35163]: pgmap v11035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19448.155060 secs 2024-03-28T11:24:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:08 smithi159 ceph-mon[36109]: pgmap v11035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19448.155060 secs 2024-03-28T11:24:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:08 smithi055 ceph-mon[31863]: pgmap v11035: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19448.155060 secs 2024-03-28T11:24:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:10 smithi086 ceph-mon[35163]: pgmap v11036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:10 smithi159 ceph-mon[36109]: pgmap v11036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:10 smithi055 ceph-mon[31863]: pgmap v11036: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:12 smithi086 ceph-mon[35163]: pgmap v11037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:12 smithi159 ceph-mon[36109]: pgmap v11037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:12 smithi055 ceph-mon[31863]: pgmap v11037: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19453.155124 secs 2024-03-28T11:24:14.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19453.155124 secs 2024-03-28T11:24:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19453.155124 secs 2024-03-28T11:24:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:14 smithi055 ceph-mon[31863]: pgmap v11038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:14 smithi086 ceph-mon[35163]: pgmap v11038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:14 smithi159 ceph-mon[36109]: pgmap v11038: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:16 smithi055 ceph-mon[31863]: pgmap v11039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:16 smithi086 ceph-mon[35163]: pgmap v11039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:16 smithi159 ceph-mon[36109]: pgmap v11039: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:18 smithi055 ceph-mon[31863]: pgmap v11040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19458.155188 secs 2024-03-28T11:24:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:18 smithi086 ceph-mon[35163]: pgmap v11040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19458.155188 secs 2024-03-28T11:24:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:18 smithi159 ceph-mon[36109]: pgmap v11040: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19458.155188 secs 2024-03-28T11:24:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:20 smithi055 ceph-mon[31863]: pgmap v11041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:20 smithi086 ceph-mon[35163]: pgmap v11041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:20 smithi159 ceph-mon[36109]: pgmap v11041: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:22 smithi055 ceph-mon[31863]: pgmap v11042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:22 smithi086 ceph-mon[35163]: pgmap v11042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:22 smithi159 ceph-mon[36109]: pgmap v11042: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19463.155246 secs 2024-03-28T11:24:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19463.155246 secs 2024-03-28T11:24:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19463.155246 secs 2024-03-28T11:24:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:24 smithi086 ceph-mon[35163]: pgmap v11043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:24 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:24:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:24 smithi159 ceph-mon[36109]: pgmap v11043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:24 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:24:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:24 smithi055 ceph-mon[31863]: pgmap v11043: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:24 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:26 smithi086 ceph-mon[35163]: pgmap v11044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:26 smithi086 ceph-mon[35163]: pgmap v11045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:24:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:24:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:24:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:26 smithi159 ceph-mon[36109]: pgmap v11044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:26 smithi159 ceph-mon[36109]: pgmap v11045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:26.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:24:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:24:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:24:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:26 smithi055 ceph-mon[31863]: pgmap v11044: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:26 smithi055 ceph-mon[31863]: pgmap v11045: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:26.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:24:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:28 smithi086 ceph-mon[35163]: pgmap v11046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19468.155370 secs 2024-03-28T11:24:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:28 smithi159 ceph-mon[36109]: pgmap v11046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:28.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19468.155370 secs 2024-03-28T11:24:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:28 smithi055 ceph-mon[31863]: pgmap v11046: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19468.155370 secs 2024-03-28T11:24:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:30 smithi086 ceph-mon[35163]: pgmap v11047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:30 smithi159 ceph-mon[36109]: pgmap v11047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:30.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:30 smithi055 ceph-mon[31863]: pgmap v11047: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:32 smithi086 ceph-mon[35163]: pgmap v11048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:32 smithi159 ceph-mon[36109]: pgmap v11048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:32 smithi055 ceph-mon[31863]: pgmap v11048: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19473.155456 secs 2024-03-28T11:24:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19473.155456 secs 2024-03-28T11:24:34.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19473.155456 secs 2024-03-28T11:24:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:34 smithi055 ceph-mon[31863]: pgmap v11049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:34 smithi086 ceph-mon[35163]: pgmap v11049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:35.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:34 smithi159 ceph-mon[36109]: pgmap v11049: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:24:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:36 smithi055 ceph-mon[31863]: pgmap v11050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:24:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:36 smithi086 ceph-mon[35163]: pgmap v11050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:24:37.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:36 smithi159 ceph-mon[36109]: pgmap v11050: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:24:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:38 smithi055 ceph-mon[31863]: pgmap v11051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19478.155527 secs 2024-03-28T11:24:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:38 smithi086 ceph-mon[35163]: pgmap v11051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19478.155527 secs 2024-03-28T11:24:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:38 smithi159 ceph-mon[36109]: pgmap v11051: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:39.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19478.155527 secs 2024-03-28T11:24:40.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:40 smithi055 ceph-mon[31863]: pgmap v11052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:40 smithi086 ceph-mon[35163]: pgmap v11052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:41.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:40 smithi159 ceph-mon[36109]: pgmap v11052: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:42.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:42 smithi055 ceph-mon[31863]: pgmap v11053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:42 smithi086 ceph-mon[35163]: pgmap v11053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:43.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:42 smithi159 ceph-mon[36109]: pgmap v11053: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19483.155591 secs 2024-03-28T11:24:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19483.155591 secs 2024-03-28T11:24:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19483.155591 secs 2024-03-28T11:24:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:44 smithi086 ceph-mon[35163]: pgmap v11054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:44 smithi159 ceph-mon[36109]: pgmap v11054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:44 smithi055 ceph-mon[31863]: pgmap v11054: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:46 smithi086 ceph-mon[35163]: pgmap v11055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:46 smithi159 ceph-mon[36109]: pgmap v11055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:46 smithi055 ceph-mon[31863]: pgmap v11055: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:48 smithi086 ceph-mon[35163]: pgmap v11056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19488.155671 secs 2024-03-28T11:24:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:48 smithi159 ceph-mon[36109]: pgmap v11056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19488.155671 secs 2024-03-28T11:24:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:48 smithi055 ceph-mon[31863]: pgmap v11056: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:49.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19488.155671 secs 2024-03-28T11:24:50.926 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:50 smithi055 ceph-mon[31863]: pgmap v11057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:50 smithi086 ceph-mon[35163]: pgmap v11057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:50 smithi159 ceph-mon[36109]: pgmap v11057: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:52 smithi086 ceph-mon[35163]: pgmap v11058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:52 smithi159 ceph-mon[36109]: pgmap v11058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:53.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:52 smithi055 ceph-mon[31863]: pgmap v11058: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19493.155835 secs 2024-03-28T11:24:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19493.155835 secs 2024-03-28T11:24:54.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19493.155835 secs 2024-03-28T11:24:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:54 smithi086 ceph-mon[35163]: pgmap v11059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:54 smithi159 ceph-mon[36109]: pgmap v11059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:54 smithi055 ceph-mon[31863]: pgmap v11059: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:24:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:56 smithi086 ceph-mon[35163]: pgmap v11060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:56 smithi159 ceph-mon[36109]: pgmap v11060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:56 smithi055 ceph-mon[31863]: pgmap v11060: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:24:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:58 smithi086 ceph-mon[35163]: pgmap v11061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:24:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19498.155905 secs 2024-03-28T11:24:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:58 smithi159 ceph-mon[36109]: pgmap v11061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:24:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19498.155905 secs 2024-03-28T11:24:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:58 smithi055 ceph-mon[31863]: pgmap v11061: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:24:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:24:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19498.155905 secs 2024-03-28T11:25:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:00 smithi086 ceph-mon[35163]: pgmap v11062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:00 smithi159 ceph-mon[36109]: pgmap v11062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:00 smithi055 ceph-mon[31863]: pgmap v11062: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:02 smithi086 ceph-mon[35163]: pgmap v11063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:02 smithi159 ceph-mon[36109]: pgmap v11063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:02 smithi055 ceph-mon[31863]: pgmap v11063: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19503.155987 secs 2024-03-28T11:25:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19503.155987 secs 2024-03-28T11:25:04.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19503.155987 secs 2024-03-28T11:25:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:04 smithi086 ceph-mon[35163]: pgmap v11064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:04 smithi159 ceph-mon[36109]: pgmap v11064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:04 smithi055 ceph-mon[31863]: pgmap v11064: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:06 smithi086 ceph-mon[35163]: pgmap v11065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:06 smithi159 ceph-mon[36109]: pgmap v11065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:06 smithi055 ceph-mon[31863]: pgmap v11065: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:08 smithi086 ceph-mon[35163]: pgmap v11066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19508.156063 secs 2024-03-28T11:25:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:08 smithi159 ceph-mon[36109]: pgmap v11066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19508.156063 secs 2024-03-28T11:25:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:08 smithi055 ceph-mon[31863]: pgmap v11066: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19508.156063 secs 2024-03-28T11:25:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:10 smithi086 ceph-mon[35163]: pgmap v11067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:10 smithi159 ceph-mon[36109]: pgmap v11067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:10 smithi055 ceph-mon[31863]: pgmap v11067: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:12 smithi086 ceph-mon[35163]: pgmap v11068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:12 smithi159 ceph-mon[36109]: pgmap v11068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:12 smithi055 ceph-mon[31863]: pgmap v11068: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19513.156124 secs 2024-03-28T11:25:14.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19513.156124 secs 2024-03-28T11:25:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19513.156124 secs 2024-03-28T11:25:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:14 smithi086 ceph-mon[35163]: pgmap v11069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:14 smithi159 ceph-mon[36109]: pgmap v11069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:14 smithi055 ceph-mon[31863]: pgmap v11069: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:16 smithi086 ceph-mon[35163]: pgmap v11070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:16 smithi159 ceph-mon[36109]: pgmap v11070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:16 smithi055 ceph-mon[31863]: pgmap v11070: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:18 smithi086 ceph-mon[35163]: pgmap v11071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19518.156192 secs 2024-03-28T11:25:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:18 smithi159 ceph-mon[36109]: pgmap v11071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19518.156192 secs 2024-03-28T11:25:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:18 smithi055 ceph-mon[31863]: pgmap v11071: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19518.156192 secs 2024-03-28T11:25:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:20 smithi086 ceph-mon[35163]: pgmap v11072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:20 smithi159 ceph-mon[36109]: pgmap v11072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:20 smithi055 ceph-mon[31863]: pgmap v11072: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:23.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:22 smithi055 ceph-mon[31863]: pgmap v11073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:22 smithi086 ceph-mon[35163]: pgmap v11073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:22 smithi159 ceph-mon[36109]: pgmap v11073: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:24.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19523.156255 secs 2024-03-28T11:25:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19523.156255 secs 2024-03-28T11:25:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19523.156255 secs 2024-03-28T11:25:25.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:24 smithi055 ceph-mon[31863]: pgmap v11074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:24 smithi086 ceph-mon[35163]: pgmap v11074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:24 smithi159 ceph-mon[36109]: pgmap v11074: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:26 smithi055 ceph-mon[31863]: pgmap v11075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:27.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:26 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:25:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:26 smithi086 ceph-mon[35163]: pgmap v11075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:26 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:26 smithi159 ceph-mon[36109]: pgmap v11075: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:27.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:26 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:25:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:25:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:25:28.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:27 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:25:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:25:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:25:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:27 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:25:28.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:25:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:25:28.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:27 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:25:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:28 smithi055 ceph-mon[31863]: pgmap v11076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:28 smithi055 ceph-mon[31863]: pgmap v11077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:29.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19528.156322 secs 2024-03-28T11:25:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:28 smithi086 ceph-mon[35163]: pgmap v11076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:28 smithi086 ceph-mon[35163]: pgmap v11077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19528.156322 secs 2024-03-28T11:25:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:28 smithi159 ceph-mon[36109]: pgmap v11076: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:28 smithi159 ceph-mon[36109]: pgmap v11077: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19528.156322 secs 2024-03-28T11:25:31.119 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:30 smithi086 ceph-mon[35163]: pgmap v11078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:31.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:30 smithi159 ceph-mon[36109]: pgmap v11078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:30 smithi055 ceph-mon[31863]: pgmap v11078: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:32 smithi086 ceph-mon[35163]: pgmap v11079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:32 smithi159 ceph-mon[36109]: pgmap v11079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:32 smithi055 ceph-mon[31863]: pgmap v11079: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19533.156397 secs 2024-03-28T11:25:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19533.156397 secs 2024-03-28T11:25:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19533.156397 secs 2024-03-28T11:25:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:34 smithi086 ceph-mon[35163]: pgmap v11080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:34 smithi159 ceph-mon[36109]: pgmap v11080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:34 smithi055 ceph-mon[31863]: pgmap v11080: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:36 smithi086 ceph-mon[35163]: pgmap v11081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:37.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:36 smithi159 ceph-mon[36109]: pgmap v11081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:36 smithi055 ceph-mon[31863]: pgmap v11081: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:38 smithi086 ceph-mon[35163]: pgmap v11082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19538.156468 secs 2024-03-28T11:25:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:38 smithi159 ceph-mon[36109]: pgmap v11082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19538.156468 secs 2024-03-28T11:25:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:38 smithi055 ceph-mon[31863]: pgmap v11082: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19538.156468 secs 2024-03-28T11:25:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:40 smithi086 ceph-mon[35163]: pgmap v11083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:40 smithi159 ceph-mon[36109]: pgmap v11083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:40 smithi055 ceph-mon[31863]: pgmap v11083: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:42 smithi086 ceph-mon[35163]: pgmap v11084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:42 smithi159 ceph-mon[36109]: pgmap v11084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:42 smithi055 ceph-mon[31863]: pgmap v11084: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19543.156533 secs 2024-03-28T11:25:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19543.156533 secs 2024-03-28T11:25:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19543.156533 secs 2024-03-28T11:25:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:44 smithi086 ceph-mon[35163]: pgmap v11085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:44 smithi159 ceph-mon[36109]: pgmap v11085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:44 smithi055 ceph-mon[31863]: pgmap v11085: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:46 smithi086 ceph-mon[35163]: pgmap v11086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:46 smithi159 ceph-mon[36109]: pgmap v11086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:46 smithi055 ceph-mon[31863]: pgmap v11086: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:25:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:48 smithi086 ceph-mon[35163]: pgmap v11087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:25:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19548.156621 secs 2024-03-28T11:25:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:48 smithi159 ceph-mon[36109]: pgmap v11087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:25:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19548.156621 secs 2024-03-28T11:25:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:48 smithi055 ceph-mon[31863]: pgmap v11087: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:25:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19548.156621 secs 2024-03-28T11:25:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:50 smithi086 ceph-mon[35163]: pgmap v11088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:50 smithi159 ceph-mon[36109]: pgmap v11088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:50 smithi055 ceph-mon[31863]: pgmap v11088: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:52 smithi086 ceph-mon[35163]: pgmap v11089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:52 smithi159 ceph-mon[36109]: pgmap v11089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:52 smithi055 ceph-mon[31863]: pgmap v11089: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:25:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19553.156706 secs 2024-03-28T11:25:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19553.156706 secs 2024-03-28T11:25:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19553.156706 secs 2024-03-28T11:25:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:55 smithi086 ceph-mon[35163]: pgmap v11090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:55 smithi159 ceph-mon[36109]: pgmap v11090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:55.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:55 smithi055 ceph-mon[31863]: pgmap v11090: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:25:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:57 smithi086 ceph-mon[35163]: pgmap v11091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:57 smithi159 ceph-mon[36109]: pgmap v11091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:57.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:57 smithi055 ceph-mon[31863]: pgmap v11091: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:25:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:59 smithi086 ceph-mon[35163]: pgmap v11092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:25:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19558.156808 secs 2024-03-28T11:25:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:59 smithi159 ceph-mon[36109]: pgmap v11092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:59.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:25:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19558.156808 secs 2024-03-28T11:25:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:59 smithi055 ceph-mon[31863]: pgmap v11092: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:25:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:25:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19558.156808 secs 2024-03-28T11:26:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:01 smithi086 ceph-mon[35163]: pgmap v11093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:01 smithi159 ceph-mon[36109]: pgmap v11093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:01 smithi055 ceph-mon[31863]: pgmap v11093: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:03 smithi086 ceph-mon[35163]: pgmap v11094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:03 smithi159 ceph-mon[36109]: pgmap v11094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:03 smithi055 ceph-mon[31863]: pgmap v11094: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19563.156892 secs 2024-03-28T11:26:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19563.156892 secs 2024-03-28T11:26:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19563.156892 secs 2024-03-28T11:26:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:05 smithi086 ceph-mon[35163]: pgmap v11095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:05 smithi159 ceph-mon[36109]: pgmap v11095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:05.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:05 smithi055 ceph-mon[31863]: pgmap v11095: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:07.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:07 smithi055 ceph-mon[31863]: pgmap v11096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:07 smithi086 ceph-mon[35163]: pgmap v11096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:07 smithi159 ceph-mon[36109]: pgmap v11096: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:09 smithi055 ceph-mon[31863]: pgmap v11097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19568.156986 secs 2024-03-28T11:26:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:09 smithi086 ceph-mon[35163]: pgmap v11097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19568.156986 secs 2024-03-28T11:26:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:09 smithi159 ceph-mon[36109]: pgmap v11097: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19568.156986 secs 2024-03-28T11:26:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:11 smithi055 ceph-mon[31863]: pgmap v11098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:11 smithi086 ceph-mon[35163]: pgmap v11098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:11 smithi159 ceph-mon[36109]: pgmap v11098: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:13.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:13 smithi055 ceph-mon[31863]: pgmap v11099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:13 smithi086 ceph-mon[35163]: pgmap v11099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:13 smithi159 ceph-mon[36109]: pgmap v11099: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19573.157078 secs 2024-03-28T11:26:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19573.157078 secs 2024-03-28T11:26:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19573.157078 secs 2024-03-28T11:26:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:15 smithi055 ceph-mon[31863]: pgmap v11100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:15 smithi086 ceph-mon[35163]: pgmap v11100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:15 smithi159 ceph-mon[36109]: pgmap v11100: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:16 smithi055 ceph-mon[31863]: pgmap v11101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:16 smithi086 ceph-mon[35163]: pgmap v11101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:16 smithi159 ceph-mon[36109]: pgmap v11101: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:18 smithi086 ceph-mon[35163]: pgmap v11102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19578.157161 secs 2024-03-28T11:26:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:18 smithi159 ceph-mon[36109]: pgmap v11102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19578.157161 secs 2024-03-28T11:26:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:18 smithi055 ceph-mon[31863]: pgmap v11102: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:18.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19578.157161 secs 2024-03-28T11:26:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:20 smithi086 ceph-mon[35163]: pgmap v11103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:20 smithi159 ceph-mon[36109]: pgmap v11103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:20.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:20 smithi055 ceph-mon[31863]: pgmap v11103: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:22 smithi086 ceph-mon[35163]: pgmap v11104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:22 smithi159 ceph-mon[36109]: pgmap v11104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:22.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:22 smithi055 ceph-mon[31863]: pgmap v11104: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19583.157281 secs 2024-03-28T11:26:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19583.157281 secs 2024-03-28T11:26:23.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19583.157281 secs 2024-03-28T11:26:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:24 smithi086 ceph-mon[35163]: pgmap v11105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:24 smithi159 ceph-mon[36109]: pgmap v11105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:24.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:24 smithi055 ceph-mon[31863]: pgmap v11105: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:26 smithi086 ceph-mon[35163]: pgmap v11106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:26 smithi159 ceph-mon[36109]: pgmap v11106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:26.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:26 smithi055 ceph-mon[31863]: pgmap v11106: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:26:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:28 smithi086 ceph-mon[35163]: pgmap v11107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19588.157349 secs 2024-03-28T11:26:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:28 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:26:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:28 smithi159 ceph-mon[36109]: pgmap v11107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19588.157349 secs 2024-03-28T11:26:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:28 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:26:28.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:28 smithi055 ceph-mon[31863]: pgmap v11107: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19588.157349 secs 2024-03-28T11:26:28.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:28 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:26:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:26:29.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:26:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:26:29.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:26:29.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:26:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:30 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:26:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:30 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:26:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:30 smithi086 ceph-mon[35163]: pgmap v11108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:30 smithi086 ceph-mon[35163]: pgmap v11109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:30 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:26:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:30 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:26:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:30 smithi159 ceph-mon[36109]: pgmap v11108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:30.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:30 smithi159 ceph-mon[36109]: pgmap v11109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:30 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:26:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:30 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:26:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:30 smithi055 ceph-mon[31863]: pgmap v11108: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:30.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:30 smithi055 ceph-mon[31863]: pgmap v11109: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:32 smithi086 ceph-mon[35163]: pgmap v11110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:32 smithi159 ceph-mon[36109]: pgmap v11110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:32.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:32 smithi055 ceph-mon[31863]: pgmap v11110: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19593.157469 secs 2024-03-28T11:26:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19593.157469 secs 2024-03-28T11:26:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19593.157469 secs 2024-03-28T11:26:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:34 smithi086 ceph-mon[35163]: pgmap v11111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:34 smithi159 ceph-mon[36109]: pgmap v11111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:34 smithi055 ceph-mon[31863]: pgmap v11111: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:36 smithi086 ceph-mon[35163]: pgmap v11112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:26:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:36 smithi159 ceph-mon[36109]: pgmap v11112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:26:36.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:36 smithi055 ceph-mon[31863]: pgmap v11112: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:38 smithi086 ceph-mon[35163]: pgmap v11113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19598.157541 secs 2024-03-28T11:26:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:38 smithi159 ceph-mon[36109]: pgmap v11113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:38.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19598.157541 secs 2024-03-28T11:26:38.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:38 smithi055 ceph-mon[31863]: pgmap v11113: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:38.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19598.157541 secs 2024-03-28T11:26:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:40 smithi086 ceph-mon[35163]: pgmap v11114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:26:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:40 smithi159 ceph-mon[36109]: pgmap v11114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:26:40.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:40 smithi055 ceph-mon[31863]: pgmap v11114: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:26:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:42 smithi086 ceph-mon[35163]: pgmap v11115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:42 smithi159 ceph-mon[36109]: pgmap v11115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:42.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:42 smithi055 ceph-mon[31863]: pgmap v11115: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19603.157607 secs 2024-03-28T11:26:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19603.157607 secs 2024-03-28T11:26:43.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19603.157607 secs 2024-03-28T11:26:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:44 smithi086 ceph-mon[35163]: pgmap v11116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:44 smithi159 ceph-mon[36109]: pgmap v11116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:44.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:44 smithi055 ceph-mon[31863]: pgmap v11116: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:46.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:46 smithi055 ceph-mon[31863]: pgmap v11117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:46 smithi086 ceph-mon[35163]: pgmap v11117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:46 smithi159 ceph-mon[36109]: pgmap v11117: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:48 smithi055 ceph-mon[31863]: pgmap v11118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19608.157726 secs 2024-03-28T11:26:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:48 smithi086 ceph-mon[35163]: pgmap v11118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19608.157726 secs 2024-03-28T11:26:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:48 smithi159 ceph-mon[36109]: pgmap v11118: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:49.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19608.157726 secs 2024-03-28T11:26:50.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:50 smithi055 ceph-mon[31863]: pgmap v11119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:50 smithi086 ceph-mon[35163]: pgmap v11119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:50 smithi159 ceph-mon[36109]: pgmap v11119: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:52.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:52 smithi055 ceph-mon[31863]: pgmap v11120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:52 smithi086 ceph-mon[35163]: pgmap v11120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:52 smithi159 ceph-mon[36109]: pgmap v11120: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19613.157819 secs 2024-03-28T11:26:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19613.157819 secs 2024-03-28T11:26:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19613.157819 secs 2024-03-28T11:26:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:54 smithi055 ceph-mon[31863]: pgmap v11121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:54 smithi086 ceph-mon[35163]: pgmap v11121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:54 smithi159 ceph-mon[36109]: pgmap v11121: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:56 smithi086 ceph-mon[35163]: pgmap v11122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:56 smithi159 ceph-mon[36109]: pgmap v11122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:56 smithi055 ceph-mon[31863]: pgmap v11122: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:26:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:58 smithi086 ceph-mon[35163]: pgmap v11123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:26:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19618.157902 secs 2024-03-28T11:26:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:58 smithi159 ceph-mon[36109]: pgmap v11123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:26:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19618.157902 secs 2024-03-28T11:26:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:58 smithi055 ceph-mon[31863]: pgmap v11123: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:26:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:26:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19618.157902 secs 2024-03-28T11:27:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:00 smithi086 ceph-mon[35163]: pgmap v11124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:00 smithi159 ceph-mon[36109]: pgmap v11124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:01.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:00 smithi055 ceph-mon[31863]: pgmap v11124: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:02 smithi086 ceph-mon[35163]: pgmap v11125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:02 smithi159 ceph-mon[36109]: pgmap v11125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:02 smithi055 ceph-mon[31863]: pgmap v11125: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19623.157965 secs 2024-03-28T11:27:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19623.157965 secs 2024-03-28T11:27:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19623.157965 secs 2024-03-28T11:27:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:04 smithi086 ceph-mon[35163]: pgmap v11126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:04 smithi159 ceph-mon[36109]: pgmap v11126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:05.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:04 smithi055 ceph-mon[31863]: pgmap v11126: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:06 smithi086 ceph-mon[35163]: pgmap v11127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:06 smithi159 ceph-mon[36109]: pgmap v11127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:06 smithi055 ceph-mon[31863]: pgmap v11127: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:08 smithi086 ceph-mon[35163]: pgmap v11128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19628.158058 secs 2024-03-28T11:27:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:08 smithi159 ceph-mon[36109]: pgmap v11128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19628.158058 secs 2024-03-28T11:27:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:08 smithi055 ceph-mon[31863]: pgmap v11128: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19628.158058 secs 2024-03-28T11:27:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:10 smithi086 ceph-mon[35163]: pgmap v11129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:10 smithi159 ceph-mon[36109]: pgmap v11129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:10 smithi055 ceph-mon[31863]: pgmap v11129: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:12 smithi086 ceph-mon[35163]: pgmap v11130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:12 smithi159 ceph-mon[36109]: pgmap v11130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:12 smithi055 ceph-mon[31863]: pgmap v11130: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19633.158122 secs 2024-03-28T11:27:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19633.158122 secs 2024-03-28T11:27:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19633.158122 secs 2024-03-28T11:27:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:14 smithi086 ceph-mon[35163]: pgmap v11131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:14 smithi159 ceph-mon[36109]: pgmap v11131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:14 smithi055 ceph-mon[31863]: pgmap v11131: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:16 smithi086 ceph-mon[35163]: pgmap v11132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:16 smithi159 ceph-mon[36109]: pgmap v11132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:16 smithi055 ceph-mon[31863]: pgmap v11132: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:18 smithi086 ceph-mon[35163]: pgmap v11133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19638.158204 secs 2024-03-28T11:27:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:18 smithi159 ceph-mon[36109]: pgmap v11133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:19.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19638.158204 secs 2024-03-28T11:27:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:18 smithi055 ceph-mon[31863]: pgmap v11133: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19638.158204 secs 2024-03-28T11:27:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:20 smithi086 ceph-mon[35163]: pgmap v11134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:20 smithi159 ceph-mon[36109]: pgmap v11134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:20 smithi055 ceph-mon[31863]: pgmap v11134: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:22 smithi086 ceph-mon[35163]: pgmap v11135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:22 smithi159 ceph-mon[36109]: pgmap v11135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:22 smithi055 ceph-mon[31863]: pgmap v11135: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19643.158296 secs 2024-03-28T11:27:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19643.158296 secs 2024-03-28T11:27:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19643.158296 secs 2024-03-28T11:27:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:24 smithi086 ceph-mon[35163]: pgmap v11136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:24 smithi159 ceph-mon[36109]: pgmap v11136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:24 smithi055 ceph-mon[31863]: pgmap v11136: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:26 smithi086 ceph-mon[35163]: pgmap v11137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:26 smithi159 ceph-mon[36109]: pgmap v11137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:26 smithi055 ceph-mon[31863]: pgmap v11137: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:28 smithi086 ceph-mon[35163]: pgmap v11138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19648.158372 secs 2024-03-28T11:27:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:28 smithi159 ceph-mon[36109]: pgmap v11138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19648.158372 secs 2024-03-28T11:27:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:28 smithi055 ceph-mon[31863]: pgmap v11138: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19648.158372 secs 2024-03-28T11:27:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:29 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:27:30.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:29 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:27:30.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:29 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:27:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:30 smithi086 ceph-mon[35163]: pgmap v11139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:30 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:30 smithi159 ceph-mon[36109]: pgmap v11139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:30 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:30 smithi055 ceph-mon[31863]: pgmap v11139: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:31.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:30 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:27:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:27:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:27:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:27:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:27:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: pgmap v11140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: pgmap v11141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:31 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:27:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:27:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:27:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:27:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:27:32.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: pgmap v11140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: pgmap v11141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:32.071 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:31 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:27:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:27:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:27:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:27:32.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:27:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: pgmap v11140: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: pgmap v11141: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:32.124 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:31 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:27:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19653.158456 secs 2024-03-28T11:27:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:34 smithi086 ceph-mon[35163]: pgmap v11142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19653.158456 secs 2024-03-28T11:27:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:34 smithi159 ceph-mon[36109]: pgmap v11142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19653.158456 secs 2024-03-28T11:27:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:34 smithi055 ceph-mon[31863]: pgmap v11142: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:36.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:36 smithi055 ceph-mon[31863]: pgmap v11143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:36 smithi086 ceph-mon[35163]: pgmap v11143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:36 smithi159 ceph-mon[36109]: pgmap v11143: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:38 smithi055 ceph-mon[31863]: pgmap v11144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:38 smithi086 ceph-mon[35163]: pgmap v11144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:38 smithi159 ceph-mon[36109]: pgmap v11144: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19658.158579 secs 2024-03-28T11:27:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19658.158579 secs 2024-03-28T11:27:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19658.158579 secs 2024-03-28T11:27:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:40 smithi055 ceph-mon[31863]: pgmap v11145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:40 smithi086 ceph-mon[35163]: pgmap v11145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:40 smithi159 ceph-mon[36109]: pgmap v11145: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:27:42.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:42 smithi055 ceph-mon[31863]: pgmap v11146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:27:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:42 smithi086 ceph-mon[35163]: pgmap v11146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:27:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:42 smithi159 ceph-mon[36109]: pgmap v11146: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:27:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19663.158698 secs 2024-03-28T11:27:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:44 smithi055 ceph-mon[31863]: pgmap v11147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19663.158698 secs 2024-03-28T11:27:44.613 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:44 smithi086 ceph-mon[35163]: pgmap v11147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:44.614 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19663.158698 secs 2024-03-28T11:27:44.614 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:44 smithi159 ceph-mon[36109]: pgmap v11147: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:46 smithi055 ceph-mon[31863]: pgmap v11148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:46 smithi086 ceph-mon[35163]: pgmap v11148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:46 smithi159 ceph-mon[36109]: pgmap v11148: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:47 smithi086 ceph-mon[35163]: pgmap v11149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:47 smithi159 ceph-mon[36109]: pgmap v11149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:47 smithi055 ceph-mon[31863]: pgmap v11149: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:48.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19668.158828 secs 2024-03-28T11:27:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19668.158828 secs 2024-03-28T11:27:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19668.158828 secs 2024-03-28T11:27:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:49 smithi055 ceph-mon[31863]: pgmap v11150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:49 smithi086 ceph-mon[35163]: pgmap v11150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:49 smithi159 ceph-mon[36109]: pgmap v11150: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:52.326 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:52 smithi055 ceph-mon[31863]: pgmap v11151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:52 smithi086 ceph-mon[35163]: pgmap v11151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:52 smithi159 ceph-mon[36109]: pgmap v11151: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19673.158912 secs 2024-03-28T11:27:54.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:54 smithi055 ceph-mon[31863]: pgmap v11152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19673.158912 secs 2024-03-28T11:27:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:54 smithi086 ceph-mon[35163]: pgmap v11152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19673.158912 secs 2024-03-28T11:27:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:54 smithi159 ceph-mon[36109]: pgmap v11152: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:56.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:56 smithi055 ceph-mon[31863]: pgmap v11153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:56 smithi086 ceph-mon[35163]: pgmap v11153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:56 smithi159 ceph-mon[36109]: pgmap v11153: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:27:58.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:58 smithi055 ceph-mon[31863]: pgmap v11154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:58 smithi086 ceph-mon[35163]: pgmap v11154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:58 smithi159 ceph-mon[36109]: pgmap v11154: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:27:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:27:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19678.158976 secs 2024-03-28T11:27:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:27:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19678.158976 secs 2024-03-28T11:27:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:27:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19678.158976 secs 2024-03-28T11:28:00.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:00 smithi055 ceph-mon[31863]: pgmap v11155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:00 smithi086 ceph-mon[35163]: pgmap v11155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:00 smithi159 ceph-mon[36109]: pgmap v11155: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:01 smithi086 ceph-mon[35163]: pgmap v11156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:01 smithi159 ceph-mon[36109]: pgmap v11156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:01.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:01 smithi055 ceph-mon[31863]: pgmap v11156: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19683.159043 secs 2024-03-28T11:28:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:04 smithi055 ceph-mon[31863]: pgmap v11157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19683.159043 secs 2024-03-28T11:28:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:04 smithi086 ceph-mon[35163]: pgmap v11157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19683.159043 secs 2024-03-28T11:28:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:04 smithi159 ceph-mon[36109]: pgmap v11157: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:06 smithi055 ceph-mon[31863]: pgmap v11158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:06 smithi086 ceph-mon[35163]: pgmap v11158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:06 smithi159 ceph-mon[36109]: pgmap v11158: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:08.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:08 smithi055 ceph-mon[31863]: pgmap v11159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:08 smithi086 ceph-mon[35163]: pgmap v11159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:08 smithi159 ceph-mon[36109]: pgmap v11159: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19688.159067 secs 2024-03-28T11:28:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19688.159067 secs 2024-03-28T11:28:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19688.159067 secs 2024-03-28T11:28:10.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:10 smithi055 ceph-mon[31863]: pgmap v11160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:10 smithi086 ceph-mon[35163]: pgmap v11160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:10 smithi159 ceph-mon[36109]: pgmap v11160: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:12.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:12 smithi055 ceph-mon[31863]: pgmap v11161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:12 smithi086 ceph-mon[35163]: pgmap v11161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:12 smithi159 ceph-mon[36109]: pgmap v11161: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:13 smithi086 ceph-mon[35163]: pgmap v11162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:13 smithi159 ceph-mon[36109]: pgmap v11162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:13 smithi055 ceph-mon[31863]: pgmap v11162: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19693.159158 secs 2024-03-28T11:28:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19693.159158 secs 2024-03-28T11:28:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19693.159158 secs 2024-03-28T11:28:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:15 smithi086 ceph-mon[35163]: pgmap v11163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:15 smithi159 ceph-mon[36109]: pgmap v11163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:15 smithi055 ceph-mon[31863]: pgmap v11163: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:18 smithi055 ceph-mon[31863]: pgmap v11164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:18 smithi086 ceph-mon[35163]: pgmap v11164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:18 smithi159 ceph-mon[36109]: pgmap v11164: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19698.159289 secs 2024-03-28T11:28:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19698.159289 secs 2024-03-28T11:28:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19698.159289 secs 2024-03-28T11:28:20.374 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:20 smithi055 ceph-mon[31863]: pgmap v11165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:20 smithi086 ceph-mon[35163]: pgmap v11165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:20 smithi159 ceph-mon[36109]: pgmap v11165: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:22 smithi055 ceph-mon[31863]: pgmap v11166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:22 smithi086 ceph-mon[35163]: pgmap v11166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:22 smithi159 ceph-mon[36109]: pgmap v11166: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19703.159364 secs 2024-03-28T11:28:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:24 smithi086 ceph-mon[35163]: pgmap v11167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19703.159364 secs 2024-03-28T11:28:24.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:24 smithi159 ceph-mon[36109]: pgmap v11167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19703.159364 secs 2024-03-28T11:28:24.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:24 smithi055 ceph-mon[31863]: pgmap v11167: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:25 smithi086 ceph-mon[35163]: pgmap v11168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:25 smithi159 ceph-mon[36109]: pgmap v11168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:25 smithi055 ceph-mon[31863]: pgmap v11168: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:28.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:28 smithi055 ceph-mon[31863]: pgmap v11169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:28 smithi086 ceph-mon[35163]: pgmap v11169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:28.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:28 smithi159 ceph-mon[36109]: pgmap v11169: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19708.159485 secs 2024-03-28T11:28:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19708.159485 secs 2024-03-28T11:28:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19708.159485 secs 2024-03-28T11:28:30.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:30 smithi055 ceph-mon[31863]: pgmap v11170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:30 smithi086 ceph-mon[35163]: pgmap v11170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:30 smithi159 ceph-mon[36109]: pgmap v11170: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:32 smithi055 ceph-mon[31863]: pgmap v11171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:32.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:32 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:28:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:32 smithi086 ceph-mon[35163]: pgmap v11171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:32 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:28:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:32 smithi159 ceph-mon[36109]: pgmap v11171: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:32.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:32 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:28:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:28:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:28:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:28:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:28:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:28:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:28:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:28:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:28:33.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:28:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19713.159608 secs 2024-03-28T11:28:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:34 smithi055 ceph-mon[31863]: pgmap v11172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:34 smithi055 ceph-mon[31863]: pgmap v11173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T11:28:34.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19713.159608 secs 2024-03-28T11:28:34.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:34 smithi086 ceph-mon[35163]: pgmap v11172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:34.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:34 smithi086 ceph-mon[35163]: pgmap v11173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T11:28:34.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19713.159608 secs 2024-03-28T11:28:34.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:34 smithi159 ceph-mon[36109]: pgmap v11172: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:28:34.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:34 smithi159 ceph-mon[36109]: pgmap v11173: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-03-28T11:28:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:35 smithi086 ceph-mon[35163]: pgmap v11174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:35 smithi159 ceph-mon[36109]: pgmap v11174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:35 smithi055 ceph-mon[31863]: pgmap v11174: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:37 smithi086 ceph-mon[35163]: pgmap v11175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:38.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:37 smithi159 ceph-mon[36109]: pgmap v11175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:38.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:37 smithi055 ceph-mon[31863]: pgmap v11175: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19718.159678 secs 2024-03-28T11:28:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19718.159678 secs 2024-03-28T11:28:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19718.159678 secs 2024-03-28T11:28:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:39 smithi086 ceph-mon[35163]: pgmap v11176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:39 smithi159 ceph-mon[36109]: pgmap v11176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:39 smithi055 ceph-mon[31863]: pgmap v11176: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:41 smithi086 ceph-mon[35163]: pgmap v11177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:28:42.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:41 smithi159 ceph-mon[36109]: pgmap v11177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:28:42.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:41 smithi055 ceph-mon[31863]: pgmap v11177: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:28:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19723.159821 secs 2024-03-28T11:28:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:43 smithi086 ceph-mon[35163]: pgmap v11178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19723.159821 secs 2024-03-28T11:28:44.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:43 smithi159 ceph-mon[36109]: pgmap v11178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19723.159821 secs 2024-03-28T11:28:44.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:43 smithi055 ceph-mon[31863]: pgmap v11178: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:28:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:45 smithi086 ceph-mon[35163]: pgmap v11179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:45 smithi159 ceph-mon[36109]: pgmap v11179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:45 smithi055 ceph-mon[31863]: pgmap v11179: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:47 smithi086 ceph-mon[35163]: pgmap v11180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:47 smithi159 ceph-mon[36109]: pgmap v11180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:47 smithi055 ceph-mon[31863]: pgmap v11180: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19728.159886 secs 2024-03-28T11:28:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19728.159886 secs 2024-03-28T11:28:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19728.159886 secs 2024-03-28T11:28:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:49 smithi086 ceph-mon[35163]: pgmap v11181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:49 smithi159 ceph-mon[36109]: pgmap v11181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:49 smithi055 ceph-mon[31863]: pgmap v11181: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:51 smithi086 ceph-mon[35163]: pgmap v11182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:51 smithi159 ceph-mon[36109]: pgmap v11182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:51 smithi055 ceph-mon[31863]: pgmap v11182: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19733.159961 secs 2024-03-28T11:28:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:53 smithi086 ceph-mon[35163]: pgmap v11183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19733.159961 secs 2024-03-28T11:28:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:53 smithi159 ceph-mon[36109]: pgmap v11183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19733.159961 secs 2024-03-28T11:28:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:53 smithi055 ceph-mon[31863]: pgmap v11183: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:55 smithi086 ceph-mon[35163]: pgmap v11184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:56.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:55 smithi159 ceph-mon[36109]: pgmap v11184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:56.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:55 smithi055 ceph-mon[31863]: pgmap v11184: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:57 smithi086 ceph-mon[35163]: pgmap v11185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:58.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:57 smithi159 ceph-mon[36109]: pgmap v11185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:58.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:57 smithi055 ceph-mon[31863]: pgmap v11185: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:28:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:28:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19738.160048 secs 2024-03-28T11:28:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:28:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19738.160048 secs 2024-03-28T11:28:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:28:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19738.160048 secs 2024-03-28T11:29:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:00 smithi086 ceph-mon[35163]: pgmap v11186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:00.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:00 smithi159 ceph-mon[36109]: pgmap v11186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:00.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:00 smithi055 ceph-mon[31863]: pgmap v11186: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:02 smithi086 ceph-mon[35163]: pgmap v11187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:02.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:02 smithi159 ceph-mon[36109]: pgmap v11187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:02.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:02 smithi055 ceph-mon[31863]: pgmap v11187: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19743.160132 secs 2024-03-28T11:29:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:04 smithi086 ceph-mon[35163]: pgmap v11188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19743.160132 secs 2024-03-28T11:29:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:04 smithi159 ceph-mon[36109]: pgmap v11188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19743.160132 secs 2024-03-28T11:29:04.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:04 smithi055 ceph-mon[31863]: pgmap v11188: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:06 smithi086 ceph-mon[35163]: pgmap v11189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:06.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:06 smithi159 ceph-mon[36109]: pgmap v11189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:06.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:06 smithi055 ceph-mon[31863]: pgmap v11189: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:08 smithi086 ceph-mon[35163]: pgmap v11190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:08.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:08 smithi159 ceph-mon[36109]: pgmap v11190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:08 smithi055 ceph-mon[31863]: pgmap v11190: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19748.160196 secs 2024-03-28T11:29:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19748.160196 secs 2024-03-28T11:29:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19748.160196 secs 2024-03-28T11:29:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:10 smithi086 ceph-mon[35163]: pgmap v11191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:10.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:10 smithi159 ceph-mon[36109]: pgmap v11191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:10 smithi055 ceph-mon[31863]: pgmap v11191: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:12 smithi086 ceph-mon[35163]: pgmap v11192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:12.322 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:12 smithi159 ceph-mon[36109]: pgmap v11192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:12 smithi055 ceph-mon[31863]: pgmap v11192: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19753.160318 secs 2024-03-28T11:29:14.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:14 smithi159 ceph-mon[36109]: pgmap v11193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19753.160318 secs 2024-03-28T11:29:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:14 smithi055 ceph-mon[31863]: pgmap v11193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19753.160318 secs 2024-03-28T11:29:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:14 smithi086 ceph-mon[35163]: pgmap v11193: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:16.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:16 smithi055 ceph-mon[31863]: pgmap v11194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:16 smithi086 ceph-mon[35163]: pgmap v11194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:16 smithi159 ceph-mon[36109]: pgmap v11194: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:18.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:18 smithi055 ceph-mon[31863]: pgmap v11195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:18 smithi086 ceph-mon[35163]: pgmap v11195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:18 smithi159 ceph-mon[36109]: pgmap v11195: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19758.160395 secs 2024-03-28T11:29:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19758.160395 secs 2024-03-28T11:29:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19758.160395 secs 2024-03-28T11:29:20.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:20 smithi055 ceph-mon[31863]: pgmap v11196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:20 smithi086 ceph-mon[35163]: pgmap v11196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:20 smithi159 ceph-mon[36109]: pgmap v11196: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:22.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:22 smithi055 ceph-mon[31863]: pgmap v11197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:22 smithi086 ceph-mon[35163]: pgmap v11197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:22 smithi159 ceph-mon[36109]: pgmap v11197: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19763.160513 secs 2024-03-28T11:29:24.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:24 smithi055 ceph-mon[31863]: pgmap v11198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19763.160513 secs 2024-03-28T11:29:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:24 smithi086 ceph-mon[35163]: pgmap v11198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19763.160513 secs 2024-03-28T11:29:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:24 smithi159 ceph-mon[36109]: pgmap v11198: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:26 smithi086 ceph-mon[35163]: pgmap v11199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:26 smithi159 ceph-mon[36109]: pgmap v11199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:26 smithi055 ceph-mon[31863]: pgmap v11199: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:28 smithi086 ceph-mon[35163]: pgmap v11200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:28 smithi159 ceph-mon[36109]: pgmap v11200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:28.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:28 smithi055 ceph-mon[31863]: pgmap v11200: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19768.160576 secs 2024-03-28T11:29:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19768.160576 secs 2024-03-28T11:29:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19768.160576 secs 2024-03-28T11:29:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:30 smithi086 ceph-mon[35163]: pgmap v11201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:30 smithi159 ceph-mon[36109]: pgmap v11201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:30 smithi055 ceph-mon[31863]: pgmap v11201: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:31 smithi086 ceph-mon[35163]: pgmap v11202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:31 smithi159 ceph-mon[36109]: pgmap v11202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:31 smithi055 ceph-mon[31863]: pgmap v11202: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:34.270 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19773.160702 secs 2024-03-28T11:29:34.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:33 smithi086 ceph-mon[35163]: pgmap v11203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:34.271 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:33 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:29:34.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19773.160702 secs 2024-03-28T11:29:34.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:33 smithi159 ceph-mon[36109]: pgmap v11203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:34.274 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:33 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:29:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19773.160702 secs 2024-03-28T11:29:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:33 smithi055 ceph-mon[31863]: pgmap v11203: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:34.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:33 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:29:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:35 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:35 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:35.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:35 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:36 smithi055 ceph-mon[31863]: pgmap v11204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:29:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:29:36.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:36 smithi086 ceph-mon[35163]: pgmap v11204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:29:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:36 smithi159 ceph-mon[36109]: pgmap v11204: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:29:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:29:36.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:29:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:37 smithi055 ceph-mon[31863]: pgmap v11205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:37.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:37 smithi055 ceph-mon[31863]: pgmap v11206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:37 smithi086 ceph-mon[35163]: pgmap v11205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:37 smithi086 ceph-mon[35163]: pgmap v11206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:37 smithi159 ceph-mon[36109]: pgmap v11205: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:37.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:37 smithi159 ceph-mon[36109]: pgmap v11206: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:39 smithi055 ceph-mon[31863]: pgmap v11207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19778.160823 secs 2024-03-28T11:29:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:39 smithi086 ceph-mon[35163]: pgmap v11207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19778.160823 secs 2024-03-28T11:29:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:39 smithi159 ceph-mon[36109]: pgmap v11207: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19778.160823 secs 2024-03-28T11:29:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:41 smithi055 ceph-mon[31863]: pgmap v11208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:41 smithi086 ceph-mon[35163]: pgmap v11208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:41 smithi159 ceph-mon[36109]: pgmap v11208: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:43 smithi086 ceph-mon[35163]: pgmap v11209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:43 smithi159 ceph-mon[36109]: pgmap v11209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:43 smithi055 ceph-mon[31863]: pgmap v11209: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19783.160940 secs 2024-03-28T11:29:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19783.160940 secs 2024-03-28T11:29:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19783.160940 secs 2024-03-28T11:29:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:45 smithi086 ceph-mon[35163]: pgmap v11210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:45.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:45 smithi159 ceph-mon[36109]: pgmap v11210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:45 smithi055 ceph-mon[31863]: pgmap v11210: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:29:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:46 smithi086 ceph-mon[35163]: pgmap v11211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:29:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:46 smithi159 ceph-mon[36109]: pgmap v11211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:29:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:46 smithi055 ceph-mon[31863]: pgmap v11211: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:29:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:48 smithi055 ceph-mon[31863]: pgmap v11212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:48.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19788.161038 secs 2024-03-28T11:29:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:48 smithi086 ceph-mon[35163]: pgmap v11212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19788.161038 secs 2024-03-28T11:29:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:48 smithi159 ceph-mon[36109]: pgmap v11212: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19788.161038 secs 2024-03-28T11:29:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:50 smithi086 ceph-mon[35163]: pgmap v11213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:50 smithi159 ceph-mon[36109]: pgmap v11213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:50 smithi055 ceph-mon[31863]: pgmap v11213: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:52.925 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:52 smithi055 ceph-mon[31863]: pgmap v11214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:52 smithi086 ceph-mon[35163]: pgmap v11214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:52 smithi159 ceph-mon[36109]: pgmap v11214: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19793.161131 secs 2024-03-28T11:29:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19793.161131 secs 2024-03-28T11:29:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19793.161131 secs 2024-03-28T11:29:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:54 smithi086 ceph-mon[35163]: pgmap v11215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:54 smithi159 ceph-mon[36109]: pgmap v11215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:54 smithi055 ceph-mon[31863]: pgmap v11215: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:29:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:56 smithi086 ceph-mon[35163]: pgmap v11216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:29:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:56 smithi159 ceph-mon[36109]: pgmap v11216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:29:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:56 smithi055 ceph-mon[31863]: pgmap v11216: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:29:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:58 smithi086 ceph-mon[35163]: pgmap v11217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:29:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19798.161210 secs 2024-03-28T11:29:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:58 smithi159 ceph-mon[36109]: pgmap v11217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:59.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:29:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19798.161210 secs 2024-03-28T11:29:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:58 smithi055 ceph-mon[31863]: pgmap v11217: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:29:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:29:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19798.161210 secs 2024-03-28T11:30:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:00 smithi086 ceph-mon[35163]: pgmap v11218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:30:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:00 smithi159 ceph-mon[36109]: pgmap v11218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:30:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:00 smithi055 ceph-mon[31863]: pgmap v11218: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:30:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:02 smithi086 ceph-mon[35163]: pgmap v11219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:02 smithi159 ceph-mon[36109]: pgmap v11219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:02 smithi055 ceph-mon[31863]: pgmap v11219: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19803.161331 secs 2024-03-28T11:30:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19803.161331 secs 2024-03-28T11:30:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19803.161331 secs 2024-03-28T11:30:04.969 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:04 smithi086 ceph-mon[35163]: pgmap v11220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:04.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:04 smithi159 ceph-mon[36109]: pgmap v11220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:04 smithi055 ceph-mon[31863]: pgmap v11220: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:06 smithi086 ceph-mon[35163]: pgmap v11221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:06 smithi159 ceph-mon[36109]: pgmap v11221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:06 smithi055 ceph-mon[31863]: pgmap v11221: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:08 smithi086 ceph-mon[35163]: pgmap v11222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19808.161415 secs 2024-03-28T11:30:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:08 smithi159 ceph-mon[36109]: pgmap v11222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:09.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19808.161415 secs 2024-03-28T11:30:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:08 smithi055 ceph-mon[31863]: pgmap v11222: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:09.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19808.161415 secs 2024-03-28T11:30:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:10 smithi086 ceph-mon[35163]: pgmap v11223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:10 smithi159 ceph-mon[36109]: pgmap v11223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:10 smithi055 ceph-mon[31863]: pgmap v11223: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:12 smithi086 ceph-mon[35163]: pgmap v11224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:12 smithi159 ceph-mon[36109]: pgmap v11224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:12 smithi055 ceph-mon[31863]: pgmap v11224: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19813.161480 secs 2024-03-28T11:30:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19813.161480 secs 2024-03-28T11:30:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19813.161480 secs 2024-03-28T11:30:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:14 smithi086 ceph-mon[35163]: pgmap v11225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:14 smithi159 ceph-mon[36109]: pgmap v11225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:14 smithi055 ceph-mon[31863]: pgmap v11225: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:16 smithi086 ceph-mon[35163]: pgmap v11226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:16 smithi159 ceph-mon[36109]: pgmap v11226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:17.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:16 smithi055 ceph-mon[31863]: pgmap v11226: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:18 smithi086 ceph-mon[35163]: pgmap v11227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19818.161560 secs 2024-03-28T11:30:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:18 smithi159 ceph-mon[36109]: pgmap v11227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19818.161560 secs 2024-03-28T11:30:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:18 smithi055 ceph-mon[31863]: pgmap v11227: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19818.161560 secs 2024-03-28T11:30:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:20 smithi086 ceph-mon[35163]: pgmap v11228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:20 smithi159 ceph-mon[36109]: pgmap v11228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:20 smithi055 ceph-mon[31863]: pgmap v11228: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:22 smithi086 ceph-mon[35163]: pgmap v11229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:22 smithi159 ceph-mon[36109]: pgmap v11229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:22 smithi055 ceph-mon[31863]: pgmap v11229: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19823.161677 secs 2024-03-28T11:30:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19823.161677 secs 2024-03-28T11:30:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19823.161677 secs 2024-03-28T11:30:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:24 smithi086 ceph-mon[35163]: pgmap v11230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:24 smithi159 ceph-mon[36109]: pgmap v11230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:24 smithi055 ceph-mon[31863]: pgmap v11230: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:26 smithi086 ceph-mon[35163]: pgmap v11231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:26 smithi159 ceph-mon[36109]: pgmap v11231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:26 smithi055 ceph-mon[31863]: pgmap v11231: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:28 smithi086 ceph-mon[35163]: pgmap v11232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19828.161757 secs 2024-03-28T11:30:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:28 smithi159 ceph-mon[36109]: pgmap v11232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:29.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19828.161757 secs 2024-03-28T11:30:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:28 smithi055 ceph-mon[31863]: pgmap v11232: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19828.161757 secs 2024-03-28T11:30:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:30 smithi086 ceph-mon[35163]: pgmap v11233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:31.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:30 smithi159 ceph-mon[36109]: pgmap v11233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:30 smithi055 ceph-mon[31863]: pgmap v11233: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:32 smithi086 ceph-mon[35163]: pgmap v11234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:33.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:32 smithi159 ceph-mon[36109]: pgmap v11234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:32 smithi055 ceph-mon[31863]: pgmap v11234: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:34.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19833.161874 secs 2024-03-28T11:30:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19833.161874 secs 2024-03-28T11:30:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19833.161874 secs 2024-03-28T11:30:35.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:34 smithi055 ceph-mon[31863]: pgmap v11235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:35.219 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:34 smithi086 ceph-mon[35163]: pgmap v11235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:35.221 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:34 smithi159 ceph-mon[36109]: pgmap v11235: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:36 smithi055 ceph-mon[31863]: pgmap v11236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:36 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:30:37.262 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:36 smithi086 ceph-mon[35163]: pgmap v11236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:37.262 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:36 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:30:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:36 smithi159 ceph-mon[36109]: pgmap v11236: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:30:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:36 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:30:38.193 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:38.193 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:37 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:37 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:38.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:37 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:38 smithi086 ceph-mon[35163]: pgmap v11237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19838.161911 secs 2024-03-28T11:30:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:38 smithi159 ceph-mon[36109]: pgmap v11237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19838.161911 secs 2024-03-28T11:30:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:38 smithi055 ceph-mon[31863]: pgmap v11237: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:30:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19838.161911 secs 2024-03-28T11:30:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:39 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:40.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:39 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:40.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:40.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:39 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:40 smithi086 ceph-mon[35163]: pgmap v11238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:40 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:40 smithi159 ceph-mon[36109]: pgmap v11238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:40 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:40 smithi055 ceph-mon[31863]: pgmap v11238: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:41.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:40 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: pgmap v11239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:30:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:30:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: pgmap v11240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: pgmap v11241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:30:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: pgmap v11239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:30:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:30:43.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: pgmap v11240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: pgmap v11241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:30:43.321 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: pgmap v11239: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:30:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:30:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: pgmap v11240: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: pgmap v11241: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:30:43.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:30:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19843.161984 secs 2024-03-28T11:30:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19843.161984 secs 2024-03-28T11:30:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19843.161984 secs 2024-03-28T11:30:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:45 smithi086 ceph-mon[35163]: pgmap v11242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:45 smithi159 ceph-mon[36109]: pgmap v11242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:45 smithi055 ceph-mon[31863]: pgmap v11242: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:47 smithi086 ceph-mon[35163]: pgmap v11243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:47.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:47 smithi159 ceph-mon[36109]: pgmap v11243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:47.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:47 smithi055 ceph-mon[31863]: pgmap v11243: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19848.162104 secs 2024-03-28T11:30:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:49 smithi086 ceph-mon[35163]: pgmap v11244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19848.162104 secs 2024-03-28T11:30:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:49 smithi159 ceph-mon[36109]: pgmap v11244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19848.162104 secs 2024-03-28T11:30:49.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:49 smithi055 ceph-mon[31863]: pgmap v11244: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:30:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:51 smithi086 ceph-mon[35163]: pgmap v11245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:51 smithi159 ceph-mon[36109]: pgmap v11245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:51 smithi055 ceph-mon[31863]: pgmap v11245: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:30:53.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:53 smithi055 ceph-mon[31863]: pgmap v11246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:53 smithi086 ceph-mon[35163]: pgmap v11246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:53 smithi159 ceph-mon[36109]: pgmap v11246: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:30:54.456 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19853.162179 secs 2024-03-28T11:30:54.456 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:54 smithi055 ceph-mon[31863]: pgmap v11247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:30:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19853.162179 secs 2024-03-28T11:30:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:54 smithi086 ceph-mon[35163]: pgmap v11247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:30:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19853.162179 secs 2024-03-28T11:30:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:54 smithi159 ceph-mon[36109]: pgmap v11247: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:30:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:57 smithi086 ceph-mon[35163]: pgmap v11248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:57 smithi159 ceph-mon[36109]: pgmap v11248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:57 smithi055 ceph-mon[31863]: pgmap v11248: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19858.162262 secs 2024-03-28T11:30:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:30:59 smithi086 ceph-mon[35163]: pgmap v11249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19858.162262 secs 2024-03-28T11:30:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:30:59 smithi159 ceph-mon[36109]: pgmap v11249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:30:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19858.162262 secs 2024-03-28T11:30:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:30:59 smithi055 ceph-mon[31863]: pgmap v11249: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:00 smithi086 ceph-mon[35163]: pgmap v11250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:00 smithi159 ceph-mon[36109]: pgmap v11250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:00 smithi055 ceph-mon[31863]: pgmap v11250: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:03 smithi086 ceph-mon[35163]: pgmap v11251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:03 smithi159 ceph-mon[36109]: pgmap v11251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:03 smithi055 ceph-mon[31863]: pgmap v11251: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19863.162346 secs 2024-03-28T11:31:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19863.162346 secs 2024-03-28T11:31:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19863.162346 secs 2024-03-28T11:31:05.470 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:05 smithi086 ceph-mon[35163]: pgmap v11252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:05.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:05 smithi159 ceph-mon[36109]: pgmap v11252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:05.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:05 smithi055 ceph-mon[31863]: pgmap v11252: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:06 smithi086 ceph-mon[35163]: pgmap v11253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:06 smithi159 ceph-mon[36109]: pgmap v11253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:06 smithi055 ceph-mon[31863]: pgmap v11253: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19868.162409 secs 2024-03-28T11:31:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:09 smithi086 ceph-mon[35163]: pgmap v11254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19868.162409 secs 2024-03-28T11:31:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:09 smithi159 ceph-mon[36109]: pgmap v11254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19868.162409 secs 2024-03-28T11:31:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:09 smithi055 ceph-mon[31863]: pgmap v11254: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:11 smithi086 ceph-mon[35163]: pgmap v11255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:11 smithi159 ceph-mon[36109]: pgmap v11255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:11 smithi055 ceph-mon[31863]: pgmap v11255: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:12 smithi086 ceph-mon[35163]: pgmap v11256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:12 smithi159 ceph-mon[36109]: pgmap v11256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:12 smithi055 ceph-mon[31863]: pgmap v11256: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19873.162528 secs 2024-03-28T11:31:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19873.162528 secs 2024-03-28T11:31:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19873.162528 secs 2024-03-28T11:31:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:14 smithi086 ceph-mon[35163]: pgmap v11257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:14 smithi159 ceph-mon[36109]: pgmap v11257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:14 smithi055 ceph-mon[31863]: pgmap v11257: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:17 smithi086 ceph-mon[35163]: pgmap v11258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:17 smithi159 ceph-mon[36109]: pgmap v11258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:17 smithi055 ceph-mon[31863]: pgmap v11258: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19878.162639 secs 2024-03-28T11:31:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:19 smithi086 ceph-mon[35163]: pgmap v11259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19878.162639 secs 2024-03-28T11:31:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:19 smithi159 ceph-mon[36109]: pgmap v11259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19878.162639 secs 2024-03-28T11:31:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:19 smithi055 ceph-mon[31863]: pgmap v11259: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:20 smithi086 ceph-mon[35163]: pgmap v11260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:20 smithi159 ceph-mon[36109]: pgmap v11260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:20 smithi055 ceph-mon[31863]: pgmap v11260: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:23 smithi086 ceph-mon[35163]: pgmap v11261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:23.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:23 smithi159 ceph-mon[36109]: pgmap v11261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:23 smithi055 ceph-mon[31863]: pgmap v11261: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19883.162756 secs 2024-03-28T11:31:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19883.162756 secs 2024-03-28T11:31:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19883.162756 secs 2024-03-28T11:31:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:25 smithi086 ceph-mon[35163]: pgmap v11262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:25 smithi159 ceph-mon[36109]: pgmap v11262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:25 smithi055 ceph-mon[31863]: pgmap v11262: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:26 smithi086 ceph-mon[35163]: pgmap v11263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:26 smithi159 ceph-mon[36109]: pgmap v11263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:26 smithi055 ceph-mon[31863]: pgmap v11263: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19888.162873 secs 2024-03-28T11:31:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:29 smithi086 ceph-mon[35163]: pgmap v11264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19888.162873 secs 2024-03-28T11:31:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:29 smithi159 ceph-mon[36109]: pgmap v11264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19888.162873 secs 2024-03-28T11:31:29.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:29 smithi055 ceph-mon[31863]: pgmap v11264: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:31 smithi086 ceph-mon[35163]: pgmap v11265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:31:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:31 smithi159 ceph-mon[36109]: pgmap v11265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:31:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:31 smithi055 ceph-mon[31863]: pgmap v11265: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:31:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:32 smithi086 ceph-mon[35163]: pgmap v11266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:32 smithi159 ceph-mon[36109]: pgmap v11266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:32 smithi055 ceph-mon[31863]: pgmap v11266: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19893.162937 secs 2024-03-28T11:31:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19893.162937 secs 2024-03-28T11:31:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19893.162937 secs 2024-03-28T11:31:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:34 smithi086 ceph-mon[35163]: pgmap v11267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:34 smithi159 ceph-mon[36109]: pgmap v11267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:34 smithi055 ceph-mon[31863]: pgmap v11267: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:37.521 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:37 smithi086 ceph-mon[35163]: pgmap v11268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:37.523 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:37 smithi159 ceph-mon[36109]: pgmap v11268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:37 smithi055 ceph-mon[31863]: pgmap v11268: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:38 smithi086 ceph-mon[35163]: pgmap v11269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:38 smithi159 ceph-mon[36109]: pgmap v11269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:38 smithi055 ceph-mon[31863]: pgmap v11269: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19898.163059 secs 2024-03-28T11:31:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19898.163059 secs 2024-03-28T11:31:39.625 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19898.163059 secs 2024-03-28T11:31:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:40 smithi086 ceph-mon[35163]: pgmap v11270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:40 smithi159 ceph-mon[36109]: pgmap v11270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:40 smithi055 ceph-mon[31863]: pgmap v11270: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:31:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:43 smithi086 ceph-mon[35163]: pgmap v11271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:43 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:31:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:43 smithi159 ceph-mon[36109]: pgmap v11271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:43 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:31:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:43 smithi055 ceph-mon[31863]: pgmap v11271: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:43 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:31:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19903.163126 secs 2024-03-28T11:31:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:31:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:31:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: pgmap v11272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: pgmap v11273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:44 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:31:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19903.163126 secs 2024-03-28T11:31:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:31:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:31:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: pgmap v11272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: pgmap v11273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:44.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:44 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:31:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19903.163126 secs 2024-03-28T11:31:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:31:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:31:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: pgmap v11272: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: pgmap v11273: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:44 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:31:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:46 smithi086 ceph-mon[35163]: pgmap v11274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:46 smithi159 ceph-mon[36109]: pgmap v11274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:46 smithi055 ceph-mon[31863]: pgmap v11274: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19908.163193 secs 2024-03-28T11:31:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:48 smithi086 ceph-mon[35163]: pgmap v11275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:31:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19908.163193 secs 2024-03-28T11:31:49.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:48 smithi159 ceph-mon[36109]: pgmap v11275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:31:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19908.163193 secs 2024-03-28T11:31:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:48 smithi055 ceph-mon[31863]: pgmap v11275: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:31:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:50 smithi086 ceph-mon[35163]: pgmap v11276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:51.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:50 smithi159 ceph-mon[36109]: pgmap v11276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:50 smithi055 ceph-mon[31863]: pgmap v11276: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:52 smithi086 ceph-mon[35163]: pgmap v11277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:52 smithi159 ceph-mon[36109]: pgmap v11277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:52 smithi055 ceph-mon[31863]: pgmap v11277: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:31:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19913.163258 secs 2024-03-28T11:31:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19913.163258 secs 2024-03-28T11:31:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19913.163258 secs 2024-03-28T11:31:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:54 smithi086 ceph-mon[35163]: pgmap v11278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:31:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:54 smithi159 ceph-mon[36109]: pgmap v11278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:31:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:54 smithi055 ceph-mon[31863]: pgmap v11278: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:31:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:56 smithi086 ceph-mon[35163]: pgmap v11279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:56 smithi159 ceph-mon[36109]: pgmap v11279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:56 smithi055 ceph-mon[31863]: pgmap v11279: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19918.163379 secs 2024-03-28T11:31:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:31:58 smithi086 ceph-mon[35163]: pgmap v11280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19918.163379 secs 2024-03-28T11:31:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:31:58 smithi159 ceph-mon[36109]: pgmap v11280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:31:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19918.163379 secs 2024-03-28T11:31:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:31:58 smithi055 ceph-mon[31863]: pgmap v11280: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:00 smithi086 ceph-mon[35163]: pgmap v11281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:00 smithi159 ceph-mon[36109]: pgmap v11281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:00 smithi055 ceph-mon[31863]: pgmap v11281: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:03 smithi086 ceph-mon[35163]: pgmap v11282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:03 smithi159 ceph-mon[36109]: pgmap v11282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:03.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:03 smithi055 ceph-mon[31863]: pgmap v11282: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19923.163466 secs 2024-03-28T11:32:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19923.163466 secs 2024-03-28T11:32:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19923.163466 secs 2024-03-28T11:32:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:05 smithi086 ceph-mon[35163]: pgmap v11283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:05 smithi159 ceph-mon[36109]: pgmap v11283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:05 smithi055 ceph-mon[31863]: pgmap v11283: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:07 smithi086 ceph-mon[35163]: pgmap v11284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:07 smithi159 ceph-mon[36109]: pgmap v11284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:07 smithi055 ceph-mon[31863]: pgmap v11284: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19928.163542 secs 2024-03-28T11:32:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:09 smithi086 ceph-mon[35163]: pgmap v11285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19928.163542 secs 2024-03-28T11:32:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:09 smithi159 ceph-mon[36109]: pgmap v11285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19928.163542 secs 2024-03-28T11:32:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:09 smithi055 ceph-mon[31863]: pgmap v11285: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:11 smithi086 ceph-mon[35163]: pgmap v11286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:11 smithi159 ceph-mon[36109]: pgmap v11286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:11 smithi055 ceph-mon[31863]: pgmap v11286: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:13 smithi086 ceph-mon[35163]: pgmap v11287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:13 smithi159 ceph-mon[36109]: pgmap v11287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:13 smithi055 ceph-mon[31863]: pgmap v11287: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:14.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19933.163606 secs 2024-03-28T11:32:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19933.163606 secs 2024-03-28T11:32:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19933.163606 secs 2024-03-28T11:32:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:15 smithi055 ceph-mon[31863]: pgmap v11288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:15 smithi086 ceph-mon[35163]: pgmap v11288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:15 smithi159 ceph-mon[36109]: pgmap v11288: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:17 smithi055 ceph-mon[31863]: pgmap v11289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:17 smithi086 ceph-mon[35163]: pgmap v11289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:17 smithi159 ceph-mon[36109]: pgmap v11289: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19938.163683 secs 2024-03-28T11:32:19.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:19 smithi055 ceph-mon[31863]: pgmap v11290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19938.163683 secs 2024-03-28T11:32:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:19 smithi086 ceph-mon[35163]: pgmap v11290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19938.163683 secs 2024-03-28T11:32:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:19 smithi159 ceph-mon[36109]: pgmap v11290: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:21.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:21 smithi055 ceph-mon[31863]: pgmap v11291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:21 smithi086 ceph-mon[35163]: pgmap v11291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:21 smithi159 ceph-mon[36109]: pgmap v11291: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:23 smithi086 ceph-mon[35163]: pgmap v11292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:23 smithi159 ceph-mon[36109]: pgmap v11292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:23 smithi055 ceph-mon[31863]: pgmap v11292: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19943.163805 secs 2024-03-28T11:32:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19943.163805 secs 2024-03-28T11:32:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19943.163805 secs 2024-03-28T11:32:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:25 smithi086 ceph-mon[35163]: pgmap v11293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:25.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:25 smithi159 ceph-mon[36109]: pgmap v11293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:25 smithi055 ceph-mon[31863]: pgmap v11293: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:26 smithi086 ceph-mon[35163]: pgmap v11294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:26 smithi159 ceph-mon[36109]: pgmap v11294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:26.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:26 smithi055 ceph-mon[31863]: pgmap v11294: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19948.163871 secs 2024-03-28T11:32:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:28 smithi086 ceph-mon[35163]: pgmap v11295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19948.163871 secs 2024-03-28T11:32:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:28 smithi159 ceph-mon[36109]: pgmap v11295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19948.163871 secs 2024-03-28T11:32:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:28 smithi055 ceph-mon[31863]: pgmap v11295: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:30 smithi086 ceph-mon[35163]: pgmap v11296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:30 smithi159 ceph-mon[36109]: pgmap v11296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:31.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:30 smithi055 ceph-mon[31863]: pgmap v11296: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:32 smithi086 ceph-mon[35163]: pgmap v11297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:32 smithi159 ceph-mon[36109]: pgmap v11297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:32 smithi055 ceph-mon[31863]: pgmap v11297: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19953.163935 secs 2024-03-28T11:32:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19953.163935 secs 2024-03-28T11:32:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19953.163935 secs 2024-03-28T11:32:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:34 smithi086 ceph-mon[35163]: pgmap v11298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:34 smithi159 ceph-mon[36109]: pgmap v11298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:34 smithi055 ceph-mon[31863]: pgmap v11298: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:36 smithi086 ceph-mon[35163]: pgmap v11299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:36 smithi159 ceph-mon[36109]: pgmap v11299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:36 smithi055 ceph-mon[31863]: pgmap v11299: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19958.164010 secs 2024-03-28T11:32:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:39 smithi086 ceph-mon[35163]: pgmap v11300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19958.164010 secs 2024-03-28T11:32:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:39 smithi159 ceph-mon[36109]: pgmap v11300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19958.164010 secs 2024-03-28T11:32:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:38 smithi055 ceph-mon[31863]: pgmap v11300: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:41 smithi086 ceph-mon[35163]: pgmap v11301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:41 smithi159 ceph-mon[36109]: pgmap v11301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:41 smithi055 ceph-mon[31863]: pgmap v11301: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:43 smithi086 ceph-mon[35163]: pgmap v11302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:43 smithi159 ceph-mon[36109]: pgmap v11302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:43 smithi055 ceph-mon[31863]: pgmap v11302: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19963.164130 secs 2024-03-28T11:32:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19963.164130 secs 2024-03-28T11:32:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19963.164130 secs 2024-03-28T11:32:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:45 smithi086 ceph-mon[35163]: pgmap v11303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:45 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:32:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:45 smithi159 ceph-mon[36109]: pgmap v11303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:45 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:32:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:45 smithi055 ceph-mon[31863]: pgmap v11303: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:32:45.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:45 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:32:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:32:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:32:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:32:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:32:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:32:46.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:32:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:32:46.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:32:46.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:32:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:47 smithi086 ceph-mon[35163]: pgmap v11304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:32:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:47 smithi086 ceph-mon[35163]: pgmap v11305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:47 smithi159 ceph-mon[36109]: pgmap v11304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:32:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:47 smithi159 ceph-mon[36109]: pgmap v11305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:47 smithi055 ceph-mon[31863]: pgmap v11304: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:32:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:47 smithi055 ceph-mon[31863]: pgmap v11305: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:49 smithi086 ceph-mon[35163]: pgmap v11306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:32:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19968.164251 secs 2024-03-28T11:32:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:49 smithi159 ceph-mon[36109]: pgmap v11306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:32:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19968.164251 secs 2024-03-28T11:32:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:49 smithi055 ceph-mon[31863]: pgmap v11306: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:32:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19968.164251 secs 2024-03-28T11:32:51.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:51 smithi055 ceph-mon[31863]: pgmap v11307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:51 smithi086 ceph-mon[35163]: pgmap v11307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:51 smithi159 ceph-mon[36109]: pgmap v11307: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:53 smithi055 ceph-mon[31863]: pgmap v11308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:53 smithi086 ceph-mon[35163]: pgmap v11308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:53.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:53 smithi159 ceph-mon[36109]: pgmap v11308: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19973.164376 secs 2024-03-28T11:32:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19973.164376 secs 2024-03-28T11:32:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19973.164376 secs 2024-03-28T11:32:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:55 smithi055 ceph-mon[31863]: pgmap v11309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:55 smithi086 ceph-mon[35163]: pgmap v11309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:55 smithi159 ceph-mon[36109]: pgmap v11309: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:32:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:57 smithi055 ceph-mon[31863]: pgmap v11310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:57 smithi086 ceph-mon[35163]: pgmap v11310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:57 smithi159 ceph-mon[36109]: pgmap v11310: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:32:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:59 smithi055 ceph-mon[31863]: pgmap v11311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:32:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19978.164442 secs 2024-03-28T11:32:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:59 smithi086 ceph-mon[35163]: pgmap v11311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:32:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19978.164442 secs 2024-03-28T11:32:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:59 smithi159 ceph-mon[36109]: pgmap v11311: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:32:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:32:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19978.164442 secs 2024-03-28T11:33:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:01 smithi055 ceph-mon[31863]: pgmap v11312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:01 smithi086 ceph-mon[35163]: pgmap v11312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:01 smithi159 ceph-mon[36109]: pgmap v11312: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:03 smithi086 ceph-mon[35163]: pgmap v11313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:03 smithi159 ceph-mon[36109]: pgmap v11313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:03 smithi055 ceph-mon[31863]: pgmap v11313: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19983.164504 secs 2024-03-28T11:33:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19983.164504 secs 2024-03-28T11:33:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19983.164504 secs 2024-03-28T11:33:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:05 smithi086 ceph-mon[35163]: pgmap v11314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:05 smithi159 ceph-mon[36109]: pgmap v11314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:05 smithi055 ceph-mon[31863]: pgmap v11314: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:07 smithi086 ceph-mon[35163]: pgmap v11315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:07 smithi159 ceph-mon[36109]: pgmap v11315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:07 smithi055 ceph-mon[31863]: pgmap v11315: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:09 smithi086 ceph-mon[35163]: pgmap v11316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19988.164574 secs 2024-03-28T11:33:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:09 smithi159 ceph-mon[36109]: pgmap v11316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19988.164574 secs 2024-03-28T11:33:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:09 smithi055 ceph-mon[31863]: pgmap v11316: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19988.164574 secs 2024-03-28T11:33:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:11 smithi086 ceph-mon[35163]: pgmap v11317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:11 smithi159 ceph-mon[36109]: pgmap v11317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:11 smithi055 ceph-mon[31863]: pgmap v11317: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:13 smithi086 ceph-mon[35163]: pgmap v11318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:13 smithi159 ceph-mon[36109]: pgmap v11318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:13 smithi055 ceph-mon[31863]: pgmap v11318: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19993.164652 secs 2024-03-28T11:33:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19993.164652 secs 2024-03-28T11:33:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19993.164652 secs 2024-03-28T11:33:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:15 smithi086 ceph-mon[35163]: pgmap v11319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:15 smithi159 ceph-mon[36109]: pgmap v11319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:15 smithi055 ceph-mon[31863]: pgmap v11319: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:16 smithi086 ceph-mon[35163]: pgmap v11320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:16 smithi159 ceph-mon[36109]: pgmap v11320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:16 smithi055 ceph-mon[31863]: pgmap v11320: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:18 smithi086 ceph-mon[35163]: pgmap v11321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 19998.164716 secs 2024-03-28T11:33:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:18 smithi159 ceph-mon[36109]: pgmap v11321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 19998.164716 secs 2024-03-28T11:33:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:18 smithi055 ceph-mon[31863]: pgmap v11321: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 19998.164716 secs 2024-03-28T11:33:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:20 smithi086 ceph-mon[35163]: pgmap v11322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:20 smithi159 ceph-mon[36109]: pgmap v11322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:20 smithi055 ceph-mon[31863]: pgmap v11322: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:22 smithi086 ceph-mon[35163]: pgmap v11323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:22 smithi159 ceph-mon[36109]: pgmap v11323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:22 smithi055 ceph-mon[31863]: pgmap v11323: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20003.164840 secs 2024-03-28T11:33:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20003.164840 secs 2024-03-28T11:33:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20003.164840 secs 2024-03-28T11:33:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:24 smithi086 ceph-mon[35163]: pgmap v11324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:24 smithi159 ceph-mon[36109]: pgmap v11324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:24 smithi055 ceph-mon[31863]: pgmap v11324: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:27.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:26 smithi159 ceph-mon[36109]: pgmap v11325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:26 smithi055 ceph-mon[31863]: pgmap v11325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:26 smithi086 ceph-mon[35163]: pgmap v11325: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:28 smithi055 ceph-mon[31863]: pgmap v11326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:29.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20008.164930 secs 2024-03-28T11:33:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:28 smithi086 ceph-mon[35163]: pgmap v11326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20008.164930 secs 2024-03-28T11:33:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:28 smithi159 ceph-mon[36109]: pgmap v11326: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20008.164930 secs 2024-03-28T11:33:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:30 smithi055 ceph-mon[31863]: pgmap v11327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:30 smithi086 ceph-mon[35163]: pgmap v11327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:30 smithi159 ceph-mon[36109]: pgmap v11327: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:32 smithi055 ceph-mon[31863]: pgmap v11328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:32 smithi086 ceph-mon[35163]: pgmap v11328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:32 smithi159 ceph-mon[36109]: pgmap v11328: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20013.165011 secs 2024-03-28T11:33:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20013.165011 secs 2024-03-28T11:33:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20013.165011 secs 2024-03-28T11:33:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:34 smithi055 ceph-mon[31863]: pgmap v11329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:34 smithi086 ceph-mon[35163]: pgmap v11329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:34 smithi159 ceph-mon[36109]: pgmap v11329: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:37.121 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:36 smithi086 ceph-mon[35163]: pgmap v11330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:37.122 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:36 smithi159 ceph-mon[36109]: pgmap v11330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:36 smithi055 ceph-mon[31863]: pgmap v11330: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:38 smithi086 ceph-mon[35163]: pgmap v11331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20018.165097 secs 2024-03-28T11:33:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:38 smithi159 ceph-mon[36109]: pgmap v11331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:39.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20018.165097 secs 2024-03-28T11:33:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:38 smithi055 ceph-mon[31863]: pgmap v11331: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:39.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20018.165097 secs 2024-03-28T11:33:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:40 smithi086 ceph-mon[35163]: pgmap v11332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:40 smithi159 ceph-mon[36109]: pgmap v11332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:40 smithi055 ceph-mon[31863]: pgmap v11332: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:42 smithi086 ceph-mon[35163]: pgmap v11333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:42 smithi159 ceph-mon[36109]: pgmap v11333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:42 smithi055 ceph-mon[31863]: pgmap v11333: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20023.165158 secs 2024-03-28T11:33:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20023.165158 secs 2024-03-28T11:33:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20023.165158 secs 2024-03-28T11:33:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:44 smithi086 ceph-mon[35163]: pgmap v11334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:44 smithi159 ceph-mon[36109]: pgmap v11334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:44 smithi055 ceph-mon[31863]: pgmap v11334: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:33:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:46 smithi086 ceph-mon[35163]: pgmap v11335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:46 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:33:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:46 smithi159 ceph-mon[36109]: pgmap v11335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:46 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:33:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:46 smithi055 ceph-mon[31863]: pgmap v11335: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:33:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:46 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:33:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:33:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:33:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:47 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:33:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:33:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:33:48.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:47 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:33:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:33:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:33:48.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:47 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:33:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:48 smithi086 ceph-mon[35163]: pgmap v11336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:48 smithi086 ceph-mon[35163]: pgmap v11337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20028.165224 secs 2024-03-28T11:33:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:48 smithi159 ceph-mon[36109]: pgmap v11336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:48 smithi159 ceph-mon[36109]: pgmap v11337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20028.165224 secs 2024-03-28T11:33:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:48 smithi055 ceph-mon[31863]: pgmap v11336: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:33:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:48 smithi055 ceph-mon[31863]: pgmap v11337: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:49.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20028.165224 secs 2024-03-28T11:33:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:50 smithi086 ceph-mon[35163]: pgmap v11338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:50 smithi159 ceph-mon[36109]: pgmap v11338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:50 smithi055 ceph-mon[31863]: pgmap v11338: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:52 smithi086 ceph-mon[35163]: pgmap v11339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:52 smithi159 ceph-mon[36109]: pgmap v11339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:52 smithi055 ceph-mon[31863]: pgmap v11339: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:54.274 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20033.165290 secs 2024-03-28T11:33:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20033.165290 secs 2024-03-28T11:33:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20033.165290 secs 2024-03-28T11:33:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:54 smithi086 ceph-mon[35163]: pgmap v11340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:54 smithi159 ceph-mon[36109]: pgmap v11340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:54 smithi055 ceph-mon[31863]: pgmap v11340: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:56 smithi086 ceph-mon[35163]: pgmap v11341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:56 smithi159 ceph-mon[36109]: pgmap v11341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:56 smithi055 ceph-mon[31863]: pgmap v11341: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:33:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:58 smithi086 ceph-mon[35163]: pgmap v11342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:33:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:33:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20038.165411 secs 2024-03-28T11:33:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:58 smithi159 ceph-mon[36109]: pgmap v11342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:33:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:33:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20038.165411 secs 2024-03-28T11:33:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:58 smithi055 ceph-mon[31863]: pgmap v11342: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:33:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:33:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20038.165411 secs 2024-03-28T11:34:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:00 smithi086 ceph-mon[35163]: pgmap v11343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:01.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:00 smithi159 ceph-mon[36109]: pgmap v11343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:00 smithi055 ceph-mon[31863]: pgmap v11343: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:03 smithi086 ceph-mon[35163]: pgmap v11344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:03.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:03 smithi159 ceph-mon[36109]: pgmap v11344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:03 smithi055 ceph-mon[31863]: pgmap v11344: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20043.165525 secs 2024-03-28T11:34:04.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20043.165525 secs 2024-03-28T11:34:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20043.165525 secs 2024-03-28T11:34:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:05 smithi086 ceph-mon[35163]: pgmap v11345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:05.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:05 smithi159 ceph-mon[36109]: pgmap v11345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:05 smithi055 ceph-mon[31863]: pgmap v11345: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:07 smithi086 ceph-mon[35163]: pgmap v11346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:07.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:07 smithi159 ceph-mon[36109]: pgmap v11346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:07 smithi055 ceph-mon[31863]: pgmap v11346: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:09 smithi086 ceph-mon[35163]: pgmap v11347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20048.165646 secs 2024-03-28T11:34:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:09 smithi159 ceph-mon[36109]: pgmap v11347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:09.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20048.165646 secs 2024-03-28T11:34:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:09 smithi055 ceph-mon[31863]: pgmap v11347: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20048.165646 secs 2024-03-28T11:34:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:11 smithi086 ceph-mon[35163]: pgmap v11348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:11.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:11 smithi159 ceph-mon[36109]: pgmap v11348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:11.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:11 smithi055 ceph-mon[31863]: pgmap v11348: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:13 smithi086 ceph-mon[35163]: pgmap v11349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:13.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:13 smithi159 ceph-mon[36109]: pgmap v11349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:13.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:13 smithi055 ceph-mon[31863]: pgmap v11349: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20053.165766 secs 2024-03-28T11:34:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20053.165766 secs 2024-03-28T11:34:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20053.165766 secs 2024-03-28T11:34:15.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:15 smithi055 ceph-mon[31863]: pgmap v11350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:15 smithi086 ceph-mon[35163]: pgmap v11350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:15 smithi159 ceph-mon[36109]: pgmap v11350: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:17.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:17 smithi055 ceph-mon[31863]: pgmap v11351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:17 smithi086 ceph-mon[35163]: pgmap v11351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:17 smithi159 ceph-mon[36109]: pgmap v11351: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:19 smithi055 ceph-mon[31863]: pgmap v11352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:19.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20058.165856 secs 2024-03-28T11:34:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:19 smithi086 ceph-mon[35163]: pgmap v11352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20058.165856 secs 2024-03-28T11:34:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:19 smithi159 ceph-mon[36109]: pgmap v11352: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20058.165856 secs 2024-03-28T11:34:21.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:21 smithi055 ceph-mon[31863]: pgmap v11353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:21 smithi086 ceph-mon[35163]: pgmap v11353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:21 smithi159 ceph-mon[36109]: pgmap v11353: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:23 smithi055 ceph-mon[31863]: pgmap v11354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:23 smithi086 ceph-mon[35163]: pgmap v11354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:23 smithi159 ceph-mon[36109]: pgmap v11354: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20063.165935 secs 2024-03-28T11:34:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20063.165935 secs 2024-03-28T11:34:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20063.165935 secs 2024-03-28T11:34:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:25 smithi086 ceph-mon[35163]: pgmap v11355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:25 smithi159 ceph-mon[36109]: pgmap v11355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:25 smithi055 ceph-mon[31863]: pgmap v11355: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:27 smithi086 ceph-mon[35163]: pgmap v11356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:27 smithi159 ceph-mon[36109]: pgmap v11356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:27 smithi055 ceph-mon[31863]: pgmap v11356: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:29 smithi086 ceph-mon[35163]: pgmap v11357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20068.166018 secs 2024-03-28T11:34:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:29 smithi159 ceph-mon[36109]: pgmap v11357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20068.166018 secs 2024-03-28T11:34:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:29 smithi055 ceph-mon[31863]: pgmap v11357: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20068.166018 secs 2024-03-28T11:34:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:31 smithi086 ceph-mon[35163]: pgmap v11358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:31 smithi159 ceph-mon[36109]: pgmap v11358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:31 smithi055 ceph-mon[31863]: pgmap v11358: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:33 smithi086 ceph-mon[35163]: pgmap v11359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:33 smithi159 ceph-mon[36109]: pgmap v11359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:33 smithi055 ceph-mon[31863]: pgmap v11359: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20073.166091 secs 2024-03-28T11:34:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20073.166091 secs 2024-03-28T11:34:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20073.166091 secs 2024-03-28T11:34:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:35 smithi086 ceph-mon[35163]: pgmap v11360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:35 smithi159 ceph-mon[36109]: pgmap v11360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:35 smithi055 ceph-mon[31863]: pgmap v11360: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:37 smithi086 ceph-mon[35163]: pgmap v11361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:37 smithi159 ceph-mon[36109]: pgmap v11361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:37 smithi055 ceph-mon[31863]: pgmap v11361: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:39 smithi086 ceph-mon[35163]: pgmap v11362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20078.166169 secs 2024-03-28T11:34:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:39 smithi159 ceph-mon[36109]: pgmap v11362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20078.166169 secs 2024-03-28T11:34:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:39 smithi055 ceph-mon[31863]: pgmap v11362: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20078.166169 secs 2024-03-28T11:34:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:41 smithi086 ceph-mon[35163]: pgmap v11363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:41.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:41 smithi159 ceph-mon[36109]: pgmap v11363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:41 smithi055 ceph-mon[31863]: pgmap v11363: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:43 smithi086 ceph-mon[35163]: pgmap v11364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:43.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:43 smithi159 ceph-mon[36109]: pgmap v11364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:43 smithi055 ceph-mon[31863]: pgmap v11364: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20083.166292 secs 2024-03-28T11:34:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:44 smithi086 ceph-mon[35163]: pgmap v11365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20083.166292 secs 2024-03-28T11:34:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:44 smithi159 ceph-mon[36109]: pgmap v11365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20083.166292 secs 2024-03-28T11:34:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:44 smithi055 ceph-mon[31863]: pgmap v11365: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:46 smithi086 ceph-mon[35163]: pgmap v11366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:46 smithi159 ceph-mon[36109]: pgmap v11366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:46 smithi055 ceph-mon[31863]: pgmap v11366: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:34:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:48 smithi086 ceph-mon[35163]: pgmap v11367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20088.166413 secs 2024-03-28T11:34:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:48 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:34:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:48 smithi159 ceph-mon[36109]: pgmap v11367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20088.166413 secs 2024-03-28T11:34:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:48 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:34:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:48 smithi055 ceph-mon[31863]: pgmap v11367: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:34:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20088.166413 secs 2024-03-28T11:34:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:48 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:34:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:34:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:34:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:49 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:34:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:34:50.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:34:50.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:49 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:34:50.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:34:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:34:50.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:49 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:34:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:50 smithi086 ceph-mon[35163]: pgmap v11368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:50 smithi086 ceph-mon[35163]: pgmap v11369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:50 smithi159 ceph-mon[36109]: pgmap v11368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:50 smithi159 ceph-mon[36109]: pgmap v11369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:50 smithi055 ceph-mon[31863]: pgmap v11368: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:34:51.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:50 smithi055 ceph-mon[31863]: pgmap v11369: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:52 smithi086 ceph-mon[35163]: pgmap v11370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:53.072 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:52 smithi159 ceph-mon[36109]: pgmap v11370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:52 smithi055 ceph-mon[31863]: pgmap v11370: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:54.025 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20093.166476 secs 2024-03-28T11:34:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20093.166476 secs 2024-03-28T11:34:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20093.166476 secs 2024-03-28T11:34:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:54 smithi086 ceph-mon[35163]: pgmap v11371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:54 smithi159 ceph-mon[36109]: pgmap v11371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:54 smithi055 ceph-mon[31863]: pgmap v11371: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:56 smithi086 ceph-mon[35163]: pgmap v11372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:56 smithi159 ceph-mon[36109]: pgmap v11372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:56 smithi055 ceph-mon[31863]: pgmap v11372: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:58 smithi086 ceph-mon[35163]: pgmap v11373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:34:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20098.166596 secs 2024-03-28T11:34:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:58 smithi159 ceph-mon[36109]: pgmap v11373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:34:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20098.166596 secs 2024-03-28T11:34:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:58 smithi055 ceph-mon[31863]: pgmap v11373: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:34:59.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:34:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20098.166596 secs 2024-03-28T11:35:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:00 smithi086 ceph-mon[35163]: pgmap v11374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:35:01.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:00 smithi159 ceph-mon[36109]: pgmap v11374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:35:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:00 smithi055 ceph-mon[31863]: pgmap v11374: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:35:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:02 smithi086 ceph-mon[35163]: pgmap v11375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:02 smithi159 ceph-mon[36109]: pgmap v11375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:02 smithi055 ceph-mon[31863]: pgmap v11375: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20103.166714 secs 2024-03-28T11:35:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20103.166714 secs 2024-03-28T11:35:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20103.166714 secs 2024-03-28T11:35:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:04 smithi086 ceph-mon[35163]: pgmap v11376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:04 smithi159 ceph-mon[36109]: pgmap v11376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:04 smithi055 ceph-mon[31863]: pgmap v11376: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:06 smithi086 ceph-mon[35163]: pgmap v11377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:06 smithi159 ceph-mon[36109]: pgmap v11377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:06 smithi055 ceph-mon[31863]: pgmap v11377: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:08 smithi086 ceph-mon[35163]: pgmap v11378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20108.166820 secs 2024-03-28T11:35:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:08 smithi159 ceph-mon[36109]: pgmap v11378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20108.166820 secs 2024-03-28T11:35:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:08 smithi055 ceph-mon[31863]: pgmap v11378: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20108.166820 secs 2024-03-28T11:35:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:10 smithi086 ceph-mon[35163]: pgmap v11379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:10 smithi159 ceph-mon[36109]: pgmap v11379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:10 smithi055 ceph-mon[31863]: pgmap v11379: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:12 smithi086 ceph-mon[35163]: pgmap v11380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:12 smithi159 ceph-mon[36109]: pgmap v11380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:12 smithi055 ceph-mon[31863]: pgmap v11380: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20113.166939 secs 2024-03-28T11:35:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20113.166939 secs 2024-03-28T11:35:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20113.166939 secs 2024-03-28T11:35:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:14 smithi159 ceph-mon[36109]: pgmap v11381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:14 smithi055 ceph-mon[31863]: pgmap v11381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:14 smithi086 ceph-mon[35163]: pgmap v11381: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:16 smithi055 ceph-mon[31863]: pgmap v11382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:16 smithi086 ceph-mon[35163]: pgmap v11382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:16 smithi159 ceph-mon[36109]: pgmap v11382: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:18 smithi055 ceph-mon[31863]: pgmap v11383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:19.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20118.167057 secs 2024-03-28T11:35:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:18 smithi086 ceph-mon[35163]: pgmap v11383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20118.167057 secs 2024-03-28T11:35:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:18 smithi159 ceph-mon[36109]: pgmap v11383: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20118.167057 secs 2024-03-28T11:35:21.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:20 smithi055 ceph-mon[31863]: pgmap v11384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:20 smithi086 ceph-mon[35163]: pgmap v11384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:20 smithi159 ceph-mon[36109]: pgmap v11384: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:22 smithi055 ceph-mon[31863]: pgmap v11385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:22 smithi086 ceph-mon[35163]: pgmap v11385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:22 smithi159 ceph-mon[36109]: pgmap v11385: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20123.167142 secs 2024-03-28T11:35:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20123.167142 secs 2024-03-28T11:35:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20123.167142 secs 2024-03-28T11:35:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:24 smithi086 ceph-mon[35163]: pgmap v11386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:24 smithi159 ceph-mon[36109]: pgmap v11386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:24 smithi055 ceph-mon[31863]: pgmap v11386: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:26 smithi086 ceph-mon[35163]: pgmap v11387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:26 smithi159 ceph-mon[36109]: pgmap v11387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:26 smithi055 ceph-mon[31863]: pgmap v11387: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:28 smithi086 ceph-mon[35163]: pgmap v11388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20128.167228 secs 2024-03-28T11:35:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:28 smithi159 ceph-mon[36109]: pgmap v11388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:29.320 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20128.167228 secs 2024-03-28T11:35:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:28 smithi055 ceph-mon[31863]: pgmap v11388: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:29.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20128.167228 secs 2024-03-28T11:35:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:30 smithi086 ceph-mon[35163]: pgmap v11389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:30 smithi159 ceph-mon[36109]: pgmap v11389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:31.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:30 smithi055 ceph-mon[31863]: pgmap v11389: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:32 smithi086 ceph-mon[35163]: pgmap v11390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:32 smithi159 ceph-mon[36109]: pgmap v11390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:33.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:32 smithi055 ceph-mon[31863]: pgmap v11390: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20133.167293 secs 2024-03-28T11:35:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20133.167293 secs 2024-03-28T11:35:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20133.167293 secs 2024-03-28T11:35:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:34 smithi086 ceph-mon[35163]: pgmap v11391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:34 smithi159 ceph-mon[36109]: pgmap v11391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:34 smithi055 ceph-mon[31863]: pgmap v11391: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:36 smithi086 ceph-mon[35163]: pgmap v11392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:36 smithi159 ceph-mon[36109]: pgmap v11392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:36 smithi055 ceph-mon[31863]: pgmap v11392: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:38 smithi086 ceph-mon[35163]: pgmap v11393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20138.167380 secs 2024-03-28T11:35:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:38 smithi159 ceph-mon[36109]: pgmap v11393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20138.167380 secs 2024-03-28T11:35:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:38 smithi055 ceph-mon[31863]: pgmap v11393: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20138.167380 secs 2024-03-28T11:35:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:40 smithi086 ceph-mon[35163]: pgmap v11394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:40 smithi159 ceph-mon[36109]: pgmap v11394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:40 smithi055 ceph-mon[31863]: pgmap v11394: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:42 smithi086 ceph-mon[35163]: pgmap v11395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:42 smithi159 ceph-mon[36109]: pgmap v11395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:42 smithi055 ceph-mon[31863]: pgmap v11395: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20143.167451 secs 2024-03-28T11:35:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20143.167451 secs 2024-03-28T11:35:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20143.167451 secs 2024-03-28T11:35:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:44 smithi086 ceph-mon[35163]: pgmap v11396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:44 smithi159 ceph-mon[36109]: pgmap v11396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:44 smithi055 ceph-mon[31863]: pgmap v11396: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:46 smithi086 ceph-mon[35163]: pgmap v11397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:46 smithi159 ceph-mon[36109]: pgmap v11397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:46 smithi055 ceph-mon[31863]: pgmap v11397: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:35:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:48 smithi086 ceph-mon[35163]: pgmap v11398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20148.167539 secs 2024-03-28T11:35:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:49 smithi159 ceph-mon[36109]: pgmap v11398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20148.167539 secs 2024-03-28T11:35:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:48 smithi055 ceph-mon[31863]: pgmap v11398: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:35:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20148.167539 secs 2024-03-28T11:35:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:50 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:35:50.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:50 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:35:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:50 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:35:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:51 smithi086 ceph-mon[35163]: pgmap v11399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:51 smithi159 ceph-mon[36109]: pgmap v11399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:51 smithi055 ceph-mon[31863]: pgmap v11399: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:35:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:35:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:35:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:35:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:35:52.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:35:52.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:35:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:35:52.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:35:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:53 smithi086 ceph-mon[35163]: pgmap v11400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:53 smithi086 ceph-mon[35163]: pgmap v11401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:53 smithi159 ceph-mon[36109]: pgmap v11400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:53 smithi159 ceph-mon[36109]: pgmap v11401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:53 smithi055 ceph-mon[31863]: pgmap v11400: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:35:53.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:53 smithi055 ceph-mon[31863]: pgmap v11401: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20153.167618 secs 2024-03-28T11:35:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20153.167618 secs 2024-03-28T11:35:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20153.167618 secs 2024-03-28T11:35:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:55 smithi086 ceph-mon[35163]: pgmap v11402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:55 smithi159 ceph-mon[36109]: pgmap v11402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:55 smithi055 ceph-mon[31863]: pgmap v11402: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:57 smithi086 ceph-mon[35163]: pgmap v11403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:35:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:57 smithi159 ceph-mon[36109]: pgmap v11403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:35:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:57 smithi055 ceph-mon[31863]: pgmap v11403: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:35:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:59 smithi055 ceph-mon[31863]: pgmap v11404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:59.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:35:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20158.167737 secs 2024-03-28T11:35:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:59 smithi086 ceph-mon[35163]: pgmap v11404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:35:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20158.167737 secs 2024-03-28T11:35:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:59 smithi159 ceph-mon[36109]: pgmap v11404: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:35:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:35:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20158.167737 secs 2024-03-28T11:36:01.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:01 smithi055 ceph-mon[31863]: pgmap v11405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:01 smithi086 ceph-mon[35163]: pgmap v11405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:01.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:01 smithi159 ceph-mon[36109]: pgmap v11405: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:03 smithi055 ceph-mon[31863]: pgmap v11406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:36:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:03 smithi086 ceph-mon[35163]: pgmap v11406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:36:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:03 smithi159 ceph-mon[36109]: pgmap v11406: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:36:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20163.167861 secs 2024-03-28T11:36:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20163.167861 secs 2024-03-28T11:36:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20163.167861 secs 2024-03-28T11:36:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:05 smithi055 ceph-mon[31863]: pgmap v11407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:05 smithi086 ceph-mon[35163]: pgmap v11407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:05 smithi159 ceph-mon[36109]: pgmap v11407: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:07 smithi055 ceph-mon[31863]: pgmap v11408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:07 smithi086 ceph-mon[35163]: pgmap v11408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:07 smithi159 ceph-mon[36109]: pgmap v11408: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:09 smithi086 ceph-mon[35163]: pgmap v11409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20168.167949 secs 2024-03-28T11:36:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:09 smithi159 ceph-mon[36109]: pgmap v11409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:09.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20168.167949 secs 2024-03-28T11:36:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:09 smithi055 ceph-mon[31863]: pgmap v11409: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:09.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20168.167949 secs 2024-03-28T11:36:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:11 smithi086 ceph-mon[35163]: pgmap v11410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:11 smithi159 ceph-mon[36109]: pgmap v11410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:11 smithi055 ceph-mon[31863]: pgmap v11410: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:13 smithi086 ceph-mon[35163]: pgmap v11411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:13 smithi159 ceph-mon[36109]: pgmap v11411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:13 smithi055 ceph-mon[31863]: pgmap v11411: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20173.168070 secs 2024-03-28T11:36:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20173.168070 secs 2024-03-28T11:36:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20173.168070 secs 2024-03-28T11:36:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:15 smithi086 ceph-mon[35163]: pgmap v11412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:15 smithi159 ceph-mon[36109]: pgmap v11412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:15 smithi055 ceph-mon[31863]: pgmap v11412: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:17 smithi086 ceph-mon[35163]: pgmap v11413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:17 smithi159 ceph-mon[36109]: pgmap v11413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:17 smithi055 ceph-mon[31863]: pgmap v11413: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:19 smithi086 ceph-mon[35163]: pgmap v11414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20178.168134 secs 2024-03-28T11:36:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:19 smithi159 ceph-mon[36109]: pgmap v11414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20178.168134 secs 2024-03-28T11:36:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:19 smithi055 ceph-mon[31863]: pgmap v11414: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20178.168134 secs 2024-03-28T11:36:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:21 smithi086 ceph-mon[35163]: pgmap v11415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:21.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:21 smithi159 ceph-mon[36109]: pgmap v11415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:21 smithi055 ceph-mon[31863]: pgmap v11415: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:23 smithi086 ceph-mon[35163]: pgmap v11416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:23 smithi159 ceph-mon[36109]: pgmap v11416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:23 smithi055 ceph-mon[31863]: pgmap v11416: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:24.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20183.168253 secs 2024-03-28T11:36:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20183.168253 secs 2024-03-28T11:36:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20183.168253 secs 2024-03-28T11:36:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:25 smithi086 ceph-mon[35163]: pgmap v11417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:25 smithi159 ceph-mon[36109]: pgmap v11417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:25 smithi055 ceph-mon[31863]: pgmap v11417: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:27 smithi086 ceph-mon[35163]: pgmap v11418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:27 smithi159 ceph-mon[36109]: pgmap v11418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:27 smithi055 ceph-mon[31863]: pgmap v11418: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:29 smithi086 ceph-mon[35163]: pgmap v11419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20188.168336 secs 2024-03-28T11:36:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:29 smithi159 ceph-mon[36109]: pgmap v11419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20188.168336 secs 2024-03-28T11:36:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:29 smithi055 ceph-mon[31863]: pgmap v11419: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20188.168336 secs 2024-03-28T11:36:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:31 smithi086 ceph-mon[35163]: pgmap v11420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:31 smithi159 ceph-mon[36109]: pgmap v11420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:31 smithi055 ceph-mon[31863]: pgmap v11420: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:33 smithi086 ceph-mon[35163]: pgmap v11421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:33 smithi159 ceph-mon[36109]: pgmap v11421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:33 smithi055 ceph-mon[31863]: pgmap v11421: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20193.168457 secs 2024-03-28T11:36:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20193.168457 secs 2024-03-28T11:36:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20193.168457 secs 2024-03-28T11:36:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:35 smithi086 ceph-mon[35163]: pgmap v11422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:35 smithi159 ceph-mon[36109]: pgmap v11422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:35 smithi055 ceph-mon[31863]: pgmap v11422: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:36 smithi086 ceph-mon[35163]: pgmap v11423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:36 smithi159 ceph-mon[36109]: pgmap v11423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:36 smithi055 ceph-mon[31863]: pgmap v11423: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:38 smithi055 ceph-mon[31863]: pgmap v11424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:38 smithi086 ceph-mon[35163]: pgmap v11424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:38.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:38 smithi159 ceph-mon[36109]: pgmap v11424: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20198.168570 secs 2024-03-28T11:36:39.719 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20198.168570 secs 2024-03-28T11:36:39.721 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20198.168570 secs 2024-03-28T11:36:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:40 smithi055 ceph-mon[31863]: pgmap v11425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:40 smithi086 ceph-mon[35163]: pgmap v11425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:40 smithi159 ceph-mon[36109]: pgmap v11425: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:42.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:42 smithi055 ceph-mon[31863]: pgmap v11426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:42 smithi086 ceph-mon[35163]: pgmap v11426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:42.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:42 smithi159 ceph-mon[36109]: pgmap v11426: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20203.168658 secs 2024-03-28T11:36:44.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:44 smithi055 ceph-mon[31863]: pgmap v11427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20203.168658 secs 2024-03-28T11:36:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:44 smithi086 ceph-mon[35163]: pgmap v11427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20203.168658 secs 2024-03-28T11:36:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:44 smithi159 ceph-mon[36109]: pgmap v11427: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:46 smithi086 ceph-mon[35163]: pgmap v11428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:46.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:46 smithi159 ceph-mon[36109]: pgmap v11428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:46.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:46 smithi055 ceph-mon[31863]: pgmap v11428: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:36:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:48 smithi086 ceph-mon[35163]: pgmap v11429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20208.168808 secs 2024-03-28T11:36:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:48 smithi159 ceph-mon[36109]: pgmap v11429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:48.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20208.168808 secs 2024-03-28T11:36:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:48 smithi055 ceph-mon[31863]: pgmap v11429: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:48.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20208.168808 secs 2024-03-28T11:36:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:50 smithi086 ceph-mon[35163]: pgmap v11430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:50.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:50 smithi159 ceph-mon[36109]: pgmap v11430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:50.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:50 smithi055 ceph-mon[31863]: pgmap v11430: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:52 smithi086 ceph-mon[35163]: pgmap v11431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:52 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:36:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:52 smithi159 ceph-mon[36109]: pgmap v11431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:52.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:52 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:36:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:52 smithi055 ceph-mon[31863]: pgmap v11431: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:52.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:52 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:36:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20213.168878 secs 2024-03-28T11:36:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: pgmap v11432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: pgmap v11433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:53 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20213.168878 secs 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.821 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:36:53.822 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:36:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:36:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:36:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: pgmap v11432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: pgmap v11433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:53.823 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:53 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20213.168878 secs 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi086 to 176.7M 2024-03-28T11:36:53.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi086 to 185386700: error parsing value: Value '185386700' is below minimum 939524096 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi055 to 177.8M 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi055 to 186497024: error parsing value: Value '186497024' is below minimum 939524096 2024-03-28T11:36:53.874 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:36:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:36:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: pgmap v11432: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:36:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: pgmap v11433: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:53.875 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:53 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:36:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:56 smithi086 ceph-mon[35163]: pgmap v11434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:56 smithi159 ceph-mon[36109]: pgmap v11434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:56.575 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:56 smithi055 ceph-mon[31863]: pgmap v11434: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:58 smithi086 ceph-mon[35163]: pgmap v11435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:58 smithi159 ceph-mon[36109]: pgmap v11435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:58.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:58 smithi055 ceph-mon[31863]: pgmap v11435: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:36:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:36:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20218.168967 secs 2024-03-28T11:36:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:36:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20218.168967 secs 2024-03-28T11:36:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:36:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20218.168967 secs 2024-03-28T11:37:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:00 smithi086 ceph-mon[35163]: pgmap v11436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:00 smithi159 ceph-mon[36109]: pgmap v11436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:00 smithi055 ceph-mon[31863]: pgmap v11436: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:02 smithi086 ceph-mon[35163]: pgmap v11437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:02 smithi159 ceph-mon[36109]: pgmap v11437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:02 smithi055 ceph-mon[31863]: pgmap v11437: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20223.169049 secs 2024-03-28T11:37:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:04 smithi086 ceph-mon[35163]: pgmap v11438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:37:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20223.169049 secs 2024-03-28T11:37:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:04 smithi159 ceph-mon[36109]: pgmap v11438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:37:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20223.169049 secs 2024-03-28T11:37:04.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:04 smithi055 ceph-mon[31863]: pgmap v11438: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:37:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:06 smithi086 ceph-mon[35163]: pgmap v11439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:06 smithi159 ceph-mon[36109]: pgmap v11439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:06 smithi055 ceph-mon[31863]: pgmap v11439: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:08 smithi086 ceph-mon[35163]: pgmap v11440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:08 smithi159 ceph-mon[36109]: pgmap v11440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:08 smithi055 ceph-mon[31863]: pgmap v11440: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20228.169124 secs 2024-03-28T11:37:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20228.169124 secs 2024-03-28T11:37:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20228.169124 secs 2024-03-28T11:37:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:10 smithi086 ceph-mon[35163]: pgmap v11441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:10 smithi159 ceph-mon[36109]: pgmap v11441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:10 smithi055 ceph-mon[31863]: pgmap v11441: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:11 smithi086 ceph-mon[35163]: pgmap v11442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:11 smithi159 ceph-mon[36109]: pgmap v11442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:11 smithi055 ceph-mon[31863]: pgmap v11442: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20233.169240 secs 2024-03-28T11:37:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:14 smithi086 ceph-mon[35163]: pgmap v11443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20233.169240 secs 2024-03-28T11:37:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:14 smithi159 ceph-mon[36109]: pgmap v11443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20233.169240 secs 2024-03-28T11:37:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:14 smithi055 ceph-mon[31863]: pgmap v11443: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:16 smithi086 ceph-mon[35163]: pgmap v11444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:37:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:16 smithi159 ceph-mon[36109]: pgmap v11444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:37:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:16 smithi055 ceph-mon[31863]: pgmap v11444: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:37:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:18 smithi086 ceph-mon[35163]: pgmap v11445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:18 smithi159 ceph-mon[36109]: pgmap v11445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:18 smithi055 ceph-mon[31863]: pgmap v11445: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:37:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20238.169362 secs 2024-03-28T11:37:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20238.169362 secs 2024-03-28T11:37:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20238.169362 secs 2024-03-28T11:37:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:20 smithi086 ceph-mon[35163]: pgmap v11446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:20 smithi159 ceph-mon[36109]: pgmap v11446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:20 smithi055 ceph-mon[31863]: pgmap v11446: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:22 smithi086 ceph-mon[35163]: pgmap v11447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:22 smithi159 ceph-mon[36109]: pgmap v11447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:22 smithi055 ceph-mon[31863]: pgmap v11447: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20243.169484 secs 2024-03-28T11:37:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:24 smithi086 ceph-mon[35163]: pgmap v11448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20243.169484 secs 2024-03-28T11:37:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:24 smithi159 ceph-mon[36109]: pgmap v11448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20243.169484 secs 2024-03-28T11:37:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:24 smithi055 ceph-mon[31863]: pgmap v11448: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:26 smithi086 ceph-mon[35163]: pgmap v11449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:26 smithi159 ceph-mon[36109]: pgmap v11449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:26 smithi055 ceph-mon[31863]: pgmap v11449: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:28 smithi086 ceph-mon[35163]: pgmap v11450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:28 smithi159 ceph-mon[36109]: pgmap v11450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:28 smithi055 ceph-mon[31863]: pgmap v11450: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20248.169602 secs 2024-03-28T11:37:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20248.169602 secs 2024-03-28T11:37:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20248.169602 secs 2024-03-28T11:37:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:30 smithi086 ceph-mon[35163]: pgmap v11451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:30 smithi159 ceph-mon[36109]: pgmap v11451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:30 smithi055 ceph-mon[31863]: pgmap v11451: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:31 smithi086 ceph-mon[35163]: pgmap v11452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:31 smithi159 ceph-mon[36109]: pgmap v11452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:31 smithi055 ceph-mon[31863]: pgmap v11452: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20253.169725 secs 2024-03-28T11:37:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:34 smithi086 ceph-mon[35163]: pgmap v11453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20253.169725 secs 2024-03-28T11:37:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:34 smithi159 ceph-mon[36109]: pgmap v11453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20253.169725 secs 2024-03-28T11:37:34.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:34 smithi055 ceph-mon[31863]: pgmap v11453: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:36 smithi086 ceph-mon[35163]: pgmap v11454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:36 smithi159 ceph-mon[36109]: pgmap v11454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:36 smithi055 ceph-mon[31863]: pgmap v11454: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:38 smithi086 ceph-mon[35163]: pgmap v11455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:38 smithi159 ceph-mon[36109]: pgmap v11455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:38 smithi055 ceph-mon[31863]: pgmap v11455: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:39.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20258.169859 secs 2024-03-28T11:37:39.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20258.169859 secs 2024-03-28T11:37:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20258.169859 secs 2024-03-28T11:37:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:40 smithi086 ceph-mon[35163]: pgmap v11456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:40 smithi159 ceph-mon[36109]: pgmap v11456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:40 smithi055 ceph-mon[31863]: pgmap v11456: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:42 smithi086 ceph-mon[35163]: pgmap v11457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:42 smithi159 ceph-mon[36109]: pgmap v11457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:42 smithi055 ceph-mon[31863]: pgmap v11457: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20263.169979 secs 2024-03-28T11:37:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:44 smithi086 ceph-mon[35163]: pgmap v11458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20263.169979 secs 2024-03-28T11:37:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:44 smithi159 ceph-mon[36109]: pgmap v11458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20263.169979 secs 2024-03-28T11:37:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:44 smithi055 ceph-mon[31863]: pgmap v11458: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:46 smithi086 ceph-mon[35163]: pgmap v11459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:46.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:46 smithi159 ceph-mon[36109]: pgmap v11459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:46.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:46 smithi055 ceph-mon[31863]: pgmap v11459: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:48 smithi086 ceph-mon[35163]: pgmap v11460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:48 smithi159 ceph-mon[36109]: pgmap v11460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:48.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:48 smithi055 ceph-mon[31863]: pgmap v11460: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20268.170065 secs 2024-03-28T11:37:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20268.170065 secs 2024-03-28T11:37:49.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20268.170065 secs 2024-03-28T11:37:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:50 smithi086 ceph-mon[35163]: pgmap v11461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:50 smithi159 ceph-mon[36109]: pgmap v11461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:50.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:50 smithi055 ceph-mon[31863]: pgmap v11461: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:51 smithi086 ceph-mon[35163]: pgmap v11462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:51.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:51 smithi159 ceph-mon[36109]: pgmap v11462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:51.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:51 smithi055 ceph-mon[31863]: pgmap v11462: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20273.170102 secs 2024-03-28T11:37:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:54 smithi086 ceph-mon[35163]: pgmap v11463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:54 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:37:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20273.170102 secs 2024-03-28T11:37:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:54 smithi159 ceph-mon[36109]: pgmap v11463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:54 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:37:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20273.170102 secs 2024-03-28T11:37:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:54 smithi055 ceph-mon[31863]: pgmap v11463: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:37:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:54 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:37:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:55 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:55 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:55.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:55 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-28T11:37:56.524 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: pgmap v11464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:37:56.525 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:37:56.526 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: pgmap v11464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:37:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:37:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: Adjusting osd_memory_target on smithi159 to 176.8M 2024-03-28T11:37:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: Unable to set osd_memory_target on smithi159 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: pgmap v11464: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:37:56.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:37:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:57 smithi086 ceph-mon[35163]: pgmap v11465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:37:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:57 smithi086 ceph-mon[35163]: pgmap v11466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:37:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:57 smithi159 ceph-mon[36109]: pgmap v11465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:37:57.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:57 smithi159 ceph-mon[36109]: pgmap v11466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:37:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:57 smithi055 ceph-mon[31863]: pgmap v11465: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:37:57.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:57 smithi055 ceph-mon[31863]: pgmap v11466: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:37:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:59 smithi086 ceph-mon[35163]: pgmap v11467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:37:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:37:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20278.170199 secs 2024-03-28T11:37:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:59 smithi159 ceph-mon[36109]: pgmap v11467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:37:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:37:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20278.170199 secs 2024-03-28T11:37:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:59 smithi055 ceph-mon[31863]: pgmap v11467: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:37:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:37:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20278.170199 secs 2024-03-28T11:38:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:01 smithi086 ceph-mon[35163]: pgmap v11468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:01 smithi159 ceph-mon[36109]: pgmap v11468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:01.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:01 smithi055 ceph-mon[31863]: pgmap v11468: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:03 smithi086 ceph-mon[35163]: pgmap v11469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:03 smithi159 ceph-mon[36109]: pgmap v11469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:03 smithi055 ceph-mon[31863]: pgmap v11469: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:38:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20283.170277 secs 2024-03-28T11:38:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20283.170277 secs 2024-03-28T11:38:04.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20283.170277 secs 2024-03-28T11:38:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:05 smithi086 ceph-mon[35163]: pgmap v11470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:38:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:05 smithi159 ceph-mon[36109]: pgmap v11470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:38:05.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:05 smithi055 ceph-mon[31863]: pgmap v11470: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:38:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:06 smithi086 ceph-mon[35163]: pgmap v11471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:38:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:06 smithi159 ceph-mon[36109]: pgmap v11471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:38:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:06 smithi055 ceph-mon[31863]: pgmap v11471: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-03-28T11:38:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:08 smithi086 ceph-mon[35163]: pgmap v11472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:38:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20288.170398 secs 2024-03-28T11:38:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:08 smithi159 ceph-mon[36109]: pgmap v11472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:38:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20288.170398 secs 2024-03-28T11:38:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:08 smithi055 ceph-mon[31863]: pgmap v11472: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:38:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20288.170398 secs 2024-03-28T11:38:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:10 smithi086 ceph-mon[35163]: pgmap v11473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:10 smithi159 ceph-mon[36109]: pgmap v11473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:10 smithi055 ceph-mon[31863]: pgmap v11473: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:12 smithi086 ceph-mon[35163]: pgmap v11474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:12 smithi159 ceph-mon[36109]: pgmap v11474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:13.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:12 smithi055 ceph-mon[31863]: pgmap v11474: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20293.170515 secs 2024-03-28T11:38:14.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20293.170515 secs 2024-03-28T11:38:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20293.170515 secs 2024-03-28T11:38:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:14 smithi086 ceph-mon[35163]: pgmap v11475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:15.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:14 smithi159 ceph-mon[36109]: pgmap v11475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:14 smithi055 ceph-mon[31863]: pgmap v11475: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:38:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:16 smithi086 ceph-mon[35163]: pgmap v11476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:17.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:16 smithi159 ceph-mon[36109]: pgmap v11476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:16 smithi055 ceph-mon[31863]: pgmap v11476: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:18 smithi086 ceph-mon[35163]: pgmap v11477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20298.170636 secs 2024-03-28T11:38:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:18 smithi159 ceph-mon[36109]: pgmap v11477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:19.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20298.170636 secs 2024-03-28T11:38:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:18 smithi055 ceph-mon[31863]: pgmap v11477: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20298.170636 secs 2024-03-28T11:38:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:20 smithi086 ceph-mon[35163]: pgmap v11478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:21.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:20 smithi159 ceph-mon[36109]: pgmap v11478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:20 smithi055 ceph-mon[31863]: pgmap v11478: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:22 smithi086 ceph-mon[35163]: pgmap v11479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:23.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:22 smithi159 ceph-mon[36109]: pgmap v11479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:23.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:22 smithi055 ceph-mon[31863]: pgmap v11479: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20303.170754 secs 2024-03-28T11:38:24.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20303.170754 secs 2024-03-28T11:38:24.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20303.170754 secs 2024-03-28T11:38:25.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:24 smithi159 ceph-mon[36109]: pgmap v11480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:25.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:24 smithi055 ceph-mon[31863]: pgmap v11480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:24 smithi086 ceph-mon[35163]: pgmap v11480: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:27.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:26 smithi055 ceph-mon[31863]: pgmap v11481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:26 smithi086 ceph-mon[35163]: pgmap v11481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:26 smithi159 ceph-mon[36109]: pgmap v11481: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:28 smithi055 ceph-mon[31863]: pgmap v11482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:29.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20308.170875 secs 2024-03-28T11:38:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:28 smithi086 ceph-mon[35163]: pgmap v11482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20308.170875 secs 2024-03-28T11:38:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:28 smithi159 ceph-mon[36109]: pgmap v11482: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20308.170875 secs 2024-03-28T11:38:31.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:30 smithi055 ceph-mon[31863]: pgmap v11483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:30 smithi086 ceph-mon[35163]: pgmap v11483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:30 smithi159 ceph-mon[36109]: pgmap v11483: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:33.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:32 smithi055 ceph-mon[31863]: pgmap v11484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:32 smithi086 ceph-mon[35163]: pgmap v11484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:32 smithi159 ceph-mon[36109]: pgmap v11484: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:34.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20313.170939 secs 2024-03-28T11:38:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20313.170939 secs 2024-03-28T11:38:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20313.170939 secs 2024-03-28T11:38:35.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:34 smithi055 ceph-mon[31863]: pgmap v11485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:34 smithi086 ceph-mon[35163]: pgmap v11485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:34 smithi159 ceph-mon[36109]: pgmap v11485: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:37.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:36 smithi055 ceph-mon[31863]: pgmap v11486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:36 smithi086 ceph-mon[35163]: pgmap v11486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:36 smithi159 ceph-mon[36109]: pgmap v11486: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:38 smithi086 ceph-mon[35163]: pgmap v11487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20318.171025 secs 2024-03-28T11:38:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:38 smithi159 ceph-mon[36109]: pgmap v11487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20318.171025 secs 2024-03-28T11:38:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:38 smithi055 ceph-mon[31863]: pgmap v11487: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20318.171025 secs 2024-03-28T11:38:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:40 smithi086 ceph-mon[35163]: pgmap v11488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:40 smithi159 ceph-mon[36109]: pgmap v11488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:40 smithi055 ceph-mon[31863]: pgmap v11488: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:42 smithi086 ceph-mon[35163]: pgmap v11489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:42 smithi159 ceph-mon[36109]: pgmap v11489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:42 smithi055 ceph-mon[31863]: pgmap v11489: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20323.171158 secs 2024-03-28T11:38:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20323.171158 secs 2024-03-28T11:38:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20323.171158 secs 2024-03-28T11:38:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:44 smithi086 ceph-mon[35163]: pgmap v11490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:44 smithi159 ceph-mon[36109]: pgmap v11490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:44 smithi055 ceph-mon[31863]: pgmap v11490: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:46 smithi086 ceph-mon[35163]: pgmap v11491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:46 smithi159 ceph-mon[36109]: pgmap v11491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:46 smithi055 ceph-mon[31863]: pgmap v11491: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:48 smithi086 ceph-mon[35163]: pgmap v11492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20328.171265 secs 2024-03-28T11:38:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:48 smithi159 ceph-mon[36109]: pgmap v11492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20328.171265 secs 2024-03-28T11:38:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:48 smithi055 ceph-mon[31863]: pgmap v11492: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20328.171265 secs 2024-03-28T11:38:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:50 smithi086 ceph-mon[35163]: pgmap v11493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:50 smithi159 ceph-mon[36109]: pgmap v11493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:50 smithi055 ceph-mon[31863]: pgmap v11493: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:52 smithi086 ceph-mon[35163]: pgmap v11494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:52 smithi159 ceph-mon[36109]: pgmap v11494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:52 smithi055 ceph-mon[31863]: pgmap v11494: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20333.171385 secs 2024-03-28T11:38:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20333.171385 secs 2024-03-28T11:38:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20333.171385 secs 2024-03-28T11:38:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:54 smithi086 ceph-mon[35163]: pgmap v11495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:54 smithi159 ceph-mon[36109]: pgmap v11495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:54 smithi055 ceph-mon[31863]: pgmap v11495: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:56 smithi086 ceph-mon[35163]: pgmap v11496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:56 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:38:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:56 smithi159 ceph-mon[36109]: pgmap v11496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:56 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:38:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:56 smithi055 ceph-mon[31863]: pgmap v11496: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:38:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:56 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: pgmap v11497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20338.171482 secs 2024-03-28T11:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: pgmap v11498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: pgmap v11499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:38:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:38:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: pgmap v11497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20338.171482 secs 2024-03-28T11:38:59.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: pgmap v11498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: pgmap v11499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:38:59.571 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:38:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: pgmap v11497: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20338.171482 secs 2024-03-28T11:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:38:59.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: pgmap v11498: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-28T11:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: pgmap v11499: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:38:59.624 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:38:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:39:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:00 smithi086 ceph-mon[35163]: pgmap v11500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:00 smithi159 ceph-mon[36109]: pgmap v11500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:00 smithi055 ceph-mon[31863]: pgmap v11500: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:02 smithi086 ceph-mon[35163]: pgmap v11501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:02 smithi159 ceph-mon[36109]: pgmap v11501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:02 smithi055 ceph-mon[31863]: pgmap v11501: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20343.171532 secs 2024-03-28T11:39:03.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20343.171532 secs 2024-03-28T11:39:03.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20343.171532 secs 2024-03-28T11:39:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:04 smithi086 ceph-mon[35163]: pgmap v11502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:04 smithi159 ceph-mon[36109]: pgmap v11502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:04 smithi055 ceph-mon[31863]: pgmap v11502: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:39:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:06 smithi086 ceph-mon[35163]: pgmap v11503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:06 smithi159 ceph-mon[36109]: pgmap v11503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:06.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:06 smithi055 ceph-mon[31863]: pgmap v11503: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:39:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:08 smithi086 ceph-mon[35163]: pgmap v11504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:39:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:08 smithi159 ceph-mon[36109]: pgmap v11504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:39:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:08 smithi055 ceph-mon[31863]: pgmap v11504: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:39:09.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20348.171597 secs 2024-03-28T11:39:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20348.171597 secs 2024-03-28T11:39:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20348.171597 secs 2024-03-28T11:39:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:10 smithi055 ceph-mon[31863]: pgmap v11505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:10 smithi086 ceph-mon[35163]: pgmap v11505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:10.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:10 smithi159 ceph-mon[36109]: pgmap v11505: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:12 smithi086 ceph-mon[35163]: pgmap v11506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:12 smithi159 ceph-mon[36109]: pgmap v11506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:12 smithi055 ceph-mon[31863]: pgmap v11506: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20353.171661 secs 2024-03-28T11:39:13.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20353.171661 secs 2024-03-28T11:39:13.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20353.171661 secs 2024-03-28T11:39:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:14 smithi086 ceph-mon[35163]: pgmap v11507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:14.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:14 smithi159 ceph-mon[36109]: pgmap v11507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:14.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:14 smithi055 ceph-mon[31863]: pgmap v11507: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:16 smithi055 ceph-mon[31863]: pgmap v11508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:16 smithi086 ceph-mon[35163]: pgmap v11508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:16.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:16 smithi159 ceph-mon[36109]: pgmap v11508: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:18 smithi055 ceph-mon[31863]: pgmap v11509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:18 smithi086 ceph-mon[35163]: pgmap v11509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:18.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:18 smithi159 ceph-mon[36109]: pgmap v11509: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:19.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20358.171755 secs 2024-03-28T11:39:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20358.171755 secs 2024-03-28T11:39:19.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20358.171755 secs 2024-03-28T11:39:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:20 smithi055 ceph-mon[31863]: pgmap v11510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:20 smithi086 ceph-mon[35163]: pgmap v11510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:20.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:20 smithi159 ceph-mon[36109]: pgmap v11510: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:22 smithi055 ceph-mon[31863]: pgmap v11511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:22 smithi086 ceph-mon[35163]: pgmap v11511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:22.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:22 smithi159 ceph-mon[36109]: pgmap v11511: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20363.171858 secs 2024-03-28T11:39:23.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20363.171858 secs 2024-03-28T11:39:23.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20363.171858 secs 2024-03-28T11:39:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:24 smithi086 ceph-mon[35163]: pgmap v11512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:24.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:24 smithi159 ceph-mon[36109]: pgmap v11512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:24.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:24 smithi055 ceph-mon[31863]: pgmap v11512: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:26 smithi055 ceph-mon[31863]: pgmap v11513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:26 smithi086 ceph-mon[35163]: pgmap v11513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:26.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:26 smithi159 ceph-mon[36109]: pgmap v11513: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:28 smithi055 ceph-mon[31863]: pgmap v11514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:28 smithi086 ceph-mon[35163]: pgmap v11514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:28.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:28 smithi159 ceph-mon[36109]: pgmap v11514: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20368.171978 secs 2024-03-28T11:39:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20368.171978 secs 2024-03-28T11:39:29.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20368.171978 secs 2024-03-28T11:39:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:30 smithi055 ceph-mon[31863]: pgmap v11515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:30 smithi086 ceph-mon[35163]: pgmap v11515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:30.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:30 smithi159 ceph-mon[36109]: pgmap v11515: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:32 smithi055 ceph-mon[31863]: pgmap v11516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:32 smithi086 ceph-mon[35163]: pgmap v11516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:32.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:32 smithi159 ceph-mon[36109]: pgmap v11516: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20373.172070 secs 2024-03-28T11:39:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20373.172070 secs 2024-03-28T11:39:33.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20373.172070 secs 2024-03-28T11:39:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:34 smithi086 ceph-mon[35163]: pgmap v11517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:34 smithi159 ceph-mon[36109]: pgmap v11517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:34 smithi055 ceph-mon[31863]: pgmap v11517: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:36 smithi055 ceph-mon[31863]: pgmap v11518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:36 smithi086 ceph-mon[35163]: pgmap v11518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:36.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:36 smithi159 ceph-mon[36109]: pgmap v11518: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20378.172128 secs 2024-03-28T11:39:39.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:39 smithi055 ceph-mon[31863]: pgmap v11519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20378.172128 secs 2024-03-28T11:39:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:39 smithi086 ceph-mon[35163]: pgmap v11519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20378.172128 secs 2024-03-28T11:39:39.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:39 smithi159 ceph-mon[36109]: pgmap v11519: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:41.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:41 smithi055 ceph-mon[31863]: pgmap v11520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:41 smithi086 ceph-mon[35163]: pgmap v11520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:41.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:41 smithi159 ceph-mon[36109]: pgmap v11520: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:43.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:43 smithi055 ceph-mon[31863]: pgmap v11521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:43 smithi086 ceph-mon[35163]: pgmap v11521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:43.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:43 smithi159 ceph-mon[36109]: pgmap v11521: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20383.172246 secs 2024-03-28T11:39:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20383.172246 secs 2024-03-28T11:39:44.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20383.172246 secs 2024-03-28T11:39:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:45 smithi055 ceph-mon[31863]: pgmap v11522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:45 smithi086 ceph-mon[35163]: pgmap v11522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:45 smithi159 ceph-mon[36109]: pgmap v11522: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:47 smithi086 ceph-mon[35163]: pgmap v11523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:47.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:47 smithi159 ceph-mon[36109]: pgmap v11523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:47.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:47 smithi055 ceph-mon[31863]: pgmap v11523: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20388.172370 secs 2024-03-28T11:39:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:49 smithi086 ceph-mon[35163]: pgmap v11524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20388.172370 secs 2024-03-28T11:39:49.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:49 smithi159 ceph-mon[36109]: pgmap v11524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20388.172370 secs 2024-03-28T11:39:49.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:49 smithi055 ceph-mon[31863]: pgmap v11524: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:51 smithi086 ceph-mon[35163]: pgmap v11525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:51.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:51 smithi159 ceph-mon[36109]: pgmap v11525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:51.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:51 smithi055 ceph-mon[31863]: pgmap v11525: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:39:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:53 smithi086 ceph-mon[35163]: pgmap v11526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:53.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:53 smithi159 ceph-mon[36109]: pgmap v11526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:53.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:53 smithi055 ceph-mon[31863]: pgmap v11526: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:39:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20393.172483 secs 2024-03-28T11:39:54.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20393.172483 secs 2024-03-28T11:39:54.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20393.172483 secs 2024-03-28T11:39:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:55 smithi086 ceph-mon[35163]: pgmap v11527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:55.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:55 smithi159 ceph-mon[36109]: pgmap v11527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:55.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:55 smithi055 ceph-mon[31863]: pgmap v11527: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:57 smithi086 ceph-mon[35163]: pgmap v11528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:57.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:57 smithi159 ceph-mon[36109]: pgmap v11528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:57.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:57 smithi055 ceph-mon[31863]: pgmap v11528: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:58.774 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20398.172599 secs 2024-03-28T11:39:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20398.172599 secs 2024-03-28T11:39:58.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20398.172599 secs 2024-03-28T11:39:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:59 smithi086 ceph-mon[35163]: pgmap v11529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:39:59 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:39:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:59 smithi159 ceph-mon[36109]: pgmap v11529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:59.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:39:59 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:39:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:59 smithi055 ceph-mon[31863]: pgmap v11529: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:39:59.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:39:59 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:40:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:00 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:00 smithi086 ceph-mon[35163]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:40:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:00 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.820 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:00 smithi159 ceph-mon[36109]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:40:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:00 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:00.873 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:00 smithi055 ceph-mon[31863]: overall HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-03-28T11:40:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: pgmap v11530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:40:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:40:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:40:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: pgmap v11531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T11:40:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: pgmap v11532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:01 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: pgmap v11530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:40:02.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:40:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:40:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: pgmap v11531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T11:40:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: pgmap v11532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:02.070 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:01 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: pgmap v11530: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:40:02.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:40:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:40:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: pgmap v11531: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-03-28T11:40:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: pgmap v11532: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:02.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:01 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:40:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20403.172713 secs 2024-03-28T11:40:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:04 smithi055 ceph-mon[31863]: pgmap v11533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20403.172713 secs 2024-03-28T11:40:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:04 smithi086 ceph-mon[35163]: pgmap v11533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20403.172713 secs 2024-03-28T11:40:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:04 smithi159 ceph-mon[36109]: pgmap v11533: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:40:06.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:06 smithi055 ceph-mon[31863]: pgmap v11534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:06 smithi086 ceph-mon[35163]: pgmap v11534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:06.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:06 smithi159 ceph-mon[36109]: pgmap v11534: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:08.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:08 smithi055 ceph-mon[31863]: pgmap v11535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:08 smithi086 ceph-mon[35163]: pgmap v11535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:08 smithi159 ceph-mon[36109]: pgmap v11535: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20408.172816 secs 2024-03-28T11:40:09.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20408.172816 secs 2024-03-28T11:40:09.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20408.172816 secs 2024-03-28T11:40:10.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:10 smithi055 ceph-mon[31863]: pgmap v11536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T11:40:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:10 smithi086 ceph-mon[35163]: pgmap v11536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T11:40:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:10 smithi159 ceph-mon[36109]: pgmap v11536: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-03-28T11:40:12.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:12 smithi055 ceph-mon[31863]: pgmap v11537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:40:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:12 smithi086 ceph-mon[35163]: pgmap v11537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:40:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:12 smithi159 ceph-mon[36109]: pgmap v11537: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:40:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20413.172935 secs 2024-03-28T11:40:14.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:14 smithi055 ceph-mon[31863]: pgmap v11538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20413.172935 secs 2024-03-28T11:40:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:14 smithi086 ceph-mon[35163]: pgmap v11538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20413.172935 secs 2024-03-28T11:40:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:14 smithi159 ceph-mon[36109]: pgmap v11538: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:16.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:16 smithi055 ceph-mon[31863]: pgmap v11539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:16 smithi086 ceph-mon[35163]: pgmap v11539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:16 smithi159 ceph-mon[36109]: pgmap v11539: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:18 smithi086 ceph-mon[35163]: pgmap v11540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:18 smithi159 ceph-mon[36109]: pgmap v11540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:18 smithi055 ceph-mon[31863]: pgmap v11540: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20418.173018 secs 2024-03-28T11:40:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20418.173018 secs 2024-03-28T11:40:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20418.173018 secs 2024-03-28T11:40:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:20 smithi086 ceph-mon[35163]: pgmap v11541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:20 smithi159 ceph-mon[36109]: pgmap v11541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:20 smithi055 ceph-mon[31863]: pgmap v11541: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:22 smithi086 ceph-mon[35163]: pgmap v11542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:22 smithi159 ceph-mon[36109]: pgmap v11542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:22 smithi055 ceph-mon[31863]: pgmap v11542: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20423.173138 secs 2024-03-28T11:40:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:24 smithi086 ceph-mon[35163]: pgmap v11543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20423.173138 secs 2024-03-28T11:40:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:24 smithi159 ceph-mon[36109]: pgmap v11543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20423.173138 secs 2024-03-28T11:40:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:24 smithi055 ceph-mon[31863]: pgmap v11543: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:26 smithi086 ceph-mon[35163]: pgmap v11544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:26 smithi159 ceph-mon[36109]: pgmap v11544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:26 smithi055 ceph-mon[31863]: pgmap v11544: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:28.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:28 smithi055 ceph-mon[31863]: pgmap v11545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:28 smithi086 ceph-mon[35163]: pgmap v11545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:28 smithi159 ceph-mon[36109]: pgmap v11545: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20428.173256 secs 2024-03-28T11:40:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20428.173256 secs 2024-03-28T11:40:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20428.173256 secs 2024-03-28T11:40:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:30 smithi086 ceph-mon[35163]: pgmap v11546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:30 smithi159 ceph-mon[36109]: pgmap v11546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:30 smithi055 ceph-mon[31863]: pgmap v11546: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:32 smithi086 ceph-mon[35163]: pgmap v11547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:32 smithi159 ceph-mon[36109]: pgmap v11547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:32 smithi055 ceph-mon[31863]: pgmap v11547: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20433.173329 secs 2024-03-28T11:40:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:34 smithi086 ceph-mon[35163]: pgmap v11548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20433.173329 secs 2024-03-28T11:40:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:34 smithi159 ceph-mon[36109]: pgmap v11548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20433.173329 secs 2024-03-28T11:40:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:34 smithi055 ceph-mon[31863]: pgmap v11548: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:36 smithi086 ceph-mon[35163]: pgmap v11549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:36.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:36 smithi159 ceph-mon[36109]: pgmap v11549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:36.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:36 smithi055 ceph-mon[31863]: pgmap v11549: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:38 smithi086 ceph-mon[35163]: pgmap v11550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:38 smithi159 ceph-mon[36109]: pgmap v11550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:38 smithi055 ceph-mon[31863]: pgmap v11550: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20438.173451 secs 2024-03-28T11:40:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20438.173451 secs 2024-03-28T11:40:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20438.173451 secs 2024-03-28T11:40:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:40 smithi086 ceph-mon[35163]: pgmap v11551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:40 smithi159 ceph-mon[36109]: pgmap v11551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:40 smithi055 ceph-mon[31863]: pgmap v11551: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:42 smithi086 ceph-mon[35163]: pgmap v11552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:42 smithi159 ceph-mon[36109]: pgmap v11552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:42 smithi055 ceph-mon[31863]: pgmap v11552: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:44 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20443.173573 secs 2024-03-28T11:40:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:44 smithi086 ceph-mon[35163]: pgmap v11553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:44 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20443.173573 secs 2024-03-28T11:40:44.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:44 smithi159 ceph-mon[36109]: pgmap v11553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:44 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20443.173573 secs 2024-03-28T11:40:44.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:44 smithi055 ceph-mon[31863]: pgmap v11553: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:45.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:45 smithi055 ceph-mon[31863]: pgmap v11554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:45 smithi086 ceph-mon[35163]: pgmap v11554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:45.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:45 smithi159 ceph-mon[36109]: pgmap v11554: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:48.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:48 smithi055 ceph-mon[31863]: pgmap v11555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:48 smithi086 ceph-mon[35163]: pgmap v11555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:48.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:48 smithi159 ceph-mon[36109]: pgmap v11555: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20448.173637 secs 2024-03-28T11:40:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20448.173637 secs 2024-03-28T11:40:49.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20448.173637 secs 2024-03-28T11:40:50.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:50 smithi055 ceph-mon[31863]: pgmap v11556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:50 smithi086 ceph-mon[35163]: pgmap v11556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:50.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:50 smithi159 ceph-mon[36109]: pgmap v11556: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:52 smithi086 ceph-mon[35163]: pgmap v11557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:52.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:52 smithi159 ceph-mon[36109]: pgmap v11557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:52.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:52 smithi055 ceph-mon[31863]: pgmap v11557: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20453.173763 secs 2024-03-28T11:40:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:54 smithi086 ceph-mon[35163]: pgmap v11558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20453.173763 secs 2024-03-28T11:40:54.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:54 smithi159 ceph-mon[36109]: pgmap v11558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20453.173763 secs 2024-03-28T11:40:54.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:54 smithi055 ceph-mon[31863]: pgmap v11558: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:56 smithi086 ceph-mon[35163]: pgmap v11559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:56.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:56 smithi159 ceph-mon[36109]: pgmap v11559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:56.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:56 smithi055 ceph-mon[31863]: pgmap v11559: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:40:58.425 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:58 smithi055 ceph-mon[31863]: pgmap v11560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:58 smithi086 ceph-mon[35163]: pgmap v11560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:58.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:58 smithi159 ceph-mon[36109]: pgmap v11560: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:40:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:40:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20458.173883 secs 2024-03-28T11:40:59.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:40:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20458.173883 secs 2024-03-28T11:40:59.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:40:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20458.173883 secs 2024-03-28T11:41:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:00 smithi086 ceph-mon[35163]: pgmap v11561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:00.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:00 smithi159 ceph-mon[36109]: pgmap v11561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:00.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:00 smithi055 ceph-mon[31863]: pgmap v11561: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:02 smithi086 ceph-mon[35163]: pgmap v11562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:02 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:41:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:02 smithi159 ceph-mon[36109]: pgmap v11562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:02.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:02 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:41:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:02 smithi055 ceph-mon[31863]: pgmap v11562: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:02.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:02 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:41:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:03 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:03 smithi055 ceph-mon[31863]: pgmap v11563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:03.750 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.750 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:03 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.750 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:03 smithi159 ceph-mon[36109]: pgmap v11563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:03 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:03 smithi086 ceph-mon[35163]: pgmap v11563: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20463.173959 secs 2024-03-28T11:41:04.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20463.173959 secs 2024-03-28T11:41:04.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20463.173959 secs 2024-03-28T11:41:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:05 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:05 smithi086 ceph-mon[35163]: pgmap v11564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:05 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:05 smithi159 ceph-mon[36109]: pgmap v11564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:06.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:05 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:06.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:05 smithi055 ceph-mon[31863]: pgmap v11564: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:07 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:07 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:07.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:07 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:08 smithi086 ceph-mon[35163]: pgmap v11565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:41:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:41:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:41:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:08 smithi159 ceph-mon[36109]: pgmap v11565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:41:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:41:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:41:08.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:08 smithi055 ceph-mon[31863]: pgmap v11565: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:41:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:41:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:41:08.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:41:09.468 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:09 smithi086 ceph-mon[35163]: pgmap v11566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:41:09.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:09 smithi086 ceph-mon[35163]: pgmap v11567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:09.469 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20468.174069 secs 2024-03-28T11:41:09.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:09 smithi159 ceph-mon[36109]: pgmap v11566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:41:09.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:09 smithi159 ceph-mon[36109]: pgmap v11567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:09.472 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20468.174069 secs 2024-03-28T11:41:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:09 smithi055 ceph-mon[31863]: pgmap v11566: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-03-28T11:41:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:09 smithi055 ceph-mon[31863]: pgmap v11567: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:09.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20468.174069 secs 2024-03-28T11:41:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:11 smithi086 ceph-mon[35163]: pgmap v11568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:11.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:11 smithi159 ceph-mon[36109]: pgmap v11568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:11 smithi055 ceph-mon[31863]: pgmap v11568: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:13 smithi086 ceph-mon[35163]: pgmap v11569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:13.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:13 smithi159 ceph-mon[36109]: pgmap v11569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:13.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:13 smithi055 ceph-mon[31863]: pgmap v11569: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-03-28T11:41:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20473.174140 secs 2024-03-28T11:41:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20473.174140 secs 2024-03-28T11:41:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20473.174140 secs 2024-03-28T11:41:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:15 smithi086 ceph-mon[35163]: pgmap v11570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:41:15.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:15 smithi159 ceph-mon[36109]: pgmap v11570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:41:15.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:15 smithi055 ceph-mon[31863]: pgmap v11570: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-03-28T11:41:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:17 smithi086 ceph-mon[35163]: pgmap v11571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:41:17.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:17 smithi159 ceph-mon[36109]: pgmap v11571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:41:17.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:17 smithi055 ceph-mon[31863]: pgmap v11571: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-03-28T11:41:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:19 smithi086 ceph-mon[35163]: pgmap v11572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:41:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20478.174235 secs 2024-03-28T11:41:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:19 smithi159 ceph-mon[36109]: pgmap v11572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:41:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20478.174235 secs 2024-03-28T11:41:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:19 smithi055 ceph-mon[31863]: pgmap v11572: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:41:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20478.174235 secs 2024-03-28T11:41:21.537 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:21 smithi159 ceph-mon[36109]: pgmap v11573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:21 smithi086 ceph-mon[35163]: pgmap v11573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:21.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:21 smithi055 ceph-mon[31863]: pgmap v11573: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:23 smithi086 ceph-mon[35163]: pgmap v11574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:23.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:23 smithi159 ceph-mon[36109]: pgmap v11574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:23.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:23 smithi055 ceph-mon[31863]: pgmap v11574: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20483.174356 secs 2024-03-28T11:41:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20483.174356 secs 2024-03-28T11:41:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20483.174356 secs 2024-03-28T11:41:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:25 smithi086 ceph-mon[35163]: pgmap v11575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:25.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:25 smithi159 ceph-mon[36109]: pgmap v11575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:25.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:25 smithi055 ceph-mon[31863]: pgmap v11575: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:27 smithi086 ceph-mon[35163]: pgmap v11576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:27.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:27 smithi159 ceph-mon[36109]: pgmap v11576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:27.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:27 smithi055 ceph-mon[31863]: pgmap v11576: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:29 smithi086 ceph-mon[35163]: pgmap v11577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20488.174483 secs 2024-03-28T11:41:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:29 smithi159 ceph-mon[36109]: pgmap v11577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20488.174483 secs 2024-03-28T11:41:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:29 smithi055 ceph-mon[31863]: pgmap v11577: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20488.174483 secs 2024-03-28T11:41:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:31 smithi086 ceph-mon[35163]: pgmap v11578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:31.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:31 smithi159 ceph-mon[36109]: pgmap v11578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:31.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:31 smithi055 ceph-mon[31863]: pgmap v11578: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:33 smithi086 ceph-mon[35163]: pgmap v11579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:33.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:33 smithi159 ceph-mon[36109]: pgmap v11579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:33 smithi055 ceph-mon[31863]: pgmap v11579: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20493.174609 secs 2024-03-28T11:41:34.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20493.174609 secs 2024-03-28T11:41:34.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20493.174609 secs 2024-03-28T11:41:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:35 smithi086 ceph-mon[35163]: pgmap v11580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:35.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:35 smithi159 ceph-mon[36109]: pgmap v11580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:35.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:35 smithi055 ceph-mon[31863]: pgmap v11580: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:37 smithi086 ceph-mon[35163]: pgmap v11581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:37.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:37 smithi159 ceph-mon[36109]: pgmap v11581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:37.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:37 smithi055 ceph-mon[31863]: pgmap v11581: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:39 smithi086 ceph-mon[35163]: pgmap v11582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20498.174743 secs 2024-03-28T11:41:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:39 smithi159 ceph-mon[36109]: pgmap v11582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:39.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20498.174743 secs 2024-03-28T11:41:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:39 smithi055 ceph-mon[31863]: pgmap v11582: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20498.174743 secs 2024-03-28T11:41:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:40 smithi055 ceph-mon[31863]: pgmap v11583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:40 smithi086 ceph-mon[35163]: pgmap v11583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:40.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:40 smithi159 ceph-mon[36109]: pgmap v11583: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:42 smithi086 ceph-mon[35163]: pgmap v11584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:43.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:42 smithi159 ceph-mon[36109]: pgmap v11584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:43.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:42 smithi055 ceph-mon[31863]: pgmap v11584: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20503.174887 secs 2024-03-28T11:41:44.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20503.174887 secs 2024-03-28T11:41:44.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20503.174887 secs 2024-03-28T11:41:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:44 smithi086 ceph-mon[35163]: pgmap v11585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:45.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:44 smithi159 ceph-mon[36109]: pgmap v11585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:45.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:44 smithi055 ceph-mon[31863]: pgmap v11585: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:46 smithi086 ceph-mon[35163]: pgmap v11586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:47.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:46 smithi159 ceph-mon[36109]: pgmap v11586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:47.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:46 smithi055 ceph-mon[31863]: pgmap v11586: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:48 smithi086 ceph-mon[35163]: pgmap v11587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:48 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20508.175021 secs 2024-03-28T11:41:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:48 smithi159 ceph-mon[36109]: pgmap v11587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:49.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:48 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20508.175021 secs 2024-03-28T11:41:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:48 smithi055 ceph-mon[31863]: pgmap v11587: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:49.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:48 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20508.175021 secs 2024-03-28T11:41:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:50 smithi086 ceph-mon[35163]: pgmap v11588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:51.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:50 smithi159 ceph-mon[36109]: pgmap v11588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:51.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:50 smithi055 ceph-mon[31863]: pgmap v11588: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:52 smithi086 ceph-mon[35163]: pgmap v11589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:53.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:52 smithi159 ceph-mon[36109]: pgmap v11589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:53.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:52 smithi055 ceph-mon[31863]: pgmap v11589: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:53 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20513.175109 secs 2024-03-28T11:41:54.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:53 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20513.175109 secs 2024-03-28T11:41:54.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:53 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20513.175109 secs 2024-03-28T11:41:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:54 smithi086 ceph-mon[35163]: pgmap v11590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:55.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:54 smithi159 ceph-mon[36109]: pgmap v11590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:55.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:54 smithi055 ceph-mon[31863]: pgmap v11590: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:41:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:56 smithi086 ceph-mon[35163]: pgmap v11591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:57.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:56 smithi159 ceph-mon[36109]: pgmap v11591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:57.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:56 smithi055 ceph-mon[31863]: pgmap v11591: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:41:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:58 smithi086 ceph-mon[35163]: pgmap v11592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:41:58 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20518.175232 secs 2024-03-28T11:41:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:58 smithi159 ceph-mon[36109]: pgmap v11592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:59.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:41:58 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20518.175232 secs 2024-03-28T11:41:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:58 smithi055 ceph-mon[31863]: pgmap v11592: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:41:59.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:41:58 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20518.175232 secs 2024-03-28T11:42:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:00 smithi086 ceph-mon[35163]: pgmap v11593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:01.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:00 smithi159 ceph-mon[36109]: pgmap v11593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:01.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:00 smithi055 ceph-mon[31863]: pgmap v11593: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:02 smithi086 ceph-mon[35163]: pgmap v11594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:03.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:02 smithi159 ceph-mon[36109]: pgmap v11594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:03.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:02 smithi055 ceph-mon[31863]: pgmap v11594: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:03 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20523.175352 secs 2024-03-28T11:42:04.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:03 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20523.175352 secs 2024-03-28T11:42:04.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:03 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20523.175352 secs 2024-03-28T11:42:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:04 smithi086 ceph-mon[35163]: pgmap v11595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:05.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:04 smithi159 ceph-mon[36109]: pgmap v11595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:05.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:04 smithi055 ceph-mon[31863]: pgmap v11595: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:06 smithi086 ceph-mon[35163]: pgmap v11596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:07.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:06 smithi159 ceph-mon[36109]: pgmap v11596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:07.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:06 smithi055 ceph-mon[31863]: pgmap v11596: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:08 smithi086 ceph-mon[35163]: pgmap v11597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:08 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20528.175430 secs 2024-03-28T11:42:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:08 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:42:09.068 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:08 smithi159 ceph-mon[36109]: pgmap v11597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:08 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20528.175430 secs 2024-03-28T11:42:09.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:08 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:42:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:08 smithi055 ceph-mon[31863]: pgmap v11597: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:08 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20528.175430 secs 2024-03-28T11:42:09.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:08 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:42:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:42:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:42:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:09 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:42:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:42:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:42:10.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:09 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:42:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:42:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:42:10.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:09 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:42:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:10 smithi086 ceph-mon[35163]: pgmap v11598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:10 smithi086 ceph-mon[35163]: pgmap v11599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:10 smithi159 ceph-mon[36109]: pgmap v11598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:11.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:10 smithi159 ceph-mon[36109]: pgmap v11599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:10 smithi055 ceph-mon[31863]: pgmap v11598: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:11.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:10 smithi055 ceph-mon[31863]: pgmap v11599: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:12 smithi086 ceph-mon[35163]: pgmap v11600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:13.069 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:12 smithi159 ceph-mon[36109]: pgmap v11600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:13.123 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:12 smithi055 ceph-mon[31863]: pgmap v11600: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:14.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:13 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20533.175560 secs 2024-03-28T11:42:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:13 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20533.175560 secs 2024-03-28T11:42:14.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:13 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20533.175560 secs 2024-03-28T11:42:15.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:14 smithi055 ceph-mon[31863]: pgmap v11601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:14 smithi086 ceph-mon[35163]: pgmap v11601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:15.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:14 smithi159 ceph-mon[36109]: pgmap v11601: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:17.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:16 smithi055 ceph-mon[31863]: pgmap v11602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:16 smithi086 ceph-mon[35163]: pgmap v11602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:17.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:16 smithi159 ceph-mon[36109]: pgmap v11602: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:18 smithi055 ceph-mon[31863]: pgmap v11603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:19.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:18 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20538.175687 secs 2024-03-28T11:42:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:18 smithi086 ceph-mon[35163]: pgmap v11603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:18 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20538.175687 secs 2024-03-28T11:42:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:18 smithi159 ceph-mon[36109]: pgmap v11603: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-03-28T11:42:19.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:18 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20538.175687 secs 2024-03-28T11:42:21.122 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:20 smithi055 ceph-mon[31863]: pgmap v11604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:42:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:20 smithi086 ceph-mon[35163]: pgmap v11604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:42:21.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:20 smithi159 ceph-mon[36109]: pgmap v11604: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:42:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:22 smithi086 ceph-mon[35163]: pgmap v11605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:23.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:22 smithi159 ceph-mon[36109]: pgmap v11605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:23.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:22 smithi055 ceph-mon[31863]: pgmap v11605: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:23 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20543.175712 secs 2024-03-28T11:42:24.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:23 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20543.175712 secs 2024-03-28T11:42:24.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:23 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20543.175712 secs 2024-03-28T11:42:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:24 smithi086 ceph-mon[35163]: pgmap v11606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:25.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:24 smithi159 ceph-mon[36109]: pgmap v11606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:25.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:24 smithi055 ceph-mon[31863]: pgmap v11606: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:26 smithi086 ceph-mon[35163]: pgmap v11607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:27.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:26 smithi159 ceph-mon[36109]: pgmap v11607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:27.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:26 smithi055 ceph-mon[31863]: pgmap v11607: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:28 smithi086 ceph-mon[35163]: pgmap v11608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:28 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20548.175802 secs 2024-03-28T11:42:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:28 smithi159 ceph-mon[36109]: pgmap v11608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:29.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:28 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20548.175802 secs 2024-03-28T11:42:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:28 smithi055 ceph-mon[31863]: pgmap v11608: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:29.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:28 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20548.175802 secs 2024-03-28T11:42:31.174 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:30 smithi055 ceph-mon[31863]: pgmap v11609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:30 smithi086 ceph-mon[35163]: pgmap v11609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:31.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:30 smithi159 ceph-mon[36109]: pgmap v11609: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:32 smithi086 ceph-mon[35163]: pgmap v11610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:33.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:32 smithi159 ceph-mon[36109]: pgmap v11610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:33.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:32 smithi055 ceph-mon[31863]: pgmap v11610: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:33 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20553.175922 secs 2024-03-28T11:42:34.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:33 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20553.175922 secs 2024-03-28T11:42:34.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:33 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20553.175922 secs 2024-03-28T11:42:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:34 smithi086 ceph-mon[35163]: pgmap v11611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:35.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:34 smithi159 ceph-mon[36109]: pgmap v11611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:35.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:34 smithi055 ceph-mon[31863]: pgmap v11611: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:36 smithi086 ceph-mon[35163]: pgmap v11612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:37.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:36 smithi159 ceph-mon[36109]: pgmap v11612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:37.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:36 smithi055 ceph-mon[31863]: pgmap v11612: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:38 smithi086 ceph-mon[35163]: pgmap v11613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:38 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20558.176020 secs 2024-03-28T11:42:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:38 smithi159 ceph-mon[36109]: pgmap v11613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:39.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:38 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20558.176020 secs 2024-03-28T11:42:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:38 smithi055 ceph-mon[31863]: pgmap v11613: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:39.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:38 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20558.176020 secs 2024-03-28T11:42:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:40 smithi086 ceph-mon[35163]: pgmap v11614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:41.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:40 smithi159 ceph-mon[36109]: pgmap v11614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:41.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:40 smithi055 ceph-mon[31863]: pgmap v11614: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:42 smithi086 ceph-mon[35163]: pgmap v11615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:43.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:42 smithi159 ceph-mon[36109]: pgmap v11615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:43.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:42 smithi055 ceph-mon[31863]: pgmap v11615: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:43 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20563.176112 secs 2024-03-28T11:42:44.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:43 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20563.176112 secs 2024-03-28T11:42:44.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:43 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20563.176112 secs 2024-03-28T11:42:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:44 smithi086 ceph-mon[35163]: pgmap v11616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:45.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:44 smithi159 ceph-mon[36109]: pgmap v11616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:45.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:44 smithi055 ceph-mon[31863]: pgmap v11616: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:46 smithi086 ceph-mon[35163]: pgmap v11617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:47.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:46 smithi159 ceph-mon[36109]: pgmap v11617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:47.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:46 smithi055 ceph-mon[31863]: pgmap v11617: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:49 smithi086 ceph-mon[35163]: pgmap v11618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:49 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20568.176209 secs 2024-03-28T11:42:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:49 smithi159 ceph-mon[36109]: pgmap v11618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:49.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:49 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20568.176209 secs 2024-03-28T11:42:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:49 smithi055 ceph-mon[31863]: pgmap v11618: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:49.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:49 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20568.176209 secs 2024-03-28T11:42:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:51 smithi086 ceph-mon[35163]: pgmap v11619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:51.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:51 smithi159 ceph-mon[36109]: pgmap v11619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:51.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:51 smithi055 ceph-mon[31863]: pgmap v11619: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:53 smithi086 ceph-mon[35163]: pgmap v11620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:53.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:53 smithi159 ceph-mon[36109]: pgmap v11620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:53.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:53 smithi055 ceph-mon[31863]: pgmap v11620: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:54 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20573.176272 secs 2024-03-28T11:42:54.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:54 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20573.176272 secs 2024-03-28T11:42:54.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:54 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20573.176272 secs 2024-03-28T11:42:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:55 smithi086 ceph-mon[35163]: pgmap v11621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:55.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:55 smithi159 ceph-mon[36109]: pgmap v11621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:55.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:55 smithi055 ceph-mon[31863]: pgmap v11621: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:42:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:57 smithi086 ceph-mon[35163]: pgmap v11622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:57.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:57 smithi159 ceph-mon[36109]: pgmap v11622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:57.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:57 smithi055 ceph-mon[31863]: pgmap v11622: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:42:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:59 smithi086 ceph-mon[35163]: pgmap v11623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:42:59 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20578.176334 secs 2024-03-28T11:42:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:59 smithi159 ceph-mon[36109]: pgmap v11623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:59.319 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:42:59 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20578.176334 secs 2024-03-28T11:42:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:59 smithi055 ceph-mon[31863]: pgmap v11623: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:42:59.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:42:59 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20578.176334 secs 2024-03-28T11:43:01.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:01 smithi055 ceph-mon[31863]: pgmap v11624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:01 smithi086 ceph-mon[35163]: pgmap v11624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:01.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:01 smithi159 ceph-mon[36109]: pgmap v11624: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:03.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:03 smithi055 ceph-mon[31863]: pgmap v11625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:03 smithi086 ceph-mon[35163]: pgmap v11625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:03.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:03 smithi159 ceph-mon[36109]: pgmap v11625: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:04.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:04 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20583.176400 secs 2024-03-28T11:43:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:04 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20583.176400 secs 2024-03-28T11:43:04.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:04 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20583.176400 secs 2024-03-28T11:43:05.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:05 smithi055 ceph-mon[31863]: pgmap v11626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:05 smithi086 ceph-mon[35163]: pgmap v11626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:05.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:05 smithi159 ceph-mon[36109]: pgmap v11626: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:07.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:07 smithi055 ceph-mon[31863]: pgmap v11627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:43:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:07 smithi086 ceph-mon[35163]: pgmap v11627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:43:07.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:07 smithi159 ceph-mon[36109]: pgmap v11627: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-03-28T11:43:09.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:09 smithi086 ceph-mon[35163]: pgmap v11628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:09.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:09 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20588.176465 secs 2024-03-28T11:43:09.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:09 smithi159 ceph-mon[36109]: pgmap v11628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:09.372 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:09 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20588.176465 secs 2024-03-28T11:43:09.372 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:09 smithi055 ceph-mon[31863]: pgmap v11628: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:09.373 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:09 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20588.176465 secs 2024-03-28T11:43:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:10 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:43:10.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:10 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:43:10.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:10 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-28T11:43:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:11 smithi086 ceph-mon[35163]: pgmap v11629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:11.568 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:11 smithi159 ceph-mon[36109]: pgmap v11629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:11.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:11 smithi055 ceph-mon[31863]: pgmap v11629: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:43:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:43:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:12 smithi086 ceph-mon[35163]: pgmap v11630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:12 smithi086 ceph-mon[35163]: pgmap v11631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:12 smithi086 ceph-mon[35163]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:43:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:43:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:43:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:12 smithi159 ceph-mon[36109]: pgmap v11630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:12 smithi159 ceph-mon[36109]: pgmap v11631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.570 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:12 smithi159 ceph-mon[36109]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:43:12.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-28T11:43:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-28T11:43:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:12 smithi055 ceph-mon[31863]: pgmap v11630: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:12 smithi055 ceph-mon[31863]: pgmap v11631: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:12.623 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:12 smithi055 ceph-mon[31863]: from='mgr.14152 172.21.15.55:0/3226660006' entity='mgr.x' 2024-03-28T11:43:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:14 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20593.176529 secs 2024-03-28T11:43:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:14 smithi086 ceph-mon[35163]: pgmap v11632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:14 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20593.176529 secs 2024-03-28T11:43:14.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:14 smithi159 ceph-mon[36109]: pgmap v11632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:14 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20593.176529 secs 2024-03-28T11:43:14.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:14 smithi055 ceph-mon[31863]: pgmap v11632: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:16 smithi086 ceph-mon[35163]: pgmap v11633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:43:16.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:16 smithi159 ceph-mon[36109]: pgmap v11633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:43:16.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:16 smithi055 ceph-mon[31863]: pgmap v11633: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-03-28T11:43:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:18 smithi086 ceph-mon[35163]: pgmap v11634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:18.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:18 smithi159 ceph-mon[36109]: pgmap v11634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:18.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:18 smithi055 ceph-mon[31863]: pgmap v11634: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:19 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20598.176648 secs 2024-03-28T11:43:19.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:19 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20598.176648 secs 2024-03-28T11:43:19.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:19 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20598.176648 secs 2024-03-28T11:43:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:20 smithi086 ceph-mon[35163]: pgmap v11635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:20.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:20 smithi159 ceph-mon[36109]: pgmap v11635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:20.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:20 smithi055 ceph-mon[31863]: pgmap v11635: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:22 smithi086 ceph-mon[35163]: pgmap v11636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:43:22.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:22 smithi159 ceph-mon[36109]: pgmap v11636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:43:22.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:22 smithi055 ceph-mon[31863]: pgmap v11636: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-03-28T11:43:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:24 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20603.176720 secs 2024-03-28T11:43:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:24 smithi086 ceph-mon[35163]: pgmap v11637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:24 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20603.176720 secs 2024-03-28T11:43:24.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:24 smithi159 ceph-mon[36109]: pgmap v11637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:24 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20603.176720 secs 2024-03-28T11:43:24.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:24 smithi055 ceph-mon[31863]: pgmap v11637: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:26 smithi086 ceph-mon[35163]: pgmap v11638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:26.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:26 smithi159 ceph-mon[36109]: pgmap v11638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:26.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:26 smithi055 ceph-mon[31863]: pgmap v11638: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:28 smithi086 ceph-mon[35163]: pgmap v11639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:28.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:28 smithi159 ceph-mon[36109]: pgmap v11639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:28.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:28 smithi055 ceph-mon[31863]: pgmap v11639: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:29 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20608.176826 secs 2024-03-28T11:43:29.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:29 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20608.176826 secs 2024-03-28T11:43:29.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:29 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20608.176826 secs 2024-03-28T11:43:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:30 smithi086 ceph-mon[35163]: pgmap v11640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:30.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:30 smithi159 ceph-mon[36109]: pgmap v11640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:30.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:30 smithi055 ceph-mon[31863]: pgmap v11640: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:32 smithi086 ceph-mon[35163]: pgmap v11641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:32.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:32 smithi159 ceph-mon[36109]: pgmap v11641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:32.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:32 smithi055 ceph-mon[31863]: pgmap v11641: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:33.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:33 smithi055 ceph-mon[31863]: pgmap v11642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:33 smithi086 ceph-mon[35163]: pgmap v11642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:33.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:33 smithi159 ceph-mon[36109]: pgmap v11642: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:34 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20613.176950 secs 2024-03-28T11:43:34.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:34 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20613.176950 secs 2024-03-28T11:43:34.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:34 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20613.176950 secs 2024-03-28T11:43:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:35 smithi086 ceph-mon[35163]: pgmap v11643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:35.819 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:35 smithi159 ceph-mon[36109]: pgmap v11643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:35.872 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:35 smithi055 ceph-mon[31863]: pgmap v11643: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-03-28T11:43:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:38 smithi086 ceph-mon[35163]: pgmap v11644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:38.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:38 smithi159 ceph-mon[36109]: pgmap v11644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:38.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:38 smithi055 ceph-mon[31863]: pgmap v11644: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:39.468 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:39 smithi086 ceph-mon[35163]: 1 slow requests, 0 included below; oldest blocked for > 20618.177018 secs 2024-03-28T11:43:39.471 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:39 smithi159 ceph-mon[36109]: 1 slow requests, 0 included below; oldest blocked for > 20618.177018 secs 2024-03-28T11:43:39.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:39 smithi055 ceph-mon[31863]: 1 slow requests, 0 included below; oldest blocked for > 20618.177018 secs 2024-03-28T11:43:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:40 smithi086 ceph-mon[35163]: pgmap v11645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:40.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:40 smithi159 ceph-mon[36109]: pgmap v11645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:40.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:40 smithi055 ceph-mon[31863]: pgmap v11645: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Mar 28 11:43:42 smithi086 ceph-mon[35163]: pgmap v11646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:42.569 INFO:journalctl@ceph.mon.c.smithi159.stdout:Mar 28 11:43:42 smithi159 ceph-mon[36109]: pgmap v11646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:42.622 INFO:journalctl@ceph.mon.a.smithi055.stdout:Mar 28 11:43:42 smithi055 ceph-mon[31863]: pgmap v11646: 97 pgs: 97 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-03-28T11:43:43.396 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-03-28T11:43:43.396 DEBUG:teuthology.task.console_log:Killing console logger for smithi055 2024-03-28T11:43:43.397 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2024-03-28T11:43:43.397 DEBUG:teuthology.task.console_log:Killing console logger for smithi159 2024-03-28T11:43:43.398 DEBUG:teuthology.exit:Finished running handlers